2024-03-04T12:08:39.332 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-03-04T12:08:39.332 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_prsrivas@teuthology --name prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi --archive /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061 --description rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} --verbose -- /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061/orig.config.yaml 2024-03-04T12:08:39.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T12:08:39.468 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061 branch: wip-rgw-d4n description: rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7581061' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rgw-d4n ceph: conf: client: debug rgw: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: 3aec390336fdfdc8f927818b718cfb0361bd47c8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3aec390336fdfdc8f927818b718cfb0361bd47c8 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: false frontend: beast storage classes: LUKEWARM, FROZEN s3tests: force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-d4n sha1: 3aec390336fdfdc8f927818b718cfb0361bd47c8 owner: scheduled_prsrivas@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 3236 sha1: 3aec390336fdfdc8f927818b718cfb0361bd47c8 sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-d4n suite_path: /home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa suite_relpath: qa suite_repo: https://github.com/pritha-srivastava/ceph.git suite_sha1: 3aec390336fdfdc8f927818b718cfb0361bd47c8 targets: smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBRfxsTEaInW4UE6C9MmpTeTftsY07BxFw+QHknsPlzJEsYaBqKH1/w6i4fnuuqmlG5TlNfR0V82yyQyIxUQw3c= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8psj+oSZ4kKEr2fYTgbk/TQycVVgPqXLGrcVm/ZViu2EK3wAHNTdYNTXzagMCg0rVKK2nQNd+8fX6dZRPRd7A= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-03-04_08:28:53 tube: smithi user: prsrivas verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-04T12:08:39.468 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa; will attempt to use it 2024-03-04T12:08:39.469 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks 2024-03-04T12:08:39.469 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-04T12:08:39.471 INFO:teuthology.task.internal:Checking packages... 2024-03-04T12:08:39.494 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3aec390336fdfdc8f927818b718cfb0361bd47c8' 2024-03-04T12:08:39.494 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-04T12:08:39.494 INFO:teuthology.packaging:ref: None 2024-03-04T12:08:39.494 INFO:teuthology.packaging:tag: None 2024-03-04T12:08:39.494 INFO:teuthology.packaging:branch: wip-rgw-d4n 2024-03-04T12:08:39.494 INFO:teuthology.packaging:sha1: 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:08:39.494 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rgw-d4n 2024-03-04T12:08:39.730 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1871.g3aec3903 2024-03-04T12:08:39.731 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-04T12:08:39.738 INFO:teuthology.task.internal:no buildpackages task found 2024-03-04T12:08:39.738 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-04T12:08:39.743 INFO:teuthology.task.internal:Saving configuration 2024-03-04T12:08:39.771 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-04T12:08:39.776 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T12:08:39.803 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 12:02:40.645335', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBRfxsTEaInW4UE6C9MmpTeTftsY07BxFw+QHknsPlzJEsYaBqKH1/w6i4fnuuqmlG5TlNfR0V82yyQyIxUQw3c='} 2024-03-04T12:08:39.825 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 12:02:40.643657', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8psj+oSZ4kKEr2fYTgbk/TQycVVgPqXLGrcVm/ZViu2EK3wAHNTdYNTXzagMCg0rVKK2nQNd+8fX6dZRPRd7A='} 2024-03-04T12:08:39.826 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-04T12:08:39.831 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-03-04T12:08:39.831 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-03-04T12:08:39.831 INFO:teuthology.run_tasks:Running task console_log... 2024-03-04T12:08:39.907 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe97d000dc0>, signals=[15]) 2024-03-04T12:08:39.907 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-04T12:08:39.914 INFO:teuthology.task.internal:Opening connections... 2024-03-04T12:08:39.914 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-03-04T12:08:39.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:08:40.021 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-03-04T12:08:40.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:08:40.111 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-04T12:08:40.118 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-03-04T12:08:40.135 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-03-04T12:08:40.135 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-03-04T12:08:40.191 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-03-04T12:08:40.191 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-03-04T12:08:40.191 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-03-04T12:08:40.191 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-03-04T12:08:40.192 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-03-04T12:08:40.192 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-03-04T12:08:40.192 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T12:08:40.192 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-03-04T12:08:40.192 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-03-04T12:08:40.192 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T12:08:40.192 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-03-04T12:08:40.192 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T12:08:40.192 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T12:08:40.192 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T12:08:40.193 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-03-04T12:08:40.233 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-03-04T12:08:40.250 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-03-04T12:08:40.250 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-03-04T12:08:40.308 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-03-04T12:08:40.309 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-03-04T12:08:40.309 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-03-04T12:08:40.309 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-03-04T12:08:40.309 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-03-04T12:08:40.309 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-03-04T12:08:40.309 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-04T12:08:40.309 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-03-04T12:08:40.309 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-03-04T12:08:40.309 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-04T12:08:40.309 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-03-04T12:08:40.309 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-04T12:08:40.309 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-04T12:08:40.309 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-04T12:08:40.310 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-03-04T12:08:40.340 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-04T12:08:40.350 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-04T12:08:40.356 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-04T12:08:40.356 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-03-04T12:08:40.359 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-03-04T12:08:40.375 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-04T12:08:40.381 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-04T12:08:40.382 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-03-04T12:08:40.415 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-03-04T12:08:40.509 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-04T12:08:40.564 INFO:teuthology.run_tasks:Running task kernel... 2024-03-04T12:08:40.578 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-04T12:08:40.578 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-04T12:08:40.579 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-04T12:08:40.579 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-04T12:08:40.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:08:40.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:08:40.597 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-03-04T12:08:40.598 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-03-04T12:08:40.654 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-361.el9.x86_64 2024-03-04T12:08:40.655 INFO:teuthology.task.kernel:Running kernel on smithi172: 5.14.0-361.el9.x86_64 2024-03-04T12:08:40.655 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum install -y kernel 2024-03-04T12:08:40.656 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-361.el9.x86_64 2024-03-04T12:08:40.656 INFO:teuthology.task.kernel:Running kernel on smithi110: 5.14.0-361.el9.x86_64 2024-03-04T12:08:40.656 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum install -y kernel 2024-03-04T12:08:43.340 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - AppStream 6.5 MB/s | 6.7 MB 00:01 2024-03-04T12:08:44.195 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS-9 - AppStream 3.6 MB/s | 6.7 MB 00:01 2024-03-04T12:08:45.023 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - BaseOS 3.4 MB/s | 2.0 MB 00:00 2024-03-04T12:08:45.811 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2024-03-04T12:08:49.124 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.0 MB 00:03 2024-03-04T12:08:49.227 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 2.1 MB/s | 8.0 MB 00:03 2024-03-04T12:08:51.063 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-03-04T12:08:53.933 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 19 MB 00:03 2024-03-04T12:08:56.868 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.1 MB 00:02 2024-03-04T12:08:58.265 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 15 kB 00:00 2024-03-04T12:08:59.799 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.1 MB 00:02 2024-03-04T12:09:01.308 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 7.0 MB/s | 20 MB 00:02 2024-03-04T12:09:01.612 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 15 kB 00:00 2024-03-04T12:09:02.454 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 28 MB/s | 20 MB 00:00 2024-03-04T12:09:06.249 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-03-04T12:09:07.554 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-03-04T12:09:08.498 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-04T12:09:08.498 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-04T12:09:08.628 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-04T12:09:08.636 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-04T12:09:08.636 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-03-04T12:09:08.636 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-04T12:09:08.636 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-04T12:09:08.637 INFO:teuthology.orchestra.run.smithi172.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-04T12:09:08.637 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-03-04T12:09:08.637 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-04T12:09:08.637 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-04T12:09:08.637 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-04T12:09:08.637 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:09:08.637 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-04T12:09:08.637 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-03-04T12:09:08.637 INFO:teuthology.orchestra.run.smithi172.stdout:Install 4 Packages 2024-03-04T12:09:08.637 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:09:08.638 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 100 M 2024-03-04T12:09:08.638 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 123 M 2024-03-04T12:09:08.638 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-04T12:09:09.052 INFO:teuthology.orchestra.run.smithi172.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 17 MB/s | 6.0 MB 00:00 2024-03-04T12:09:09.794 INFO:teuthology.orchestra.run.smithi110.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-04T12:09:09.795 INFO:teuthology.orchestra.run.smithi110.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-04T12:09:09.892 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-03-04T12:09:09.899 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-03-04T12:09:09.899 INFO:teuthology.orchestra.run.smithi110.stdout: Package Architecture Version Repository Size 2024-03-04T12:09:09.899 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-03-04T12:09:09.899 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-03-04T12:09:09.899 INFO:teuthology.orchestra.run.smithi110.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-04T12:09:09.899 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-03-04T12:09:09.899 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-04T12:09:09.899 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-04T12:09:09.899 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-04T12:09:09.900 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:09:09.900 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-03-04T12:09:09.900 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-03-04T12:09:09.900 INFO:teuthology.orchestra.run.smithi110.stdout:Install 4 Packages 2024-03-04T12:09:09.900 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:09:09.900 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 100 M 2024-03-04T12:09:09.901 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 123 M 2024-03-04T12:09:09.901 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-03-04T12:09:09.960 INFO:teuthology.orchestra.run.smithi172.stdout:(2/4): kernel-modules-core-5.14.0-427.el9.x86_6 37 MB/s | 33 MB 00:00 2024-03-04T12:09:10.368 INFO:teuthology.orchestra.run.smithi172.stdout:(3/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 24 MB/s | 39 MB 00:01 2024-03-04T12:09:10.547 INFO:teuthology.orchestra.run.smithi110.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 11 MB/s | 6.0 MB 00:00 2024-03-04T12:09:11.327 INFO:teuthology.orchestra.run.smithi172.stdout:(4/4): kernel-core-5.14.0-427.el9.x86_64.rpm 7.9 MB/s | 21 MB 00:02 2024-03-04T12:09:11.327 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-04T12:09:11.327 INFO:teuthology.orchestra.run.smithi172.stdout:Total 37 MB/s | 100 MB 00:02 2024-03-04T12:09:11.489 INFO:teuthology.orchestra.run.smithi110.stdout:(2/4): kernel-modules-core-5.14.0-427.el9.x86_6 35 MB/s | 33 MB 00:00 2024-03-04T12:09:12.216 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-04T12:09:12.596 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-04T12:09:12.597 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-04T12:09:14.240 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-04T12:09:14.240 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-04T12:09:17.194 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-04T12:09:17.866 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-04T12:09:18.011 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T12:09:20.839 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T12:09:21.040 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T12:09:25.770 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T12:09:26.017 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:09:30.779 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:09:35.988 INFO:teuthology.orchestra.run.smithi110.stdout:(3/4): kernel-core-5.14.0-427.el9.x86_64.rpm 822 kB/s | 21 MB 00:25 2024-03-04T12:09:48.362 INFO:teuthology.orchestra.run.smithi110.stdout:(4/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 1.0 MB/s | 39 MB 00:38 2024-03-04T12:09:48.362 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-03-04T12:09:48.363 INFO:teuthology.orchestra.run.smithi110.stdout:Total 2.6 MB/s | 100 MB 00:38 2024-03-04T12:09:49.251 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-03-04T12:09:49.637 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-03-04T12:09:49.637 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-03-04T12:09:50.983 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-03-04T12:09:50.983 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-03-04T12:09:53.909 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-03-04T12:09:54.560 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-04T12:09:54.691 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T12:09:57.476 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T12:09:57.659 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T12:10:00.300 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:10:00.300 INFO:teuthology.orchestra.run.smithi172.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-04T12:10:00.301 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:10:00.386 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:10:00.890 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:10:00.890 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-04T12:10:00.890 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T12:10:00.890 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T12:10:01.324 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:10:01.324 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:10:01.324 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-04T12:10:01.324 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-04T12:10:01.324 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-04T12:10:01.324 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-04T12:10:01.324 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-04T12:10:01.324 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:10:01.324 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-04T12:10:01.820 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T12:10:01.960 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T12:10:01.960 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T12:10:01.961 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-04T12:10:01.961 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-04T12:10:01.961 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-04T12:10:01.961 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-03-04T12:10:01.961 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi172.front.sepia.ceph.com, path=None, version=distro) 2024-03-04T12:10:01.961 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T12:10:02.083 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T12:10:02.083 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T12:10:02.083 DEBUG:teuthology.orchestra.run.smithi172:> sudo rpm -qi grub2-tools 2024-03-04T12:10:02.117 INFO:teuthology.orchestra.run.smithi172.stdout:Name : grub2-tools 2024-03-04T12:10:02.117 INFO:teuthology.orchestra.run.smithi172.stdout:Epoch : 1 2024-03-04T12:10:02.117 INFO:teuthology.orchestra.run.smithi172.stdout:Version : 2.06 2024-03-04T12:10:02.117 INFO:teuthology.orchestra.run.smithi172.stdout:Release : 68.el9 2024-03-04T12:10:02.117 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: x86_64 2024-03-04T12:10:02.117 INFO:teuthology.orchestra.run.smithi172.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-04T12:10:02.117 INFO:teuthology.orchestra.run.smithi172.stdout:Group : Unspecified 2024-03-04T12:10:02.117 INFO:teuthology.orchestra.run.smithi172.stdout:Size : 8264254 2024-03-04T12:10:02.117 INFO:teuthology.orchestra.run.smithi172.stdout:License : GPLv3+ 2024-03-04T12:10:02.117 INFO:teuthology.orchestra.run.smithi172.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-04T12:10:02.118 INFO:teuthology.orchestra.run.smithi172.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-04T12:10:02.118 INFO:teuthology.orchestra.run.smithi172.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-04T12:10:02.118 INFO:teuthology.orchestra.run.smithi172.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-04T12:10:02.118 INFO:teuthology.orchestra.run.smithi172.stdout:Packager : builder@centos.org 2024-03-04T12:10:02.118 INFO:teuthology.orchestra.run.smithi172.stdout:Vendor : CentOS 2024-03-04T12:10:02.118 INFO:teuthology.orchestra.run.smithi172.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-04T12:10:02.118 INFO:teuthology.orchestra.run.smithi172.stdout:Summary : Support tools for GRUB. 2024-03-04T12:10:02.118 INFO:teuthology.orchestra.run.smithi172.stdout:Description : 2024-03-04T12:10:02.118 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:10:02.118 INFO:teuthology.orchestra.run.smithi172.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-04T12:10:02.118 INFO:teuthology.orchestra.run.smithi172.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-04T12:10:02.118 INFO:teuthology.orchestra.run.smithi172.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-04T12:10:02.118 INFO:teuthology.orchestra.run.smithi172.stdout:hardware devices. 2024-03-04T12:10:02.118 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:10:02.119 INFO:teuthology.orchestra.run.smithi172.stdout:This subpackage provides tools for support of all platforms. 2024-03-04T12:10:02.119 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-04T12:10:02.119 INFO:teuthology.task.kernel:Updating grub on smithi172 to boot 5.14.0-427.el9.x86_64 2024-03-04T12:10:02.120 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-04T12:10:02.387 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T12:10:02.585 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:10:02.723 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2024-03-04T12:10:04.260 INFO:teuthology.orchestra.run.smithi172.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-04T12:10:04.288 INFO:teuthology.orchestra.run.smithi172.stderr:done 2024-03-04T12:10:04.298 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-03-04T12:10:04.353 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.cG4NXWBevO 2024-03-04T12:10:04.353 DEBUG:teuthology.orchestra.run.smithi172:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.cG4NXWBevO 2024-03-04T12:10:04.430 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.cG4NXWBevO 2024-03-04T12:10:04.568 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.cG4NXWBevO is 6KB 2024-03-04T12:10:04.617 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.cG4NXWBevO 2024-03-04T12:10:04.631 DEBUG:teuthology.orchestra.run.smithi172:> sudo /bin/ls /boot/loader/entries || true 2024-03-04T12:10:04.696 INFO:teuthology.orchestra.run.smithi172.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-04T12:10:04.696 INFO:teuthology.orchestra.run.smithi172.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-04T12:10:04.696 INFO:teuthology.orchestra.run.smithi172.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-04T12:10:04.696 INFO:teuthology.orchestra.run.smithi172.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-04T12:10:04.698 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-04T12:10:04.838 DEBUG:teuthology.orchestra.run.smithi172:> sudo shutdown -r now 2024-03-04T12:10:07.336 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:10:34.841 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-04T12:10:34.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-04T12:10:34.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:10:36.710 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:10:36.710 INFO:teuthology.orchestra.run.smithi110.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-04T12:10:36.710 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:10:36.795 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:10:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:10:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-04T12:10:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-04T12:10:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-04T12:10:37.721 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-04T12:10:37.721 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:10:37.721 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-03-04T12:10:37.722 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-04T12:10:37.722 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-04T12:10:37.722 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-04T12:10:37.722 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-04T12:10:37.722 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:10:37.722 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-03-04T12:10:38.263 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T12:10:38.406 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T12:10:38.407 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T12:10:38.407 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-04T12:10:38.407 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-04T12:10:38.407 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-04T12:10:38.407 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-04T12:10:38.407 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=None, version=distro) 2024-03-04T12:10:38.407 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q kernel | sort -rV | head -n 1 2024-03-04T12:10:38.528 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-04T12:10:38.528 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-04T12:10:38.529 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -qi grub2-tools 2024-03-04T12:10:38.562 INFO:teuthology.orchestra.run.smithi110.stdout:Name : grub2-tools 2024-03-04T12:10:38.562 INFO:teuthology.orchestra.run.smithi110.stdout:Epoch : 1 2024-03-04T12:10:38.562 INFO:teuthology.orchestra.run.smithi110.stdout:Version : 2.06 2024-03-04T12:10:38.563 INFO:teuthology.orchestra.run.smithi110.stdout:Release : 68.el9 2024-03-04T12:10:38.563 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: x86_64 2024-03-04T12:10:38.563 INFO:teuthology.orchestra.run.smithi110.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-04T12:10:38.563 INFO:teuthology.orchestra.run.smithi110.stdout:Group : Unspecified 2024-03-04T12:10:38.563 INFO:teuthology.orchestra.run.smithi110.stdout:Size : 8264254 2024-03-04T12:10:38.563 INFO:teuthology.orchestra.run.smithi110.stdout:License : GPLv3+ 2024-03-04T12:10:38.563 INFO:teuthology.orchestra.run.smithi110.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-04T12:10:38.563 INFO:teuthology.orchestra.run.smithi110.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-04T12:10:38.563 INFO:teuthology.orchestra.run.smithi110.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-04T12:10:38.563 INFO:teuthology.orchestra.run.smithi110.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-04T12:10:38.563 INFO:teuthology.orchestra.run.smithi110.stdout:Packager : builder@centos.org 2024-03-04T12:10:38.563 INFO:teuthology.orchestra.run.smithi110.stdout:Vendor : CentOS 2024-03-04T12:10:38.563 INFO:teuthology.orchestra.run.smithi110.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-04T12:10:38.563 INFO:teuthology.orchestra.run.smithi110.stdout:Summary : Support tools for GRUB. 2024-03-04T12:10:38.564 INFO:teuthology.orchestra.run.smithi110.stdout:Description : 2024-03-04T12:10:38.564 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:10:38.564 INFO:teuthology.orchestra.run.smithi110.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-04T12:10:38.564 INFO:teuthology.orchestra.run.smithi110.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-04T12:10:38.564 INFO:teuthology.orchestra.run.smithi110.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-04T12:10:38.564 INFO:teuthology.orchestra.run.smithi110.stdout:hardware devices. 2024-03-04T12:10:38.564 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:10:38.564 INFO:teuthology.orchestra.run.smithi110.stdout:This subpackage provides tools for support of all platforms. 2024-03-04T12:10:38.565 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-04T12:10:38.565 INFO:teuthology.task.kernel:Updating grub on smithi110 to boot 5.14.0-427.el9.x86_64 2024-03-04T12:10:38.565 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-04T12:10:39.177 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-03-04T12:10:40.571 INFO:teuthology.orchestra.run.smithi110.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-04T12:10:40.602 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-03-04T12:10:40.604 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-03-04T12:10:40.619 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.rwdQtZld3B 2024-03-04T12:10:40.620 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.rwdQtZld3B 2024-03-04T12:10:40.687 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.rwdQtZld3B 2024-03-04T12:10:40.834 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.rwdQtZld3B is 6KB 2024-03-04T12:10:40.853 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.rwdQtZld3B 2024-03-04T12:10:40.866 DEBUG:teuthology.orchestra.run.smithi110:> sudo /bin/ls /boot/loader/entries || true 2024-03-04T12:10:40.931 INFO:teuthology.orchestra.run.smithi110.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-04T12:10:40.931 INFO:teuthology.orchestra.run.smithi110.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-04T12:10:40.931 INFO:teuthology.orchestra.run.smithi110.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-04T12:10:40.931 INFO:teuthology.orchestra.run.smithi110.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-04T12:10:40.932 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-04T12:10:41.076 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2024-03-04T12:11:09.500 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-04T12:11:11.078 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-04T12:11:11.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-03-04T12:11:11.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:11:18.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-04T12:11:18.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:12:11.134 DEBUG:teuthology.orchestra.remote:timed out 2024-03-04T12:12:18.516 DEBUG:teuthology.orchestra.remote:timed out 2024-03-04T12:12:20.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-03-04T12:12:20.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:12:20.505 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-03-04T12:12:20.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-03-04T12:12:20.946 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-427.el9.x86_64"... 2024-03-04T12:12:20.946 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-03-04T12:12:20.961 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-427.el9.x86_64 2024-03-04T12:12:20.961 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-04T12:12:20.961 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-04T12:12:20.961 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-04T12:12:21.961 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-04T12:12:21.962 DEBUG:teuthology.orchestra.run.smithi110:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-04T12:12:22.037 INFO:teuthology.orchestra.run.smithi110.stdout:ttyS1 2024-03-04T12:12:22.066 DEBUG:teuthology.parallel:result is None 2024-03-04T12:12:30.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-04T12:12:30.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:12:30.961 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-03-04T12:12:31.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-04T12:12:31.367 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-427.el9.x86_64"... 2024-03-04T12:12:31.367 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-03-04T12:12:31.382 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-427.el9.x86_64 2024-03-04T12:12:31.382 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-04T12:12:31.382 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-04T12:12:31.383 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-04T12:12:32.383 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-04T12:12:32.383 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-04T12:12:32.452 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2024-03-04T12:12:32.489 DEBUG:teuthology.parallel:result is None 2024-03-04T12:12:32.489 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-04T12:12:32.498 INFO:teuthology.task.internal:Creating test directory... 2024-03-04T12:12:32.498 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-04T12:12:32.501 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-04T12:12:32.518 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-04T12:12:32.524 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-04T12:12:32.533 INFO:teuthology.task.internal:Creating archive directory... 2024-03-04T12:12:32.533 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-04T12:12:32.560 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-04T12:12:32.591 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-04T12:12:32.598 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-04T12:12:32.598 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-04T12:12:32.627 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-04T12:12:32.658 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T12:12:32.660 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T12:12:32.672 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T12:12:32.674 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-04T12:12:32.675 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-04T12:12:32.682 INFO:teuthology.task.internal:Configuring sudo... 2024-03-04T12:12:32.682 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-04T12:12:32.716 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-04T12:12:32.745 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-04T12:12:32.755 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-04T12:12:32.755 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-04T12:12:32.786 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-04T12:12:32.802 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T12:12:32.883 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T12:12:32.942 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T12:12:32.981 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T12:12:33.026 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:12:33.027 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-04T12:12:33.094 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T12:12:33.136 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-04T12:12:33.188 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T12:12:33.271 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-04T12:12:33.312 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:12:33.312 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-04T12:12:33.380 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-03-04T12:12:33.382 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-03-04T12:12:33.433 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T12:12:33.463 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T12:12:33.792 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-04T12:12:33.799 INFO:teuthology.task.internal:Starting timer... 2024-03-04T12:12:33.800 INFO:teuthology.run_tasks:Running task pcp... 2024-03-04T12:12:33.809 INFO:teuthology.run_tasks:Running task selinux... 2024-03-04T12:12:33.818 DEBUG:teuthology.orchestra.run.smithi110:> sudo service auditd rotate 2024-03-04T12:12:33.889 INFO:teuthology.orchestra.run.smithi110.stdout:Rotating logs: 2024-03-04T12:12:33.891 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-03-04T12:12:33.937 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-03-04T12:12:33.939 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-04T12:12:33.939 DEBUG:teuthology.orchestra.run.smithi110:> /usr/sbin/getenforce 2024-03-04T12:12:33.960 INFO:teuthology.orchestra.run.smithi110.stdout:Permissive 2024-03-04T12:12:33.960 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-03-04T12:12:33.985 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-03-04T12:12:33.985 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi110.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2024-03-04T12:12:33.986 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T12:12:34.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:12:34.028 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T12:12:34.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:12:34.056 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-04T12:12:34.056 DEBUG:teuthology.orchestra.run.smithi110:> sudo /usr/sbin/setenforce permissive 2024-03-04T12:12:34.103 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-03-04T12:12:34.137 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-04T12:12:34.147 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-04T12:12:34.152 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-04T12:12:34.271 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-04T12:12:34.286 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-04T12:12:34.287 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi110.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-04T12:16:44.993 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi110.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-03-04T12:16:44.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-03-04T12:16:44.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:16:45.087 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-03-04T12:16:45.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-03-04T12:16:45.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-04T12:16:45.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-04T12:16:45.255 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-03-04T12:16:45.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-04T12:16:45.290 INFO:teuthology.run_tasks:Running task clock... 2024-03-04T12:16:45.300 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-04T12:16:45.301 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-04T12:16:45.301 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T12:16:45.303 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-04T12:16:45.304 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T12:16:45.332 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-04T12:16:45.348 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-04T12:16:45.361 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-04T12:16:45.377 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: ntpd: command not found 2024-03-04T12:16:45.378 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-04T12:16:45.391 INFO:teuthology.orchestra.run.smithi110.stdout:506 Cannot talk to daemon 2024-03-04T12:16:45.407 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-03-04T12:16:45.407 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-04T12:16:45.421 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-03-04T12:16:45.423 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-04T12:16:45.437 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-04T12:16:45.454 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-04T12:16:45.476 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-03-04T12:16:45.479 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T12:16:45.479 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-03-04T12:16:45.480 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T12:16:45.480 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T12:16:45.480 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T12:16:45.480 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T12:16:45.514 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-03-04T12:16:45.518 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T12:16:45.518 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-03-04T12:16:45.518 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T12:16:45.518 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T12:16:45.518 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T12:16:45.518 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T12:16:45.519 INFO:teuthology.run_tasks:Running task install... 2024-03-04T12:16:45.531 DEBUG:teuthology.task.install:project ceph 2024-03-04T12:16:45.531 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8'}} 2024-03-04T12:16:45.531 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8'} 2024-03-04T12:16:45.531 INFO:teuthology.task.install:Using flavor: default 2024-03-04T12:16:45.538 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-04T12:16:45.538 INFO:teuthology.task.install:extra packages: [] 2024-03-04T12:16:45.538 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8', 'tag': None, 'wait_for_package': False} 2024-03-04T12:16:45.539 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:16:45.541 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8', 'tag': None, 'wait_for_package': False} 2024-03-04T12:16:45.542 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:16:45.691 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-d4n/3aec390336fdfdc8f927818b718cfb0361bd47c8/centos/9/flavors/default/ 2024-03-04T12:16:45.692 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1871.g3aec3903 2024-03-04T12:16:45.768 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-d4n/3aec390336fdfdc8f927818b718cfb0361bd47c8/centos/9/flavors/default/ 2024-03-04T12:16:45.768 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1871.g3aec3903 2024-03-04T12:16:45.880 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-d4n/3aec390336fdfdc8f927818b718cfb0361bd47c8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-d4n/3aec390336fdfdc8f927818b718cfb0361bd47c8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-d4n/3aec390336fdfdc8f927818b718cfb0361bd47c8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-04T12:16:45.880 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:16:45.880 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-04T12:16:45.908 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-03-04T12:16:45.908 DEBUG:teuthology.orchestra.run.smithi110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3aec390336fdfdc8f927818b718cfb0361bd47c8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-04T12:16:45.939 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-d4n/3aec390336fdfdc8f927818b718cfb0361bd47c8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-d4n/3aec390336fdfdc8f927818b718cfb0361bd47c8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-d4n/3aec390336fdfdc8f927818b718cfb0361bd47c8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-04T12:16:45.939 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:16:45.939 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-04T12:16:45.968 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-03-04T12:16:45.969 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3aec390336fdfdc8f927818b718cfb0361bd47c8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-04T12:16:45.975 DEBUG:teuthology.orchestra.run.smithi110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-04T12:16:46.036 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-04T12:16:46.055 DEBUG:teuthology.orchestra.run.smithi110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-04T12:16:46.117 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-04T12:16:46.121 INFO:teuthology.orchestra.run.smithi110.stdout:check_obsoletes = 1 2024-03-04T12:16:46.123 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum clean all 2024-03-04T12:16:46.184 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-03-04T12:16:46.186 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-03-04T12:16:46.362 INFO:teuthology.orchestra.run.smithi110.stdout:74 files removed 2024-03-04T12:16:46.388 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-03-04T12:16:46.428 INFO:teuthology.orchestra.run.smithi172.stdout:74 files removed 2024-03-04T12:16:46.458 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-03-04T12:16:47.178 INFO:teuthology.orchestra.run.smithi110.stdout:ceph packages for x86_64 172 kB/s | 82 kB 00:00 2024-03-04T12:16:47.194 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 197 kB/s | 82 kB 00:00 2024-03-04T12:16:47.554 INFO:teuthology.orchestra.run.smithi110.stdout:ceph noarch packages 31 kB/s | 10 kB 00:00 2024-03-04T12:16:47.636 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 26 kB/s | 10 kB 00:00 2024-03-04T12:16:47.930 INFO:teuthology.orchestra.run.smithi110.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-03-04T12:16:48.054 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-03-04T12:16:48.423 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-03-04T12:16:48.614 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-04T12:16:49.883 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - BaseOS 5.6 MB/s | 2.0 MB 00:00 2024-03-04T12:16:50.073 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS-9 - BaseOS 5.7 MB/s | 2.0 MB 00:00 2024-03-04T12:16:52.371 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.0 MB 00:02 2024-03-04T12:16:52.761 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.0 MB 00:02 2024-03-04T12:16:54.888 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-03-04T12:16:58.309 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 4.3 MB/s | 19 MB 00:04 2024-03-04T12:17:00.841 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.1 MB 00:02 2024-03-04T12:17:02.656 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 15 kB 00:00 2024-03-04T12:17:04.381 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2024-03-04T12:17:04.841 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.1 MB 00:02 2024-03-04T12:17:07.454 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 10 kB/s | 15 kB 00:01 2024-03-04T12:17:09.256 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-03-04T12:17:11.238 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 5.6 MB/s | 20 MB 00:03 2024-03-04T12:17:11.837 INFO:teuthology.orchestra.run.smithi110.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T12:17:11.838 INFO:teuthology.orchestra.run.smithi110.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T12:17:11.945 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-03-04T12:17:11.973 INFO:teuthology.orchestra.run.smithi110.stdout:=========================================================================================================== 2024-03-04T12:17:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-03-04T12:17:11.973 INFO:teuthology.orchestra.run.smithi110.stdout:=========================================================================================================== 2024-03-04T12:17:11.973 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-03-04T12:17:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: ceph x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 6.6 k 2024-03-04T12:17:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 5.3 M 2024-03-04T12:17:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 887 k 2024-03-04T12:17:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 145 k 2024-03-04T12:17:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 1.5 M 2024-03-04T12:17:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 138 k 2024-03-04T12:17:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 1.8 M 2024-03-04T12:17:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 7.4 M 2024-03-04T12:17:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 49 k 2024-03-04T12:17:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 9.9 M 2024-03-04T12:17:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 48 M 2024-03-04T12:17:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 264 k 2024-03-04T12:17:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 749 k 2024-03-04T12:17:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 31 k 2024-03-04T12:17:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 744 k 2024-03-04T12:17:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 127 k 2024-03-04T12:17:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: maven noarch 1:3.6.3-15.el9 CentOS-AppStream 17 k 2024-03-04T12:17:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 161 k 2024-03-04T12:17:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 320 k 2024-03-04T12:17:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 299 k 2024-03-04T12:17:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 99 k 2024-03-04T12:17:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 85 k 2024-03-04T12:17:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 3.1 M 2024-03-04T12:17:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 171 k 2024-03-04T12:17:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-03-04T12:17:11.975 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2024-03-04T12:17:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 3.4 M 2024-03-04T12:17:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 3.1 M 2024-03-04T12:17:11.975 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-03-04T12:17:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: ModemManager-glib x86_64 1.20.2-1.el9 CentOS-BaseOS 334 k 2024-03-04T12:17:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-04T12:17:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 CentOS-AppStream 625 k 2024-03-04T12:17:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 CentOS-AppStream 11 M 2024-03-04T12:17:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: alsa-lib x86_64 1.2.10-2.el9 CentOS-AppStream 504 k 2024-03-04T12:17:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: apache-commons-cli noarch 1.4-17.el9 CentOS-AppStream 70 k 2024-03-04T12:17:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: apache-commons-codec noarch 1.15-7.el9 CentOS-AppStream 301 k 2024-03-04T12:17:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: apache-commons-io noarch 1:2.8.0-8.el9 CentOS-AppStream 282 k 2024-03-04T12:17:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 CentOS-AppStream 558 k 2024-03-04T12:17:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: at-spi2-atk x86_64 2.38.0-4.el9 CentOS-AppStream 86 k 2024-03-04T12:17:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: at-spi2-core x86_64 2.40.3-1.el9 CentOS-AppStream 176 k 2024-03-04T12:17:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: atinject noarch 1.0.3-6.el9 CentOS-AppStream 22 k 2024-03-04T12:17:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: atk x86_64 2.36.0-5.el9 CentOS-AppStream 270 k 2024-03-04T12:17:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: avahi-glib x86_64 0.8-12.el9 appstream 15 k 2024-03-04T12:17:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: bluez-libs x86_64 5.64-1.el9 CentOS-BaseOS 83 k 2024-03-04T12:17:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-04T12:17:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: bubblewrap x86_64 0.4.1-6.el9 CentOS-BaseOS 49 k 2024-03-04T12:17:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: cdi-api noarch 2.0.2-6.el9 CentOS-AppStream 52 k 2024-03-04T12:17:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 20 M 2024-03-04T12:17:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 31 k 2024-03-04T12:17:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 2.1 M 2024-03-04T12:17:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 248 k 2024-03-04T12:17:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 4.7 M 2024-03-04T12:17:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 17 M 2024-03-04T12:17:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 16 k 2024-03-04T12:17:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 25 k 2024-03-04T12:17:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: colord-libs x86_64 1.4.5-4.el9 CentOS-AppStream 228 k 2024-03-04T12:17:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: copy-jdk-configs noarch 4.0-3.el9 CentOS-AppStream 27 k 2024-03-04T12:17:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: cups-libs x86_64 1:2.3.3op2-24.el9 CentOS-BaseOS 261 k 2024-03-04T12:17:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 CentOS-AppStream 524 k 2024-03-04T12:17:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: exiv2-libs x86_64 0.27.5-2.el9 CentOS-AppStream 780 k 2024-03-04T12:17:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: fdk-aac-free x86_64 2.0.0-8.el9 CentOS-AppStream 324 k 2024-03-04T12:17:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-03-04T12:17:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: flatpak-selinux noarch 1.12.8-1.el9 CentOS-AppStream 20 k 2024-03-04T12:17:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 CentOS-AppStream 73 k 2024-03-04T12:17:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-04T12:17:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-04T12:17:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-04T12:17:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-04T12:17:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 CentOS-AppStream 84 k 2024-03-04T12:17:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: geoclue2 x86_64 2.6.0-7.el9 CentOS-AppStream 122 k 2024-03-04T12:17:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: giflib x86_64 5.2.1-9.el9 CentOS-AppStream 47 k 2024-03-04T12:17:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: google-guice noarch 4.2.3-9.el9 CentOS-AppStream 472 k 2024-03-04T12:17:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-04T12:17:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: graphene x86_64 1.10.6-2.el9 CentOS-AppStream 63 k 2024-03-04T12:17:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-04T12:17:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: gsm x86_64 1.0.19-6.el9 CentOS-AppStream 33 k 2024-03-04T12:17:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: gstreamer1 x86_64 1.22.1-2.el9 CentOS-AppStream 1.4 M 2024-03-04T12:17:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 CentOS-AppStream 2.2 M 2024-03-04T12:17:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 CentOS-AppStream 34 k 2024-03-04T12:17:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: guava noarch 30.1-6.el9 CentOS-AppStream 2.3 M 2024-03-04T12:17:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: hicolor-icon-theme noarch 0.17-13.el9 CentOS-AppStream 65 k 2024-03-04T12:17:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: httpcomponents-client noarch 4.5.13-3.el9 CentOS-AppStream 656 k 2024-03-04T12:17:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: httpcomponents-core noarch 4.4.13-7.el9 CentOS-AppStream 630 k 2024-03-04T12:17:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: iso-codes noarch 4.6.0-3.el9 CentOS-AppStream 3.3 M 2024-03-04T12:17:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: jakarta-annotations noarch 1.3.5-13.el9 CentOS-AppStream 44 k 2024-03-04T12:17:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: jansi x86_64 2.3.3-6.el9 CentOS-AppStream 108 k 2024-03-04T12:17:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: java-11-openjdk x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 439 k 2024-03-04T12:17:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: java-11-openjdk-headless x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 40 M 2024-03-04T12:17:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: javapackages-filesystem noarch 6.0.0-4.el9 CentOS-AppStream 10 k 2024-03-04T12:17:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: jbigkit-libs x86_64 2.1-23.el9 CentOS-AppStream 52 k 2024-03-04T12:17:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 CentOS-AppStream 23 k 2024-03-04T12:17:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-03-04T12:17:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: jsoup noarch 1.13.1-10.el9 CentOS-AppStream 376 k 2024-03-04T12:17:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: jsr-305 noarch 3.0.2-6.el9 CentOS-AppStream 31 k 2024-03-04T12:17:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: lcms2 x86_64 2.12-3.el9 CentOS-AppStream 166 k 2024-03-04T12:17:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: libX11-xcb x86_64 1.7.0-8.el9 appstream 11 k 2024-03-04T12:17:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: libXcomposite x86_64 0.4.5-7.el9 CentOS-AppStream 23 k 2024-03-04T12:17:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: libXcursor x86_64 1.2.0-7.el9 CentOS-AppStream 30 k 2024-03-04T12:17:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: libXdamage x86_64 1.1.5-7.el9 CentOS-AppStream 22 k 2024-03-04T12:17:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: libXfixes x86_64 5.0.3-16.el9 CentOS-AppStream 19 k 2024-03-04T12:17:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: libXi x86_64 1.7.10-8.el9 CentOS-AppStream 38 k 2024-03-04T12:17:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: libXinerama x86_64 1.1.4-10.el9 CentOS-AppStream 14 k 2024-03-04T12:17:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: libXrandr x86_64 1.5.2-8.el9 CentOS-AppStream 27 k 2024-03-04T12:17:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: libXtst x86_64 1.2.3-16.el9 CentOS-AppStream 20 k 2024-03-04T12:17:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: libXv x86_64 1.0.11-16.el9 CentOS-AppStream 18 k 2024-03-04T12:17:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: libXxf86vm x86_64 1.1.4-18.el9 CentOS-AppStream 18 k 2024-03-04T12:17:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-04T12:17:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-04T12:17:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: libasyncns x86_64 0.8-22.el9 CentOS-AppStream 29 k 2024-03-04T12:17:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: libcanberra x86_64 0.30-27.el9 CentOS-AppStream 85 k 2024-03-04T12:17:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 163 k 2024-03-04T12:17:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: libdrm x86_64 2.4.117-1.el9 CentOS-AppStream 158 k 2024-03-04T12:17:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: libepoxy x86_64 1.5.5-4.el9 CentOS-AppStream 240 k 2024-03-04T12:17:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: libexif x86_64 0.6.22-6.el9 CentOS-AppStream 431 k 2024-03-04T12:17:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: libfontenc x86_64 1.1.3-17.el9 CentOS-AppStream 30 k 2024-03-04T12:17:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: libgexiv2 x86_64 0.12.3-1.el9 CentOS-AppStream 82 k 2024-03-04T12:17:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-03-04T12:17:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: libglvnd x86_64 1:1.3.4-1.el9 CentOS-AppStream 134 k 2024-03-04T12:17:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 CentOS-AppStream 36 k 2024-03-04T12:17:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 CentOS-AppStream 141 k 2024-03-04T12:17:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: libgsf x86_64 1.14.47-5.el9 CentOS-AppStream 245 k 2024-03-04T12:17:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: libgxps x86_64 0.3.2-3.el9 CentOS-AppStream 78 k 2024-03-04T12:17:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: libiptcdata x86_64 1.0.5-9.el9 CentOS-AppStream 61 k 2024-03-04T12:17:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: libldac x86_64 2.0.2.3-10.el9 CentOS-AppStream 40 k 2024-03-04T12:17:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: libnotify x86_64 0.7.9-8.el9 CentOS-AppStream 43 k 2024-03-04T12:17:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-04T12:17:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: libogg x86_64 2:1.3.4-6.el9 CentOS-AppStream 32 k 2024-03-04T12:17:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: libosinfo x86_64 1.10.0-1.el9 CentOS-AppStream 312 k 2024-03-04T12:17:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: libpciaccess x86_64 0.16-6.el9 CentOS-BaseOS 27 k 2024-03-04T12:17:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-04T12:17:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-03-04T12:17:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-04T12:17:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 501 k 2024-03-04T12:17:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-04T12:17:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 5.2 M 2024-03-04T12:17:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: libsbc x86_64 1.4-9.el9 CentOS-AppStream 44 k 2024-03-04T12:17:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: libsndfile x86_64 1.0.31-8.el9 CentOS-AppStream 205 k 2024-03-04T12:17:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: libtheora x86_64 1:1.1.1-31.el9 CentOS-AppStream 163 k 2024-03-04T12:17:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: libtiff x86_64 4.4.0-12.el9 CentOS-AppStream 197 k 2024-03-04T12:17:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: libtool-ltdl x86_64 2.4.6-45.el9 CentOS-AppStream 36 k 2024-03-04T12:17:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: libtracker-sparql x86_64 3.1.2-3.el9 CentOS-AppStream 316 k 2024-03-04T12:17:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-04T12:17:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: libvisual x86_64 1:0.4.0-34.el9 CentOS-AppStream 143 k 2024-03-04T12:17:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: libvorbis x86_64 1:1.3.7-5.el9 CentOS-AppStream 192 k 2024-03-04T12:17:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: libwayland-client x86_64 1.21.0-1.el9 CentOS-AppStream 32 k 2024-03-04T12:17:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: libwayland-cursor x86_64 1.21.0-1.el9 CentOS-AppStream 18 k 2024-03-04T12:17:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: libwayland-egl x86_64 1.21.0-1.el9 CentOS-AppStream 12 k 2024-03-04T12:17:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: libwayland-server x86_64 1.21.0-1.el9 CentOS-AppStream 41 k 2024-03-04T12:17:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: libwebp x86_64 1.2.0-8.el9 CentOS-AppStream 276 k 2024-03-04T12:17:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: libxkbcommon x86_64 1.0.3-4.el9 CentOS-AppStream 132 k 2024-03-04T12:17:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: libxshmfence x86_64 1.3-10.el9 CentOS-AppStream 12 k 2024-03-04T12:17:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: lksctp-tools x86_64 1.0.19-2.el9 CentOS-BaseOS 90 k 2024-03-04T12:17:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: low-memory-monitor x86_64 2.1-4.el9 CentOS-AppStream 35 k 2024-03-04T12:17:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-04T12:17:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-04T12:17:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-04T12:17:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: lua-posix x86_64 35.0-8.el9 CentOS-AppStream 131 k 2024-03-04T12:17:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-04T12:17:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: maven-lib noarch 1:3.6.3-15.el9 CentOS-AppStream 1.5 M 2024-03-04T12:17:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 CentOS-AppStream 7.9 k 2024-03-04T12:17:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: maven-resolver noarch 1:1.6.1-10.el9 CentOS-AppStream 512 k 2024-03-04T12:17:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: maven-shared-utils noarch 3.3.4-3.el9 CentOS-AppStream 150 k 2024-03-04T12:17:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: maven-wagon noarch 3.4.2-7.el9 CentOS-AppStream 111 k 2024-03-04T12:17:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: mesa-libEGL x86_64 23.3.3-1.el9 CentOS-AppStream 126 k 2024-03-04T12:17:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: mesa-libGL x86_64 23.3.3-1.el9 CentOS-AppStream 167 k 2024-03-04T12:17:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: mesa-libgbm x86_64 23.3.3-1.el9 CentOS-AppStream 37 k 2024-03-04T12:17:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: mesa-libglapi x86_64 23.3.3-1.el9 CentOS-AppStream 43 k 2024-03-04T12:17:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: mkfontscale x86_64 1.2.1-3.el9 CentOS-AppStream 31 k 2024-03-04T12:17:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-03-04T12:17:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-04T12:17:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-04T12:17:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: openjpeg2 x86_64 2.4.0-7.el9 CentOS-AppStream 162 k 2024-03-04T12:17:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: opus x86_64 1.3.1-10.el9 CentOS-AppStream 199 k 2024-03-04T12:17:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: orc x86_64 0.4.31-6.el9 CentOS-AppStream 183 k 2024-03-04T12:17:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: osinfo-db noarch 20231215-1.el9 CentOS-AppStream 283 k 2024-03-04T12:17:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 CentOS-AppStream 68 k 2024-03-04T12:17:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: ostree-libs x86_64 2024.4-3.el9 appstream 487 k 2024-03-04T12:17:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-04T12:17:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 CentOS-AppStream 134 k 2024-03-04T12:17:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: pipewire-libs x86_64 1.0.1-1.el9 CentOS-AppStream 1.9 M 2024-03-04T12:17:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: plexus-cipher noarch 1.7-27.el9 CentOS-AppStream 25 k 2024-03-04T12:17:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: plexus-classworlds noarch 2.6.0-11.el9 CentOS-AppStream 59 k 2024-03-04T12:17:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 CentOS-AppStream 17 k 2024-03-04T12:17:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: plexus-interpolation noarch 1.26-11.el9 CentOS-AppStream 79 k 2024-03-04T12:17:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 CentOS-AppStream 33 k 2024-03-04T12:17:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: plexus-utils noarch 3.3.0-10.el9 CentOS-AppStream 253 k 2024-03-04T12:17:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: poppler x86_64 21.01.0-19.el9 CentOS-AppStream 1.1 M 2024-03-04T12:17:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: poppler-data noarch 0.4.9-9.el9 CentOS-AppStream 1.8 M 2024-03-04T12:17:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: poppler-glib x86_64 21.01.0-19.el9 CentOS-AppStream 151 k 2024-03-04T12:17:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-04T12:17:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-04T12:17:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: publicsuffix-list noarch 20210518-3.el9 CentOS-AppStream 82 k 2024-03-04T12:17:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: pulseaudio-libs x86_64 15.0-2.el9 CentOS-AppStream 666 k 2024-03-04T12:17:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-04T12:17:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-04T12:17:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-04T12:17:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-04T12:17:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 45 k 2024-03-04T12:17:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 131 k 2024-03-04T12:17:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-04T12:17:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-04T12:17:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-04T12:17:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-04T12:17:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-04T12:17:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-04T12:17:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-04T12:17:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-04T12:17:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-04T12:17:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-04T12:17:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-04T12:17:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-04T12:17:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-04T12:17:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-04T12:17:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-03-04T12:17:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-04T12:17:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-04T12:17:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-04T12:17:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-04T12:17:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-04T12:17:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-04T12:17:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-04T12:17:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-04T12:17:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-04T12:17:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-04T12:17:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-04T12:17:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-04T12:17:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-04T12:17:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-04T12:17:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-04T12:17:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-04T12:17:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-04T12:17:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-04T12:17:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-04T12:17:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-04T12:17:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-04T12:17:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-04T12:17:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-04T12:17:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-03-04T12:17:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-04T12:17:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-04T12:17:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-04T12:17:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-04T12:17:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-04T12:17:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-04T12:17:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-04T12:17:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-04T12:17:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-04T12:17:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-04T12:17:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-04T12:17:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-04T12:17:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-03-04T12:17:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-03-04T12:17:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-04T12:17:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: rtkit x86_64 0.11-28.el9 CentOS-AppStream 55 k 2024-03-04T12:17:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: sisu noarch 1:0.3.4-10.el9 CentOS-AppStream 509 k 2024-03-04T12:17:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: slf4j noarch 1.7.30-13.el9 CentOS-AppStream 68 k 2024-03-04T12:17:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-04T12:17:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: sound-theme-freedesktop noarch 0.8-17.el9 CentOS-AppStream 377 k 2024-03-04T12:17:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-04T12:17:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: totem-pl-parser x86_64 3.26.6-2.el9 CentOS-AppStream 130 k 2024-03-04T12:17:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: ttmkfdir x86_64 3.0.9-65.el9 CentOS-AppStream 52 k 2024-03-04T12:17:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: tzdata-java noarch 2024a-1.el9 CentOS-AppStream 148 k 2024-03-04T12:17:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: upower x86_64 0.99.11-11.el9 CentOS-AppStream 168 k 2024-03-04T12:17:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 CentOS-AppStream 305 k 2024-03-04T12:17:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: wireplumber x86_64 0.4.14-1.el9 CentOS-AppStream 83 k 2024-03-04T12:17:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: wireplumber-libs x86_64 0.4.14-1.el9 CentOS-AppStream 337 k 2024-03-04T12:17:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 CentOS-AppStream 41 k 2024-03-04T12:17:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 CentOS-AppStream 367 k 2024-03-04T12:17:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: xkeyboard-config noarch 2.33-2.el9 CentOS-AppStream 780 k 2024-03-04T12:17:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-04T12:17:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 CentOS-AppStream 499 k 2024-03-04T12:17:11.993 INFO:teuthology.orchestra.run.smithi110.stdout:Installing weak dependencies: 2024-03-04T12:17:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: dconf x86_64 0.40.0-6.el9 CentOS-AppStream 108 k 2024-03-04T12:17:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: exiv2 x86_64 0.27.5-2.el9 CentOS-AppStream 978 k 2024-03-04T12:17:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: flatpak x86_64 1.12.8-1.el9 CentOS-AppStream 1.7 M 2024-03-04T12:17:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: gtk3 x86_64 3.24.31-2.el9 CentOS-AppStream 4.8 M 2024-03-04T12:17:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: java-11-openjdk-devel x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 3.3 M 2024-03-04T12:17:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 CentOS-AppStream 31 k 2024-03-04T12:17:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: p11-kit-server x86_64 0.24.1-2.el9 appstream 199 k 2024-03-04T12:17:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: pipewire x86_64 1.0.1-1.el9 CentOS-AppStream 101 k 2024-03-04T12:17:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: pipewire-alsa x86_64 1.0.1-1.el9 CentOS-AppStream 56 k 2024-03-04T12:17:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 CentOS-AppStream 8.0 k 2024-03-04T12:17:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 CentOS-AppStream 185 k 2024-03-04T12:17:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-03-04T12:17:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: tracker x86_64 3.1.2-3.el9 CentOS-AppStream 537 k 2024-03-04T12:17:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: tracker-miners x86_64 3.1.2-4.el9 CentOS-AppStream 893 k 2024-03-04T12:17:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 CentOS-AppStream 130 k 2024-03-04T12:17:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:17:11.994 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-03-04T12:17:11.994 INFO:teuthology.orchestra.run.smithi110.stdout:=========================================================================================================== 2024-03-04T12:17:11.994 INFO:teuthology.orchestra.run.smithi110.stdout:Install 282 Packages 2024-03-04T12:17:11.994 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 2 Packages 2024-03-04T12:17:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:17:11.995 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 296 M 2024-03-04T12:17:11.995 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-03-04T12:17:12.832 INFO:teuthology.orchestra.run.smithi110.stdout:(1/284): ceph-19.0.0-1871.g3aec3903.el9.x86_64. 38 kB/s | 6.6 kB 00:00 2024-03-04T12:17:13.049 INFO:teuthology.orchestra.run.smithi110.stdout:(2/284): ceph-fuse-19.0.0-1871.g3aec3903.el9.x8 4.0 MB/s | 887 kB 00:00 2024-03-04T12:17:13.100 INFO:teuthology.orchestra.run.smithi110.stdout:(3/284): ceph-immutable-object-cache-19.0.0-187 2.8 MB/s | 145 kB 00:00 2024-03-04T12:17:13.350 INFO:teuthology.orchestra.run.smithi110.stdout:(4/284): ceph-mds-19.0.0-1871.g3aec3903.el9.x86 8.5 MB/s | 2.1 MB 00:00 2024-03-04T12:17:13.417 INFO:teuthology.orchestra.run.smithi110.stdout:(5/284): ceph-base-19.0.0-1871.g3aec3903.el9.x8 7.1 MB/s | 5.3 MB 00:00 2024-03-04T12:17:13.567 INFO:teuthology.orchestra.run.smithi110.stdout:(6/284): ceph-mgr-19.0.0-1871.g3aec3903.el9.x86 6.9 MB/s | 1.5 MB 00:00 2024-03-04T12:17:13.826 INFO:teuthology.orchestra.run.smithi110.stdout:(7/284): ceph-mon-19.0.0-1871.g3aec3903.el9.x86 11 MB/s | 4.7 MB 00:00 2024-03-04T12:17:14.676 INFO:teuthology.orchestra.run.smithi110.stdout:(8/284): ceph-radosgw-19.0.0-1871.g3aec3903.el9 12 MB/s | 9.9 MB 00:00 2024-03-04T12:17:14.734 INFO:teuthology.orchestra.run.smithi110.stdout:(9/284): ceph-selinux-19.0.0-1871.g3aec3903.el9 433 kB/s | 25 kB 00:00 2024-03-04T12:17:15.168 INFO:teuthology.orchestra.run.smithi110.stdout:(10/284): ceph-osd-19.0.0-1871.g3aec3903.el9.x8 10 MB/s | 17 MB 00:01 2024-03-04T12:17:15.235 INFO:teuthology.orchestra.run.smithi110.stdout:(11/284): libcephfs-devel-19.0.0-1871.g3aec3903 469 kB/s | 31 kB 00:00 2024-03-04T12:17:15.360 INFO:teuthology.orchestra.run.smithi110.stdout:(12/284): libcephfs2-19.0.0-1871.g3aec3903.el9. 5.8 MB/s | 744 kB 00:00 2024-03-04T12:17:15.427 INFO:teuthology.orchestra.run.smithi110.stdout:(13/284): libcephsqlite-19.0.0-1871.g3aec3903.e 2.4 MB/s | 163 kB 00:00 2024-03-04T12:17:15.494 INFO:teuthology.orchestra.run.smithi110.stdout:(14/284): librados-devel-19.0.0-1871.g3aec3903. 1.9 MB/s | 127 kB 00:00 2024-03-04T12:17:15.577 INFO:teuthology.orchestra.run.smithi110.stdout:(15/284): libradosstriper1-19.0.0-1871.g3aec390 5.9 MB/s | 501 kB 00:00 2024-03-04T12:17:16.086 INFO:teuthology.orchestra.run.smithi110.stdout:(16/284): librgw2-19.0.0-1871.g3aec3903.el9.x86 10 MB/s | 5.2 MB 00:00 2024-03-04T12:17:16.153 INFO:teuthology.orchestra.run.smithi110.stdout:(17/284): python3-ceph-argparse-19.0.0-1871.g3a 679 kB/s | 45 kB 00:00 2024-03-04T12:17:16.179 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-03-04T12:17:16.245 INFO:teuthology.orchestra.run.smithi110.stdout:(18/284): python3-ceph-common-19.0.0-1871.g3aec 1.4 MB/s | 131 kB 00:00 2024-03-04T12:17:16.312 INFO:teuthology.orchestra.run.smithi110.stdout:(19/284): python3-cephfs-19.0.0-1871.g3aec3903. 2.4 MB/s | 161 kB 00:00 2024-03-04T12:17:16.387 INFO:teuthology.orchestra.run.smithi110.stdout:(20/284): python3-rados-19.0.0-1871.g3aec3903.e 4.2 MB/s | 320 kB 00:00 2024-03-04T12:17:16.462 INFO:teuthology.orchestra.run.smithi110.stdout:(21/284): python3-rbd-19.0.0-1871.g3aec3903.el9 3.9 MB/s | 299 kB 00:00 2024-03-04T12:17:16.538 INFO:teuthology.orchestra.run.smithi110.stdout:(22/284): python3-rgw-19.0.0-1871.g3aec3903.el9 1.3 MB/s | 99 kB 00:00 2024-03-04T12:17:16.596 INFO:teuthology.orchestra.run.smithi110.stdout:(23/284): rbd-fuse-19.0.0-1871.g3aec3903.el9.x8 1.4 MB/s | 85 kB 00:00 2024-03-04T12:17:16.788 INFO:teuthology.orchestra.run.smithi110.stdout:(24/284): ceph-common-19.0.0-1871.g3aec3903.el9 4.9 MB/s | 20 MB 00:04 2024-03-04T12:17:16.888 INFO:teuthology.orchestra.run.smithi110.stdout:(25/284): rbd-nbd-19.0.0-1871.g3aec3903.el9.x86 1.7 MB/s | 171 kB 00:00 2024-03-04T12:17:16.947 INFO:teuthology.orchestra.run.smithi110.stdout:(26/284): rbd-mirror-19.0.0-1871.g3aec3903.el9. 8.8 MB/s | 3.1 MB 00:00 2024-03-04T12:17:16.973 INFO:teuthology.orchestra.run.smithi110.stdout:(27/284): ceph-grafana-dashboards-19.0.0-1871.g 376 kB/s | 31 kB 00:00 2024-03-04T12:17:17.006 INFO:teuthology.orchestra.run.smithi110.stdout:(28/284): ceph-mgr-cephadm-19.0.0-1871.g3aec390 2.3 MB/s | 138 kB 00:00 2024-03-04T12:17:17.365 INFO:teuthology.orchestra.run.smithi110.stdout:(29/284): ceph-mgr-dashboard-19.0.0-1871.g3aec3 4.5 MB/s | 1.8 MB 00:00 2024-03-04T12:17:17.473 INFO:teuthology.orchestra.run.smithi110.stdout:(30/284): ceph-mgr-modules-core-19.0.0-1871.g3a 2.2 MB/s | 248 kB 00:00 2024-03-04T12:17:17.574 INFO:teuthology.orchestra.run.smithi110.stdout:(31/284): ceph-mgr-rook-19.0.0-1871.g3aec3903.e 493 kB/s | 49 kB 00:00 2024-03-04T12:17:17.700 INFO:teuthology.orchestra.run.smithi110.stdout:(32/284): ceph-prometheus-alerts-19.0.0-1871.g3 130 kB/s | 16 kB 00:00 2024-03-04T12:17:17.783 INFO:teuthology.orchestra.run.smithi110.stdout:(33/284): ceph-mgr-diskprediction-local-19.0.0- 9.5 MB/s | 7.4 MB 00:00 2024-03-04T12:17:17.808 INFO:teuthology.orchestra.run.smithi110.stdout:(34/284): ceph-volume-19.0.0-1871.g3aec3903.el9 2.4 MB/s | 264 kB 00:00 2024-03-04T12:17:17.916 INFO:teuthology.orchestra.run.smithi110.stdout:(35/284): cephadm-19.0.0-1871.g3aec3903.el9.noa 5.5 MB/s | 749 kB 00:00 2024-03-04T12:17:18.325 INFO:teuthology.orchestra.run.smithi110.stdout:(36/284): ceph-test-19.0.0-1871.g3aec3903.el9.x 13 MB/s | 48 MB 00:03 2024-03-04T12:17:18.359 INFO:teuthology.orchestra.run.smithi110.stdout:(37/284): adwaita-cursor-theme-40.1.1-3.el9.noa 1.1 MB/s | 625 kB 00:00 2024-03-04T12:17:18.551 INFO:teuthology.orchestra.run.smithi110.stdout:(38/284): apache-commons-cli-1.4-17.el9.noarch. 365 kB/s | 70 kB 00:00 2024-03-04T12:17:18.601 INFO:teuthology.orchestra.run.smithi110.stdout:(39/284): alsa-lib-1.2.10-2.el9.x86_64.rpm 1.8 MB/s | 504 kB 00:00 2024-03-04T12:17:18.735 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T12:17:18.736 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-04T12:17:18.776 INFO:teuthology.orchestra.run.smithi110.stdout:(40/284): apache-commons-codec-1.15-7.el9.noarc 1.3 MB/s | 301 kB 00:00 2024-03-04T12:17:18.845 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-03-04T12:17:18.870 INFO:teuthology.orchestra.run.smithi172.stdout:=========================================================================================================== 2024-03-04T12:17:18.870 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-03-04T12:17:18.870 INFO:teuthology.orchestra.run.smithi172.stdout:=========================================================================================================== 2024-03-04T12:17:18.870 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-03-04T12:17:18.871 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 6.6 k 2024-03-04T12:17:18.871 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 5.3 M 2024-03-04T12:17:18.871 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 887 k 2024-03-04T12:17:18.871 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 145 k 2024-03-04T12:17:18.871 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 1.5 M 2024-03-04T12:17:18.871 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 138 k 2024-03-04T12:17:18.871 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 1.8 M 2024-03-04T12:17:18.872 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 7.4 M 2024-03-04T12:17:18.872 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 49 k 2024-03-04T12:17:18.872 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 9.9 M 2024-03-04T12:17:18.872 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 48 M 2024-03-04T12:17:18.872 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 264 k 2024-03-04T12:17:18.872 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 749 k 2024-03-04T12:17:18.872 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 31 k 2024-03-04T12:17:18.872 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 744 k 2024-03-04T12:17:18.872 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 127 k 2024-03-04T12:17:18.873 INFO:teuthology.orchestra.run.smithi172.stdout: maven noarch 1:3.6.3-15.el9 CentOS-AppStream 17 k 2024-03-04T12:17:18.873 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 161 k 2024-03-04T12:17:18.873 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 320 k 2024-03-04T12:17:18.873 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 299 k 2024-03-04T12:17:18.873 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 99 k 2024-03-04T12:17:18.873 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 85 k 2024-03-04T12:17:18.873 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 3.1 M 2024-03-04T12:17:18.873 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 171 k 2024-03-04T12:17:18.873 INFO:teuthology.orchestra.run.smithi172.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-03-04T12:17:18.873 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-03-04T12:17:18.874 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 3.4 M 2024-03-04T12:17:18.874 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 3.1 M 2024-03-04T12:17:18.874 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-03-04T12:17:18.874 INFO:teuthology.orchestra.run.smithi172.stdout: ModemManager-glib x86_64 1.20.2-1.el9 CentOS-BaseOS 334 k 2024-03-04T12:17:18.874 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-04T12:17:18.874 INFO:teuthology.orchestra.run.smithi172.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 CentOS-AppStream 625 k 2024-03-04T12:17:18.874 INFO:teuthology.orchestra.run.smithi172.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 CentOS-AppStream 11 M 2024-03-04T12:17:18.874 INFO:teuthology.orchestra.run.smithi172.stdout: alsa-lib x86_64 1.2.10-2.el9 CentOS-AppStream 504 k 2024-03-04T12:17:18.874 INFO:teuthology.orchestra.run.smithi172.stdout: apache-commons-cli noarch 1.4-17.el9 CentOS-AppStream 70 k 2024-03-04T12:17:18.874 INFO:teuthology.orchestra.run.smithi172.stdout: apache-commons-codec noarch 1.15-7.el9 CentOS-AppStream 301 k 2024-03-04T12:17:18.875 INFO:teuthology.orchestra.run.smithi172.stdout: apache-commons-io noarch 1:2.8.0-8.el9 CentOS-AppStream 282 k 2024-03-04T12:17:18.875 INFO:teuthology.orchestra.run.smithi172.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 CentOS-AppStream 558 k 2024-03-04T12:17:18.875 INFO:teuthology.orchestra.run.smithi172.stdout: at-spi2-atk x86_64 2.38.0-4.el9 CentOS-AppStream 86 k 2024-03-04T12:17:18.875 INFO:teuthology.orchestra.run.smithi172.stdout: at-spi2-core x86_64 2.40.3-1.el9 CentOS-AppStream 176 k 2024-03-04T12:17:18.875 INFO:teuthology.orchestra.run.smithi172.stdout: atinject noarch 1.0.3-6.el9 CentOS-AppStream 22 k 2024-03-04T12:17:18.875 INFO:teuthology.orchestra.run.smithi172.stdout: atk x86_64 2.36.0-5.el9 CentOS-AppStream 270 k 2024-03-04T12:17:18.875 INFO:teuthology.orchestra.run.smithi172.stdout: avahi-glib x86_64 0.8-12.el9 appstream 15 k 2024-03-04T12:17:18.875 INFO:teuthology.orchestra.run.smithi172.stdout: bluez-libs x86_64 5.64-1.el9 CentOS-BaseOS 83 k 2024-03-04T12:17:18.875 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-04T12:17:18.875 INFO:teuthology.orchestra.run.smithi172.stdout: bubblewrap x86_64 0.4.1-6.el9 CentOS-BaseOS 49 k 2024-03-04T12:17:18.876 INFO:teuthology.orchestra.run.smithi172.stdout: cdi-api noarch 2.0.2-6.el9 CentOS-AppStream 52 k 2024-03-04T12:17:18.876 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 20 M 2024-03-04T12:17:18.876 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 31 k 2024-03-04T12:17:18.876 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 2.1 M 2024-03-04T12:17:18.876 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 248 k 2024-03-04T12:17:18.876 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 4.7 M 2024-03-04T12:17:18.876 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 17 M 2024-03-04T12:17:18.876 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1871.g3aec3903.el9 ceph-noarch 16 k 2024-03-04T12:17:18.876 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 25 k 2024-03-04T12:17:18.877 INFO:teuthology.orchestra.run.smithi172.stdout: colord-libs x86_64 1.4.5-4.el9 CentOS-AppStream 228 k 2024-03-04T12:17:18.877 INFO:teuthology.orchestra.run.smithi172.stdout: copy-jdk-configs noarch 4.0-3.el9 CentOS-AppStream 27 k 2024-03-04T12:17:18.877 INFO:teuthology.orchestra.run.smithi172.stdout: cups-libs x86_64 1:2.3.3op2-24.el9 CentOS-BaseOS 261 k 2024-03-04T12:17:18.877 INFO:teuthology.orchestra.run.smithi172.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 CentOS-AppStream 524 k 2024-03-04T12:17:18.877 INFO:teuthology.orchestra.run.smithi172.stdout: exiv2-libs x86_64 0.27.5-2.el9 CentOS-AppStream 780 k 2024-03-04T12:17:18.877 INFO:teuthology.orchestra.run.smithi172.stdout: fdk-aac-free x86_64 2.0.0-8.el9 CentOS-AppStream 324 k 2024-03-04T12:17:18.877 INFO:teuthology.orchestra.run.smithi172.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-03-04T12:17:18.877 INFO:teuthology.orchestra.run.smithi172.stdout: flatpak-selinux noarch 1.12.8-1.el9 CentOS-AppStream 20 k 2024-03-04T12:17:18.877 INFO:teuthology.orchestra.run.smithi172.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 CentOS-AppStream 73 k 2024-03-04T12:17:18.877 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-04T12:17:18.878 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-04T12:17:18.878 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-04T12:17:18.878 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-04T12:17:18.878 INFO:teuthology.orchestra.run.smithi172.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 CentOS-AppStream 84 k 2024-03-04T12:17:18.878 INFO:teuthology.orchestra.run.smithi172.stdout: geoclue2 x86_64 2.6.0-7.el9 CentOS-AppStream 122 k 2024-03-04T12:17:18.878 INFO:teuthology.orchestra.run.smithi172.stdout: giflib x86_64 5.2.1-9.el9 CentOS-AppStream 47 k 2024-03-04T12:17:18.878 INFO:teuthology.orchestra.run.smithi172.stdout: google-guice noarch 4.2.3-9.el9 CentOS-AppStream 472 k 2024-03-04T12:17:18.878 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-04T12:17:18.878 INFO:teuthology.orchestra.run.smithi172.stdout: graphene x86_64 1.10.6-2.el9 CentOS-AppStream 63 k 2024-03-04T12:17:18.878 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-04T12:17:18.879 INFO:teuthology.orchestra.run.smithi172.stdout: gsm x86_64 1.0.19-6.el9 CentOS-AppStream 33 k 2024-03-04T12:17:18.879 INFO:teuthology.orchestra.run.smithi172.stdout: gstreamer1 x86_64 1.22.1-2.el9 CentOS-AppStream 1.4 M 2024-03-04T12:17:18.879 INFO:teuthology.orchestra.run.smithi172.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 CentOS-AppStream 2.2 M 2024-03-04T12:17:18.879 INFO:teuthology.orchestra.run.smithi172.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 CentOS-AppStream 34 k 2024-03-04T12:17:18.879 INFO:teuthology.orchestra.run.smithi172.stdout: guava noarch 30.1-6.el9 CentOS-AppStream 2.3 M 2024-03-04T12:17:18.879 INFO:teuthology.orchestra.run.smithi172.stdout: hicolor-icon-theme noarch 0.17-13.el9 CentOS-AppStream 65 k 2024-03-04T12:17:18.879 INFO:teuthology.orchestra.run.smithi172.stdout: httpcomponents-client noarch 4.5.13-3.el9 CentOS-AppStream 656 k 2024-03-04T12:17:18.879 INFO:teuthology.orchestra.run.smithi172.stdout: httpcomponents-core noarch 4.4.13-7.el9 CentOS-AppStream 630 k 2024-03-04T12:17:18.879 INFO:teuthology.orchestra.run.smithi172.stdout: iso-codes noarch 4.6.0-3.el9 CentOS-AppStream 3.3 M 2024-03-04T12:17:18.879 INFO:teuthology.orchestra.run.smithi172.stdout: jakarta-annotations noarch 1.3.5-13.el9 CentOS-AppStream 44 k 2024-03-04T12:17:18.879 INFO:teuthology.orchestra.run.smithi172.stdout: jansi x86_64 2.3.3-6.el9 CentOS-AppStream 108 k 2024-03-04T12:17:18.879 INFO:teuthology.orchestra.run.smithi172.stdout: java-11-openjdk x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 439 k 2024-03-04T12:17:18.879 INFO:teuthology.orchestra.run.smithi172.stdout: java-11-openjdk-headless x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 40 M 2024-03-04T12:17:18.879 INFO:teuthology.orchestra.run.smithi172.stdout: javapackages-filesystem noarch 6.0.0-4.el9 CentOS-AppStream 10 k 2024-03-04T12:17:18.880 INFO:teuthology.orchestra.run.smithi172.stdout: jbigkit-libs x86_64 2.1-23.el9 CentOS-AppStream 52 k 2024-03-04T12:17:18.880 INFO:teuthology.orchestra.run.smithi172.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 CentOS-AppStream 23 k 2024-03-04T12:17:18.880 INFO:teuthology.orchestra.run.smithi172.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-03-04T12:17:18.880 INFO:teuthology.orchestra.run.smithi172.stdout: jsoup noarch 1.13.1-10.el9 CentOS-AppStream 376 k 2024-03-04T12:17:18.880 INFO:teuthology.orchestra.run.smithi172.stdout: jsr-305 noarch 3.0.2-6.el9 CentOS-AppStream 31 k 2024-03-04T12:17:18.880 INFO:teuthology.orchestra.run.smithi172.stdout: lcms2 x86_64 2.12-3.el9 CentOS-AppStream 166 k 2024-03-04T12:17:18.880 INFO:teuthology.orchestra.run.smithi172.stdout: libX11-xcb x86_64 1.7.0-8.el9 appstream 11 k 2024-03-04T12:17:18.880 INFO:teuthology.orchestra.run.smithi172.stdout: libXcomposite x86_64 0.4.5-7.el9 CentOS-AppStream 23 k 2024-03-04T12:17:18.881 INFO:teuthology.orchestra.run.smithi172.stdout: libXcursor x86_64 1.2.0-7.el9 CentOS-AppStream 30 k 2024-03-04T12:17:18.881 INFO:teuthology.orchestra.run.smithi172.stdout: libXdamage x86_64 1.1.5-7.el9 CentOS-AppStream 22 k 2024-03-04T12:17:18.881 INFO:teuthology.orchestra.run.smithi172.stdout: libXfixes x86_64 5.0.3-16.el9 CentOS-AppStream 19 k 2024-03-04T12:17:18.881 INFO:teuthology.orchestra.run.smithi172.stdout: libXi x86_64 1.7.10-8.el9 CentOS-AppStream 38 k 2024-03-04T12:17:18.881 INFO:teuthology.orchestra.run.smithi172.stdout: libXinerama x86_64 1.1.4-10.el9 CentOS-AppStream 14 k 2024-03-04T12:17:18.881 INFO:teuthology.orchestra.run.smithi172.stdout: libXrandr x86_64 1.5.2-8.el9 CentOS-AppStream 27 k 2024-03-04T12:17:18.881 INFO:teuthology.orchestra.run.smithi172.stdout: libXtst x86_64 1.2.3-16.el9 CentOS-AppStream 20 k 2024-03-04T12:17:18.881 INFO:teuthology.orchestra.run.smithi172.stdout: libXv x86_64 1.0.11-16.el9 CentOS-AppStream 18 k 2024-03-04T12:17:18.881 INFO:teuthology.orchestra.run.smithi172.stdout: libXxf86vm x86_64 1.1.4-18.el9 CentOS-AppStream 18 k 2024-03-04T12:17:18.882 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-04T12:17:18.882 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-04T12:17:18.882 INFO:teuthology.orchestra.run.smithi172.stdout: libasyncns x86_64 0.8-22.el9 CentOS-AppStream 29 k 2024-03-04T12:17:18.882 INFO:teuthology.orchestra.run.smithi172.stdout: libcanberra x86_64 0.30-27.el9 CentOS-AppStream 85 k 2024-03-04T12:17:18.882 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 163 k 2024-03-04T12:17:18.882 INFO:teuthology.orchestra.run.smithi172.stdout: libdrm x86_64 2.4.117-1.el9 CentOS-AppStream 158 k 2024-03-04T12:17:18.882 INFO:teuthology.orchestra.run.smithi172.stdout: libepoxy x86_64 1.5.5-4.el9 CentOS-AppStream 240 k 2024-03-04T12:17:18.882 INFO:teuthology.orchestra.run.smithi172.stdout: libexif x86_64 0.6.22-6.el9 CentOS-AppStream 431 k 2024-03-04T12:17:18.883 INFO:teuthology.orchestra.run.smithi172.stdout: libfontenc x86_64 1.1.3-17.el9 CentOS-AppStream 30 k 2024-03-04T12:17:18.883 INFO:teuthology.orchestra.run.smithi172.stdout: libgexiv2 x86_64 0.12.3-1.el9 CentOS-AppStream 82 k 2024-03-04T12:17:18.883 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-03-04T12:17:18.883 INFO:teuthology.orchestra.run.smithi172.stdout: libglvnd x86_64 1:1.3.4-1.el9 CentOS-AppStream 134 k 2024-03-04T12:17:18.883 INFO:teuthology.orchestra.run.smithi172.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 CentOS-AppStream 36 k 2024-03-04T12:17:18.883 INFO:teuthology.orchestra.run.smithi172.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 CentOS-AppStream 141 k 2024-03-04T12:17:18.883 INFO:teuthology.orchestra.run.smithi172.stdout: libgsf x86_64 1.14.47-5.el9 CentOS-AppStream 245 k 2024-03-04T12:17:18.883 INFO:teuthology.orchestra.run.smithi172.stdout: libgxps x86_64 0.3.2-3.el9 CentOS-AppStream 78 k 2024-03-04T12:17:18.884 INFO:teuthology.orchestra.run.smithi172.stdout: libiptcdata x86_64 1.0.5-9.el9 CentOS-AppStream 61 k 2024-03-04T12:17:18.884 INFO:teuthology.orchestra.run.smithi172.stdout: libldac x86_64 2.0.2.3-10.el9 CentOS-AppStream 40 k 2024-03-04T12:17:18.884 INFO:teuthology.orchestra.run.smithi172.stdout: libnotify x86_64 0.7.9-8.el9 CentOS-AppStream 43 k 2024-03-04T12:17:18.884 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-04T12:17:18.884 INFO:teuthology.orchestra.run.smithi172.stdout: libogg x86_64 2:1.3.4-6.el9 CentOS-AppStream 32 k 2024-03-04T12:17:18.884 INFO:teuthology.orchestra.run.smithi172.stdout: libosinfo x86_64 1.10.0-1.el9 CentOS-AppStream 312 k 2024-03-04T12:17:18.884 INFO:teuthology.orchestra.run.smithi172.stdout: libpciaccess x86_64 0.16-6.el9 CentOS-BaseOS 27 k 2024-03-04T12:17:18.885 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-04T12:17:18.885 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-03-04T12:17:18.885 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-04T12:17:18.885 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 501 k 2024-03-04T12:17:18.885 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-04T12:17:18.885 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 5.2 M 2024-03-04T12:17:18.885 INFO:teuthology.orchestra.run.smithi172.stdout: libsbc x86_64 1.4-9.el9 CentOS-AppStream 44 k 2024-03-04T12:17:18.885 INFO:teuthology.orchestra.run.smithi172.stdout: libsndfile x86_64 1.0.31-8.el9 CentOS-AppStream 205 k 2024-03-04T12:17:18.886 INFO:teuthology.orchestra.run.smithi172.stdout: libtheora x86_64 1:1.1.1-31.el9 CentOS-AppStream 163 k 2024-03-04T12:17:18.886 INFO:teuthology.orchestra.run.smithi172.stdout: libtiff x86_64 4.4.0-12.el9 CentOS-AppStream 197 k 2024-03-04T12:17:18.886 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-ltdl x86_64 2.4.6-45.el9 CentOS-AppStream 36 k 2024-03-04T12:17:18.886 INFO:teuthology.orchestra.run.smithi172.stdout: libtracker-sparql x86_64 3.1.2-3.el9 CentOS-AppStream 316 k 2024-03-04T12:17:18.886 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-04T12:17:18.886 INFO:teuthology.orchestra.run.smithi172.stdout: libvisual x86_64 1:0.4.0-34.el9 CentOS-AppStream 143 k 2024-03-04T12:17:18.886 INFO:teuthology.orchestra.run.smithi172.stdout: libvorbis x86_64 1:1.3.7-5.el9 CentOS-AppStream 192 k 2024-03-04T12:17:18.886 INFO:teuthology.orchestra.run.smithi172.stdout: libwayland-client x86_64 1.21.0-1.el9 CentOS-AppStream 32 k 2024-03-04T12:17:18.887 INFO:teuthology.orchestra.run.smithi172.stdout: libwayland-cursor x86_64 1.21.0-1.el9 CentOS-AppStream 18 k 2024-03-04T12:17:18.887 INFO:teuthology.orchestra.run.smithi172.stdout: libwayland-egl x86_64 1.21.0-1.el9 CentOS-AppStream 12 k 2024-03-04T12:17:18.887 INFO:teuthology.orchestra.run.smithi172.stdout: libwayland-server x86_64 1.21.0-1.el9 CentOS-AppStream 41 k 2024-03-04T12:17:18.887 INFO:teuthology.orchestra.run.smithi172.stdout: libwebp x86_64 1.2.0-8.el9 CentOS-AppStream 276 k 2024-03-04T12:17:18.887 INFO:teuthology.orchestra.run.smithi172.stdout: libxkbcommon x86_64 1.0.3-4.el9 CentOS-AppStream 132 k 2024-03-04T12:17:18.887 INFO:teuthology.orchestra.run.smithi172.stdout: libxshmfence x86_64 1.3-10.el9 CentOS-AppStream 12 k 2024-03-04T12:17:18.887 INFO:teuthology.orchestra.run.smithi172.stdout: lksctp-tools x86_64 1.0.19-2.el9 CentOS-BaseOS 90 k 2024-03-04T12:17:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: low-memory-monitor x86_64 2.1-4.el9 CentOS-AppStream 35 k 2024-03-04T12:17:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-04T12:17:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-04T12:17:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-04T12:17:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: lua-posix x86_64 35.0-8.el9 CentOS-AppStream 131 k 2024-03-04T12:17:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-04T12:17:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: maven-lib noarch 1:3.6.3-15.el9 CentOS-AppStream 1.5 M 2024-03-04T12:17:18.888 INFO:teuthology.orchestra.run.smithi172.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 CentOS-AppStream 7.9 k 2024-03-04T12:17:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: maven-resolver noarch 1:1.6.1-10.el9 CentOS-AppStream 512 k 2024-03-04T12:17:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: maven-shared-utils noarch 3.3.4-3.el9 CentOS-AppStream 150 k 2024-03-04T12:17:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: maven-wagon noarch 3.4.2-7.el9 CentOS-AppStream 111 k 2024-03-04T12:17:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: mesa-libEGL x86_64 23.3.3-1.el9 CentOS-AppStream 126 k 2024-03-04T12:17:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: mesa-libGL x86_64 23.3.3-1.el9 CentOS-AppStream 167 k 2024-03-04T12:17:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: mesa-libgbm x86_64 23.3.3-1.el9 CentOS-AppStream 37 k 2024-03-04T12:17:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: mesa-libglapi x86_64 23.3.3-1.el9 CentOS-AppStream 43 k 2024-03-04T12:17:18.889 INFO:teuthology.orchestra.run.smithi172.stdout: mkfontscale x86_64 1.2.1-3.el9 CentOS-AppStream 31 k 2024-03-04T12:17:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-03-04T12:17:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-04T12:17:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-04T12:17:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: openjpeg2 x86_64 2.4.0-7.el9 CentOS-AppStream 162 k 2024-03-04T12:17:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: opus x86_64 1.3.1-10.el9 CentOS-AppStream 199 k 2024-03-04T12:17:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: orc x86_64 0.4.31-6.el9 CentOS-AppStream 183 k 2024-03-04T12:17:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: osinfo-db noarch 20231215-1.el9 CentOS-AppStream 283 k 2024-03-04T12:17:18.890 INFO:teuthology.orchestra.run.smithi172.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 CentOS-AppStream 68 k 2024-03-04T12:17:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: ostree-libs x86_64 2024.4-3.el9 appstream 487 k 2024-03-04T12:17:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-04T12:17:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 CentOS-AppStream 134 k 2024-03-04T12:17:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: pipewire-libs x86_64 1.0.1-1.el9 CentOS-AppStream 1.9 M 2024-03-04T12:17:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: plexus-cipher noarch 1.7-27.el9 CentOS-AppStream 25 k 2024-03-04T12:17:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: plexus-classworlds noarch 2.6.0-11.el9 CentOS-AppStream 59 k 2024-03-04T12:17:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 CentOS-AppStream 17 k 2024-03-04T12:17:18.891 INFO:teuthology.orchestra.run.smithi172.stdout: plexus-interpolation noarch 1.26-11.el9 CentOS-AppStream 79 k 2024-03-04T12:17:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 CentOS-AppStream 33 k 2024-03-04T12:17:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: plexus-utils noarch 3.3.0-10.el9 CentOS-AppStream 253 k 2024-03-04T12:17:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: poppler x86_64 21.01.0-19.el9 CentOS-AppStream 1.1 M 2024-03-04T12:17:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: poppler-data noarch 0.4.9-9.el9 CentOS-AppStream 1.8 M 2024-03-04T12:17:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: poppler-glib x86_64 21.01.0-19.el9 CentOS-AppStream 151 k 2024-03-04T12:17:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-04T12:17:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-04T12:17:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: publicsuffix-list noarch 20210518-3.el9 CentOS-AppStream 82 k 2024-03-04T12:17:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: pulseaudio-libs x86_64 15.0-2.el9 CentOS-AppStream 666 k 2024-03-04T12:17:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-04T12:17:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-04T12:17:18.892 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-04T12:17:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-04T12:17:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 45 k 2024-03-04T12:17:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.0.0-1871.g3aec3903.el9 ceph 131 k 2024-03-04T12:17:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-04T12:17:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-04T12:17:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-04T12:17:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-04T12:17:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-04T12:17:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-04T12:17:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-04T12:17:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-04T12:17:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-04T12:17:18.893 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-04T12:17:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-04T12:17:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-04T12:17:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-04T12:17:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-04T12:17:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-03-04T12:17:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-04T12:17:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-04T12:17:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-04T12:17:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-04T12:17:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-04T12:17:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-04T12:17:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-04T12:17:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-04T12:17:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-04T12:17:18.894 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-04T12:17:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-04T12:17:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-04T12:17:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-04T12:17:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-04T12:17:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-04T12:17:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-04T12:17:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-04T12:17:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-04T12:17:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-04T12:17:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-04T12:17:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-04T12:17:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-04T12:17:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-04T12:17:18.895 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-03-04T12:17:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-04T12:17:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-04T12:17:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-04T12:17:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-04T12:17:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-04T12:17:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-04T12:17:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-04T12:17:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-04T12:17:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-04T12:17:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-04T12:17:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-04T12:17:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-04T12:17:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-03-04T12:17:18.896 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-03-04T12:17:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-04T12:17:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: rtkit x86_64 0.11-28.el9 CentOS-AppStream 55 k 2024-03-04T12:17:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: sisu noarch 1:0.3.4-10.el9 CentOS-AppStream 509 k 2024-03-04T12:17:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: slf4j noarch 1.7.30-13.el9 CentOS-AppStream 68 k 2024-03-04T12:17:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-04T12:17:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: sound-theme-freedesktop noarch 0.8-17.el9 CentOS-AppStream 377 k 2024-03-04T12:17:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-04T12:17:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: totem-pl-parser x86_64 3.26.6-2.el9 CentOS-AppStream 130 k 2024-03-04T12:17:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: ttmkfdir x86_64 3.0.9-65.el9 CentOS-AppStream 52 k 2024-03-04T12:17:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: tzdata-java noarch 2024a-1.el9 CentOS-AppStream 148 k 2024-03-04T12:17:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: upower x86_64 0.99.11-11.el9 CentOS-AppStream 168 k 2024-03-04T12:17:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 CentOS-AppStream 305 k 2024-03-04T12:17:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: wireplumber x86_64 0.4.14-1.el9 CentOS-AppStream 83 k 2024-03-04T12:17:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: wireplumber-libs x86_64 0.4.14-1.el9 CentOS-AppStream 337 k 2024-03-04T12:17:18.897 INFO:teuthology.orchestra.run.smithi172.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 CentOS-AppStream 41 k 2024-03-04T12:17:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 CentOS-AppStream 367 k 2024-03-04T12:17:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: xkeyboard-config noarch 2.33-2.el9 CentOS-AppStream 780 k 2024-03-04T12:17:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-04T12:17:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 CentOS-AppStream 499 k 2024-03-04T12:17:18.898 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-03-04T12:17:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: dconf x86_64 0.40.0-6.el9 CentOS-AppStream 108 k 2024-03-04T12:17:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: exiv2 x86_64 0.27.5-2.el9 CentOS-AppStream 978 k 2024-03-04T12:17:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: flatpak x86_64 1.12.8-1.el9 CentOS-AppStream 1.7 M 2024-03-04T12:17:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: gtk3 x86_64 3.24.31-2.el9 CentOS-AppStream 4.8 M 2024-03-04T12:17:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: java-11-openjdk-devel x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 3.3 M 2024-03-04T12:17:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 CentOS-AppStream 31 k 2024-03-04T12:17:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: p11-kit-server x86_64 0.24.1-2.el9 appstream 199 k 2024-03-04T12:17:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: pipewire x86_64 1.0.1-1.el9 CentOS-AppStream 101 k 2024-03-04T12:17:18.898 INFO:teuthology.orchestra.run.smithi172.stdout: pipewire-alsa x86_64 1.0.1-1.el9 CentOS-AppStream 56 k 2024-03-04T12:17:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 CentOS-AppStream 8.0 k 2024-03-04T12:17:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 CentOS-AppStream 185 k 2024-03-04T12:17:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-03-04T12:17:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: tracker x86_64 3.1.2-3.el9 CentOS-AppStream 537 k 2024-03-04T12:17:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: tracker-miners x86_64 3.1.2-4.el9 CentOS-AppStream 893 k 2024-03-04T12:17:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 CentOS-AppStream 130 k 2024-03-04T12:17:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:17:18.899 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-03-04T12:17:18.899 INFO:teuthology.orchestra.run.smithi172.stdout:=========================================================================================================== 2024-03-04T12:17:18.899 INFO:teuthology.orchestra.run.smithi172.stdout:Install 282 Packages 2024-03-04T12:17:18.899 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 2 Packages 2024-03-04T12:17:18.899 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:17:18.900 INFO:teuthology.orchestra.run.smithi110.stdout:(41/284): apache-commons-io-2.8.0-8.el9.noarch. 997 kB/s | 282 kB 00:00 2024-03-04T12:17:18.901 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 296 M 2024-03-04T12:17:18.901 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-03-04T12:17:19.027 INFO:teuthology.orchestra.run.smithi110.stdout:(42/284): adwaita-icon-theme-40.1.1-3.el9.noarc 9.6 MB/s | 11 MB 00:01 2024-03-04T12:17:19.060 INFO:teuthology.orchestra.run.smithi110.stdout:(43/284): apache-commons-lang3-3.12.0-6.el9.noa 1.9 MB/s | 558 kB 00:00 2024-03-04T12:17:19.085 INFO:teuthology.orchestra.run.smithi110.stdout:(44/284): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 431 kB/s | 86 kB 00:00 2024-03-04T12:17:19.111 INFO:teuthology.orchestra.run.smithi110.stdout:(45/284): at-spi2-core-2.40.3-1.el9.x86_64.rpm 2.1 MB/s | 176 kB 00:00 2024-03-04T12:17:19.136 INFO:teuthology.orchestra.run.smithi110.stdout:(46/284): atinject-1.0.3-6.el9.noarch.rpm 447 kB/s | 22 kB 00:00 2024-03-04T12:17:19.161 INFO:teuthology.orchestra.run.smithi110.stdout:(47/284): atk-2.36.0-5.el9.x86_64.rpm 3.5 MB/s | 270 kB 00:00 2024-03-04T12:17:19.186 INFO:teuthology.orchestra.run.smithi110.stdout:(48/284): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 106 kB 00:00 2024-03-04T12:17:19.212 INFO:teuthology.orchestra.run.smithi110.stdout:(49/284): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 52 kB 00:00 2024-03-04T12:17:19.240 INFO:teuthology.orchestra.run.smithi110.stdout:(50/284): colord-libs-1.4.5-4.el9.x86_64.rpm 3.0 MB/s | 228 kB 00:00 2024-03-04T12:17:19.262 INFO:teuthology.orchestra.run.smithi110.stdout:(51/284): copy-jdk-configs-4.0-3.el9.noarch.rpm 363 kB/s | 27 kB 00:00 2024-03-04T12:17:19.287 INFO:teuthology.orchestra.run.smithi110.stdout:(52/284): dconf-0.40.0-6.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-03-04T12:17:19.321 INFO:teuthology.orchestra.run.smithi110.stdout:(53/284): exempi-2.6.0-0.2.20211007gite23c213.e 6.1 MB/s | 524 kB 00:00 2024-03-04T12:17:19.363 INFO:teuthology.orchestra.run.smithi110.stdout:(54/284): exiv2-0.27.5-2.el9.x86_64.rpm 9.6 MB/s | 978 kB 00:00 2024-03-04T12:17:19.388 INFO:teuthology.orchestra.run.smithi110.stdout:(55/284): exiv2-libs-0.27.5-2.el9.x86_64.rpm 7.6 MB/s | 780 kB 00:00 2024-03-04T12:17:19.413 INFO:teuthology.orchestra.run.smithi110.stdout:(56/284): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.5 MB/s | 324 kB 00:00 2024-03-04T12:17:19.480 INFO:teuthology.orchestra.run.smithi110.stdout:(57/284): flatpak-1.12.8-1.el9.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2024-03-04T12:17:19.505 INFO:teuthology.orchestra.run.smithi110.stdout:(58/284): flatpak-selinux-1.12.8-1.el9.noarch.r 225 kB/s | 20 kB 00:00 2024-03-04T12:17:19.531 INFO:teuthology.orchestra.run.smithi110.stdout:(59/284): flatpak-session-helper-1.12.8-1.el9.x 632 kB/s | 73 kB 00:00 2024-03-04T12:17:19.556 INFO:teuthology.orchestra.run.smithi110.stdout:(60/284): flexiblas-3.0.4-8.el9.x86_64.rpm 422 kB/s | 32 kB 00:00 2024-03-04T12:17:19.706 INFO:teuthology.orchestra.run.smithi110.stdout:(61/284): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-03-04T12:17:19.732 INFO:teuthology.orchestra.run.smithi110.stdout:(62/284): flexiblas-openblas-openmp-3.0.4-8.el9 85 kB/s | 17 kB 00:00 2024-03-04T12:17:19.757 INFO:teuthology.orchestra.run.smithi110.stdout:(63/284): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 420 kB/s | 84 kB 00:00 2024-03-04T12:17:19.782 INFO:teuthology.orchestra.run.smithi110.stdout:(64/284): geoclue2-2.6.0-7.el9.x86_64.rpm 1.6 MB/s | 122 kB 00:00 2024-03-04T12:17:19.797 INFO:teuthology.orchestra.run.smithi172.stdout:(1/284): ceph-19.0.0-1871.g3aec3903.el9.x86_64. 32 kB/s | 6.6 kB 00:00 2024-03-04T12:17:19.807 INFO:teuthology.orchestra.run.smithi110.stdout:(65/284): giflib-5.2.1-9.el9.x86_64.rpm 955 kB/s | 47 kB 00:00 2024-03-04T12:17:19.832 INFO:teuthology.orchestra.run.smithi110.stdout:(66/284): google-guice-4.2.3-9.el9.noarch.rpm 6.2 MB/s | 472 kB 00:00 2024-03-04T12:17:19.858 INFO:teuthology.orchestra.run.smithi110.stdout:(67/284): graphene-1.10.6-2.el9.x86_64.rpm 849 kB/s | 63 kB 00:00 2024-03-04T12:17:19.883 INFO:teuthology.orchestra.run.smithi110.stdout:(68/284): gsm-1.0.19-6.el9.x86_64.rpm 440 kB/s | 33 kB 00:00 2024-03-04T12:17:20.016 INFO:teuthology.orchestra.run.smithi110.stdout:(69/284): gstreamer1-1.22.1-2.el9.x86_64.rpm 8.9 MB/s | 1.4 MB 00:00 2024-03-04T12:17:20.067 INFO:teuthology.orchestra.run.smithi110.stdout:(70/284): gstreamer1-plugins-base-1.22.1-2.el9. 11 MB/s | 2.2 MB 00:00 2024-03-04T12:17:20.084 INFO:teuthology.orchestra.run.smithi110.stdout:(71/284): gtk-update-icon-cache-3.24.31-2.el9.x 171 kB/s | 34 kB 00:00 2024-03-04T12:17:20.276 INFO:teuthology.orchestra.run.smithi110.stdout:(72/284): gtk3-3.24.31-2.el9.x86_64.rpm 19 MB/s | 4.8 MB 00:00 2024-03-04T12:17:20.300 INFO:teuthology.orchestra.run.smithi110.stdout:(73/284): hicolor-icon-theme-0.17-13.el9.noarch 306 kB/s | 65 kB 00:00 2024-03-04T12:17:20.351 INFO:teuthology.orchestra.run.smithi110.stdout:(74/284): guava-30.1-6.el9.noarch.rpm 8.7 MB/s | 2.3 MB 00:00 2024-03-04T12:17:20.356 INFO:teuthology.orchestra.run.smithi172.stdout:(2/284): ceph-fuse-19.0.0-1871.g3aec3903.el9.x8 1.6 MB/s | 887 kB 00:00 2024-03-04T12:17:20.376 INFO:teuthology.orchestra.run.smithi110.stdout:(75/284): httpcomponents-client-4.5.13-3.el9.no 6.4 MB/s | 656 kB 00:00 2024-03-04T12:17:20.401 INFO:teuthology.orchestra.run.smithi110.stdout:(76/284): httpcomponents-core-4.4.13-7.el9.noar 6.3 MB/s | 630 kB 00:00 2024-03-04T12:17:20.514 INFO:teuthology.orchestra.run.smithi172.stdout:(3/284): ceph-immutable-object-cache-19.0.0-187 918 kB/s | 145 kB 00:00 2024-03-04T12:17:20.535 INFO:teuthology.orchestra.run.smithi110.stdout:(77/284): iso-codes-4.6.0-3.el9.noarch.rpm 18 MB/s | 3.3 MB 00:00 2024-03-04T12:17:20.560 INFO:teuthology.orchestra.run.smithi110.stdout:(78/284): jakarta-annotations-1.3.5-13.el9.noar 281 kB/s | 44 kB 00:00 2024-03-04T12:17:20.577 INFO:teuthology.orchestra.run.smithi110.stdout:(79/284): jansi-2.3.3-6.el9.x86_64.rpm 626 kB/s | 108 kB 00:00 2024-03-04T12:17:20.610 INFO:teuthology.orchestra.run.smithi110.stdout:(80/284): java-11-openjdk-11.0.18.0.10-3.el9.x8 5.7 MB/s | 439 kB 00:00 2024-03-04T12:17:20.844 INFO:teuthology.orchestra.run.smithi110.stdout:(81/284): java-11-openjdk-devel-11.0.18.0.10-3. 12 MB/s | 3.3 MB 00:00 2024-03-04T12:17:20.869 INFO:teuthology.orchestra.run.smithi110.stdout:(82/284): javapackages-filesystem-6.0.0-4.el9.n 40 kB/s | 10 kB 00:00 2024-03-04T12:17:21.048 INFO:teuthology.orchestra.run.smithi172.stdout:(4/284): ceph-common-19.0.0-1871.g3aec3903.el9. 14 MB/s | 20 MB 00:01 2024-03-04T12:17:21.111 INFO:teuthology.orchestra.run.smithi110.stdout:(83/284): jbigkit-libs-2.1-23.el9.x86_64.rpm 195 kB/s | 52 kB 00:00 2024-03-04T12:17:21.136 INFO:teuthology.orchestra.run.smithi110.stdout:(84/284): jcl-over-slf4j-1.7.30-13.el9.noarch.r 86 kB/s | 23 kB 00:00 2024-03-04T12:17:21.140 INFO:teuthology.orchestra.run.smithi172.stdout:(5/284): ceph-base-19.0.0-1871.g3aec3903.el9.x8 3.5 MB/s | 5.3 MB 00:01 2024-03-04T12:17:21.182 INFO:teuthology.orchestra.run.smithi172.stdout:(6/284): ceph-mgr-19.0.0-1871.g3aec3903.el9.x86 11 MB/s | 1.5 MB 00:00 2024-03-04T12:17:21.404 INFO:teuthology.orchestra.run.smithi110.stdout:(85/284): jsr-305-3.0.2-6.el9.noarch.rpm 116 kB/s | 31 kB 00:00 2024-03-04T12:17:21.429 INFO:teuthology.orchestra.run.smithi110.stdout:(86/284): jsoup-1.13.1-10.el9.noarch.rpm 1.3 MB/s | 376 kB 00:00 2024-03-04T12:17:21.637 INFO:teuthology.orchestra.run.smithi110.stdout:(87/284): lcms2-2.12-3.el9.x86_64.rpm 717 kB/s | 166 kB 00:00 2024-03-04T12:17:21.691 INFO:teuthology.orchestra.run.smithi172.stdout:(7/284): ceph-mds-19.0.0-1871.g3aec3903.el9.x86 1.8 MB/s | 2.1 MB 00:01 2024-03-04T12:17:21.721 INFO:teuthology.orchestra.run.smithi110.stdout:(88/284): libXcomposite-0.4.5-7.el9.x86_64.rpm 79 kB/s | 23 kB 00:00 2024-03-04T12:17:22.113 INFO:teuthology.orchestra.run.smithi110.stdout:(89/284): java-11-openjdk-headless-11.0.18.0.10 26 MB/s | 40 MB 00:01 2024-03-04T12:17:22.138 INFO:teuthology.orchestra.run.smithi110.stdout:(90/284): libXcursor-1.2.0-7.el9.x86_64.rpm 59 kB/s | 30 kB 00:00 2024-03-04T12:17:22.147 INFO:teuthology.orchestra.run.smithi172.stdout:(8/284): ceph-osd-19.0.0-1871.g3aec3903.el9.x86 17 MB/s | 17 MB 00:00 2024-03-04T12:17:22.163 INFO:teuthology.orchestra.run.smithi110.stdout:(91/284): libXdamage-1.1.5-7.el9.x86_64.rpm 49 kB/s | 22 kB 00:00 2024-03-04T12:17:22.189 INFO:teuthology.orchestra.run.smithi110.stdout:(92/284): libXfixes-5.0.3-16.el9.x86_64.rpm 250 kB/s | 19 kB 00:00 2024-03-04T12:17:22.199 INFO:teuthology.orchestra.run.smithi172.stdout:(9/284): ceph-selinux-19.0.0-1871.g3aec3903.el9 490 kB/s | 25 kB 00:00 2024-03-04T12:17:22.214 INFO:teuthology.orchestra.run.smithi110.stdout:(93/284): libXi-1.7.10-8.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-03-04T12:17:22.239 INFO:teuthology.orchestra.run.smithi110.stdout:(94/284): libXinerama-1.1.4-10.el9.x86_64.rpm 186 kB/s | 14 kB 00:00 2024-03-04T12:17:22.258 INFO:teuthology.orchestra.run.smithi172.stdout:(10/284): ceph-mon-19.0.0-1871.g3aec3903.el9.x8 4.2 MB/s | 4.7 MB 00:01 2024-03-04T12:17:22.264 INFO:teuthology.orchestra.run.smithi110.stdout:(95/284): libXrandr-1.5.2-8.el9.x86_64.rpm 364 kB/s | 27 kB 00:00 2024-03-04T12:17:22.315 INFO:teuthology.orchestra.run.smithi110.stdout:(96/284): libXtst-1.2.3-16.el9.x86_64.rpm 272 kB/s | 20 kB 00:00 2024-03-04T12:17:22.340 INFO:teuthology.orchestra.run.smithi110.stdout:(97/284): libXv-1.0.11-16.el9.x86_64.rpm 180 kB/s | 18 kB 00:00 2024-03-04T12:17:22.342 INFO:teuthology.orchestra.run.smithi172.stdout:(11/284): libcephfs-devel-19.0.0-1871.g3aec3903 376 kB/s | 31 kB 00:00 2024-03-04T12:17:22.365 INFO:teuthology.orchestra.run.smithi110.stdout:(98/284): libXxf86vm-1.1.4-18.el9.x86_64.rpm 176 kB/s | 18 kB 00:00 2024-03-04T12:17:22.390 INFO:teuthology.orchestra.run.smithi110.stdout:(99/284): libasyncns-0.8-22.el9.x86_64.rpm 585 kB/s | 29 kB 00:00 2024-03-04T12:17:22.416 INFO:teuthology.orchestra.run.smithi110.stdout:(100/284): libcanberra-0.30-27.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2024-03-04T12:17:22.441 INFO:teuthology.orchestra.run.smithi110.stdout:(101/284): libcanberra-gtk3-0.30-27.el9.x86_64. 409 kB/s | 31 kB 00:00 2024-03-04T12:17:22.474 INFO:teuthology.orchestra.run.smithi110.stdout:(102/284): libdrm-2.4.117-1.el9.x86_64.rpm 2.7 MB/s | 158 kB 00:00 2024-03-04T12:17:22.500 INFO:teuthology.orchestra.run.smithi110.stdout:(103/284): libepoxy-1.5.5-4.el9.x86_64.rpm 2.8 MB/s | 240 kB 00:00 2024-03-04T12:17:22.525 INFO:teuthology.orchestra.run.smithi110.stdout:(104/284): libexif-0.6.22-6.el9.x86_64.rpm 5.0 MB/s | 431 kB 00:00 2024-03-04T12:17:22.550 INFO:teuthology.orchestra.run.smithi110.stdout:(105/284): libfontenc-1.1.3-17.el9.x86_64.rpm 403 kB/s | 30 kB 00:00 2024-03-04T12:17:22.575 INFO:teuthology.orchestra.run.smithi110.stdout:(106/284): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.1 MB/s | 82 kB 00:00 2024-03-04T12:17:22.576 INFO:teuthology.orchestra.run.smithi172.stdout:(12/284): libcephfs2-19.0.0-1871.g3aec3903.el9. 3.1 MB/s | 744 kB 00:00 2024-03-04T12:17:22.601 INFO:teuthology.orchestra.run.smithi110.stdout:(107/284): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 718 kB/s | 36 kB 00:00 2024-03-04T12:17:22.626 INFO:teuthology.orchestra.run.smithi110.stdout:(108/284): libglvnd-1.3.4-1.el9.x86_64.rpm 1.7 MB/s | 134 kB 00:00 2024-03-04T12:17:22.667 INFO:teuthology.orchestra.run.smithi172.stdout:(13/284): libcephsqlite-19.0.0-1871.g3aec3903.e 1.7 MB/s | 163 kB 00:00 2024-03-04T12:17:22.693 INFO:teuthology.orchestra.run.smithi110.stdout:(109/284): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.2 MB/s | 141 kB 00:00 2024-03-04T12:17:22.718 INFO:teuthology.orchestra.run.smithi110.stdout:(110/284): libgsf-1.14.47-5.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-03-04T12:17:22.743 INFO:teuthology.orchestra.run.smithi110.stdout:(111/284): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 78 kB 00:00 2024-03-04T12:17:22.751 INFO:teuthology.orchestra.run.smithi172.stdout:(14/284): librados-devel-19.0.0-1871.g3aec3903. 1.5 MB/s | 127 kB 00:00 2024-03-04T12:17:22.768 INFO:teuthology.orchestra.run.smithi110.stdout:(112/284): libiptcdata-1.0.5-9.el9.x86_64.rpm 810 kB/s | 61 kB 00:00 2024-03-04T12:17:22.794 INFO:teuthology.orchestra.run.smithi110.stdout:(113/284): libldac-2.0.2.3-10.el9.x86_64.rpm 536 kB/s | 40 kB 00:00 2024-03-04T12:17:22.819 INFO:teuthology.orchestra.run.smithi110.stdout:(114/284): libnotify-0.7.9-8.el9.x86_64.rpm 853 kB/s | 43 kB 00:00 2024-03-04T12:17:22.844 INFO:teuthology.orchestra.run.smithi110.stdout:(115/284): libogg-1.3.4-6.el9.x86_64.rpm 433 kB/s | 32 kB 00:00 2024-03-04T12:17:22.878 INFO:teuthology.orchestra.run.smithi110.stdout:(116/284): libosinfo-1.10.0-1.el9.x86_64.rpm 3.7 MB/s | 312 kB 00:00 2024-03-04T12:17:22.903 INFO:teuthology.orchestra.run.smithi110.stdout:(117/284): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-03-04T12:17:22.918 INFO:teuthology.orchestra.run.smithi172.stdout:(15/284): libradosstriper1-19.0.0-1871.g3aec390 2.9 MB/s | 501 kB 00:00 2024-03-04T12:17:22.928 INFO:teuthology.orchestra.run.smithi110.stdout:(118/284): librabbitmq-0.11.0-7.el9.x86_64.rpm 533 kB/s | 44 kB 00:00 2024-03-04T12:17:22.953 INFO:teuthology.orchestra.run.smithi110.stdout:(119/284): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-03-04T12:17:22.978 INFO:teuthology.orchestra.run.smithi110.stdout:(120/284): libsbc-1.4-9.el9.x86_64.rpm 895 kB/s | 44 kB 00:00 2024-03-04T12:17:23.004 INFO:teuthology.orchestra.run.smithi110.stdout:(121/284): libsndfile-1.0.31-8.el9.x86_64.rpm 2.7 MB/s | 205 kB 00:00 2024-03-04T12:17:23.029 INFO:teuthology.orchestra.run.smithi110.stdout:(122/284): libtheora-1.1.1-31.el9.x86_64.rpm 2.1 MB/s | 163 kB 00:00 2024-03-04T12:17:23.063 INFO:teuthology.orchestra.run.smithi110.stdout:(123/284): libtiff-4.4.0-12.el9.x86_64.rpm 3.3 MB/s | 197 kB 00:00 2024-03-04T12:17:23.080 INFO:teuthology.orchestra.run.smithi110.stdout:(124/284): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 479 kB/s | 36 kB 00:00 2024-03-04T12:17:23.105 INFO:teuthology.orchestra.run.smithi110.stdout:(125/284): libtracker-sparql-3.1.2-3.el9.x86_64 4.1 MB/s | 316 kB 00:00 2024-03-04T12:17:23.130 INFO:teuthology.orchestra.run.smithi110.stdout:(126/284): libvisual-0.4.0-34.el9.x86_64.rpm 2.8 MB/s | 143 kB 00:00 2024-03-04T12:17:23.155 INFO:teuthology.orchestra.run.smithi110.stdout:(127/284): libvorbis-1.3.7-5.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-03-04T12:17:23.181 INFO:teuthology.orchestra.run.smithi110.stdout:(128/284): libwayland-client-1.21.0-1.el9.x86_6 431 kB/s | 32 kB 00:00 2024-03-04T12:17:23.206 INFO:teuthology.orchestra.run.smithi110.stdout:(129/284): libwayland-cursor-1.21.0-1.el9.x86_6 367 kB/s | 18 kB 00:00 2024-03-04T12:17:23.231 INFO:teuthology.orchestra.run.smithi110.stdout:(130/284): libwayland-egl-1.21.0-1.el9.x86_64.r 157 kB/s | 12 kB 00:00 2024-03-04T12:17:23.256 INFO:teuthology.orchestra.run.smithi110.stdout:(131/284): libwayland-server-1.21.0-1.el9.x86_6 542 kB/s | 41 kB 00:00 2024-03-04T12:17:23.282 INFO:teuthology.orchestra.run.smithi110.stdout:(132/284): libwebp-1.2.0-8.el9.x86_64.rpm 5.4 MB/s | 276 kB 00:00 2024-03-04T12:17:23.307 INFO:teuthology.orchestra.run.smithi110.stdout:(133/284): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.7 MB/s | 132 kB 00:00 2024-03-04T12:17:23.332 INFO:teuthology.orchestra.run.smithi110.stdout:(134/284): libxshmfence-1.3-10.el9.x86_64.rpm 155 kB/s | 12 kB 00:00 2024-03-04T12:17:23.358 INFO:teuthology.orchestra.run.smithi110.stdout:(135/284): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-04T12:17:23.382 INFO:teuthology.orchestra.run.smithi110.stdout:(136/284): low-memory-monitor-2.1-4.el9.x86_64. 462 kB/s | 35 kB 00:00 2024-03-04T12:17:23.408 INFO:teuthology.orchestra.run.smithi110.stdout:(137/284): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2024-03-04T12:17:23.433 INFO:teuthology.orchestra.run.smithi110.stdout:(138/284): lua-posix-35.0-8.el9.x86_64.rpm 1.7 MB/s | 131 kB 00:00 2024-03-04T12:17:23.450 INFO:teuthology.orchestra.run.smithi110.stdout:(139/284): maven-3.6.3-15.el9.noarch.rpm 402 kB/s | 17 kB 00:00 2024-03-04T12:17:23.500 INFO:teuthology.orchestra.run.smithi110.stdout:(140/284): maven-lib-3.6.3-15.el9.noarch.rpm 16 MB/s | 1.5 MB 00:00 2024-03-04T12:17:23.525 INFO:teuthology.orchestra.run.smithi110.stdout:(141/284): maven-openjdk11-3.6.3-15.el9.noarch. 87 kB/s | 7.9 kB 00:00 2024-03-04T12:17:23.551 INFO:teuthology.orchestra.run.smithi110.stdout:(142/284): maven-resolver-1.6.1-10.el9.noarch.r 5.0 MB/s | 512 kB 00:00 2024-03-04T12:17:23.576 INFO:teuthology.orchestra.run.smithi110.stdout:(143/284): maven-shared-utils-3.3.4-3.el9.noarc 3.0 MB/s | 150 kB 00:00 2024-03-04T12:17:23.601 INFO:teuthology.orchestra.run.smithi110.stdout:(144/284): maven-wagon-3.4.2-7.el9.noarch.rpm 1.5 MB/s | 111 kB 00:00 2024-03-04T12:17:23.626 INFO:teuthology.orchestra.run.smithi110.stdout:(145/284): mesa-libEGL-23.3.3-1.el9.x86_64.rpm 1.6 MB/s | 126 kB 00:00 2024-03-04T12:17:23.652 INFO:teuthology.orchestra.run.smithi110.stdout:(146/284): mesa-libgbm-23.3.3-1.el9.x86_64.rpm 734 kB/s | 37 kB 00:00 2024-03-04T12:17:23.677 INFO:teuthology.orchestra.run.smithi110.stdout:(147/284): mesa-libGL-23.3.3-1.el9.x86_64.rpm 2.2 MB/s | 167 kB 00:00 2024-03-04T12:17:23.702 INFO:teuthology.orchestra.run.smithi110.stdout:(148/284): mesa-libglapi-23.3.3-1.el9.x86_64.rp 573 kB/s | 43 kB 00:00 2024-03-04T12:17:23.727 INFO:teuthology.orchestra.run.smithi110.stdout:(149/284): mkfontscale-1.2.1-3.el9.x86_64.rpm 417 kB/s | 31 kB 00:00 2024-03-04T12:17:23.753 INFO:teuthology.orchestra.run.smithi110.stdout:(150/284): openblas-0.3.21-2.el9.x86_64.rpm 684 kB/s | 34 kB 00:00 2024-03-04T12:17:23.945 INFO:teuthology.orchestra.run.smithi110.stdout:(151/284): openblas-openmp-0.3.21-2.el9.x86_64. 20 MB/s | 4.7 MB 00:00 2024-03-04T12:17:23.970 INFO:teuthology.orchestra.run.smithi110.stdout:(152/284): openjpeg2-2.4.0-7.el9.x86_64.rpm 671 kB/s | 162 kB 00:00 2024-03-04T12:17:23.995 INFO:teuthology.orchestra.run.smithi110.stdout:(153/284): opus-1.3.1-10.el9.x86_64.rpm 825 kB/s | 199 kB 00:00 2024-03-04T12:17:24.018 INFO:teuthology.orchestra.run.smithi172.stdout:(16/284): librgw2-19.0.0-1871.g3aec3903.el9.x86 4.7 MB/s | 5.2 MB 00:01 2024-03-04T12:17:24.020 INFO:teuthology.orchestra.run.smithi110.stdout:(154/284): orc-0.4.31-6.el9.x86_64.rpm 2.4 MB/s | 183 kB 00:00 2024-03-04T12:17:24.037 INFO:teuthology.orchestra.run.smithi110.stdout:(155/284): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.6 MB/s | 68 kB 00:00 2024-03-04T12:17:24.062 INFO:teuthology.orchestra.run.smithi110.stdout:(156/284): osinfo-db-20231215-1.el9.noarch.rpm 4.2 MB/s | 283 kB 00:00 2024-03-04T12:17:24.087 INFO:teuthology.orchestra.run.smithi110.stdout:(157/284): pipewire-1.0.1-1.el9.x86_64.rpm 1.5 MB/s | 101 kB 00:00 2024-03-04T12:17:24.101 INFO:teuthology.orchestra.run.smithi172.stdout:(17/284): python3-ceph-argparse-19.0.0-1871.g3a 543 kB/s | 45 kB 00:00 2024-03-04T12:17:24.121 INFO:teuthology.orchestra.run.smithi110.stdout:(158/284): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 674 kB/s | 56 kB 00:00 2024-03-04T12:17:24.149 INFO:teuthology.orchestra.run.smithi110.stdout:(159/284): pipewire-jack-audio-connection-kit-1 138 kB/s | 8.0 kB 00:00 2024-03-04T12:17:24.172 INFO:teuthology.orchestra.run.smithi110.stdout:(160/284): pipewire-jack-audio-connection-kit-l 1.6 MB/s | 134 kB 00:00 2024-03-04T12:17:24.193 INFO:teuthology.orchestra.run.smithi172.stdout:(18/284): python3-ceph-common-19.0.0-1871.g3aec 1.4 MB/s | 131 kB 00:00 2024-03-04T12:17:24.239 INFO:teuthology.orchestra.run.smithi110.stdout:(161/284): pipewire-libs-1.0.1-1.el9.x86_64.rpm 16 MB/s | 1.9 MB 00:00 2024-03-04T12:17:24.264 INFO:teuthology.orchestra.run.smithi110.stdout:(162/284): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.0 MB/s | 185 kB 00:00 2024-03-04T12:17:24.289 INFO:teuthology.orchestra.run.smithi110.stdout:(163/284): plexus-cipher-1.7-27.el9.noarch.rpm 215 kB/s | 25 kB 00:00 2024-03-04T12:17:24.293 INFO:teuthology.orchestra.run.smithi172.stdout:(19/284): python3-cephfs-19.0.0-1871.g3aec3903. 1.6 MB/s | 161 kB 00:00 2024-03-04T12:17:24.314 INFO:teuthology.orchestra.run.smithi110.stdout:(164/284): plexus-classworlds-2.6.0-11.el9.noar 787 kB/s | 59 kB 00:00 2024-03-04T12:17:24.339 INFO:teuthology.orchestra.run.smithi110.stdout:(165/284): plexus-containers-component-annotati 347 kB/s | 17 kB 00:00 2024-03-04T12:17:24.357 INFO:teuthology.orchestra.run.smithi110.stdout:(166/284): plexus-interpolation-1.26-11.el9.noa 1.2 MB/s | 79 kB 00:00 2024-03-04T12:17:24.382 INFO:teuthology.orchestra.run.smithi110.stdout:(167/284): plexus-sec-dispatcher-1.4-37.el9.noa 487 kB/s | 33 kB 00:00 2024-03-04T12:17:24.407 INFO:teuthology.orchestra.run.smithi110.stdout:(168/284): plexus-utils-3.3.0-10.el9.noarch.rpm 5.0 MB/s | 253 kB 00:00 2024-03-04T12:17:24.410 INFO:teuthology.orchestra.run.smithi172.stdout:(20/284): python3-rados-19.0.0-1871.g3aec3903.e 2.7 MB/s | 320 kB 00:00 2024-03-04T12:17:24.457 INFO:teuthology.orchestra.run.smithi110.stdout:(169/284): poppler-21.01.0-19.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-03-04T12:17:24.549 INFO:teuthology.orchestra.run.smithi110.stdout:(170/284): poppler-data-0.4.9-9.el9.noarch.rpm 11 MB/s | 1.8 MB 00:00 2024-03-04T12:17:24.575 INFO:teuthology.orchestra.run.smithi110.stdout:(171/284): poppler-glib-21.01.0-19.el9.x86_64.r 910 kB/s | 151 kB 00:00 2024-03-04T12:17:24.608 INFO:teuthology.orchestra.run.smithi110.stdout:(172/284): protobuf-3.14.0-13.el9.x86_64.rpm 6.8 MB/s | 1.0 MB 00:00 2024-03-04T12:17:24.633 INFO:teuthology.orchestra.run.smithi110.stdout:(173/284): publicsuffix-list-20210518-3.el9.noa 1.0 MB/s | 82 kB 00:00 2024-03-04T12:17:24.819 INFO:teuthology.orchestra.run.smithi172.stdout:(21/284): ceph-test-19.0.0-1871.g3aec3903.el9.x 18 MB/s | 48 MB 00:02 2024-03-04T12:17:24.844 INFO:teuthology.orchestra.run.smithi172.stdout:(22/284): python3-rbd-19.0.0-1871.g3aec3903.el9 689 kB/s | 299 kB 00:00 2024-03-04T12:17:24.870 INFO:teuthology.orchestra.run.smithi172.stdout:(23/284): python3-rgw-19.0.0-1871.g3aec3903.el9 1.9 MB/s | 99 kB 00:00 2024-03-04T12:17:24.880 INFO:teuthology.orchestra.run.smithi110.stdout:(174/284): pulseaudio-libs-15.0-2.el9.x86_64.rp 2.4 MB/s | 666 kB 00:00 2024-03-04T12:17:24.947 INFO:teuthology.orchestra.run.smithi172.stdout:(24/284): rbd-fuse-19.0.0-1871.g3aec3903.el9.x8 832 kB/s | 85 kB 00:00 2024-03-04T12:17:24.992 INFO:teuthology.orchestra.run.smithi110.stdout:(175/284): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 5.8 MB 00:00 2024-03-04T12:17:25.017 INFO:teuthology.orchestra.run.smithi110.stdout:(176/284): python3-jinja2-2.11.3-5.el9.noarch.r 592 kB/s | 227 kB 00:00 2024-03-04T12:17:25.034 INFO:teuthology.orchestra.run.smithi110.stdout:(177/284): python3-jsonpatch-1.21-16.el9.noarch 162 kB/s | 24 kB 00:00 2024-03-04T12:17:25.051 INFO:teuthology.orchestra.run.smithi110.stdout:(178/284): python3-jsonpointer-2.0-4.el9.noarch 312 kB/s | 18 kB 00:00 2024-03-04T12:17:25.054 INFO:teuthology.orchestra.run.smithi172.stdout:(25/284): ceph-radosgw-19.0.0-1871.g3aec3903.el 3.0 MB/s | 9.9 MB 00:03 2024-03-04T12:17:25.076 INFO:teuthology.orchestra.run.smithi110.stdout:(179/284): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-03-04T12:17:25.093 INFO:teuthology.orchestra.run.smithi110.stdout:(180/284): python3-markupsafe-1.1.1-12.el9.x86_ 541 kB/s | 32 kB 00:00 2024-03-04T12:17:25.095 INFO:teuthology.orchestra.run.smithi172.stdout:(26/284): rbd-nbd-19.0.0-1871.g3aec3903.el9.x86 1.1 MB/s | 171 kB 00:00 2024-03-04T12:17:25.154 INFO:teuthology.orchestra.run.smithi172.stdout:(27/284): rbd-mirror-19.0.0-1871.g3aec3903.el9. 11 MB/s | 3.1 MB 00:00 2024-03-04T12:17:25.179 INFO:teuthology.orchestra.run.smithi172.stdout:(28/284): ceph-grafana-dashboards-19.0.0-1871.g 251 kB/s | 31 kB 00:00 2024-03-04T12:17:25.213 INFO:teuthology.orchestra.run.smithi172.stdout:(29/284): ceph-mgr-cephadm-19.0.0-1871.g3aec390 1.2 MB/s | 138 kB 00:00 2024-03-04T12:17:25.280 INFO:teuthology.orchestra.run.smithi172.stdout:(30/284): ceph-mgr-dashboard-19.0.0-1871.g3aec3 14 MB/s | 1.8 MB 00:00 2024-03-04T12:17:25.319 INFO:teuthology.orchestra.run.smithi110.stdout:(181/284): python3-numpy-1.20.1-5.el9.x86_64.rp 18 MB/s | 4.8 MB 00:00 2024-03-04T12:17:25.330 INFO:teuthology.orchestra.run.smithi172.stdout:(31/284): ceph-mgr-rook-19.0.0-1871.g3aec3903.e 989 kB/s | 49 kB 00:00 2024-03-04T12:17:25.343 INFO:teuthology.orchestra.run.smithi110.stdout:(182/284): python3-numpy-f2py-1.20.1-5.el9.x86_ 816 kB/s | 217 kB 00:00 2024-03-04T12:17:25.355 INFO:teuthology.orchestra.run.smithi172.stdout:(32/284): ceph-mgr-modules-core-19.0.0-1871.g3a 1.7 MB/s | 248 kB 00:00 2024-03-04T12:17:25.369 INFO:teuthology.orchestra.run.smithi110.stdout:(183/284): python3-oauthlib-3.1.1-5.el9.noarch. 635 kB/s | 174 kB 00:00 2024-03-04T12:17:25.381 INFO:teuthology.orchestra.run.smithi172.stdout:(33/284): ceph-prometheus-alerts-19.0.0-1871.g3 328 kB/s | 16 kB 00:00 2024-03-04T12:17:25.394 INFO:teuthology.orchestra.run.smithi110.stdout:(184/284): python3-packaging-20.9-5.el9.noarch. 923 kB/s | 69 kB 00:00 2024-03-04T12:17:25.419 INFO:teuthology.orchestra.run.smithi110.stdout:(185/284): python3-prettytable-0.7.2-27.el9.noa 825 kB/s | 41 kB 00:00 2024-03-04T12:17:25.431 INFO:teuthology.orchestra.run.smithi172.stdout:(34/284): ceph-volume-19.0.0-1871.g3aec3903.el9 3.4 MB/s | 264 kB 00:00 2024-03-04T12:17:25.444 INFO:teuthology.orchestra.run.smithi110.stdout:(186/284): python3-protobuf-3.14.0-13.el9.noarc 3.1 MB/s | 238 kB 00:00 2024-03-04T12:17:25.465 INFO:teuthology.orchestra.run.smithi172.stdout:(35/284): cephadm-19.0.0-1871.g3aec3903.el9.noa 8.7 MB/s | 749 kB 00:00 2024-03-04T12:17:25.470 INFO:teuthology.orchestra.run.smithi110.stdout:(187/284): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.7 MB/s | 132 kB 00:00 2024-03-04T12:17:25.495 INFO:teuthology.orchestra.run.smithi110.stdout:(188/284): python3-pyasn1-modules-0.4.8-6.el9.n 2.7 MB/s | 211 kB 00:00 2024-03-04T12:17:25.520 INFO:teuthology.orchestra.run.smithi110.stdout:(189/284): python3-pytz-2021.1-5.el9.noarch.rpm 954 kB/s | 47 kB 00:00 2024-03-04T12:17:25.545 INFO:teuthology.orchestra.run.smithi110.stdout:(190/284): python3-requests-oauthlib-1.3.0-12.e 572 kB/s | 43 kB 00:00 2024-03-04T12:17:25.962 INFO:teuthology.orchestra.run.smithi110.stdout:(191/284): qatlib-23.11.0-1.el9.x86_64.rpm 520 kB/s | 215 kB 00:00 2024-03-04T12:17:25.988 INFO:teuthology.orchestra.run.smithi110.stdout:(192/284): python3-toml-0.10.2-6.el9.noarch.rpm 88 kB/s | 39 kB 00:00 2024-03-04T12:17:25.990 INFO:teuthology.orchestra.run.smithi172.stdout:(36/284): adwaita-cursor-theme-40.1.1-3.el9.noa 1.1 MB/s | 625 kB 00:00 2024-03-04T12:17:26.255 INFO:teuthology.orchestra.run.smithi110.stdout:(193/284): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-03-04T12:17:26.265 INFO:teuthology.orchestra.run.smithi172.stdout:(37/284): alsa-lib-1.2.10-2.el9.x86_64.rpm 1.8 MB/s | 504 kB 00:00 2024-03-04T12:17:26.280 INFO:teuthology.orchestra.run.smithi110.stdout:(194/284): qatlib-service-23.11.0-1.el9.x86_64. 106 kB/s | 34 kB 00:00 2024-03-04T12:17:26.305 INFO:teuthology.orchestra.run.smithi110.stdout:(195/284): qatzip-libs-1.1.2-2.el9.x86_64.rpm 137 kB/s | 43 kB 00:00 2024-03-04T12:17:26.324 INFO:teuthology.orchestra.run.smithi172.stdout:(38/284): apache-commons-cli-1.4-17.el9.noarch. 1.2 MB/s | 70 kB 00:00 2024-03-04T12:17:26.330 INFO:teuthology.orchestra.run.smithi110.stdout:(196/284): rtkit-0.11-28.el9.x86_64.rpm 734 kB/s | 55 kB 00:00 2024-03-04T12:17:26.364 INFO:teuthology.orchestra.run.smithi110.stdout:(197/284): sisu-0.3.4-10.el9.noarch.rpm 8.6 MB/s | 509 kB 00:00 2024-03-04T12:17:26.389 INFO:teuthology.orchestra.run.smithi110.stdout:(198/284): slf4j-1.7.30-13.el9.noarch.rpm 814 kB/s | 68 kB 00:00 2024-03-04T12:17:26.414 INFO:teuthology.orchestra.run.smithi110.stdout:(199/284): socat-1.7.4.1-5.el9.x86_64.rpm 3.5 MB/s | 300 kB 00:00 2024-03-04T12:17:26.440 INFO:teuthology.orchestra.run.smithi110.stdout:(200/284): sound-theme-freedesktop-0.8-17.el9.n 4.9 MB/s | 377 kB 00:00 2024-03-04T12:17:26.457 INFO:teuthology.orchestra.run.smithi172.stdout:(39/284): apache-commons-codec-1.15-7.el9.noarc 2.2 MB/s | 301 kB 00:00 2024-03-04T12:17:26.465 INFO:teuthology.orchestra.run.smithi110.stdout:(201/284): totem-pl-parser-3.26.6-2.el9.x86_64. 2.6 MB/s | 130 kB 00:00 2024-03-04T12:17:26.490 INFO:teuthology.orchestra.run.smithi110.stdout:(202/284): tracker-3.1.2-3.el9.x86_64.rpm 7.0 MB/s | 537 kB 00:00 2024-03-04T12:17:26.524 INFO:teuthology.orchestra.run.smithi110.stdout:(203/284): tracker-miners-3.1.2-4.el9.x86_64.rp 11 MB/s | 893 kB 00:00 2024-03-04T12:17:26.549 INFO:teuthology.orchestra.run.smithi110.stdout:(204/284): ttmkfdir-3.0.9-65.el9.x86_64.rpm 632 kB/s | 52 kB 00:00 2024-03-04T12:17:26.574 INFO:teuthology.orchestra.run.smithi110.stdout:(205/284): tzdata-java-2024a-1.el9.noarch.rpm 1.8 MB/s | 148 kB 00:00 2024-03-04T12:17:26.582 INFO:teuthology.orchestra.run.smithi172.stdout:(40/284): apache-commons-io-2.8.0-8.el9.noarch. 2.2 MB/s | 282 kB 00:00 2024-03-04T12:17:26.599 INFO:teuthology.orchestra.run.smithi110.stdout:(206/284): upower-0.99.11-11.el9.x86_64.rpm 3.3 MB/s | 168 kB 00:00 2024-03-04T12:17:26.625 INFO:teuthology.orchestra.run.smithi110.stdout:(207/284): webrtc-audio-processing-0.3.1-8.el9. 4.0 MB/s | 305 kB 00:00 2024-03-04T12:17:26.650 INFO:teuthology.orchestra.run.smithi110.stdout:(208/284): wireplumber-0.4.14-1.el9.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2024-03-04T12:17:26.675 INFO:teuthology.orchestra.run.smithi110.stdout:(209/284): wireplumber-libs-0.4.14-1.el9.x86_64 4.4 MB/s | 337 kB 00:00 2024-03-04T12:17:26.700 INFO:teuthology.orchestra.run.smithi110.stdout:(210/284): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 836 kB/s | 41 kB 00:00 2024-03-04T12:17:26.726 INFO:teuthology.orchestra.run.smithi110.stdout:(211/284): xdg-desktop-portal-1.12.6-1.el9.x86_ 4.8 MB/s | 367 kB 00:00 2024-03-04T12:17:26.751 INFO:teuthology.orchestra.run.smithi110.stdout:(212/284): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.7 MB/s | 130 kB 00:00 2024-03-04T12:17:26.784 INFO:teuthology.orchestra.run.smithi110.stdout:(213/284): xkeyboard-config-2.33-2.el9.noarch.r 9.2 MB/s | 780 kB 00:00 2024-03-04T12:17:26.791 INFO:teuthology.orchestra.run.smithi172.stdout:(41/284): apache-commons-lang3-3.12.0-6.el9.noa 2.6 MB/s | 558 kB 00:00 2024-03-04T12:17:26.810 INFO:teuthology.orchestra.run.smithi110.stdout:(214/284): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2024-03-04T12:17:26.843 INFO:teuthology.orchestra.run.smithi110.stdout:(215/284): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.4 MB/s | 499 kB 00:00 2024-03-04T12:17:26.869 INFO:teuthology.orchestra.run.smithi110.stdout:(216/284): ModemManager-glib-1.20.2-1.el9.x86_6 3.9 MB/s | 334 kB 00:00 2024-03-04T12:17:26.875 INFO:teuthology.orchestra.run.smithi172.stdout:(42/284): ceph-mgr-diskprediction-local-19.0.0- 4.4 MB/s | 7.4 MB 00:01 2024-03-04T12:17:26.900 INFO:teuthology.orchestra.run.smithi172.stdout:(43/284): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 795 kB/s | 86 kB 00:00 2024-03-04T12:17:26.950 INFO:teuthology.orchestra.run.smithi172.stdout:(44/284): at-spi2-core-2.40.3-1.el9.x86_64.rpm 2.3 MB/s | 176 kB 00:00 2024-03-04T12:17:26.955 INFO:teuthology.orchestra.run.smithi110.stdout:(217/284): bluez-libs-5.64-1.el9.x86_64.rpm 572 kB/s | 83 kB 00:00 2024-03-04T12:17:26.975 INFO:teuthology.orchestra.run.smithi172.stdout:(45/284): atinject-1.0.3-6.el9.noarch.rpm 297 kB/s | 22 kB 00:00 2024-03-04T12:17:27.044 INFO:teuthology.orchestra.run.smithi110.stdout:(218/284): bubblewrap-0.4.1-6.el9.x86_64.rpm 245 kB/s | 49 kB 00:00 2024-03-04T12:17:27.068 INFO:teuthology.orchestra.run.smithi172.stdout:(46/284): atk-2.36.0-5.el9.x86_64.rpm 2.3 MB/s | 270 kB 00:00 2024-03-04T12:17:27.069 INFO:teuthology.orchestra.run.smithi110.stdout:(219/284): fuse-2.9.9-15.el9.x86_64.rpm 694 kB/s | 79 kB 00:00 2024-03-04T12:17:27.093 INFO:teuthology.orchestra.run.smithi172.stdout:(47/284): boost-program-options-1.75.0-8.el9.x8 909 kB/s | 106 kB 00:00 2024-03-04T12:17:27.095 INFO:teuthology.orchestra.run.smithi110.stdout:(220/284): cups-libs-2.3.3op2-24.el9.x86_64.rpm 1.8 MB/s | 261 kB 00:00 2024-03-04T12:17:27.120 INFO:teuthology.orchestra.run.smithi110.stdout:(221/284): jq-1.6-16.el9.x86_64.rpm 2.4 MB/s | 186 kB 00:00 2024-03-04T12:17:27.126 INFO:teuthology.orchestra.run.smithi172.stdout:(48/284): cdi-api-2.0.2-6.el9.noarch.rpm 906 kB/s | 52 kB 00:00 2024-03-04T12:17:27.153 INFO:teuthology.orchestra.run.smithi110.stdout:(222/284): libgfortran-11.4.1-3.el9.x86_64.rpm 9.5 MB/s | 802 kB 00:00 2024-03-04T12:17:27.170 INFO:teuthology.orchestra.run.smithi110.stdout:(223/284): libquadmath-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 194 kB 00:00 2024-03-04T12:17:27.193 INFO:teuthology.orchestra.run.smithi172.stdout:(49/284): colord-libs-1.4.5-4.el9.x86_64.rpm 2.2 MB/s | 228 kB 00:00 2024-03-04T12:17:27.196 INFO:teuthology.orchestra.run.smithi110.stdout:(224/284): libpciaccess-0.16-6.el9.x86_64.rpm 360 kB/s | 27 kB 00:00 2024-03-04T12:17:27.218 INFO:teuthology.orchestra.run.smithi172.stdout:(50/284): copy-jdk-configs-4.0-3.el9.noarch.rpm 296 kB/s | 27 kB 00:00 2024-03-04T12:17:27.221 INFO:teuthology.orchestra.run.smithi110.stdout:(225/284): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.3 MB/s | 90 kB 00:00 2024-03-04T12:17:27.255 INFO:teuthology.orchestra.run.smithi110.stdout:(226/284): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.5 MB/s | 217 kB 00:00 2024-03-04T12:17:27.260 INFO:teuthology.orchestra.run.smithi172.stdout:(51/284): dconf-0.40.0-6.el9.x86_64.rpm 1.6 MB/s | 108 kB 00:00 2024-03-04T12:17:27.280 INFO:teuthology.orchestra.run.smithi110.stdout:(227/284): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.8 MB/s | 241 kB 00:00 2024-03-04T12:17:27.314 INFO:teuthology.orchestra.run.smithi110.stdout:(228/284): python3-cryptography-36.0.1-4.el9.x8 12 MB/s | 1.1 MB 00:00 2024-03-04T12:17:27.339 INFO:teuthology.orchestra.run.smithi110.stdout:(229/284): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-04T12:17:27.364 INFO:teuthology.orchestra.run.smithi110.stdout:(230/284): python3-pycparser-2.20-6.el9.noarch. 1.5 MB/s | 124 kB 00:00 2024-03-04T12:17:27.377 INFO:teuthology.orchestra.run.smithi172.stdout:(52/284): exempi-2.6.0-0.2.20211007gite23c213.e 3.2 MB/s | 524 kB 00:00 2024-03-04T12:17:27.392 INFO:teuthology.orchestra.run.smithi110.stdout:(231/284): python3-requests-2.25.1-8.el9.noarch 1.4 MB/s | 113 kB 00:00 2024-03-04T12:17:27.425 INFO:teuthology.orchestra.run.smithi110.stdout:(232/284): python3-urllib3-1.26.5-5.el9.noarch. 3.0 MB/s | 187 kB 00:00 2024-03-04T12:17:27.559 INFO:teuthology.orchestra.run.smithi110.stdout:(233/284): libX11-xcb-1.7.0-8.el9.x86_64.rpm 82 kB/s | 11 kB 00:00 2024-03-04T12:17:27.601 INFO:teuthology.orchestra.run.smithi110.stdout:(234/284): avahi-glib-0.8-12.el9.x86_64.rpm 63 kB/s | 15 kB 00:00 2024-03-04T12:17:27.670 INFO:teuthology.orchestra.run.smithi172.stdout:(53/284): adwaita-icon-theme-40.1.1-3.el9.noarc 4.9 MB/s | 11 MB 00:02 2024-03-04T12:17:27.711 INFO:teuthology.orchestra.run.smithi172.stdout:(54/284): exiv2-0.27.5-2.el9.x86_64.rpm 2.1 MB/s | 978 kB 00:00 2024-03-04T12:17:27.745 INFO:teuthology.orchestra.run.smithi172.stdout:(55/284): exiv2-libs-0.27.5-2.el9.x86_64.rpm 2.1 MB/s | 780 kB 00:00 2024-03-04T12:17:27.751 INFO:teuthology.orchestra.run.smithi110.stdout:(235/284): flac-libs-1.3.3-12.el9.x86_64.rpm 607 kB/s | 218 kB 00:00 2024-03-04T12:17:27.795 INFO:teuthology.orchestra.run.smithi172.stdout:(56/284): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 2.6 MB/s | 324 kB 00:00 2024-03-04T12:17:27.827 INFO:teuthology.orchestra.run.smithi110.stdout:(236/284): ostree-libs-2024.4-3.el9.x86_64.rpm 1.8 MB/s | 487 kB 00:00 2024-03-04T12:17:27.852 INFO:teuthology.orchestra.run.smithi110.stdout:(237/284): p11-kit-server-0.24.1-2.el9.x86_64.r 792 kB/s | 199 kB 00:00 2024-03-04T12:17:27.977 INFO:teuthology.orchestra.run.smithi110.stdout:(238/284): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-03-04T12:17:28.012 INFO:teuthology.orchestra.run.smithi172.stdout:(57/284): flatpak-selinux-1.12.8-1.el9.noarch.r 76 kB/s | 20 kB 00:00 2024-03-04T12:17:28.086 INFO:teuthology.orchestra.run.smithi110.stdout:(239/284): python3-devel-3.9.17-2.el9.x86_64.rp 735 kB/s | 245 kB 00:00 2024-03-04T12:17:28.087 INFO:teuthology.orchestra.run.smithi172.stdout:(58/284): flatpak-1.12.8-1.el9.x86_64.rpm 4.5 MB/s | 1.7 MB 00:00 2024-03-04T12:17:28.113 INFO:teuthology.orchestra.run.smithi172.stdout:(59/284): flatpak-session-helper-1.12.8-1.el9.x 230 kB/s | 73 kB 00:00 2024-03-04T12:17:28.138 INFO:teuthology.orchestra.run.smithi172.stdout:(60/284): flexiblas-3.0.4-8.el9.x86_64.rpm 253 kB/s | 32 kB 00:00 2024-03-04T12:17:28.330 INFO:teuthology.orchestra.run.smithi172.stdout:(61/284): flexiblas-openblas-openmp-3.0.4-8.el9 90 kB/s | 17 kB 00:00 2024-03-04T12:17:28.346 INFO:teuthology.orchestra.run.smithi172.stdout:(62/284): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 405 kB/s | 84 kB 00:00 2024-03-04T12:17:28.414 INFO:teuthology.orchestra.run.smithi172.stdout:(63/284): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.2 MB/s | 3.0 MB 00:00 2024-03-04T12:17:28.439 INFO:teuthology.orchestra.run.smithi172.stdout:(64/284): geoclue2-2.6.0-7.el9.x86_64.rpm 1.1 MB/s | 122 kB 00:00 2024-03-04T12:17:28.453 INFO:teuthology.orchestra.run.smithi110.stdout:(240/284): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-03-04T12:17:28.464 INFO:teuthology.orchestra.run.smithi172.stdout:(65/284): giflib-5.2.1-9.el9.x86_64.rpm 408 kB/s | 47 kB 00:00 2024-03-04T12:17:28.490 INFO:teuthology.orchestra.run.smithi172.stdout:(66/284): google-guice-4.2.3-9.el9.noarch.rpm 6.1 MB/s | 472 kB 00:00 2024-03-04T12:17:28.511 INFO:teuthology.orchestra.run.smithi110.stdout:(241/284): gperftools-libs-2.9.1-2.el9.x86_64.r 726 kB/s | 309 kB 00:00 2024-03-04T12:17:28.515 INFO:teuthology.orchestra.run.smithi172.stdout:(67/284): gsm-1.0.19-6.el9.x86_64.rpm 668 kB/s | 33 kB 00:00 2024-03-04T12:17:28.536 INFO:teuthology.orchestra.run.smithi110.stdout:(242/284): grpc-data-1.46.7-10.el9.noarch.rpm 233 kB/s | 19 kB 00:00 2024-03-04T12:17:28.540 INFO:teuthology.orchestra.run.smithi172.stdout:(68/284): graphene-1.10.6-2.el9.x86_64.rpm 849 kB/s | 63 kB 00:00 2024-03-04T12:17:28.612 INFO:teuthology.orchestra.run.smithi110.stdout:(243/284): libarrow-doc-9.0.0-10.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-03-04T12:17:28.615 INFO:teuthology.orchestra.run.smithi172.stdout:(69/284): gstreamer1-1.22.1-2.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-03-04T12:17:28.696 INFO:teuthology.orchestra.run.smithi110.stdout:(244/284): liboath-2.6.7-2.el9.x86_64.rpm 583 kB/s | 49 kB 00:00 2024-03-04T12:17:28.716 INFO:teuthology.orchestra.run.smithi172.stdout:(70/284): gstreamer1-plugins-base-1.22.1-2.el9. 11 MB/s | 2.2 MB 00:00 2024-03-04T12:17:28.741 INFO:teuthology.orchestra.run.smithi172.stdout:(71/284): gtk-update-icon-cache-3.24.31-2.el9.x 171 kB/s | 34 kB 00:00 2024-03-04T12:17:28.787 INFO:teuthology.orchestra.run.smithi110.stdout:(245/284): libunwind-1.6.2-1.el9.x86_64.rpm 736 kB/s | 67 kB 00:00 2024-03-04T12:17:28.888 INFO:teuthology.orchestra.run.smithi110.stdout:(246/284): libarrow-9.0.0-10.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-03-04T12:17:28.913 INFO:teuthology.orchestra.run.smithi110.stdout:(247/284): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-03-04T12:17:28.916 INFO:teuthology.orchestra.run.smithi172.stdout:(72/284): gtk3-3.24.31-2.el9.x86_64.rpm 16 MB/s | 4.8 MB 00:00 2024-03-04T12:17:28.971 INFO:teuthology.orchestra.run.smithi110.stdout:(248/284): parquet-libs-9.0.0-10.el9.x86_64.rpm 9.8 MB/s | 838 kB 00:00 2024-03-04T12:17:28.983 INFO:teuthology.orchestra.run.smithi172.stdout:(73/284): guava-30.1-6.el9.noarch.rpm 8.7 MB/s | 2.3 MB 00:00 2024-03-04T12:17:29.005 INFO:teuthology.orchestra.run.smithi110.stdout:(249/284): protobuf-compiler-3.14.0-13.el9.x86_ 749 kB/s | 863 kB 00:01 2024-03-04T12:17:29.008 INFO:teuthology.orchestra.run.smithi172.stdout:(74/284): hicolor-icon-theme-0.17-13.el9.noarch 246 kB/s | 65 kB 00:00 2024-03-04T12:17:29.030 INFO:teuthology.orchestra.run.smithi110.stdout:(250/284): python3-asyncssh-2.13.2-4.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-03-04T12:17:29.033 INFO:teuthology.orchestra.run.smithi172.stdout:(75/284): httpcomponents-client-4.5.13-3.el9.no 5.6 MB/s | 656 kB 00:00 2024-03-04T12:17:29.047 INFO:teuthology.orchestra.run.smithi110.stdout:(251/284): python3-bcrypt-3.2.2-1.el9.x86_64.rp 576 kB/s | 43 kB 00:00 2024-03-04T12:17:29.059 INFO:teuthology.orchestra.run.smithi172.stdout:(76/284): httpcomponents-core-4.4.13-7.el9.noar 8.3 MB/s | 630 kB 00:00 2024-03-04T12:17:29.084 INFO:teuthology.orchestra.run.smithi172.stdout:(77/284): jakarta-annotations-1.3.5-13.el9.noar 902 kB/s | 44 kB 00:00 2024-03-04T12:17:29.097 INFO:teuthology.orchestra.run.smithi110.stdout:(252/284): python3-certifi-2021.10.8-2.el9.noar 225 kB/s | 15 kB 00:00 2024-03-04T12:17:29.123 INFO:teuthology.orchestra.run.smithi110.stdout:(253/284): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-03-04T12:17:29.190 INFO:teuthology.orchestra.run.smithi110.stdout:(254/284): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-03-04T12:17:29.201 INFO:teuthology.orchestra.run.smithi172.stdout:(78/284): iso-codes-4.6.0-3.el9.noarch.rpm 20 MB/s | 3.3 MB 00:00 2024-03-04T12:17:29.215 INFO:teuthology.orchestra.run.smithi110.stdout:(255/284): python3-google-auth-2.28.0-1.el9.noa 2.2 MB/s | 203 kB 00:00 2024-03-04T12:17:29.226 INFO:teuthology.orchestra.run.smithi172.stdout:(79/284): jansi-2.3.3-6.el9.x86_64.rpm 650 kB/s | 108 kB 00:00 2024-03-04T12:17:29.260 INFO:teuthology.orchestra.run.smithi172.stdout:(80/284): java-11-openjdk-11.0.18.0.10-3.el9.x8 2.5 MB/s | 439 kB 00:00 2024-03-04T12:17:29.273 INFO:teuthology.orchestra.run.smithi110.stdout:(256/284): python3-cachetools-4.2.4-1.el9.noarc 120 kB/s | 32 kB 00:00 2024-03-04T12:17:29.299 INFO:teuthology.orchestra.run.smithi110.stdout:(257/284): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-03-04T12:17:29.357 INFO:teuthology.orchestra.run.smithi110.stdout:(258/284): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-03-04T12:17:29.376 INFO:teuthology.orchestra.run.smithi172.stdout:(81/284): java-11-openjdk-devel-11.0.18.0.10-3. 19 MB/s | 3.3 MB 00:00 2024-03-04T12:17:29.391 INFO:teuthology.orchestra.run.smithi110.stdout:(259/284): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-03-04T12:17:29.402 INFO:teuthology.orchestra.run.smithi172.stdout:(82/284): javapackages-filesystem-6.0.0-4.el9.n 75 kB/s | 10 kB 00:00 2024-03-04T12:17:29.433 INFO:teuthology.orchestra.run.smithi110.stdout:(260/284): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-03-04T12:17:29.458 INFO:teuthology.orchestra.run.smithi110.stdout:(261/284): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-03-04T12:17:29.484 INFO:teuthology.orchestra.run.smithi110.stdout:(262/284): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-03-04T12:17:29.509 INFO:teuthology.orchestra.run.smithi110.stdout:(263/284): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-03-04T12:17:29.559 INFO:teuthology.orchestra.run.smithi110.stdout:(264/284): python3-logutils-0.3.5-21.el9.noarch 616 kB/s | 46 kB 00:00 2024-03-04T12:17:29.584 INFO:teuthology.orchestra.run.smithi110.stdout:(265/284): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-03-04T12:17:29.619 INFO:teuthology.orchestra.run.smithi172.stdout:(83/284): jbigkit-libs-2.1-23.el9.x86_64.rpm 215 kB/s | 52 kB 00:00 2024-03-04T12:17:29.635 INFO:teuthology.orchestra.run.smithi110.stdout:(266/284): python3-natsort-7.1.1-5.el9.noarch.r 767 kB/s | 58 kB 00:00 2024-03-04T12:17:29.644 INFO:teuthology.orchestra.run.smithi172.stdout:(84/284): jcl-over-slf4j-1.7.30-13.el9.noarch.r 96 kB/s | 23 kB 00:00 2024-03-04T12:17:29.668 INFO:teuthology.orchestra.run.smithi110.stdout:(267/284): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-03-04T12:17:29.710 INFO:teuthology.orchestra.run.smithi110.stdout:(268/284): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-03-04T12:17:29.744 INFO:teuthology.orchestra.run.smithi110.stdout:(269/284): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-03-04T12:17:29.786 INFO:teuthology.orchestra.run.smithi110.stdout:(270/284): python3-repoze-lru-0.7-16.el9.noarch 410 kB/s | 31 kB 00:00 2024-03-04T12:17:29.819 INFO:teuthology.orchestra.run.smithi110.stdout:(271/284): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-03-04T12:17:29.845 INFO:teuthology.orchestra.run.smithi110.stdout:(272/284): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-03-04T12:17:29.869 INFO:teuthology.orchestra.run.smithi172.stdout:(85/284): jsr-305-3.0.2-6.el9.noarch.rpm 139 kB/s | 31 kB 00:00 2024-03-04T12:17:29.870 INFO:teuthology.orchestra.run.smithi110.stdout:(273/284): python3-rsa-4.9-2.el9.noarch.rpm 706 kB/s | 59 kB 00:00 2024-03-04T12:17:29.894 INFO:teuthology.orchestra.run.smithi172.stdout:(86/284): jsoup-1.13.1-10.el9.noarch.rpm 1.5 MB/s | 376 kB 00:00 2024-03-04T12:17:29.895 INFO:teuthology.orchestra.run.smithi110.stdout:(274/284): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-03-04T12:17:29.920 INFO:teuthology.orchestra.run.smithi110.stdout:(275/284): python3-typing-extensions-4.4.0-2.el 678 kB/s | 51 kB 00:00 2024-03-04T12:17:29.946 INFO:teuthology.orchestra.run.smithi110.stdout:(276/284): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-03-04T12:17:29.971 INFO:teuthology.orchestra.run.smithi110.stdout:(277/284): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-03-04T12:17:30.017 INFO:teuthology.orchestra.run.smithi110.stdout:(278/284): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-03-04T12:17:30.030 INFO:teuthology.orchestra.run.smithi110.stdout:(279/284): python3-zc-lockfile-2.0-10.el9.noarc 239 kB/s | 20 kB 00:00 2024-03-04T12:17:30.055 INFO:teuthology.orchestra.run.smithi110.stdout:(280/284): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-03-04T12:17:30.089 INFO:teuthology.orchestra.run.smithi110.stdout:(281/284): s3cmd-2.4.0-1.el9.noarch.rpm 2.7 MB/s | 206 kB 00:00 2024-03-04T12:17:30.131 INFO:teuthology.orchestra.run.smithi110.stdout:(282/284): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-03-04T12:17:30.161 INFO:teuthology.orchestra.run.smithi172.stdout:(87/284): lcms2-2.12-3.el9.x86_64.rpm 572 kB/s | 166 kB 00:00 2024-03-04T12:17:30.186 INFO:teuthology.orchestra.run.smithi172.stdout:(88/284): libXcomposite-0.4.5-7.el9.x86_64.rpm 80 kB/s | 23 kB 00:00 2024-03-04T12:17:30.397 INFO:teuthology.orchestra.run.smithi110.stdout:(283/284): librados2-19.0.0-1871.g3aec3903.el9. 9.9 MB/s | 3.4 MB 00:00 2024-03-04T12:17:30.456 INFO:teuthology.orchestra.run.smithi110.stdout:(284/284): librbd1-19.0.0-1871.g3aec3903.el9.x8 8.6 MB/s | 3.1 MB 00:00 2024-03-04T12:17:30.464 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-03-04T12:17:30.464 INFO:teuthology.orchestra.run.smithi110.stdout:Total 16 MB/s | 296 MB 00:18 2024-03-04T12:17:30.561 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-03-04T12:17:30.712 INFO:teuthology.orchestra.run.smithi172.stdout:(89/284): java-11-openjdk-headless-11.0.18.0.10 27 MB/s | 40 MB 00:01 2024-03-04T12:17:30.723 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-03-04T12:17:30.723 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-03-04T12:17:30.737 INFO:teuthology.orchestra.run.smithi172.stdout:(90/284): libXcursor-1.2.0-7.el9.x86_64.rpm 52 kB/s | 30 kB 00:00 2024-03-04T12:17:30.754 INFO:teuthology.orchestra.run.smithi172.stdout:(91/284): libXdamage-1.1.5-7.el9.x86_64.rpm 39 kB/s | 22 kB 00:00 2024-03-04T12:17:30.779 INFO:teuthology.orchestra.run.smithi172.stdout:(92/284): libXfixes-5.0.3-16.el9.x86_64.rpm 281 kB/s | 19 kB 00:00 2024-03-04T12:17:30.804 INFO:teuthology.orchestra.run.smithi172.stdout:(93/284): libXi-1.7.10-8.el9.x86_64.rpm 773 kB/s | 38 kB 00:00 2024-03-04T12:17:30.829 INFO:teuthology.orchestra.run.smithi172.stdout:(94/284): libXinerama-1.1.4-10.el9.x86_64.rpm 187 kB/s | 14 kB 00:00 2024-03-04T12:17:30.855 INFO:teuthology.orchestra.run.smithi172.stdout:(95/284): libXrandr-1.5.2-8.el9.x86_64.rpm 364 kB/s | 27 kB 00:00 2024-03-04T12:17:30.880 INFO:teuthology.orchestra.run.smithi172.stdout:(96/284): libXv-1.0.11-16.el9.x86_64.rpm 361 kB/s | 18 kB 00:00 2024-03-04T12:17:30.897 INFO:teuthology.orchestra.run.smithi172.stdout:(97/284): libXtst-1.2.3-16.el9.x86_64.rpm 304 kB/s | 20 kB 00:00 2024-03-04T12:17:30.914 INFO:teuthology.orchestra.run.smithi172.stdout:(98/284): libXxf86vm-1.1.4-18.el9.x86_64.rpm 302 kB/s | 18 kB 00:00 2024-03-04T12:17:30.931 INFO:teuthology.orchestra.run.smithi172.stdout:(99/284): libasyncns-0.8-22.el9.x86_64.rpm 583 kB/s | 29 kB 00:00 2024-03-04T12:17:30.948 INFO:teuthology.orchestra.run.smithi172.stdout:(100/284): libcanberra-gtk3-0.30-27.el9.x86_64. 916 kB/s | 31 kB 00:00 2024-03-04T12:17:30.973 INFO:teuthology.orchestra.run.smithi172.stdout:(101/284): libcanberra-0.30-27.el9.x86_64.rpm 1.4 MB/s | 85 kB 00:00 2024-03-04T12:17:30.998 INFO:teuthology.orchestra.run.smithi172.stdout:(102/284): libdrm-2.4.117-1.el9.x86_64.rpm 2.3 MB/s | 158 kB 00:00 2024-03-04T12:17:31.024 INFO:teuthology.orchestra.run.smithi172.stdout:(103/284): libepoxy-1.5.5-4.el9.x86_64.rpm 3.1 MB/s | 240 kB 00:00 2024-03-04T12:17:31.049 INFO:teuthology.orchestra.run.smithi172.stdout:(104/284): libfontenc-1.1.3-17.el9.x86_64.rpm 605 kB/s | 30 kB 00:00 2024-03-04T12:17:31.083 INFO:teuthology.orchestra.run.smithi172.stdout:(105/284): libexif-0.6.22-6.el9.x86_64.rpm 5.1 MB/s | 431 kB 00:00 2024-03-04T12:17:31.108 INFO:teuthology.orchestra.run.smithi172.stdout:(106/284): libgexiv2-0.12.3-1.el9.x86_64.rpm 978 kB/s | 82 kB 00:00 2024-03-04T12:17:31.133 INFO:teuthology.orchestra.run.smithi172.stdout:(107/284): libglvnd-1.3.4-1.el9.x86_64.rpm 1.6 MB/s | 134 kB 00:00 2024-03-04T12:17:31.158 INFO:teuthology.orchestra.run.smithi172.stdout:(108/284): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 715 kB/s | 36 kB 00:00 2024-03-04T12:17:31.183 INFO:teuthology.orchestra.run.smithi172.stdout:(109/284): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.8 MB/s | 141 kB 00:00 2024-03-04T12:17:31.217 INFO:teuthology.orchestra.run.smithi172.stdout:(110/284): libgsf-1.14.47-5.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-03-04T12:17:31.234 INFO:teuthology.orchestra.run.smithi172.stdout:(111/284): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 78 kB 00:00 2024-03-04T12:17:31.259 INFO:teuthology.orchestra.run.smithi172.stdout:(112/284): libiptcdata-1.0.5-9.el9.x86_64.rpm 811 kB/s | 61 kB 00:00 2024-03-04T12:17:31.284 INFO:teuthology.orchestra.run.smithi172.stdout:(113/284): libldac-2.0.2.3-10.el9.x86_64.rpm 604 kB/s | 40 kB 00:00 2024-03-04T12:17:31.309 INFO:teuthology.orchestra.run.smithi172.stdout:(114/284): libogg-1.3.4-6.el9.x86_64.rpm 652 kB/s | 32 kB 00:00 2024-03-04T12:17:31.335 INFO:teuthology.orchestra.run.smithi172.stdout:(115/284): libnotify-0.7.9-8.el9.x86_64.rpm 565 kB/s | 43 kB 00:00 2024-03-04T12:17:31.360 INFO:teuthology.orchestra.run.smithi172.stdout:(116/284): libosinfo-1.10.0-1.el9.x86_64.rpm 4.1 MB/s | 312 kB 00:00 2024-03-04T12:17:31.385 INFO:teuthology.orchestra.run.smithi172.stdout:(117/284): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2024-03-04T12:17:31.410 INFO:teuthology.orchestra.run.smithi172.stdout:(118/284): librabbitmq-0.11.0-7.el9.x86_64.rpm 892 kB/s | 44 kB 00:00 2024-03-04T12:17:31.436 INFO:teuthology.orchestra.run.smithi172.stdout:(119/284): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-03-04T12:17:31.461 INFO:teuthology.orchestra.run.smithi172.stdout:(120/284): libsbc-1.4-9.el9.x86_64.rpm 583 kB/s | 44 kB 00:00 2024-03-04T12:17:31.486 INFO:teuthology.orchestra.run.smithi172.stdout:(121/284): libsndfile-1.0.31-8.el9.x86_64.rpm 2.7 MB/s | 205 kB 00:00 2024-03-04T12:17:31.511 INFO:teuthology.orchestra.run.smithi172.stdout:(122/284): libtheora-1.1.1-31.el9.x86_64.rpm 3.2 MB/s | 163 kB 00:00 2024-03-04T12:17:31.537 INFO:teuthology.orchestra.run.smithi172.stdout:(123/284): libtiff-4.4.0-12.el9.x86_64.rpm 2.6 MB/s | 197 kB 00:00 2024-03-04T12:17:31.562 INFO:teuthology.orchestra.run.smithi172.stdout:(124/284): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 482 kB/s | 36 kB 00:00 2024-03-04T12:17:31.587 INFO:teuthology.orchestra.run.smithi172.stdout:(125/284): libtracker-sparql-3.1.2-3.el9.x86_64 6.2 MB/s | 316 kB 00:00 2024-03-04T12:17:31.612 INFO:teuthology.orchestra.run.smithi172.stdout:(126/284): libvisual-0.4.0-34.el9.x86_64.rpm 1.9 MB/s | 143 kB 00:00 2024-03-04T12:17:31.638 INFO:teuthology.orchestra.run.smithi172.stdout:(127/284): libvorbis-1.3.7-5.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-03-04T12:17:31.663 INFO:teuthology.orchestra.run.smithi172.stdout:(128/284): libwayland-client-1.21.0-1.el9.x86_6 431 kB/s | 32 kB 00:00 2024-03-04T12:17:31.688 INFO:teuthology.orchestra.run.smithi172.stdout:(129/284): libwayland-cursor-1.21.0-1.el9.x86_6 366 kB/s | 18 kB 00:00 2024-03-04T12:17:31.713 INFO:teuthology.orchestra.run.smithi172.stdout:(130/284): libwayland-egl-1.21.0-1.el9.x86_64.r 157 kB/s | 12 kB 00:00 2024-03-04T12:17:31.738 INFO:teuthology.orchestra.run.smithi172.stdout:(131/284): libwayland-server-1.21.0-1.el9.x86_6 542 kB/s | 41 kB 00:00 2024-03-04T12:17:31.764 INFO:teuthology.orchestra.run.smithi172.stdout:(132/284): libwebp-1.2.0-8.el9.x86_64.rpm 5.4 MB/s | 276 kB 00:00 2024-03-04T12:17:31.789 INFO:teuthology.orchestra.run.smithi172.stdout:(133/284): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.7 MB/s | 132 kB 00:00 2024-03-04T12:17:31.814 INFO:teuthology.orchestra.run.smithi172.stdout:(134/284): libxshmfence-1.3-10.el9.x86_64.rpm 154 kB/s | 12 kB 00:00 2024-03-04T12:17:31.840 INFO:teuthology.orchestra.run.smithi172.stdout:(135/284): low-memory-monitor-2.1-4.el9.x86_64. 693 kB/s | 35 kB 00:00 2024-03-04T12:17:31.865 INFO:teuthology.orchestra.run.smithi172.stdout:(136/284): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-03-04T12:17:31.890 INFO:teuthology.orchestra.run.smithi172.stdout:(137/284): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2024-03-04T12:17:31.915 INFO:teuthology.orchestra.run.smithi172.stdout:(138/284): lua-posix-35.0-8.el9.x86_64.rpm 2.6 MB/s | 131 kB 00:00 2024-03-04T12:17:31.941 INFO:teuthology.orchestra.run.smithi172.stdout:(139/284): maven-3.6.3-15.el9.noarch.rpm 222 kB/s | 17 kB 00:00 2024-03-04T12:17:31.991 INFO:teuthology.orchestra.run.smithi172.stdout:(140/284): maven-lib-3.6.3-15.el9.noarch.rpm 15 MB/s | 1.5 MB 00:00 2024-03-04T12:17:32.016 INFO:teuthology.orchestra.run.smithi172.stdout:(141/284): maven-openjdk11-3.6.3-15.el9.noarch. 109 kB/s | 7.9 kB 00:00 2024-03-04T12:17:32.042 INFO:teuthology.orchestra.run.smithi172.stdout:(142/284): maven-resolver-1.6.1-10.el9.noarch.r 5.1 MB/s | 512 kB 00:00 2024-03-04T12:17:32.067 INFO:teuthology.orchestra.run.smithi172.stdout:(143/284): maven-shared-utils-3.3.4-3.el9.noarc 2.0 MB/s | 150 kB 00:00 2024-03-04T12:17:32.092 INFO:teuthology.orchestra.run.smithi172.stdout:(144/284): maven-wagon-3.4.2-7.el9.noarch.rpm 2.2 MB/s | 111 kB 00:00 2024-03-04T12:17:32.117 INFO:teuthology.orchestra.run.smithi172.stdout:(145/284): mesa-libEGL-23.3.3-1.el9.x86_64.rpm 1.6 MB/s | 126 kB 00:00 2024-03-04T12:17:32.142 INFO:teuthology.orchestra.run.smithi172.stdout:(146/284): mesa-libGL-23.3.3-1.el9.x86_64.rpm 2.2 MB/s | 167 kB 00:00 2024-03-04T12:17:32.168 INFO:teuthology.orchestra.run.smithi172.stdout:(147/284): mesa-libgbm-23.3.3-1.el9.x86_64.rpm 488 kB/s | 37 kB 00:00 2024-03-04T12:17:32.193 INFO:teuthology.orchestra.run.smithi172.stdout:(148/284): mesa-libglapi-23.3.3-1.el9.x86_64.rp 865 kB/s | 43 kB 00:00 2024-03-04T12:17:32.210 INFO:teuthology.orchestra.run.smithi172.stdout:(149/284): mkfontscale-1.2.1-3.el9.x86_64.rpm 467 kB/s | 31 kB 00:00 2024-03-04T12:17:32.235 INFO:teuthology.orchestra.run.smithi172.stdout:(150/284): openblas-0.3.21-2.el9.x86_64.rpm 512 kB/s | 34 kB 00:00 2024-03-04T12:17:32.260 INFO:teuthology.orchestra.run.smithi172.stdout:(151/284): openjpeg2-2.4.0-7.el9.x86_64.rpm 3.2 MB/s | 162 kB 00:00 2024-03-04T12:17:32.527 INFO:teuthology.orchestra.run.smithi172.stdout:(152/284): openblas-openmp-0.3.21-2.el9.x86_64. 15 MB/s | 4.7 MB 00:00 2024-03-04T12:17:32.553 INFO:teuthology.orchestra.run.smithi172.stdout:(153/284): orc-0.4.31-6.el9.x86_64.rpm 628 kB/s | 183 kB 00:00 2024-03-04T12:17:32.578 INFO:teuthology.orchestra.run.smithi172.stdout:(154/284): opus-1.3.1-10.el9.x86_64.rpm 581 kB/s | 199 kB 00:00 2024-03-04T12:17:32.617 INFO:teuthology.orchestra.run.smithi172.stdout:(155/284): osinfo-db-20231215-1.el9.noarch.rpm 3.1 MB/s | 283 kB 00:00 2024-03-04T12:17:32.645 INFO:teuthology.orchestra.run.smithi172.stdout:(156/284): osinfo-db-tools-1.10.0-1.el9.x86_64. 745 kB/s | 68 kB 00:00 2024-03-04T12:17:32.670 INFO:teuthology.orchestra.run.smithi172.stdout:(157/284): pipewire-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 101 kB 00:00 2024-03-04T12:17:32.695 INFO:teuthology.orchestra.run.smithi172.stdout:(158/284): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 726 kB/s | 56 kB 00:00 2024-03-04T12:17:32.812 INFO:teuthology.orchestra.run.smithi172.stdout:(159/284): pipewire-jack-audio-connection-kit-1 57 kB/s | 8.0 kB 00:00 2024-03-04T12:17:32.904 INFO:teuthology.orchestra.run.smithi172.stdout:(160/284): pipewire-jack-audio-connection-kit-l 573 kB/s | 134 kB 00:00 2024-03-04T12:17:32.946 INFO:teuthology.orchestra.run.smithi172.stdout:(161/284): pipewire-libs-1.0.1-1.el9.x86_64.rpm 7.4 MB/s | 1.9 MB 00:00 2024-03-04T12:17:32.972 INFO:teuthology.orchestra.run.smithi172.stdout:(162/284): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.2 MB/s | 185 kB 00:00 2024-03-04T12:17:32.996 INFO:teuthology.orchestra.run.smithi172.stdout:(163/284): plexus-cipher-1.7-27.el9.noarch.rpm 273 kB/s | 25 kB 00:00 2024-03-04T12:17:33.030 INFO:teuthology.orchestra.run.smithi172.stdout:(164/284): plexus-classworlds-2.6.0-11.el9.noar 1.0 MB/s | 59 kB 00:00 2024-03-04T12:17:33.056 INFO:teuthology.orchestra.run.smithi172.stdout:(165/284): plexus-containers-component-annotati 207 kB/s | 17 kB 00:00 2024-03-04T12:17:33.081 INFO:teuthology.orchestra.run.smithi172.stdout:(166/284): plexus-interpolation-1.26-11.el9.noa 937 kB/s | 79 kB 00:00 2024-03-04T12:17:33.106 INFO:teuthology.orchestra.run.smithi172.stdout:(167/284): plexus-sec-dispatcher-1.4-37.el9.noa 431 kB/s | 33 kB 00:00 2024-03-04T12:17:33.131 INFO:teuthology.orchestra.run.smithi172.stdout:(168/284): plexus-utils-3.3.0-10.el9.noarch.rpm 3.3 MB/s | 253 kB 00:00 2024-03-04T12:17:33.199 INFO:teuthology.orchestra.run.smithi172.stdout:(169/284): poppler-21.01.0-19.el9.x86_64.rpm 9.1 MB/s | 1.1 MB 00:00 2024-03-04T12:17:33.234 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-03-04T12:17:33.234 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-03-04T12:17:33.307 INFO:teuthology.orchestra.run.smithi172.stdout:(170/284): poppler-data-0.4.9-9.el9.noarch.rpm 9.1 MB/s | 1.8 MB 00:00 2024-03-04T12:17:33.332 INFO:teuthology.orchestra.run.smithi172.stdout:(171/284): poppler-glib-21.01.0-19.el9.x86_64.r 758 kB/s | 151 kB 00:00 2024-03-04T12:17:33.366 INFO:teuthology.orchestra.run.smithi172.stdout:(172/284): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-03-04T12:17:33.391 INFO:teuthology.orchestra.run.smithi172.stdout:(173/284): publicsuffix-list-20210518-3.el9.noa 994 kB/s | 82 kB 00:00 2024-03-04T12:17:33.417 INFO:teuthology.orchestra.run.smithi172.stdout:(174/284): pulseaudio-libs-15.0-2.el9.x86_64.rp 7.8 MB/s | 666 kB 00:00 2024-03-04T12:17:33.692 INFO:teuthology.orchestra.run.smithi172.stdout:(175/284): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2024-03-04T12:17:33.717 INFO:teuthology.orchestra.run.smithi172.stdout:(176/284): python3-jinja2-2.11.3-5.el9.noarch.r 699 kB/s | 227 kB 00:00 2024-03-04T12:17:33.742 INFO:teuthology.orchestra.run.smithi172.stdout:(177/284): python3-jsonpatch-1.21-16.el9.noarch 75 kB/s | 24 kB 00:00 2024-03-04T12:17:33.767 INFO:teuthology.orchestra.run.smithi172.stdout:(178/284): python3-jsonpointer-2.0-4.el9.noarch 243 kB/s | 18 kB 00:00 2024-03-04T12:17:33.793 INFO:teuthology.orchestra.run.smithi172.stdout:(179/284): python3-markupsafe-1.1.1-12.el9.x86_ 632 kB/s | 32 kB 00:00 2024-03-04T12:17:33.818 INFO:teuthology.orchestra.run.smithi172.stdout:(180/284): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-03-04T12:17:34.043 INFO:teuthology.orchestra.run.smithi172.stdout:(181/284): python3-numpy-1.20.1-5.el9.x86_64.rp 17 MB/s | 4.8 MB 00:00 2024-03-04T12:17:34.068 INFO:teuthology.orchestra.run.smithi172.stdout:(182/284): python3-numpy-f2py-1.20.1-5.el9.x86_ 791 kB/s | 217 kB 00:00 2024-03-04T12:17:34.094 INFO:teuthology.orchestra.run.smithi172.stdout:(183/284): python3-oauthlib-3.1.1-5.el9.noarch. 636 kB/s | 174 kB 00:00 2024-03-04T12:17:34.119 INFO:teuthology.orchestra.run.smithi172.stdout:(184/284): python3-packaging-20.9-5.el9.noarch. 921 kB/s | 69 kB 00:00 2024-03-04T12:17:34.144 INFO:teuthology.orchestra.run.smithi172.stdout:(185/284): python3-prettytable-0.7.2-27.el9.noa 826 kB/s | 41 kB 00:00 2024-03-04T12:17:34.169 INFO:teuthology.orchestra.run.smithi172.stdout:(186/284): python3-protobuf-3.14.0-13.el9.noarc 3.1 MB/s | 238 kB 00:00 2024-03-04T12:17:34.195 INFO:teuthology.orchestra.run.smithi172.stdout:(187/284): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.7 MB/s | 132 kB 00:00 2024-03-04T12:17:34.220 INFO:teuthology.orchestra.run.smithi172.stdout:(188/284): python3-pytz-2021.1-5.el9.noarch.rpm 950 kB/s | 47 kB 00:00 2024-03-04T12:17:34.253 INFO:teuthology.orchestra.run.smithi172.stdout:(189/284): python3-pyasn1-modules-0.4.8-6.el9.n 2.5 MB/s | 211 kB 00:00 2024-03-04T12:17:34.279 INFO:teuthology.orchestra.run.smithi172.stdout:(190/284): python3-requests-oauthlib-1.3.0-12.e 513 kB/s | 43 kB 00:00 2024-03-04T12:17:34.687 INFO:teuthology.orchestra.run.smithi172.stdout:(191/284): python3-toml-0.10.2-6.el9.noarch.rpm 95 kB/s | 39 kB 00:00 2024-03-04T12:17:34.712 INFO:teuthology.orchestra.run.smithi172.stdout:(192/284): qatlib-23.11.0-1.el9.x86_64.rpm 499 kB/s | 215 kB 00:00 2024-03-04T12:17:35.013 INFO:teuthology.orchestra.run.smithi172.stdout:(193/284): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-03-04T12:17:35.030 INFO:teuthology.orchestra.run.smithi172.stdout:(194/284): qatlib-service-23.11.0-1.el9.x86_64. 99 kB/s | 34 kB 00:00 2024-03-04T12:17:35.046 INFO:teuthology.orchestra.run.smithi172.stdout:(195/284): qatzip-libs-1.1.2-2.el9.x86_64.rpm 130 kB/s | 43 kB 00:00 2024-03-04T12:17:35.063 INFO:teuthology.orchestra.run.smithi172.stdout:(196/284): rtkit-0.11-28.el9.x86_64.rpm 1.1 MB/s | 55 kB 00:00 2024-03-04T12:17:35.102 INFO:teuthology.orchestra.run.smithi172.stdout:(197/284): slf4j-1.7.30-13.el9.noarch.rpm 1.2 MB/s | 68 kB 00:00 2024-03-04T12:17:35.127 INFO:teuthology.orchestra.run.smithi172.stdout:(198/284): sisu-0.3.4-10.el9.noarch.rpm 6.2 MB/s | 509 kB 00:00 2024-03-04T12:17:35.152 INFO:teuthology.orchestra.run.smithi172.stdout:(199/284): socat-1.7.4.1-5.el9.x86_64.rpm 3.3 MB/s | 300 kB 00:00 2024-03-04T12:17:35.178 INFO:teuthology.orchestra.run.smithi172.stdout:(200/284): sound-theme-freedesktop-0.8-17.el9.n 5.0 MB/s | 377 kB 00:00 2024-03-04T12:17:35.204 INFO:teuthology.orchestra.run.smithi172.stdout:(201/284): totem-pl-parser-3.26.6-2.el9.x86_64. 1.7 MB/s | 130 kB 00:00 2024-03-04T12:17:35.238 INFO:teuthology.orchestra.run.smithi172.stdout:(202/284): tracker-3.1.2-3.el9.x86_64.rpm 6.3 MB/s | 537 kB 00:00 2024-03-04T12:17:35.288 INFO:teuthology.orchestra.run.smithi172.stdout:(203/284): tracker-miners-3.1.2-4.el9.x86_64.rp 8.0 MB/s | 893 kB 00:00 2024-03-04T12:17:35.313 INFO:teuthology.orchestra.run.smithi172.stdout:(204/284): ttmkfdir-3.0.9-65.el9.x86_64.rpm 482 kB/s | 52 kB 00:00 2024-03-04T12:17:35.338 INFO:teuthology.orchestra.run.smithi172.stdout:(205/284): tzdata-java-2024a-1.el9.noarch.rpm 1.5 MB/s | 148 kB 00:00 2024-03-04T12:17:35.363 INFO:teuthology.orchestra.run.smithi172.stdout:(206/284): upower-0.99.11-11.el9.x86_64.rpm 2.2 MB/s | 168 kB 00:00 2024-03-04T12:17:35.406 INFO:teuthology.orchestra.run.smithi172.stdout:(207/284): wireplumber-0.4.14-1.el9.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2024-03-04T12:17:35.439 INFO:teuthology.orchestra.run.smithi172.stdout:(208/284): webrtc-audio-processing-0.3.1-8.el9. 3.0 MB/s | 305 kB 00:00 2024-03-04T12:17:35.539 INFO:teuthology.orchestra.run.smithi172.stdout:(209/284): wireplumber-libs-0.4.14-1.el9.x86_64 1.9 MB/s | 337 kB 00:00 2024-03-04T12:17:35.555 INFO:teuthology.orchestra.run.smithi172.stdout:(210/284): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 276 kB/s | 41 kB 00:00 2024-03-04T12:17:35.581 INFO:teuthology.orchestra.run.smithi172.stdout:(211/284): xdg-desktop-portal-1.12.6-1.el9.x86_ 2.5 MB/s | 367 kB 00:00 2024-03-04T12:17:35.731 INFO:teuthology.orchestra.run.smithi172.stdout:(212/284): xdg-desktop-portal-gtk-1.12.0-3.el9. 866 kB/s | 130 kB 00:00 2024-03-04T12:17:35.756 INFO:teuthology.orchestra.run.smithi172.stdout:(213/284): xmlstarlet-1.6.1-20.el9.x86_64.rpm 358 kB/s | 63 kB 00:00 2024-03-04T12:17:35.789 INFO:teuthology.orchestra.run.smithi172.stdout:(214/284): xkeyboard-config-2.33-2.el9.noarch.r 3.7 MB/s | 780 kB 00:00 2024-03-04T12:17:35.840 INFO:teuthology.orchestra.run.smithi172.stdout:(215/284): xorg-x11-fonts-Type1-7.5-33.el9.noar 4.5 MB/s | 499 kB 00:00 2024-03-04T12:17:35.932 INFO:teuthology.orchestra.run.smithi172.stdout:(216/284): ModemManager-glib-1.20.2-1.el9.x86_6 1.9 MB/s | 334 kB 00:00 2024-03-04T12:17:35.957 INFO:teuthology.orchestra.run.smithi172.stdout:(217/284): bluez-libs-5.64-1.el9.x86_64.rpm 496 kB/s | 83 kB 00:00 2024-03-04T12:17:35.982 INFO:teuthology.orchestra.run.smithi172.stdout:(218/284): bubblewrap-0.4.1-6.el9.x86_64.rpm 346 kB/s | 49 kB 00:00 2024-03-04T12:17:36.057 INFO:teuthology.orchestra.run.smithi172.stdout:(219/284): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-04T12:17:36.083 INFO:teuthology.orchestra.run.smithi172.stdout:(220/284): cups-libs-2.3.3op2-24.el9.x86_64.rpm 2.5 MB/s | 261 kB 00:00 2024-03-04T12:17:36.108 INFO:teuthology.orchestra.run.smithi172.stdout:(221/284): jq-1.6-16.el9.x86_64.rpm 1.5 MB/s | 186 kB 00:00 2024-03-04T12:17:36.183 INFO:teuthology.orchestra.run.smithi172.stdout:(222/284): libgfortran-11.4.1-3.el9.x86_64.rpm 6.3 MB/s | 802 kB 00:00 2024-03-04T12:17:36.209 INFO:teuthology.orchestra.run.smithi172.stdout:(223/284): libpciaccess-0.16-6.el9.x86_64.rpm 212 kB/s | 27 kB 00:00 2024-03-04T12:17:36.234 INFO:teuthology.orchestra.run.smithi172.stdout:(224/284): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 194 kB 00:00 2024-03-04T12:17:36.259 INFO:teuthology.orchestra.run.smithi172.stdout:(225/284): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.2 MB/s | 90 kB 00:00 2024-03-04T12:17:36.301 INFO:teuthology.orchestra.run.smithi172.stdout:(226/284): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.2 MB/s | 217 kB 00:00 2024-03-04T12:17:36.326 INFO:teuthology.orchestra.run.smithi172.stdout:(227/284): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2024-03-04T12:17:36.453 INFO:teuthology.orchestra.run.smithi172.stdout:(228/284): python3-cryptography-36.0.1-4.el9.x8 5.9 MB/s | 1.1 MB 00:00 2024-03-04T12:17:36.477 INFO:teuthology.orchestra.run.smithi172.stdout:(229/284): python3-ply-3.11-14.el9.noarch.rpm 589 kB/s | 103 kB 00:00 2024-03-04T12:17:36.502 INFO:teuthology.orchestra.run.smithi172.stdout:(230/284): python3-pycparser-2.20-6.el9.noarch. 710 kB/s | 124 kB 00:00 2024-03-04T12:17:36.527 INFO:teuthology.orchestra.run.smithi172.stdout:(231/284): python3-requests-2.25.1-8.el9.noarch 1.5 MB/s | 113 kB 00:00 2024-03-04T12:17:36.553 INFO:teuthology.orchestra.run.smithi172.stdout:(232/284): python3-urllib3-1.26.5-5.el9.noarch. 3.7 MB/s | 187 kB 00:00 2024-03-04T12:17:36.619 INFO:teuthology.orchestra.run.smithi172.stdout:(233/284): libX11-xcb-1.7.0-8.el9.x86_64.rpm 164 kB/s | 11 kB 00:00 2024-03-04T12:17:36.645 INFO:teuthology.orchestra.run.smithi172.stdout:(234/284): avahi-glib-0.8-12.el9.x86_64.rpm 104 kB/s | 15 kB 00:00 2024-03-04T12:17:36.695 INFO:teuthology.orchestra.run.smithi172.stdout:(235/284): flac-libs-1.3.3-12.el9.x86_64.rpm 1.3 MB/s | 218 kB 00:00 2024-03-04T12:17:36.762 INFO:teuthology.orchestra.run.smithi172.stdout:(236/284): python3-devel-3.9.17-2.el9.x86_64.rp 3.6 MB/s | 245 kB 00:00 2024-03-04T12:17:36.796 INFO:teuthology.orchestra.run.smithi172.stdout:(237/284): ostree-libs-2024.4-3.el9.x86_64.rpm 2.7 MB/s | 487 kB 00:00 2024-03-04T12:17:36.872 INFO:teuthology.orchestra.run.smithi172.stdout:(238/284): p11-kit-server-0.24.1-2.el9.x86_64.r 876 kB/s | 199 kB 00:00 2024-03-04T12:17:37.055 INFO:teuthology.orchestra.run.smithi172.stdout:(239/284): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-03-04T12:17:37.105 INFO:teuthology.orchestra.run.smithi172.stdout:(240/284): abseil-cpp-20211102.0-3.el9.x86_64.r 2.3 MB/s | 548 kB 00:00 2024-03-04T12:17:37.147 INFO:teuthology.orchestra.run.smithi172.stdout:(241/284): grpc-data-1.46.7-10.el9.noarch.rpm 467 kB/s | 19 kB 00:00 2024-03-04T12:17:37.239 INFO:teuthology.orchestra.run.smithi172.stdout:(242/284): gperftools-libs-2.9.1-2.el9.x86_64.r 1.6 MB/s | 309 kB 00:00 2024-03-04T12:17:37.272 INFO:teuthology.orchestra.run.smithi172.stdout:(243/284): libarrow-doc-9.0.0-10.el9.noarch.rpm 778 kB/s | 26 kB 00:00 2024-03-04T12:17:37.314 INFO:teuthology.orchestra.run.smithi172.stdout:(244/284): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-03-04T12:17:37.356 INFO:teuthology.orchestra.run.smithi172.stdout:(245/284): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-03-04T12:17:37.423 INFO:teuthology.orchestra.run.smithi172.stdout:(246/284): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-03-04T12:17:37.581 INFO:teuthology.orchestra.run.smithi172.stdout:(247/284): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.2 MB/s | 838 kB 00:00 2024-03-04T12:17:37.690 INFO:teuthology.orchestra.run.smithi172.stdout:(248/284): python3-asyncssh-2.13.2-4.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-03-04T12:17:37.724 INFO:teuthology.orchestra.run.smithi172.stdout:(249/284): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-03-04T12:17:37.757 INFO:teuthology.orchestra.run.smithi172.stdout:(250/284): python3-cachetools-4.2.4-1.el9.noarc 966 kB/s | 32 kB 00:00 2024-03-04T12:17:37.791 INFO:teuthology.orchestra.run.smithi172.stdout:(251/284): python3-certifi-2021.10.8-2.el9.noar 450 kB/s | 15 kB 00:00 2024-03-04T12:17:37.908 INFO:teuthology.orchestra.run.smithi172.stdout:(252/284): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-03-04T12:17:38.016 INFO:teuthology.orchestra.run.smithi172.stdout:(253/284): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-03-04T12:17:38.101 INFO:teuthology.orchestra.run.smithi172.stdout:(254/284): python3-google-auth-2.28.0-1.el9.noa 2.3 MB/s | 203 kB 00:00 2024-03-04T12:17:38.326 INFO:teuthology.orchestra.run.smithi172.stdout:(255/284): libarrow-9.0.0-10.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-03-04T12:17:38.443 INFO:teuthology.orchestra.run.smithi172.stdout:(256/284): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-03-04T12:17:38.502 INFO:teuthology.orchestra.run.smithi172.stdout:(257/284): python3-grpcio-1.46.7-10.el9.x86_64. 5.1 MB/s | 2.0 MB 00:00 2024-03-04T12:17:38.529 INFO:teuthology.orchestra.run.smithi172.stdout:(258/284): python3-jaraco-8.2.1-3.el9.noarch.rp 125 kB/s | 11 kB 00:00 2024-03-04T12:17:38.563 INFO:teuthology.orchestra.run.smithi172.stdout:(259/284): python3-jaraco-classes-3.2.1-5.el9.n 290 kB/s | 18 kB 00:00 2024-03-04T12:17:38.588 INFO:teuthology.orchestra.run.smithi172.stdout:(260/284): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2024-03-04T12:17:38.630 INFO:teuthology.orchestra.run.smithi172.stdout:(261/284): python3-jaraco-functools-3.5.0-2.el9 291 kB/s | 19 kB 00:00 2024-03-04T12:17:38.664 INFO:teuthology.orchestra.run.smithi172.stdout:(262/284): protobuf-compiler-3.14.0-13.el9.x86_ 462 kB/s | 863 kB 00:01 2024-03-04T12:17:38.697 INFO:teuthology.orchestra.run.smithi172.stdout:(263/284): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2024-03-04T12:17:38.739 INFO:teuthology.orchestra.run.smithi172.stdout:(264/284): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-03-04T12:17:38.815 INFO:teuthology.orchestra.run.smithi172.stdout:(265/284): python3-natsort-7.1.1-5.el9.noarch.r 770 kB/s | 58 kB 00:00 2024-03-04T12:17:38.890 INFO:teuthology.orchestra.run.smithi172.stdout:(266/284): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-03-04T12:17:38.932 INFO:teuthology.orchestra.run.smithi172.stdout:(267/284): python3-more-itertools-8.12.0-2.el9. 337 kB/s | 79 kB 00:00 2024-03-04T12:17:38.957 INFO:teuthology.orchestra.run.smithi172.stdout:(268/284): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-03-04T12:17:38.999 INFO:teuthology.orchestra.run.smithi172.stdout:(269/284): python3-repoze-lru-0.7-16.el9.noarch 738 kB/s | 31 kB 00:00 2024-03-04T12:17:39.024 INFO:teuthology.orchestra.run.smithi172.stdout:(270/284): python3-pyOpenSSL-21.0.0-1.el9.noarc 979 kB/s | 90 kB 00:00 2024-03-04T12:17:39.083 INFO:teuthology.orchestra.run.smithi172.stdout:(271/284): python3-kubernetes-26.1.0-2.el9.noar 2.3 MB/s | 1.0 MB 00:00 2024-03-04T12:17:39.125 INFO:teuthology.orchestra.run.smithi172.stdout:(272/284): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-03-04T12:17:39.150 INFO:teuthology.orchestra.run.smithi172.stdout:(273/284): python3-rsa-4.9-2.el9.noarch.rpm 471 kB/s | 59 kB 00:00 2024-03-04T12:17:39.167 INFO:teuthology.orchestra.run.smithi172.stdout:(274/284): python3-tempora-5.0.0-2.el9.noarch.r 427 kB/s | 36 kB 00:00 2024-03-04T12:17:39.192 INFO:teuthology.orchestra.run.smithi172.stdout:(275/284): python3-typing-extensions-4.4.0-2.el 1.2 MB/s | 51 kB 00:00 2024-03-04T12:17:39.226 INFO:teuthology.orchestra.run.smithi172.stdout:(276/284): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-03-04T12:17:39.284 INFO:teuthology.orchestra.run.smithi172.stdout:(277/284): python3-zc-lockfile-2.0-10.el9.noarc 343 kB/s | 20 kB 00:00 2024-03-04T12:17:39.310 INFO:teuthology.orchestra.run.smithi172.stdout:(278/284): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-03-04T12:17:39.335 INFO:teuthology.orchestra.run.smithi172.stdout:(279/284): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-03-04T12:17:39.393 INFO:teuthology.orchestra.run.smithi172.stdout:(280/284): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-03-04T12:17:39.427 INFO:teuthology.orchestra.run.smithi172.stdout:(281/284): s3cmd-2.4.0-1.el9.noarch.rpm 1.7 MB/s | 206 kB 00:00 2024-03-04T12:17:39.694 INFO:teuthology.orchestra.run.smithi172.stdout:(282/284): thrift-0.15.0-2.el9.x86_64.rpm 4.4 MB/s | 1.6 MB 00:00 2024-03-04T12:17:40.202 INFO:teuthology.orchestra.run.smithi172.stdout:(283/284): librbd1-19.0.0-1871.g3aec3903.el9.x8 4.0 MB/s | 3.1 MB 00:00 2024-03-04T12:17:40.536 INFO:teuthology.orchestra.run.smithi172.stdout:(284/284): librados2-19.0.0-1871.g3aec3903.el9. 3.0 MB/s | 3.4 MB 00:01 2024-03-04T12:17:40.540 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-03-04T12:17:40.541 INFO:teuthology.orchestra.run.smithi172.stdout:Total 14 MB/s | 296 MB 00:21 2024-03-04T12:17:40.636 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-03-04T12:17:40.802 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-03-04T12:17:40.802 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-03-04T12:17:42.813 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-03-04T12:17:42.964 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 1/1 2024-03-04T12:17:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-03-04T12:17:43.202 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/286 2024-03-04T12:17:43.230 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/286 2024-03-04T12:17:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/286 2024-03-04T12:17:43.346 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : alsa-lib-1.2.10-2.el9.x86_64 4/286 2024-03-04T12:17:43.346 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-03-04T12:17:43.346 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-03-04T12:17:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/286 2024-03-04T12:17:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/286 2024-03-04T12:17:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/286 2024-03-04T12:17:43.507 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/286 2024-03-04T12:17:43.845 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/286 2024-03-04T12:17:43.900 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librados2-2:19.0.0-1871.g3aec3903.el9.x86_64 10/286 2024-03-04T12:17:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:19.0.0-1871.g3aec3903.el9.x86_64 10/286 2024-03-04T12:17:44.051 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-2:19.0.0-1871.g3aec3903.el9.x86_64 11/286 2024-03-04T12:17:44.155 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs2-2:19.0.0-1871.g3aec3903.el9.x86_64 11/286 2024-03-04T12:17:44.180 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-2:19.0.0-1871.g3aec3903.el9.x86_64 12/286 2024-03-04T12:17:44.228 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/286 2024-03-04T12:17:44.265 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/286 2024-03-04T12:17:44.290 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/286 2024-03-04T12:17:44.314 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/286 2024-03-04T12:17:44.342 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libX11-xcb-1.7.0-8.el9.x86_64 17/286 2024-03-04T12:17:44.374 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : opus-1.3.1-10.el9.x86_64 18/286 2024-03-04T12:17:44.412 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-5.4.4-4.el9.x86_64 19/286 2024-03-04T12:17:44.561 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/286 2024-03-04T12:17:44.707 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/286 2024-03-04T12:17:44.743 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/286 2024-03-04T12:17:44.787 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/286 2024-03-04T12:17:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephsqlite-2:19.0.0-1871.g3aec3903.el9.x86_64 24/286 2024-03-04T12:17:44.904 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1871.g3aec3903.el9.x86_64 24/286 2024-03-04T12:17:44.933 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libradosstriper1-2:19.0.0-1871.g3aec3903.el9.x86 25/286 2024-03-04T12:17:44.996 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1871.g3aec3903.el9.x86 25/286 2024-03-04T12:17:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/286 2024-03-04T12:17:45.043 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 27/286 2024-03-04T12:17:45.059 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 27/286 2024-03-04T12:17:45.237 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 28/286 2024-03-04T12:17:45.269 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 28/286 2024-03-04T12:17:45.379 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : re2-1:20211101-3.el9.x86_64 29/286 2024-03-04T12:17:45.474 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 30/286 2024-03-04T12:17:45.517 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 31/286 2024-03-04T12:17:45.596 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/286 2024-03-04T12:17:45.649 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 33/286 2024-03-04T12:17:45.680 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 34/286 2024-03-04T12:17:45.723 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 35/286 2024-03-04T12:17:45.759 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 36/286 2024-03-04T12:17:45.792 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-2.9.9-15.el9.x86_64 37/286 2024-03-04T12:17:45.831 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cups-libs-1:2.3.3op2-24.el9.x86_64 38/286 2024-03-04T12:17:45.896 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 39/286 2024-03-04T12:17:45.930 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 40/286 2024-03-04T12:17:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 41/286 2024-03-04T12:17:45.999 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 42/286 2024-03-04T12:17:46.023 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : mesa-libglapi-23.3.3-1.el9.x86_64 43/286 2024-03-04T12:17:46.050 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 44/286 2024-03-04T12:17:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 45/286 2024-03-04T12:17:46.109 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 46/286 2024-03-04T12:17:46.138 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 47/286 2024-03-04T12:17:46.170 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 48/286 2024-03-04T12:17:46.195 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 49/286 2024-03-04T12:17:46.244 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 50/286 2024-03-04T12:17:46.268 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : dconf-0.40.0-6.el9.x86_64 51/286 2024-03-04T12:17:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 51/286 2024-03-04T12:17:46.368 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-common-2:19.0.0-1871.g3aec3903.el9. 52/286 2024-03-04T12:17:46.411 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-argparse-2:19.0.0-1871.g3aec3903.el 53/286 2024-03-04T12:17:46.453 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-2:19.0.0-1871.g3aec3903.el9.x86_6 54/286 2024-03-04T12:17:46.537 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/286 2024-03-04T12:17:46.679 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/286 2024-03-04T12:17:46.731 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/286 2024-03-04T12:17:47.260 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/286 2024-03-04T12:17:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/286 2024-03-04T12:17:47.370 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 60/286 2024-03-04T12:17:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 61/286 2024-03-04T12:17:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/286 2024-03-04T12:17:47.514 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/286 2024-03-04T12:17:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/286 2024-03-04T12:17:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/286 2024-03-04T12:17:47.645 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : luarocks-3.9.2-1.el9.noarch 66/286 2024-03-04T12:17:47.670 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/286 2024-03-04T12:17:47.706 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/286 2024-03-04T12:17:47.744 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-2:19.0.0-1871.g3aec3903.el9.x86_6 69/286 2024-03-04T12:17:47.775 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/286 2024-03-04T12:17:47.811 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/286 2024-03-04T12:17:47.851 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 72/286 2024-03-04T12:17:47.908 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/286 2024-03-04T12:17:47.952 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/286 2024-03-04T12:17:47.989 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/286 2024-03-04T12:17:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/286 2024-03-04T12:17:48.117 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/286 2024-03-04T12:17:48.148 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 78/286 2024-03-04T12:17:48.184 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 79/286 2024-03-04T12:17:48.231 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/286 2024-03-04T12:17:48.276 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/286 2024-03-04T12:17:48.318 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/286 2024-03-04T12:17:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/286 2024-03-04T12:17:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/286 2024-03-04T12:17:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 85/286 2024-03-04T12:17:48.641 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/286 2024-03-04T12:17:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 87/286 2024-03-04T12:17:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/286 2024-03-04T12:17:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/286 2024-03-04T12:17:48.769 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 90/286 2024-03-04T12:17:48.852 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/286 2024-03-04T12:17:48.979 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/286 2024-03-04T12:17:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/286 2024-03-04T12:17:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 94/286 2024-03-04T12:17:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : p11-kit-server-0.24.1-2.el9.x86_64 95/286 2024-03-04T12:17:49.202 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ostree-libs-2024.4-3.el9.x86_64 96/286 2024-03-04T12:17:49.237 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : avahi-glib-0.8-12.el9.x86_64 97/286 2024-03-04T12:17:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/286 2024-03-04T12:17:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/286 2024-03-04T12:17:49.551 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/286 2024-03-04T12:17:49.592 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/286 2024-03-04T12:17:49.732 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/286 2024-03-04T12:17:49.775 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 103/286 2024-03-04T12:17:49.810 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 104/286 2024-03-04T12:17:49.847 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 105/286 2024-03-04T12:17:49.880 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : jq-1.6-16.el9.x86_64 106/286 2024-03-04T12:17:49.908 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 107/286 2024-03-04T12:17:49.972 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libpciaccess-0.16-6.el9.x86_64 108/286 2024-03-04T12:17:50.009 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libdrm-2.4.117-1.el9.x86_64 109/286 2024-03-04T12:17:50.035 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : mesa-libgbm-23.3.3-1.el9.x86_64 110/286 2024-03-04T12:17:50.062 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 111/286 2024-03-04T12:17:50.088 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : mesa-libEGL-23.3.3-1.el9.x86_64 112/286 2024-03-04T12:17:50.120 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : bubblewrap-0.4.1-6.el9.x86_64 113/286 2024-03-04T12:17:50.153 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : bluez-libs-5.64-1.el9.x86_64 114/286 2024-03-04T12:17:50.183 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 115/286 2024-03-04T12:17:50.393 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 116/286 2024-03-04T12:17:50.435 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 117/286 2024-03-04T12:17:50.467 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 118/286 2024-03-04T12:17:50.497 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 119/286 2024-03-04T12:17:50.538 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 120/286 2024-03-04T12:17:50.568 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : upower-0.99.11-11.el9.x86_64 121/286 2024-03-04T12:17:50.580 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 121/286 2024-03-04T12:17:50.580 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-03-04T12:17:50.580 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:17:50.771 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : tzdata-java-2024a-1.el9.noarch 122/286 2024-03-04T12:17:50.847 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 123/286 2024-03-04T12:17:50.899 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 124/286 2024-03-04T12:17:50.924 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 125/286 2024-03-04T12:17:50.950 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 125/286 2024-03-04T12:17:50.984 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 126/286 2024-03-04T12:17:51.398 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 127/286 2024-03-04T12:17:51.422 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rtkit-0.11-28.el9.x86_64 127/286 2024-03-04T12:17:51.434 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 127/286 2024-03-04T12:17:51.434 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-03-04T12:17:51.434 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:17:51.478 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 128/286 2024-03-04T12:17:51.555 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 129/286 2024-03-04T12:17:51.589 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 130/286 2024-03-04T12:17:51.630 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 131/286 2024-03-04T12:17:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 132/286 2024-03-04T12:17:51.706 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 133/286 2024-03-04T12:17:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 134/286 2024-03-04T12:17:51.895 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 135/286 2024-03-04T12:17:51.938 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 136/286 2024-03-04T12:17:51.969 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 137/286 2024-03-04T12:17:52.016 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 138/286 2024-03-04T12:17:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-packaging-20.9-5.el9.noarch 139/286 2024-03-04T12:17:52.171 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 140/286 2024-03-04T12:17:52.918 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 141/286 2024-03-04T12:17:52.960 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 142/286 2024-03-04T12:17:53.002 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 143/286 2024-03-04T12:17:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 144/286 2024-03-04T12:17:53.075 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-03-04T12:17:53.226 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 1/1 2024-03-04T12:17:53.233 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 145/286 2024-03-04T12:17:53.269 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 146/286 2024-03-04T12:17:53.386 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-03-04T12:17:53.467 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/286 2024-03-04T12:17:53.498 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/286 2024-03-04T12:17:53.565 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/286 2024-03-04T12:17:53.605 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : alsa-lib-1.2.10-2.el9.x86_64 4/286 2024-03-04T12:17:53.659 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/286 2024-03-04T12:17:53.700 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/286 2024-03-04T12:17:53.716 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/286 2024-03-04T12:17:53.751 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 147/286 2024-03-04T12:17:53.780 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/286 2024-03-04T12:17:53.807 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : osinfo-db-20231215-1.el9.noarch 148/286 2024-03-04T12:17:53.845 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 149/286 2024-03-04T12:17:53.878 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : orc-0.4.31-6.el9.x86_64 150/286 2024-03-04T12:17:53.912 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 151/286 2024-03-04T12:17:54.089 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-0.3.21-2.el9.x86_64 152/286 2024-03-04T12:17:54.117 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/286 2024-03-04T12:17:54.118 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 153/286 2024-03-04T12:17:54.167 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.0.0-1871.g3aec3903.el9.x86_64 10/286 2024-03-04T12:17:54.201 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 154/286 2024-03-04T12:17:54.272 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.0.0-1871.g3aec3903.el9.x86_64 10/286 2024-03-04T12:17:54.302 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.0.0-1871.g3aec3903.el9.x86_64 11/286 2024-03-04T12:17:54.378 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.0.0-1871.g3aec3903.el9.x86_64 11/286 2024-03-04T12:17:54.406 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.0.0-1871.g3aec3903.el9.x86_64 12/286 2024-03-04T12:17:54.444 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/286 2024-03-04T12:17:54.482 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/286 2024-03-04T12:17:54.507 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/286 2024-03-04T12:17:54.531 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/286 2024-03-04T12:17:54.559 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libX11-xcb-1.7.0-8.el9.x86_64 17/286 2024-03-04T12:17:54.591 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : opus-1.3.1-10.el9.x86_64 18/286 2024-03-04T12:17:54.626 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 19/286 2024-03-04T12:17:54.775 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/286 2024-03-04T12:17:54.879 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 155/286 2024-03-04T12:17:54.896 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/286 2024-03-04T12:17:54.933 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/286 2024-03-04T12:17:54.970 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/286 2024-03-04T12:17:54.992 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 156/286 2024-03-04T12:17:54.997 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.0.0-1871.g3aec3903.el9.x86_64 24/286 2024-03-04T12:17:55.085 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1871.g3aec3903.el9.x86_64 24/286 2024-03-04T12:17:55.107 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.0.0-1871.g3aec3903.el9.x86 25/286 2024-03-04T12:17:55.170 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1871.g3aec3903.el9.x86 25/286 2024-03-04T12:17:55.204 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/286 2024-03-04T12:17:55.233 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 27/286 2024-03-04T12:17:55.249 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 27/286 2024-03-04T12:17:55.435 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 28/286 2024-03-04T12:17:55.466 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 28/286 2024-03-04T12:17:55.581 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-3.el9.x86_64 29/286 2024-03-04T12:17:55.669 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 30/286 2024-03-04T12:17:55.706 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 31/286 2024-03-04T12:17:55.776 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/286 2024-03-04T12:17:55.830 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 33/286 2024-03-04T12:17:55.861 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 34/286 2024-03-04T12:17:55.903 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 35/286 2024-03-04T12:17:55.940 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 36/286 2024-03-04T12:17:55.973 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-15.el9.x86_64 37/286 2024-03-04T12:17:56.013 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cups-libs-1:2.3.3op2-24.el9.x86_64 38/286 2024-03-04T12:17:56.093 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 39/286 2024-03-04T12:17:56.128 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 40/286 2024-03-04T12:17:56.170 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 41/286 2024-03-04T12:17:56.205 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 42/286 2024-03-04T12:17:56.229 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : mesa-libglapi-23.3.3-1.el9.x86_64 43/286 2024-03-04T12:17:56.256 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 44/286 2024-03-04T12:17:56.283 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 157/286 2024-03-04T12:17:56.285 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 45/286 2024-03-04T12:17:56.315 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 46/286 2024-03-04T12:17:56.343 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 47/286 2024-03-04T12:17:56.375 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 48/286 2024-03-04T12:17:56.379 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 158/286 2024-03-04T12:17:56.400 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 49/286 2024-03-04T12:17:56.407 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-posix-35.0-8.el9.x86_64 159/286 2024-03-04T12:17:56.442 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 50/286 2024-03-04T12:17:56.466 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : dconf-0.40.0-6.el9.x86_64 51/286 2024-03-04T12:17:56.536 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 51/286 2024-03-04T12:17:56.590 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.0.0-1871.g3aec3903.el9. 52/286 2024-03-04T12:17:56.632 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.0.0-1871.g3aec3903.el 53/286 2024-03-04T12:17:56.683 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.0.0-1871.g3aec3903.el9.x86_6 54/286 2024-03-04T12:17:56.758 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/286 2024-03-04T12:17:56.900 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/286 2024-03-04T12:17:56.953 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/286 2024-03-04T12:17:57.302 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 160/286 2024-03-04T12:17:57.353 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 161/286 2024-03-04T12:17:57.478 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/286 2024-03-04T12:17:57.564 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/286 2024-03-04T12:17:57.591 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 60/286 2024-03-04T12:17:57.651 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 61/286 2024-03-04T12:17:57.690 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/286 2024-03-04T12:17:57.705 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 161/286 2024-03-04T12:17:57.726 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/286 2024-03-04T12:17:57.743 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 162/286 2024-03-04T12:17:57.755 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/286 2024-03-04T12:17:57.775 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : slf4j-1.7.30-13.el9.noarch 163/286 2024-03-04T12:17:57.801 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : atinject-1.0.3-6.el9.noarch 164/286 2024-03-04T12:17:57.824 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/286 2024-03-04T12:17:57.837 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 165/286 2024-03-04T12:17:57.857 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-1.el9.noarch 66/286 2024-03-04T12:17:57.873 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 166/286 2024-03-04T12:17:57.882 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/286 2024-03-04T12:17:57.900 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 167/286 2024-03-04T12:17:57.918 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/286 2024-03-04T12:17:57.927 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 168/286 2024-03-04T12:17:57.952 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 169/286 2024-03-04T12:17:57.955 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.0.0-1871.g3aec3903.el9.x86_6 69/286 2024-03-04T12:17:57.977 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 170/286 2024-03-04T12:17:57.987 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/286 2024-03-04T12:17:58.004 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 171/286 2024-03-04T12:17:58.022 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/286 2024-03-04T12:17:58.029 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 172/286 2024-03-04T12:17:58.056 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 173/286 2024-03-04T12:17:58.062 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 72/286 2024-03-04T12:17:58.086 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 174/286 2024-03-04T12:17:58.114 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 175/286 2024-03-04T12:17:58.120 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/286 2024-03-04T12:17:58.150 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 176/286 2024-03-04T12:17:58.155 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/286 2024-03-04T12:17:58.185 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 177/286 2024-03-04T12:17:58.192 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/286 2024-03-04T12:17:58.215 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 178/286 2024-03-04T12:17:58.247 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/286 2024-03-04T12:17:58.250 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 179/286 2024-03-04T12:17:58.284 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : jansi-2.3.3-6.el9.x86_64 180/286 2024-03-04T12:17:58.313 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : jsoup-1.13.1-10.el9.noarch 181/286 2024-03-04T12:17:58.319 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/286 2024-03-04T12:17:58.351 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 182/286 2024-03-04T12:17:58.359 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 78/286 2024-03-04T12:17:58.389 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 183/286 2024-03-04T12:17:58.396 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 79/286 2024-03-04T12:17:58.430 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 184/286 2024-03-04T12:17:58.442 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/286 2024-03-04T12:17:58.462 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : guava-30.1-6.el9.noarch 185/286 2024-03-04T12:17:58.485 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : google-guice-4.2.3-9.el9.noarch 186/286 2024-03-04T12:17:58.487 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/286 2024-03-04T12:17:58.530 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/286 2024-03-04T12:17:58.538 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 187/286 2024-03-04T12:17:58.572 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 188/286 2024-03-04T12:17:58.602 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 189/286 2024-03-04T12:17:58.612 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 189/286 2024-03-04T12:17:58.613 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-03-04T12:17:58.613 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:17:58.664 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/286 2024-03-04T12:17:58.666 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 190/286 2024-03-04T12:17:58.697 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 191/286 2024-03-04T12:17:58.706 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/286 2024-03-04T12:17:58.725 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libsbc-1.4-9.el9.x86_64 192/286 2024-03-04T12:17:58.747 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 85/286 2024-03-04T12:17:58.842 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/286 2024-03-04T12:17:58.890 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 87/286 2024-03-04T12:17:58.930 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/286 2024-03-04T12:17:58.963 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/286 2024-03-04T12:17:58.988 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 90/286 2024-03-04T12:17:59.038 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 193/286 2024-03-04T12:17:59.072 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librbd1-2:19.0.0-1871.g3aec3903.el9.x86_64 194/286 2024-03-04T12:17:59.075 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/286 2024-03-04T12:17:59.163 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:19.0.0-1871.g3aec3903.el9.x86_64 194/286 2024-03-04T12:17:59.196 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-2:19.0.0-1871.g3aec3903.el9.x86_64 195/286 2024-03-04T12:17:59.196 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/286 2024-03-04T12:17:59.225 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 196/286 2024-03-04T12:17:59.312 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/286 2024-03-04T12:17:59.357 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 94/286 2024-03-04T12:17:59.394 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : p11-kit-server-0.24.1-2.el9.x86_64 95/286 2024-03-04T12:17:59.437 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ostree-libs-2024.4-3.el9.x86_64 96/286 2024-03-04T12:17:59.471 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : avahi-glib-0.8-12.el9.x86_64 97/286 2024-03-04T12:17:59.536 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/286 2024-03-04T12:17:59.600 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/286 2024-03-04T12:17:59.641 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-04T12:17:59.671 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-04T12:17:59.688 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-04T12:17:59.721 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 198/286 2024-03-04T12:17:59.777 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 199/286 2024-03-04T12:17:59.792 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/286 2024-03-04T12:17:59.814 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 200/286 2024-03-04T12:17:59.840 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 201/286 2024-03-04T12:17:59.841 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/286 2024-03-04T12:17:59.884 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 202/286 2024-03-04T12:17:59.904 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 203/286 2024-03-04T12:17:59.979 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/286 2024-03-04T12:18:00.015 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 103/286 2024-03-04T12:18:00.047 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 104/286 2024-03-04T12:18:00.079 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 105/286 2024-03-04T12:18:00.117 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : jq-1.6-16.el9.x86_64 106/286 2024-03-04T12:18:00.161 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 107/286 2024-03-04T12:18:00.179 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 203/286 2024-03-04T12:18:00.192 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpciaccess-0.16-6.el9.x86_64 108/286 2024-03-04T12:18:00.214 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libexif-0.6.22-6.el9.x86_64 204/286 2024-03-04T12:18:00.219 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libdrm-2.4.117-1.el9.x86_64 109/286 2024-03-04T12:18:00.242 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 205/286 2024-03-04T12:18:00.246 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : mesa-libgbm-23.3.3-1.el9.x86_64 110/286 2024-03-04T12:18:00.268 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libasyncns-0.8-22.el9.x86_64 206/286 2024-03-04T12:18:00.272 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 111/286 2024-03-04T12:18:00.296 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 207/286 2024-03-04T12:18:00.298 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : mesa-libEGL-23.3.3-1.el9.x86_64 112/286 2024-03-04T12:18:00.323 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bubblewrap-0.4.1-6.el9.x86_64 113/286 2024-03-04T12:18:00.329 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 208/286 2024-03-04T12:18:00.353 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : mesa-libGL-23.3.3-1.el9.x86_64 209/286 2024-03-04T12:18:00.355 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bluez-libs-5.64-1.el9.x86_64 114/286 2024-03-04T12:18:00.385 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 115/286 2024-03-04T12:18:00.387 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libXv-1.0.11-16.el9.x86_64 210/286 2024-03-04T12:18:00.412 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 211/286 2024-03-04T12:18:00.440 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 212/286 2024-03-04T12:18:00.477 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 213/286 2024-03-04T12:18:00.520 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libtiff-4.4.0-12.el9.x86_64 214/286 2024-03-04T12:18:00.552 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 215/286 2024-03-04T12:18:00.591 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 116/286 2024-03-04T12:18:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 216/286 2024-03-04T12:18:00.627 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : poppler-21.01.0-19.el9.x86_64 217/286 2024-03-04T12:18:00.629 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 117/286 2024-03-04T12:18:00.660 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 118/286 2024-03-04T12:18:00.690 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 119/286 2024-03-04T12:18:00.731 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 120/286 2024-03-04T12:18:00.761 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : upower-0.99.11-11.el9.x86_64 121/286 2024-03-04T12:18:00.773 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 121/286 2024-03-04T12:18:00.773 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-03-04T12:18:00.773 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:18:00.956 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : tzdata-java-2024a-1.el9.noarch 122/286 2024-03-04T12:18:01.022 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 123/286 2024-03-04T12:18:01.083 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 124/286 2024-03-04T12:18:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : poppler-glib-21.01.0-19.el9.x86_64 218/286 2024-03-04T12:18:01.109 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 125/286 2024-03-04T12:18:01.132 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 125/286 2024-03-04T12:18:01.160 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 126/286 2024-03-04T12:18:01.216 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 219/286 2024-03-04T12:18:01.268 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 220/286 2024-03-04T12:18:01.294 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 221/286 2024-03-04T12:18:01.322 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gsm-1.0.19-6.el9.x86_64 222/286 2024-03-04T12:18:01.394 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 223/286 2024-03-04T12:18:01.438 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 224/286 2024-03-04T12:18:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcanberra-0.30-27.el9.x86_64 225/286 2024-03-04T12:18:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 225/286 2024-03-04T12:18:01.514 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 127/286 2024-03-04T12:18:01.547 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rtkit-0.11-28.el9.x86_64 127/286 2024-03-04T12:18:01.558 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 127/286 2024-03-04T12:18:01.558 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-03-04T12:18:01.558 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:18:01.590 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : graphene-1.10.6-2.el9.x86_64 226/286 2024-03-04T12:18:01.603 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 128/286 2024-03-04T12:18:01.629 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 227/286 2024-03-04T12:18:01.654 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : giflib-5.2.1-9.el9.x86_64 228/286 2024-03-04T12:18:01.684 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 229/286 2024-03-04T12:18:01.718 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 230/286 2024-03-04T12:18:01.723 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 129/286 2024-03-04T12:18:01.772 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 130/286 2024-03-04T12:18:01.805 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 131/286 2024-03-04T12:18:01.846 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 132/286 2024-03-04T12:18:01.881 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 133/286 2024-03-04T12:18:01.971 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 134/286 2024-03-04T12:18:02.061 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 135/286 2024-03-04T12:18:02.104 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 136/286 2024-03-04T12:18:02.143 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 137/286 2024-03-04T12:18:02.190 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 138/286 2024-03-04T12:18:02.290 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 139/286 2024-03-04T12:18:02.345 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 140/286 2024-03-04T12:18:03.094 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 141/286 2024-03-04T12:18:03.141 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 142/286 2024-03-04T12:18:03.175 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 143/286 2024-03-04T12:18:03.208 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 144/286 2024-03-04T12:18:03.400 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 145/286 2024-03-04T12:18:03.442 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 146/286 2024-03-04T12:18:03.933 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 147/286 2024-03-04T12:18:03.996 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : osinfo-db-20231215-1.el9.noarch 148/286 2024-03-04T12:18:04.033 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 149/286 2024-03-04T12:18:04.067 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : orc-0.4.31-6.el9.x86_64 150/286 2024-03-04T12:18:04.100 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 151/286 2024-03-04T12:18:04.278 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.21-2.el9.x86_64 152/286 2024-03-04T12:18:04.306 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 153/286 2024-03-04T12:18:04.389 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 154/286 2024-03-04T12:18:05.090 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 155/286 2024-03-04T12:18:05.206 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 156/286 2024-03-04T12:18:06.479 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 157/286 2024-03-04T12:18:06.574 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 158/286 2024-03-04T12:18:06.618 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-posix-35.0-8.el9.x86_64 159/286 2024-03-04T12:18:07.500 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 160/286 2024-03-04T12:18:07.579 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 161/286 2024-03-04T12:18:07.962 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 161/286 2024-03-04T12:18:08.045 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 162/286 2024-03-04T12:18:08.075 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : slf4j-1.7.30-13.el9.noarch 163/286 2024-03-04T12:18:08.103 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : atinject-1.0.3-6.el9.noarch 164/286 2024-03-04T12:18:08.146 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 165/286 2024-03-04T12:18:08.183 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 166/286 2024-03-04T12:18:08.210 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 167/286 2024-03-04T12:18:08.236 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 168/286 2024-03-04T12:18:08.262 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 169/286 2024-03-04T12:18:08.286 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 170/286 2024-03-04T12:18:08.321 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 171/286 2024-03-04T12:18:08.346 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 172/286 2024-03-04T12:18:08.373 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 173/286 2024-03-04T12:18:08.403 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 174/286 2024-03-04T12:18:08.431 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 175/286 2024-03-04T12:18:08.458 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 176/286 2024-03-04T12:18:08.494 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 177/286 2024-03-04T12:18:08.524 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 178/286 2024-03-04T12:18:08.558 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 179/286 2024-03-04T12:18:08.592 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : jansi-2.3.3-6.el9.x86_64 180/286 2024-03-04T12:18:08.629 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : jsoup-1.13.1-10.el9.noarch 181/286 2024-03-04T12:18:08.668 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 182/286 2024-03-04T12:18:08.710 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 183/286 2024-03-04T12:18:08.754 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 184/286 2024-03-04T12:18:08.786 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : guava-30.1-6.el9.noarch 185/286 2024-03-04T12:18:08.809 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : google-guice-4.2.3-9.el9.noarch 186/286 2024-03-04T12:18:08.863 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 187/286 2024-03-04T12:18:08.897 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 188/286 2024-03-04T12:18:08.926 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 189/286 2024-03-04T12:18:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 189/286 2024-03-04T12:18:08.937 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-03-04T12:18:08.937 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:18:08.997 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 190/286 2024-03-04T12:18:09.029 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 191/286 2024-03-04T12:18:09.058 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libsbc-1.4-9.el9.x86_64 192/286 2024-03-04T12:18:09.371 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 193/286 2024-03-04T12:18:09.396 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.0.0-1871.g3aec3903.el9.x86_64 194/286 2024-03-04T12:18:09.487 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.0.0-1871.g3aec3903.el9.x86_64 194/286 2024-03-04T12:18:09.519 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.0.0-1871.g3aec3903.el9.x86_64 195/286 2024-03-04T12:18:09.548 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 196/286 2024-03-04T12:18:09.924 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-04T12:18:09.953 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-04T12:18:09.970 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-04T12:18:10.002 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 198/286 2024-03-04T12:18:10.059 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 199/286 2024-03-04T12:18:10.092 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 200/286 2024-03-04T12:18:10.126 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 201/286 2024-03-04T12:18:10.172 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 202/286 2024-03-04T12:18:10.199 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 203/286 2024-03-04T12:18:10.504 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 203/286 2024-03-04T12:18:10.543 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libexif-0.6.22-6.el9.x86_64 204/286 2024-03-04T12:18:10.571 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 205/286 2024-03-04T12:18:10.596 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libasyncns-0.8-22.el9.x86_64 206/286 2024-03-04T12:18:10.624 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 207/286 2024-03-04T12:18:10.657 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 208/286 2024-03-04T12:18:10.681 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : mesa-libGL-23.3.3-1.el9.x86_64 209/286 2024-03-04T12:18:10.706 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libXv-1.0.11-16.el9.x86_64 210/286 2024-03-04T12:18:10.731 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 211/286 2024-03-04T12:18:10.759 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 212/286 2024-03-04T12:18:10.791 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 213/286 2024-03-04T12:18:10.834 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtiff-4.4.0-12.el9.x86_64 214/286 2024-03-04T12:18:10.863 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 215/286 2024-03-04T12:18:10.911 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 216/286 2024-03-04T12:18:10.937 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : poppler-21.01.0-19.el9.x86_64 217/286 2024-03-04T12:18:11.421 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : poppler-glib-21.01.0-19.el9.x86_64 218/286 2024-03-04T12:18:11.555 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 219/286 2024-03-04T12:18:11.611 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 220/286 2024-03-04T12:18:11.636 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 221/286 2024-03-04T12:18:11.665 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gsm-1.0.19-6.el9.x86_64 222/286 2024-03-04T12:18:11.759 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 223/286 2024-03-04T12:18:11.796 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 224/286 2024-03-04T12:18:11.821 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcanberra-0.30-27.el9.x86_64 225/286 2024-03-04T12:18:11.839 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 225/286 2024-03-04T12:18:11.948 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : graphene-1.10.6-2.el9.x86_64 226/286 2024-03-04T12:18:11.995 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 227/286 2024-03-04T12:18:12.021 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : giflib-5.2.1-9.el9.x86_64 228/286 2024-03-04T12:18:12.054 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 229/286 2024-03-04T12:18:12.085 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 230/286 2024-03-04T12:18:14.633 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 230/286 2024-03-04T12:18:14.664 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 231/286 2024-03-04T12:18:15.085 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 232/286 2024-03-04T12:18:15.112 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 232/286 2024-03-04T12:18:15.127 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 232/286 2024-03-04T12:18:15.128 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-03-04T12:18:15.128 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:18:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 233/286 2024-03-04T12:18:15.431 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 234/286 2024-03-04T12:18:15.473 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 235/286 2024-03-04T12:18:15.950 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 236/286 2024-03-04T12:18:16.027 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 236/286 2024-03-04T12:18:16.058 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 237/286 2024-03-04T12:18:16.085 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 237/286 2024-03-04T12:18:16.120 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 238/286 2024-03-04T12:18:16.174 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 239/286 2024-03-04T12:18:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 240/286 2024-03-04T12:18:16.281 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : tracker-3.1.2-3.el9.x86_64 241/286 2024-03-04T12:18:16.389 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 241/286 2024-03-04T12:18:16.437 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 242/286 2024-03-04T12:18:16.451 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 242/286 2024-03-04T12:18:16.501 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 243/286 2024-03-04T12:18:16.962 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 244/286 2024-03-04T12:18:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librgw2-2:19.0.0-1871.g3aec3903.el9.x86_64 245/286 2024-03-04T12:18:17.060 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librgw2-2:19.0.0-1871.g3aec3903.el9.x86_64 245/286 2024-03-04T12:18:17.082 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-2:19.0.0-1871.g3aec3903.el9.x86_64 246/286 2024-03-04T12:18:19.296 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 247/286 2024-03-04T12:18:19.329 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 247/286 2024-03-04T12:18:19.881 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 247/286 2024-03-04T12:18:19.916 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-2:19.0.0-1871.g3aec3903.el9.x86_64 248/286 2024-03-04T12:18:20.009 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-base-2:19.0.0-1871.g3aec3903.el9.x86_64 248/286 2024-03-04T12:18:20.009 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-04T12:18:20.009 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-04T12:18:20.009 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:18:20.042 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-selinux-2:19.0.0-1871.g3aec3903.el9.x86_64 249/286 2024-03-04T12:18:24.493 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 230/286 2024-03-04T12:18:24.518 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 231/286 2024-03-04T12:18:24.939 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 232/286 2024-03-04T12:18:24.973 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 232/286 2024-03-04T12:18:24.988 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 232/286 2024-03-04T12:18:24.988 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-03-04T12:18:24.988 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:18:25.233 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 233/286 2024-03-04T12:18:25.301 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 234/286 2024-03-04T12:18:25.333 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 235/286 2024-03-04T12:18:25.829 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 236/286 2024-03-04T12:18:25.918 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 236/286 2024-03-04T12:18:25.951 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 237/286 2024-03-04T12:18:25.979 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 237/286 2024-03-04T12:18:26.020 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 238/286 2024-03-04T12:18:26.067 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 239/286 2024-03-04T12:18:26.134 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 240/286 2024-03-04T12:18:26.164 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : tracker-3.1.2-3.el9.x86_64 241/286 2024-03-04T12:18:26.268 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 241/286 2024-03-04T12:18:26.311 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 242/286 2024-03-04T12:18:26.325 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 242/286 2024-03-04T12:18:26.371 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 243/286 2024-03-04T12:18:26.827 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 244/286 2024-03-04T12:18:26.854 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.0.0-1871.g3aec3903.el9.x86_64 245/286 2024-03-04T12:18:26.926 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.0.0-1871.g3aec3903.el9.x86_64 245/286 2024-03-04T12:18:26.957 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.0.0-1871.g3aec3903.el9.x86_64 246/286 2024-03-04T12:18:29.132 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 247/286 2024-03-04T12:18:29.170 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 247/286 2024-03-04T12:18:29.409 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1871.g3aec3903.el9.x86_64 249/286 2024-03-04T12:18:29.409 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /sys 2024-03-04T12:18:29.409 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /proc 2024-03-04T12:18:29.409 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /mnt 2024-03-04T12:18:29.409 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /var/tmp 2024-03-04T12:18:29.409 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /home 2024-03-04T12:18:29.409 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /root 2024-03-04T12:18:29.409 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /tmp 2024-03-04T12:18:29.409 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:18:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-volume-2:19.0.0-1871.g3aec3903.el9.noarch 250/286 2024-03-04T12:18:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-volume-2:19.0.0-1871.g3aec3903.el9.noarch 250/286 2024-03-04T12:18:29.583 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:18:29.583 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-04T12:18:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:18:29.710 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 247/286 2024-03-04T12:18:29.739 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.0.0-1871.g3aec3903.el9.x86_64 248/286 2024-03-04T12:18:29.831 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.0.0-1871.g3aec3903.el9.x86_64 248/286 2024-03-04T12:18:29.831 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-04T12:18:29.831 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-04T12:18:29.831 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:18:29.857 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.0.0-1871.g3aec3903.el9.x86_64 249/286 2024-03-04T12:18:31.020 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-2:19.0.0-1871.g3aec3903.el9.x86_64 251/286 2024-03-04T12:18:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-osd-2:19.0.0-1871.g3aec3903.el9.x86_64 251/286 2024-03-04T12:18:31.046 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:18:31.046 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-04T12:18:31.046 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T12:18:31.046 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T12:18:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:18:31.254 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-2:19.0.0-1871.g3aec3903.el9.x86_64 252/286 2024-03-04T12:18:31.276 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mds-2:19.0.0-1871.g3aec3903.el9.x86_64 252/286 2024-03-04T12:18:31.276 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:18:31.276 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-04T12:18:31.276 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T12:18:31.276 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T12:18:31.276 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:18:31.713 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-2:19.0.0-1871.g3aec3903.el9.x86_64 253/286 2024-03-04T12:18:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mon-2:19.0.0-1871.g3aec3903.el9.x86_64 253/286 2024-03-04T12:18:31.735 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:18:31.735 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-04T12:18:31.735 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T12:18:31.735 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T12:18:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:18:34.636 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 254/286 2024-03-04T12:18:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 255/286 2024-03-04T12:18:34.767 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 256/286 2024-03-04T12:18:34.795 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/286 2024-03-04T12:18:34.977 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/286 2024-03-04T12:18:35.028 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 258/286 2024-03-04T12:18:35.051 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 259/286 2024-03-04T12:18:35.117 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 259/286 2024-03-04T12:18:35.146 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 260/286 2024-03-04T12:18:35.156 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 260/286 2024-03-04T12:18:35.188 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : maven-1:3.6.3-15.el9.noarch 261/286 2024-03-04T12:18:35.209 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 261/286 2024-03-04T12:18:35.239 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 262/286 2024-03-04T12:18:35.682 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 263/286 2024-03-04T12:18:35.712 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 263/286 2024-03-04T12:18:35.736 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1871.g3aec3903.e 264/286 2024-03-04T12:18:35.797 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1871.g3aec3903. 265/286 2024-03-04T12:18:35.820 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1871.g3aec3903.el9.noa 266/286 2024-03-04T12:18:36.047 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1871.g3aec3903.el9.noa 266/286 2024-03-04T12:18:36.079 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1871.g3aec3903.el9.n 267/286 2024-03-04T12:18:37.044 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1871.g3aec3903.el9.n 267/286 2024-03-04T12:18:37.071 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1871.g3ae 268/286 2024-03-04T12:18:37.171 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1871.g3ae 268/286 2024-03-04T12:18:37.334 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1871.g3aec3903.el 269/286 2024-03-04T12:18:37.365 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-2:19.0.0-1871.g3aec3903.el9.x86_64 270/286 2024-03-04T12:18:37.387 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1871.g3aec3903.el9.x86_64 270/286 2024-03-04T12:18:37.387 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:18:37.387 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-04T12:18:37.388 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T12:18:37.388 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T12:18:37.388 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:18:37.432 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-rook-2:19.0.0-1871.g3aec3903.el9.noarch 271/286 2024-03-04T12:18:37.443 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1871.g3aec3903.el9.noarch 271/286 2024-03-04T12:18:38.309 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-2:19.0.0-1871.g3aec3903.el9.x86_64 272/286 2024-03-04T12:18:38.359 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-2:19.0.0-1871.g3aec3903.el9.x86_64 273/286 2024-03-04T12:18:38.381 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1871.g3aec3903.el9.x86_64 273/286 2024-03-04T12:18:38.381 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:18:38.381 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-04T12:18:38.381 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T12:18:38.381 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T12:18:38.381 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:18:38.426 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1871.g3aec3 274/286 2024-03-04T12:18:38.447 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1871.g3aec3 274/286 2024-03-04T12:18:38.447 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:18:38.447 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-04T12:18:38.448 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:18:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-2:19.0.0-1871.g3aec3903.el9.x86_64 275/286 2024-03-04T12:18:38.773 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1871.g3aec3903.el9.x86_64 275/286 2024-03-04T12:18:38.774 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:18:38.774 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-04T12:18:38.774 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T12:18:38.774 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T12:18:38.774 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:18:39.261 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1871.g3aec3903.el9.x86_64 249/286 2024-03-04T12:18:39.261 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-03-04T12:18:39.261 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-03-04T12:18:39.261 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-03-04T12:18:39.261 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-03-04T12:18:39.261 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-03-04T12:18:39.261 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-03-04T12:18:39.262 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-03-04T12:18:39.262 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:18:39.431 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:19.0.0-1871.g3aec3903.el9.noarch 250/286 2024-03-04T12:18:39.446 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:19.0.0-1871.g3aec3903.el9.noarch 250/286 2024-03-04T12:18:39.446 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:18:39.446 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-04T12:18:39.446 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:18:40.881 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.0.0-1871.g3aec3903.el9.x86_64 251/286 2024-03-04T12:18:40.907 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.0.0-1871.g3aec3903.el9.x86_64 251/286 2024-03-04T12:18:40.907 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:18:40.907 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-04T12:18:40.907 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T12:18:40.907 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-04T12:18:40.907 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:18:41.116 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.0.0-1871.g3aec3903.el9.x86_64 252/286 2024-03-04T12:18:41.138 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.0.0-1871.g3aec3903.el9.x86_64 252/286 2024-03-04T12:18:41.138 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:18:41.138 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-04T12:18:41.138 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T12:18:41.138 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-04T12:18:41.138 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:18:41.583 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.0.0-1871.g3aec3903.el9.x86_64 253/286 2024-03-04T12:18:41.605 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.0.0-1871.g3aec3903.el9.x86_64 253/286 2024-03-04T12:18:41.605 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:18:41.605 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-04T12:18:41.606 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T12:18:41.606 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-04T12:18:41.606 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:18:43.265 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-2:19.0.0-1871.g3aec3903.el9.x86_64 276/286 2024-03-04T12:18:43.293 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 277/286 2024-03-04T12:18:43.341 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 278/286 2024-03-04T12:18:43.366 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 279/286 2024-03-04T12:18:43.380 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 279/286 2024-03-04T12:18:43.380 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-03-04T12:18:43.380 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:18:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 280/286 2024-03-04T12:18:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-2:19.0.0-1871.g3aec3903.el9.x86_64 281/286 2024-03-04T12:18:43.566 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs-devel-2:19.0.0-1871.g3aec3903.el9.x86_ 282/286 2024-03-04T12:18:43.623 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 283/286 2024-03-04T12:18:43.655 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 284/286 2024-03-04T12:18:43.655 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 285/286 2024-03-04T12:18:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 285/286 2024-03-04T12:18:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-04T12:18:43.821 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-04T12:18:43.839 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 286/286 2024-03-04T12:18:43.844 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 286/286 2024-03-04T12:18:43.852 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 286/286 2024-03-04T12:18:43.861 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 286/286 2024-03-04T12:18:43.862 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-03-04T12:18:43.862 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-03-04T12:18:43.862 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:18:43.934 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 286/286 2024-03-04T12:18:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 286/286 2024-03-04T12:18:44.507 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 254/286 2024-03-04T12:18:44.609 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 255/286 2024-03-04T12:18:44.653 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 256/286 2024-03-04T12:18:44.680 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/286 2024-03-04T12:18:44.857 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/286 2024-03-04T12:18:44.905 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 258/286 2024-03-04T12:18:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 259/286 2024-03-04T12:18:44.998 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 259/286 2024-03-04T12:18:45.039 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 260/286 2024-03-04T12:18:45.049 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 260/286 2024-03-04T12:18:45.081 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : maven-1:3.6.3-15.el9.noarch 261/286 2024-03-04T12:18:45.102 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 261/286 2024-03-04T12:18:45.132 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 262/286 2024-03-04T12:18:45.532 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 263/286 2024-03-04T12:18:45.562 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 263/286 2024-03-04T12:18:45.595 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1871.g3aec3903.e 264/286 2024-03-04T12:18:45.664 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1871.g3aec3903. 265/286 2024-03-04T12:18:45.687 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1871.g3aec3903.el9.noa 266/286 2024-03-04T12:18:45.914 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1871.g3aec3903.el9.noa 266/286 2024-03-04T12:18:45.946 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1871.g3aec3903.el9.n 267/286 2024-03-04T12:18:46.911 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1871.g3aec3903.el9.n 267/286 2024-03-04T12:18:46.946 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1871.g3ae 268/286 2024-03-04T12:18:47.047 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1871.g3ae 268/286 2024-03-04T12:18:47.200 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1871.g3aec3903.el 269/286 2024-03-04T12:18:47.223 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.0.0-1871.g3aec3903.el9.x86_64 270/286 2024-03-04T12:18:47.245 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1871.g3aec3903.el9.x86_64 270/286 2024-03-04T12:18:47.246 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:18:47.246 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-04T12:18:47.246 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T12:18:47.246 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-04T12:18:47.246 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:18:47.291 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.0.0-1871.g3aec3903.el9.noarch 271/286 2024-03-04T12:18:47.302 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1871.g3aec3903.el9.noarch 271/286 2024-03-04T12:18:48.174 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.0.0-1871.g3aec3903.el9.x86_64 272/286 2024-03-04T12:18:48.209 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.0.0-1871.g3aec3903.el9.x86_64 273/286 2024-03-04T12:18:48.231 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1871.g3aec3903.el9.x86_64 273/286 2024-03-04T12:18:48.231 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:18:48.231 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-04T12:18:48.232 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T12:18:48.232 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-04T12:18:48.232 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:18:48.276 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1871.g3aec3 274/286 2024-03-04T12:18:48.297 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1871.g3aec3 274/286 2024-03-04T12:18:48.297 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:18:48.297 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-04T12:18:48.298 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:18:48.601 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.0.0-1871.g3aec3903.el9.x86_64 275/286 2024-03-04T12:18:48.624 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1871.g3aec3903.el9.x86_64 275/286 2024-03-04T12:18:48.624 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-04T12:18:48.624 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-04T12:18:48.624 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T12:18:48.624 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-04T12:18:48.624 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:18:50.299 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-04T12:18:50.300 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-2:19.0.0-1871.g3aec3903.el9.x86_64 1/286 2024-03-04T12:18:50.300 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-2:19.0.0-1871.g3aec3903.el9.x86_64 2/286 2024-03-04T12:18:50.300 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 3/286 2024-03-04T12:18:50.300 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 4/286 2024-03-04T12:18:50.300 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1871.g3aec3 5/286 2024-03-04T12:18:50.300 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-2:19.0.0-1871.g3aec3903.el9.x86_64 6/286 2024-03-04T12:18:50.300 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-2:19.0.0-1871.g3aec3903.el9.x86_64 7/286 2024-03-04T12:18:50.300 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-2:19.0.0-1871.g3aec3903.el9.x86_64 8/286 2024-03-04T12:18:50.300 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-2:19.0.0-1871.g3aec3903.el9.x86_64 9/286 2024-03-04T12:18:50.300 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-2:19.0.0-1871.g3aec3903.el9.x86_64 10/286 2024-03-04T12:18:50.300 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-selinux-2:19.0.0-1871.g3aec3903.el9.x86_64 11/286 2024-03-04T12:18:50.300 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-2:19.0.0-1871.g3aec3903.el9.x86_64 12/286 2024-03-04T12:18:50.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs-devel-2:19.0.0-1871.g3aec3903.el9.x86_ 13/286 2024-03-04T12:18:50.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-2:19.0.0-1871.g3aec3903.el9.x86_64 14/286 2024-03-04T12:18:50.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephsqlite-2:19.0.0-1871.g3aec3903.el9.x86_64 15/286 2024-03-04T12:18:50.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-2:19.0.0-1871.g3aec3903.el9.x86_6 16/286 2024-03-04T12:18:50.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libradosstriper1-2:19.0.0-1871.g3aec3903.el9.x86 17/286 2024-03-04T12:18:50.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librgw2-2:19.0.0-1871.g3aec3903.el9.x86_64 18/286 2024-03-04T12:18:50.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1871.g3aec3903.el 19/286 2024-03-04T12:18:50.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-common-2:19.0.0-1871.g3aec3903.el9. 20/286 2024-03-04T12:18:50.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-2:19.0.0-1871.g3aec3903.el9.x86_6 21/286 2024-03-04T12:18:50.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-2:19.0.0-1871.g3aec3903.el9.x86_64 22/286 2024-03-04T12:18:50.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-2:19.0.0-1871.g3aec3903.el9.x86_64 23/286 2024-03-04T12:18:50.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-2:19.0.0-1871.g3aec3903.el9.x86_64 24/286 2024-03-04T12:18:50.301 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 25/286 2024-03-04T12:18:50.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-2:19.0.0-1871.g3aec3903.el9.x86_64 26/286 2024-03-04T12:18:50.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-2:19.0.0-1871.g3aec3903.el9.x86_64 27/286 2024-03-04T12:18:50.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1871.g3aec3903. 28/286 2024-03-04T12:18:50.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1871.g3aec3903.el9.noa 29/286 2024-03-04T12:18:50.302 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1871.g3aec3903.el9.n 30/286 2024-03-04T12:18:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1871.g3ae 31/286 2024-03-04T12:18:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1871.g3aec3903.el 32/286 2024-03-04T12:18:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1871.g3aec3903.el9.noarch 33/286 2024-03-04T12:18:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1871.g3aec3903.e 34/286 2024-03-04T12:18:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-volume-2:19.0.0-1871.g3aec3903.el9.noarch 35/286 2024-03-04T12:18:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 36/286 2024-03-04T12:18:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 37/286 2024-03-04T12:18:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 38/286 2024-03-04T12:18:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : alsa-lib-1.2.10-2.el9.x86_64 39/286 2024-03-04T12:18:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 40/286 2024-03-04T12:18:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 41/286 2024-03-04T12:18:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 42/286 2024-03-04T12:18:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 43/286 2024-03-04T12:18:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 44/286 2024-03-04T12:18:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 45/286 2024-03-04T12:18:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : atinject-1.0.3-6.el9.noarch 46/286 2024-03-04T12:18:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : atk-2.36.0-5.el9.x86_64 47/286 2024-03-04T12:18:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/286 2024-03-04T12:18:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 49/286 2024-03-04T12:18:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 50/286 2024-03-04T12:18:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 51/286 2024-03-04T12:18:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 52/286 2024-03-04T12:18:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 53/286 2024-03-04T12:18:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 54/286 2024-03-04T12:18:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 55/286 2024-03-04T12:18:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 56/286 2024-03-04T12:18:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 57/286 2024-03-04T12:18:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 58/286 2024-03-04T12:18:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 59/286 2024-03-04T12:18:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 60/286 2024-03-04T12:18:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 61/286 2024-03-04T12:18:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 62/286 2024-03-04T12:18:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 63/286 2024-03-04T12:18:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 64/286 2024-03-04T12:18:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 65/286 2024-03-04T12:18:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 66/286 2024-03-04T12:18:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 67/286 2024-03-04T12:18:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 68/286 2024-03-04T12:18:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 69/286 2024-03-04T12:18:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 70/286 2024-03-04T12:18:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 71/286 2024-03-04T12:18:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 72/286 2024-03-04T12:18:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : guava-30.1-6.el9.noarch 73/286 2024-03-04T12:18:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 74/286 2024-03-04T12:18:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 75/286 2024-03-04T12:18:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 76/286 2024-03-04T12:18:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 77/286 2024-03-04T12:18:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 78/286 2024-03-04T12:18:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 79/286 2024-03-04T12:18:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 80/286 2024-03-04T12:18:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 81/286 2024-03-04T12:18:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 82/286 2024-03-04T12:18:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 83/286 2024-03-04T12:18:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 84/286 2024-03-04T12:18:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 85/286 2024-03-04T12:18:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 86/286 2024-03-04T12:18:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 87/286 2024-03-04T12:18:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lcms2-2.12-3.el9.x86_64 88/286 2024-03-04T12:18:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 89/286 2024-03-04T12:18:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 90/286 2024-03-04T12:18:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 91/286 2024-03-04T12:18:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 92/286 2024-03-04T12:18:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 93/286 2024-03-04T12:18:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 94/286 2024-03-04T12:18:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 95/286 2024-03-04T12:18:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 96/286 2024-03-04T12:18:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 97/286 2024-03-04T12:18:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 98/286 2024-03-04T12:18:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 99/286 2024-03-04T12:18:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 100/286 2024-03-04T12:18:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 101/286 2024-03-04T12:18:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libdrm-2.4.117-1.el9.x86_64 102/286 2024-03-04T12:18:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 103/286 2024-03-04T12:18:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 104/286 2024-03-04T12:18:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 105/286 2024-03-04T12:18:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 106/286 2024-03-04T12:18:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 107/286 2024-03-04T12:18:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 108/286 2024-03-04T12:18:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 109/286 2024-03-04T12:18:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 110/286 2024-03-04T12:18:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 111/286 2024-03-04T12:18:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 112/286 2024-03-04T12:18:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 113/286 2024-03-04T12:18:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 114/286 2024-03-04T12:18:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 115/286 2024-03-04T12:18:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 116/286 2024-03-04T12:18:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 117/286 2024-03-04T12:18:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 118/286 2024-03-04T12:18:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 119/286 2024-03-04T12:18:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libsbc-1.4-9.el9.x86_64 120/286 2024-03-04T12:18:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 121/286 2024-03-04T12:18:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 122/286 2024-03-04T12:18:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libtiff-4.4.0-12.el9.x86_64 123/286 2024-03-04T12:18:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 124/286 2024-03-04T12:18:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 125/286 2024-03-04T12:18:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 126/286 2024-03-04T12:18:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 127/286 2024-03-04T12:18:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 128/286 2024-03-04T12:18:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 129/286 2024-03-04T12:18:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 130/286 2024-03-04T12:18:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 131/286 2024-03-04T12:18:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 132/286 2024-03-04T12:18:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 133/286 2024-03-04T12:18:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 134/286 2024-03-04T12:18:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 135/286 2024-03-04T12:18:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 136/286 2024-03-04T12:18:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-5.4.4-4.el9.x86_64 137/286 2024-03-04T12:18:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 138/286 2024-03-04T12:18:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 139/286 2024-03-04T12:18:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 140/286 2024-03-04T12:18:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 141/286 2024-03-04T12:18:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 142/286 2024-03-04T12:18:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 143/286 2024-03-04T12:18:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 144/286 2024-03-04T12:18:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : mesa-libEGL-23.3.3-1.el9.x86_64 145/286 2024-03-04T12:18:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : mesa-libGL-23.3.3-1.el9.x86_64 146/286 2024-03-04T12:18:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : mesa-libgbm-23.3.3-1.el9.x86_64 147/286 2024-03-04T12:18:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : mesa-libglapi-23.3.3-1.el9.x86_64 148/286 2024-03-04T12:18:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 149/286 2024-03-04T12:18:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 150/286 2024-03-04T12:18:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 151/286 2024-03-04T12:18:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 152/286 2024-03-04T12:18:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : opus-1.3.1-10.el9.x86_64 153/286 2024-03-04T12:18:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : orc-0.4.31-6.el9.x86_64 154/286 2024-03-04T12:18:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : osinfo-db-20231215-1.el9.noarch 155/286 2024-03-04T12:18:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 156/286 2024-03-04T12:18:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 157/286 2024-03-04T12:18:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 158/286 2024-03-04T12:18:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 159/286 2024-03-04T12:18:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 160/286 2024-03-04T12:18:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 161/286 2024-03-04T12:18:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 162/286 2024-03-04T12:18:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 163/286 2024-03-04T12:18:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 164/286 2024-03-04T12:18:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 165/286 2024-03-04T12:18:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 166/286 2024-03-04T12:18:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 167/286 2024-03-04T12:18:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 168/286 2024-03-04T12:18:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : poppler-21.01.0-19.el9.x86_64 169/286 2024-03-04T12:18:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 170/286 2024-03-04T12:18:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : poppler-glib-21.01.0-19.el9.x86_64 171/286 2024-03-04T12:18:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 172/286 2024-03-04T12:18:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 173/286 2024-03-04T12:18:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 174/286 2024-03-04T12:18:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 175/286 2024-03-04T12:18:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 176/286 2024-03-04T12:18:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 177/286 2024-03-04T12:18:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 178/286 2024-03-04T12:18:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 179/286 2024-03-04T12:18:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 180/286 2024-03-04T12:18:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 181/286 2024-03-04T12:18:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 182/286 2024-03-04T12:18:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 183/286 2024-03-04T12:18:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 184/286 2024-03-04T12:18:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 185/286 2024-03-04T12:18:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 186/286 2024-03-04T12:18:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 187/286 2024-03-04T12:18:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 188/286 2024-03-04T12:18:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 189/286 2024-03-04T12:18:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 190/286 2024-03-04T12:18:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 191/286 2024-03-04T12:18:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 192/286 2024-03-04T12:18:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 193/286 2024-03-04T12:18:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 194/286 2024-03-04T12:18:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 195/286 2024-03-04T12:18:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rtkit-0.11-28.el9.x86_64 196/286 2024-03-04T12:18:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 197/286 2024-03-04T12:18:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 198/286 2024-03-04T12:18:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 199/286 2024-03-04T12:18:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 200/286 2024-03-04T12:18:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 201/286 2024-03-04T12:18:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 202/286 2024-03-04T12:18:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 203/286 2024-03-04T12:18:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 204/286 2024-03-04T12:18:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : tzdata-java-2024a-1.el9.noarch 205/286 2024-03-04T12:18:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : upower-0.99.11-11.el9.x86_64 206/286 2024-03-04T12:18:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 207/286 2024-03-04T12:18:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 208/286 2024-03-04T12:18:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 209/286 2024-03-04T12:18:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 210/286 2024-03-04T12:18:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 211/286 2024-03-04T12:18:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 212/286 2024-03-04T12:18:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 213/286 2024-03-04T12:18:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 214/286 2024-03-04T12:18:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 215/286 2024-03-04T12:18:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 216/286 2024-03-04T12:18:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : bluez-libs-5.64-1.el9.x86_64 217/286 2024-03-04T12:18:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : bubblewrap-0.4.1-6.el9.x86_64 218/286 2024-03-04T12:18:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cups-libs-1:2.3.3op2-24.el9.x86_64 219/286 2024-03-04T12:18:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 220/286 2024-03-04T12:18:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : jq-1.6-16.el9.x86_64 221/286 2024-03-04T12:18:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 222/286 2024-03-04T12:18:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libpciaccess-0.16-6.el9.x86_64 223/286 2024-03-04T12:18:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 224/286 2024-03-04T12:18:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 225/286 2024-03-04T12:18:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 226/286 2024-03-04T12:18:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 227/286 2024-03-04T12:18:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 228/286 2024-03-04T12:18:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ply-3.11-14.el9.noarch 229/286 2024-03-04T12:18:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 230/286 2024-03-04T12:18:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 231/286 2024-03-04T12:18:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 232/286 2024-03-04T12:18:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : avahi-glib-0.8-12.el9.x86_64 233/286 2024-03-04T12:18:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 234/286 2024-03-04T12:18:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libX11-xcb-1.7.0-8.el9.x86_64 235/286 2024-03-04T12:18:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ostree-libs-2024.4-3.el9.x86_64 236/286 2024-03-04T12:18:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : p11-kit-server-0.24.1-2.el9.x86_64 237/286 2024-03-04T12:18:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 238/286 2024-03-04T12:18:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 239/286 2024-03-04T12:18:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 240/286 2024-03-04T12:18:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 241/286 2024-03-04T12:18:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 242/286 2024-03-04T12:18:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 243/286 2024-03-04T12:18:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 244/286 2024-03-04T12:18:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 245/286 2024-03-04T12:18:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 246/286 2024-03-04T12:18:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 247/286 2024-03-04T12:18:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 248/286 2024-03-04T12:18:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 249/286 2024-03-04T12:18:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 250/286 2024-03-04T12:18:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 251/286 2024-03-04T12:18:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 252/286 2024-03-04T12:18:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 253/286 2024-03-04T12:18:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 254/286 2024-03-04T12:18:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 255/286 2024-03-04T12:18:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 256/286 2024-03-04T12:18:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 257/286 2024-03-04T12:18:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 258/286 2024-03-04T12:18:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 259/286 2024-03-04T12:18:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 260/286 2024-03-04T12:18:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 261/286 2024-03-04T12:18:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 262/286 2024-03-04T12:18:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 263/286 2024-03-04T12:18:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 264/286 2024-03-04T12:18:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 265/286 2024-03-04T12:18:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 266/286 2024-03-04T12:18:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 267/286 2024-03-04T12:18:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 268/286 2024-03-04T12:18:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 269/286 2024-03-04T12:18:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 270/286 2024-03-04T12:18:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 271/286 2024-03-04T12:18:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 272/286 2024-03-04T12:18:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 273/286 2024-03-04T12:18:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 274/286 2024-03-04T12:18:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 275/286 2024-03-04T12:18:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 276/286 2024-03-04T12:18:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 277/286 2024-03-04T12:18:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 278/286 2024-03-04T12:18:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 279/286 2024-03-04T12:18:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : re2-1:20211101-3.el9.x86_64 280/286 2024-03-04T12:18:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 281/286 2024-03-04T12:18:50.347 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 282/286 2024-03-04T12:18:50.347 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:19.0.0-1871.g3aec3903.el9.x86_64 283/286 2024-03-04T12:18:50.347 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 284/286 2024-03-04T12:18:50.347 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:19.0.0-1871.g3aec3903.el9.x86_64 285/286 2024-03-04T12:18:53.122 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.0.0-1871.g3aec3903.el9.x86_64 276/286 2024-03-04T12:18:53.151 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 277/286 2024-03-04T12:18:53.200 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 278/286 2024-03-04T12:18:53.223 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 279/286 2024-03-04T12:18:53.238 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 279/286 2024-03-04T12:18:53.238 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-03-04T12:18:53.238 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:18:53.290 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 280/286 2024-03-04T12:18:53.321 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.0.0-1871.g3aec3903.el9.x86_64 281/286 2024-03-04T12:18:53.424 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.0.0-1871.g3aec3903.el9.x86_ 282/286 2024-03-04T12:18:53.497 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 283/286 2024-03-04T12:18:53.529 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 284/286 2024-03-04T12:18:53.529 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 285/286 2024-03-04T12:18:53.680 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 285/286 2024-03-04T12:18:53.680 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-04T12:18:53.762 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-04T12:18:53.783 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 286/286 2024-03-04T12:18:53.789 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 286/286 2024-03-04T12:18:53.797 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 286/286 2024-03-04T12:18:53.806 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 286/286 2024-03-04T12:18:53.806 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-03-04T12:18:53.806 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-03-04T12:18:53.806 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:18:53.874 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 286/286 2024-03-04T12:18:53.887 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 286/286 2024-03-04T12:18:53.887 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:18:53.888 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2024-03-04T12:18:53.888 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.888 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.888 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-03-04T12:18:53.888 INFO:teuthology.orchestra.run.smithi110.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-03-04T12:18:53.888 INFO:teuthology.orchestra.run.smithi110.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-04T12:18:53.888 INFO:teuthology.orchestra.run.smithi110.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-03-04T12:18:53.888 INFO:teuthology.orchestra.run.smithi110.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-03-04T12:18:53.888 INFO:teuthology.orchestra.run.smithi110.stdout: alsa-lib-1.2.10-2.el9.x86_64 2024-03-04T12:18:53.888 INFO:teuthology.orchestra.run.smithi110.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-03-04T12:18:53.888 INFO:teuthology.orchestra.run.smithi110.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-03-04T12:18:53.888 INFO:teuthology.orchestra.run.smithi110.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-03-04T12:18:53.888 INFO:teuthology.orchestra.run.smithi110.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-03-04T12:18:53.889 INFO:teuthology.orchestra.run.smithi110.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-03-04T12:18:53.889 INFO:teuthology.orchestra.run.smithi110.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-03-04T12:18:53.889 INFO:teuthology.orchestra.run.smithi110.stdout: atinject-1.0.3-6.el9.noarch 2024-03-04T12:18:53.889 INFO:teuthology.orchestra.run.smithi110.stdout: atk-2.36.0-5.el9.x86_64 2024-03-04T12:18:53.889 INFO:teuthology.orchestra.run.smithi110.stdout: avahi-glib-0.8-12.el9.x86_64 2024-03-04T12:18:53.889 INFO:teuthology.orchestra.run.smithi110.stdout: bluez-libs-5.64-1.el9.x86_64 2024-03-04T12:18:53.889 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-04T12:18:53.889 INFO:teuthology.orchestra.run.smithi110.stdout: bubblewrap-0.4.1-6.el9.x86_64 2024-03-04T12:18:53.889 INFO:teuthology.orchestra.run.smithi110.stdout: cdi-api-2.0.2-6.el9.noarch 2024-03-04T12:18:53.889 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.889 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.889 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.889 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.889 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:18:53.889 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.890 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.890 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.890 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:18:53.890 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:18:53.890 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:18:53.890 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:18:53.890 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:18:53.890 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.890 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.890 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:18:53.890 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.890 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.890 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.890 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:18:53.891 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:18:53.891 INFO:teuthology.orchestra.run.smithi110.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-03-04T12:18:53.891 INFO:teuthology.orchestra.run.smithi110.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-03-04T12:18:53.891 INFO:teuthology.orchestra.run.smithi110.stdout: cups-libs-1:2.3.3op2-24.el9.x86_64 2024-03-04T12:18:53.891 INFO:teuthology.orchestra.run.smithi110.stdout: dconf-0.40.0-6.el9.x86_64 2024-03-04T12:18:53.891 INFO:teuthology.orchestra.run.smithi110.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-03-04T12:18:53.891 INFO:teuthology.orchestra.run.smithi110.stdout: exiv2-0.27.5-2.el9.x86_64 2024-03-04T12:18:53.891 INFO:teuthology.orchestra.run.smithi110.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-03-04T12:18:53.891 INFO:teuthology.orchestra.run.smithi110.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-03-04T12:18:53.891 INFO:teuthology.orchestra.run.smithi110.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-03-04T12:18:53.891 INFO:teuthology.orchestra.run.smithi110.stdout: flatpak-1.12.8-1.el9.x86_64 2024-03-04T12:18:53.891 INFO:teuthology.orchestra.run.smithi110.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2024-03-04T12:18:53.891 INFO:teuthology.orchestra.run.smithi110.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2024-03-04T12:18:53.891 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-04T12:18:53.892 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-04T12:18:53.892 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-04T12:18:53.892 INFO:teuthology.orchestra.run.smithi110.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-04T12:18:53.892 INFO:teuthology.orchestra.run.smithi110.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2024-03-04T12:18:53.892 INFO:teuthology.orchestra.run.smithi110.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-03-04T12:18:53.892 INFO:teuthology.orchestra.run.smithi110.stdout: giflib-5.2.1-9.el9.x86_64 2024-03-04T12:18:53.892 INFO:teuthology.orchestra.run.smithi110.stdout: google-guice-4.2.3-9.el9.noarch 2024-03-04T12:18:53.892 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-04T12:18:53.892 INFO:teuthology.orchestra.run.smithi110.stdout: graphene-1.10.6-2.el9.x86_64 2024-03-04T12:18:53.892 INFO:teuthology.orchestra.run.smithi110.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-04T12:18:53.892 INFO:teuthology.orchestra.run.smithi110.stdout: gsm-1.0.19-6.el9.x86_64 2024-03-04T12:18:53.892 INFO:teuthology.orchestra.run.smithi110.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-03-04T12:18:53.892 INFO:teuthology.orchestra.run.smithi110.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-03-04T12:18:53.893 INFO:teuthology.orchestra.run.smithi110.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2024-03-04T12:18:53.893 INFO:teuthology.orchestra.run.smithi110.stdout: gtk3-3.24.31-2.el9.x86_64 2024-03-04T12:18:53.893 INFO:teuthology.orchestra.run.smithi110.stdout: guava-30.1-6.el9.noarch 2024-03-04T12:18:53.893 INFO:teuthology.orchestra.run.smithi110.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-03-04T12:18:53.893 INFO:teuthology.orchestra.run.smithi110.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-03-04T12:18:53.893 INFO:teuthology.orchestra.run.smithi110.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-03-04T12:18:53.893 INFO:teuthology.orchestra.run.smithi110.stdout: iso-codes-4.6.0-3.el9.noarch 2024-03-04T12:18:53.893 INFO:teuthology.orchestra.run.smithi110.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-03-04T12:18:53.893 INFO:teuthology.orchestra.run.smithi110.stdout: jansi-2.3.3-6.el9.x86_64 2024-03-04T12:18:53.893 INFO:teuthology.orchestra.run.smithi110.stdout: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 2024-03-04T12:18:53.893 INFO:teuthology.orchestra.run.smithi110.stdout: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_64 2024-03-04T12:18:53.893 INFO:teuthology.orchestra.run.smithi110.stdout: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 2024-03-04T12:18:53.893 INFO:teuthology.orchestra.run.smithi110.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-03-04T12:18:53.894 INFO:teuthology.orchestra.run.smithi110.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-03-04T12:18:53.894 INFO:teuthology.orchestra.run.smithi110.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-03-04T12:18:53.894 INFO:teuthology.orchestra.run.smithi110.stdout: jq-1.6-16.el9.x86_64 2024-03-04T12:18:53.894 INFO:teuthology.orchestra.run.smithi110.stdout: jsoup-1.13.1-10.el9.noarch 2024-03-04T12:18:53.894 INFO:teuthology.orchestra.run.smithi110.stdout: jsr-305-3.0.2-6.el9.noarch 2024-03-04T12:18:53.894 INFO:teuthology.orchestra.run.smithi110.stdout: lcms2-2.12-3.el9.x86_64 2024-03-04T12:18:53.894 INFO:teuthology.orchestra.run.smithi110.stdout: libX11-xcb-1.7.0-8.el9.x86_64 2024-03-04T12:18:53.894 INFO:teuthology.orchestra.run.smithi110.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-03-04T12:18:53.894 INFO:teuthology.orchestra.run.smithi110.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-03-04T12:18:53.894 INFO:teuthology.orchestra.run.smithi110.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-03-04T12:18:53.894 INFO:teuthology.orchestra.run.smithi110.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-03-04T12:18:53.894 INFO:teuthology.orchestra.run.smithi110.stdout: libXi-1.7.10-8.el9.x86_64 2024-03-04T12:18:53.894 INFO:teuthology.orchestra.run.smithi110.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-03-04T12:18:53.895 INFO:teuthology.orchestra.run.smithi110.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-03-04T12:18:53.895 INFO:teuthology.orchestra.run.smithi110.stdout: libXtst-1.2.3-16.el9.x86_64 2024-03-04T12:18:53.895 INFO:teuthology.orchestra.run.smithi110.stdout: libXv-1.0.11-16.el9.x86_64 2024-03-04T12:18:53.895 INFO:teuthology.orchestra.run.smithi110.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-03-04T12:18:53.895 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-04T12:18:53.895 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-04T12:18:53.895 INFO:teuthology.orchestra.run.smithi110.stdout: libasyncns-0.8-22.el9.x86_64 2024-03-04T12:18:53.895 INFO:teuthology.orchestra.run.smithi110.stdout: libcanberra-0.30-27.el9.x86_64 2024-03-04T12:18:53.895 INFO:teuthology.orchestra.run.smithi110.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-03-04T12:18:53.895 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.895 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.895 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.895 INFO:teuthology.orchestra.run.smithi110.stdout: libdrm-2.4.117-1.el9.x86_64 2024-03-04T12:18:53.896 INFO:teuthology.orchestra.run.smithi110.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-03-04T12:18:53.896 INFO:teuthology.orchestra.run.smithi110.stdout: libexif-0.6.22-6.el9.x86_64 2024-03-04T12:18:53.896 INFO:teuthology.orchestra.run.smithi110.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-03-04T12:18:53.896 INFO:teuthology.orchestra.run.smithi110.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-03-04T12:18:53.896 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-04T12:18:53.896 INFO:teuthology.orchestra.run.smithi110.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-03-04T12:18:53.896 INFO:teuthology.orchestra.run.smithi110.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-03-04T12:18:53.896 INFO:teuthology.orchestra.run.smithi110.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-03-04T12:18:53.896 INFO:teuthology.orchestra.run.smithi110.stdout: libgsf-1.14.47-5.el9.x86_64 2024-03-04T12:18:53.896 INFO:teuthology.orchestra.run.smithi110.stdout: libgxps-0.3.2-3.el9.x86_64 2024-03-04T12:18:53.896 INFO:teuthology.orchestra.run.smithi110.stdout: libiptcdata-1.0.5-9.el9.x86_64 2024-03-04T12:18:53.896 INFO:teuthology.orchestra.run.smithi110.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-03-04T12:18:53.896 INFO:teuthology.orchestra.run.smithi110.stdout: libnotify-0.7.9-8.el9.x86_64 2024-03-04T12:18:53.897 INFO:teuthology.orchestra.run.smithi110.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-04T12:18:53.897 INFO:teuthology.orchestra.run.smithi110.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-03-04T12:18:53.897 INFO:teuthology.orchestra.run.smithi110.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-03-04T12:18:53.897 INFO:teuthology.orchestra.run.smithi110.stdout: libpciaccess-0.16-6.el9.x86_64 2024-03-04T12:18:53.897 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-04T12:18:53.897 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-04T12:18:53.897 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-04T12:18:53.897 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.897 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.897 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-04T12:18:53.897 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.897 INFO:teuthology.orchestra.run.smithi110.stdout: libsbc-1.4-9.el9.x86_64 2024-03-04T12:18:53.897 INFO:teuthology.orchestra.run.smithi110.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-03-04T12:18:53.897 INFO:teuthology.orchestra.run.smithi110.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-03-04T12:18:53.898 INFO:teuthology.orchestra.run.smithi110.stdout: libtiff-4.4.0-12.el9.x86_64 2024-03-04T12:18:53.898 INFO:teuthology.orchestra.run.smithi110.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2024-03-04T12:18:53.898 INFO:teuthology.orchestra.run.smithi110.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-03-04T12:18:53.898 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-04T12:18:53.898 INFO:teuthology.orchestra.run.smithi110.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-03-04T12:18:53.898 INFO:teuthology.orchestra.run.smithi110.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-03-04T12:18:53.898 INFO:teuthology.orchestra.run.smithi110.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-03-04T12:18:53.898 INFO:teuthology.orchestra.run.smithi110.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-03-04T12:18:53.898 INFO:teuthology.orchestra.run.smithi110.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-03-04T12:18:53.898 INFO:teuthology.orchestra.run.smithi110.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-03-04T12:18:53.898 INFO:teuthology.orchestra.run.smithi110.stdout: libwebp-1.2.0-8.el9.x86_64 2024-03-04T12:18:53.898 INFO:teuthology.orchestra.run.smithi110.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-03-04T12:18:53.898 INFO:teuthology.orchestra.run.smithi110.stdout: libxshmfence-1.3-10.el9.x86_64 2024-03-04T12:18:53.898 INFO:teuthology.orchestra.run.smithi110.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-03-04T12:18:53.899 INFO:teuthology.orchestra.run.smithi110.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-03-04T12:18:53.899 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-04T12:18:53.899 INFO:teuthology.orchestra.run.smithi110.stdout: lua-5.4.4-4.el9.x86_64 2024-03-04T12:18:53.899 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-04T12:18:53.899 INFO:teuthology.orchestra.run.smithi110.stdout: lua-posix-35.0-8.el9.x86_64 2024-03-04T12:18:53.899 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-04T12:18:53.899 INFO:teuthology.orchestra.run.smithi110.stdout: maven-1:3.6.3-15.el9.noarch 2024-03-04T12:18:53.899 INFO:teuthology.orchestra.run.smithi110.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-03-04T12:18:53.899 INFO:teuthology.orchestra.run.smithi110.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-03-04T12:18:53.899 INFO:teuthology.orchestra.run.smithi110.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-03-04T12:18:53.899 INFO:teuthology.orchestra.run.smithi110.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-03-04T12:18:53.899 INFO:teuthology.orchestra.run.smithi110.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-03-04T12:18:53.899 INFO:teuthology.orchestra.run.smithi110.stdout: mesa-libEGL-23.3.3-1.el9.x86_64 2024-03-04T12:18:53.900 INFO:teuthology.orchestra.run.smithi110.stdout: mesa-libGL-23.3.3-1.el9.x86_64 2024-03-04T12:18:53.900 INFO:teuthology.orchestra.run.smithi110.stdout: mesa-libgbm-23.3.3-1.el9.x86_64 2024-03-04T12:18:53.900 INFO:teuthology.orchestra.run.smithi110.stdout: mesa-libglapi-23.3.3-1.el9.x86_64 2024-03-04T12:18:53.900 INFO:teuthology.orchestra.run.smithi110.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-03-04T12:18:53.900 INFO:teuthology.orchestra.run.smithi110.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-04T12:18:53.900 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-04T12:18:53.900 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-04T12:18:53.900 INFO:teuthology.orchestra.run.smithi110.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-03-04T12:18:53.900 INFO:teuthology.orchestra.run.smithi110.stdout: opus-1.3.1-10.el9.x86_64 2024-03-04T12:18:53.900 INFO:teuthology.orchestra.run.smithi110.stdout: orc-0.4.31-6.el9.x86_64 2024-03-04T12:18:53.900 INFO:teuthology.orchestra.run.smithi110.stdout: osinfo-db-20231215-1.el9.noarch 2024-03-04T12:18:53.900 INFO:teuthology.orchestra.run.smithi110.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-03-04T12:18:53.900 INFO:teuthology.orchestra.run.smithi110.stdout: ostree-libs-2024.4-3.el9.x86_64 2024-03-04T12:18:53.900 INFO:teuthology.orchestra.run.smithi110.stdout: p11-kit-server-0.24.1-2.el9.x86_64 2024-03-04T12:18:53.901 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-04T12:18:53.901 INFO:teuthology.orchestra.run.smithi110.stdout: pipewire-1.0.1-1.el9.x86_64 2024-03-04T12:18:53.901 INFO:teuthology.orchestra.run.smithi110.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-03-04T12:18:53.901 INFO:teuthology.orchestra.run.smithi110.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-03-04T12:18:53.901 INFO:teuthology.orchestra.run.smithi110.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-03-04T12:18:53.901 INFO:teuthology.orchestra.run.smithi110.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-03-04T12:18:53.901 INFO:teuthology.orchestra.run.smithi110.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-03-04T12:18:53.901 INFO:teuthology.orchestra.run.smithi110.stdout: plexus-cipher-1.7-27.el9.noarch 2024-03-04T12:18:53.901 INFO:teuthology.orchestra.run.smithi110.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-03-04T12:18:53.901 INFO:teuthology.orchestra.run.smithi110.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-03-04T12:18:53.901 INFO:teuthology.orchestra.run.smithi110.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-03-04T12:18:53.901 INFO:teuthology.orchestra.run.smithi110.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-03-04T12:18:53.901 INFO:teuthology.orchestra.run.smithi110.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-03-04T12:18:53.902 INFO:teuthology.orchestra.run.smithi110.stdout: poppler-21.01.0-19.el9.x86_64 2024-03-04T12:18:53.902 INFO:teuthology.orchestra.run.smithi110.stdout: poppler-data-0.4.9-9.el9.noarch 2024-03-04T12:18:53.902 INFO:teuthology.orchestra.run.smithi110.stdout: poppler-glib-21.01.0-19.el9.x86_64 2024-03-04T12:18:53.902 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-04T12:18:53.902 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-04T12:18:53.902 INFO:teuthology.orchestra.run.smithi110.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-03-04T12:18:53.902 INFO:teuthology.orchestra.run.smithi110.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-03-04T12:18:53.902 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-04T12:18:53.902 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-04T12:18:53.902 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-04T12:18:53.902 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-04T12:18:53.902 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.902 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.903 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.903 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-04T12:18:53.903 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-04T12:18:53.903 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-04T12:18:53.903 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-04T12:18:53.903 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-04T12:18:53.903 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-04T12:18:53.903 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-04T12:18:53.903 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-04T12:18:53.903 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-04T12:18:53.903 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-04T12:18:53.903 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-04T12:18:53.903 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-04T12:18:53.903 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-04T12:18:53.904 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-04T12:18:53.904 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-04T12:18:53.904 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-04T12:18:53.904 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-04T12:18:53.904 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-04T12:18:53.904 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-04T12:18:53.904 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-04T12:18:53.904 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-04T12:18:53.904 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-04T12:18:53.904 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-04T12:18:53.904 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-04T12:18:53.904 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-04T12:18:53.904 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-04T12:18:53.904 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-04T12:18:53.905 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-04T12:18:53.905 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply-3.11-14.el9.noarch 2024-03-04T12:18:53.905 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-04T12:18:53.905 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-04T12:18:53.905 INFO:teuthology.orchestra.run.smithi110.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-04T12:18:53.905 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-04T12:18:53.905 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-04T12:18:53.905 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-04T12:18:53.905 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-04T12:18:53.905 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-04T12:18:53.905 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.905 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.905 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-04T12:18:53.905 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-04T12:18:53.905 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-04T12:18:53.906 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.906 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-04T12:18:53.906 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-04T12:18:53.906 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-04T12:18:53.906 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-04T12:18:53.906 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-04T12:18:53.906 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-04T12:18:53.906 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-04T12:18:53.906 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-04T12:18:53.906 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-04T12:18:53.906 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-04T12:18:53.906 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-04T12:18:53.906 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-04T12:18:53.906 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-04T12:18:53.906 INFO:teuthology.orchestra.run.smithi110.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-04T12:18:53.907 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.907 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.907 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:18:53.907 INFO:teuthology.orchestra.run.smithi110.stdout: re2-1:20211101-3.el9.x86_64 2024-03-04T12:18:53.907 INFO:teuthology.orchestra.run.smithi110.stdout: rtkit-0.11-28.el9.x86_64 2024-03-04T12:18:53.907 INFO:teuthology.orchestra.run.smithi110.stdout: s3cmd-2.4.0-1.el9.noarch 2024-03-04T12:18:53.907 INFO:teuthology.orchestra.run.smithi110.stdout: sisu-1:0.3.4-10.el9.noarch 2024-03-04T12:18:53.907 INFO:teuthology.orchestra.run.smithi110.stdout: slf4j-1.7.30-13.el9.noarch 2024-03-04T12:18:53.907 INFO:teuthology.orchestra.run.smithi110.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-04T12:18:53.907 INFO:teuthology.orchestra.run.smithi110.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-03-04T12:18:53.907 INFO:teuthology.orchestra.run.smithi110.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-04T12:18:53.907 INFO:teuthology.orchestra.run.smithi110.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-03-04T12:18:53.907 INFO:teuthology.orchestra.run.smithi110.stdout: tracker-3.1.2-3.el9.x86_64 2024-03-04T12:18:53.907 INFO:teuthology.orchestra.run.smithi110.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-03-04T12:18:53.907 INFO:teuthology.orchestra.run.smithi110.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-03-04T12:18:53.908 INFO:teuthology.orchestra.run.smithi110.stdout: tzdata-java-2024a-1.el9.noarch 2024-03-04T12:18:53.908 INFO:teuthology.orchestra.run.smithi110.stdout: upower-0.99.11-11.el9.x86_64 2024-03-04T12:18:53.908 INFO:teuthology.orchestra.run.smithi110.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-03-04T12:18:53.908 INFO:teuthology.orchestra.run.smithi110.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-03-04T12:18:53.908 INFO:teuthology.orchestra.run.smithi110.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-03-04T12:18:53.908 INFO:teuthology.orchestra.run.smithi110.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-03-04T12:18:53.908 INFO:teuthology.orchestra.run.smithi110.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-03-04T12:18:53.908 INFO:teuthology.orchestra.run.smithi110.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-03-04T12:18:53.908 INFO:teuthology.orchestra.run.smithi110.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-03-04T12:18:53.908 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-04T12:18:53.909 INFO:teuthology.orchestra.run.smithi110.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-03-04T12:18:53.909 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:18:53.909 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-03-04T12:18:53.942 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 286/286 2024-03-04T12:18:54.261 DEBUG:teuthology.parallel:result is None 2024-03-04T12:19:00.095 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-04T12:19:00.095 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.0.0-1871.g3aec3903.el9.x86_64 1/286 2024-03-04T12:19:00.095 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.0.0-1871.g3aec3903.el9.x86_64 2/286 2024-03-04T12:19:00.095 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 3/286 2024-03-04T12:19:00.095 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 4/286 2024-03-04T12:19:00.095 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1871.g3aec3 5/286 2024-03-04T12:19:00.095 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.0.0-1871.g3aec3903.el9.x86_64 6/286 2024-03-04T12:19:00.095 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.0.0-1871.g3aec3903.el9.x86_64 7/286 2024-03-04T12:19:00.095 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.0.0-1871.g3aec3903.el9.x86_64 8/286 2024-03-04T12:19:00.096 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.0.0-1871.g3aec3903.el9.x86_64 9/286 2024-03-04T12:19:00.096 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.0.0-1871.g3aec3903.el9.x86_64 10/286 2024-03-04T12:19:00.096 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.0.0-1871.g3aec3903.el9.x86_64 11/286 2024-03-04T12:19:00.096 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.0.0-1871.g3aec3903.el9.x86_64 12/286 2024-03-04T12:19:00.096 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.0.0-1871.g3aec3903.el9.x86_ 13/286 2024-03-04T12:19:00.096 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.0.0-1871.g3aec3903.el9.x86_64 14/286 2024-03-04T12:19:00.096 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.0.0-1871.g3aec3903.el9.x86_64 15/286 2024-03-04T12:19:00.096 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.0.0-1871.g3aec3903.el9.x86_6 16/286 2024-03-04T12:19:00.096 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.0.0-1871.g3aec3903.el9.x86 17/286 2024-03-04T12:19:00.096 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.0.0-1871.g3aec3903.el9.x86_64 18/286 2024-03-04T12:19:00.096 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1871.g3aec3903.el 19/286 2024-03-04T12:19:00.096 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.0.0-1871.g3aec3903.el9. 20/286 2024-03-04T12:19:00.096 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.0.0-1871.g3aec3903.el9.x86_6 21/286 2024-03-04T12:19:00.097 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.0.0-1871.g3aec3903.el9.x86_64 22/286 2024-03-04T12:19:00.097 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.0.0-1871.g3aec3903.el9.x86_64 23/286 2024-03-04T12:19:00.097 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.0.0-1871.g3aec3903.el9.x86_64 24/286 2024-03-04T12:19:00.097 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 25/286 2024-03-04T12:19:00.097 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.0.0-1871.g3aec3903.el9.x86_64 26/286 2024-03-04T12:19:00.097 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.0.0-1871.g3aec3903.el9.x86_64 27/286 2024-03-04T12:19:00.097 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1871.g3aec3903. 28/286 2024-03-04T12:19:00.097 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1871.g3aec3903.el9.noa 29/286 2024-03-04T12:19:00.097 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1871.g3aec3903.el9.n 30/286 2024-03-04T12:19:00.097 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1871.g3ae 31/286 2024-03-04T12:19:00.097 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1871.g3aec3903.el 32/286 2024-03-04T12:19:00.097 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1871.g3aec3903.el9.noarch 33/286 2024-03-04T12:19:00.097 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1871.g3aec3903.e 34/286 2024-03-04T12:19:00.098 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:19.0.0-1871.g3aec3903.el9.noarch 35/286 2024-03-04T12:19:00.098 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 36/286 2024-03-04T12:19:00.098 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 37/286 2024-03-04T12:19:00.098 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 38/286 2024-03-04T12:19:00.098 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : alsa-lib-1.2.10-2.el9.x86_64 39/286 2024-03-04T12:19:00.098 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 40/286 2024-03-04T12:19:00.098 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 41/286 2024-03-04T12:19:00.098 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 42/286 2024-03-04T12:19:00.098 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 43/286 2024-03-04T12:19:00.098 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 44/286 2024-03-04T12:19:00.098 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 45/286 2024-03-04T12:19:00.098 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : atinject-1.0.3-6.el9.noarch 46/286 2024-03-04T12:19:00.098 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : atk-2.36.0-5.el9.x86_64 47/286 2024-03-04T12:19:00.098 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/286 2024-03-04T12:19:00.099 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 49/286 2024-03-04T12:19:00.099 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 50/286 2024-03-04T12:19:00.099 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 51/286 2024-03-04T12:19:00.099 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 52/286 2024-03-04T12:19:00.099 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 53/286 2024-03-04T12:19:00.099 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 54/286 2024-03-04T12:19:00.099 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 55/286 2024-03-04T12:19:00.099 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 56/286 2024-03-04T12:19:00.099 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 57/286 2024-03-04T12:19:00.099 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 58/286 2024-03-04T12:19:00.099 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 59/286 2024-03-04T12:19:00.099 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 60/286 2024-03-04T12:19:00.100 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 61/286 2024-03-04T12:19:00.100 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 62/286 2024-03-04T12:19:00.100 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 63/286 2024-03-04T12:19:00.100 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 64/286 2024-03-04T12:19:00.100 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 65/286 2024-03-04T12:19:00.100 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 66/286 2024-03-04T12:19:00.100 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 67/286 2024-03-04T12:19:00.100 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 68/286 2024-03-04T12:19:00.100 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 69/286 2024-03-04T12:19:00.100 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 70/286 2024-03-04T12:19:00.100 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 71/286 2024-03-04T12:19:00.100 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 72/286 2024-03-04T12:19:00.100 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : guava-30.1-6.el9.noarch 73/286 2024-03-04T12:19:00.101 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 74/286 2024-03-04T12:19:00.101 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 75/286 2024-03-04T12:19:00.101 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 76/286 2024-03-04T12:19:00.101 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 77/286 2024-03-04T12:19:00.101 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 78/286 2024-03-04T12:19:00.101 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 79/286 2024-03-04T12:19:00.101 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 80/286 2024-03-04T12:19:00.101 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 81/286 2024-03-04T12:19:00.101 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 82/286 2024-03-04T12:19:00.101 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 83/286 2024-03-04T12:19:00.101 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 84/286 2024-03-04T12:19:00.101 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 85/286 2024-03-04T12:19:00.101 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 86/286 2024-03-04T12:19:00.102 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 87/286 2024-03-04T12:19:00.102 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lcms2-2.12-3.el9.x86_64 88/286 2024-03-04T12:19:00.102 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 89/286 2024-03-04T12:19:00.102 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 90/286 2024-03-04T12:19:00.102 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 91/286 2024-03-04T12:19:00.102 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 92/286 2024-03-04T12:19:00.102 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 93/286 2024-03-04T12:19:00.102 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 94/286 2024-03-04T12:19:00.102 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 95/286 2024-03-04T12:19:00.102 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 96/286 2024-03-04T12:19:00.102 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 97/286 2024-03-04T12:19:00.102 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 98/286 2024-03-04T12:19:00.102 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 99/286 2024-03-04T12:19:00.102 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 100/286 2024-03-04T12:19:00.102 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 101/286 2024-03-04T12:19:00.103 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libdrm-2.4.117-1.el9.x86_64 102/286 2024-03-04T12:19:00.103 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 103/286 2024-03-04T12:19:00.103 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 104/286 2024-03-04T12:19:00.103 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 105/286 2024-03-04T12:19:00.103 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 106/286 2024-03-04T12:19:00.103 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 107/286 2024-03-04T12:19:00.103 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 108/286 2024-03-04T12:19:00.103 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 109/286 2024-03-04T12:19:00.103 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 110/286 2024-03-04T12:19:00.103 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 111/286 2024-03-04T12:19:00.103 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 112/286 2024-03-04T12:19:00.103 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 113/286 2024-03-04T12:19:00.103 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 114/286 2024-03-04T12:19:00.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 115/286 2024-03-04T12:19:00.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 116/286 2024-03-04T12:19:00.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 117/286 2024-03-04T12:19:00.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 118/286 2024-03-04T12:19:00.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 119/286 2024-03-04T12:19:00.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libsbc-1.4-9.el9.x86_64 120/286 2024-03-04T12:19:00.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 121/286 2024-03-04T12:19:00.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 122/286 2024-03-04T12:19:00.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtiff-4.4.0-12.el9.x86_64 123/286 2024-03-04T12:19:00.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 124/286 2024-03-04T12:19:00.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 125/286 2024-03-04T12:19:00.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 126/286 2024-03-04T12:19:00.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 127/286 2024-03-04T12:19:00.104 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 128/286 2024-03-04T12:19:00.105 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 129/286 2024-03-04T12:19:00.105 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 130/286 2024-03-04T12:19:00.105 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 131/286 2024-03-04T12:19:00.105 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 132/286 2024-03-04T12:19:00.105 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 133/286 2024-03-04T12:19:00.105 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 134/286 2024-03-04T12:19:00.105 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 135/286 2024-03-04T12:19:00.105 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 136/286 2024-03-04T12:19:00.105 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 137/286 2024-03-04T12:19:00.105 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 138/286 2024-03-04T12:19:00.105 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 139/286 2024-03-04T12:19:00.105 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 140/286 2024-03-04T12:19:00.105 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 141/286 2024-03-04T12:19:00.105 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 142/286 2024-03-04T12:19:00.105 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 143/286 2024-03-04T12:19:00.106 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 144/286 2024-03-04T12:19:00.106 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : mesa-libEGL-23.3.3-1.el9.x86_64 145/286 2024-03-04T12:19:00.106 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : mesa-libGL-23.3.3-1.el9.x86_64 146/286 2024-03-04T12:19:00.106 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : mesa-libgbm-23.3.3-1.el9.x86_64 147/286 2024-03-04T12:19:00.106 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : mesa-libglapi-23.3.3-1.el9.x86_64 148/286 2024-03-04T12:19:00.106 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 149/286 2024-03-04T12:19:00.106 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 150/286 2024-03-04T12:19:00.106 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 151/286 2024-03-04T12:19:00.106 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 152/286 2024-03-04T12:19:00.106 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : opus-1.3.1-10.el9.x86_64 153/286 2024-03-04T12:19:00.106 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : orc-0.4.31-6.el9.x86_64 154/286 2024-03-04T12:19:00.106 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : osinfo-db-20231215-1.el9.noarch 155/286 2024-03-04T12:19:00.106 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 156/286 2024-03-04T12:19:00.106 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 157/286 2024-03-04T12:19:00.106 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 158/286 2024-03-04T12:19:00.107 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 159/286 2024-03-04T12:19:00.107 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 160/286 2024-03-04T12:19:00.107 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 161/286 2024-03-04T12:19:00.107 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 162/286 2024-03-04T12:19:00.107 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 163/286 2024-03-04T12:19:00.107 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 164/286 2024-03-04T12:19:00.107 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 165/286 2024-03-04T12:19:00.107 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 166/286 2024-03-04T12:19:00.107 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 167/286 2024-03-04T12:19:00.107 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 168/286 2024-03-04T12:19:00.107 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : poppler-21.01.0-19.el9.x86_64 169/286 2024-03-04T12:19:00.107 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 170/286 2024-03-04T12:19:00.107 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : poppler-glib-21.01.0-19.el9.x86_64 171/286 2024-03-04T12:19:00.107 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 172/286 2024-03-04T12:19:00.108 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 173/286 2024-03-04T12:19:00.108 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 174/286 2024-03-04T12:19:00.108 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 175/286 2024-03-04T12:19:00.108 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 176/286 2024-03-04T12:19:00.108 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 177/286 2024-03-04T12:19:00.108 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 178/286 2024-03-04T12:19:00.108 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 179/286 2024-03-04T12:19:00.108 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 180/286 2024-03-04T12:19:00.108 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 181/286 2024-03-04T12:19:00.108 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 182/286 2024-03-04T12:19:00.108 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 183/286 2024-03-04T12:19:00.108 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 184/286 2024-03-04T12:19:00.109 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 185/286 2024-03-04T12:19:00.109 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 186/286 2024-03-04T12:19:00.109 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 187/286 2024-03-04T12:19:00.109 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 188/286 2024-03-04T12:19:00.109 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 189/286 2024-03-04T12:19:00.109 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 190/286 2024-03-04T12:19:00.109 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 191/286 2024-03-04T12:19:00.109 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 192/286 2024-03-04T12:19:00.109 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 193/286 2024-03-04T12:19:00.109 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 194/286 2024-03-04T12:19:00.109 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 195/286 2024-03-04T12:19:00.109 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rtkit-0.11-28.el9.x86_64 196/286 2024-03-04T12:19:00.109 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 197/286 2024-03-04T12:19:00.109 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 198/286 2024-03-04T12:19:00.109 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 199/286 2024-03-04T12:19:00.110 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 200/286 2024-03-04T12:19:00.110 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 201/286 2024-03-04T12:19:00.110 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 202/286 2024-03-04T12:19:00.110 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 203/286 2024-03-04T12:19:00.110 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 204/286 2024-03-04T12:19:00.110 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : tzdata-java-2024a-1.el9.noarch 205/286 2024-03-04T12:19:00.110 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : upower-0.99.11-11.el9.x86_64 206/286 2024-03-04T12:19:00.110 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 207/286 2024-03-04T12:19:00.110 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 208/286 2024-03-04T12:19:00.110 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 209/286 2024-03-04T12:19:00.110 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 210/286 2024-03-04T12:19:00.111 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 211/286 2024-03-04T12:19:00.111 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 212/286 2024-03-04T12:19:00.111 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 213/286 2024-03-04T12:19:00.111 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 214/286 2024-03-04T12:19:00.111 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 215/286 2024-03-04T12:19:00.111 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 216/286 2024-03-04T12:19:00.111 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bluez-libs-5.64-1.el9.x86_64 217/286 2024-03-04T12:19:00.111 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bubblewrap-0.4.1-6.el9.x86_64 218/286 2024-03-04T12:19:00.111 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cups-libs-1:2.3.3op2-24.el9.x86_64 219/286 2024-03-04T12:19:00.111 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 220/286 2024-03-04T12:19:00.111 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : jq-1.6-16.el9.x86_64 221/286 2024-03-04T12:19:00.111 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 222/286 2024-03-04T12:19:00.112 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpciaccess-0.16-6.el9.x86_64 223/286 2024-03-04T12:19:00.112 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 224/286 2024-03-04T12:19:00.112 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 225/286 2024-03-04T12:19:00.112 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 226/286 2024-03-04T12:19:00.112 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 227/286 2024-03-04T12:19:00.112 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 228/286 2024-03-04T12:19:00.112 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 229/286 2024-03-04T12:19:00.112 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 230/286 2024-03-04T12:19:00.112 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 231/286 2024-03-04T12:19:00.112 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 232/286 2024-03-04T12:19:00.112 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : avahi-glib-0.8-12.el9.x86_64 233/286 2024-03-04T12:19:00.112 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 234/286 2024-03-04T12:19:00.113 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libX11-xcb-1.7.0-8.el9.x86_64 235/286 2024-03-04T12:19:00.113 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ostree-libs-2024.4-3.el9.x86_64 236/286 2024-03-04T12:19:00.113 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : p11-kit-server-0.24.1-2.el9.x86_64 237/286 2024-03-04T12:19:00.113 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 238/286 2024-03-04T12:19:00.113 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 239/286 2024-03-04T12:19:00.113 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 240/286 2024-03-04T12:19:00.113 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 241/286 2024-03-04T12:19:00.113 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 242/286 2024-03-04T12:19:00.113 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 243/286 2024-03-04T12:19:00.113 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 244/286 2024-03-04T12:19:00.114 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 245/286 2024-03-04T12:19:00.114 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 246/286 2024-03-04T12:19:00.114 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 247/286 2024-03-04T12:19:00.114 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 248/286 2024-03-04T12:19:00.114 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 249/286 2024-03-04T12:19:00.114 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 250/286 2024-03-04T12:19:00.114 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 251/286 2024-03-04T12:19:00.114 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 252/286 2024-03-04T12:19:00.114 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 253/286 2024-03-04T12:19:00.114 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 254/286 2024-03-04T12:19:00.114 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 255/286 2024-03-04T12:19:00.114 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 256/286 2024-03-04T12:19:00.114 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 257/286 2024-03-04T12:19:00.115 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 258/286 2024-03-04T12:19:00.115 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 259/286 2024-03-04T12:19:00.115 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 260/286 2024-03-04T12:19:00.115 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 261/286 2024-03-04T12:19:00.115 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 262/286 2024-03-04T12:19:00.115 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 263/286 2024-03-04T12:19:00.115 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 264/286 2024-03-04T12:19:00.115 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 265/286 2024-03-04T12:19:00.115 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 266/286 2024-03-04T12:19:00.115 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 267/286 2024-03-04T12:19:00.115 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 268/286 2024-03-04T12:19:00.116 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 269/286 2024-03-04T12:19:00.116 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 270/286 2024-03-04T12:19:00.116 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 271/286 2024-03-04T12:19:00.116 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 272/286 2024-03-04T12:19:00.116 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 273/286 2024-03-04T12:19:00.116 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 274/286 2024-03-04T12:19:00.116 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 275/286 2024-03-04T12:19:00.116 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 276/286 2024-03-04T12:19:00.116 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 277/286 2024-03-04T12:19:00.116 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 278/286 2024-03-04T12:19:00.116 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 279/286 2024-03-04T12:19:00.116 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-3.el9.x86_64 280/286 2024-03-04T12:19:00.117 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 281/286 2024-03-04T12:19:00.117 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 282/286 2024-03-04T12:19:00.117 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.0.0-1871.g3aec3903.el9.x86_64 283/286 2024-03-04T12:19:00.117 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 284/286 2024-03-04T12:19:00.117 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.0.0-1871.g3aec3903.el9.x86_64 285/286 2024-03-04T12:19:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 286/286 2024-03-04T12:19:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:03.540 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-03-04T12:19:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.540 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.540 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-03-04T12:19:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-03-04T12:19:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-04T12:19:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-03-04T12:19:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-03-04T12:19:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: alsa-lib-1.2.10-2.el9.x86_64 2024-03-04T12:19:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-03-04T12:19:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-03-04T12:19:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-03-04T12:19:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-03-04T12:19:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-03-04T12:19:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-03-04T12:19:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: atinject-1.0.3-6.el9.noarch 2024-03-04T12:19:03.541 INFO:teuthology.orchestra.run.smithi172.stdout: atk-2.36.0-5.el9.x86_64 2024-03-04T12:19:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: avahi-glib-0.8-12.el9.x86_64 2024-03-04T12:19:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: bluez-libs-5.64-1.el9.x86_64 2024-03-04T12:19:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-04T12:19:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: bubblewrap-0.4.1-6.el9.x86_64 2024-03-04T12:19:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: cdi-api-2.0.2-6.el9.noarch 2024-03-04T12:19:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:19:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.542 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:19:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:19:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:19:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:19:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:19:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:19:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.543 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:19:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.0.0-1871.g3aec3903.el9.noarch 2024-03-04T12:19:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-03-04T12:19:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-03-04T12:19:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: cups-libs-1:2.3.3op2-24.el9.x86_64 2024-03-04T12:19:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: dconf-0.40.0-6.el9.x86_64 2024-03-04T12:19:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-03-04T12:19:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: exiv2-0.27.5-2.el9.x86_64 2024-03-04T12:19:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-03-04T12:19:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-03-04T12:19:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-03-04T12:19:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: flatpak-1.12.8-1.el9.x86_64 2024-03-04T12:19:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2024-03-04T12:19:03.544 INFO:teuthology.orchestra.run.smithi172.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2024-03-04T12:19:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-04T12:19:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-04T12:19:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-04T12:19:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-04T12:19:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2024-03-04T12:19:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-03-04T12:19:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: giflib-5.2.1-9.el9.x86_64 2024-03-04T12:19:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: google-guice-4.2.3-9.el9.noarch 2024-03-04T12:19:03.545 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-04T12:19:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: graphene-1.10.6-2.el9.x86_64 2024-03-04T12:19:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-04T12:19:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: gsm-1.0.19-6.el9.x86_64 2024-03-04T12:19:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-03-04T12:19:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-03-04T12:19:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2024-03-04T12:19:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: gtk3-3.24.31-2.el9.x86_64 2024-03-04T12:19:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: guava-30.1-6.el9.noarch 2024-03-04T12:19:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-03-04T12:19:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-03-04T12:19:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-03-04T12:19:03.546 INFO:teuthology.orchestra.run.smithi172.stdout: iso-codes-4.6.0-3.el9.noarch 2024-03-04T12:19:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-03-04T12:19:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: jansi-2.3.3-6.el9.x86_64 2024-03-04T12:19:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 2024-03-04T12:19:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_64 2024-03-04T12:19:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 2024-03-04T12:19:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-03-04T12:19:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-03-04T12:19:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-03-04T12:19:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: jq-1.6-16.el9.x86_64 2024-03-04T12:19:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: jsoup-1.13.1-10.el9.noarch 2024-03-04T12:19:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: jsr-305-3.0.2-6.el9.noarch 2024-03-04T12:19:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: lcms2-2.12-3.el9.x86_64 2024-03-04T12:19:03.547 INFO:teuthology.orchestra.run.smithi172.stdout: libX11-xcb-1.7.0-8.el9.x86_64 2024-03-04T12:19:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-03-04T12:19:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-03-04T12:19:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-03-04T12:19:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-03-04T12:19:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: libXi-1.7.10-8.el9.x86_64 2024-03-04T12:19:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-03-04T12:19:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-03-04T12:19:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: libXtst-1.2.3-16.el9.x86_64 2024-03-04T12:19:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: libXv-1.0.11-16.el9.x86_64 2024-03-04T12:19:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-03-04T12:19:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-04T12:19:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-04T12:19:03.548 INFO:teuthology.orchestra.run.smithi172.stdout: libasyncns-0.8-22.el9.x86_64 2024-03-04T12:19:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: libcanberra-0.30-27.el9.x86_64 2024-03-04T12:19:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-03-04T12:19:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: libdrm-2.4.117-1.el9.x86_64 2024-03-04T12:19:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-03-04T12:19:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: libexif-0.6.22-6.el9.x86_64 2024-03-04T12:19:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-03-04T12:19:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-03-04T12:19:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-04T12:19:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-03-04T12:19:03.549 INFO:teuthology.orchestra.run.smithi172.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-03-04T12:19:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-03-04T12:19:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: libgsf-1.14.47-5.el9.x86_64 2024-03-04T12:19:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: libgxps-0.3.2-3.el9.x86_64 2024-03-04T12:19:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: libiptcdata-1.0.5-9.el9.x86_64 2024-03-04T12:19:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-03-04T12:19:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: libnotify-0.7.9-8.el9.x86_64 2024-03-04T12:19:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-04T12:19:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-03-04T12:19:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-03-04T12:19:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: libpciaccess-0.16-6.el9.x86_64 2024-03-04T12:19:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-04T12:19:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-04T12:19:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-04T12:19:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.550 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-04T12:19:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: libsbc-1.4-9.el9.x86_64 2024-03-04T12:19:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-03-04T12:19:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-03-04T12:19:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: libtiff-4.4.0-12.el9.x86_64 2024-03-04T12:19:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2024-03-04T12:19:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-03-04T12:19:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-04T12:19:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-03-04T12:19:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-03-04T12:19:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-03-04T12:19:03.551 INFO:teuthology.orchestra.run.smithi172.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-03-04T12:19:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-03-04T12:19:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-03-04T12:19:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: libwebp-1.2.0-8.el9.x86_64 2024-03-04T12:19:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-03-04T12:19:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: libxshmfence-1.3-10.el9.x86_64 2024-03-04T12:19:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-03-04T12:19:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-03-04T12:19:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-04T12:19:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-03-04T12:19:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-04T12:19:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: lua-posix-35.0-8.el9.x86_64 2024-03-04T12:19:03.552 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-04T12:19:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: maven-1:3.6.3-15.el9.noarch 2024-03-04T12:19:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-03-04T12:19:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-03-04T12:19:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-03-04T12:19:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-03-04T12:19:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-03-04T12:19:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: mesa-libEGL-23.3.3-1.el9.x86_64 2024-03-04T12:19:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: mesa-libGL-23.3.3-1.el9.x86_64 2024-03-04T12:19:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: mesa-libgbm-23.3.3-1.el9.x86_64 2024-03-04T12:19:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: mesa-libglapi-23.3.3-1.el9.x86_64 2024-03-04T12:19:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-03-04T12:19:03.553 INFO:teuthology.orchestra.run.smithi172.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-04T12:19:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-04T12:19:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-04T12:19:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-03-04T12:19:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: opus-1.3.1-10.el9.x86_64 2024-03-04T12:19:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: orc-0.4.31-6.el9.x86_64 2024-03-04T12:19:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: osinfo-db-20231215-1.el9.noarch 2024-03-04T12:19:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-03-04T12:19:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: ostree-libs-2024.4-3.el9.x86_64 2024-03-04T12:19:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: p11-kit-server-0.24.1-2.el9.x86_64 2024-03-04T12:19:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-04T12:19:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: pipewire-1.0.1-1.el9.x86_64 2024-03-04T12:19:03.554 INFO:teuthology.orchestra.run.smithi172.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-03-04T12:19:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-03-04T12:19:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-03-04T12:19:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-03-04T12:19:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-03-04T12:19:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: plexus-cipher-1.7-27.el9.noarch 2024-03-04T12:19:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-03-04T12:19:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-03-04T12:19:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-03-04T12:19:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-03-04T12:19:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-03-04T12:19:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: poppler-21.01.0-19.el9.x86_64 2024-03-04T12:19:03.555 INFO:teuthology.orchestra.run.smithi172.stdout: poppler-data-0.4.9-9.el9.noarch 2024-03-04T12:19:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: poppler-glib-21.01.0-19.el9.x86_64 2024-03-04T12:19:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-04T12:19:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-04T12:19:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-03-04T12:19:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-03-04T12:19:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-04T12:19:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-04T12:19:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-04T12:19:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-04T12:19:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.556 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-04T12:19:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-04T12:19:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-04T12:19:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-04T12:19:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-04T12:19:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-04T12:19:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-04T12:19:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-04T12:19:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-04T12:19:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-04T12:19:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-04T12:19:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-04T12:19:03.557 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-04T12:19:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-04T12:19:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-04T12:19:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-04T12:19:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-04T12:19:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-04T12:19:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-04T12:19:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-04T12:19:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-04T12:19:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-04T12:19:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-04T12:19:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-04T12:19:03.558 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-04T12:19:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-04T12:19:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-04T12:19:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-04T12:19:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-03-04T12:19:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-04T12:19:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-04T12:19:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-04T12:19:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-04T12:19:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-04T12:19:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-04T12:19:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-04T12:19:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-04T12:19:03.559 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-04T12:19:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-04T12:19:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-04T12:19:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-04T12:19:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-04T12:19:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-04T12:19:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-04T12:19:03.560 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-04T12:19:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-04T12:19:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-04T12:19:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-04T12:19:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-04T12:19:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-04T12:19:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-04T12:19:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-04T12:19:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-04T12:19:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-04T12:19:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.0.0-1871.g3aec3903.el9.x86_64 2024-03-04T12:19:03.561 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-3.el9.x86_64 2024-03-04T12:19:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: rtkit-0.11-28.el9.x86_64 2024-03-04T12:19:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: s3cmd-2.4.0-1.el9.noarch 2024-03-04T12:19:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: sisu-1:0.3.4-10.el9.noarch 2024-03-04T12:19:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: slf4j-1.7.30-13.el9.noarch 2024-03-04T12:19:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-04T12:19:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-03-04T12:19:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-04T12:19:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-03-04T12:19:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: tracker-3.1.2-3.el9.x86_64 2024-03-04T12:19:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-03-04T12:19:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-03-04T12:19:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: tzdata-java-2024a-1.el9.noarch 2024-03-04T12:19:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: upower-0.99.11-11.el9.x86_64 2024-03-04T12:19:03.562 INFO:teuthology.orchestra.run.smithi172.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-03-04T12:19:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-03-04T12:19:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-03-04T12:19:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-03-04T12:19:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-03-04T12:19:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-03-04T12:19:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-03-04T12:19:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-04T12:19:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-03-04T12:19:03.563 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:03.564 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-03-04T12:19:03.926 DEBUG:teuthology.parallel:result is None 2024-03-04T12:19:03.927 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:19:04.145 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-04T12:19:04.244 INFO:teuthology.orchestra.run.smithi110.stdout:19.0.0-1871.g3aec3903.el9 2024-03-04T12:19:04.244 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1871.g3aec3903.el9 2024-03-04T12:19:04.244 INFO:teuthology.task.install:The correct ceph version 19.0.0-1871.g3aec3903 is installed. 2024-03-04T12:19:04.246 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:19:04.463 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-04T12:19:04.557 INFO:teuthology.orchestra.run.smithi172.stdout:19.0.0-1871.g3aec3903.el9 2024-03-04T12:19:04.557 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1871.g3aec3903.el9 2024-03-04T12:19:04.557 INFO:teuthology.task.install:The correct ceph version 19.0.0-1871.g3aec3903 is installed. 2024-03-04T12:19:04.559 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-04T12:19:04.559 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:04.559 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-04T12:19:04.609 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:04.610 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-04T12:19:04.654 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-04T12:19:04.654 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:04.654 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-03-04T12:19:04.701 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-04T12:19:04.783 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:04.783 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-03-04T12:19:04.825 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-04T12:19:04.907 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-04T12:19:04.907 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:04.907 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-04T12:19:04.950 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-04T12:19:05.031 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:05.031 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-04T12:19:05.072 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-04T12:19:05.151 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-04T12:19:05.152 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:05.152 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-03-04T12:19:05.191 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-04T12:19:05.270 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:05.270 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-03-04T12:19:05.311 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-04T12:19:05.391 INFO:teuthology.run_tasks:Running task ceph... 2024-03-04T12:19:05.496 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-04T12:19:05.496 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2024-03-04T12:19:05.498 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /var/log/ceph 2024-03-04T12:19:05.538 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-04T12:19:05.539 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-04T12:19:05.579 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-04T12:19:05.618 INFO:tasks.ceph:Creating extra log directories... 2024-03-04T12:19:05.619 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-04T12:19:05.658 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-04T12:19:05.711 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-04T12:19:05.711 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-04T12:19:05.711 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061', 'branch': 'wip-rgw-d4n', 'description': 'rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7581061', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rgw-d4n'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': False, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-d4n', 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8'}}, 'owner': 'scheduled_prsrivas@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 3236, 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-d4n', 'suite_path': '/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/pritha-srivastava/ceph.git', 'suite_sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8', 'targets': {'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBRfxsTEaInW4UE6C9MmpTeTftsY07BxFw+QHknsPlzJEsYaBqKH1/w6i4fnuuqmlG5TlNfR0V82yyQyIxUQw3c=', 'smithi172.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8psj+oSZ4kKEr2fYTgbk/TQycVVgPqXLGrcVm/ZViu2EK3wAHNTdYNTXzagMCg0rVKK2nQNd+8fX6dZRPRd7A='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '3aec390336fdfdc8f927818b718cfb0361bd47c8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-03-04_08:28:53', 'tube': 'smithi', 'user': 'prsrivas', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-04T12:19:05.712 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-04T12:19:05.738 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-04T12:19:05.768 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2024-03-04T12:19:05.806 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2024-03-04T12:19:05.847 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:05.847 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-03-04T12:19:05.911 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-04T12:19:05.911 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-03-04T12:19:05.978 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-04T12:19:05.978 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T12:19:05.978 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-03-04T12:19:05.978 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T12:19:05.978 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T12:19:05.979 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-03-04 12:18:44.888997637 +0000 2024-03-04T12:19:05.979 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-03-04 12:16:21.246323248 +0000 2024-03-04T12:19:05.979 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-03-04 12:16:21.246323248 +0000 2024-03-04T12:19:05.979 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-03-04 12:16:21.246323248 +0000 2024-03-04T12:19:05.979 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-04T12:19:06.055 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-03-04T12:19:06.056 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-03-04T12:19:06.056 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 9.6029e-05 s, 5.3 MB/s 2024-03-04T12:19:06.057 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-04T12:19:06.126 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-03-04T12:19:06.194 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-04T12:19:06.194 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T12:19:06.194 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-03-04T12:19:06.194 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T12:19:06.194 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T12:19:06.194 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-03-04 12:18:44.888997637 +0000 2024-03-04T12:19:06.194 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-03-04 12:16:21.558317930 +0000 2024-03-04T12:19:06.194 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-03-04 12:16:21.558317930 +0000 2024-03-04T12:19:06.194 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-03-04 12:16:21.558317930 +0000 2024-03-04T12:19:06.195 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-04T12:19:06.272 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-03-04T12:19:06.272 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-03-04T12:19:06.272 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000101033 s, 5.1 MB/s 2024-03-04T12:19:06.273 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-04T12:19:06.341 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-03-04T12:19:06.409 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-04T12:19:06.410 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T12:19:06.410 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-03-04T12:19:06.410 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T12:19:06.410 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T12:19:06.410 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-03-04 12:18:44.888997637 +0000 2024-03-04T12:19:06.410 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-03-04 12:16:21.895312187 +0000 2024-03-04T12:19:06.410 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-03-04 12:16:21.895312187 +0000 2024-03-04T12:19:06.410 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-03-04 12:16:21.895312187 +0000 2024-03-04T12:19:06.410 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-04T12:19:06.487 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-03-04T12:19:06.487 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-03-04T12:19:06.487 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 8.9695e-05 s, 5.7 MB/s 2024-03-04T12:19:06.488 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-04T12:19:06.556 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-03-04T12:19:06.624 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-04T12:19:06.624 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T12:19:06.624 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-03-04T12:19:06.624 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T12:19:06.625 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T12:19:06.625 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-03-04 12:18:44.889997620 +0000 2024-03-04T12:19:06.625 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-03-04 12:16:22.233306426 +0000 2024-03-04T12:19:06.625 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-03-04 12:16:22.233306426 +0000 2024-03-04T12:19:06.625 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-03-04 12:16:22.233306426 +0000 2024-03-04T12:19:06.625 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-04T12:19:06.702 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-03-04T12:19:06.703 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-03-04T12:19:06.703 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 9.9041e-05 s, 5.2 MB/s 2024-03-04T12:19:06.704 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-04T12:19:06.771 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T12:19:06.771 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:06.771 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-03-04T12:19:06.804 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-04T12:19:06.804 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-03-04T12:19:06.874 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-04T12:19:06.874 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T12:19:06.875 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-03-04T12:19:06.875 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T12:19:06.875 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T12:19:06.875 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-03-04 12:18:54.788956535 +0000 2024-03-04T12:19:06.875 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-03-04 12:16:21.253781916 +0000 2024-03-04T12:19:06.875 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-03-04 12:16:21.253781916 +0000 2024-03-04T12:19:06.875 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-03-04 12:16:21.253781916 +0000 2024-03-04T12:19:06.875 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-04T12:19:06.954 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-03-04T12:19:06.954 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-03-04T12:19:06.954 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000187654 s, 2.7 MB/s 2024-03-04T12:19:06.955 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-04T12:19:07.024 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-03-04T12:19:07.091 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-04T12:19:07.092 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T12:19:07.092 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-03-04T12:19:07.092 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T12:19:07.092 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T12:19:07.092 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-03-04 12:18:54.788956535 +0000 2024-03-04T12:19:07.092 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-03-04 12:16:21.591773743 +0000 2024-03-04T12:19:07.092 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-03-04 12:16:21.591773743 +0000 2024-03-04T12:19:07.092 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-03-04 12:16:21.591773743 +0000 2024-03-04T12:19:07.092 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-04T12:19:07.172 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-03-04T12:19:07.172 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-03-04T12:19:07.172 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000210628 s, 2.4 MB/s 2024-03-04T12:19:07.173 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-04T12:19:07.241 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-03-04T12:19:07.309 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-04T12:19:07.309 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T12:19:07.310 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-03-04T12:19:07.310 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T12:19:07.310 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T12:19:07.310 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-03-04 12:18:54.788956535 +0000 2024-03-04T12:19:07.310 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-03-04 12:16:21.925765667 +0000 2024-03-04T12:19:07.310 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-03-04 12:16:21.925765667 +0000 2024-03-04T12:19:07.310 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-03-04 12:16:21.925765667 +0000 2024-03-04T12:19:07.310 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-04T12:19:07.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-03-04T12:19:07.388 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-03-04T12:19:07.388 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000212998 s, 2.4 MB/s 2024-03-04T12:19:07.389 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-04T12:19:07.458 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-03-04T12:19:07.525 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-04T12:19:07.525 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-04T12:19:07.526 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-03-04T12:19:07.526 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-04T12:19:07.526 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-03-04T12:19:07.526 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-03-04 12:18:54.789956511 +0000 2024-03-04T12:19:07.526 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-03-04 12:16:22.266757421 +0000 2024-03-04T12:19:07.526 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-03-04 12:16:22.266757421 +0000 2024-03-04T12:19:07.526 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-03-04 12:16:22.266757421 +0000 2024-03-04T12:19:07.526 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-04T12:19:07.603 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-03-04T12:19:07.603 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-03-04T12:19:07.603 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000236988 s, 2.2 MB/s 2024-03-04T12:19:07.604 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-04T12:19:07.673 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T12:19:07.673 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-04T12:19:07.673 INFO:tasks.ceph:Generating config... 2024-03-04T12:19:07.674 INFO:tasks.ceph:[client] debug rgw = 20 2024-03-04T12:19:07.675 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-03-04T12:19:07.675 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-03-04T12:19:07.675 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-03-04T12:19:07.675 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-03-04T12:19:07.675 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-03-04T12:19:07.675 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-03-04T12:19:07.675 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-03-04T12:19:07.675 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-03-04T12:19:07.675 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-03-04T12:19:07.675 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-03-04T12:19:07.675 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-03-04T12:19:07.675 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-03-04T12:19:07.675 INFO:tasks.ceph:[client] setgroup = ceph 2024-03-04T12:19:07.675 INFO:tasks.ceph:[client] setuser = ceph 2024-03-04T12:19:07.675 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-03-04T12:19:07.676 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-03-04T12:19:07.676 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-03-04T12:19:07.676 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-03-04T12:19:07.676 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-03-04T12:19:07.676 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-04T12:19:07.676 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-04T12:19:07.676 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-04T12:19:07.676 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-04T12:19:07.676 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-04T12:19:07.676 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-03-04T12:19:07.676 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-04T12:19:07.676 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-04T12:19:07.676 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-04T12:19:07.676 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-04T12:19:07.677 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-04T12:19:07.677 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-04T12:19:07.677 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-04T12:19:07.677 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-04T12:19:07.677 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-04T12:19:07.677 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-04T12:19:07.677 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-04T12:19:07.677 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-04T12:19:07.677 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-04T12:19:07.677 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-04T12:19:07.677 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-03-04T12:19:07.677 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-04T12:19:07.677 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-03-04T12:19:07.678 INFO:tasks.ceph:Setting up mon.a... 2024-03-04T12:19:07.678 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-04T12:19:07.755 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.keyring 2024-03-04T12:19:07.757 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-04T12:19:07.816 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-04T12:19:07.857 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.110'), ('mon.c', '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]'), ('mon.b', '172.21.15.172')] 2024-03-04T12:19:07.858 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790],172.21.15.172', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-03-04T12:19:07.860 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:07.860 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-04T12:19:07.928 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.110 --addv c '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]' --add b 172.21.15.172 --print /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:19:08.026 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:19:08.027 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:19:08.027 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:19:08.027 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool: generated fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:19:08.027 INFO:teuthology.orchestra.run.smithi110.stdout:setting min_mon_release = quincy 2024-03-04T12:19:08.028 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 0 2024-03-04T12:19:08.028 INFO:teuthology.orchestra.run.smithi110.stdout:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:19:08.028 INFO:teuthology.orchestra.run.smithi110.stdout:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:19:08.028 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:19:08.028 INFO:teuthology.orchestra.run.smithi110.stdout:min_mon_release 17 (quincy) 2024-03-04T12:19:08.028 INFO:teuthology.orchestra.run.smithi110.stdout:election_strategy: 1 2024-03-04T12:19:08.028 INFO:teuthology.orchestra.run.smithi110.stdout:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:19:08.028 INFO:teuthology.orchestra.run.smithi110.stdout:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:19:08.028 INFO:teuthology.orchestra.run.smithi110.stdout:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:19:08.028 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-04T12:19:08.029 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-04T12:19:08.056 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d1d8dd61-f240-416d-a8c7-564800fa8311... 2024-03-04T12:19:08.057 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-04T12:19:08.099 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-04T12:19:08.160 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-03-04T12:19:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-03-04T12:19:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-04T12:19:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-03-04T12:19:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-03-04T12:19:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-03-04T12:19:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-03-04T12:19:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-03-04T12:19:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-03-04T12:19:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-03-04T12:19:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-04T12:19:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-03-04T12:19:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-03-04T12:19:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-04T12:19:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-03-04T12:19:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-03-04T12:19:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-03-04T12:19:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-03-04T12:19:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-03-04T12:19:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-03-04T12:19:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-03-04T12:19:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-03-04T12:19:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-04T12:19:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-04T12:19:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-03-04T12:19:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-04T12:19:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-03-04T12:19:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-03-04T12:19:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-03-04T12:19:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-03-04T12:19:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-03-04T12:19:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790],172.21.15.172" 2024-03-04T12:19:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: mon client directed command retry = 5 2024-03-04T12:19:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject socket failures = 5000 2024-03-04T12:19:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: osd heartbeat grace = 40 2024-03-04T12:19:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: osd_max_pg_log_entries = 10 2024-03-04T12:19:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: osd_min_pg_log_entries = 10 2024-03-04T12:19:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:19:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.163 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-03-04T12:19:08.164 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-03-04T12:19:08.164 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.164 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-03-04T12:19:08.164 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-03-04T12:19:08.164 INFO:teuthology.orchestra.run.smithi110.stdout: osd mclock profile = high_recovery_ops 2024-03-04T12:19:08.164 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.164 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-03-04T12:19:08.164 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-03-04T12:19:08.164 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.164 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-03-04T12:19:08.164 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-03-04T12:19:08.164 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-03-04T12:19:08.164 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug trim objects = true 2024-03-04T12:19:08.164 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.165 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-03-04T12:19:08.165 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-03-04T12:19:08.165 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.165 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-03-04T12:19:08.165 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.165 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-03-04T12:19:08.165 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.165 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-03-04T12:19:08.165 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.165 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-03-04T12:19:08.165 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-03-04T12:19:08.165 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.165 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-03-04T12:19:08.165 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-03-04T12:19:08.165 INFO:teuthology.orchestra.run.smithi110.stdout: bdev async discard = True 2024-03-04T12:19:08.166 INFO:teuthology.orchestra.run.smithi110.stdout: bdev enable discard = True 2024-03-04T12:19:08.166 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore allocator = bitmap 2024-03-04T12:19:08.166 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-03-04T12:19:08.166 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-03-04T12:19:08.166 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 1/20 2024-03-04T12:19:08.166 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 1/20 2024-03-04T12:19:08.166 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-03-04T12:19:08.166 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-03-04T12:19:08.166 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 4/10 2024-03-04T12:19:08.166 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-03-04T12:19:08.166 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-03-04T12:19:08.166 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-03-04T12:19:08.166 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-03-04T12:19:08.166 INFO:teuthology.orchestra.run.smithi110.stdout: osd fast shutdown = False 2024-03-04T12:19:08.166 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-03-04T12:19:08.166 INFO:teuthology.orchestra.run.smithi110.stdout: osd shutdown pgref assert = True 2024-03-04T12:19:08.167 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.167 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-03-04T12:19:08.167 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-03-04T12:19:08.167 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-03-04T12:19:08.167 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-03-04T12:19:08.167 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-03-04T12:19:08.167 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-03-04T12:19:08.167 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-03-04T12:19:08.167 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-03-04T12:19:08.167 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.167 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-03-04T12:19:08.167 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-03-04T12:19:08.167 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-03-04T12:19:08.167 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-03-04T12:19:08.167 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-03-04T12:19:08.168 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-03-04T12:19:08.168 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-03-04T12:19:08.168 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-03-04T12:19:08.168 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-03-04T12:19:08.168 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-03-04T12:19:08.168 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-03-04T12:19:08.168 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.168 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-04T12:19:08.168 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-03-04T12:19:08.168 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-03-04T12:19:08.168 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.168 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-03-04T12:19:08.168 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-04T12:19:08.169 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-04T12:19:08.169 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.169 INFO:teuthology.orchestra.run.smithi110.stdout: # 1m isn't quite enough 2024-03-04T12:19:08.169 INFO:teuthology.orchestra.run.smithi110.stdout: mon_down_mkfs_grace = 2m 2024-03-04T12:19:08.169 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.169 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_filestore_osds = false 2024-03-04T12:19:08.169 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd crush smoke test = False 2024-03-04T12:19:08.169 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:08.169 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-03-04T12:19:08.169 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-03-04T12:19:08.169 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = True 2024-03-04T12:19:08.169 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-03-04T12:19:08.169 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-04T12:19:08.169 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-04T12:19:08.169 INFO:teuthology.orchestra.run.smithi110.stdout: debug rgw = 20 2024-03-04T12:19:08.169 INFO:teuthology.orchestra.run.smithi110.stdout: rgw bucket counters cache = True 2024-03-04T12:19:08.170 INFO:teuthology.orchestra.run.smithi110.stdout: rgw crypt require ssl = False 2024-03-04T12:19:08.170 INFO:teuthology.orchestra.run.smithi110.stdout: rgw crypt s3 kms backend = testing 2024-03-04T12:19:08.170 INFO:teuthology.orchestra.run.smithi110.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-03-04T12:19:08.170 INFO:teuthology.orchestra.run.smithi110.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-03-04T12:19:08.170 INFO:teuthology.orchestra.run.smithi110.stdout: rgw d3n l1 datacache size = 10737418240 2024-03-04T12:19:08.170 INFO:teuthology.orchestra.run.smithi110.stdout: rgw d3n l1 local datacache enabled = True 2024-03-04T12:19:08.170 INFO:teuthology.orchestra.run.smithi110.stdout: rgw max chunk size = 4194304 2024-03-04T12:19:08.170 INFO:teuthology.orchestra.run.smithi110.stdout: rgw obj stripe size = 6291456 2024-03-04T12:19:08.170 INFO:teuthology.orchestra.run.smithi110.stdout: rgw torrent flag = True 2024-03-04T12:19:08.170 INFO:teuthology.orchestra.run.smithi110.stdout: rgw user counters cache = True 2024-03-04T12:19:08.170 INFO:teuthology.orchestra.run.smithi110.stdout: setgroup = ceph 2024-03-04T12:19:08.170 INFO:teuthology.orchestra.run.smithi110.stdout: setuser = ceph 2024-03-04T12:19:08.170 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-03-04T12:19:08.170 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2024-03-04T12:19:08.170 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2024-03-04T12:19:08.171 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2024-03-04T12:19:08.171 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2024-03-04T12:19:08.171 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-04T12:19:08.171 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2024-03-04T12:19:08.171 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.172 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2024-03-04T12:19:08.172 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.172 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2024-03-04T12:19:08.172 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.172 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2024-03-04T12:19:08.172 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2024-03-04T12:19:08.172 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.172 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2024-03-04T12:19:08.172 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2024-03-04T12:19:08.172 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.172 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-04T12:19:08.172 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2024-03-04T12:19:08.173 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.173 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2024-03-04T12:19:08.173 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-04T12:19:08.173 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.173 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2024-03-04T12:19:08.173 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.173 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2024-03-04T12:19:08.173 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2024-03-04T12:19:08.173 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2024-03-04T12:19:08.173 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2024-03-04T12:19:08.173 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2024-03-04T12:19:08.173 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2024-03-04T12:19:08.173 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2024-03-04T12:19:08.174 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-04T12:19:08.174 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-04T12:19:08.174 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2024-03-04T12:19:08.174 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.174 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-04T12:19:08.174 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.174 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2024-03-04T12:19:08.174 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.174 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2024-03-04T12:19:08.174 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.174 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2024-03-04T12:19:08.174 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2024-03-04T12:19:08.174 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2024-03-04T12:19:08.174 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790],172.21.15.172" 2024-03-04T12:19:08.174 INFO:teuthology.orchestra.run.smithi172.stdout: mon client directed command retry = 5 2024-03-04T12:19:08.175 INFO:teuthology.orchestra.run.smithi172.stdout: ms inject socket failures = 5000 2024-03-04T12:19:08.175 INFO:teuthology.orchestra.run.smithi172.stdout: osd heartbeat grace = 40 2024-03-04T12:19:08.175 INFO:teuthology.orchestra.run.smithi172.stdout: osd_max_pg_log_entries = 10 2024-03-04T12:19:08.175 INFO:teuthology.orchestra.run.smithi172.stdout: osd_min_pg_log_entries = 10 2024-03-04T12:19:08.175 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:19:08.175 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.175 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2024-03-04T12:19:08.175 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2024-03-04T12:19:08.175 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.175 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2024-03-04T12:19:08.176 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2024-03-04T12:19:08.176 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2024-03-04T12:19:08.176 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.176 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2024-03-04T12:19:08.176 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2024-03-04T12:19:08.176 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.176 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2024-03-04T12:19:08.176 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2024-03-04T12:19:08.176 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2024-03-04T12:19:08.176 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug trim objects = true 2024-03-04T12:19:08.176 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.176 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2024-03-04T12:19:08.176 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2024-03-04T12:19:08.176 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.177 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2024-03-04T12:19:08.177 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.177 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2024-03-04T12:19:08.177 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.177 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2024-03-04T12:19:08.177 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.177 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2024-03-04T12:19:08.177 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2024-03-04T12:19:08.177 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.177 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2024-03-04T12:19:08.177 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2024-03-04T12:19:08.177 INFO:teuthology.orchestra.run.smithi172.stdout: bdev async discard = True 2024-03-04T12:19:08.177 INFO:teuthology.orchestra.run.smithi172.stdout: bdev enable discard = True 2024-03-04T12:19:08.177 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore allocator = bitmap 2024-03-04T12:19:08.178 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2024-03-04T12:19:08.178 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2024-03-04T12:19:08.178 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 1/20 2024-03-04T12:19:08.178 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 1/20 2024-03-04T12:19:08.178 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-03-04T12:19:08.178 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2024-03-04T12:19:08.178 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 4/10 2024-03-04T12:19:08.178 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2024-03-04T12:19:08.178 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2024-03-04T12:19:08.178 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2024-03-04T12:19:08.178 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2024-03-04T12:19:08.178 INFO:teuthology.orchestra.run.smithi172.stdout: osd fast shutdown = False 2024-03-04T12:19:08.178 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2024-03-04T12:19:08.178 INFO:teuthology.orchestra.run.smithi172.stdout: osd shutdown pgref assert = True 2024-03-04T12:19:08.179 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.179 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2024-03-04T12:19:08.179 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-03-04T12:19:08.179 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2024-03-04T12:19:08.179 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-03-04T12:19:08.179 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-03-04T12:19:08.179 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-03-04T12:19:08.179 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-03-04T12:19:08.179 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2024-03-04T12:19:08.179 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.179 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2024-03-04T12:19:08.179 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-03-04T12:19:08.179 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-03-04T12:19:08.179 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2024-03-04T12:19:08.180 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-03-04T12:19:08.180 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2024-03-04T12:19:08.180 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2024-03-04T12:19:08.180 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-03-04T12:19:08.180 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2024-03-04T12:19:08.180 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2024-03-04T12:19:08.180 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-03-04T12:19:08.180 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.180 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-04T12:19:08.180 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2024-03-04T12:19:08.180 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2024-03-04T12:19:08.180 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.180 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2024-03-04T12:19:08.180 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-04T12:19:08.181 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-04T12:19:08.181 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.181 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2024-03-04T12:19:08.181 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2024-03-04T12:19:08.181 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.181 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2024-03-04T12:19:08.181 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd crush smoke test = False 2024-03-04T12:19:08.181 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-03-04T12:19:08.181 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2024-03-04T12:19:08.181 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2024-03-04T12:19:08.181 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = True 2024-03-04T12:19:08.181 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2024-03-04T12:19:08.181 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-04T12:19:08.181 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-04T12:19:08.181 INFO:teuthology.orchestra.run.smithi172.stdout: debug rgw = 20 2024-03-04T12:19:08.182 INFO:teuthology.orchestra.run.smithi172.stdout: rgw bucket counters cache = True 2024-03-04T12:19:08.182 INFO:teuthology.orchestra.run.smithi172.stdout: rgw crypt require ssl = False 2024-03-04T12:19:08.182 INFO:teuthology.orchestra.run.smithi172.stdout: rgw crypt s3 kms backend = testing 2024-03-04T12:19:08.182 INFO:teuthology.orchestra.run.smithi172.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-03-04T12:19:08.182 INFO:teuthology.orchestra.run.smithi172.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-03-04T12:19:08.182 INFO:teuthology.orchestra.run.smithi172.stdout: rgw d3n l1 datacache size = 10737418240 2024-03-04T12:19:08.182 INFO:teuthology.orchestra.run.smithi172.stdout: rgw d3n l1 local datacache enabled = True 2024-03-04T12:19:08.182 INFO:teuthology.orchestra.run.smithi172.stdout: rgw max chunk size = 4194304 2024-03-04T12:19:08.182 INFO:teuthology.orchestra.run.smithi172.stdout: rgw obj stripe size = 6291456 2024-03-04T12:19:08.182 INFO:teuthology.orchestra.run.smithi172.stdout: rgw torrent flag = True 2024-03-04T12:19:08.182 INFO:teuthology.orchestra.run.smithi172.stdout: rgw user counters cache = True 2024-03-04T12:19:08.182 INFO:teuthology.orchestra.run.smithi172.stdout: setgroup = ceph 2024-03-04T12:19:08.182 INFO:teuthology.orchestra.run.smithi172.stdout: setuser = ceph 2024-03-04T12:19:08.182 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2024-03-04T12:19:08.182 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2024-03-04T12:19:08.183 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2024-03-04T12:19:08.184 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-04T12:19:08.184 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-04T12:19:08.292 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-04T12:19:08.292 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:08.293 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-04T12:19:08.320 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:08.320 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-04T12:19:08.386 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2024-03-04T12:19:08.387 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:08.387 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-04T12:19:08.387 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-04T12:19:08.478 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:08.478 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:19:08.545 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi172.front.sepia.ceph.com 2024-03-04T12:19:08.545 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:08.545 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-04T12:19:08.545 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-04T12:19:08.598 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:08.598 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:19:08.666 INFO:tasks.ceph:Setting up mon nodes... 2024-03-04T12:19:08.666 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-04T12:19:08.666 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-04T12:19:08.735 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-04T12:19:08.737 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-04T12:19:08.813 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-04T12:19:08.816 INFO:tasks.ceph:Setting up mds nodes... 2024-03-04T12:19:08.816 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-04T12:19:08.816 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-04T12:19:08.870 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-04T12:19:08.886 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-04T12:19:08.942 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-04T12:19:08.958 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-04T12:19:08.958 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-04T12:19:08.958 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-04T12:19:08.997 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T12:19:08.997 INFO:tasks.ceph:role: osd.0 2024-03-04T12:19:08.997 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2024-03-04T12:19:08.998 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-04T12:19:09.077 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T12:19:09.077 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T12:19:09.077 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T12:19:09.077 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T12:19:09.077 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T12:19:09.077 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-03-04T12:19:09.077 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T12:19:09.077 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T12:19:09.077 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T12:19:09.077 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T12:19:09.109 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-03-04T12:19:09.111 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-03-04T12:19:09.111 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-04T12:19:09.197 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-04T12:19:09.283 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-04T12:19:09.323 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T12:19:09.323 INFO:tasks.ceph:role: osd.1 2024-03-04T12:19:09.323 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com 2024-03-04T12:19:09.324 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-04T12:19:09.404 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T12:19:09.404 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T12:19:09.404 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T12:19:09.405 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T12:19:09.405 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T12:19:09.405 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-03-04T12:19:09.405 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T12:19:09.405 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T12:19:09.405 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T12:19:09.405 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T12:19:09.436 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-03-04T12:19:09.438 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-03-04T12:19:09.438 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-04T12:19:09.524 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-04T12:19:09.567 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-04T12:19:09.647 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T12:19:09.648 INFO:tasks.ceph:role: osd.2 2024-03-04T12:19:09.648 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com 2024-03-04T12:19:09.648 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-04T12:19:09.727 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T12:19:09.727 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T12:19:09.727 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T12:19:09.727 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T12:19:09.727 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T12:19:09.727 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-03-04T12:19:09.727 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T12:19:09.727 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T12:19:09.727 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T12:19:09.727 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T12:19:09.759 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-03-04T12:19:09.761 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-03-04T12:19:09.762 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-04T12:19:09.844 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-04T12:19:09.931 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-04T12:19:10.011 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-04T12:19:10.011 INFO:tasks.ceph:role: osd.3 2024-03-04T12:19:10.011 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com 2024-03-04T12:19:10.011 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-04T12:19:10.091 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T12:19:10.091 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T12:19:10.091 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T12:19:10.092 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T12:19:10.092 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T12:19:10.092 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-03-04T12:19:10.092 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T12:19:10.092 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T12:19:10.092 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T12:19:10.092 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T12:19:10.124 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-03-04T12:19:10.125 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-03-04T12:19:10.125 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-04T12:19:10.209 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-04T12:19:10.293 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:19:10.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:10.401+0000 7fb566a68640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-04T12:19:10.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:10.402+0000 7fb566a68640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-04T12:19:10.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:10.402+0000 7fb566a68640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-04T12:19:10.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:10.402+0000 7fb566a68640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-04T12:19:10.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:10.402+0000 7fb566a68640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-04T12:19:10.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:10.402+0000 7fb566a68640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-04T12:19:13.262 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-04T12:19:13.309 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:19:13.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:13.411+0000 7f43500a4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-04T12:19:13.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:13.411+0000 7f43500a4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-04T12:19:13.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:13.411+0000 7f43500a4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-04T12:19:13.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:13.411+0000 7f43500a4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-04T12:19:13.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:13.411+0000 7f43500a4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-04T12:19:13.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:13.412+0000 7f43500a4640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-04T12:19:16.267 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-04T12:19:16.313 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:19:16.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:16.370+0000 7f6e50b49640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-04T12:19:16.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:16.370+0000 7f6e50b49640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-04T12:19:16.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:16.370+0000 7f6e50b49640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-04T12:19:16.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:16.370+0000 7f6e50b49640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-04T12:19:16.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:16.370+0000 7f6e50b49640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-04T12:19:16.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:16.370+0000 7f6e50b49640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-04T12:19:19.226 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-04T12:19:19.271 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:19:19.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:19.329+0000 7f48b148b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-04T12:19:19.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:19.329+0000 7f48b148b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-04T12:19:19.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:19.329+0000 7f48b148b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-04T12:19:19.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:19.329+0000 7f48b148b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-04T12:19:19.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:19.329+0000 7f48b148b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-04T12:19:19.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:19:19.329+0000 7f48b148b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-04T12:19:22.184 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-04T12:19:22.229 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-04T12:19:22.276 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T12:19:22.276 INFO:tasks.ceph:role: osd.4 2024-03-04T12:19:22.276 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com 2024-03-04T12:19:22.276 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-04T12:19:22.326 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T12:19:22.326 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T12:19:22.326 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T12:19:22.326 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T12:19:22.326 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T12:19:22.326 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-03-04T12:19:22.326 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T12:19:22.326 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T12:19:22.327 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T12:19:22.327 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T12:19:22.822 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-03-04T12:19:22.824 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-03-04T12:19:22.824 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-04T12:19:22.932 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-04T12:19:22.982 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-04T12:19:23.023 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T12:19:23.023 INFO:tasks.ceph:role: osd.5 2024-03-04T12:19:23.023 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com 2024-03-04T12:19:23.023 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-04T12:19:23.113 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T12:19:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T12:19:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T12:19:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T12:19:23.113 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T12:19:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-03-04T12:19:23.113 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T12:19:23.113 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T12:19:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T12:19:23.113 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T12:19:23.577 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-03-04T12:19:23.579 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-03-04T12:19:23.579 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-04T12:19:23.650 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-04T12:19:23.695 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-04T12:19:23.777 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T12:19:23.777 INFO:tasks.ceph:role: osd.6 2024-03-04T12:19:23.777 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi172.front.sepia.ceph.com 2024-03-04T12:19:23.777 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-04T12:19:23.864 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T12:19:23.864 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T12:19:23.864 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T12:19:23.864 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T12:19:23.865 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T12:19:23.865 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-03-04T12:19:23.865 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T12:19:23.865 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T12:19:23.865 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T12:19:23.865 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T12:19:24.372 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-03-04T12:19:24.374 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-03-04T12:19:24.374 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-04T12:19:24.478 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-04T12:19:24.524 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-04T12:19:24.564 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-04T12:19:24.565 INFO:tasks.ceph:role: osd.7 2024-03-04T12:19:24.565 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi172.front.sepia.ceph.com 2024-03-04T12:19:24.565 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-04T12:19:24.653 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-04T12:19:24.653 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-04T12:19:24.653 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-04T12:19:24.653 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-04T12:19:24.653 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-04T12:19:24.654 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-03-04T12:19:24.654 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-04T12:19:24.654 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-04T12:19:24.654 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-04T12:19:24.654 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-04T12:19:25.170 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-03-04T12:19:25.171 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-03-04T12:19:25.172 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-04T12:19:25.270 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-04T12:19:25.318 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:19:25.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:25.383+0000 7f776b80d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-04T12:19:25.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:25.383+0000 7f776b80d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-04T12:19:25.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:25.383+0000 7f776b80d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-04T12:19:25.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:25.383+0000 7f776b80d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-04T12:19:25.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:25.383+0000 7f776b80d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-04T12:19:25.388 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:25.384+0000 7f776b80d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-04T12:19:28.232 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-04T12:19:28.276 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:19:28.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:28.373+0000 7f643d413640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-04T12:19:28.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:28.373+0000 7f643d413640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-04T12:19:28.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:28.373+0000 7f643d413640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-04T12:19:28.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:28.373+0000 7f643d413640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-04T12:19:28.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:28.373+0000 7f643d413640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-04T12:19:28.378 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:28.374+0000 7f643d413640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-04T12:19:31.229 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-04T12:19:31.275 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:19:31.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:31.332+0000 7f8b27e17640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-04T12:19:31.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:31.333+0000 7f8b27e17640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-04T12:19:31.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:31.333+0000 7f8b27e17640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-04T12:19:31.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:31.333+0000 7f8b27e17640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-04T12:19:31.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:31.333+0000 7f8b27e17640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-04T12:19:31.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:31.333+0000 7f8b27e17640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-04T12:19:34.182 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-04T12:19:34.224 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:19:34.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:34.321+0000 7f904dc0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-04T12:19:34.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:34.321+0000 7f904dc0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-04T12:19:34.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:34.321+0000 7f904dc0c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-04T12:19:34.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:34.321+0000 7f904dc0c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-04T12:19:34.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:34.321+0000 7f904dc0c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-04T12:19:34.326 INFO:teuthology.orchestra.run.smithi172.stderr:2024-03-04T12:19:34.321+0000 7f904dc0c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-04T12:19:37.194 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-04T12:19:37.239 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-04T12:19:37.239 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:37.240 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-04T12:19:37.287 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:37.287 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-04T12:19:37.371 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:37.371 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-04T12:19:37.454 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:37.454 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-04T12:19:37.534 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:37.534 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-04T12:19:37.615 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:37.615 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-04T12:19:37.662 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:37.662 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-04T12:19:37.745 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:37.745 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-04T12:19:37.827 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:37.827 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-04T12:19:37.907 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:37.907 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-04T12:19:37.986 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:37.986 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-04T12:19:38.013 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:38.014 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-04T12:19:38.054 INFO:tasks.ceph:Adding keys to all mons... 2024-03-04T12:19:38.055 DEBUG:teuthology.orchestra.run.smithi110:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-04T12:19:38.057 DEBUG:teuthology.orchestra.run.smithi172:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-04T12:19:38.098 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.y] 2024-03-04T12:19:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQA8vOVlqAeWKxAAp9vbuMW1DVXZBGGylBQxFQ== 2024-03-04T12:19:38.098 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2024-03-04T12:19:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQA+vOVl7rYAGBAAOpvDIFjU524msGcD01BnpA== 2024-03-04T12:19:38.098 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2024-03-04T12:19:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBBvOVlwH6VGBAABc8tU5jpEaQrde+m4BGVKA== 2024-03-04T12:19:38.098 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2024-03-04T12:19:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBEvOVl1OghFhAA9zzFdf6qcy9jz/c3qmLcNA== 2024-03-04T12:19:38.098 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2024-03-04T12:19:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBHvOVl+LitExAAA0E4lGby/97UTrcGIwFVzg== 2024-03-04T12:19:38.098 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.x] 2024-03-04T12:19:38.099 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQA8vOVlm6JHMBAAl1oJPRQq4a72ViUuS4FVDQ== 2024-03-04T12:19:38.099 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.4] 2024-03-04T12:19:38.099 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBNvOVliiviFhAAxQKEoR3O/qo7NfrpTkEb5Q== 2024-03-04T12:19:38.099 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.5] 2024-03-04T12:19:38.099 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBQvOVlp8hKFhAAB+C0jXaQHgCRP5rL70IVJA== 2024-03-04T12:19:38.099 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.6] 2024-03-04T12:19:38.099 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBTvOVlrKrjExAAQnag1L4hjUoBSLHcToIAKA== 2024-03-04T12:19:38.099 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.7] 2024-03-04T12:19:38.099 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBWvOVloZ0vExAAgoQhuh1lbRn2WKPfcUEp4A== 2024-03-04T12:19:38.099 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2024-03-04T12:19:38.099 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQA8vOVlQCesMxAABWYorUSFDIutPk9XoAaulw== 2024-03-04T12:19:38.099 INFO:teuthology.orchestra.run.smithi110.stdout:[client.1] 2024-03-04T12:19:38.099 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQA8vOVlnPfwNxAAhSrYW/WZ5gG9o6yjF+bqhw== 2024-03-04T12:19:38.132 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr.y] 2024-03-04T12:19:38.132 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA8vOVlqAeWKxAAp9vbuMW1DVXZBGGylBQxFQ== 2024-03-04T12:19:38.132 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.0] 2024-03-04T12:19:38.132 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA+vOVl7rYAGBAAOpvDIFjU524msGcD01BnpA== 2024-03-04T12:19:38.132 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.1] 2024-03-04T12:19:38.132 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBBvOVlwH6VGBAABc8tU5jpEaQrde+m4BGVKA== 2024-03-04T12:19:38.133 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.2] 2024-03-04T12:19:38.133 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBEvOVl1OghFhAA9zzFdf6qcy9jz/c3qmLcNA== 2024-03-04T12:19:38.133 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.3] 2024-03-04T12:19:38.133 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBHvOVl+LitExAAA0E4lGby/97UTrcGIwFVzg== 2024-03-04T12:19:38.133 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr.x] 2024-03-04T12:19:38.133 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA8vOVlm6JHMBAAl1oJPRQq4a72ViUuS4FVDQ== 2024-03-04T12:19:38.133 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.4] 2024-03-04T12:19:38.133 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBNvOVliiviFhAAxQKEoR3O/qo7NfrpTkEb5Q== 2024-03-04T12:19:38.133 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.5] 2024-03-04T12:19:38.133 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBQvOVlp8hKFhAAB+C0jXaQHgCRP5rL70IVJA== 2024-03-04T12:19:38.133 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.6] 2024-03-04T12:19:38.133 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBTvOVlrKrjExAAQnag1L4hjUoBSLHcToIAKA== 2024-03-04T12:19:38.133 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.7] 2024-03-04T12:19:38.133 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBWvOVloZ0vExAAgoQhuh1lbRn2WKPfcUEp4A== 2024-03-04T12:19:38.133 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-03-04T12:19:38.134 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA8vOVlQCesMxAABWYorUSFDIutPk9XoAaulw== 2024-03-04T12:19:38.134 INFO:teuthology.orchestra.run.smithi172.stdout:[client.1] 2024-03-04T12:19:38.134 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA8vOVlnPfwNxAAhSrYW/WZ5gG9o6yjF+bqhw== 2024-03-04T12:19:38.135 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-04T12:19:38.143 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-04T12:19:38.239 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:19:38.242 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:19:38.308 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:19:38.311 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:19:38.375 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:19:38.377 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:19:38.441 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:19:38.444 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:19:38.509 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-04T12:19:38.511 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-04T12:19:38.575 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:19:38.578 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:19:38.642 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:19:38.645 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:19:38.710 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:19:38.712 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:19:38.775 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:19:38.777 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-04T12:19:38.842 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T12:19:38.844 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T12:19:38.912 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T12:19:38.914 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-04T12:19:38.981 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-04T12:19:38.981 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-04T12:19:39.020 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-04T12:19:39.130 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-04T12:19:39.169 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-04T12:19:39.249 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-04T12:19:39.359 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-04T12:19:39.399 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-04T12:19:39.439 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-04T12:19:39.551 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-04T12:19:39.590 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:19:39.593 DEBUG:teuthology.orchestra.run.smithi172:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-04T12:19:39.658 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-04T12:19:39.659 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-04T12:19:39.659 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-04T12:19:39.661 INFO:tasks.ceph.mon.a:Started 2024-03-04T12:19:39.662 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-04T12:19:39.662 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-04T12:19:39.663 INFO:tasks.ceph.mon.c:Started 2024-03-04T12:19:39.664 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-04T12:19:39.664 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-04T12:19:39.701 INFO:tasks.ceph.mon.b:Started 2024-03-04T12:19:39.702 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-04T12:19:39.702 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-04T12:19:39.702 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-04T12:19:39.706 INFO:tasks.ceph.mgr.y:Started 2024-03-04T12:19:39.706 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-04T12:19:39.706 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-04T12:19:39.708 INFO:tasks.ceph.mgr.x:Started 2024-03-04T12:19:39.708 INFO:tasks.ceph:Setting crush tunables to default 2024-03-04T12:19:39.708 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd crush tunables default 2024-03-04T12:19:45.513 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:45.507+0000 7fb2cf03c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T12:19:45.515 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:45.509+0000 7f8f231b8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-04T12:19:45.566 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:45.560+0000 7fb2cf03c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T12:19:45.568 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:45.562+0000 7f8f231b8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-04T12:19:45.901 INFO:teuthology.orchestra.run.smithi110.stderr:adjusted tunables profile to default 2024-03-04T12:19:45.913 INFO:tasks.ceph:check_enable_crimson: False 2024-03-04T12:19:45.913 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-04T12:19:45.913 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:45.913 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-04T12:19:45.952 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:45.952 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-04T12:19:46.033 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:46.033 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-04T12:19:46.091 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:46.085+0000 7f8f231b8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T12:19:46.113 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:19:46.114 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-04T12:19:46.116 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:46.111+0000 7fb2cf03c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-04T12:19:46.144 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:46.139+0000 7f8f231b8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T12:19:46.156 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:46.156 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-04T12:19:46.176 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:46.170+0000 7fb2cf03c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-04T12:19:46.191 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:46.186+0000 7f8f231b8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T12:19:46.198 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:46.198 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-04T12:19:46.221 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:46.215+0000 7fb2cf03c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-04T12:19:46.247 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:46.242+0000 7f8f231b8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T12:19:46.274 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:46.268+0000 7fb2cf03c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-04T12:19:46.277 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:46.278 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-04T12:19:46.293 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:46.287+0000 7f8f231b8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T12:19:46.316 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:46.310+0000 7fb2cf03c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-04T12:19:46.332 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-03-04T12:19:46.332 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-04T12:19:46.412 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 922e853a-a6f3-4c4d-8778-e24d4fe356f3 0 2024-03-04T12:19:46.415 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:46.409+0000 7f8f231b8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T12:19:46.430 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:46.424+0000 7fb2cf03c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-04T12:19:46.489 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:46.483+0000 7f8f231b8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T12:19:46.499 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:46.494+0000 7fb2cf03c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-04T12:19:46.538 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:46.532+0000 7f8f231b8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T12:19:46.547 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:46.541+0000 7fb2cf03c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-04T12:19:46.593 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:46.587+0000 7f8f231b8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T12:19:46.598 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:46.592+0000 7fb2cf03c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-04T12:19:46.613 INFO:teuthology.orchestra.run.smithi172.stdout:0 2024-03-04T12:19:46.625 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new dc1229f0-30b4-46f3-8d1b-05eac1e21ae9 1 2024-03-04T12:19:46.643 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:46.637+0000 7f8f231b8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T12:19:46.645 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:46.639+0000 7fb2cf03c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-04T12:19:46.826 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-03-04T12:19:46.838 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 5ff1bd28-cc33-4d98-8e2b-c214194ee334 2 2024-03-04T12:19:47.019 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:47.013+0000 7fb2cf03c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T12:19:47.068 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:47.061+0000 7f8f231b8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-04T12:19:47.106 INFO:teuthology.orchestra.run.smithi172.stdout:2 2024-03-04T12:19:47.118 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new ca92763a-b287-481e-a6d2-56a30f5fcd7a 3 2024-03-04T12:19:47.154 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:47.148+0000 7fb2cf03c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T12:19:47.209 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:47.204+0000 7f8f231b8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-04T12:19:47.265 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:47.259+0000 7fb2cf03c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T12:19:47.310 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:47.304+0000 7fb2cf03c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T12:19:47.322 INFO:teuthology.orchestra.run.smithi172.stdout:3 2024-03-04T12:19:47.334 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new b95079a0-f322-48fe-ba2c-4a78ffe05dfd 4 2024-03-04T12:19:47.343 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:47.338+0000 7f8f231b8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-04T12:19:47.392 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:47.387+0000 7f8f231b8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-04T12:19:47.421 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:47.415+0000 7fb2cf03c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T12:19:47.510 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:47.505+0000 7f8f231b8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-04T12:19:47.516 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:47.510+0000 7fb2cf03c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T12:19:47.533 INFO:teuthology.orchestra.run.smithi172.stdout:4 2024-03-04T12:19:47.546 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 11d5852a-b541-4483-a150-d5255e18cb28 5 2024-03-04T12:19:47.610 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:47.605+0000 7f8f231b8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-04T12:19:47.668 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:47.662+0000 7fb2cf03c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T12:19:47.711 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:47.705+0000 7fb2cf03c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T12:19:47.770 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:47.765+0000 7f8f231b8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-04T12:19:47.783 INFO:teuthology.orchestra.run.smithi172.stdout:5 2024-03-04T12:19:47.795 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new cd71a69e-5780-4a9e-952e-84e5ca55c859 6 2024-03-04T12:19:47.815 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:47.810+0000 7f8f231b8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-04T12:19:47.864 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:47.858+0000 7fb2cf03c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T12:19:47.977 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:47.972+0000 7f8f231b8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-04T12:19:48.014 INFO:teuthology.orchestra.run.smithi172.stdout:6 2024-03-04T12:19:48.025 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 1068d0ef-20ea-4d21-bec0-9cfa650be0e1 7 2024-03-04T12:19:48.222 INFO:teuthology.orchestra.run.smithi172.stdout:7 2024-03-04T12:19:48.233 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-04T12:19:48.233 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-04T12:19:48.236 INFO:tasks.ceph.osd.0:Started 2024-03-04T12:19:48.236 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-04T12:19:48.236 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-04T12:19:48.238 INFO:tasks.ceph.osd.1:Started 2024-03-04T12:19:48.238 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-04T12:19:48.238 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-04T12:19:48.240 INFO:tasks.ceph.osd.2:Started 2024-03-04T12:19:48.240 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-04T12:19:48.240 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-04T12:19:48.242 INFO:tasks.ceph.osd.3:Started 2024-03-04T12:19:48.242 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-04T12:19:48.242 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-04T12:19:48.244 INFO:tasks.ceph.osd.4:Started 2024-03-04T12:19:48.244 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-04T12:19:48.245 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-04T12:19:48.246 INFO:tasks.ceph.osd.5:Started 2024-03-04T12:19:48.247 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-04T12:19:48.247 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-04T12:19:48.249 INFO:tasks.ceph.osd.6:Started 2024-03-04T12:19:48.249 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-04T12:19:48.249 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-04T12:19:48.251 INFO:tasks.ceph.osd.7:Started 2024-03-04T12:19:48.252 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T12:19:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:19:48.464 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":10,"fsid":"d1d8dd61-f240-416d-a8c7-564800fa8311","created":"2024-03-04T12:19:45.018205+0000","modified":"2024-03-04T12:19:48.216003+0000","last_up_change":"0.000000","last_in_change":"2024-03-04T12:19:48.216003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"922e853a-a6f3-4c4d-8778-e24d4fe356f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dc1229f0-30b4-46f3-8d1b-05eac1e21ae9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5ff1bd28-cc33-4d98-8e2b-c214194ee334","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ca92763a-b287-481e-a6d2-56a30f5fcd7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b95079a0-f322-48fe-ba2c-4a78ffe05dfd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"11d5852a-b541-4483-a150-d5255e18cb28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cd71a69e-5780-4a9e-952e-84e5ca55c859","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1068d0ef-20ea-4d21-bec0-9cfa650be0e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T12:19:48.475 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-04T12:19:48.475 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-04T12:19:48.829 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:48.825+0000 7f8f231b8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T12:19:48.867 INFO:tasks.ceph.osd.5.smithi172.stderr:2024-03-04T12:19:48.862+0000 7f78f0ea4640 -1 Falling back to public interface 2024-03-04T12:19:48.868 INFO:tasks.ceph.osd.4.smithi172.stderr:2024-03-04T12:19:48.863+0000 7ff049613640 -1 Falling back to public interface 2024-03-04T12:19:48.868 INFO:tasks.ceph.osd.2.smithi110.stderr:2024-03-04T12:19:48.862+0000 7f2b9480d640 -1 Falling back to public interface 2024-03-04T12:19:48.872 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-03-04T12:19:48.867+0000 7f2da960f640 -1 Falling back to public interface 2024-03-04T12:19:48.876 INFO:tasks.ceph.osd.3.smithi110.stderr:2024-03-04T12:19:48.870+0000 7f28b0e11640 -1 Falling back to public interface 2024-03-04T12:19:48.880 INFO:tasks.ceph.osd.7.smithi172.stderr:2024-03-04T12:19:48.875+0000 7ff6bf20c640 -1 Falling back to public interface 2024-03-04T12:19:48.881 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-03-04T12:19:48.875+0000 7fbd75813640 -1 Falling back to public interface 2024-03-04T12:19:48.882 INFO:tasks.ceph.osd.6.smithi172.stderr:2024-03-04T12:19:48.877+0000 7f07a5a13640 -1 Falling back to public interface 2024-03-04T12:19:48.993 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:48.987+0000 7fb2cf03c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-04T12:19:49.108 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:49.103+0000 7f8f231b8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T12:19:49.160 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:49.156+0000 7f8f231b8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T12:19:49.268 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:49.262+0000 7fb2cf03c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-04T12:19:49.276 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:49.272+0000 7f8f231b8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T12:19:49.282 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-04T12:19:49.324 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:49.318+0000 7fb2cf03c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-04T12:19:49.449 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-03-04T12:19:49.443+0000 7fb2cf03c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-04T12:19:49.460 INFO:teuthology.misc.health.smithi110.stdout: 2024-03-04T12:19:49.460 INFO:teuthology.misc.health.smithi110.stdout:{"epoch":10,"fsid":"d1d8dd61-f240-416d-a8c7-564800fa8311","created":"2024-03-04T12:19:45.018205+0000","modified":"2024-03-04T12:19:48.216003+0000","last_up_change":"0.000000","last_in_change":"2024-03-04T12:19:48.216003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"922e853a-a6f3-4c4d-8778-e24d4fe356f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dc1229f0-30b4-46f3-8d1b-05eac1e21ae9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5ff1bd28-cc33-4d98-8e2b-c214194ee334","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ca92763a-b287-481e-a6d2-56a30f5fcd7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b95079a0-f322-48fe-ba2c-4a78ffe05dfd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"11d5852a-b541-4483-a150-d5255e18cb28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cd71a69e-5780-4a9e-952e-84e5ca55c859","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1068d0ef-20ea-4d21-bec0-9cfa650be0e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T12:19:49.470 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-04T12:19:50.302 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:50.297+0000 7f8ec4617640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-04T12:19:50.303 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-03-04T12:19:50.298+0000 7f8ec4617640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-04T12:19:52.324 INFO:tasks.ceph.osd.5.smithi172.stderr:2024-03-04T12:19:52.320+0000 7f78f0ea4640 -1 osd.5 0 log_to_monitors true 2024-03-04T12:19:52.341 INFO:tasks.ceph.osd.3.smithi110.stderr:2024-03-04T12:19:52.336+0000 7f28b0e11640 -1 osd.3 0 log_to_monitors true 2024-03-04T12:19:52.362 INFO:tasks.ceph.osd.2.smithi110.stderr:2024-03-04T12:19:52.357+0000 7f2b9480d640 -1 osd.2 0 log_to_monitors true 2024-03-04T12:19:52.405 INFO:tasks.ceph.osd.7.smithi172.stderr:2024-03-04T12:19:52.400+0000 7ff6bf20c640 -1 osd.7 0 log_to_monitors true 2024-03-04T12:19:52.411 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-03-04T12:19:52.406+0000 7f2da960f640 -1 osd.0 0 log_to_monitors true 2024-03-04T12:19:52.412 INFO:tasks.ceph.osd.4.smithi172.stderr:2024-03-04T12:19:52.407+0000 7ff049613640 -1 osd.4 0 log_to_monitors true 2024-03-04T12:19:52.417 INFO:tasks.ceph.osd.6.smithi172.stderr:2024-03-04T12:19:52.412+0000 7f07a5a13640 -1 osd.6 0 log_to_monitors true 2024-03-04T12:19:52.423 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-03-04T12:19:52.418+0000 7fbd75813640 -1 osd.1 0 log_to_monitors true 2024-03-04T12:19:55.747 INFO:tasks.ceph.osd.3.smithi110.stderr:2024-03-04T12:19:55.741+0000 7f28ac050640 -1 osd.3 0 waiting for initial osdmap 2024-03-04T12:19:55.755 INFO:tasks.ceph.osd.3.smithi110.stderr:2024-03-04T12:19:55.750+0000 7f28a4682640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T12:19:55.831 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-03-04T12:19:55.826+0000 7f2da4723640 -1 osd.0 0 waiting for initial osdmap 2024-03-04T12:19:55.832 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-03-04T12:19:55.827+0000 7fbd727bc640 -1 osd.1 0 waiting for initial osdmap 2024-03-04T12:19:55.836 INFO:tasks.ceph.osd.2.smithi110.stderr:2024-03-04T12:19:55.832+0000 7f2b8f8ea640 -1 osd.2 0 waiting for initial osdmap 2024-03-04T12:19:55.845 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-03-04T12:19:55.840+0000 7fbd695b6640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T12:19:55.845 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-03-04T12:19:55.840+0000 7f2d9cd55640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T12:19:55.847 INFO:tasks.ceph.osd.2.smithi110.stderr:2024-03-04T12:19:55.843+0000 7f2b87f1c640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T12:19:56.277 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-04T12:19:56.364 INFO:tasks.ceph.osd.5.smithi172.stderr:2024-03-04T12:19:56.359+0000 7f78ec615640 -1 osd.5 0 waiting for initial osdmap 2024-03-04T12:19:56.368 INFO:tasks.ceph.osd.4.smithi172.stderr:2024-03-04T12:19:56.363+0000 7ff044758640 -1 osd.4 0 waiting for initial osdmap 2024-03-04T12:19:56.375 INFO:tasks.ceph.osd.6.smithi172.stderr:2024-03-04T12:19:56.370+0000 7f07a0b23640 -1 osd.6 0 waiting for initial osdmap 2024-03-04T12:19:56.378 INFO:tasks.ceph.osd.5.smithi172.stderr:2024-03-04T12:19:56.374+0000 7f78e4c47640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T12:19:56.382 INFO:tasks.ceph.osd.4.smithi172.stderr:2024-03-04T12:19:56.378+0000 7ff03cd8a640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T12:19:56.386 INFO:tasks.ceph.osd.6.smithi172.stderr:2024-03-04T12:19:56.382+0000 7f0799155640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T12:19:56.439 INFO:tasks.ceph.osd.7.smithi172.stderr:2024-03-04T12:19:56.434+0000 7ff6ba3ae640 -1 osd.7 0 waiting for initial osdmap 2024-03-04T12:19:56.449 INFO:tasks.ceph.osd.7.smithi172.stderr:2024-03-04T12:19:56.444+0000 7ff6b29e0640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-04T12:19:56.567 INFO:teuthology.misc.health.smithi110.stdout: 2024-03-04T12:19:56.568 INFO:teuthology.misc.health.smithi110.stdout:{"epoch":12,"fsid":"d1d8dd61-f240-416d-a8c7-564800fa8311","created":"2024-03-04T12:19:45.018205+0000","modified":"2024-03-04T12:19:54.296343+0000","last_up_change":"0.000000","last_in_change":"2024-03-04T12:19:48.216003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"922e853a-a6f3-4c4d-8778-e24d4fe356f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dc1229f0-30b4-46f3-8d1b-05eac1e21ae9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5ff1bd28-cc33-4d98-8e2b-c214194ee334","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ca92763a-b287-481e-a6d2-56a30f5fcd7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b95079a0-f322-48fe-ba2c-4a78ffe05dfd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"11d5852a-b541-4483-a150-d5255e18cb28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cd71a69e-5780-4a9e-952e-84e5ca55c859","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1068d0ef-20ea-4d21-bec0-9cfa650be0e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T12:19:56.578 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-04T12:20:03.386 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-04T12:20:03.683 INFO:teuthology.misc.health.smithi110.stdout: 2024-03-04T12:20:03.684 INFO:teuthology.misc.health.smithi110.stdout:{"epoch":16,"fsid":"d1d8dd61-f240-416d-a8c7-564800fa8311","created":"2024-03-04T12:19:45.018205+0000","modified":"2024-03-04T12:19:59.757235+0000","last_up_change":"2024-03-04T12:19:56.748782+0000","last_in_change":"2024-03-04T12:19:48.216003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T12:19:57.318984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"922e853a-a6f3-4c4d-8778-e24d4fe356f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3146826323},{"type":"v1","addr":"172.21.15.110:6809","nonce":3146826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3146826323},{"type":"v1","addr":"172.21.15.110:6811","nonce":3146826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3146826323},{"type":"v1","addr":"172.21.15.110:6815","nonce":3146826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3146826323},{"type":"v1","addr":"172.21.15.110:6813","nonce":3146826323}]},"public_addr":"172.21.15.110:6809/3146826323","cluster_addr":"172.21.15.110:6811/3146826323","heartbeat_back_addr":"172.21.15.110:6815/3146826323","heartbeat_front_addr":"172.21.15.110:6813/3146826323","state":["exists","up"]},{"osd":1,"uuid":"dc1229f0-30b4-46f3-8d1b-05eac1e21ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3005097257},{"type":"v1","addr":"172.21.15.110:6825","nonce":3005097257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3005097257},{"type":"v1","addr":"172.21.15.110:6827","nonce":3005097257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3005097257},{"type":"v1","addr":"172.21.15.110:6831","nonce":3005097257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3005097257},{"type":"v1","addr":"172.21.15.110:6829","nonce":3005097257}]},"public_addr":"172.21.15.110:6825/3005097257","cluster_addr":"172.21.15.110:6827/3005097257","heartbeat_back_addr":"172.21.15.110:6831/3005097257","heartbeat_front_addr":"172.21.15.110:6829/3005097257","state":["exists","up"]},{"osd":2,"uuid":"5ff1bd28-cc33-4d98-8e2b-c214194ee334","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2482344533},{"type":"v1","addr":"172.21.15.110:6801","nonce":2482344533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2482344533},{"type":"v1","addr":"172.21.15.110:6803","nonce":2482344533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2482344533},{"type":"v1","addr":"172.21.15.110:6807","nonce":2482344533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2482344533},{"type":"v1","addr":"172.21.15.110:6805","nonce":2482344533}]},"public_addr":"172.21.15.110:6801/2482344533","cluster_addr":"172.21.15.110:6803/2482344533","heartbeat_back_addr":"172.21.15.110:6807/2482344533","heartbeat_front_addr":"172.21.15.110:6805/2482344533","state":["exists","up"]},{"osd":3,"uuid":"ca92763a-b287-481e-a6d2-56a30f5fcd7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2308430566},{"type":"v1","addr":"172.21.15.110:6817","nonce":2308430566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2308430566},{"type":"v1","addr":"172.21.15.110:6819","nonce":2308430566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2308430566},{"type":"v1","addr":"172.21.15.110:6823","nonce":2308430566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2308430566},{"type":"v1","addr":"172.21.15.110:6821","nonce":2308430566}]},"public_addr":"172.21.15.110:6817/2308430566","cluster_addr":"172.21.15.110:6819/2308430566","heartbeat_back_addr":"172.21.15.110:6823/2308430566","heartbeat_front_addr":"172.21.15.110:6821/2308430566","state":["exists","up"]},{"osd":4,"uuid":"b95079a0-f322-48fe-ba2c-4a78ffe05dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3873506104},{"type":"v1","addr":"172.21.15.172:6809","nonce":3873506104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3873506104},{"type":"v1","addr":"172.21.15.172:6811","nonce":3873506104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3873506104},{"type":"v1","addr":"172.21.15.172:6815","nonce":3873506104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3873506104},{"type":"v1","addr":"172.21.15.172:6813","nonce":3873506104}]},"public_addr":"172.21.15.172:6809/3873506104","cluster_addr":"172.21.15.172:6811/3873506104","heartbeat_back_addr":"172.21.15.172:6815/3873506104","heartbeat_front_addr":"172.21.15.172:6813/3873506104","state":["exists","up"]},{"osd":5,"uuid":"11d5852a-b541-4483-a150-d5255e18cb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":824320839},{"type":"v1","addr":"172.21.15.172:6801","nonce":824320839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":824320839},{"type":"v1","addr":"172.21.15.172:6803","nonce":824320839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":824320839},{"type":"v1","addr":"172.21.15.172:6807","nonce":824320839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":824320839},{"type":"v1","addr":"172.21.15.172:6805","nonce":824320839}]},"public_addr":"172.21.15.172:6801/824320839","cluster_addr":"172.21.15.172:6803/824320839","heartbeat_back_addr":"172.21.15.172:6807/824320839","heartbeat_front_addr":"172.21.15.172:6805/824320839","state":["exists","up"]},{"osd":6,"uuid":"cd71a69e-5780-4a9e-952e-84e5ca55c859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6821","nonce":1928063852},{"type":"v1","addr":"172.21.15.172:6823","nonce":1928063852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6825","nonce":1928063852},{"type":"v1","addr":"172.21.15.172:6827","nonce":1928063852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1928063852},{"type":"v1","addr":"172.21.15.172:6831","nonce":1928063852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1928063852},{"type":"v1","addr":"172.21.15.172:6829","nonce":1928063852}]},"public_addr":"172.21.15.172:6823/1928063852","cluster_addr":"172.21.15.172:6827/1928063852","heartbeat_back_addr":"172.21.15.172:6831/1928063852","heartbeat_front_addr":"172.21.15.172:6829/1928063852","state":["exists","up"]},{"osd":7,"uuid":"1068d0ef-20ea-4d21-bec0-9cfa650be0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":486554607},{"type":"v1","addr":"172.21.15.172:6817","nonce":486554607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":486554607},{"type":"v1","addr":"172.21.15.172:6819","nonce":486554607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":486554607},{"type":"v1","addr":"172.21.15.172:6826","nonce":486554607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":486554607},{"type":"v1","addr":"172.21.15.172:6822","nonce":486554607}]},"public_addr":"172.21.15.172:6817/486554607","cluster_addr":"172.21.15.172:6819/486554607","heartbeat_back_addr":"172.21.15.172:6826/486554607","heartbeat_front_addr":"172.21.15.172:6822/486554607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.396267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.415617+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.330003+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.354908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.437877+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.300459+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.394851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.377902+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T12:20:03.695 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-04T12:20:03.695 INFO:tasks.ceph:Creating RBD pool 2024-03-04T12:20:03.695 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd pool create rbd 8 2024-03-04T12:20:04.776 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'rbd' created 2024-03-04T12:20:04.791 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-03-04T12:20:05.779 INFO:teuthology.orchestra.run.smithi110.stderr:enabled application 'rbd' on pool 'rbd' 2024-03-04T12:20:05.797 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-04T12:20:05.797 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-04T12:20:05.798 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-04T12:20:05.798 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-04T12:20:05.798 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-04T12:20:06.151 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:20:06.161 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1816111885},{"type":"v1","addr":"172.21.15.172:6833","nonce":1816111885}]},"active_addr":"172.21.15.172:6833/1816111885","active_change":"2024-03-04T12:19:49.286304+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4102,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":258025378}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":2692911423}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":1609135556}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":3947156181}]}]} 2024-03-04T12:20:06.165 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-04T12:20:06.165 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-04T12:20:06.165 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T12:20:06.461 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:20:06.461 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":18,"fsid":"d1d8dd61-f240-416d-a8c7-564800fa8311","created":"2024-03-04T12:19:45.018205+0000","modified":"2024-03-04T12:20:05.770534+0000","last_up_change":"2024-03-04T12:19:56.748782+0000","last_in_change":"2024-03-04T12:19:48.216003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T12:19:57.318984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-04T12:20:03.986192+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"922e853a-a6f3-4c4d-8778-e24d4fe356f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3146826323},{"type":"v1","addr":"172.21.15.110:6809","nonce":3146826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3146826323},{"type":"v1","addr":"172.21.15.110:6811","nonce":3146826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3146826323},{"type":"v1","addr":"172.21.15.110:6815","nonce":3146826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3146826323},{"type":"v1","addr":"172.21.15.110:6813","nonce":3146826323}]},"public_addr":"172.21.15.110:6809/3146826323","cluster_addr":"172.21.15.110:6811/3146826323","heartbeat_back_addr":"172.21.15.110:6815/3146826323","heartbeat_front_addr":"172.21.15.110:6813/3146826323","state":["exists","up"]},{"osd":1,"uuid":"dc1229f0-30b4-46f3-8d1b-05eac1e21ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3005097257},{"type":"v1","addr":"172.21.15.110:6825","nonce":3005097257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3005097257},{"type":"v1","addr":"172.21.15.110:6827","nonce":3005097257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3005097257},{"type":"v1","addr":"172.21.15.110:6831","nonce":3005097257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3005097257},{"type":"v1","addr":"172.21.15.110:6829","nonce":3005097257}]},"public_addr":"172.21.15.110:6825/3005097257","cluster_addr":"172.21.15.110:6827/3005097257","heartbeat_back_addr":"172.21.15.110:6831/3005097257","heartbeat_front_addr":"172.21.15.110:6829/3005097257","state":["exists","up"]},{"osd":2,"uuid":"5ff1bd28-cc33-4d98-8e2b-c214194ee334","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2482344533},{"type":"v1","addr":"172.21.15.110:6801","nonce":2482344533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2482344533},{"type":"v1","addr":"172.21.15.110:6803","nonce":2482344533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2482344533},{"type":"v1","addr":"172.21.15.110:6807","nonce":2482344533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2482344533},{"type":"v1","addr":"172.21.15.110:6805","nonce":2482344533}]},"public_addr":"172.21.15.110:6801/2482344533","cluster_addr":"172.21.15.110:6803/2482344533","heartbeat_back_addr":"172.21.15.110:6807/2482344533","heartbeat_front_addr":"172.21.15.110:6805/2482344533","state":["exists","up"]},{"osd":3,"uuid":"ca92763a-b287-481e-a6d2-56a30f5fcd7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2308430566},{"type":"v1","addr":"172.21.15.110:6817","nonce":2308430566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2308430566},{"type":"v1","addr":"172.21.15.110:6819","nonce":2308430566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2308430566},{"type":"v1","addr":"172.21.15.110:6823","nonce":2308430566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2308430566},{"type":"v1","addr":"172.21.15.110:6821","nonce":2308430566}]},"public_addr":"172.21.15.110:6817/2308430566","cluster_addr":"172.21.15.110:6819/2308430566","heartbeat_back_addr":"172.21.15.110:6823/2308430566","heartbeat_front_addr":"172.21.15.110:6821/2308430566","state":["exists","up"]},{"osd":4,"uuid":"b95079a0-f322-48fe-ba2c-4a78ffe05dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3873506104},{"type":"v1","addr":"172.21.15.172:6809","nonce":3873506104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3873506104},{"type":"v1","addr":"172.21.15.172:6811","nonce":3873506104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3873506104},{"type":"v1","addr":"172.21.15.172:6815","nonce":3873506104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3873506104},{"type":"v1","addr":"172.21.15.172:6813","nonce":3873506104}]},"public_addr":"172.21.15.172:6809/3873506104","cluster_addr":"172.21.15.172:6811/3873506104","heartbeat_back_addr":"172.21.15.172:6815/3873506104","heartbeat_front_addr":"172.21.15.172:6813/3873506104","state":["exists","up"]},{"osd":5,"uuid":"11d5852a-b541-4483-a150-d5255e18cb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":824320839},{"type":"v1","addr":"172.21.15.172:6801","nonce":824320839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":824320839},{"type":"v1","addr":"172.21.15.172:6803","nonce":824320839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":824320839},{"type":"v1","addr":"172.21.15.172:6807","nonce":824320839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":824320839},{"type":"v1","addr":"172.21.15.172:6805","nonce":824320839}]},"public_addr":"172.21.15.172:6801/824320839","cluster_addr":"172.21.15.172:6803/824320839","heartbeat_back_addr":"172.21.15.172:6807/824320839","heartbeat_front_addr":"172.21.15.172:6805/824320839","state":["exists","up"]},{"osd":6,"uuid":"cd71a69e-5780-4a9e-952e-84e5ca55c859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6821","nonce":1928063852},{"type":"v1","addr":"172.21.15.172:6823","nonce":1928063852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6825","nonce":1928063852},{"type":"v1","addr":"172.21.15.172:6827","nonce":1928063852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1928063852},{"type":"v1","addr":"172.21.15.172:6831","nonce":1928063852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1928063852},{"type":"v1","addr":"172.21.15.172:6829","nonce":1928063852}]},"public_addr":"172.21.15.172:6823/1928063852","cluster_addr":"172.21.15.172:6827/1928063852","heartbeat_back_addr":"172.21.15.172:6831/1928063852","heartbeat_front_addr":"172.21.15.172:6829/1928063852","state":["exists","up"]},{"osd":7,"uuid":"1068d0ef-20ea-4d21-bec0-9cfa650be0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":486554607},{"type":"v1","addr":"172.21.15.172:6817","nonce":486554607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":486554607},{"type":"v1","addr":"172.21.15.172:6819","nonce":486554607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":486554607},{"type":"v1","addr":"172.21.15.172:6826","nonce":486554607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":486554607},{"type":"v1","addr":"172.21.15.172:6822","nonce":486554607}]},"public_addr":"172.21.15.172:6817/486554607","cluster_addr":"172.21.15.172:6819/486554607","heartbeat_back_addr":"172.21.15.172:6826/486554607","heartbeat_front_addr":"172.21.15.172:6822/486554607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.396267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.415617+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.330003+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.354908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.437877+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.300459+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.394851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.377902+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T12:20:06.474 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-04T12:20:06.474 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T12:20:06.769 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:20:06.769 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":18,"fsid":"d1d8dd61-f240-416d-a8c7-564800fa8311","created":"2024-03-04T12:19:45.018205+0000","modified":"2024-03-04T12:20:05.770534+0000","last_up_change":"2024-03-04T12:19:56.748782+0000","last_in_change":"2024-03-04T12:19:48.216003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T12:19:57.318984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-04T12:20:03.986192+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"922e853a-a6f3-4c4d-8778-e24d4fe356f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3146826323},{"type":"v1","addr":"172.21.15.110:6809","nonce":3146826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3146826323},{"type":"v1","addr":"172.21.15.110:6811","nonce":3146826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3146826323},{"type":"v1","addr":"172.21.15.110:6815","nonce":3146826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3146826323},{"type":"v1","addr":"172.21.15.110:6813","nonce":3146826323}]},"public_addr":"172.21.15.110:6809/3146826323","cluster_addr":"172.21.15.110:6811/3146826323","heartbeat_back_addr":"172.21.15.110:6815/3146826323","heartbeat_front_addr":"172.21.15.110:6813/3146826323","state":["exists","up"]},{"osd":1,"uuid":"dc1229f0-30b4-46f3-8d1b-05eac1e21ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3005097257},{"type":"v1","addr":"172.21.15.110:6825","nonce":3005097257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3005097257},{"type":"v1","addr":"172.21.15.110:6827","nonce":3005097257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3005097257},{"type":"v1","addr":"172.21.15.110:6831","nonce":3005097257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3005097257},{"type":"v1","addr":"172.21.15.110:6829","nonce":3005097257}]},"public_addr":"172.21.15.110:6825/3005097257","cluster_addr":"172.21.15.110:6827/3005097257","heartbeat_back_addr":"172.21.15.110:6831/3005097257","heartbeat_front_addr":"172.21.15.110:6829/3005097257","state":["exists","up"]},{"osd":2,"uuid":"5ff1bd28-cc33-4d98-8e2b-c214194ee334","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2482344533},{"type":"v1","addr":"172.21.15.110:6801","nonce":2482344533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2482344533},{"type":"v1","addr":"172.21.15.110:6803","nonce":2482344533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2482344533},{"type":"v1","addr":"172.21.15.110:6807","nonce":2482344533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2482344533},{"type":"v1","addr":"172.21.15.110:6805","nonce":2482344533}]},"public_addr":"172.21.15.110:6801/2482344533","cluster_addr":"172.21.15.110:6803/2482344533","heartbeat_back_addr":"172.21.15.110:6807/2482344533","heartbeat_front_addr":"172.21.15.110:6805/2482344533","state":["exists","up"]},{"osd":3,"uuid":"ca92763a-b287-481e-a6d2-56a30f5fcd7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2308430566},{"type":"v1","addr":"172.21.15.110:6817","nonce":2308430566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2308430566},{"type":"v1","addr":"172.21.15.110:6819","nonce":2308430566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2308430566},{"type":"v1","addr":"172.21.15.110:6823","nonce":2308430566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2308430566},{"type":"v1","addr":"172.21.15.110:6821","nonce":2308430566}]},"public_addr":"172.21.15.110:6817/2308430566","cluster_addr":"172.21.15.110:6819/2308430566","heartbeat_back_addr":"172.21.15.110:6823/2308430566","heartbeat_front_addr":"172.21.15.110:6821/2308430566","state":["exists","up"]},{"osd":4,"uuid":"b95079a0-f322-48fe-ba2c-4a78ffe05dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3873506104},{"type":"v1","addr":"172.21.15.172:6809","nonce":3873506104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3873506104},{"type":"v1","addr":"172.21.15.172:6811","nonce":3873506104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3873506104},{"type":"v1","addr":"172.21.15.172:6815","nonce":3873506104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3873506104},{"type":"v1","addr":"172.21.15.172:6813","nonce":3873506104}]},"public_addr":"172.21.15.172:6809/3873506104","cluster_addr":"172.21.15.172:6811/3873506104","heartbeat_back_addr":"172.21.15.172:6815/3873506104","heartbeat_front_addr":"172.21.15.172:6813/3873506104","state":["exists","up"]},{"osd":5,"uuid":"11d5852a-b541-4483-a150-d5255e18cb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":824320839},{"type":"v1","addr":"172.21.15.172:6801","nonce":824320839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":824320839},{"type":"v1","addr":"172.21.15.172:6803","nonce":824320839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":824320839},{"type":"v1","addr":"172.21.15.172:6807","nonce":824320839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":824320839},{"type":"v1","addr":"172.21.15.172:6805","nonce":824320839}]},"public_addr":"172.21.15.172:6801/824320839","cluster_addr":"172.21.15.172:6803/824320839","heartbeat_back_addr":"172.21.15.172:6807/824320839","heartbeat_front_addr":"172.21.15.172:6805/824320839","state":["exists","up"]},{"osd":6,"uuid":"cd71a69e-5780-4a9e-952e-84e5ca55c859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6821","nonce":1928063852},{"type":"v1","addr":"172.21.15.172:6823","nonce":1928063852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6825","nonce":1928063852},{"type":"v1","addr":"172.21.15.172:6827","nonce":1928063852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1928063852},{"type":"v1","addr":"172.21.15.172:6831","nonce":1928063852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1928063852},{"type":"v1","addr":"172.21.15.172:6829","nonce":1928063852}]},"public_addr":"172.21.15.172:6823/1928063852","cluster_addr":"172.21.15.172:6827/1928063852","heartbeat_back_addr":"172.21.15.172:6831/1928063852","heartbeat_front_addr":"172.21.15.172:6829/1928063852","state":["exists","up"]},{"osd":7,"uuid":"1068d0ef-20ea-4d21-bec0-9cfa650be0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":486554607},{"type":"v1","addr":"172.21.15.172:6817","nonce":486554607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":486554607},{"type":"v1","addr":"172.21.15.172:6819","nonce":486554607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":486554607},{"type":"v1","addr":"172.21.15.172:6826","nonce":486554607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":486554607},{"type":"v1","addr":"172.21.15.172:6822","nonce":486554607}]},"public_addr":"172.21.15.172:6817/486554607","cluster_addr":"172.21.15.172:6819/486554607","heartbeat_back_addr":"172.21.15.172:6826/486554607","heartbeat_front_addr":"172.21.15.172:6822/486554607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.396267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.415617+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.330003+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.354908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.437877+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.300459+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.394851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.377902+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T12:20:06.782 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-04T12:20:06.783 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-04T12:20:06.783 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-04T12:20:06.783 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-04T12:20:06.784 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-04T12:20:06.784 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-04T12:20:06.785 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-04T12:20:06.785 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-04T12:20:07.049 INFO:teuthology.orchestra.run.smithi110.stdout:55834574852 2024-03-04T12:20:07.049 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-04T12:20:07.050 INFO:teuthology.orchestra.run.smithi110.stdout:55834574852 2024-03-04T12:20:07.051 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-04T12:20:07.053 INFO:teuthology.orchestra.run.smithi110.stdout:55834574852 2024-03-04T12:20:07.053 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-04T12:20:07.055 INFO:teuthology.orchestra.run.smithi110.stdout:55834574852 2024-03-04T12:20:07.056 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-04T12:20:07.057 INFO:teuthology.orchestra.run.smithi110.stdout:55834574852 2024-03-04T12:20:07.057 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-04T12:20:07.058 INFO:teuthology.orchestra.run.smithi110.stdout:55834574852 2024-03-04T12:20:07.058 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-04T12:20:07.059 INFO:teuthology.orchestra.run.smithi110.stdout:55834574851 2024-03-04T12:20:07.059 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-04T12:20:07.060 INFO:teuthology.orchestra.run.smithi110.stdout:55834574852 2024-03-04T12:20:07.060 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-04T12:20:07.638 INFO:teuthology.orchestra.run.smithi110.stdout:55834574851 2024-03-04T12:20:07.653 INFO:teuthology.orchestra.run.smithi110.stdout:55834574851 2024-03-04T12:20:07.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2024-03-04T12:20:07.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2024-03-04T12:20:07.682 INFO:teuthology.orchestra.run.smithi110.stdout:55834574851 2024-03-04T12:20:07.693 INFO:teuthology.orchestra.run.smithi110.stdout:55834574851 2024-03-04T12:20:07.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2024-03-04T12:20:07.701 INFO:teuthology.orchestra.run.smithi110.stdout:55834574851 2024-03-04T12:20:07.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2024-03-04T12:20:07.709 INFO:teuthology.orchestra.run.smithi110.stdout:55834574851 2024-03-04T12:20:07.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.7 2024-03-04T12:20:07.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2024-03-04T12:20:07.724 INFO:teuthology.orchestra.run.smithi110.stdout:55834574850 2024-03-04T12:20:07.732 INFO:teuthology.orchestra.run.smithi110.stdout:55834574851 2024-03-04T12:20:07.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.0 2024-03-04T12:20:07.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.3 2024-03-04T12:20:08.660 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-04T12:20:08.674 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-04T12:20:08.696 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-04T12:20:08.707 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-04T12:20:08.717 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-04T12:20:08.725 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-04T12:20:08.741 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-04T12:20:08.747 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-04T12:20:09.245 INFO:teuthology.orchestra.run.smithi110.stdout:55834574852 2024-03-04T12:20:09.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2024-03-04T12:20:09.265 DEBUG:teuthology.parallel:result is None 2024-03-04T12:20:09.283 INFO:teuthology.orchestra.run.smithi110.stdout:55834574852 2024-03-04T12:20:09.296 INFO:teuthology.orchestra.run.smithi110.stdout:55834574852 2024-03-04T12:20:09.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-03-04T12:20:09.298 DEBUG:teuthology.parallel:result is None 2024-03-04T12:20:09.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2024-03-04T12:20:09.309 DEBUG:teuthology.parallel:result is None 2024-03-04T12:20:09.325 INFO:teuthology.orchestra.run.smithi110.stdout:55834574852 2024-03-04T12:20:09.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.5 2024-03-04T12:20:09.338 DEBUG:teuthology.parallel:result is None 2024-03-04T12:20:09.365 INFO:teuthology.orchestra.run.smithi110.stdout:55834574852 2024-03-04T12:20:09.367 INFO:teuthology.orchestra.run.smithi110.stdout:55834574851 2024-03-04T12:20:09.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.0 2024-03-04T12:20:09.380 DEBUG:teuthology.parallel:result is None 2024-03-04T12:20:09.383 INFO:teuthology.orchestra.run.smithi110.stdout:55834574852 2024-03-04T12:20:09.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-03-04T12:20:09.385 INFO:teuthology.orchestra.run.smithi110.stdout:55834574852 2024-03-04T12:20:09.386 DEBUG:teuthology.parallel:result is None 2024-03-04T12:20:09.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2024-03-04T12:20:09.397 DEBUG:teuthology.parallel:result is None 2024-03-04T12:20:09.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.7 2024-03-04T12:20:09.398 DEBUG:teuthology.parallel:result is None 2024-03-04T12:20:09.398 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-04T12:20:09.398 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T12:20:09.732 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:20:09.732 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-03-04T12:20:09.744 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-03-04T12:20:09.294845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235432,"kb_used_data":2592,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739288,"statfs":{"total":773094113280,"available":772853030912,"internally_reserved":0,"allocated":2654208,"data_stored":1650760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001315"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.806968+0000","last_change":"2024-03-04T12:20:05.779688+0000","last_active":"2024-03-04T12:20:06.806968+0000","last_peered":"2024-03-04T12:20:06.806968+0000","last_clean":"2024-03-04T12:20:06.806968+0000","last_became_active":"2024-03-04T12:20:05.779370+0000","last_became_peered":"2024-03-04T12:20:05.779370+0000","last_unstale":"2024-03-04T12:20:06.806968+0000","last_undegraded":"2024-03-04T12:20:06.806968+0000","last_fullsized":"2024-03-04T12:20:06.806968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:52.901612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.808321+0000","last_change":"2024-03-04T12:20:05.784418+0000","last_active":"2024-03-04T12:20:06.808321+0000","last_peered":"2024-03-04T12:20:06.808321+0000","last_clean":"2024-03-04T12:20:06.808321+0000","last_became_active":"2024-03-04T12:20:05.784145+0000","last_became_peered":"2024-03-04T12:20:05.784145+0000","last_unstale":"2024-03-04T12:20:06.808321+0000","last_undegraded":"2024-03-04T12:20:06.808321+0000","last_fullsized":"2024-03-04T12:20:06.808321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:41.291467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.779947+0000","last_change":"2024-03-04T12:20:05.863980+0000","last_active":"2024-03-04T12:20:06.779947+0000","last_peered":"2024-03-04T12:20:06.779947+0000","last_clean":"2024-03-04T12:20:06.779947+0000","last_became_active":"2024-03-04T12:20:05.863682+0000","last_became_peered":"2024-03-04T12:20:05.863682+0000","last_unstale":"2024-03-04T12:20:06.779947+0000","last_undegraded":"2024-03-04T12:20:06.779947+0000","last_fullsized":"2024-03-04T12:20:06.779947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:13.302689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.808169+0000","last_change":"2024-03-04T12:20:05.863592+0000","last_active":"2024-03-04T12:20:06.808169+0000","last_peered":"2024-03-04T12:20:06.808169+0000","last_clean":"2024-03-04T12:20:06.808169+0000","last_became_active":"2024-03-04T12:20:05.863311+0000","last_became_peered":"2024-03-04T12:20:05.863311+0000","last_unstale":"2024-03-04T12:20:06.808169+0000","last_undegraded":"2024-03-04T12:20:06.808169+0000","last_fullsized":"2024-03-04T12:20:06.808169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:19:53.481187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.807234+0000","last_change":"2024-03-04T12:20:05.783217+0000","last_active":"2024-03-04T12:20:06.807234+0000","last_peered":"2024-03-04T12:20:06.807234+0000","last_clean":"2024-03-04T12:20:06.807234+0000","last_became_active":"2024-03-04T12:20:05.782897+0000","last_became_peered":"2024-03-04T12:20:05.782897+0000","last_unstale":"2024-03-04T12:20:06.807234+0000","last_undegraded":"2024-03-04T12:20:06.807234+0000","last_fullsized":"2024-03-04T12:20:06.807234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:51:54.079894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.777308+0000","last_change":"2024-03-04T12:20:05.864062+0000","last_active":"2024-03-04T12:20:06.777308+0000","last_peered":"2024-03-04T12:20:06.777308+0000","last_clean":"2024-03-04T12:20:06.777308+0000","last_became_active":"2024-03-04T12:20:05.863125+0000","last_became_peered":"2024-03-04T12:20:05.863125+0000","last_unstale":"2024-03-04T12:20:06.777308+0000","last_undegraded":"2024-03-04T12:20:06.777308+0000","last_fullsized":"2024-03-04T12:20:06.777308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:25.960438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.779946+0000","last_change":"2024-03-04T12:20:05.781479+0000","last_active":"2024-03-04T12:20:06.779946+0000","last_peered":"2024-03-04T12:20:06.779946+0000","last_clean":"2024-03-04T12:20:06.779946+0000","last_became_active":"2024-03-04T12:20:05.781199+0000","last_became_peered":"2024-03-04T12:20:05.781199+0000","last_unstale":"2024-03-04T12:20:06.779946+0000","last_undegraded":"2024-03-04T12:20:06.779946+0000","last_fullsized":"2024-03-04T12:20:06.779946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:44.684083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.807246+0000","last_change":"2024-03-04T12:20:05.783212+0000","last_active":"2024-03-04T12:20:06.807246+0000","last_peered":"2024-03-04T12:20:06.807246+0000","last_clean":"2024-03-04T12:20:06.807246+0000","last_became_active":"2024-03-04T12:20:05.782921+0000","last_became_peered":"2024-03-04T12:20:05.782921+0000","last_unstale":"2024-03-04T12:20:06.807246+0000","last_undegraded":"2024-03-04T12:20:06.807246+0000","last_fullsized":"2024-03-04T12:20:06.807246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:47.241725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.779815+0000","last_change":"2024-03-04T12:19:58.807747+0000","last_active":"2024-03-04T12:20:06.779815+0000","last_peered":"2024-03-04T12:20:06.779815+0000","last_clean":"2024-03-04T12:20:06.779815+0000","last_became_active":"2024-03-04T12:19:58.806723+0000","last_became_peered":"2024-03-04T12:19:58.806723+0000","last_unstale":"2024-03-04T12:20:06.779815+0000","last_undegraded":"2024-03-04T12:20:06.779815+0000","last_fullsized":"2024-03-04T12:20:06.779815+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:19:57.750293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:19:57.750293+0000","last_clean_scrub_stamp":"2024-03-04T12:19:57.750293+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:53:17.368805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T12:20:09.745 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T12:20:10.041 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:20:10.042 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-03-04T12:20:10.053 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-03-04T12:20:09.294845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235432,"kb_used_data":2592,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739288,"statfs":{"total":773094113280,"available":772853030912,"internally_reserved":0,"allocated":2654208,"data_stored":1650760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001315"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.806968+0000","last_change":"2024-03-04T12:20:05.779688+0000","last_active":"2024-03-04T12:20:06.806968+0000","last_peered":"2024-03-04T12:20:06.806968+0000","last_clean":"2024-03-04T12:20:06.806968+0000","last_became_active":"2024-03-04T12:20:05.779370+0000","last_became_peered":"2024-03-04T12:20:05.779370+0000","last_unstale":"2024-03-04T12:20:06.806968+0000","last_undegraded":"2024-03-04T12:20:06.806968+0000","last_fullsized":"2024-03-04T12:20:06.806968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:52.901612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.808321+0000","last_change":"2024-03-04T12:20:05.784418+0000","last_active":"2024-03-04T12:20:06.808321+0000","last_peered":"2024-03-04T12:20:06.808321+0000","last_clean":"2024-03-04T12:20:06.808321+0000","last_became_active":"2024-03-04T12:20:05.784145+0000","last_became_peered":"2024-03-04T12:20:05.784145+0000","last_unstale":"2024-03-04T12:20:06.808321+0000","last_undegraded":"2024-03-04T12:20:06.808321+0000","last_fullsized":"2024-03-04T12:20:06.808321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:41.291467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.779947+0000","last_change":"2024-03-04T12:20:05.863980+0000","last_active":"2024-03-04T12:20:06.779947+0000","last_peered":"2024-03-04T12:20:06.779947+0000","last_clean":"2024-03-04T12:20:06.779947+0000","last_became_active":"2024-03-04T12:20:05.863682+0000","last_became_peered":"2024-03-04T12:20:05.863682+0000","last_unstale":"2024-03-04T12:20:06.779947+0000","last_undegraded":"2024-03-04T12:20:06.779947+0000","last_fullsized":"2024-03-04T12:20:06.779947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:13.302689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.808169+0000","last_change":"2024-03-04T12:20:05.863592+0000","last_active":"2024-03-04T12:20:06.808169+0000","last_peered":"2024-03-04T12:20:06.808169+0000","last_clean":"2024-03-04T12:20:06.808169+0000","last_became_active":"2024-03-04T12:20:05.863311+0000","last_became_peered":"2024-03-04T12:20:05.863311+0000","last_unstale":"2024-03-04T12:20:06.808169+0000","last_undegraded":"2024-03-04T12:20:06.808169+0000","last_fullsized":"2024-03-04T12:20:06.808169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:19:53.481187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.807234+0000","last_change":"2024-03-04T12:20:05.783217+0000","last_active":"2024-03-04T12:20:06.807234+0000","last_peered":"2024-03-04T12:20:06.807234+0000","last_clean":"2024-03-04T12:20:06.807234+0000","last_became_active":"2024-03-04T12:20:05.782897+0000","last_became_peered":"2024-03-04T12:20:05.782897+0000","last_unstale":"2024-03-04T12:20:06.807234+0000","last_undegraded":"2024-03-04T12:20:06.807234+0000","last_fullsized":"2024-03-04T12:20:06.807234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:51:54.079894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.777308+0000","last_change":"2024-03-04T12:20:05.864062+0000","last_active":"2024-03-04T12:20:06.777308+0000","last_peered":"2024-03-04T12:20:06.777308+0000","last_clean":"2024-03-04T12:20:06.777308+0000","last_became_active":"2024-03-04T12:20:05.863125+0000","last_became_peered":"2024-03-04T12:20:05.863125+0000","last_unstale":"2024-03-04T12:20:06.777308+0000","last_undegraded":"2024-03-04T12:20:06.777308+0000","last_fullsized":"2024-03-04T12:20:06.777308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:25.960438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.779946+0000","last_change":"2024-03-04T12:20:05.781479+0000","last_active":"2024-03-04T12:20:06.779946+0000","last_peered":"2024-03-04T12:20:06.779946+0000","last_clean":"2024-03-04T12:20:06.779946+0000","last_became_active":"2024-03-04T12:20:05.781199+0000","last_became_peered":"2024-03-04T12:20:05.781199+0000","last_unstale":"2024-03-04T12:20:06.779946+0000","last_undegraded":"2024-03-04T12:20:06.779946+0000","last_fullsized":"2024-03-04T12:20:06.779946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:44.684083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.807246+0000","last_change":"2024-03-04T12:20:05.783212+0000","last_active":"2024-03-04T12:20:06.807246+0000","last_peered":"2024-03-04T12:20:06.807246+0000","last_clean":"2024-03-04T12:20:06.807246+0000","last_became_active":"2024-03-04T12:20:05.782921+0000","last_became_peered":"2024-03-04T12:20:05.782921+0000","last_unstale":"2024-03-04T12:20:06.807246+0000","last_undegraded":"2024-03-04T12:20:06.807246+0000","last_fullsized":"2024-03-04T12:20:06.807246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:47.241725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-04T12:20:06.779815+0000","last_change":"2024-03-04T12:19:58.807747+0000","last_active":"2024-03-04T12:20:06.779815+0000","last_peered":"2024-03-04T12:20:06.779815+0000","last_clean":"2024-03-04T12:20:06.779815+0000","last_became_active":"2024-03-04T12:19:58.806723+0000","last_became_peered":"2024-03-04T12:19:58.806723+0000","last_unstale":"2024-03-04T12:20:06.779815+0000","last_undegraded":"2024-03-04T12:20:06.779815+0000","last_fullsized":"2024-03-04T12:20:06.779815+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:19:57.750293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:19:57.750293+0000","last_clean_scrub_stamp":"2024-03-04T12:19:57.750293+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:53:17.368805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31360,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340480,"statfs":{"total":96636764160,"available":96604651520,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T12:20:10.054 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-04T12:20:10.054 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-04T12:20:10.054 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-04T12:20:10.055 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-04T12:20:10.384 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:20:10.384 INFO:teuthology.orchestra.run.smithi110.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-04T12:20:10.397 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-04T12:20:10.397 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-03-04T12:20:10.409 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-03-04T12:20:10.409 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p /home/ubuntu/cephtest/ca 2024-03-04T12:20:10.437 DEBUG:teuthology.orchestra.run.smithi110:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-03-04T12:20:11.180 INFO:teuthology.orchestra.run.smithi110.stderr:........+......+......+..+.........................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+..+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+.....+...+.........................+......+..+............+...+..........+.....+........................+.+...+.....+......+.+.........+...+........+...............+...............+....+...+...............+...........+.........+.+............+..+.......+...+...............+............+........+.+......+...............+......+.................+.+..+...+.+......+.....+.............+..+.......+..+...+.......+.....+....+..+.............+......+......+........+......+........................+.+......+........+...................+..+...+...+...............+...+.........+.....................+.+.....+................+...+..+.............+...........+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-03-04T12:20:11.765 INFO:teuthology.orchestra.run.smithi110.stderr:.+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+...+.......+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+......+.....+......+.+..............+.+..+...+....+...+.....................+...........+....+......+......+...+.........+...+.........+.....+.+..+.+..+...............+..................+....+......+......+...........+.......+.....+..........+...+...+......+.....+......+.......+..+......+.............+..+............+.+...........+...+...+............+.+......+.....+...................+.....+....+.....+..............................+.+..+.......+...........+.+..............+.........+......................+......+..+.........................+........+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-03-04T12:20:11.780 INFO:teuthology.orchestra.run.smithi110.stderr:----- 2024-03-04T12:20:11.787 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2024-03-04T12:20:11.868 DEBUG:teuthology.orchestra.run.smithi110:> sudo update-ca-trust 2024-03-04T12:20:12.718 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p /home/ubuntu/cephtest/ca 2024-03-04T12:20:12.745 DEBUG:teuthology.orchestra.run.smithi110:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi110.front.sepia.ceph.com 2024-03-04T12:20:12.909 INFO:teuthology.orchestra.run.smithi110.stderr:.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.....+...+..........+..+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+.+...+............+..+...+.........+...+................+.....+.........+.+..+.......+..+...+......+.+........+.+..+...+.......+..+.......+.....+...+..........+........+.......+..+.+...............+...+..+....+.........+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-03-04T12:20:12.985 INFO:teuthology.orchestra.run.smithi110.stderr:.......+..+.+.....+.........+......+.+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...........+.+...+.........+..+...+..........+..+....+..+...+.+..............+.+......+...+.....+.+.........+.........+..+......+...+......................+..+..........+..+.........+.......+..+.+..+............+......+.+.....+...+..........+..+..........+.....................+...+..............+.+..+...+.+......+............+...+..+............+.+.........+........+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-03-04T12:20:12.988 INFO:teuthology.orchestra.run.smithi110.stderr:----- 2024-03-04T12:20:12.990 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:20:12.990 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-03-04T12:20:13.059 DEBUG:teuthology.orchestra.run.smithi110:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-03-04T12:20:13.148 INFO:teuthology.orchestra.run.smithi110.stderr:Certificate request self-signature ok 2024-03-04T12:20:13.148 INFO:teuthology.orchestra.run.smithi110.stderr:subject=CN = smithi110.front.sepia.ceph.com 2024-03-04T12:20:13.156 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-03-04T12:20:13.183 DEBUG:teuthology.orchestra.run.smithi110:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-03-04T12:20:13.252 INFO:teuthology.orchestra.run.smithi110.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-03-04T12:20:13.253 DEBUG:teuthology.orchestra.run.smithi110:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-03-04T12:20:13.322 INFO:teuthology.run_tasks:Running task rgw... 2024-03-04T12:20:13.339 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-03-04T12:20:13.340 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-03-04T12:20:13.340 INFO:tasks.rgw:Creating data pools 2024-03-04T12:20:13.340 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-03-04T12:20:13.340 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-03-04T12:20:13.802 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'default.rgw.buckets.data' created 2024-03-04T12:20:13.821 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-03-04T12:20:14.808 INFO:teuthology.orchestra.run.smithi110.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-03-04T12:20:14.838 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-03-04T12:20:15.813 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'default.rgw.buckets.index' created 2024-03-04T12:20:15.835 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-03-04T12:20:16.814 INFO:teuthology.orchestra.run.smithi110.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-03-04T12:20:16.844 DEBUG:tasks.rgw:Pools created 2024-03-04T12:20:16.844 INFO:tasks.rgw:Configuring compression type = random 2024-03-04T12:20:16.844 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-03-04T12:20:16.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-03-04T12:20:16.844 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-03-04T12:20:16.959 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:20:16.959 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:20:18.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:18.868+0000 7f91ff665640 0 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55d5d87d9eb0 msgr2=0x55d5d87da2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2024-03-04T12:20:18.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:18.872+0000 7f9203133800 20 rados->read ofs=0 len=0 2024-03-04T12:20:18.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:18.873+0000 7f91fee64640 0 -- 172.21.15.110:0/2112975731 >> [v2:172.21.15.110:6824/3005097257,v1:172.21.15.110:6825/3005097257] conn(0x55d5d87f2400 msgr2=0x55d5d87f4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:20:19.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.074+0000 7f9203133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:20:19.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.074+0000 7f9203133800 20 realm 2024-03-04T12:20:19.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.074+0000 7f9203133800 20 rados->read ofs=0 len=0 2024-03-04T12:20:19.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.074+0000 7f9203133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:20:19.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.075+0000 7f9203133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:20:19.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.075+0000 7f9203133800 20 rados->read ofs=0 len=0 2024-03-04T12:20:19.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.075+0000 7f9203133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:20:19.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.075+0000 7f9203133800 20 rados->read ofs=0 len=0 2024-03-04T12:20:19.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.076+0000 7f9203133800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:20:19.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.076+0000 7f9203133800 20 rados->read ofs=0 len=0 2024-03-04T12:20:19.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.076+0000 7f9203133800 20 rados_obj.operate() r=0 bl.length=875 2024-03-04T12:20:19.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.076+0000 7f9203133800 20 searching for the correct realm 2024-03-04T12:20:19.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.090+0000 7f9203133800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:20:19.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.090+0000 7f9203133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:20:19.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.090+0000 7f9203133800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:20:19.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.090+0000 7f9203133800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:20:19.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.090+0000 7f9203133800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:20:19.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.090+0000 7f9203133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:20:19.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.090+0000 7f9203133800 20 rados->read ofs=0 len=0 2024-03-04T12:20:19.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.091+0000 7f9203133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:20:19.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.091+0000 7f9203133800 20 rados->read ofs=0 len=0 2024-03-04T12:20:19.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.091+0000 7f9203133800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:20:19.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.091+0000 7f9203133800 20 rados->read ofs=0 len=0 2024-03-04T12:20:19.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.091+0000 7f9203133800 20 rados_obj.operate() r=0 bl.length=398 2024-03-04T12:20:19.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.091+0000 7f9203133800 20 zone default found 2024-03-04T12:20:19.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.091+0000 7f9203133800 4 Realm: () 2024-03-04T12:20:19.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.091+0000 7f9203133800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:20:19.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.091+0000 7f9203133800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:20:19.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.091+0000 7f9203133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:20:19.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.091+0000 7f9203133800 20 zonegroup default 2024-03-04T12:20:19.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.091+0000 7f9203133800 20 rados->read ofs=0 len=0 2024-03-04T12:20:19.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.092+0000 7f9203133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:20:19.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:19.092+0000 7f9203133800 20 rados->read ofs=0 len=0 2024-03-04T12:20:20.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:20.840+0000 7f9203133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:20:20.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:20.840+0000 7f9203133800 20 rados->read ofs=0 len=0 2024-03-04T12:20:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:20.842+0000 7f9203133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:20:20.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:20.842+0000 7f9203133800 20 started sync module instance, tier type = 2024-03-04T12:20:20.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:20.842+0000 7f9203133800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:20:22.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.867+0000 7f9203133800 20 add_watcher() i=0 2024-03-04T12:20:22.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.867+0000 7f9203133800 20 add_watcher() i=1 2024-03-04T12:20:22.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.867+0000 7f9203133800 20 add_watcher() i=2 2024-03-04T12:20:22.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.867+0000 7f9203133800 20 add_watcher() i=3 2024-03-04T12:20:22.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.867+0000 7f9203133800 20 add_watcher() i=4 2024-03-04T12:20:22.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.867+0000 7f9203133800 20 add_watcher() i=5 2024-03-04T12:20:22.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.867+0000 7f9203133800 20 add_watcher() i=6 2024-03-04T12:20:22.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.868+0000 7f9203133800 20 add_watcher() i=7 2024-03-04T12:20:22.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.868+0000 7f9203133800 2 all 8 watchers are set, enabling cache 2024-03-04T12:20:22.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.869+0000 7f9203133800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-03-04T12:20:22.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.869+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-03-04T12:20:22.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.869+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.869+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-03-04T12:20:22.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.869+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-03-04T12:20:22.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.869+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.869+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-03-04T12:20:22.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.869+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-03-04T12:20:22.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.869+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.870+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-03-04T12:20:22.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.870+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-03-04T12:20:22.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.870+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.870+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-03-04T12:20:22.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.870+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-03-04T12:20:22.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.870+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.870+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-03-04T12:20:22.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.870+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-03-04T12:20:22.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.870+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.871+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-03-04T12:20:22.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.871+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-03-04T12:20:22.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.871+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.871+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-03-04T12:20:22.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.871+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-03-04T12:20:22.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.871+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.871+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-03-04T12:20:22.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.871+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-03-04T12:20:22.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.871+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.871+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-03-04T12:20:22.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.871+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-03-04T12:20:22.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.871+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.872+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-03-04T12:20:22.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.872+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-03-04T12:20:22.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.872+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.872+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-03-04T12:20:22.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.872+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-03-04T12:20:22.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.872+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.872+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-03-04T12:20:22.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.872+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-03-04T12:20:22.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.872+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.872+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-03-04T12:20:22.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.872+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-03-04T12:20:22.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.872+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.873+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-03-04T12:20:22.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.873+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-03-04T12:20:22.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.873+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.873+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-03-04T12:20:22.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.873+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-03-04T12:20:22.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.873+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.873+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-03-04T12:20:22.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.873+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-03-04T12:20:22.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.873+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.874+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-03-04T12:20:22.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.874+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-03-04T12:20:22.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.874+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.874+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-03-04T12:20:22.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.874+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-03-04T12:20:22.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.874+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.874+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-03-04T12:20:22.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.874+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-03-04T12:20:22.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.874+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.875+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-03-04T12:20:22.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.875+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-03-04T12:20:22.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.875+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.875+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-03-04T12:20:22.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.875+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-03-04T12:20:22.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.875+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.875+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-03-04T12:20:22.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.875+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-03-04T12:20:22.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.875+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.876+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-03-04T12:20:22.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.876+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-03-04T12:20:22.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.876+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.876+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-03-04T12:20:22.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.876+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-03-04T12:20:22.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.876+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.876+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-03-04T12:20:22.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.876+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-03-04T12:20:22.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.876+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.876+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-03-04T12:20:22.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.876+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-03-04T12:20:22.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.876+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.876+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-03-04T12:20:22.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.876+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-03-04T12:20:22.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.876+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.877+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-03-04T12:20:22.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.877+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-03-04T12:20:22.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.877+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.877+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-03-04T12:20:22.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.877+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-03-04T12:20:22.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.877+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.877+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-03-04T12:20:22.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.877+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-03-04T12:20:22.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.877+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.878+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-03-04T12:20:22.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.878+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-03-04T12:20:22.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.878+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.878+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-03-04T12:20:22.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.878+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-03-04T12:20:22.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.878+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.878+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-03-04T12:20:22.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.878+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-03-04T12:20:22.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.878+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.879+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-03-04T12:20:22.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.879+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-03-04T12:20:22.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.879+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.879+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-03-04T12:20:22.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.879+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-03-04T12:20:22.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.879+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.879+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-03-04T12:20:22.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.879+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-03-04T12:20:22.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.879+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.879+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-03-04T12:20:22.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.879+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-03-04T12:20:22.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.879+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.879+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-03-04T12:20:22.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.879+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-03-04T12:20:22.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.879+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.880+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-03-04T12:20:22.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.880+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-03-04T12:20:22.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.880+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.880+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-03-04T12:20:22.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.880+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-03-04T12:20:22.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.880+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.880+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-03-04T12:20:22.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.880+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-03-04T12:20:22.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.880+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.880+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-03-04T12:20:22.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.880+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-03-04T12:20:22.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.880+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.881+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-03-04T12:20:22.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.881+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-03-04T12:20:22.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.881+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.881+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-03-04T12:20:22.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.881+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-03-04T12:20:22.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.881+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.881+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-03-04T12:20:22.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.881+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-03-04T12:20:22.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.881+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.882+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-03-04T12:20:22.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.882+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-03-04T12:20:22.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.882+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.882+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-03-04T12:20:22.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.882+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-03-04T12:20:22.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.882+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.882+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-03-04T12:20:22.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.882+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-03-04T12:20:22.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.882+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.882+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-03-04T12:20:22.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.882+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-03-04T12:20:22.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.882+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.883+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-03-04T12:20:22.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.883+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-03-04T12:20:22.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.883+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.883+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-03-04T12:20:22.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.883+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-03-04T12:20:22.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.883+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.883+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-03-04T12:20:22.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.883+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-03-04T12:20:22.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.883+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.883+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-03-04T12:20:22.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.883+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-03-04T12:20:22.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.883+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.884+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-03-04T12:20:22.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.884+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-03-04T12:20:22.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.884+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.884+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-03-04T12:20:22.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.884+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-03-04T12:20:22.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.884+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.884+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-03-04T12:20:22.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.884+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-03-04T12:20:22.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.884+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.885+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-03-04T12:20:22.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.885+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-03-04T12:20:22.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.885+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.885+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-03-04T12:20:22.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.885+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-03-04T12:20:22.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.885+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.885+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-03-04T12:20:22.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.885+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-03-04T12:20:22.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.885+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.886+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-03-04T12:20:22.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.886+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-03-04T12:20:22.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.886+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.886+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-03-04T12:20:22.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.886+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-03-04T12:20:22.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.886+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.886+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-03-04T12:20:22.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.886+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-03-04T12:20:22.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.886+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.886+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-03-04T12:20:22.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.886+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-03-04T12:20:22.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.886+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.886+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-03-04T12:20:22.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.886+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-03-04T12:20:22.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.886+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.887+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-03-04T12:20:22.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.887+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-03-04T12:20:22.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.887+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.887+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-03-04T12:20:22.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.887+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-03-04T12:20:22.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.887+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.887+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-03-04T12:20:22.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.887+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-03-04T12:20:22.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.887+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.887+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-03-04T12:20:22.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.887+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-03-04T12:20:22.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.887+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.888+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-03-04T12:20:22.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.888+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-03-04T12:20:22.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.888+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.888+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-03-04T12:20:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.888+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-03-04T12:20:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.888+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.888+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-03-04T12:20:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.888+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-03-04T12:20:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.888+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.888+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-03-04T12:20:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.888+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-03-04T12:20:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.888+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.889+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-03-04T12:20:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.889+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-03-04T12:20:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.889+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.889+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-03-04T12:20:22.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.889+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-03-04T12:20:22.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.889+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.889+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-03-04T12:20:22.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.889+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-03-04T12:20:22.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.889+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.889+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-03-04T12:20:22.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.889+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-03-04T12:20:22.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.889+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.890+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-03-04T12:20:22.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.890+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-03-04T12:20:22.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.890+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.890+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-03-04T12:20:22.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.890+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-03-04T12:20:22.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.890+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.890+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-03-04T12:20:22.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.890+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-03-04T12:20:22.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.890+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.890+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-03-04T12:20:22.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.890+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-03-04T12:20:22.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.890+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.891+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-03-04T12:20:22.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.891+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-03-04T12:20:22.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.891+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.891+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-03-04T12:20:22.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.891+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-03-04T12:20:22.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.891+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.892+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-03-04T12:20:22.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.892+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-03-04T12:20:22.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.892+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.892+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-03-04T12:20:22.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.892+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-03-04T12:20:22.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.892+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.892+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-03-04T12:20:22.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.892+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-03-04T12:20:22.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.892+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.893+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-03-04T12:20:22.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.893+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-03-04T12:20:22.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.893+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.893+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-03-04T12:20:22.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.893+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-03-04T12:20:22.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.893+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.893+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-03-04T12:20:22.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.893+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-03-04T12:20:22.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.893+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.893+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-03-04T12:20:22.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.893+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-03-04T12:20:22.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.893+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.894+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-03-04T12:20:22.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.894+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-03-04T12:20:22.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.894+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.894+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-03-04T12:20:22.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.894+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-03-04T12:20:22.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.894+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.894+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-03-04T12:20:22.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.894+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-03-04T12:20:22.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.894+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.894+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-03-04T12:20:22.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.894+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-03-04T12:20:22.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.894+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.895+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-03-04T12:20:22.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.895+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-03-04T12:20:22.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.895+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.895+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-03-04T12:20:22.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.895+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-03-04T12:20:22.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.895+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.895+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-03-04T12:20:22.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.895+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-03-04T12:20:22.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.895+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.896+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-03-04T12:20:22.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.896+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-03-04T12:20:22.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.896+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.896+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-03-04T12:20:22.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.896+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-03-04T12:20:22.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.896+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.896+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-03-04T12:20:22.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.896+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-03-04T12:20:22.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.896+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.897+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-03-04T12:20:22.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.897+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-03-04T12:20:22.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.897+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.897+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-03-04T12:20:22.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.897+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-03-04T12:20:22.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.897+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.897+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-03-04T12:20:22.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.897+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-03-04T12:20:22.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.897+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.898+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-03-04T12:20:22.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.898+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-03-04T12:20:22.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.898+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.898+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-03-04T12:20:22.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.898+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-03-04T12:20:22.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.898+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.898+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-03-04T12:20:22.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.898+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-03-04T12:20:22.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.898+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.898+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-03-04T12:20:22.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.898+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-03-04T12:20:22.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.898+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.899+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-03-04T12:20:22.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.899+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-03-04T12:20:22.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.899+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.899+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-03-04T12:20:22.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.899+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-03-04T12:20:22.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.899+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.899+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-03-04T12:20:22.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.899+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-03-04T12:20:22.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.899+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.899+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-03-04T12:20:22.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.899+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-03-04T12:20:22.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.899+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.900+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-03-04T12:20:22.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.900+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-03-04T12:20:22.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.900+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.900+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-03-04T12:20:22.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.900+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-03-04T12:20:22.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.900+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.900+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-03-04T12:20:22.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.900+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-03-04T12:20:22.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.900+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.900+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-03-04T12:20:22.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.900+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-03-04T12:20:22.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.900+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.901+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-03-04T12:20:22.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.901+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-03-04T12:20:22.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.901+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.901+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-03-04T12:20:22.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.901+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-03-04T12:20:22.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.901+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.901+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-03-04T12:20:22.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.901+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-03-04T12:20:22.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.901+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.901+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-03-04T12:20:22.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.901+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-03-04T12:20:22.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.901+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.901+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-03-04T12:20:22.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.901+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-03-04T12:20:22.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.901+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.902+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-03-04T12:20:22.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.902+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-03-04T12:20:22.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.902+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.902+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-03-04T12:20:22.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.902+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-03-04T12:20:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.902+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.902+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-03-04T12:20:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.902+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-03-04T12:20:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.902+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.903+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-03-04T12:20:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.903+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-03-04T12:20:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.903+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.903+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-03-04T12:20:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.903+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-03-04T12:20:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.903+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.903+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-03-04T12:20:22.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.903+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-03-04T12:20:22.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.903+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.904+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-03-04T12:20:22.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.904+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-03-04T12:20:22.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.904+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.904+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-03-04T12:20:22.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.904+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-03-04T12:20:22.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.904+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.904+0000 7f9203133800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-03-04T12:20:22.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.904+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-03-04T12:20:22.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.906+0000 7f9203133800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-04T12:20:22.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.910+0000 7f90b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:20:22.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.911+0000 7f9203133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:20:22.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:22.911+0000 7f9203133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:20:25.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:25.864+0000 7f9203133800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-03-04T12:20:25.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:25.864+0000 7f9203133800 5 note: GC not initialized 2024-03-04T12:20:25.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:25.865+0000 7f901bfff640 20 reqs_thread_entry: start 2024-03-04T12:20:25.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:25.865+0000 7f9203133800 20 init_complete bucket index max shards: 11 2024-03-04T12:20:25.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:25.865+0000 7f9203133800 20 Filter name: none 2024-03-04T12:20:25.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:25.865+0000 7f9019ffb640 20 reqs_thread_entry: start 2024-03-04T12:20:25.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:25.894+0000 7f90b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:20:25.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:25.897+0000 7f9203133800 20 remove_watcher() i=0 2024-03-04T12:20:25.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:25.897+0000 7f9203133800 2 removed watcher, disabling cache 2024-03-04T12:20:25.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:25.899+0000 7f9203133800 20 remove_watcher() i=1 2024-03-04T12:20:25.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:25.900+0000 7f9203133800 20 remove_watcher() i=2 2024-03-04T12:20:25.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:25.901+0000 7f9203133800 20 remove_watcher() i=3 2024-03-04T12:20:25.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:25.902+0000 7f9203133800 20 remove_watcher() i=4 2024-03-04T12:20:25.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:25.903+0000 7f9203133800 20 remove_watcher() i=5 2024-03-04T12:20:25.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:25.905+0000 7f9203133800 20 remove_watcher() i=6 2024-03-04T12:20:25.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:25.906+0000 7f9203133800 20 remove_watcher() i=7 2024-03-04T12:20:25.998 INFO:teuthology.orchestra.run.smithi110.stdout:[] 2024-03-04T12:20:25.999 DEBUG:tasks.util.rgw: json result: [] 2024-03-04T12:20:25.999 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-03-04T12:20:25.999 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-03-04T12:20:25.999 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-03-04T12:20:26.064 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:20:26.064 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:20:26.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.082+0000 7faa83c11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:20:26.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.082+0000 7faa83c11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:20:26.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.085+0000 7fa8ddffb640 20 reqs_thread_entry: start 2024-03-04T12:20:26.105 INFO:teuthology.orchestra.run.smithi110.stdout:{"id":"82bf9204-52b3-42fc-9db8-0f1135c09e01","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-04T12:20:26.105 DEBUG:tasks.util.rgw: json result: {'id': '82bf9204-52b3-42fc-9db8-0f1135c09e01', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-04T12:20:26.105 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-03-04T12:20:26.106 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p /tmp/rgw_datacache 2024-03-04T12:20:26.133 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a+rwx /tmp/rgw_datacache 2024-03-04T12:20:26.213 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-03-04T12:20:26.213 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-03-04T12:20:26.213 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-03-04T12:20:26.306 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:20:26.306 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:20:26.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.331+0000 7f0f75f4b800 20 rados->read ofs=0 len=0 2024-03-04T12:20:26.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.332+0000 7f0f75f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:20:26.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.332+0000 7f0f75f4b800 20 realm 2024-03-04T12:20:26.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.332+0000 7f0f75f4b800 20 rados->read ofs=0 len=0 2024-03-04T12:20:26.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.332+0000 7f0f75f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:20:26.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.332+0000 7f0f75f4b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:20:26.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.332+0000 7f0f75f4b800 20 rados->read ofs=0 len=0 2024-03-04T12:20:26.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.332+0000 7f0f75f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:20:26.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.332+0000 7f0f75f4b800 20 rados->read ofs=0 len=0 2024-03-04T12:20:26.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.333+0000 7f0f75f4b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:20:26.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.333+0000 7f0f75f4b800 20 rados->read ofs=0 len=0 2024-03-04T12:20:26.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.334+0000 7f0f75f4b800 20 rados_obj.operate() r=0 bl.length=891 2024-03-04T12:20:26.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.334+0000 7f0f75f4b800 20 searching for the correct realm 2024-03-04T12:20:26.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.337+0000 7f0f73246640 0 -- 172.21.15.110:0/3814971748 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x56413d9dba00 msgr2=0x56413d9e0250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:20:26.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.341+0000 7f0f73a47640 0 -- 172.21.15.110:0/3814971748 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f0f680b3b80 msgr2=0x7f0f68003b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:20:26.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.345+0000 7f0f75f4b800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:20:26.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.345+0000 7f0f75f4b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:20:26.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.345+0000 7f0f75f4b800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:20:26.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.345+0000 7f0f75f4b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:20:26.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.345+0000 7f0f75f4b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:20:26.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.345+0000 7f0f75f4b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:20:26.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.345+0000 7f0f75f4b800 20 rados->read ofs=0 len=0 2024-03-04T12:20:26.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.346+0000 7f0f75f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:20:26.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.346+0000 7f0f75f4b800 20 rados->read ofs=0 len=0 2024-03-04T12:20:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.346+0000 7f0f75f4b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:20:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.346+0000 7f0f75f4b800 20 rados->read ofs=0 len=0 2024-03-04T12:20:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.346+0000 7f0f75f4b800 20 rados_obj.operate() r=0 bl.length=398 2024-03-04T12:20:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.346+0000 7f0f75f4b800 20 zone default found 2024-03-04T12:20:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.346+0000 7f0f75f4b800 4 Realm: () 2024-03-04T12:20:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.346+0000 7f0f75f4b800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:20:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.346+0000 7f0f75f4b800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:20:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.346+0000 7f0f75f4b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:20:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.346+0000 7f0f75f4b800 20 zonegroup default 2024-03-04T12:20:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.346+0000 7f0f75f4b800 20 rados->read ofs=0 len=0 2024-03-04T12:20:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.346+0000 7f0f75f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:20:26.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.346+0000 7f0f75f4b800 20 rados->read ofs=0 len=0 2024-03-04T12:20:26.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.347+0000 7f0f75f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:20:26.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.347+0000 7f0f75f4b800 20 rados->read ofs=0 len=0 2024-03-04T12:20:26.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.347+0000 7f0f75f4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:20:26.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.347+0000 7f0f75f4b800 20 started sync module instance, tier type = 2024-03-04T12:20:26.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.347+0000 7f0f75f4b800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:20:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.356+0000 7f0f75f4b800 20 add_watcher() i=0 2024-03-04T12:20:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.356+0000 7f0f75f4b800 20 add_watcher() i=1 2024-03-04T12:20:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.356+0000 7f0f75f4b800 20 add_watcher() i=2 2024-03-04T12:20:26.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.356+0000 7f0f75f4b800 20 add_watcher() i=3 2024-03-04T12:20:26.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.356+0000 7f0f75f4b800 20 add_watcher() i=4 2024-03-04T12:20:26.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.356+0000 7f0f75f4b800 20 add_watcher() i=5 2024-03-04T12:20:26.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.356+0000 7f0f75f4b800 20 add_watcher() i=6 2024-03-04T12:20:26.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.357+0000 7f0f75f4b800 20 add_watcher() i=7 2024-03-04T12:20:26.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.357+0000 7f0f75f4b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:20:26.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.359+0000 7f0e29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:20:26.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.359+0000 7f0f75f4b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:20:26.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.359+0000 7f0f75f4b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:20:26.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.359+0000 7f0f75f4b800 5 note: GC not initialized 2024-03-04T12:20:26.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.359+0000 7f0e28fe1640 20 reqs_thread_entry: start 2024-03-04T12:20:26.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.359+0000 7f0f75f4b800 20 init_complete bucket index max shards: 11 2024-03-04T12:20:26.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.359+0000 7f0f75f4b800 20 Filter name: none 2024-03-04T12:20:26.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.359+0000 7f0da27fc640 20 reqs_thread_entry: start 2024-03-04T12:20:26.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.369+0000 7f0e29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:20:26.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.372+0000 7f0f75f4b800 20 remove_watcher() i=0 2024-03-04T12:20:26.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.372+0000 7f0f75f4b800 2 removed watcher, disabling cache 2024-03-04T12:20:26.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.373+0000 7f0f75f4b800 20 remove_watcher() i=1 2024-03-04T12:20:26.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.374+0000 7f0f75f4b800 20 remove_watcher() i=2 2024-03-04T12:20:26.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.375+0000 7f0f75f4b800 20 remove_watcher() i=3 2024-03-04T12:20:26.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.376+0000 7f0f75f4b800 20 remove_watcher() i=4 2024-03-04T12:20:26.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.377+0000 7f0f75f4b800 20 remove_watcher() i=5 2024-03-04T12:20:26.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.378+0000 7f0f75f4b800 20 remove_watcher() i=6 2024-03-04T12:20:26.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.379+0000 7f0f75f4b800 20 remove_watcher() i=7 2024-03-04T12:20:26.393 INFO:teuthology.orchestra.run.smithi110.stdout:[] 2024-03-04T12:20:26.393 DEBUG:tasks.util.rgw: json result: [] 2024-03-04T12:20:26.394 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-03-04T12:20:26.394 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-03-04T12:20:26.394 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-03-04T12:20:26.394 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-03-04T12:20:26.453 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:20:26.453 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:20:26.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.470+0000 7f5124267800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:20:26.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.470+0000 7f5124267800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:20:26.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.473+0000 7f4f57fff640 20 reqs_thread_entry: start 2024-03-04T12:20:26.492 INFO:teuthology.orchestra.run.smithi110.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-03-04T12:20:26.492 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-03-04T12:20:26.492 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-03-04T12:20:26.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-03-04T12:20:26.493 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-03-04T12:20:26.554 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:20:26.554 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:20:26.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.571+0000 7f5d6d444800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:20:26.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.571+0000 7f5d6d444800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:20:26.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.574+0000 7f5c28ff9640 20 reqs_thread_entry: start 2024-03-04T12:20:26.594 INFO:teuthology.orchestra.run.smithi110.stdout:{"id":"82bf9204-52b3-42fc-9db8-0f1135c09e01","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-04T12:20:26.594 DEBUG:tasks.util.rgw: json result: {'id': '82bf9204-52b3-42fc-9db8-0f1135c09e01', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-04T12:20:26.594 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-03-04T12:20:26.594 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-03-04T12:20:26.595 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-03-04T12:20:26.595 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-03-04T12:20:26.654 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:20:26.654 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:20:26.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.670+0000 7f866874b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:20:26.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.670+0000 7f866874b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:20:26.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.674+0000 7f8528fe1640 20 reqs_thread_entry: start 2024-03-04T12:20:26.692 INFO:teuthology.orchestra.run.smithi110.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-03-04T12:20:26.693 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-03-04T12:20:26.693 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-03-04T12:20:26.693 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-03-04T12:20:26.693 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-03-04T12:20:26.754 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:20:26.754 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:20:26.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.772+0000 7f45f2016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:20:26.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.772+0000 7f45f2016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:20:26.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:20:26.775+0000 7f442b7fe640 20 reqs_thread_entry: start 2024-03-04T12:20:26.794 INFO:teuthology.orchestra.run.smithi110.stdout:{"id":"82bf9204-52b3-42fc-9db8-0f1135c09e01","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-04T12:20:26.794 DEBUG:tasks.util.rgw: json result: {'id': '82bf9204-52b3-42fc-9db8-0f1135c09e01', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-04T12:20:26.795 INFO:tasks.rgw:Starting rgw... 2024-03-04T12:20:26.795 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-03-04T12:20:26.795 INFO:tasks.rgw:Using beast as radosgw frontend 2024-03-04T12:20:26.795 DEBUG:teuthology.orchestra.run.smithi110:> sudo echo -n https://smithi110.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-03-04T12:20:26.836 INFO:teuthology.orchestra.run.smithi110.stdout:https://smithi110.front.sepia.ceph.com:443 2024-03-04T12:20:26.837 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-03-04T12:20:26.917 DEBUG:teuthology.orchestra.run.smithi110:> sudo keytool -import -alias smithi110.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-03-04T12:20:27.124 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: use -cacerts option to access cacerts keystore 2024-03-04T12:20:27.253 INFO:teuthology.orchestra.run.smithi110.stderr:Certificate was added to keystore 2024-03-04T12:20:27.279 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-03-04T12:20:27.279 INFO:tasks.rgw.client.0:Restarting daemon 2024-03-04T12:20:27.279 DEBUG:teuthology.orchestra.run.smithi110:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-03-04T12:20:27.283 INFO:tasks.rgw.client.0:Started 2024-03-04T12:20:27.283 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi110.front.sepia.ceph.com:443/ 2024-03-04T12:20:27.283 DEBUG:teuthology.orchestra.run.smithi110:> curl https://smithi110.front.sepia.ceph.com:443/ 2024-03-04T12:20:27.363 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-04T12:20:27.363 INFO:teuthology.orchestra.run.smithi110.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-04T12:20:27.364 INFO:teuthology.orchestra.run.smithi110.stderr: Dload Upload Total Spent Left Speed 2024-03-04T12:20:27.364 INFO:teuthology.orchestra.run.smithi110.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-04T12:20:27.364 INFO:teuthology.orchestra.run.smithi110.stderr:curl: (7) Failed to connect to smithi110.front.sepia.ceph.com port 443: Connection refused 2024-03-04T12:20:28.365 DEBUG:teuthology.orchestra.run.smithi110:> curl https://smithi110.front.sepia.ceph.com:443/ 2024-03-04T12:20:28.396 INFO:teuthology.orchestra.run.smithi110.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-04T12:20:28.397 INFO:teuthology.orchestra.run.smithi110.stderr: Dload Upload Total Spent Left Speed 2024-03-04T12:20:28.397 INFO:teuthology.orchestra.run.smithi110.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-04T12:20:28.398 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-04T12:20:28.398 INFO:teuthology.orchestra.run.smithi110.stderr:curl: (7) Failed to connect to smithi110.front.sepia.ceph.com port 443: Connection refused 2024-03-04T12:20:30.399 DEBUG:teuthology.orchestra.run.smithi110:> curl https://smithi110.front.sepia.ceph.com:443/ 2024-03-04T12:20:30.431 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-04T12:20:30.432 INFO:teuthology.orchestra.run.smithi110.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-04T12:20:30.432 INFO:teuthology.orchestra.run.smithi110.stderr: Dload Upload Total Spent Left Speed 2024-03-04T12:20:30.432 INFO:teuthology.orchestra.run.smithi110.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-04T12:20:30.432 INFO:teuthology.orchestra.run.smithi110.stderr:curl: (7) Failed to connect to smithi110.front.sepia.ceph.com port 443: Connection refused 2024-03-04T12:20:34.433 DEBUG:teuthology.orchestra.run.smithi110:> curl https://smithi110.front.sepia.ceph.com:443/ 2024-03-04T12:20:34.465 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-04T12:20:34.466 INFO:teuthology.orchestra.run.smithi110.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-04T12:20:34.466 INFO:teuthology.orchestra.run.smithi110.stderr: Dload Upload Total Spent Left Speed 2024-03-04T12:20:34.466 INFO:teuthology.orchestra.run.smithi110.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-04T12:20:34.466 INFO:teuthology.orchestra.run.smithi110.stderr:curl: (7) Failed to connect to smithi110.front.sepia.ceph.com port 443: Connection refused 2024-03-04T12:20:42.467 DEBUG:teuthology.orchestra.run.smithi110:> curl https://smithi110.front.sepia.ceph.com:443/ 2024-03-04T12:20:42.499 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-04T12:20:42.500 INFO:teuthology.orchestra.run.smithi110.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-04T12:20:42.500 INFO:teuthology.orchestra.run.smithi110.stderr: Dload Upload Total Spent Left Speed 2024-03-04T12:20:42.500 INFO:teuthology.orchestra.run.smithi110.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-04T12:20:42.500 INFO:teuthology.orchestra.run.smithi110.stderr:curl: (7) Failed to connect to smithi110.front.sepia.ceph.com port 443: Connection refused 2024-03-04T12:20:49.578 INFO:tasks.rgw.client.0.smithi110.stdout:2024-03-04T12:20:49.272+0000 a03b0c0 -1 ssl_private_key was not found: rgw/cert//default.key 2024-03-04T12:20:58.502 DEBUG:teuthology.orchestra.run.smithi110:> curl https://smithi110.front.sepia.ceph.com:443/ 2024-03-04T12:20:58.539 INFO:teuthology.orchestra.run.smithi110.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-04T12:20:58.539 INFO:teuthology.orchestra.run.smithi110.stderr: Dload Upload Total Spent Left Speed 2024-03-04T12:20:59.507 INFO:teuthology.orchestra.run.smithi110.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 221 0 --:--:-- --:--:-- --:--:-- 220 2024-03-04T12:20:59.509 INFO:teuthology.orchestra.run.smithi110.stdout:anonymous 2024-03-04T12:20:59.509 INFO:teuthology.run_tasks:Running task tox... 2024-03-04T12:20:59.520 INFO:tasks.tox:Deploying tox from pip... 2024-03-04T12:20:59.520 DEBUG:teuthology.orchestra.run.smithi110:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-03-04T12:21:01.898 DEBUG:teuthology.orchestra.run.smithi110:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-03-04T12:21:02.440 INFO:teuthology.orchestra.run.smithi110.stdout:Collecting tox==3.15.0 2024-03-04T12:21:02.531 INFO:teuthology.orchestra.run.smithi110.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-03-04T12:21:02.689 INFO:teuthology.orchestra.run.smithi110.stdout:Collecting pluggy<1,>=0.12.0 2024-03-04T12:21:02.705 INFO:teuthology.orchestra.run.smithi110.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-03-04T12:21:02.794 INFO:teuthology.orchestra.run.smithi110.stdout:Collecting six<2,>=1.14.0 2024-03-04T12:21:02.812 INFO:teuthology.orchestra.run.smithi110.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-04T12:21:02.888 INFO:teuthology.orchestra.run.smithi110.stdout:Collecting toml>=0.9.4 2024-03-04T12:21:02.905 INFO:teuthology.orchestra.run.smithi110.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-03-04T12:21:03.175 INFO:teuthology.orchestra.run.smithi110.stdout:Collecting filelock<4,>=3.0.0 2024-03-04T12:21:03.192 INFO:teuthology.orchestra.run.smithi110.stdout: Downloading filelock-3.13.1-py3-none-any.whl (11 kB) 2024-03-04T12:21:03.298 INFO:teuthology.orchestra.run.smithi110.stdout:Collecting packaging>=14 2024-03-04T12:21:03.315 INFO:teuthology.orchestra.run.smithi110.stdout: Downloading packaging-23.2-py3-none-any.whl (53 kB) 2024-03-04T12:21:03.417 INFO:teuthology.orchestra.run.smithi110.stdout:Collecting py<2,>=1.4.17 2024-03-04T12:21:03.438 INFO:teuthology.orchestra.run.smithi110.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-03-04T12:21:03.735 INFO:teuthology.orchestra.run.smithi110.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-03-04T12:21:03.752 INFO:teuthology.orchestra.run.smithi110.stdout: Downloading virtualenv-20.25.1-py3-none-any.whl (3.8 MB) 2024-03-04T12:21:04.037 INFO:teuthology.orchestra.run.smithi110.stdout:Collecting platformdirs<5,>=3.9.1 2024-03-04T12:21:04.054 INFO:teuthology.orchestra.run.smithi110.stdout: Downloading platformdirs-4.2.0-py3-none-any.whl (17 kB) 2024-03-04T12:21:04.139 INFO:teuthology.orchestra.run.smithi110.stdout:Collecting distlib<1,>=0.3.7 2024-03-04T12:21:04.153 INFO:teuthology.orchestra.run.smithi110.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-03-04T12:21:04.270 INFO:teuthology.orchestra.run.smithi110.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-03-04T12:21:05.100 INFO:teuthology.orchestra.run.smithi110.stdout:Successfully installed distlib-0.3.8 filelock-3.13.1 packaging-23.2 platformdirs-4.2.0 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.25.1 2024-03-04T12:21:05.315 INFO:teuthology.orchestra.run.smithi110.stderr:WARNING: You are using pip version 21.2.3; however, version 24.0 is available. 2024-03-04T12:21:05.315 INFO:teuthology.orchestra.run.smithi110.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-03-04T12:21:05.379 INFO:teuthology.run_tasks:Running task workunit... 2024-03-04T12:21:05.391 INFO:tasks.workunit:Pulling workunits from ref 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:21:05.392 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-04T12:21:05.392 DEBUG:teuthology.orchestra.run.smithi110:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:21:05.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:21:05.421 INFO:teuthology.orchestra.run.smithi110.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-04T12:21:05.421 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:21:05.488 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-04T12:21:05.488 DEBUG:teuthology.orchestra.run.smithi110:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-04T12:21:05.555 INFO:tasks.workunit:timeout=3h 2024-03-04T12:21:05.555 INFO:tasks.workunit:cleanup=True 2024-03-04T12:21:05.556 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/pritha-srivastava/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:21:05.622 INFO:tasks.workunit.client.0.smithi110.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-04T12:21:46.753 INFO:tasks.workunit.client.0.smithi110.stderr:Note: switching to '3aec390336fdfdc8f927818b718cfb0361bd47c8'. 2024-03-04T12:21:46.754 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:21:46.754 INFO:tasks.workunit.client.0.smithi110.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-04T12:21:46.754 INFO:tasks.workunit.client.0.smithi110.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-04T12:21:46.754 INFO:tasks.workunit.client.0.smithi110.stderr:state without impacting any branches by switching back to a branch. 2024-03-04T12:21:46.754 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:21:46.754 INFO:tasks.workunit.client.0.smithi110.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-04T12:21:46.754 INFO:tasks.workunit.client.0.smithi110.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-04T12:21:46.754 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:21:46.754 INFO:tasks.workunit.client.0.smithi110.stderr: git switch -c 2024-03-04T12:21:46.754 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:21:46.755 INFO:tasks.workunit.client.0.smithi110.stderr:Or undo this operation with: 2024-03-04T12:21:46.755 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:21:46.755 INFO:tasks.workunit.client.0.smithi110.stderr: git switch - 2024-03-04T12:21:46.755 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:21:46.755 INFO:tasks.workunit.client.0.smithi110.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-04T12:21:46.755 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:21:46.755 INFO:tasks.workunit.client.0.smithi110.stderr:HEAD is now at 3aec390336f qa/d4n: Start redis up before rgw 2024-03-04T12:21:46.758 DEBUG:teuthology.orchestra.run.smithi110:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-04T12:21:47.001 INFO:tasks.workunit.client.0.smithi110.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-04T12:21:47.003 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:21:47.003 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-04T12:21:47.653 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-04T12:21:47.711 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-04T12:21:47.751 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:21:47.753 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:21:47.753 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-04T12:21:47.792 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:21:47.795 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:21:47.795 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-04T12:21:47.822 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-03-04T12:21:47.823 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-03-04T12:21:47.824 DEBUG:teuthology.orchestra.run.smithi110:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-03-04T12:21:47.894 INFO:tasks.workunit.client.0.smithi110.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-03-04T12:21:47.894 INFO:tasks.workunit.client.0.smithi110.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-04T12:21:47.894 INFO:tasks.workunit.client.0.smithi110.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-04T12:21:50.266 INFO:tasks.workunit.client.0.smithi110.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-03-04T12:21:50.266 INFO:tasks.workunit.client.0.smithi110.stderr:++ deactivate nondestructive 2024-03-04T12:21:50.266 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n '' ']' 2024-03-04T12:21:50.267 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n '' ']' 2024-03-04T12:21:50.267 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-04T12:21:50.267 INFO:tasks.workunit.client.0.smithi110.stderr:++ hash -r 2024-03-04T12:21:50.267 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n '' ']' 2024-03-04T12:21:50.267 INFO:tasks.workunit.client.0.smithi110.stderr:++ unset VIRTUAL_ENV 2024-03-04T12:21:50.267 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-03-04T12:21:50.267 INFO:tasks.workunit.client.0.smithi110.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-04T12:21:50.267 INFO:tasks.workunit.client.0.smithi110.stderr:++ export VIRTUAL_ENV 2024-03-04T12:21:50.267 INFO:tasks.workunit.client.0.smithi110.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-04T12:21:50.268 INFO:tasks.workunit.client.0.smithi110.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-04T12:21:50.268 INFO:tasks.workunit.client.0.smithi110.stderr:++ export PATH 2024-03-04T12:21:50.268 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n '' ']' 2024-03-04T12:21:50.268 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -z '' ']' 2024-03-04T12:21:50.268 INFO:tasks.workunit.client.0.smithi110.stderr:++ _OLD_VIRTUAL_PS1= 2024-03-04T12:21:50.268 INFO:tasks.workunit.client.0.smithi110.stderr:++ PS1='(rgw) ' 2024-03-04T12:21:50.268 INFO:tasks.workunit.client.0.smithi110.stderr:++ export PS1 2024-03-04T12:21:50.268 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-04T12:21:50.268 INFO:tasks.workunit.client.0.smithi110.stderr:++ hash -r 2024-03-04T12:21:50.268 INFO:tasks.workunit.client.0.smithi110.stderr:+ pip install pip --upgrade 2024-03-04T12:21:50.496 INFO:tasks.workunit.client.0.smithi110.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2024-03-04T12:21:50.700 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting pip 2024-03-04T12:21:50.804 INFO:tasks.workunit.client.0.smithi110.stdout: Downloading pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-04T12:21:51.026 INFO:tasks.workunit.client.0.smithi110.stdout:Installing collected packages: pip 2024-03-04T12:21:51.026 INFO:tasks.workunit.client.0.smithi110.stdout: Attempting uninstall: pip 2024-03-04T12:21:51.026 INFO:tasks.workunit.client.0.smithi110.stdout: Found existing installation: pip 21.2.3 2024-03-04T12:21:51.175 INFO:tasks.workunit.client.0.smithi110.stdout: Uninstalling pip-21.2.3: 2024-03-04T12:21:51.181 INFO:tasks.workunit.client.0.smithi110.stdout: Successfully uninstalled pip-21.2.3 2024-03-04T12:21:52.151 INFO:tasks.workunit.client.0.smithi110.stdout:Successfully installed pip-24.0 2024-03-04T12:21:52.454 INFO:tasks.workunit.client.0.smithi110.stderr:+ pip install configobj 2024-03-04T12:21:52.971 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting configobj 2024-03-04T12:21:53.140 INFO:tasks.workunit.client.0.smithi110.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-03-04T12:21:53.295 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting six (from configobj) 2024-03-04T12:21:53.355 INFO:tasks.workunit.client.0.smithi110.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-04T12:21:53.437 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-03-04T12:21:53.571 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-04T12:21:53.643 INFO:tasks.workunit.client.0.smithi110.stdout:Installing collected packages: six, configobj 2024-03-04T12:21:53.780 INFO:tasks.workunit.client.0.smithi110.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-03-04T12:21:53.835 INFO:tasks.workunit.client.0.smithi110.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-03-04T12:21:53.868 INFO:tasks.workunit.client.0.smithi110.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-03-04T12:21:53.868 INFO:tasks.workunit.client.0.smithi110.stderr:DEBUG:root:exec_cmd(pwd) 2024-03-04T12:21:53.869 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:command succeeded 2024-03-04T12:21:53.869 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-03-04T12:21:53.869 INFO:tasks.workunit.client.0.smithi110.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:21:53.869 INFO:tasks.workunit.client.0.smithi110.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-03-04T12:21:53.923 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:command succeeded 2024-03-04T12:21:53.924 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:b'tcp 0 0 0.0.0.0:443 0.0.0.0:* LISTEN 45657/valgrind \ntcp6 0 0 :::443 :::* LISTEN 45657/valgrind \n' 2024-03-04T12:21:53.924 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:radosgw port: 443 2024-03-04T12:21:53.924 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-03-04T12:21:53.924 INFO:tasks.workunit.client.0.smithi110.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-03-04T12:21:53.947 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:command succeeded 2024-03-04T12:21:53.947 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:b'' 2024-03-04T12:21:53.947 INFO:tasks.workunit.client.0.smithi110.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-03-04T12:21:54.102 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:command succeeded 2024-03-04T12:21:54.102 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": []\n}\n\n' 2024-03-04T12:21:54.102 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:Creating s3cmd config... 2024-03-04T12:21:54.102 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:proto for s3cmd config is https 2024-03-04T12:21:54.102 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:s3cmd config written 2024-03-04T12:21:54.102 INFO:tasks.workunit.client.0.smithi110.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-03-04T12:21:54.722 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:command succeeded 2024-03-04T12:21:54.722 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-03-04T12:21:54.722 INFO:tasks.workunit.client.0.smithi110.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-03-04T12:21:57.094 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:command succeeded 2024-03-04T12:21:57.094 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 2.1 seconds, 3.36 MB/s) [1 of 1]\n" 2024-03-04T12:21:57.094 INFO:tasks.workunit.client.0.smithi110.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-03-04T12:21:58.254 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:command succeeded 2024-03-04T12:21:58.254 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.8 seconds, 8.41 MB/s)\n" 2024-03-04T12:21:58.254 INFO:tasks.workunit.client.0.smithi110.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-03-04T12:21:58.372 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:command succeeded 2024-03-04T12:21:58.372 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340032,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "etag": "72b0fead9dea211b8f47af831b4215b3",\n "tag": "82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.6194569032587361964",\n "manifest": {\n "objs": [],\n "obj_size": 7340032,\n "explicit_objs": false,\n "head_size": 4194304,\n "max_head_size": 4194304,\n "prefix": ".T_rWcOsTzhZ41wzMW1NVkjhel4mM_mo_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 4194304,\n "part_size": 0,\n "stripe_max_size": 6291456,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.1",\n "bucket_id": "82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4194304,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.1",\n "bucket_id": "82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": "7M.dat",\n "instance": "",\n "ns": ""\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 4194304,\n "stripe_ofs": 4194304,\n "ofs": 7340032,\n "stripe_size": 3145728,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.1",\n "bucket_id": "82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".T_rWcOsTzhZ41wzMW1NVkjhel4mM_mo_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-03-04T12:21:56.937921Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.6194569032587361964",\n "user.rgw.x-amz-content-sha256": "d0a0f65c22c71e8ad3ec8a743fbdffe7e3e0bbdfb12f90e9092c3e18ebe3aa42",\n "user.rgw.x-amz-date": "20240304T122155Z",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1709554913/ctime:1709554913/gid:1301/gname:ubuntu/md5:72b0fead9dea211b8f47af831b4215b3/mode:33188/mtime:1709554913/uid:1000/uname:ubuntu"\n }\n}\n' 2024-03-04T12:21:58.372 INFO:tasks.workunit.client.0.smithi110.stderr:DEBUG:root:Cached object name is: .T_rWcOsTzhZ41wzMW1NVkjhel4mM_mo_ 2024-03-04T12:21:58.373 INFO:tasks.workunit.client.0.smithi110.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-03-04T12:21:58.380 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:command succeeded 2024-03-04T12:21:58.380 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:b'0\n' 2024-03-04T12:21:58.380 INFO:tasks.workunit.client.0.smithi110.stderr:DEBUG:root:Check cache dir content: 0 2024-03-04T12:21:58.380 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-03-04T12:21:58.380 INFO:tasks.workunit.client.0.smithi110.stderr:INFO:root:Completed Datacache tests 2024-03-04T12:21:58.386 INFO:tasks.workunit.client.0.smithi110.stderr:+ deactivate 2024-03-04T12:21:58.386 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-03-04T12:21:58.386 INFO:tasks.workunit.client.0.smithi110.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-04T12:21:58.386 INFO:tasks.workunit.client.0.smithi110.stderr:+ export PATH 2024-03-04T12:21:58.386 INFO:tasks.workunit.client.0.smithi110.stderr:+ unset _OLD_VIRTUAL_PATH 2024-03-04T12:21:58.386 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' -n '' ']' 2024-03-04T12:21:58.387 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-04T12:21:58.387 INFO:tasks.workunit.client.0.smithi110.stderr:+ hash -r 2024-03-04T12:21:58.387 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' -n '' ']' 2024-03-04T12:21:58.387 INFO:tasks.workunit.client.0.smithi110.stderr:+ unset VIRTUAL_ENV 2024-03-04T12:21:58.387 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' '!' '' = nondestructive ']' 2024-03-04T12:21:58.387 INFO:tasks.workunit.client.0.smithi110.stderr:+ unset -f deactivate 2024-03-04T12:21:58.387 INFO:tasks.workunit.client.0.smithi110.stderr:+ echo OK. 2024-03-04T12:21:58.388 INFO:tasks.workunit.client.0.smithi110.stdout:OK. 2024-03-04T12:21:58.388 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:21:58.388 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:21:58.472 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-03-04T12:21:58.472 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-04T12:21:58.786 DEBUG:teuthology.parallel:result is None 2024-03-04T12:21:58.787 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:21:58.826 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:21:58.827 DEBUG:teuthology.orchestra.run.smithi110:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:21:58.907 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:21:58.907 INFO:teuthology.run_tasks:Running task workunit... 2024-03-04T12:21:58.923 INFO:tasks.workunit:Pulling workunits from ref 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:21:58.923 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-04T12:21:58.924 DEBUG:teuthology.orchestra.run.smithi110:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:21:58.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:21:58.976 INFO:teuthology.orchestra.run.smithi110.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-04T12:21:58.976 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:21:59.044 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-04T12:21:59.044 DEBUG:teuthology.orchestra.run.smithi110:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-04T12:21:59.111 INFO:tasks.workunit:timeout=3h 2024-03-04T12:21:59.111 INFO:tasks.workunit:cleanup=True 2024-03-04T12:21:59.111 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/pritha-srivastava/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:21:59.179 INFO:tasks.workunit.client.0.smithi110.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-04T12:22:40.817 INFO:tasks.workunit.client.0.smithi110.stderr:Note: switching to '3aec390336fdfdc8f927818b718cfb0361bd47c8'. 2024-03-04T12:22:40.818 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:22:40.818 INFO:tasks.workunit.client.0.smithi110.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-04T12:22:40.818 INFO:tasks.workunit.client.0.smithi110.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-04T12:22:40.818 INFO:tasks.workunit.client.0.smithi110.stderr:state without impacting any branches by switching back to a branch. 2024-03-04T12:22:40.818 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:22:40.819 INFO:tasks.workunit.client.0.smithi110.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-04T12:22:40.819 INFO:tasks.workunit.client.0.smithi110.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-04T12:22:40.819 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:22:40.819 INFO:tasks.workunit.client.0.smithi110.stderr: git switch -c 2024-03-04T12:22:40.819 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:22:40.819 INFO:tasks.workunit.client.0.smithi110.stderr:Or undo this operation with: 2024-03-04T12:22:40.819 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:22:40.819 INFO:tasks.workunit.client.0.smithi110.stderr: git switch - 2024-03-04T12:22:40.819 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:22:40.819 INFO:tasks.workunit.client.0.smithi110.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-04T12:22:40.820 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:22:40.820 INFO:tasks.workunit.client.0.smithi110.stderr:HEAD is now at 3aec390336f qa/d4n: Start redis up before rgw 2024-03-04T12:22:40.822 DEBUG:teuthology.orchestra.run.smithi110:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-04T12:22:40.889 INFO:tasks.workunit.client.0.smithi110.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-04T12:22:40.891 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:22:40.891 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-04T12:22:40.941 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-04T12:22:40.990 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-04T12:22:41.030 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:22:41.031 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:22:41.031 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-04T12:22:41.071 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:22:41.074 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:22:41.074 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-04T12:22:41.142 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-03-04T12:22:41.143 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-03-04T12:22:41.143 DEBUG:teuthology.orchestra.run.smithi110:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-03-04T12:22:41.213 INFO:tasks.workunit.client.0.smithi110.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-03-04T12:22:41.214 INFO:tasks.workunit.client.0.smithi110.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-04T12:22:41.214 INFO:tasks.workunit.client.0.smithi110.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-04T12:22:43.513 INFO:tasks.workunit.client.0.smithi110.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-03-04T12:22:43.513 INFO:tasks.workunit.client.0.smithi110.stderr:++ deactivate nondestructive 2024-03-04T12:22:43.513 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n '' ']' 2024-03-04T12:22:43.513 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n '' ']' 2024-03-04T12:22:43.513 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-04T12:22:43.513 INFO:tasks.workunit.client.0.smithi110.stderr:++ hash -r 2024-03-04T12:22:43.513 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n '' ']' 2024-03-04T12:22:43.513 INFO:tasks.workunit.client.0.smithi110.stderr:++ unset VIRTUAL_ENV 2024-03-04T12:22:43.513 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-03-04T12:22:43.513 INFO:tasks.workunit.client.0.smithi110.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-04T12:22:43.515 INFO:tasks.workunit.client.0.smithi110.stderr:++ export VIRTUAL_ENV 2024-03-04T12:22:43.515 INFO:tasks.workunit.client.0.smithi110.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-04T12:22:43.515 INFO:tasks.workunit.client.0.smithi110.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-04T12:22:43.515 INFO:tasks.workunit.client.0.smithi110.stderr:++ export PATH 2024-03-04T12:22:43.515 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n '' ']' 2024-03-04T12:22:43.515 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -z '' ']' 2024-03-04T12:22:43.515 INFO:tasks.workunit.client.0.smithi110.stderr:++ _OLD_VIRTUAL_PS1= 2024-03-04T12:22:43.515 INFO:tasks.workunit.client.0.smithi110.stderr:++ PS1='(rgw) ' 2024-03-04T12:22:43.515 INFO:tasks.workunit.client.0.smithi110.stderr:++ export PS1 2024-03-04T12:22:43.516 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-04T12:22:43.516 INFO:tasks.workunit.client.0.smithi110.stderr:++ hash -r 2024-03-04T12:22:43.516 INFO:tasks.workunit.client.0.smithi110.stderr:+ pip install pip --upgrade 2024-03-04T12:22:43.739 INFO:tasks.workunit.client.0.smithi110.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2024-03-04T12:22:43.949 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting pip 2024-03-04T12:22:43.955 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-04T12:22:44.002 INFO:tasks.workunit.client.0.smithi110.stdout:Installing collected packages: pip 2024-03-04T12:22:44.002 INFO:tasks.workunit.client.0.smithi110.stdout: Attempting uninstall: pip 2024-03-04T12:22:44.002 INFO:tasks.workunit.client.0.smithi110.stdout: Found existing installation: pip 21.2.3 2024-03-04T12:22:44.149 INFO:tasks.workunit.client.0.smithi110.stdout: Uninstalling pip-21.2.3: 2024-03-04T12:22:44.154 INFO:tasks.workunit.client.0.smithi110.stdout: Successfully uninstalled pip-21.2.3 2024-03-04T12:22:45.107 INFO:tasks.workunit.client.0.smithi110.stdout:Successfully installed pip-24.0 2024-03-04T12:22:45.154 INFO:tasks.workunit.client.0.smithi110.stderr:+ pip install boto3 2024-03-04T12:22:46.070 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting boto3 2024-03-04T12:22:46.165 INFO:tasks.workunit.client.0.smithi110.stdout: Downloading boto3-1.34.54-py3-none-any.whl.metadata (6.6 kB) 2024-03-04T12:22:46.872 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting botocore<1.35.0,>=1.34.54 (from boto3) 2024-03-04T12:22:46.903 INFO:tasks.workunit.client.0.smithi110.stdout: Downloading botocore-1.34.54-py3-none-any.whl.metadata (5.7 kB) 2024-03-04T12:22:47.051 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-03-04T12:22:47.068 INFO:tasks.workunit.client.0.smithi110.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-03-04T12:22:47.213 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-03-04T12:22:47.279 INFO:tasks.workunit.client.0.smithi110.stdout: Downloading s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-03-04T12:22:47.416 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:22:47.445 INFO:tasks.workunit.client.0.smithi110.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-03-04T12:22:47.634 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:22:47.658 INFO:tasks.workunit.client.0.smithi110.stdout: Downloading urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-03-04T12:22:47.737 INFO:tasks.workunit.client.0.smithi110.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.9/48.9 kB 542.5 kB/s eta 0:00:00 2024-03-04T12:22:47.965 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:22:47.966 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-04T12:22:48.026 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading boto3-1.34.54-py3-none-any.whl (139 kB) 2024-03-04T12:22:48.155 INFO:tasks.workunit.client.0.smithi110.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 139.3/139.3 kB 1.0 MB/s eta 0:00:00 2024-03-04T12:22:48.173 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading botocore-1.34.54-py3-none-any.whl (12.0 MB) 2024-03-04T12:22:49.165 INFO:tasks.workunit.client.0.smithi110.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.0/12.0 MB 14.7 MB/s eta 0:00:00 2024-03-04T12:22:49.183 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-03-04T12:22:49.248 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-03-04T12:22:49.298 INFO:tasks.workunit.client.0.smithi110.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82.1/82.1 kB 1.5 MB/s eta 0:00:00 2024-03-04T12:22:49.316 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-03-04T12:22:49.374 INFO:tasks.workunit.client.0.smithi110.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 229.9/229.9 kB 3.9 MB/s eta 0:00:00 2024-03-04T12:22:49.393 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-03-04T12:22:49.474 INFO:tasks.workunit.client.0.smithi110.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.8/143.8 kB 1.7 MB/s eta 0:00:00 2024-03-04T12:22:49.475 INFO:tasks.workunit.client.0.smithi110.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-04T12:22:49.575 INFO:tasks.workunit.client.0.smithi110.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-03-04T12:22:50.645 INFO:tasks.workunit.client.0.smithi110.stdout:Successfully installed boto3-1.34.54 botocore-1.34.54 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.0 six-1.16.0 urllib3-1.26.18 2024-03-04T12:22:50.783 INFO:tasks.workunit.client.0.smithi110.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-03-04T12:22:50.918 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-03-04T12:22:50.951 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:22:50.951 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:22:50.984 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:50.978+0000 7f73badaf800 20 rados->read ofs=0 len=0 2024-03-04T12:22:50.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:50.979+0000 7f73badaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:50.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:50.979+0000 7f73badaf800 20 realm 2024-03-04T12:22:50.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:50.979+0000 7f73badaf800 20 rados->read ofs=0 len=0 2024-03-04T12:22:50.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:50.979+0000 7f73badaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:50.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:50.979+0000 7f73badaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:22:50.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:50.979+0000 7f73badaf800 20 rados->read ofs=0 len=0 2024-03-04T12:22:50.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:50.979+0000 7f73badaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:50.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:50.979+0000 7f73badaf800 20 rados->read ofs=0 len=0 2024-03-04T12:22:50.987 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:50.980+0000 7f73badaf800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:50.987 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:50.980+0000 7f73badaf800 20 rados->read ofs=0 len=0 2024-03-04T12:22:50.987 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:50.981+0000 7f73badaf800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:22:50.987 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:50.981+0000 7f73badaf800 20 searching for the correct realm 2024-03-04T12:22:50.990 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:50.984+0000 7f73b90ac640 0 -- 172.21.15.110:0/1817597871 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f73a405da90 msgr2=0x7f73a40620c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:51.195 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.189+0000 7f73b88ab640 0 -- 172.21.15.110:0/1817597871 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f73a40872f0 msgr2=0x7f73a4063600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:51.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.596+0000 7f73badaf800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:22:51.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.596+0000 7f73badaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:22:51.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.596+0000 7f73badaf800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:22:51.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.596+0000 7f73badaf800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:22:51.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.596+0000 7f73badaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:22:51.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.596+0000 7f73badaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:22:51.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.596+0000 7f73badaf800 20 rados->read ofs=0 len=0 2024-03-04T12:22:51.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.596+0000 7f73badaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:51.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.596+0000 7f73badaf800 20 rados->read ofs=0 len=0 2024-03-04T12:22:51.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.597+0000 7f73badaf800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:51.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.597+0000 7f73badaf800 20 rados->read ofs=0 len=0 2024-03-04T12:22:51.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.597+0000 7f73badaf800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:22:51.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.597+0000 7f73badaf800 20 zone default found 2024-03-04T12:22:51.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.597+0000 7f73badaf800 4 Realm: () 2024-03-04T12:22:51.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.597+0000 7f73badaf800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:22:51.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.597+0000 7f73badaf800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:22:51.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.597+0000 7f73badaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:22:51.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.597+0000 7f73badaf800 20 zonegroup default 2024-03-04T12:22:51.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.597+0000 7f73badaf800 20 rados->read ofs=0 len=0 2024-03-04T12:22:51.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.597+0000 7f73badaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:51.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.598+0000 7f73badaf800 20 rados->read ofs=0 len=0 2024-03-04T12:22:51.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.598+0000 7f73badaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:51.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.598+0000 7f73badaf800 20 rados->read ofs=0 len=0 2024-03-04T12:22:51.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.598+0000 7f73badaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:51.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.598+0000 7f73badaf800 20 started sync module instance, tier type = 2024-03-04T12:22:51.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.598+0000 7f73badaf800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:22:51.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.608+0000 7f73badaf800 20 add_watcher() i=0 2024-03-04T12:22:51.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.608+0000 7f73badaf800 20 add_watcher() i=1 2024-03-04T12:22:51.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.608+0000 7f73badaf800 20 add_watcher() i=2 2024-03-04T12:22:51.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.608+0000 7f73badaf800 20 add_watcher() i=3 2024-03-04T12:22:51.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.608+0000 7f73badaf800 20 add_watcher() i=4 2024-03-04T12:22:51.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.608+0000 7f73badaf800 20 add_watcher() i=5 2024-03-04T12:22:51.615 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.608+0000 7f73badaf800 20 add_watcher() i=6 2024-03-04T12:22:51.615 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.609+0000 7f73badaf800 20 add_watcher() i=7 2024-03-04T12:22:51.615 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.609+0000 7f73badaf800 2 all 8 watchers are set, enabling cache 2024-03-04T12:22:51.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.611+0000 7f726f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:51.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.612+0000 7f73badaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:22:51.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.612+0000 7f73badaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:22:51.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.612+0000 7f73badaf800 5 note: GC not initialized 2024-03-04T12:22:51.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.612+0000 7f726e7e4640 20 reqs_thread_entry: start 2024-03-04T12:22:51.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.612+0000 7f73badaf800 20 init_complete bucket index max shards: 11 2024-03-04T12:22:51.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.612+0000 7f73badaf800 20 Filter name: none 2024-03-04T12:22:51.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.612+0000 7f72677fe640 20 reqs_thread_entry: start 2024-03-04T12:22:51.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.612+0000 7f73badaf800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-03-04T12:22:51.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.612+0000 7f73badaf800 20 rados->read ofs=0 len=0 2024-03-04T12:22:51.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.612+0000 7f73badaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:51.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.612+0000 7f73badaf800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-03-04T12:22:51.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.612+0000 7f73badaf800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-03-04T12:22:51.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.612+0000 7f73badaf800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-03-04T12:22:51.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.612+0000 7f73badaf800 20 rados->read ofs=0 len=0 2024-03-04T12:22:51.620 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.613+0000 7f73badaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:51.620 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.613+0000 7f73badaf800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-03-04T12:22:51.620 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.613+0000 7f73badaf800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-03-04T12:22:51.620 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.613+0000 7f73badaf800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-03-04T12:22:51.620 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.613+0000 7f73badaf800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-03-04T12:22:51.620 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.614+0000 7f73badaf800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-03-04T12:22:51.620 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.614+0000 7f73badaf800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-03-04T12:22:51.621 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.614+0000 7f73badaf800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-03-04T12:22:51.621 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.615+0000 7f728ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888065 cookie 94778442657280 notifier 4671 bl.length()=560 2024-03-04T12:22:51.621 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.615+0000 7f728ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-03-04T12:22:51.621 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.615+0000 7f728ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-03-04T12:22:51.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.619+0000 7f73badaf800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-03-04T12:22:51.625 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.619+0000 7f73badaf800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-03-04T12:22:51.625 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.619+0000 7f73badaf800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-03-04T12:22:51.625 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.619+0000 7f728ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888064 cookie 94778442651168 notifier 4671 bl.length()=186 2024-03-04T12:22:51.625 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.619+0000 7f728ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-03-04T12:22:51.625 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.619+0000 7f728ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-03-04T12:22:51.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.621+0000 7f726f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:51.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.624+0000 7f73badaf800 20 remove_watcher() i=0 2024-03-04T12:22:51.630 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.624+0000 7f73badaf800 2 removed watcher, disabling cache 2024-03-04T12:22:51.630 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.625+0000 7f73badaf800 20 remove_watcher() i=1 2024-03-04T12:22:51.631 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.626+0000 7f73badaf800 20 remove_watcher() i=2 2024-03-04T12:22:51.633 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.627+0000 7f73badaf800 20 remove_watcher() i=3 2024-03-04T12:22:51.634 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.628+0000 7f73badaf800 20 remove_watcher() i=4 2024-03-04T12:22:51.635 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.629+0000 7f73badaf800 20 remove_watcher() i=5 2024-03-04T12:22:51.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.630+0000 7f73badaf800 20 remove_watcher() i=6 2024-03-04T12:22:51.637 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:51.631+0000 7f73badaf800 20 remove_watcher() i=7 2024-03-04T12:22:51.835 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:51.835 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:51.884 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:51.884 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:51.950 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:51.951 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:51.995 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:51.995 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:52.071 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:52.071 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:52.097 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:52.097 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:52.125 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:52.126 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:52.147 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:52.147 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:52.229 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:52.229 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:52.326 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:52.326 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:52.356 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:52.356 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:52.403 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:52.403 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:52.425 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:52.425 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:52.498 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:52.499 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:52.520 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:52.520 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:52.565 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:52.565 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:52.586 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: recalculated bucket check stats are correct 2024-03-04T12:22:52.586 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:22:52.587 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-03-04T12:22:52.615 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:22:52.616 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:22:52.648 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.643+0000 7ffbf7b2a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.644+0000 7ffbf7b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:52.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.644+0000 7ffbf7b2a800 20 realm 2024-03-04T12:22:52.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.644+0000 7ffbf7b2a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.644+0000 7ffbf7b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:52.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.644+0000 7ffbf7b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:22:52.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.644+0000 7ffbf7b2a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.644+0000 7ffbf7b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:52.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.644+0000 7ffbf7b2a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.645+0000 7ffbf7b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:52.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.645+0000 7ffbf7b2a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.645+0000 7ffbf7b2a800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:22:52.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.645+0000 7ffbf7b2a800 20 searching for the correct realm 2024-03-04T12:22:52.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.649+0000 7ffbf40c0640 0 -- 172.21.15.110:0/246927019 >> [v2:172.21.15.110:6824/3005097257,v1:172.21.15.110:6825/3005097257] conn(0x55fefa058750 msgr2=0x55fefa05ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:52.658 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.653+0000 7ffbf30be640 0 -- 172.21.15.110:0/246927019 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7ffbe4061070 msgr2=0x7ffbe40d80b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:52.662 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.656+0000 7ffbf7b2a800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:22:52.663 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.656+0000 7ffbf7b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:22:52.663 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.656+0000 7ffbf7b2a800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:22:52.663 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.656+0000 7ffbf7b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:22:52.663 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.656+0000 7ffbf7b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:22:52.663 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.656+0000 7ffbf7b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:22:52.663 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.656+0000 7ffbf7b2a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.663 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.657+0000 7ffbf7b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:52.663 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.657+0000 7ffbf7b2a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.657+0000 7ffbf7b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:52.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.657+0000 7ffbf7b2a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.657+0000 7ffbf7b2a800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:22:52.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.657+0000 7ffbf7b2a800 20 zone default found 2024-03-04T12:22:52.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.657+0000 7ffbf7b2a800 4 Realm: () 2024-03-04T12:22:52.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.657+0000 7ffbf7b2a800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:22:52.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.657+0000 7ffbf7b2a800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:22:52.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.657+0000 7ffbf7b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:22:52.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.657+0000 7ffbf7b2a800 20 zonegroup default 2024-03-04T12:22:52.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.657+0000 7ffbf7b2a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.658+0000 7ffbf7b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:52.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.658+0000 7ffbf7b2a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.658+0000 7ffbf7b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:52.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.658+0000 7ffbf7b2a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.666 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.658+0000 7ffbf7b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:52.666 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.658+0000 7ffbf7b2a800 20 started sync module instance, tier type = 2024-03-04T12:22:52.666 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.658+0000 7ffbf7b2a800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:22:52.676 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.670+0000 7ffbf7b2a800 20 add_watcher() i=0 2024-03-04T12:22:52.676 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.670+0000 7ffbf7b2a800 20 add_watcher() i=1 2024-03-04T12:22:52.676 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.670+0000 7ffbf7b2a800 20 add_watcher() i=2 2024-03-04T12:22:52.676 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.670+0000 7ffbf7b2a800 20 add_watcher() i=3 2024-03-04T12:22:52.676 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.670+0000 7ffbf7b2a800 20 add_watcher() i=4 2024-03-04T12:22:52.677 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.670+0000 7ffbf7b2a800 20 add_watcher() i=5 2024-03-04T12:22:52.677 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.670+0000 7ffbf7b2a800 20 add_watcher() i=6 2024-03-04T12:22:52.677 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.671+0000 7ffbf7b2a800 20 add_watcher() i=7 2024-03-04T12:22:52.677 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.671+0000 7ffbf7b2a800 2 all 8 watchers are set, enabling cache 2024-03-04T12:22:52.679 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.673+0000 7ffaa9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:52.680 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.673+0000 7ffbf7b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:22:52.680 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.673+0000 7ffbf7b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:22:52.680 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.674+0000 7ffbf7b2a800 5 note: GC not initialized 2024-03-04T12:22:52.680 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.674+0000 7ffaa8fe1640 20 reqs_thread_entry: start 2024-03-04T12:22:52.680 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.674+0000 7ffbf7b2a800 20 init_complete bucket index max shards: 11 2024-03-04T12:22:52.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.674+0000 7ffbf7b2a800 20 Filter name: none 2024-03-04T12:22:52.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.674+0000 7ffa227fc640 20 reqs_thread_entry: start 2024-03-04T12:22:52.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.674+0000 7ffbf7b2a800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:22:52.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.674+0000 7ffbf7b2a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.674+0000 7ffbf7b2a800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:22:52.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.674+0000 7ffbf7b2a800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:22:52.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.674+0000 7ffbf7b2a800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:22:52.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.674+0000 7ffbf7b2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 : miss 2024-03-04T12:22:52.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.674+0000 7ffbf7b2a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.675+0000 7ffbf7b2a800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:22:52.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.675+0000 7ffbf7b2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 info.flags=0x17 2024-03-04T12:22:52.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.675+0000 7ffbf7b2a800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 to cache LRU end 2024-03-04T12:22:52.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.675+0000 7ffbf7b2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:22:52.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.675+0000 7ffbf7b2a800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:22:52.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.675+0000 7ffbf7b2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 2024-03-04T12:22:52.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.675+0000 7ffbf7b2a800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:22:52.683 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.675+0000 7ffbf7b2a800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:22:52.683 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.676+0000 7ffbf7b2a800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:22:52.683 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.676+0000 7ffbf7b2a800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:22:52.683 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.676+0000 7ffbf7b2a800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:22:52.683 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.676+0000 7ffbf7b2a800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:22:52.688 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.682+0000 7ffaa9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:52.691 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.685+0000 7ffbf7b2a800 20 remove_watcher() i=0 2024-03-04T12:22:52.691 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.685+0000 7ffbf7b2a800 2 removed watcher, disabling cache 2024-03-04T12:22:52.692 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.686+0000 7ffbf7b2a800 20 remove_watcher() i=1 2024-03-04T12:22:52.693 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.687+0000 7ffbf7b2a800 20 remove_watcher() i=2 2024-03-04T12:22:52.695 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.689+0000 7ffbf7b2a800 20 remove_watcher() i=3 2024-03-04T12:22:52.696 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.690+0000 7ffbf7b2a800 20 remove_watcher() i=4 2024-03-04T12:22:52.697 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.691+0000 7ffbf7b2a800 20 remove_watcher() i=5 2024-03-04T12:22:52.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.692+0000 7ffbf7b2a800 20 remove_watcher() i=6 2024-03-04T12:22:52.699 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.693+0000 7ffbf7b2a800 20 remove_watcher() i=7 2024-03-04T12:22:52.710 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-03-04T12:22:52.737 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:22:52.737 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:22:52.770 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.764+0000 7fc0e5644800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.766+0000 7fc0e5644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:52.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.766+0000 7fc0e5644800 20 realm 2024-03-04T12:22:52.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.766+0000 7fc0e5644800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.766+0000 7fc0e5644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:52.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.766+0000 7fc0e5644800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:22:52.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.766+0000 7fc0e5644800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.766+0000 7fc0e5644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:52.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.766+0000 7fc0e5644800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.767+0000 7fc0e5644800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:52.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.767+0000 7fc0e5644800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.768+0000 7fc0e5644800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:22:52.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.768+0000 7fc0e5644800 20 searching for the correct realm 2024-03-04T12:22:52.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.769+0000 7fc0e3140640 0 -- 172.21.15.110:0/2204091913 >> [v2:172.21.15.110:6800/2482344533,v1:172.21.15.110:6801/2482344533] conn(0x7fc0dc017020 msgr2=0x7fc0dc025920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:52.980 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.974+0000 7fc0e3941640 0 -- 172.21.15.110:0/2204091913 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7fc0cc03a070 msgr2=0x7fc0cc0620c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:52.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.980+0000 7fc0e5644800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:22:52.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.980+0000 7fc0e5644800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:22:52.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.980+0000 7fc0e5644800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:22:52.987 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.980+0000 7fc0e5644800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:22:52.987 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.980+0000 7fc0e5644800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:22:52.987 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.980+0000 7fc0e5644800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:22:52.987 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.980+0000 7fc0e5644800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.987 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.981+0000 7fc0e5644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:52.987 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.981+0000 7fc0e5644800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.988 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.981+0000 7fc0e5644800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:52.988 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.981+0000 7fc0e5644800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.988 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.981+0000 7fc0e5644800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:22:52.988 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.981+0000 7fc0e5644800 20 zone default found 2024-03-04T12:22:52.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.981+0000 7fc0e5644800 4 Realm: () 2024-03-04T12:22:52.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.981+0000 7fc0e5644800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:22:52.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.981+0000 7fc0e5644800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:22:52.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.981+0000 7fc0e5644800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:22:52.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.981+0000 7fc0e5644800 20 zonegroup default 2024-03-04T12:22:52.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.981+0000 7fc0e5644800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.981+0000 7fc0e5644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:52.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.981+0000 7fc0e5644800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.982+0000 7fc0e5644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:52.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.982+0000 7fc0e5644800 20 rados->read ofs=0 len=0 2024-03-04T12:22:52.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.982+0000 7fc0e5644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:52.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.982+0000 7fc0e5644800 20 started sync module instance, tier type = 2024-03-04T12:22:52.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.982+0000 7fc0e5644800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:22:53.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.994+0000 7fc0e5644800 20 add_watcher() i=0 2024-03-04T12:22:53.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.994+0000 7fc0e5644800 20 add_watcher() i=1 2024-03-04T12:22:53.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.994+0000 7fc0e5644800 20 add_watcher() i=2 2024-03-04T12:22:53.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.994+0000 7fc0e5644800 20 add_watcher() i=3 2024-03-04T12:22:53.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.994+0000 7fc0e5644800 20 add_watcher() i=4 2024-03-04T12:22:53.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.994+0000 7fc0e5644800 20 add_watcher() i=5 2024-03-04T12:22:53.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.994+0000 7fc0e5644800 20 add_watcher() i=6 2024-03-04T12:22:53.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.995+0000 7fc0e5644800 20 add_watcher() i=7 2024-03-04T12:22:53.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:52.995+0000 7fc0e5644800 2 all 8 watchers are set, enabling cache 2024-03-04T12:22:53.006 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.000+0000 7fbf99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:53.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.000+0000 7fc0e5644800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:22:53.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.000+0000 7fc0e5644800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:22:53.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.000+0000 7fc0e5644800 5 note: GC not initialized 2024-03-04T12:22:53.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.001+0000 7fbf98fe1640 20 reqs_thread_entry: start 2024-03-04T12:22:53.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.001+0000 7fc0e5644800 20 init_complete bucket index max shards: 11 2024-03-04T12:22:53.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.001+0000 7fc0e5644800 20 Filter name: none 2024-03-04T12:22:53.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.001+0000 7fbf127fc640 20 reqs_thread_entry: start 2024-03-04T12:22:53.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.001+0000 7fc0e5644800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.001+0000 7fc0e5644800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:22:53.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.001+0000 7fc0e5644800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.002+0000 7fc0e5644800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:22:53.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.002+0000 7fc0e5644800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:22:53.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.002+0000 7fc0e5644800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.002+0000 7fc0e5644800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:22:53.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.002+0000 7fc0e5644800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.002+0000 7fc0e5644800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:22:53.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.002+0000 7fc0e5644800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:22:53.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.003+0000 7fc0e5644800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.010 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.004+0000 7fc0e5644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:53.010 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.004+0000 7fbf99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:53.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.007+0000 7fc0e5644800 20 remove_watcher() i=0 2024-03-04T12:22:53.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.007+0000 7fc0e5644800 2 removed watcher, disabling cache 2024-03-04T12:22:53.014 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.008+0000 7fc0e5644800 20 remove_watcher() i=1 2024-03-04T12:22:53.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.009+0000 7fc0e5644800 20 remove_watcher() i=2 2024-03-04T12:22:53.016 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.010+0000 7fc0e5644800 20 remove_watcher() i=3 2024-03-04T12:22:53.017 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.011+0000 7fc0e5644800 20 remove_watcher() i=4 2024-03-04T12:22:53.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.012+0000 7fc0e5644800 20 remove_watcher() i=5 2024-03-04T12:22:53.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.013+0000 7fc0e5644800 20 remove_watcher() i=6 2024-03-04T12:22:53.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.014+0000 7fc0e5644800 20 remove_watcher() i=7 2024-03-04T12:22:53.029 INFO:tasks.workunit.client.0.smithi110.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 96, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-03-04T12:22:53.029 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: bucket check unlinked does not report normal entries 2024-03-04T12:22:53.030 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:22:53.031 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-03-04T12:22:53.062 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:22:53.063 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:22:53.097 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.091+0000 7f4017ac0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.093+0000 7f4017ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:53.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.093+0000 7f4017ac0800 20 realm 2024-03-04T12:22:53.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.093+0000 7f4017ac0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.093+0000 7f4017ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:53.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.093+0000 7f4017ac0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:22:53.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.093+0000 7f4017ac0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.093+0000 7f4017ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:53.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.093+0000 7f4017ac0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.094+0000 7f4017ac0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:53.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.094+0000 7f4017ac0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.094+0000 7f4017ac0800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:22:53.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.094+0000 7f4017ac0800 20 searching for the correct realm 2024-03-04T12:22:53.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.095+0000 7f4015dbd640 0 -- 172.21.15.110:0/1562988306 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f400c025030 msgr2=0x7f400c054940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:53.306 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.300+0000 7f4015dbd640 0 -- 172.21.15.110:0/1562988306 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7f400c0827c0 msgr2=0x7f400c0821e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:22:53.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.509+0000 7f4017ac0800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:22:53.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.509+0000 7f4017ac0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:22:53.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.509+0000 7f4017ac0800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:22:53.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.509+0000 7f4017ac0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:22:53.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.509+0000 7f4017ac0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:22:53.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.509+0000 7f4017ac0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:22:53.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.509+0000 7f4017ac0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.509+0000 7f4017ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:53.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.509+0000 7f4017ac0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.509+0000 7f4017ac0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:53.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.509+0000 7f4017ac0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.510+0000 7f4017ac0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:22:53.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.510+0000 7f4017ac0800 20 zone default found 2024-03-04T12:22:53.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.510+0000 7f4017ac0800 4 Realm: () 2024-03-04T12:22:53.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.510+0000 7f4017ac0800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:22:53.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.510+0000 7f4017ac0800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:22:53.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.510+0000 7f4017ac0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:22:53.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.510+0000 7f4017ac0800 20 zonegroup default 2024-03-04T12:22:53.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.510+0000 7f4017ac0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.510+0000 7f4017ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:53.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.510+0000 7f4017ac0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.510+0000 7f4017ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:53.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.510+0000 7f4017ac0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.511+0000 7f4017ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:53.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.511+0000 7f4017ac0800 20 started sync module instance, tier type = 2024-03-04T12:22:53.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.511+0000 7f4017ac0800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:22:53.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.523+0000 7f4017ac0800 20 add_watcher() i=0 2024-03-04T12:22:53.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.523+0000 7f4017ac0800 20 add_watcher() i=1 2024-03-04T12:22:53.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.523+0000 7f4017ac0800 20 add_watcher() i=2 2024-03-04T12:22:53.530 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.523+0000 7f4017ac0800 20 add_watcher() i=3 2024-03-04T12:22:53.530 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.523+0000 7f4017ac0800 20 add_watcher() i=4 2024-03-04T12:22:53.530 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.523+0000 7f4017ac0800 20 add_watcher() i=5 2024-03-04T12:22:53.530 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.523+0000 7f4017ac0800 20 add_watcher() i=6 2024-03-04T12:22:53.530 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.524+0000 7f4017ac0800 20 add_watcher() i=7 2024-03-04T12:22:53.530 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.524+0000 7f4017ac0800 2 all 8 watchers are set, enabling cache 2024-03-04T12:22:53.532 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.526+0000 7f3ec77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:53.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.527+0000 7f4017ac0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:22:53.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.527+0000 7f4017ac0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:22:53.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.527+0000 7f4017ac0800 5 note: GC not initialized 2024-03-04T12:22:53.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.527+0000 7f3ec67e4640 20 reqs_thread_entry: start 2024-03-04T12:22:53.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.527+0000 7f4017ac0800 20 init_complete bucket index max shards: 11 2024-03-04T12:22:53.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.527+0000 7f4017ac0800 20 Filter name: none 2024-03-04T12:22:53.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.527+0000 7f3e37fff640 20 reqs_thread_entry: start 2024-03-04T12:22:53.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.527+0000 7f4017ac0800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:22:53.534 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.527+0000 7f4017ac0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.534 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.528+0000 7f4017ac0800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:22:53.534 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.528+0000 7f4017ac0800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:22:53.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.528+0000 7f4017ac0800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:22:53.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.528+0000 7f4017ac0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 : miss 2024-03-04T12:22:53.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.528+0000 7f4017ac0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:53.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.528+0000 7f4017ac0800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:22:53.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.528+0000 7f4017ac0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 info.flags=0x17 2024-03-04T12:22:53.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.528+0000 7f4017ac0800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 to cache LRU end 2024-03-04T12:22:53.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.528+0000 7f4017ac0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:22:53.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.528+0000 7f4017ac0800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:22:53.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.528+0000 7f4017ac0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 2024-03-04T12:22:53.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.528+0000 7f4017ac0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:22:53.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.528+0000 7f4017ac0800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-04T12:22:53.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.528+0000 7f4017ac0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:22:53.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.529+0000 7f4017ac0800 1 NOTICE: finished shard 1 (0 entries found) 2024-03-04T12:22:53.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.529+0000 7f4017ac0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:22:53.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.530+0000 7f4017ac0800 1 NOTICE: finished shard 2 (0 entries found) 2024-03-04T12:22:53.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.530+0000 7f4017ac0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:22:53.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.530+0000 7f4017ac0800 1 NOTICE: finished shard 3 (0 entries found) 2024-03-04T12:22:53.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.530+0000 7f4017ac0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:22:53.537 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.531+0000 7f4017ac0800 1 NOTICE: finished shard 4 (0 entries found) 2024-03-04T12:22:53.537 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.531+0000 7f4017ac0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:53.537 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.531+0000 7f4017ac0800 1 NOTICE: finished shard 5 (0 entries found) 2024-03-04T12:22:53.537 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.531+0000 7f4017ac0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:22:53.537 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.531+0000 7f4017ac0800 1 NOTICE: finished shard 6 (0 entries found) 2024-03-04T12:22:53.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.531+0000 7f4017ac0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:22:53.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.532+0000 7f4017ac0800 1 NOTICE: finished shard 7 (0 entries found) 2024-03-04T12:22:53.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.532+0000 7f4017ac0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:53.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.532+0000 7f4017ac0800 1 NOTICE: finished shard 8 (0 entries found) 2024-03-04T12:22:53.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.532+0000 7f4017ac0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:22:53.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.532+0000 7f4017ac0800 1 NOTICE: finished shard 9 (0 entries found) 2024-03-04T12:22:53.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.532+0000 7f4017ac0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:22:53.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.533+0000 7f4017ac0800 1 NOTICE: finished shard 10 (0 entries found) 2024-03-04T12:22:53.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.533+0000 7f4017ac0800 1 NOTICE: finished all shards (0 entries found) 2024-03-04T12:22:53.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.534+0000 7f3ec77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:53.542 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.536+0000 7f4017ac0800 20 remove_watcher() i=0 2024-03-04T12:22:53.542 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.536+0000 7f4017ac0800 2 removed watcher, disabling cache 2024-03-04T12:22:53.543 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.538+0000 7f4017ac0800 20 remove_watcher() i=1 2024-03-04T12:22:53.545 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.539+0000 7f4017ac0800 20 remove_watcher() i=2 2024-03-04T12:22:53.546 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.540+0000 7f4017ac0800 20 remove_watcher() i=3 2024-03-04T12:22:53.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.541+0000 7f4017ac0800 20 remove_watcher() i=4 2024-03-04T12:22:53.548 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.542+0000 7f4017ac0800 20 remove_watcher() i=5 2024-03-04T12:22:53.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.543+0000 7f4017ac0800 20 remove_watcher() i=6 2024-03-04T12:22:53.550 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:53.544+0000 7f4017ac0800 20 remove_watcher() i=7 2024-03-04T12:22:53.561 INFO:tasks.workunit.client.0.smithi110.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-03-04T12:22:53.953 INFO:tasks.workunit.client.0.smithi110.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-03-04T12:22:55.337 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:55.337 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:55.451 INFO:tasks.workunit.client.0.smithi110.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:22:55.452 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-04T12:22:55.484 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:22:55.484 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:22:55.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.511+0000 7f3d3c533800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.513+0000 7f3d3c533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:55.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.513+0000 7f3d3c533800 20 realm 2024-03-04T12:22:55.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.513+0000 7f3d3c533800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.513+0000 7f3d3c533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:55.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.513+0000 7f3d3c533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:22:55.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.513+0000 7f3d3c533800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.513+0000 7f3d3c533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:55.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.513+0000 7f3d3c533800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.514+0000 7f3d3c533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:55.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.514+0000 7f3d3c533800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.514+0000 7f3d3c533800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:22:55.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.514+0000 7f3d3c533800 20 searching for the correct realm 2024-03-04T12:22:55.524 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.519+0000 7f3d2f9d2640 0 -- 172.21.15.110:0/3804620549 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f3d28044b60 msgr2=0x7f3d2803c480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:55.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.522+0000 7f3d389d4640 0 -- 172.21.15.110:0/3804620549 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7f3d20011c20 msgr2=0x7f3d200930d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:22:55.532 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:22:55.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:22:55.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:22:55.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:22:55.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:22:55.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:22:55.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:55.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:55.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:22:55.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 20 zone default found 2024-03-04T12:22:55.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 4 Realm: () 2024-03-04T12:22:55.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:22:55.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:22:55.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:22:55.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 20 zonegroup default 2024-03-04T12:22:55.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.527+0000 7f3d3c533800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.528+0000 7f3d3c533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:55.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.528+0000 7f3d3c533800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.528+0000 7f3d3c533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:55.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.528+0000 7f3d3c533800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.528+0000 7f3d3c533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:55.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.528+0000 7f3d3c533800 20 started sync module instance, tier type = 2024-03-04T12:22:55.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.528+0000 7f3d3c533800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:22:55.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.538+0000 7f3d3c533800 20 add_watcher() i=0 2024-03-04T12:22:55.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.538+0000 7f3d3c533800 20 add_watcher() i=1 2024-03-04T12:22:55.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.538+0000 7f3d3c533800 20 add_watcher() i=2 2024-03-04T12:22:55.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.538+0000 7f3d3c533800 20 add_watcher() i=3 2024-03-04T12:22:55.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.538+0000 7f3d3c533800 20 add_watcher() i=4 2024-03-04T12:22:55.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.538+0000 7f3d3c533800 20 add_watcher() i=5 2024-03-04T12:22:55.545 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.538+0000 7f3d3c533800 20 add_watcher() i=6 2024-03-04T12:22:55.545 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.539+0000 7f3d3c533800 20 add_watcher() i=7 2024-03-04T12:22:55.545 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.539+0000 7f3d3c533800 2 all 8 watchers are set, enabling cache 2024-03-04T12:22:55.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.541+0000 7f3beefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:55.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.541+0000 7f3d3c533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:22:55.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.541+0000 7f3d3c533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:22:55.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.541+0000 7f3d3c533800 5 note: GC not initialized 2024-03-04T12:22:55.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.541+0000 7f3bedfdb640 20 reqs_thread_entry: start 2024-03-04T12:22:55.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.541+0000 7f3d3c533800 20 init_complete bucket index max shards: 11 2024-03-04T12:22:55.548 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.541+0000 7f3d3c533800 20 Filter name: none 2024-03-04T12:22:55.548 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.541+0000 7f3b5f7fe640 20 reqs_thread_entry: start 2024-03-04T12:22:55.548 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.541+0000 7f3d3c533800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.542+0000 7f3d3c533800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:22:55.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.542+0000 7f3d3c533800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.542+0000 7f3d3c533800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:22:55.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.542+0000 7f3d3c533800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:22:55.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.542+0000 7f3d3c533800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:22:55.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.542+0000 7f3d3c533800 20 INFO: main: starting shard=0 2024-03-04T12:22:55.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.542+0000 7f3d3c533800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:22:55.550 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.543+0000 7f3d3c533800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.550 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.543+0000 7f3d3c533800 20 INFO: main: starting shard=1 2024-03-04T12:22:55.550 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.543+0000 7f3d3c533800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:22:55.550 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.543+0000 7f3d3c533800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.550 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.543+0000 7f3d3c533800 20 INFO: main: starting shard=2 2024-03-04T12:22:55.550 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.543+0000 7f3d3c533800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:22:55.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.544+0000 7f3d3c533800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.544+0000 7f3d3c533800 20 INFO: main: starting shard=3 2024-03-04T12:22:55.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.544+0000 7f3d3c533800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:22:55.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.544+0000 7f3d3c533800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.544+0000 7f3d3c533800 20 INFO: main: starting shard=4 2024-03-04T12:22:55.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.544+0000 7f3d3c533800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:22:55.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.545+0000 7f3d3c533800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.545+0000 7f3d3c533800 20 INFO: main: starting shard=5 2024-03-04T12:22:55.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.545+0000 7f3d3c533800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:55.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.545+0000 7f3d3c533800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.545+0000 7f3d3c533800 20 INFO: main: starting shard=6 2024-03-04T12:22:55.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.545+0000 7f3d3c533800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:22:55.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.546+0000 7f3d3c533800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.546+0000 7f3d3c533800 20 INFO: main: starting shard=7 2024-03-04T12:22:55.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.546+0000 7f3d3c533800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:22:55.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.546+0000 7f3d3c533800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.546+0000 7f3d3c533800 20 INFO: main: starting shard=8 2024-03-04T12:22:55.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.546+0000 7f3d3c533800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:55.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.546+0000 7f3d3c533800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-04T12:22:55.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.547+0000 7f3d3c533800 20 INFO: main: starting shard=9 2024-03-04T12:22:55.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.547+0000 7f3d3c533800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:22:55.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.547+0000 7f3d3c533800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.547+0000 7f3d3c533800 20 INFO: main: starting shard=10 2024-03-04T12:22:55.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.547+0000 7f3d3c533800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:22:55.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.548+0000 7f3d3c533800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.548+0000 7f3d3c533800 20 INFO: main: done 2024-03-04T12:22:55.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.548+0000 7f3beefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:55.557 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.551+0000 7f3d3c533800 20 remove_watcher() i=0 2024-03-04T12:22:55.557 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.551+0000 7f3d3c533800 2 removed watcher, disabling cache 2024-03-04T12:22:55.558 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.552+0000 7f3d3c533800 20 remove_watcher() i=1 2024-03-04T12:22:55.559 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.553+0000 7f3d3c533800 20 remove_watcher() i=2 2024-03-04T12:22:55.560 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.554+0000 7f3d3c533800 20 remove_watcher() i=3 2024-03-04T12:22:55.561 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.555+0000 7f3d3c533800 20 remove_watcher() i=4 2024-03-04T12:22:55.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.556+0000 7f3d3c533800 20 remove_watcher() i=5 2024-03-04T12:22:55.563 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.557+0000 7f3d3c533800 20 remove_watcher() i=6 2024-03-04T12:22:55.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.558+0000 7f3d3c533800 20 remove_watcher() i=7 2024-03-04T12:22:55.576 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:55.576 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:55.597 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:55.597 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:55.672 INFO:tasks.workunit.client.0.smithi110.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:22:55.673 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-04T12:22:55.703 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:22:55.703 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:22:55.759 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.753+0000 7ffb1bc8a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.755+0000 7ffb1bc8a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:55.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.755+0000 7ffb1bc8a800 20 realm 2024-03-04T12:22:55.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.755+0000 7ffb1bc8a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.755+0000 7ffb1bc8a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:55.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.755+0000 7ffb1bc8a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:22:55.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.755+0000 7ffb1bc8a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.762 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.755+0000 7ffb1bc8a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:55.762 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.755+0000 7ffb1bc8a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.762 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.756+0000 7ffb1bc8a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:55.762 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.756+0000 7ffb1bc8a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.762 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.757+0000 7ffb1bc8a800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:22:55.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.757+0000 7ffb1bc8a800 20 searching for the correct realm 2024-03-04T12:22:55.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.760+0000 7ffb18f85640 0 -- 172.21.15.110:0/1054523138 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7ffb0c02f070 msgr2=0x7ffb0c03ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:55.770 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.764+0000 7ffb19f87640 0 -- 172.21.15.110:0/1054523138 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7ffb0400b040 msgr2=0x7ffb04068290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:55.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:22:55.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:22:55.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:22:55.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:22:55.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:22:55.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:22:55.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:55.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:55.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:22:55.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 20 zone default found 2024-03-04T12:22:55.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 4 Realm: () 2024-03-04T12:22:55.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:22:55.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:22:55.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:22:55.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.768+0000 7ffb1bc8a800 20 zonegroup default 2024-03-04T12:22:55.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.769+0000 7ffb1bc8a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.769+0000 7ffb1bc8a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:55.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.769+0000 7ffb1bc8a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.777 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.769+0000 7ffb1bc8a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:55.777 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.769+0000 7ffb1bc8a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.777 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.770+0000 7ffb1bc8a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:55.777 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.770+0000 7ffb1bc8a800 20 started sync module instance, tier type = 2024-03-04T12:22:55.777 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.770+0000 7ffb1bc8a800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:22:55.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.780+0000 7ffb1bc8a800 20 add_watcher() i=0 2024-03-04T12:22:55.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.780+0000 7ffb1bc8a800 20 add_watcher() i=1 2024-03-04T12:22:55.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.780+0000 7ffb1bc8a800 20 add_watcher() i=2 2024-03-04T12:22:55.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.780+0000 7ffb1bc8a800 20 add_watcher() i=3 2024-03-04T12:22:55.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.780+0000 7ffb1bc8a800 20 add_watcher() i=4 2024-03-04T12:22:55.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.780+0000 7ffb1bc8a800 20 add_watcher() i=5 2024-03-04T12:22:55.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.780+0000 7ffb1bc8a800 20 add_watcher() i=6 2024-03-04T12:22:55.787 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.781+0000 7ffb1bc8a800 20 add_watcher() i=7 2024-03-04T12:22:55.787 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.781+0000 7ffb1bc8a800 2 all 8 watchers are set, enabling cache 2024-03-04T12:22:55.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.783+0000 7ff9cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:55.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.783+0000 7ffb1bc8a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:22:55.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.783+0000 7ffb1bc8a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:22:55.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.783+0000 7ffb1bc8a800 5 note: GC not initialized 2024-03-04T12:22:55.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.783+0000 7ff9ce7e4640 20 reqs_thread_entry: start 2024-03-04T12:22:55.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.783+0000 7ffb1bc8a800 20 init_complete bucket index max shards: 11 2024-03-04T12:22:55.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.783+0000 7ffb1bc8a800 20 Filter name: none 2024-03-04T12:22:55.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.783+0000 7ff93ffff640 20 reqs_thread_entry: start 2024-03-04T12:22:55.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.783+0000 7ffb1bc8a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.784+0000 7ffb1bc8a800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:22:55.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.784+0000 7ffb1bc8a800 20 rados->read ofs=0 len=0 2024-03-04T12:22:55.791 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.784+0000 7ffb1bc8a800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:22:55.791 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.784+0000 7ffb1bc8a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:22:55.791 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.784+0000 7ffb1bc8a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:22:55.791 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.784+0000 7ffb1bc8a800 20 INFO: main: starting shard=0 2024-03-04T12:22:55.791 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.784+0000 7ffb1bc8a800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:22:55.791 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.785+0000 7ffb1bc8a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.785+0000 7ffb1bc8a800 20 INFO: main: starting shard=1 2024-03-04T12:22:55.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.785+0000 7ffb1bc8a800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:22:55.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.785+0000 7ffb1bc8a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.785+0000 7ffb1bc8a800 20 INFO: main: starting shard=2 2024-03-04T12:22:55.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.785+0000 7ffb1bc8a800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:22:55.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.786+0000 7ffb1bc8a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.786+0000 7ffb1bc8a800 20 INFO: main: starting shard=3 2024-03-04T12:22:55.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.786+0000 7ffb1bc8a800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:22:55.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.787+0000 7ffb1bc8a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.787+0000 7ffb1bc8a800 20 INFO: main: starting shard=4 2024-03-04T12:22:55.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.787+0000 7ffb1bc8a800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:22:55.794 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.787+0000 7ffb1bc8a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.794 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.787+0000 7ffb1bc8a800 20 INFO: main: starting shard=5 2024-03-04T12:22:55.794 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.787+0000 7ffb1bc8a800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:55.794 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.788+0000 7ffb1bc8a800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-04T12:22:55.794 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.788+0000 7ffb1bc8a800 20 INFO: main: starting shard=6 2024-03-04T12:22:55.794 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.788+0000 7ffb1bc8a800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:22:55.795 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.788+0000 7ffb1bc8a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.795 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.788+0000 7ffb1bc8a800 20 INFO: main: starting shard=7 2024-03-04T12:22:55.795 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.788+0000 7ffb1bc8a800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:22:55.795 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.789+0000 7ffb1bc8a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.795 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.789+0000 7ffb1bc8a800 20 INFO: main: starting shard=8 2024-03-04T12:22:55.795 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.789+0000 7ffb1bc8a800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:55.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.789+0000 7ffb1bc8a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.789+0000 7ffb1bc8a800 20 INFO: main: starting shard=9 2024-03-04T12:22:55.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.789+0000 7ffb1bc8a800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:22:55.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.790+0000 7ffb1bc8a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.790+0000 7ffb1bc8a800 20 INFO: main: starting shard=10 2024-03-04T12:22:55.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.790+0000 7ffb1bc8a800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:22:55.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.790+0000 7ffb1bc8a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:55.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.790+0000 7ffb1bc8a800 20 INFO: main: done 2024-03-04T12:22:55.797 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.791+0000 7ff9cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:55.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.793+0000 7ffb1bc8a800 20 remove_watcher() i=0 2024-03-04T12:22:55.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.793+0000 7ffb1bc8a800 2 removed watcher, disabling cache 2024-03-04T12:22:55.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.794+0000 7ffb1bc8a800 20 remove_watcher() i=1 2024-03-04T12:22:55.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.795+0000 7ffb1bc8a800 20 remove_watcher() i=2 2024-03-04T12:22:55.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.796+0000 7ffb1bc8a800 20 remove_watcher() i=3 2024-03-04T12:22:55.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.797+0000 7ffb1bc8a800 20 remove_watcher() i=4 2024-03-04T12:22:55.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.798+0000 7ffb1bc8a800 20 remove_watcher() i=5 2024-03-04T12:22:55.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.799+0000 7ffb1bc8a800 20 remove_watcher() i=6 2024-03-04T12:22:55.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.800+0000 7ffb1bc8a800 20 remove_watcher() i=7 2024-03-04T12:22:55.817 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:55.817 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:55.839 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:55.839 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:55.859 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:55.859 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:55.934 INFO:tasks.workunit.client.0.smithi110.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:22:55.935 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-03-04T12:22:55.966 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:22:55.966 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:22:55.998 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.993+0000 7fa90ea13800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.994+0000 7fa90ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:56.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.994+0000 7fa90ea13800 20 realm 2024-03-04T12:22:56.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.994+0000 7fa90ea13800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.994+0000 7fa90ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:56.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.994+0000 7fa90ea13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:22:56.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.994+0000 7fa90ea13800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.995+0000 7fa90ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:56.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.995+0000 7fa90ea13800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.995+0000 7fa90ea13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:56.002 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.995+0000 7fa90ea13800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.002 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.996+0000 7fa90ea13800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:22:56.002 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.996+0000 7fa90ea13800 20 searching for the correct realm 2024-03-04T12:22:56.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:55.999+0000 7fa90cd10640 0 -- 172.21.15.110:0/2666264856 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7fa90006fb20 msgr2=0x7fa900056d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:56.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.002+0000 7fa90c50f640 0 -- 172.21.15.110:0/2666264856 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fa900060c00 msgr2=0x7fa90006b2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:56.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.208+0000 7fa90ea13800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:22:56.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.208+0000 7fa90ea13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:22:56.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.208+0000 7fa90ea13800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:22:56.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.208+0000 7fa90ea13800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:22:56.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.208+0000 7fa90ea13800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:22:56.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.208+0000 7fa90ea13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:22:56.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.208+0000 7fa90ea13800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.209+0000 7fa90ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:56.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.209+0000 7fa90ea13800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.209+0000 7fa90ea13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:56.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.209+0000 7fa90ea13800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.209+0000 7fa90ea13800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:22:56.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.209+0000 7fa90ea13800 20 zone default found 2024-03-04T12:22:56.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.209+0000 7fa90ea13800 4 Realm: () 2024-03-04T12:22:56.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.209+0000 7fa90ea13800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:22:56.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.209+0000 7fa90ea13800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:22:56.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.209+0000 7fa90ea13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:22:56.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.209+0000 7fa90ea13800 20 zonegroup default 2024-03-04T12:22:56.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.209+0000 7fa90ea13800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.209+0000 7fa90ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:56.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.209+0000 7fa90ea13800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.210+0000 7fa90ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:56.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.210+0000 7fa90ea13800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.210+0000 7fa90ea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:56.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.210+0000 7fa90ea13800 20 started sync module instance, tier type = 2024-03-04T12:22:56.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.210+0000 7fa90ea13800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:22:56.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.221+0000 7fa90ea13800 20 add_watcher() i=0 2024-03-04T12:22:56.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.221+0000 7fa90ea13800 20 add_watcher() i=1 2024-03-04T12:22:56.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.221+0000 7fa90ea13800 20 add_watcher() i=2 2024-03-04T12:22:56.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.221+0000 7fa90ea13800 20 add_watcher() i=3 2024-03-04T12:22:56.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.221+0000 7fa90ea13800 20 add_watcher() i=4 2024-03-04T12:22:56.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.221+0000 7fa90ea13800 20 add_watcher() i=5 2024-03-04T12:22:56.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.221+0000 7fa90ea13800 20 add_watcher() i=6 2024-03-04T12:22:56.228 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.222+0000 7fa90ea13800 20 add_watcher() i=7 2024-03-04T12:22:56.228 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.222+0000 7fa90ea13800 2 all 8 watchers are set, enabling cache 2024-03-04T12:22:56.231 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.223+0000 7fa7c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:56.231 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.224+0000 7fa90ea13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:22:56.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.224+0000 7fa90ea13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:22:56.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.224+0000 7fa90ea13800 5 note: GC not initialized 2024-03-04T12:22:56.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.224+0000 7fa7c1fdb640 20 reqs_thread_entry: start 2024-03-04T12:22:56.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.224+0000 7fa90ea13800 20 init_complete bucket index max shards: 11 2024-03-04T12:22:56.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.224+0000 7fa90ea13800 20 Filter name: none 2024-03-04T12:22:56.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.224+0000 7fa7337fe640 20 reqs_thread_entry: start 2024-03-04T12:22:56.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.224+0000 7fa90ea13800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.225+0000 7fa90ea13800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:22:56.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.225+0000 7fa90ea13800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.225+0000 7fa90ea13800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:22:56.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.225+0000 7fa90ea13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:22:56.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.225+0000 7fa90ea13800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:22:56.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.225+0000 7fa90ea13800 20 INFO: main: starting shard=0 2024-03-04T12:22:56.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.225+0000 7fa90ea13800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:22:56.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.226+0000 7fa90ea13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.226+0000 7fa90ea13800 20 INFO: main: starting shard=1 2024-03-04T12:22:56.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.226+0000 7fa90ea13800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:22:56.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.226+0000 7fa90ea13800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-04T12:22:56.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.226+0000 7fa90ea13800 20 INFO: main: starting shard=2 2024-03-04T12:22:56.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.226+0000 7fa90ea13800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:22:56.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.227+0000 7fa90ea13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.227+0000 7fa90ea13800 20 INFO: main: starting shard=3 2024-03-04T12:22:56.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.227+0000 7fa90ea13800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:22:56.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.227+0000 7fa90ea13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.227+0000 7fa90ea13800 20 INFO: main: starting shard=4 2024-03-04T12:22:56.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.227+0000 7fa90ea13800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:22:56.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.228+0000 7fa90ea13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.228+0000 7fa90ea13800 20 INFO: main: starting shard=5 2024-03-04T12:22:56.235 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.228+0000 7fa90ea13800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:56.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.228+0000 7fa90ea13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.228+0000 7fa90ea13800 20 INFO: main: starting shard=6 2024-03-04T12:22:56.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.228+0000 7fa90ea13800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:22:56.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.229+0000 7fa90ea13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.229+0000 7fa90ea13800 20 INFO: main: starting shard=7 2024-03-04T12:22:56.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.229+0000 7fa90ea13800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:22:56.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.229+0000 7fa90ea13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.229+0000 7fa90ea13800 20 INFO: main: starting shard=8 2024-03-04T12:22:56.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.229+0000 7fa90ea13800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:56.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.230+0000 7fa90ea13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.230+0000 7fa90ea13800 20 INFO: main: starting shard=9 2024-03-04T12:22:56.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.230+0000 7fa90ea13800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:22:56.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.230+0000 7fa90ea13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.230+0000 7fa90ea13800 20 INFO: main: starting shard=10 2024-03-04T12:22:56.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.230+0000 7fa90ea13800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:22:56.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.231+0000 7fa90ea13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.231+0000 7fa90ea13800 20 INFO: main: done 2024-03-04T12:22:56.238 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.232+0000 7fa7c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:56.240 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.234+0000 7fa90ea13800 20 remove_watcher() i=0 2024-03-04T12:22:56.240 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.234+0000 7fa90ea13800 2 removed watcher, disabling cache 2024-03-04T12:22:56.241 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.235+0000 7fa90ea13800 20 remove_watcher() i=1 2024-03-04T12:22:56.242 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.236+0000 7fa90ea13800 20 remove_watcher() i=2 2024-03-04T12:22:56.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.237+0000 7fa90ea13800 20 remove_watcher() i=3 2024-03-04T12:22:56.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.239+0000 7fa90ea13800 20 remove_watcher() i=4 2024-03-04T12:22:56.245 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.239+0000 7fa90ea13800 20 remove_watcher() i=5 2024-03-04T12:22:56.246 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.240+0000 7fa90ea13800 20 remove_watcher() i=6 2024-03-04T12:22:56.247 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.241+0000 7fa90ea13800 20 remove_watcher() i=7 2024-03-04T12:22:56.259 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:56.259 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:56.279 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:56.279 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:56.359 INFO:tasks.workunit.client.0.smithi110.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:22:56.360 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-03-04T12:22:56.389 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:22:56.389 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:22:56.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.416+0000 7f8a82e34800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.418+0000 7f8a82e34800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:56.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.418+0000 7f8a82e34800 20 realm 2024-03-04T12:22:56.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.418+0000 7f8a82e34800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.418+0000 7f8a82e34800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:56.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.418+0000 7f8a82e34800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:22:56.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.418+0000 7f8a82e34800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.418+0000 7f8a82e34800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:56.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.418+0000 7f8a82e34800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.419+0000 7f8a82e34800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:56.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.419+0000 7f8a82e34800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.419+0000 7f8a82e34800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:22:56.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.419+0000 7f8a82e34800 20 searching for the correct realm 2024-03-04T12:22:56.429 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.423+0000 7f8a7e8da640 0 -- 172.21.15.110:0/2814287265 >> [v2:172.21.15.110:6824/3005097257,v1:172.21.15.110:6825/3005097257] conn(0x55be3be6c910 msgr2=0x55be3be6eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:56.432 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.427+0000 7f8a758d8640 0 -- 172.21.15.110:0/2814287265 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f8a70066070 msgr2=0x7f8a7008fa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:56.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.430+0000 7f8a82e34800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:22:56.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.430+0000 7f8a82e34800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:22:56.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.430+0000 7f8a82e34800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:22:56.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.430+0000 7f8a82e34800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:22:56.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.430+0000 7f8a82e34800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:22:56.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.430+0000 7f8a82e34800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:22:56.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.430+0000 7f8a82e34800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.431+0000 7f8a82e34800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:56.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.431+0000 7f8a82e34800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.431+0000 7f8a82e34800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:56.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.431+0000 7f8a82e34800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.438 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.431+0000 7f8a82e34800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:22:56.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.431+0000 7f8a82e34800 20 zone default found 2024-03-04T12:22:56.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.431+0000 7f8a82e34800 4 Realm: () 2024-03-04T12:22:56.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.431+0000 7f8a82e34800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:22:56.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.431+0000 7f8a82e34800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:22:56.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.431+0000 7f8a82e34800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:22:56.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.431+0000 7f8a82e34800 20 zonegroup default 2024-03-04T12:22:56.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.431+0000 7f8a82e34800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.431+0000 7f8a82e34800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:56.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.432+0000 7f8a82e34800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.432+0000 7f8a82e34800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:56.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.432+0000 7f8a82e34800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.432+0000 7f8a82e34800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:56.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.432+0000 7f8a82e34800 20 started sync module instance, tier type = 2024-03-04T12:22:56.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.432+0000 7f8a82e34800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:22:56.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.441+0000 7f8a82e34800 20 add_watcher() i=0 2024-03-04T12:22:56.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.441+0000 7f8a82e34800 20 add_watcher() i=1 2024-03-04T12:22:56.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.441+0000 7f8a82e34800 20 add_watcher() i=2 2024-03-04T12:22:56.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.441+0000 7f8a82e34800 20 add_watcher() i=3 2024-03-04T12:22:56.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.441+0000 7f8a82e34800 20 add_watcher() i=4 2024-03-04T12:22:56.448 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.441+0000 7f8a82e34800 20 add_watcher() i=5 2024-03-04T12:22:56.448 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.441+0000 7f8a82e34800 20 add_watcher() i=6 2024-03-04T12:22:56.448 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.442+0000 7f8a82e34800 20 add_watcher() i=7 2024-03-04T12:22:56.448 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.442+0000 7f8a82e34800 2 all 8 watchers are set, enabling cache 2024-03-04T12:22:56.449 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.444+0000 7f8934fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:56.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.444+0000 7f8a82e34800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:22:56.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.444+0000 7f8a82e34800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:22:56.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.444+0000 7f8a82e34800 5 note: GC not initialized 2024-03-04T12:22:56.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.444+0000 7f88af7fe640 20 reqs_thread_entry: start 2024-03-04T12:22:56.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.444+0000 7f8a82e34800 20 init_complete bucket index max shards: 11 2024-03-04T12:22:56.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.444+0000 7f8a82e34800 20 Filter name: none 2024-03-04T12:22:56.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.444+0000 7f88ad7fa640 20 reqs_thread_entry: start 2024-03-04T12:22:56.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.444+0000 7f8a82e34800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.445+0000 7f8a82e34800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:22:56.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.445+0000 7f8a82e34800 20 rados->read ofs=0 len=0 2024-03-04T12:22:56.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.445+0000 7f8a82e34800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:22:56.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.445+0000 7f8a82e34800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:22:56.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.445+0000 7f8a82e34800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:22:56.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.445+0000 7f8a82e34800 20 INFO: main: starting shard=0 2024-03-04T12:22:56.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.445+0000 7f8a82e34800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:22:56.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.446+0000 7f8a82e34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.446+0000 7f8a82e34800 20 INFO: main: starting shard=1 2024-03-04T12:22:56.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.446+0000 7f8a82e34800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:22:56.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.446+0000 7f8a82e34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.446+0000 7f8a82e34800 20 INFO: main: starting shard=2 2024-03-04T12:22:56.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.446+0000 7f8a82e34800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:22:56.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.447+0000 7f8a82e34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.447+0000 7f8a82e34800 20 INFO: main: starting shard=3 2024-03-04T12:22:56.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.447+0000 7f8a82e34800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:22:56.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.447+0000 7f8a82e34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.447+0000 7f8a82e34800 20 INFO: main: starting shard=4 2024-03-04T12:22:56.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.447+0000 7f8a82e34800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:22:56.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.448+0000 7f8a82e34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.448+0000 7f8a82e34800 20 INFO: main: starting shard=5 2024-03-04T12:22:56.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.448+0000 7f8a82e34800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:56.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.448+0000 7f8a82e34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.448+0000 7f8a82e34800 20 INFO: main: starting shard=6 2024-03-04T12:22:56.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.448+0000 7f8a82e34800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:22:56.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.448+0000 7f8a82e34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.448+0000 7f8a82e34800 20 INFO: main: starting shard=7 2024-03-04T12:22:56.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.448+0000 7f8a82e34800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:22:56.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.449+0000 7f8a82e34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.449+0000 7f8a82e34800 20 INFO: main: starting shard=8 2024-03-04T12:22:56.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.449+0000 7f8a82e34800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:56.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.449+0000 7f8a82e34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.449+0000 7f8a82e34800 20 INFO: main: starting shard=9 2024-03-04T12:22:56.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.449+0000 7f8a82e34800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:22:56.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.450+0000 7f8a82e34800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:56.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.450+0000 7f8a82e34800 20 INFO: main: starting shard=10 2024-03-04T12:22:56.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.450+0000 7f8a82e34800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:22:56.457 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.450+0000 7f8a82e34800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-04T12:22:56.457 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.450+0000 7f8a82e34800 20 INFO: main: done 2024-03-04T12:22:56.457 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.451+0000 7f8934fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:56.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.453+0000 7f8a82e34800 20 remove_watcher() i=0 2024-03-04T12:22:56.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.453+0000 7f8a82e34800 2 removed watcher, disabling cache 2024-03-04T12:22:56.460 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.454+0000 7f8a82e34800 20 remove_watcher() i=1 2024-03-04T12:22:56.462 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.456+0000 7f8a82e34800 20 remove_watcher() i=2 2024-03-04T12:22:56.463 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.457+0000 7f8a82e34800 20 remove_watcher() i=3 2024-03-04T12:22:56.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.458+0000 7f8a82e34800 20 remove_watcher() i=4 2024-03-04T12:22:56.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.459+0000 7f8a82e34800 20 remove_watcher() i=5 2024-03-04T12:22:56.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.460+0000 7f8a82e34800 20 remove_watcher() i=6 2024-03-04T12:22:56.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:56.461+0000 7f8a82e34800 20 remove_watcher() i=7 2024-03-04T12:22:56.478 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:56.478 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:56.499 INFO:tasks.workunit.client.0.smithi110.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-03-04T12:22:56.901 INFO:tasks.workunit.client.0.smithi110.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-03-04T12:22:57.283 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: bucket check unlinked finds unlistable entries 2024-03-04T12:22:57.283 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:22:57.284 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-03-04T12:22:57.316 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:22:57.316 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:22:57.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.343+0000 7f492cb42800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.344+0000 7f492cb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:57.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.344+0000 7f492cb42800 20 realm 2024-03-04T12:22:57.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.344+0000 7f492cb42800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.344+0000 7f492cb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:57.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.344+0000 7f492cb42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:22:57.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.344+0000 7f492cb42800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.344+0000 7f492cb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:57.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.344+0000 7f492cb42800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.345+0000 7f492cb42800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:57.352 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.345+0000 7f492cb42800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.352 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.346+0000 7f492cb42800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:22:57.352 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.346+0000 7f492cb42800 20 searching for the correct realm 2024-03-04T12:22:57.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.349+0000 7f4920040640 0 -- 172.21.15.110:0/1856925839 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x55a00014f830 msgr2=0x55a000151cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:57.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.353+0000 7f4928841640 0 -- 172.21.15.110:0/1856925839 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f4910000ed0 msgr2=0x7f4910097050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:57.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.358+0000 7f492cb42800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:22:57.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.358+0000 7f492cb42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:22:57.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.358+0000 7f492cb42800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:22:57.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.358+0000 7f492cb42800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:22:57.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.358+0000 7f492cb42800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:22:57.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.358+0000 7f492cb42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:22:57.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.358+0000 7f492cb42800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.358+0000 7f492cb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:57.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.358+0000 7f492cb42800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.358+0000 7f492cb42800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:57.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.358+0000 7f492cb42800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.359+0000 7f492cb42800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:22:57.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.359+0000 7f492cb42800 20 zone default found 2024-03-04T12:22:57.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.359+0000 7f492cb42800 4 Realm: () 2024-03-04T12:22:57.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.359+0000 7f492cb42800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:22:57.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.359+0000 7f492cb42800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:22:57.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.359+0000 7f492cb42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:22:57.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.359+0000 7f492cb42800 20 zonegroup default 2024-03-04T12:22:57.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.359+0000 7f492cb42800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.359+0000 7f492cb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:57.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.359+0000 7f492cb42800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.359+0000 7f492cb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:57.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.359+0000 7f492cb42800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.360+0000 7f492cb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:57.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.360+0000 7f492cb42800 20 started sync module instance, tier type = 2024-03-04T12:22:57.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.360+0000 7f492cb42800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:22:57.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.371+0000 7f492cb42800 20 add_watcher() i=0 2024-03-04T12:22:57.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.371+0000 7f492cb42800 20 add_watcher() i=1 2024-03-04T12:22:57.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.371+0000 7f492cb42800 20 add_watcher() i=2 2024-03-04T12:22:57.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.371+0000 7f492cb42800 20 add_watcher() i=3 2024-03-04T12:22:57.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.371+0000 7f492cb42800 20 add_watcher() i=4 2024-03-04T12:22:57.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.371+0000 7f492cb42800 20 add_watcher() i=5 2024-03-04T12:22:57.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.371+0000 7f492cb42800 20 add_watcher() i=6 2024-03-04T12:22:57.378 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.372+0000 7f492cb42800 20 add_watcher() i=7 2024-03-04T12:22:57.378 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.372+0000 7f492cb42800 2 all 8 watchers are set, enabling cache 2024-03-04T12:22:57.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.374+0000 7f47defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:57.380 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.374+0000 7f492cb42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:22:57.380 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.374+0000 7f492cb42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:22:57.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.374+0000 7f492cb42800 5 note: GC not initialized 2024-03-04T12:22:57.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.374+0000 7f47ddfe3640 20 reqs_thread_entry: start 2024-03-04T12:22:57.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.374+0000 7f492cb42800 20 init_complete bucket index max shards: 11 2024-03-04T12:22:57.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.374+0000 7f492cb42800 20 Filter name: none 2024-03-04T12:22:57.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.374+0000 7f474f7fe640 20 reqs_thread_entry: start 2024-03-04T12:22:57.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.374+0000 7f492cb42800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:22:57.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.374+0000 7f492cb42800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.375+0000 7f492cb42800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:22:57.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.375+0000 7f492cb42800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:22:57.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.375+0000 7f492cb42800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:22:57.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.375+0000 7f492cb42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 : miss 2024-03-04T12:22:57.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.375+0000 7f492cb42800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.382 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.375+0000 7f492cb42800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:22:57.382 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.375+0000 7f492cb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 info.flags=0x17 2024-03-04T12:22:57.382 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.375+0000 7f492cb42800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 to cache LRU end 2024-03-04T12:22:57.382 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.375+0000 7f492cb42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:22:57.382 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.375+0000 7f492cb42800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:22:57.382 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.375+0000 7f492cb42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 2024-03-04T12:22:57.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.375+0000 7f492cb42800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:22:57.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.376+0000 7f492cb42800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-04T12:22:57.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.376+0000 7f492cb42800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:22:57.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.376+0000 7f492cb42800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:22:57.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.377+0000 7f492cb42800 1 NOTICE: finished shard 2 (0 entries found) 2024-03-04T12:22:57.384 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.377+0000 7f492cb42800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:22:57.384 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.377+0000 7f492cb42800 1 NOTICE: finished shard 3 (0 entries found) 2024-03-04T12:22:57.384 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.377+0000 7f492cb42800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:22:57.384 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.378+0000 7f492cb42800 1 NOTICE: finished shard 4 (0 entries found) 2024-03-04T12:22:57.384 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.378+0000 7f492cb42800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:57.384 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.378+0000 7f492cb42800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:22:57.384 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.379+0000 7f492cb42800 1 NOTICE: finished shard 6 (0 entries found) 2024-03-04T12:22:57.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.379+0000 7f492cb42800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:22:57.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.379+0000 7f492cb42800 1 NOTICE: finished shard 7 (0 entries found) 2024-03-04T12:22:57.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.379+0000 7f492cb42800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:57.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.379+0000 7f492cb42800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:22:57.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.380+0000 7f492cb42800 1 NOTICE: finished shard 9 (0 entries found) 2024-03-04T12:22:57.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.380+0000 7f492cb42800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:22:57.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.381+0000 7f492cb42800 1 NOTICE: finished shard 1 (1 entries found) 2024-03-04T12:22:57.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.381+0000 7f492cb42800 1 NOTICE: finished shard 5 (1 entries found) 2024-03-04T12:22:57.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.381+0000 7f492cb42800 1 NOTICE: finished shard 8 (1 entries found) 2024-03-04T12:22:57.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.381+0000 7f492cb42800 1 NOTICE: finished shard 10 (1 entries found) 2024-03-04T12:22:57.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.381+0000 7f492cb42800 1 NOTICE: finished all shards (4 entries found) 2024-03-04T12:22:57.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.382+0000 7f47defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:57.390 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.384+0000 7f492cb42800 20 remove_watcher() i=0 2024-03-04T12:22:57.390 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.384+0000 7f492cb42800 2 removed watcher, disabling cache 2024-03-04T12:22:57.391 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.385+0000 7f492cb42800 20 remove_watcher() i=1 2024-03-04T12:22:57.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.386+0000 7f492cb42800 20 remove_watcher() i=2 2024-03-04T12:22:57.393 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.387+0000 7f492cb42800 20 remove_watcher() i=3 2024-03-04T12:22:57.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.388+0000 7f492cb42800 20 remove_watcher() i=4 2024-03-04T12:22:57.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.389+0000 7f492cb42800 20 remove_watcher() i=5 2024-03-04T12:22:57.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.390+0000 7f492cb42800 20 remove_watcher() i=6 2024-03-04T12:22:57.397 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.391+0000 7f492cb42800 20 remove_watcher() i=7 2024-03-04T12:22:57.406 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: unlinked entries are not listable 2024-03-04T12:22:57.407 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:22:57.409 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:57.409 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:57.524 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-03-04T12:22:57.524 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:22:57.526 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:57.526 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:57.589 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:57.589 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:57.645 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-03-04T12:22:57.645 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:22:57.647 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-04T12:22:57.680 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:22:57.680 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:22:57.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.707+0000 7f37647a2800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.714 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.708+0000 7f37647a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:57.715 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.708+0000 7f37647a2800 20 realm 2024-03-04T12:22:57.715 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.708+0000 7f37647a2800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.715 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.709+0000 7f37647a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:57.715 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.709+0000 7f37647a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:22:57.715 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.709+0000 7f37647a2800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.715 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.709+0000 7f37647a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:57.715 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.709+0000 7f37647a2800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.716 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.710+0000 7f37647a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:57.716 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.710+0000 7f37647a2800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.716 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.710+0000 7f37647a2800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:22:57.716 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.710+0000 7f37647a2800 20 searching for the correct realm 2024-03-04T12:22:57.720 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.714+0000 7f3761a9d640 0 -- 172.21.15.110:0/3081011636 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f37540a9c40 msgr2=0x7f37540ccab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:57.723 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.717+0000 7f3761a9d640 0 -- 172.21.15.110:0/3081011636 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f362c077210 msgr2=0x7f362c079640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:57.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.721+0000 7f37647a2800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:22:57.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.721+0000 7f37647a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:22:57.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.721+0000 7f37647a2800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:22:57.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.721+0000 7f37647a2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:22:57.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.721+0000 7f37647a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:22:57.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.721+0000 7f37647a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:22:57.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.721+0000 7f37647a2800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.729 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.722+0000 7f37647a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:57.729 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.722+0000 7f37647a2800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.722+0000 7f37647a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:57.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.722+0000 7f37647a2800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.723+0000 7f37647a2800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:22:57.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.723+0000 7f37647a2800 20 zone default found 2024-03-04T12:22:57.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.723+0000 7f37647a2800 4 Realm: () 2024-03-04T12:22:57.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.723+0000 7f37647a2800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:22:57.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.723+0000 7f37647a2800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:22:57.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.723+0000 7f37647a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:22:57.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.723+0000 7f37647a2800 20 zonegroup default 2024-03-04T12:22:57.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.723+0000 7f37647a2800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.723+0000 7f37647a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:57.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.723+0000 7f37647a2800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.723+0000 7f37647a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:57.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.723+0000 7f37647a2800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.723+0000 7f37647a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:57.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.723+0000 7f37647a2800 20 started sync module instance, tier type = 2024-03-04T12:22:57.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.723+0000 7f37647a2800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:22:57.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.733+0000 7f37647a2800 20 add_watcher() i=0 2024-03-04T12:22:57.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.733+0000 7f37647a2800 20 add_watcher() i=1 2024-03-04T12:22:57.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.733+0000 7f37647a2800 20 add_watcher() i=2 2024-03-04T12:22:57.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.733+0000 7f37647a2800 20 add_watcher() i=3 2024-03-04T12:22:57.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.733+0000 7f37647a2800 20 add_watcher() i=4 2024-03-04T12:22:57.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.733+0000 7f37647a2800 20 add_watcher() i=5 2024-03-04T12:22:57.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.733+0000 7f37647a2800 20 add_watcher() i=6 2024-03-04T12:22:57.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.734+0000 7f37647a2800 20 add_watcher() i=7 2024-03-04T12:22:57.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.734+0000 7f37647a2800 2 all 8 watchers are set, enabling cache 2024-03-04T12:22:57.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.736+0000 7f3618fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:57.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.736+0000 7f37647a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:22:57.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.736+0000 7f37647a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:22:57.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.736+0000 7f37647a2800 5 note: GC not initialized 2024-03-04T12:22:57.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.736+0000 7f35937fe640 20 reqs_thread_entry: start 2024-03-04T12:22:57.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.736+0000 7f37647a2800 20 init_complete bucket index max shards: 11 2024-03-04T12:22:57.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.736+0000 7f37647a2800 20 Filter name: none 2024-03-04T12:22:57.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.736+0000 7f35917fa640 20 reqs_thread_entry: start 2024-03-04T12:22:57.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.736+0000 7f37647a2800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:22:57.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.736+0000 7f37647a2800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.737+0000 7f37647a2800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:22:57.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.737+0000 7f37647a2800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:22:57.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.737+0000 7f37647a2800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:22:57.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.737+0000 7f37647a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 : miss 2024-03-04T12:22:57.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.737+0000 7f37647a2800 20 rados->read ofs=0 len=0 2024-03-04T12:22:57.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.737+0000 7f37647a2800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:22:57.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.737+0000 7f37647a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 info.flags=0x17 2024-03-04T12:22:57.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.737+0000 7f37647a2800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 to cache LRU end 2024-03-04T12:22:57.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.737+0000 7f37647a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:22:57.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.737+0000 7f37647a2800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:22:57.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.737+0000 7f37647a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 2024-03-04T12:22:57.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.737+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:22:57.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.738+0000 7f37647a2800 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-04T12:22:57.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.738+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:22:57.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.738+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:22:57.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.739+0000 7f37647a2800 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-04T12:22:57.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.739+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:22:57.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.739+0000 7f37647a2800 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-04T12:22:57.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.739+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:22:57.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.740+0000 7f37647a2800 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-04T12:22:57.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.740+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:57.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.740+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:22:57.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.740+0000 7f37647a2800 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-04T12:22:57.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.740+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:22:57.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.741+0000 7f37647a2800 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-04T12:22:57.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.741+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:57.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.741+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:22:57.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.742+0000 7f37647a2800 1 NOTICE: finished shard 9 (0 entries removed) 2024-03-04T12:22:57.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.742+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:22:57.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.742+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:22:57.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.743+0000 7f37647a2800 20 get_obj_state: octx=0x5638267fc3f0 obj=check-bucket:e state=0x563826a9bf58 s->prefetch_data=0 2024-03-04T12:22:57.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.743+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:57.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.743+0000 7f37647a2800 20 get_obj_state: octx=0x5638267fc5d0 obj=check-bucket:d state=0x563826a98408 s->prefetch_data=0 2024-03-04T12:22:57.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.743+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:57.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.743+0000 7f37647a2800 20 get_obj_state: octx=0x563826aa0d50 obj=check-bucket:c state=0x563826a98f68 s->prefetch_data=0 2024-03-04T12:22:57.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.743+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:22:57.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.744+0000 7f37647a2800 20 get_obj_state: octx=0x563826a9b320 obj=check-bucket:f state=0x563826b36378 s->prefetch_data=0 2024-03-04T12:22:57.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.744+0000 7f37647a2800 20 get_obj_state: setting s->obj_tag to 72k1hf3egfvhreljmzznt2f3r2bqtdex 2024-03-04T12:22:57.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.744+0000 7f37647a2800 20 get_obj_state_impl: setting s->olh_tag to jmusknnb1qzgu3lbhb62urtaonj61cwv 2024-03-04T12:22:57.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.744+0000 7f37647a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jmusknnb1qzgu3lbhb62urtaonj61cwv 2024-03-04T12:22:57.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.744+0000 7f37647a2800 20 get_obj_state: setting s->obj_tag to 78x8ds18462jjqmar9czad8rdpns26di 2024-03-04T12:22:57.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.744+0000 7f37647a2800 20 get_obj_state_impl: setting s->olh_tag to g05ombvey3eownigwx06yj1uukdp2x09 2024-03-04T12:22:57.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.744+0000 7f37647a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g05ombvey3eownigwx06yj1uukdp2x09 2024-03-04T12:22:57.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.744+0000 7f37647a2800 20 get_obj_state: setting s->obj_tag to jp33uhozx81c991zulw7fau25seqs187 2024-03-04T12:22:57.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.744+0000 7f37647a2800 20 get_obj_state_impl: setting s->olh_tag to wmiczewhj4k2enityxbw2yvmmajf6m3i 2024-03-04T12:22:57.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.744+0000 7f37647a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wmiczewhj4k2enityxbw2yvmmajf6m3i 2024-03-04T12:22:57.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.744+0000 7f37647a2800 20 get_obj_state: setting s->obj_tag to uwtkfeundjq32ubumr2u9zgr05pyn343 2024-03-04T12:22:57.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.744+0000 7f37647a2800 20 get_obj_state_impl: setting s->olh_tag to rd1prq7ucpc3m5ykd6u75p10ctpsn1et 2024-03-04T12:22:57.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.744+0000 7f37647a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rd1prq7ucpc3m5ykd6u75p10ctpsn1et 2024-03-04T12:22:57.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.745+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:57.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.745+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:22:57.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.746+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:57.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.747+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:22:57.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.747+0000 7f37647a2800 20 olh_log_entry: epoch=3 op=3 key=c[AHVbxiQgLuu7w.8ABNsSP.plLz2zpOX] 2024-03-04T12:22:57.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.747+0000 7f37647a2800 20 get_obj_state: octx=0x563826aa0d50 obj=check-bucket:_:AHVbxiQgLuu7w.8ABNsSP.plLz2zpOX_c state=0x563826b49d88 s->prefetch_data=0 2024-03-04T12:22:57.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.747+0000 7f37647a2800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-03-04T12:22:57.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.747+0000 7f37647a2800 20 olh_log_entry: epoch=2 op=3 key=e[anLK74DkcRxab6zij89fpXDQD.LOP7w] 2024-03-04T12:22:57.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.747+0000 7f37647a2800 20 get_obj_state: octx=0x5638267fc3f0 obj=check-bucket:_:anLK74DkcRxab6zij89fpXDQD.LOP7w_e state=0x563826b4ff98 s->prefetch_data=0 2024-03-04T12:22:57.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.747+0000 7f37647a2800 10 manifest: total_size = 22 2024-03-04T12:22:57.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.747+0000 7f37647a2800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14788249932152320027 2024-03-04T12:22:57.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.747+0000 7f37647a2800 20 get_obj_state: octx=0x563826aa0d50 obj=check-bucket:_:AHVbxiQgLuu7w.8ABNsSP.plLz2zpOX_c state=0x563826b49d88 s->prefetch_data=0 2024-03-04T12:22:57.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.747+0000 7f37647a2800 20 prepare_atomic_modification: state is not atomic. state=0x563826b49d88 2024-03-04T12:22:57.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.747+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:57.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.747+0000 7f37647a2800 10 manifest: total_size = 12 2024-03-04T12:22:57.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.747+0000 7f37647a2800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3245121405669125020 2024-03-04T12:22:57.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.747+0000 7f37647a2800 20 get_obj_state: octx=0x5638267fc3f0 obj=check-bucket:_:anLK74DkcRxab6zij89fpXDQD.LOP7w_e state=0x563826b4ff98 s->prefetch_data=0 2024-03-04T12:22:57.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.747+0000 7f37647a2800 20 prepare_atomic_modification: state is not atomic. state=0x563826b4ff98 2024-03-04T12:22:57.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.747+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:22:57.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.748+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:57.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.748+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:22:57.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.749+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:57.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.749+0000 7f37647a2800 20 olh_log_entry: epoch=3 op=3 key=d[Y0Yee0XbkLZFEM2DJHny-zj0yHsGqjb] 2024-03-04T12:22:57.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.750+0000 7f37647a2800 20 get_obj_state: octx=0x5638267fc5d0 obj=check-bucket:_:Y0Yee0XbkLZFEM2DJHny-zj0yHsGqjb_d state=0x563826b59438 s->prefetch_data=0 2024-03-04T12:22:57.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.750+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:22:57.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.750+0000 7f37647a2800 10 manifest: total_size = 12 2024-03-04T12:22:57.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.750+0000 7f37647a2800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11748612412286152026 2024-03-04T12:22:57.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.750+0000 7f37647a2800 20 get_obj_state: octx=0x5638267fc5d0 obj=check-bucket:_:Y0Yee0XbkLZFEM2DJHny-zj0yHsGqjb_d state=0x563826b59438 s->prefetch_data=0 2024-03-04T12:22:57.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.750+0000 7f37647a2800 20 prepare_atomic_modification: state is not atomic. state=0x563826b59438 2024-03-04T12:22:57.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.750+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:57.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.750+0000 7f37647a2800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-03-04T12:22:57.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.750+0000 7f37647a2800 20 olh_log_entry: epoch=2 op=3 key=f[DRKdD.WaC6Y3H.mbE0ZTA7z3JPMbSHC] 2024-03-04T12:22:57.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.750+0000 7f37647a2800 20 get_obj_state: octx=0x563826a9b320 obj=check-bucket:_:DRKdD.WaC6Y3H.mbE0ZTA7z3JPMbSHC_f state=0x563826b68698 s->prefetch_data=0 2024-03-04T12:22:57.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.750+0000 7f37647a2800 10 manifest: total_size = 22 2024-03-04T12:22:57.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.750+0000 7f37647a2800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9682344146672440257 2024-03-04T12:22:57.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.750+0000 7f37647a2800 20 get_obj_state: octx=0x563826a9b320 obj=check-bucket:_:DRKdD.WaC6Y3H.mbE0ZTA7z3JPMbSHC_f state=0x563826b68698 s->prefetch_data=0 2024-03-04T12:22:57.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.750+0000 7f37647a2800 20 prepare_atomic_modification: state is not atomic. state=0x563826b68698 2024-03-04T12:22:57.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.750+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:22:57.759 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.753+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:57.759 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.753+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:57.759 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.753+0000 7f3645ffb640 20 handle_completion(): completion ok for obj=c[AHVbxiQgLuu7w.8ABNsSP.plLz2zpOX] 2024-03-04T12:22:57.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.754+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:57.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.754+0000 7f37647a2800 1 NOTICE: finished shard 8 (1 entries removed) 2024-03-04T12:22:57.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.756+0000 7f36457fa640 20 handle_completion(): completion ok for obj=e[anLK74DkcRxab6zij89fpXDQD.LOP7w] 2024-03-04T12:22:57.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.757+0000 7f37647a2800 20 get_obj_state: octx=0x5638267fc3f0 obj=check-bucket:e state=0x563826a9bf58 s->prefetch_data=0 2024-03-04T12:22:57.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.757+0000 7f37647a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jmusknnb1qzgu3lbhb62urtaonj61cwv 2024-03-04T12:22:57.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.757+0000 7f36457fa640 20 handle_completion(): completion ok for obj=d[Y0Yee0XbkLZFEM2DJHny-zj0yHsGqjb] 2024-03-04T12:22:57.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.760+0000 7f37647a2800 20 get_obj_state: octx=0x563826a9b320 obj=check-bucket:f state=0x563826b36378 s->prefetch_data=0 2024-03-04T12:22:57.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.760+0000 7f37647a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rd1prq7ucpc3m5ykd6u75p10ctpsn1et 2024-03-04T12:22:57.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.760+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:57.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.760+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:57.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.760+0000 7f3645ffb640 20 handle_completion(): completion ok for obj=f[DRKdD.WaC6Y3H.mbE0ZTA7z3JPMbSHC] 2024-03-04T12:22:57.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.763+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:57.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.763+0000 7f37647a2800 1 NOTICE: finished shard 5 (1 entries removed) 2024-03-04T12:22:57.771 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.765+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:22:57.771 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.765+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:22:57.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.766+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:22:57.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.766+0000 7f37647a2800 1 NOTICE: finished shard 1 (1 entries removed) 2024-03-04T12:22:57.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.768+0000 7f37647a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:22:57.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.768+0000 7f37647a2800 1 NOTICE: finished shard 10 (1 entries removed) 2024-03-04T12:22:57.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.768+0000 7f37647a2800 1 NOTICE: finished all shards (4 entries removed) 2024-03-04T12:22:57.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.769+0000 7f3618fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:57.777 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.771+0000 7f37647a2800 20 remove_watcher() i=0 2024-03-04T12:22:57.777 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.771+0000 7f37647a2800 2 removed watcher, disabling cache 2024-03-04T12:22:57.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.773+0000 7f37647a2800 20 remove_watcher() i=1 2024-03-04T12:22:57.780 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.774+0000 7f37647a2800 20 remove_watcher() i=2 2024-03-04T12:22:57.781 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.775+0000 7f37647a2800 20 remove_watcher() i=3 2024-03-04T12:22:57.782 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.776+0000 7f37647a2800 20 remove_watcher() i=4 2024-03-04T12:22:57.783 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.777+0000 7f37647a2800 20 remove_watcher() i=5 2024-03-04T12:22:57.784 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.778+0000 7f37647a2800 20 remove_watcher() i=6 2024-03-04T12:22:57.785 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:57.779+0000 7f37647a2800 20 remove_watcher() i=7 2024-03-04T12:22:57.797 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:57.797 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:57.813 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:57.814 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:57.831 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:57.831 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:57.847 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:57.848 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:57.862 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: bucket check unlinked does not affect normal entries 2024-03-04T12:22:57.862 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:22:57.863 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:57.863 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:57.933 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:57.933 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:57.952 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:57.952 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:57.972 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:57.972 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:57.992 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:57.992 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:58.010 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-03-04T12:22:58.010 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:22:58.012 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-03-04T12:22:58.042 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:22:58.042 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:22:58.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.070+0000 7fce88133800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.072+0000 7fce88133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.072+0000 7fce88133800 20 realm 2024-03-04T12:22:58.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.072+0000 7fce88133800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.072+0000 7fce88133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.072+0000 7fce88133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:22:58.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.072+0000 7fce88133800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.072+0000 7fce88133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.072+0000 7fce88133800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.073+0000 7fce88133800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:58.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.073+0000 7fce88133800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.073+0000 7fce88133800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:22:58.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.073+0000 7fce88133800 20 searching for the correct realm 2024-03-04T12:22:58.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.077+0000 7fce7b5d2640 0 -- 172.21.15.110:0/461733999 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x55610eeada30 msgr2=0x55610eeafef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:58.086 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.080+0000 7fce83dd3640 0 -- 172.21.15.110:0/461733999 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fce6c007390 msgr2=0x7fce6c055630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:58.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.085+0000 7fce88133800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:22:58.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.085+0000 7fce88133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:22:58.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.085+0000 7fce88133800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:22:58.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.085+0000 7fce88133800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:22:58.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.085+0000 7fce88133800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:22:58.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.085+0000 7fce88133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:22:58.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.085+0000 7fce88133800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.085+0000 7fce88133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.085+0000 7fce88133800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.085+0000 7fce88133800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:58.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.085+0000 7fce88133800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.086+0000 7fce88133800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:22:58.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.086+0000 7fce88133800 20 zone default found 2024-03-04T12:22:58.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.086+0000 7fce88133800 4 Realm: () 2024-03-04T12:22:58.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.086+0000 7fce88133800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:22:58.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.086+0000 7fce88133800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:22:58.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.086+0000 7fce88133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:22:58.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.086+0000 7fce88133800 20 zonegroup default 2024-03-04T12:22:58.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.086+0000 7fce88133800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.094 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.086+0000 7fce88133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.094 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.086+0000 7fce88133800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.094 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.086+0000 7fce88133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.094 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.086+0000 7fce88133800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.094 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.087+0000 7fce88133800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.094 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.087+0000 7fce88133800 20 started sync module instance, tier type = 2024-03-04T12:22:58.094 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.087+0000 7fce88133800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:22:58.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.097+0000 7fce88133800 20 add_watcher() i=0 2024-03-04T12:22:58.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.097+0000 7fce88133800 20 add_watcher() i=1 2024-03-04T12:22:58.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.097+0000 7fce88133800 20 add_watcher() i=2 2024-03-04T12:22:58.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.097+0000 7fce88133800 20 add_watcher() i=3 2024-03-04T12:22:58.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.097+0000 7fce88133800 20 add_watcher() i=4 2024-03-04T12:22:58.104 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.097+0000 7fce88133800 20 add_watcher() i=5 2024-03-04T12:22:58.104 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.097+0000 7fce88133800 20 add_watcher() i=6 2024-03-04T12:22:58.104 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.098+0000 7fce88133800 20 add_watcher() i=7 2024-03-04T12:22:58.104 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.098+0000 7fce88133800 2 all 8 watchers are set, enabling cache 2024-03-04T12:22:58.105 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.100+0000 7fcd39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:58.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.100+0000 7fce88133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:22:58.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.100+0000 7fce88133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:22:58.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.100+0000 7fce88133800 5 note: GC not initialized 2024-03-04T12:22:58.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.100+0000 7fcd38fe1640 20 reqs_thread_entry: start 2024-03-04T12:22:58.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.100+0000 7fce88133800 20 init_complete bucket index max shards: 11 2024-03-04T12:22:58.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.100+0000 7fce88133800 20 Filter name: none 2024-03-04T12:22:58.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.100+0000 7fccb27fc640 20 reqs_thread_entry: start 2024-03-04T12:22:58.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.101+0000 7fce88133800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:22:58.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.101+0000 7fce88133800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.101+0000 7fce88133800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:22:58.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.101+0000 7fce88133800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:22:58.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.101+0000 7fce88133800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:22:58.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.101+0000 7fce88133800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 : miss 2024-03-04T12:22:58.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.101+0000 7fce88133800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.101+0000 7fce88133800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:22:58.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.101+0000 7fce88133800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 info.flags=0x17 2024-03-04T12:22:58.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.101+0000 7fce88133800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 to cache LRU end 2024-03-04T12:22:58.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.101+0000 7fce88133800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:22:58.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.101+0000 7fce88133800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:22:58.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.101+0000 7fce88133800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 2024-03-04T12:22:58.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.101+0000 7fce88133800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:22:58.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.102+0000 7fce88133800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-04T12:22:58.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.102+0000 7fce88133800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:22:58.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.102+0000 7fce88133800 1 NOTICE: finished shard 1 (0 entries found) 2024-03-04T12:22:58.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.102+0000 7fce88133800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:22:58.110 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.103+0000 7fce88133800 1 NOTICE: finished shard 2 (0 entries found) 2024-03-04T12:22:58.110 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.103+0000 7fce88133800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:22:58.110 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.103+0000 7fce88133800 1 NOTICE: finished shard 3 (0 entries found) 2024-03-04T12:22:58.110 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.103+0000 7fce88133800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:22:58.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.104+0000 7fce88133800 1 NOTICE: finished shard 4 (0 entries found) 2024-03-04T12:22:58.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.104+0000 7fce88133800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:58.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.104+0000 7fce88133800 1 NOTICE: finished shard 5 (0 entries found) 2024-03-04T12:22:58.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.104+0000 7fce88133800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:22:58.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.104+0000 7fce88133800 1 NOTICE: finished shard 6 (0 entries found) 2024-03-04T12:22:58.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.104+0000 7fce88133800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:22:58.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.105+0000 7fce88133800 1 NOTICE: finished shard 7 (0 entries found) 2024-03-04T12:22:58.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.105+0000 7fce88133800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:58.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.105+0000 7fce88133800 1 NOTICE: finished shard 8 (0 entries found) 2024-03-04T12:22:58.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.105+0000 7fce88133800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:22:58.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.106+0000 7fce88133800 1 NOTICE: finished shard 9 (0 entries found) 2024-03-04T12:22:58.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.106+0000 7fce88133800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:22:58.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.106+0000 7fce88133800 1 NOTICE: finished shard 10 (0 entries found) 2024-03-04T12:22:58.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.106+0000 7fce88133800 1 NOTICE: finished all shards (0 entries found) 2024-03-04T12:22:58.113 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.107+0000 7fcd39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:58.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.110+0000 7fce88133800 20 remove_watcher() i=0 2024-03-04T12:22:58.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.110+0000 7fce88133800 2 removed watcher, disabling cache 2024-03-04T12:22:58.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.111+0000 7fce88133800 20 remove_watcher() i=1 2024-03-04T12:22:58.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.112+0000 7fce88133800 20 remove_watcher() i=2 2024-03-04T12:22:58.118 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.113+0000 7fce88133800 20 remove_watcher() i=3 2024-03-04T12:22:58.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.114+0000 7fce88133800 20 remove_watcher() i=4 2024-03-04T12:22:58.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.115+0000 7fce88133800 20 remove_watcher() i=5 2024-03-04T12:22:58.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.116+0000 7fce88133800 20 remove_watcher() i=6 2024-03-04T12:22:58.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.117+0000 7fce88133800 20 remove_watcher() i=7 2024-03-04T12:22:58.135 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:58.135 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:58.244 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:22:58.244 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:22:58.286 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-04T12:22:58.314 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:22:58.314 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:22:58.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.341+0000 7f376e030800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.342+0000 7f376e030800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.342+0000 7f376e030800 20 realm 2024-03-04T12:22:58.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.342+0000 7f376e030800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.342+0000 7f376e030800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.342+0000 7f376e030800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:22:58.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.342+0000 7f376e030800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.342+0000 7f376e030800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.342+0000 7f376e030800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.343+0000 7f376e030800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:58.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.343+0000 7f376e030800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.343+0000 7f376e030800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:22:58.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.343+0000 7f376e030800 20 searching for the correct realm 2024-03-04T12:22:58.352 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.346+0000 7f3768b2f640 0 -- 172.21.15.110:0/2904582903 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f375c01c040 msgr2=0x7f375c046430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:58.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.350+0000 7f3769330640 0 -- 172.21.15.110:0/2904582903 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f376003e950 msgr2=0x7f37600223f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:58.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.556+0000 7f376e030800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:22:58.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.556+0000 7f376e030800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:22:58.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.556+0000 7f376e030800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:22:58.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.556+0000 7f376e030800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:22:58.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.556+0000 7f376e030800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:22:58.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.556+0000 7f376e030800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:22:58.563 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.556+0000 7f376e030800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.563 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.556+0000 7f376e030800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.563 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.556+0000 7f376e030800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.563 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.556+0000 7f376e030800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:58.563 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.556+0000 7f376e030800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.557+0000 7f376e030800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:22:58.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.557+0000 7f376e030800 20 zone default found 2024-03-04T12:22:58.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.557+0000 7f376e030800 4 Realm: () 2024-03-04T12:22:58.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.557+0000 7f376e030800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:22:58.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.557+0000 7f376e030800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:22:58.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.557+0000 7f376e030800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:22:58.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.557+0000 7f376e030800 20 zonegroup default 2024-03-04T12:22:58.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.557+0000 7f376e030800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.565 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.557+0000 7f376e030800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.565 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.557+0000 7f376e030800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.565 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.557+0000 7f376e030800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.565 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.557+0000 7f376e030800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.565 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.557+0000 7f376e030800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.565 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.557+0000 7f376e030800 20 started sync module instance, tier type = 2024-03-04T12:22:58.565 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.557+0000 7f376e030800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:22:58.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.567+0000 7f376e030800 20 add_watcher() i=0 2024-03-04T12:22:58.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.567+0000 7f376e030800 20 add_watcher() i=1 2024-03-04T12:22:58.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.567+0000 7f376e030800 20 add_watcher() i=2 2024-03-04T12:22:58.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.567+0000 7f376e030800 20 add_watcher() i=3 2024-03-04T12:22:58.574 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.567+0000 7f376e030800 20 add_watcher() i=4 2024-03-04T12:22:58.574 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.567+0000 7f376e030800 20 add_watcher() i=5 2024-03-04T12:22:58.574 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.567+0000 7f376e030800 20 add_watcher() i=6 2024-03-04T12:22:58.574 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.568+0000 7f376e030800 20 add_watcher() i=7 2024-03-04T12:22:58.574 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.568+0000 7f376e030800 2 all 8 watchers are set, enabling cache 2024-03-04T12:22:58.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.570+0000 7f361f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:58.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.570+0000 7f376e030800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:22:58.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.570+0000 7f376e030800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:22:58.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.571+0000 7f376e030800 5 note: GC not initialized 2024-03-04T12:22:58.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.571+0000 7f361e7e4640 20 reqs_thread_entry: start 2024-03-04T12:22:58.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.571+0000 7f376e030800 20 init_complete bucket index max shards: 11 2024-03-04T12:22:58.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.571+0000 7f376e030800 20 Filter name: none 2024-03-04T12:22:58.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.571+0000 7f358ffff640 20 reqs_thread_entry: start 2024-03-04T12:22:58.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.571+0000 7f376e030800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.571+0000 7f376e030800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:22:58.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.571+0000 7f376e030800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.572+0000 7f376e030800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:22:58.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.572+0000 7f376e030800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:22:58.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.572+0000 7f376e030800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:22:58.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.572+0000 7f376e030800 20 INFO: main: starting shard=0 2024-03-04T12:22:58.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.572+0000 7f376e030800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:22:58.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.572+0000 7f376e030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:58.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.572+0000 7f376e030800 20 INFO: main: starting shard=1 2024-03-04T12:22:58.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.572+0000 7f376e030800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:22:58.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.573+0000 7f376e030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:58.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.573+0000 7f376e030800 20 INFO: main: starting shard=2 2024-03-04T12:22:58.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.573+0000 7f376e030800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:22:58.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.573+0000 7f376e030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:58.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.573+0000 7f376e030800 20 INFO: main: starting shard=3 2024-03-04T12:22:58.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.573+0000 7f376e030800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:22:58.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.574+0000 7f376e030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:58.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.574+0000 7f376e030800 20 INFO: main: starting shard=4 2024-03-04T12:22:58.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.574+0000 7f376e030800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:22:58.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.574+0000 7f376e030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:58.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.574+0000 7f376e030800 20 INFO: main: starting shard=5 2024-03-04T12:22:58.581 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.574+0000 7f376e030800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:58.581 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.575+0000 7f376e030800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-03-04T12:22:58.581 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.575+0000 7f376e030800 20 INFO: main: starting shard=6 2024-03-04T12:22:58.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.575+0000 7f376e030800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:22:58.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.575+0000 7f376e030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:58.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.575+0000 7f376e030800 20 INFO: main: starting shard=7 2024-03-04T12:22:58.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.575+0000 7f376e030800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:22:58.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.575+0000 7f376e030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:58.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.575+0000 7f376e030800 20 INFO: main: starting shard=8 2024-03-04T12:22:58.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.575+0000 7f376e030800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:58.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.576+0000 7f376e030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:58.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.576+0000 7f376e030800 20 INFO: main: starting shard=9 2024-03-04T12:22:58.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.576+0000 7f376e030800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:22:58.583 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.576+0000 7f376e030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:58.583 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.576+0000 7f376e030800 20 INFO: main: starting shard=10 2024-03-04T12:22:58.583 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.576+0000 7f376e030800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:22:58.583 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.577+0000 7f376e030800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:58.583 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.577+0000 7f376e030800 20 INFO: main: done 2024-03-04T12:22:58.583 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.577+0000 7f361f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:58.585 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.580+0000 7f376e030800 20 remove_watcher() i=0 2024-03-04T12:22:58.585 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.580+0000 7f376e030800 2 removed watcher, disabling cache 2024-03-04T12:22:58.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.581+0000 7f376e030800 20 remove_watcher() i=1 2024-03-04T12:22:58.587 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.582+0000 7f376e030800 20 remove_watcher() i=2 2024-03-04T12:22:58.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.583+0000 7f376e030800 20 remove_watcher() i=3 2024-03-04T12:22:58.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.584+0000 7f376e030800 20 remove_watcher() i=4 2024-03-04T12:22:58.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.585+0000 7f376e030800 20 remove_watcher() i=5 2024-03-04T12:22:58.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.586+0000 7f376e030800 20 remove_watcher() i=6 2024-03-04T12:22:58.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.587+0000 7f376e030800 20 remove_watcher() i=7 2024-03-04T12:22:58.603 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-04T12:22:58.633 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:22:58.633 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:22:58.666 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.660+0000 7fdb0e8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.667 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.661+0000 7fdb0e8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.667 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.661+0000 7fdb0e8c0800 20 realm 2024-03-04T12:22:58.667 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.661+0000 7fdb0e8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.667 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.661+0000 7fdb0e8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.667 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.661+0000 7fdb0e8c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:22:58.668 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.661+0000 7fdb0e8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.668 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.661+0000 7fdb0e8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:58.668 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.661+0000 7fdb0e8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.668 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.662+0000 7fdb0e8c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:58.668 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.662+0000 7fdb0e8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:58.669 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.663+0000 7fdb0e8c0800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:22:58.669 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.663+0000 7fdb0e8c0800 20 searching for the correct realm 2024-03-04T12:22:58.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:58.866+0000 7fdb03fff640 0 -- 172.21.15.110:0/228272293 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7fdafc027070 msgr2=0x7fdafc021880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:59.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.274+0000 7fdb0c3bc640 0 -- 172.21.15.110:0/228272293 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fdaf405e070 msgr2=0x7fdaf406b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:22:59.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.481+0000 7fdb0e8c0800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:22:59.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.481+0000 7fdb0e8c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:22:59.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.481+0000 7fdb0e8c0800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:22:59.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.481+0000 7fdb0e8c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:22:59.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.481+0000 7fdb0e8c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:22:59.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.481+0000 7fdb0e8c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:22:59.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.481+0000 7fdb0e8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:59.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.481+0000 7fdb0e8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:59.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.481+0000 7fdb0e8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:59.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.482+0000 7fdb0e8c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:59.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.482+0000 7fdb0e8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:59.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.482+0000 7fdb0e8c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:22:59.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.482+0000 7fdb0e8c0800 20 zone default found 2024-03-04T12:22:59.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.482+0000 7fdb0e8c0800 4 Realm: () 2024-03-04T12:22:59.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.482+0000 7fdb0e8c0800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:22:59.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.482+0000 7fdb0e8c0800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:22:59.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.482+0000 7fdb0e8c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:22:59.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.482+0000 7fdb0e8c0800 20 zonegroup default 2024-03-04T12:22:59.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.482+0000 7fdb0e8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:59.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.482+0000 7fdb0e8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:59.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.482+0000 7fdb0e8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:59.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.483+0000 7fdb0e8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:59.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.483+0000 7fdb0e8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:59.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.483+0000 7fdb0e8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:59.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.483+0000 7fdb0e8c0800 20 started sync module instance, tier type = 2024-03-04T12:22:59.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.483+0000 7fdb0e8c0800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:22:59.499 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.493+0000 7fdb0e8c0800 20 add_watcher() i=0 2024-03-04T12:22:59.499 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.493+0000 7fdb0e8c0800 20 add_watcher() i=1 2024-03-04T12:22:59.499 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.493+0000 7fdb0e8c0800 20 add_watcher() i=2 2024-03-04T12:22:59.499 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.493+0000 7fdb0e8c0800 20 add_watcher() i=3 2024-03-04T12:22:59.499 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.493+0000 7fdb0e8c0800 20 add_watcher() i=4 2024-03-04T12:22:59.499 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.493+0000 7fdb0e8c0800 20 add_watcher() i=5 2024-03-04T12:22:59.499 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.493+0000 7fdb0e8c0800 20 add_watcher() i=6 2024-03-04T12:22:59.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.494+0000 7fdb0e8c0800 20 add_watcher() i=7 2024-03-04T12:22:59.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.494+0000 7fdb0e8c0800 2 all 8 watchers are set, enabling cache 2024-03-04T12:22:59.501 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.496+0000 7fd9c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:59.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.496+0000 7fdb0e8c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:22:59.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.496+0000 7fdb0e8c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:22:59.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.496+0000 7fdb0e8c0800 5 note: GC not initialized 2024-03-04T12:22:59.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.496+0000 7fd9c1fdb640 20 reqs_thread_entry: start 2024-03-04T12:22:59.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.496+0000 7fdb0e8c0800 20 init_complete bucket index max shards: 11 2024-03-04T12:22:59.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.497+0000 7fdb0e8c0800 20 Filter name: none 2024-03-04T12:22:59.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.497+0000 7fd9337fe640 20 reqs_thread_entry: start 2024-03-04T12:22:59.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.497+0000 7fdb0e8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:59.504 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.497+0000 7fdb0e8c0800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:22:59.504 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.497+0000 7fdb0e8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:22:59.504 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.498+0000 7fdb0e8c0800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:22:59.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.498+0000 7fdb0e8c0800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:22:59.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.498+0000 7fdb0e8c0800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:22:59.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.498+0000 7fdb0e8c0800 20 INFO: main: starting shard=0 2024-03-04T12:22:59.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.498+0000 7fdb0e8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:22:59.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.498+0000 7fdb0e8c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:59.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.498+0000 7fdb0e8c0800 20 INFO: main: starting shard=1 2024-03-04T12:22:59.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.498+0000 7fdb0e8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:22:59.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.498+0000 7fdb0e8c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:59.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.498+0000 7fdb0e8c0800 20 INFO: main: starting shard=2 2024-03-04T12:22:59.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.498+0000 7fdb0e8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:22:59.506 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.499+0000 7fdb0e8c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:59.506 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.499+0000 7fdb0e8c0800 20 INFO: main: starting shard=3 2024-03-04T12:22:59.506 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.499+0000 7fdb0e8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:22:59.506 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.500+0000 7fdb0e8c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:59.506 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.500+0000 7fdb0e8c0800 20 INFO: main: starting shard=4 2024-03-04T12:22:59.507 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.500+0000 7fdb0e8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:22:59.507 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.500+0000 7fdb0e8c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:59.507 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.500+0000 7fdb0e8c0800 20 INFO: main: starting shard=5 2024-03-04T12:22:59.507 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.500+0000 7fdb0e8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:22:59.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.501+0000 7fdb0e8c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:59.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.501+0000 7fdb0e8c0800 20 INFO: main: starting shard=6 2024-03-04T12:22:59.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.501+0000 7fdb0e8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:22:59.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.501+0000 7fdb0e8c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:59.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.501+0000 7fdb0e8c0800 20 INFO: main: starting shard=7 2024-03-04T12:22:59.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.501+0000 7fdb0e8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:22:59.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.501+0000 7fdb0e8c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:59.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.501+0000 7fdb0e8c0800 20 INFO: main: starting shard=8 2024-03-04T12:22:59.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.501+0000 7fdb0e8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:22:59.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.502+0000 7fdb0e8c0800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-03-04T12:22:59.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.502+0000 7fdb0e8c0800 20 INFO: main: starting shard=9 2024-03-04T12:22:59.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.502+0000 7fdb0e8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:22:59.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.502+0000 7fdb0e8c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:59.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.502+0000 7fdb0e8c0800 20 INFO: main: starting shard=10 2024-03-04T12:22:59.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.502+0000 7fdb0e8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:22:59.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.503+0000 7fdb0e8c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:22:59.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.503+0000 7fdb0e8c0800 20 INFO: main: done 2024-03-04T12:22:59.510 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.504+0000 7fd9c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:22:59.512 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.506+0000 7fdb0e8c0800 20 remove_watcher() i=0 2024-03-04T12:22:59.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.506+0000 7fdb0e8c0800 2 removed watcher, disabling cache 2024-03-04T12:22:59.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.508+0000 7fdb0e8c0800 20 remove_watcher() i=1 2024-03-04T12:22:59.515 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.509+0000 7fdb0e8c0800 20 remove_watcher() i=2 2024-03-04T12:22:59.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.510+0000 7fdb0e8c0800 20 remove_watcher() i=3 2024-03-04T12:22:59.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.511+0000 7fdb0e8c0800 20 remove_watcher() i=4 2024-03-04T12:22:59.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.512+0000 7fdb0e8c0800 20 remove_watcher() i=5 2024-03-04T12:22:59.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.513+0000 7fdb0e8c0800 20 remove_watcher() i=6 2024-03-04T12:22:59.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.514+0000 7fdb0e8c0800 20 remove_watcher() i=7 2024-03-04T12:22:59.530 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: bucket check olh finds leftover OLH entries 2024-03-04T12:22:59.530 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:22:59.532 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-03-04T12:22:59.561 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:22:59.562 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:22:59.594 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.588+0000 7f7177333800 20 rados->read ofs=0 len=0 2024-03-04T12:22:59.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.589+0000 7f7177333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:59.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.589+0000 7f7177333800 20 realm 2024-03-04T12:22:59.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.590+0000 7f7177333800 20 rados->read ofs=0 len=0 2024-03-04T12:22:59.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.590+0000 7f7177333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:59.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.590+0000 7f7177333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:22:59.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.590+0000 7f7177333800 20 rados->read ofs=0 len=0 2024-03-04T12:22:59.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.590+0000 7f7177333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:22:59.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.590+0000 7f7177333800 20 rados->read ofs=0 len=0 2024-03-04T12:22:59.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.591+0000 7f7177333800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:22:59.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.591+0000 7f7177333800 20 rados->read ofs=0 len=0 2024-03-04T12:22:59.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.591+0000 7f7177333800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:22:59.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.591+0000 7f7177333800 20 searching for the correct realm 2024-03-04T12:22:59.599 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.594+0000 7f716bfff640 0 -- 172.21.15.110:0/1589060620 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f716401cc90 msgr2=0x7f716401a4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:22:59.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:22:59.800+0000 7f7172ff7640 0 -- 172.21.15.110:0/1589060620 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f715c050030 msgr2=0x7f715c0ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:00.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.006+0000 7f7177333800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:23:00.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.006+0000 7f7177333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:23:00.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.006+0000 7f7177333800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:23:00.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.006+0000 7f7177333800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:23:00.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.006+0000 7f7177333800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:23:00.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.006+0000 7f7177333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:23:00.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.006+0000 7f7177333800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.007+0000 7f7177333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.007+0000 7f7177333800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.014 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.007+0000 7f7177333800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:00.014 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.007+0000 7f7177333800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.007+0000 7f7177333800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:23:00.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.007+0000 7f7177333800 20 zone default found 2024-03-04T12:23:00.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.007+0000 7f7177333800 4 Realm: () 2024-03-04T12:23:00.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.007+0000 7f7177333800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:23:00.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.007+0000 7f7177333800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:23:00.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.007+0000 7f7177333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:23:00.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.007+0000 7f7177333800 20 zonegroup default 2024-03-04T12:23:00.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.007+0000 7f7177333800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.008+0000 7f7177333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.008+0000 7f7177333800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.008+0000 7f7177333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.016 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.008+0000 7f7177333800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.016 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.008+0000 7f7177333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.016 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.008+0000 7f7177333800 20 started sync module instance, tier type = 2024-03-04T12:23:00.016 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.008+0000 7f7177333800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:23:00.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.019+0000 7f7177333800 20 add_watcher() i=0 2024-03-04T12:23:00.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.019+0000 7f7177333800 20 add_watcher() i=1 2024-03-04T12:23:00.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.019+0000 7f7177333800 20 add_watcher() i=2 2024-03-04T12:23:00.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.019+0000 7f7177333800 20 add_watcher() i=3 2024-03-04T12:23:00.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.019+0000 7f7177333800 20 add_watcher() i=4 2024-03-04T12:23:00.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.019+0000 7f7177333800 20 add_watcher() i=5 2024-03-04T12:23:00.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.019+0000 7f7177333800 20 add_watcher() i=6 2024-03-04T12:23:00.026 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.020+0000 7f7177333800 20 add_watcher() i=7 2024-03-04T12:23:00.026 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.020+0000 7f7177333800 2 all 8 watchers are set, enabling cache 2024-03-04T12:23:00.027 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.022+0000 7f70297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:00.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.022+0000 7f7177333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:23:00.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.022+0000 7f7177333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:23:00.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.022+0000 7f7177333800 5 note: GC not initialized 2024-03-04T12:23:00.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.022+0000 7f6fa3fff640 20 reqs_thread_entry: start 2024-03-04T12:23:00.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.022+0000 7f7177333800 20 init_complete bucket index max shards: 11 2024-03-04T12:23:00.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.022+0000 7f7177333800 20 Filter name: none 2024-03-04T12:23:00.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.022+0000 7f6fa1ffb640 20 reqs_thread_entry: start 2024-03-04T12:23:00.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.022+0000 7f7177333800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:23:00.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.022+0000 7f7177333800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.023+0000 7f7177333800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:23:00.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.023+0000 7f7177333800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:23:00.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.023+0000 7f7177333800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:23:00.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.023+0000 7f7177333800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 : miss 2024-03-04T12:23:00.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.023+0000 7f7177333800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.030 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.023+0000 7f7177333800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:23:00.030 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.023+0000 7f7177333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 info.flags=0x17 2024-03-04T12:23:00.030 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.023+0000 7f7177333800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 to cache LRU end 2024-03-04T12:23:00.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.023+0000 7f7177333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:23:00.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.023+0000 7f7177333800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:23:00.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.023+0000 7f7177333800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 2024-03-04T12:23:00.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.024+0000 7f7177333800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:23:00.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.024+0000 7f7177333800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-04T12:23:00.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.024+0000 7f7177333800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:23:00.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.024+0000 7f7177333800 1 NOTICE: finished shard 1 (0 entries found) 2024-03-04T12:23:00.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.024+0000 7f7177333800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:23:00.032 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.025+0000 7f7177333800 1 NOTICE: finished shard 2 (0 entries found) 2024-03-04T12:23:00.032 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.025+0000 7f7177333800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:23:00.032 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.025+0000 7f7177333800 1 NOTICE: finished shard 3 (0 entries found) 2024-03-04T12:23:00.032 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.026+0000 7f7177333800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:23:00.032 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.026+0000 7f7177333800 1 NOTICE: finished shard 4 (0 entries found) 2024-03-04T12:23:00.032 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.026+0000 7f7177333800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:00.033 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.026+0000 7f7177333800 1 NOTICE: finished shard 5 (1 entries found) 2024-03-04T12:23:00.033 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.026+0000 7f7177333800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:23:00.033 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.027+0000 7f7177333800 1 NOTICE: finished shard 6 (0 entries found) 2024-03-04T12:23:00.033 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.027+0000 7f7177333800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:23:00.033 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.027+0000 7f7177333800 1 NOTICE: finished shard 7 (0 entries found) 2024-03-04T12:23:00.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.027+0000 7f7177333800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:00.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.028+0000 7f7177333800 1 NOTICE: finished shard 8 (1 entries found) 2024-03-04T12:23:00.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.028+0000 7f7177333800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:23:00.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.028+0000 7f7177333800 1 NOTICE: finished shard 9 (0 entries found) 2024-03-04T12:23:00.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.028+0000 7f7177333800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:23:00.035 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.029+0000 7f7177333800 1 NOTICE: finished shard 10 (0 entries found) 2024-03-04T12:23:00.035 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.029+0000 7f7177333800 1 NOTICE: finished all shards (2 entries found) 2024-03-04T12:23:00.035 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.029+0000 7f70297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:00.038 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.032+0000 7f7177333800 20 remove_watcher() i=0 2024-03-04T12:23:00.038 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.032+0000 7f7177333800 2 removed watcher, disabling cache 2024-03-04T12:23:00.039 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.033+0000 7f7177333800 20 remove_watcher() i=1 2024-03-04T12:23:00.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.034+0000 7f7177333800 20 remove_watcher() i=2 2024-03-04T12:23:00.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.035+0000 7f7177333800 20 remove_watcher() i=3 2024-03-04T12:23:00.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.036+0000 7f7177333800 20 remove_watcher() i=4 2024-03-04T12:23:00.043 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.037+0000 7f7177333800 20 remove_watcher() i=5 2024-03-04T12:23:00.044 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.038+0000 7f7177333800 20 remove_watcher() i=6 2024-03-04T12:23:00.045 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.039+0000 7f7177333800 20 remove_watcher() i=7 2024-03-04T12:23:00.055 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-03-04T12:23:00.055 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:23:00.056 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-04T12:23:00.088 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:23:00.088 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:23:00.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.115+0000 7fc0ed8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.117+0000 7fc0ed8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.117+0000 7fc0ed8c0800 20 realm 2024-03-04T12:23:00.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.117+0000 7fc0ed8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.117+0000 7fc0ed8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.117+0000 7fc0ed8c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:23:00.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.117+0000 7fc0ed8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.117+0000 7fc0ed8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.117+0000 7fc0ed8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.118+0000 7fc0ed8c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:00.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.118+0000 7fc0ed8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.118+0000 7fc0ed8c0800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:23:00.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.118+0000 7fc0ed8c0800 20 searching for the correct realm 2024-03-04T12:23:00.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.122+0000 7fc0e2bbb640 0 -- 172.21.15.110:0/4044032009 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x558325cb7890 msgr2=0x558325cb9d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:23:00.131 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.125+0000 7fc0eb3bc640 0 -- 172.21.15.110:0/4044032009 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fc0d40a7ec0 msgr2=0x7fc0d40a1e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:23:00.338 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.331+0000 7fc0ed8c0800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:23:00.338 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.331+0000 7fc0ed8c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:23:00.338 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.331+0000 7fc0ed8c0800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:23:00.338 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.331+0000 7fc0ed8c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:23:00.338 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.331+0000 7fc0ed8c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:23:00.338 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.331+0000 7fc0ed8c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:23:00.338 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.331+0000 7fc0ed8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.338 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.331+0000 7fc0ed8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.338 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.331+0000 7fc0ed8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.339 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.332+0000 7fc0ed8c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:00.339 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.332+0000 7fc0ed8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.332+0000 7fc0ed8c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:23:00.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.332+0000 7fc0ed8c0800 20 zone default found 2024-03-04T12:23:00.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.332+0000 7fc0ed8c0800 4 Realm: () 2024-03-04T12:23:00.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.332+0000 7fc0ed8c0800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:23:00.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.332+0000 7fc0ed8c0800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:23:00.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.332+0000 7fc0ed8c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:23:00.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.332+0000 7fc0ed8c0800 20 zonegroup default 2024-03-04T12:23:00.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.332+0000 7fc0ed8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.332+0000 7fc0ed8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.332+0000 7fc0ed8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.333+0000 7fc0ed8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.341 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.333+0000 7fc0ed8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.341 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.333+0000 7fc0ed8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.341 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.333+0000 7fc0ed8c0800 20 started sync module instance, tier type = 2024-03-04T12:23:00.341 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.333+0000 7fc0ed8c0800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:23:00.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.344+0000 7fc0ed8c0800 20 add_watcher() i=0 2024-03-04T12:23:00.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.344+0000 7fc0ed8c0800 20 add_watcher() i=1 2024-03-04T12:23:00.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.344+0000 7fc0ed8c0800 20 add_watcher() i=2 2024-03-04T12:23:00.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.344+0000 7fc0ed8c0800 20 add_watcher() i=3 2024-03-04T12:23:00.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.344+0000 7fc0ed8c0800 20 add_watcher() i=4 2024-03-04T12:23:00.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.344+0000 7fc0ed8c0800 20 add_watcher() i=5 2024-03-04T12:23:00.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.344+0000 7fc0ed8c0800 20 add_watcher() i=6 2024-03-04T12:23:00.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.345+0000 7fc0ed8c0800 20 add_watcher() i=7 2024-03-04T12:23:00.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.345+0000 7fc0ed8c0800 2 all 8 watchers are set, enabling cache 2024-03-04T12:23:00.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.346+0000 7fbfa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:00.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.346+0000 7fc0ed8c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:23:00.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.346+0000 7fc0ed8c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:23:00.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.347+0000 7fc0ed8c0800 5 note: GC not initialized 2024-03-04T12:23:00.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.347+0000 7fbfa0fe1640 20 reqs_thread_entry: start 2024-03-04T12:23:00.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.347+0000 7fc0ed8c0800 20 init_complete bucket index max shards: 11 2024-03-04T12:23:00.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.347+0000 7fc0ed8c0800 20 Filter name: none 2024-03-04T12:23:00.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.347+0000 7fbf1a7fc640 20 reqs_thread_entry: start 2024-03-04T12:23:00.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.347+0000 7fc0ed8c0800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:23:00.354 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.347+0000 7fc0ed8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.347+0000 7fc0ed8c0800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:23:00.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.347+0000 7fc0ed8c0800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:23:00.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.347+0000 7fc0ed8c0800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:23:00.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.347+0000 7fc0ed8c0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 : miss 2024-03-04T12:23:00.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.347+0000 7fc0ed8c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.348+0000 7fc0ed8c0800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:23:00.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.348+0000 7fc0ed8c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 info.flags=0x17 2024-03-04T12:23:00.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.348+0000 7fc0ed8c0800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 to cache LRU end 2024-03-04T12:23:00.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.348+0000 7fc0ed8c0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:23:00.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.348+0000 7fc0ed8c0800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:23:00.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.348+0000 7fc0ed8c0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 2024-03-04T12:23:00.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.348+0000 7fc0ed8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:23:00.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.349+0000 7fc0ed8c0800 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-04T12:23:00.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.349+0000 7fc0ed8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:23:00.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.350+0000 7fc0ed8c0800 1 NOTICE: finished shard 1 (0 entries removed) 2024-03-04T12:23:00.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.350+0000 7fc0ed8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:23:00.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.350+0000 7fc0ed8c0800 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-04T12:23:00.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.350+0000 7fc0ed8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:23:00.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.351+0000 7fc0ed8c0800 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-04T12:23:00.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.351+0000 7fc0ed8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:23:00.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.351+0000 7fc0ed8c0800 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-04T12:23:00.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.351+0000 7fc0ed8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:00.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.352+0000 7fc0ed8c0800 20 get_obj_state: octx=0x558325a493d0 obj=check-bucket:d state=0x558325cea368 s->prefetch_data=0 2024-03-04T12:23:00.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.352+0000 7fc0ed8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:23:00.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.352+0000 7fc0ed8c0800 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-04T12:23:00.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.352+0000 7fc0ed8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:23:00.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.352+0000 7fc0ed8c0800 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-04T12:23:00.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.352+0000 7fc0ed8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:00.360 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.353+0000 7fc0ed8c0800 20 get_obj_state: octx=0x558325a495b0 obj=check-bucket:c state=0x558325ce7e98 s->prefetch_data=0 2024-03-04T12:23:00.360 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.353+0000 7fc0ed8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:23:00.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.353+0000 7fc0ed8c0800 1 NOTICE: finished shard 9 (0 entries removed) 2024-03-04T12:23:00.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.353+0000 7fc0ed8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:23:00.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.354+0000 7fc0ed8c0800 1 NOTICE: finished shard 10 (0 entries removed) 2024-03-04T12:23:00.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.354+0000 7fc0ed8c0800 20 get_obj_state: setting s->obj_tag to 78x8ds18462jjqmar9czad8rdpns26di 2024-03-04T12:23:00.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.354+0000 7fc0ed8c0800 20 get_obj_state_impl: setting s->olh_tag to g05ombvey3eownigwx06yj1uukdp2x09 2024-03-04T12:23:00.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.354+0000 7fc0ed8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:00.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.354+0000 7fc0ed8c0800 20 get_obj_state: setting s->obj_tag to jp33uhozx81c991zulw7fau25seqs187 2024-03-04T12:23:00.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.354+0000 7fc0ed8c0800 20 get_obj_state_impl: setting s->olh_tag to wmiczewhj4k2enityxbw2yvmmajf6m3i 2024-03-04T12:23:00.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.354+0000 7fc0ed8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:00.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.354+0000 7fc0ed8c0800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-03-04T12:23:00.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.354+0000 7fc0ed8c0800 20 olh_log_entry: epoch=4 op=3 key=d[Vh4xkaC14YLwD5TIFfpXAbB0SDhNxw4] 2024-03-04T12:23:00.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.354+0000 7fc0ed8c0800 20 get_obj_state: octx=0x558325d235b0 obj=check-bucket:_:Vh4xkaC14YLwD5TIFfpXAbB0SDhNxw4_d state=0x558325ce6a18 s->prefetch_data=0 2024-03-04T12:23:00.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.354+0000 7fc0ed8c0800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-03-04T12:23:00.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.354+0000 7fc0ed8c0800 20 olh_log_entry: epoch=4 op=3 key=c[cDgxfGJLxdiAi-UeW2qJhBcy-w-nL33] 2024-03-04T12:23:00.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.354+0000 7fc0ed8c0800 20 get_obj_state: octx=0x558325d435b0 obj=check-bucket:_:cDgxfGJLxdiAi-UeW2qJhBcy-w-nL33_c state=0x558325d50ee8 s->prefetch_data=0 2024-03-04T12:23:00.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.356+0000 7fc0ed8c0800 20 get_obj_state: octx=0x558325d435b0 obj=check-bucket:c state=0x558325d4deb8 s->prefetch_data=0 2024-03-04T12:23:00.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.356+0000 7fc0ed8c0800 20 get_obj_state: setting s->obj_tag to jp33uhozx81c991zulw7fau25seqs187 2024-03-04T12:23:00.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.356+0000 7fc0ed8c0800 20 get_obj_state_impl: setting s->olh_tag to wmiczewhj4k2enityxbw2yvmmajf6m3i 2024-03-04T12:23:00.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.356+0000 7fc0ed8c0800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wmiczewhj4k2enityxbw2yvmmajf6m3i 2024-03-04T12:23:00.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.356+0000 7fc0ed8c0800 20 get_obj_state: octx=0x558325d235b0 obj=check-bucket:d state=0x558325d4fa28 s->prefetch_data=0 2024-03-04T12:23:00.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.356+0000 7fc0ed8c0800 20 get_obj_state: setting s->obj_tag to 78x8ds18462jjqmar9czad8rdpns26di 2024-03-04T12:23:00.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.356+0000 7fc0ed8c0800 20 get_obj_state_impl: setting s->olh_tag to g05ombvey3eownigwx06yj1uukdp2x09 2024-03-04T12:23:00.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.356+0000 7fc0ed8c0800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g05ombvey3eownigwx06yj1uukdp2x09 2024-03-04T12:23:00.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.358+0000 7fc0ed8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:00.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.359+0000 7fc0ed8c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:00.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.359+0000 7fc0ed8c0800 1 NOTICE: finished shard 8 (1 entries removed) 2024-03-04T12:23:00.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.360+0000 7fc0ed8c0800 1 NOTICE: finished shard 5 (1 entries removed) 2024-03-04T12:23:00.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.360+0000 7fc0ed8c0800 1 NOTICE: finished all shards (2 entries removed) 2024-03-04T12:23:00.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.361+0000 7fbfa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:00.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.363+0000 7fc0ed8c0800 20 remove_watcher() i=0 2024-03-04T12:23:00.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.363+0000 7fc0ed8c0800 2 removed watcher, disabling cache 2024-03-04T12:23:00.370 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.364+0000 7fc0ed8c0800 20 remove_watcher() i=1 2024-03-04T12:23:00.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.365+0000 7fc0ed8c0800 20 remove_watcher() i=2 2024-03-04T12:23:00.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.367+0000 7fc0ed8c0800 20 remove_watcher() i=3 2024-03-04T12:23:00.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.367+0000 7fc0ed8c0800 20 remove_watcher() i=4 2024-03-04T12:23:00.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.368+0000 7fc0ed8c0800 20 remove_watcher() i=5 2024-03-04T12:23:00.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.369+0000 7fc0ed8c0800 20 remove_watcher() i=6 2024-03-04T12:23:00.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.370+0000 7fc0ed8c0800 20 remove_watcher() i=7 2024-03-04T12:23:00.387 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-04T12:23:00.416 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:23:00.417 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:23:00.449 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.443+0000 7fc91e93c800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.445+0000 7fc91e93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.445+0000 7fc91e93c800 20 realm 2024-03-04T12:23:00.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.445+0000 7fc91e93c800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.445+0000 7fc91e93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.445+0000 7fc91e93c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:23:00.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.445+0000 7fc91e93c800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.445+0000 7fc91e93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.445+0000 7fc91e93c800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.446+0000 7fc91e93c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:00.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.446+0000 7fc91e93c800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.447+0000 7fc91e93c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:23:00.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.447+0000 7fc91e93c800 20 searching for the correct realm 2024-03-04T12:23:00.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.450+0000 7fc911ef9640 0 -- 172.21.15.110:0/1421710053 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x5582a37a9f20 msgr2=0x5582a37ac3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:00.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.454+0000 7fc91a6fa640 0 -- 172.21.15.110:0/1421710053 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fc90406b0a0 msgr2=0x7fc904076440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:00.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.459+0000 7fc91e93c800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:23:00.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.459+0000 7fc91e93c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:23:00.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.459+0000 7fc91e93c800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:23:00.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.459+0000 7fc91e93c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:23:00.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.459+0000 7fc91e93c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:23:00.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.459+0000 7fc91e93c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:23:00.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.459+0000 7fc91e93c800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.459+0000 7fc91e93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.459+0000 7fc91e93c800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.459+0000 7fc91e93c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:00.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.459+0000 7fc91e93c800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.460+0000 7fc91e93c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:23:00.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.460+0000 7fc91e93c800 20 zone default found 2024-03-04T12:23:00.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.460+0000 7fc91e93c800 4 Realm: () 2024-03-04T12:23:00.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.460+0000 7fc91e93c800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:23:00.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.460+0000 7fc91e93c800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:23:00.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.460+0000 7fc91e93c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:23:00.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.460+0000 7fc91e93c800 20 zonegroup default 2024-03-04T12:23:00.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.460+0000 7fc91e93c800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.460+0000 7fc91e93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.460+0000 7fc91e93c800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.468 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.460+0000 7fc91e93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.468 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.460+0000 7fc91e93c800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.468 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.461+0000 7fc91e93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.468 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.461+0000 7fc91e93c800 20 started sync module instance, tier type = 2024-03-04T12:23:00.468 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.461+0000 7fc91e93c800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:23:00.476 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.470+0000 7fc91e93c800 20 add_watcher() i=0 2024-03-04T12:23:00.476 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.470+0000 7fc91e93c800 20 add_watcher() i=1 2024-03-04T12:23:00.476 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.470+0000 7fc91e93c800 20 add_watcher() i=2 2024-03-04T12:23:00.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.470+0000 7fc91e93c800 20 add_watcher() i=3 2024-03-04T12:23:00.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.470+0000 7fc91e93c800 20 add_watcher() i=4 2024-03-04T12:23:00.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.470+0000 7fc91e93c800 20 add_watcher() i=5 2024-03-04T12:23:00.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.470+0000 7fc91e93c800 20 add_watcher() i=6 2024-03-04T12:23:00.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.471+0000 7fc91e93c800 20 add_watcher() i=7 2024-03-04T12:23:00.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.471+0000 7fc91e93c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:23:00.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.473+0000 7fc7d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:00.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.474+0000 7fc91e93c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:23:00.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.474+0000 7fc91e93c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:23:00.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.474+0000 7fc91e93c800 5 note: GC not initialized 2024-03-04T12:23:00.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.474+0000 7fc74b7fe640 20 reqs_thread_entry: start 2024-03-04T12:23:00.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.474+0000 7fc91e93c800 20 init_complete bucket index max shards: 11 2024-03-04T12:23:00.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.474+0000 7fc91e93c800 20 Filter name: none 2024-03-04T12:23:00.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.474+0000 7fc7497fa640 20 reqs_thread_entry: start 2024-03-04T12:23:00.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.474+0000 7fc91e93c800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.474+0000 7fc91e93c800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:23:00.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.474+0000 7fc91e93c800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.475+0000 7fc91e93c800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:23:00.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.475+0000 7fc91e93c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:23:00.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.475+0000 7fc91e93c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:23:00.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.475+0000 7fc91e93c800 20 INFO: main: starting shard=0 2024-03-04T12:23:00.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.475+0000 7fc91e93c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:23:00.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.475+0000 7fc91e93c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.475+0000 7fc91e93c800 20 INFO: main: starting shard=1 2024-03-04T12:23:00.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.475+0000 7fc91e93c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:23:00.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.476+0000 7fc91e93c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.476+0000 7fc91e93c800 20 INFO: main: starting shard=2 2024-03-04T12:23:00.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.476+0000 7fc91e93c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:23:00.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.476+0000 7fc91e93c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.476+0000 7fc91e93c800 20 INFO: main: starting shard=3 2024-03-04T12:23:00.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.476+0000 7fc91e93c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:23:00.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.477+0000 7fc91e93c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.477+0000 7fc91e93c800 20 INFO: main: starting shard=4 2024-03-04T12:23:00.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.477+0000 7fc91e93c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:23:00.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.477+0000 7fc91e93c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.477+0000 7fc91e93c800 20 INFO: main: starting shard=5 2024-03-04T12:23:00.485 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.477+0000 7fc91e93c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:00.485 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.478+0000 7fc91e93c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.485 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.478+0000 7fc91e93c800 20 INFO: main: starting shard=6 2024-03-04T12:23:00.485 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.478+0000 7fc91e93c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:23:00.485 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.478+0000 7fc91e93c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.485 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.478+0000 7fc91e93c800 20 INFO: main: starting shard=7 2024-03-04T12:23:00.485 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.478+0000 7fc91e93c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:23:00.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.478+0000 7fc91e93c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.478+0000 7fc91e93c800 20 INFO: main: starting shard=8 2024-03-04T12:23:00.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.478+0000 7fc91e93c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:00.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.479+0000 7fc91e93c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.479+0000 7fc91e93c800 20 INFO: main: starting shard=9 2024-03-04T12:23:00.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.479+0000 7fc91e93c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:23:00.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.479+0000 7fc91e93c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.479+0000 7fc91e93c800 20 INFO: main: starting shard=10 2024-03-04T12:23:00.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.479+0000 7fc91e93c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:23:00.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.480+0000 7fc91e93c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.480+0000 7fc91e93c800 20 INFO: main: done 2024-03-04T12:23:00.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.480+0000 7fc7d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:00.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.483+0000 7fc91e93c800 20 remove_watcher() i=0 2024-03-04T12:23:00.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.483+0000 7fc91e93c800 2 removed watcher, disabling cache 2024-03-04T12:23:00.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.484+0000 7fc91e93c800 20 remove_watcher() i=1 2024-03-04T12:23:00.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.485+0000 7fc91e93c800 20 remove_watcher() i=2 2024-03-04T12:23:00.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.486+0000 7fc91e93c800 20 remove_watcher() i=3 2024-03-04T12:23:00.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.487+0000 7fc91e93c800 20 remove_watcher() i=4 2024-03-04T12:23:00.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.488+0000 7fc91e93c800 20 remove_watcher() i=5 2024-03-04T12:23:00.494 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.489+0000 7fc91e93c800 20 remove_watcher() i=6 2024-03-04T12:23:00.495 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.490+0000 7fc91e93c800 20 remove_watcher() i=7 2024-03-04T12:23:00.506 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-04T12:23:00.535 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:23:00.536 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:23:00.568 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.562+0000 7f4b3bf11800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.570 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.564+0000 7f4b3bf11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.570 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.564+0000 7f4b3bf11800 20 realm 2024-03-04T12:23:00.570 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.564+0000 7f4b3bf11800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.570 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.564+0000 7f4b3bf11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.564+0000 7f4b3bf11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:23:00.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.564+0000 7f4b3bf11800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.564+0000 7f4b3bf11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.564+0000 7f4b3bf11800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.572 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.565+0000 7f4b3bf11800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:00.572 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.565+0000 7f4b3bf11800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.572 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.565+0000 7f4b3bf11800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:23:00.572 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.565+0000 7f4b3bf11800 20 searching for the correct realm 2024-03-04T12:23:00.574 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.568+0000 7f4b3a20e640 0 -- 172.21.15.110:0/4089406312 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f4b2402e040 msgr2=0x7f4b24010950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:00.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.572+0000 7f4b39a0d640 0 -- 172.21.15.110:0/4089406312 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f4b24052450 msgr2=0x7f4b240528d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:00.785 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.778+0000 7f4b3bf11800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:23:00.785 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.778+0000 7f4b3bf11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:23:00.785 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.778+0000 7f4b3bf11800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:23:00.785 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.778+0000 7f4b3bf11800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:23:00.785 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.778+0000 7f4b3bf11800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:23:00.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.778+0000 7f4b3bf11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:23:00.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.778+0000 7f4b3bf11800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.778+0000 7f4b3bf11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.778+0000 7f4b3bf11800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.779+0000 7f4b3bf11800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:00.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.779+0000 7f4b3bf11800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.779+0000 7f4b3bf11800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:23:00.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.779+0000 7f4b3bf11800 20 zone default found 2024-03-04T12:23:00.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.779+0000 7f4b3bf11800 4 Realm: () 2024-03-04T12:23:00.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.779+0000 7f4b3bf11800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:23:00.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.779+0000 7f4b3bf11800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:23:00.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.779+0000 7f4b3bf11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:23:00.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.779+0000 7f4b3bf11800 20 zonegroup default 2024-03-04T12:23:00.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.779+0000 7f4b3bf11800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.779+0000 7f4b3bf11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.787 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.779+0000 7f4b3bf11800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.787 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.780+0000 7f4b3bf11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.787 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.780+0000 7f4b3bf11800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.787 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.780+0000 7f4b3bf11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.787 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.780+0000 7f4b3bf11800 20 started sync module instance, tier type = 2024-03-04T12:23:00.788 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.780+0000 7f4b3bf11800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:23:00.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.790+0000 7f4b3bf11800 20 add_watcher() i=0 2024-03-04T12:23:00.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.790+0000 7f4b3bf11800 20 add_watcher() i=1 2024-03-04T12:23:00.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.790+0000 7f4b3bf11800 20 add_watcher() i=2 2024-03-04T12:23:00.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.790+0000 7f4b3bf11800 20 add_watcher() i=3 2024-03-04T12:23:00.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.790+0000 7f4b3bf11800 20 add_watcher() i=4 2024-03-04T12:23:00.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.790+0000 7f4b3bf11800 20 add_watcher() i=5 2024-03-04T12:23:00.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.790+0000 7f4b3bf11800 20 add_watcher() i=6 2024-03-04T12:23:00.797 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.790+0000 7f4b3bf11800 20 add_watcher() i=7 2024-03-04T12:23:00.797 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.790+0000 7f4b3bf11800 2 all 8 watchers are set, enabling cache 2024-03-04T12:23:00.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.792+0000 7f49eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:00.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.793+0000 7f4b3bf11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:23:00.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.793+0000 7f4b3bf11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:23:00.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.793+0000 7f4b3bf11800 5 note: GC not initialized 2024-03-04T12:23:00.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.793+0000 7f49ea7fc640 20 reqs_thread_entry: start 2024-03-04T12:23:00.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.793+0000 7f4b3bf11800 20 init_complete bucket index max shards: 11 2024-03-04T12:23:00.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.793+0000 7f4b3bf11800 20 Filter name: none 2024-03-04T12:23:00.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.793+0000 7f495bfff640 20 reqs_thread_entry: start 2024-03-04T12:23:00.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.793+0000 7f4b3bf11800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.793+0000 7f4b3bf11800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:23:00.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.793+0000 7f4b3bf11800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.794+0000 7f4b3bf11800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:23:00.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.794+0000 7f4b3bf11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:23:00.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.794+0000 7f4b3bf11800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:23:00.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.794+0000 7f4b3bf11800 20 INFO: main: starting shard=0 2024-03-04T12:23:00.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.794+0000 7f4b3bf11800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:23:00.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.794+0000 7f4b3bf11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.794+0000 7f4b3bf11800 20 INFO: main: starting shard=1 2024-03-04T12:23:00.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.794+0000 7f4b3bf11800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:23:00.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.795+0000 7f4b3bf11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.795+0000 7f4b3bf11800 20 INFO: main: starting shard=2 2024-03-04T12:23:00.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.795+0000 7f4b3bf11800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:23:00.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.796+0000 7f4b3bf11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.796+0000 7f4b3bf11800 20 INFO: main: starting shard=3 2024-03-04T12:23:00.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.796+0000 7f4b3bf11800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:23:00.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.796+0000 7f4b3bf11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.796+0000 7f4b3bf11800 20 INFO: main: starting shard=4 2024-03-04T12:23:00.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.796+0000 7f4b3bf11800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:23:00.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.797+0000 7f4b3bf11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.797+0000 7f4b3bf11800 20 INFO: main: starting shard=5 2024-03-04T12:23:00.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.797+0000 7f4b3bf11800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:00.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.797+0000 7f4b3bf11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.797+0000 7f4b3bf11800 20 INFO: main: starting shard=6 2024-03-04T12:23:00.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.797+0000 7f4b3bf11800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:23:00.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.798+0000 7f4b3bf11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.798+0000 7f4b3bf11800 20 INFO: main: starting shard=7 2024-03-04T12:23:00.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.798+0000 7f4b3bf11800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:23:00.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.798+0000 7f4b3bf11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.798+0000 7f4b3bf11800 20 INFO: main: starting shard=8 2024-03-04T12:23:00.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.798+0000 7f4b3bf11800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:00.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.798+0000 7f4b3bf11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.798+0000 7f4b3bf11800 20 INFO: main: starting shard=9 2024-03-04T12:23:00.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.798+0000 7f4b3bf11800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:23:00.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.799+0000 7f4b3bf11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.799+0000 7f4b3bf11800 20 INFO: main: starting shard=10 2024-03-04T12:23:00.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.799+0000 7f4b3bf11800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:23:00.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.799+0000 7f4b3bf11800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:00.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.799+0000 7f4b3bf11800 20 INFO: main: done 2024-03-04T12:23:00.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.800+0000 7f49eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:00.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.803+0000 7f4b3bf11800 20 remove_watcher() i=0 2024-03-04T12:23:00.809 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.803+0000 7f4b3bf11800 2 removed watcher, disabling cache 2024-03-04T12:23:00.809 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.804+0000 7f4b3bf11800 20 remove_watcher() i=1 2024-03-04T12:23:00.810 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.805+0000 7f4b3bf11800 20 remove_watcher() i=2 2024-03-04T12:23:00.812 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.806+0000 7f4b3bf11800 20 remove_watcher() i=3 2024-03-04T12:23:00.812 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.807+0000 7f4b3bf11800 20 remove_watcher() i=4 2024-03-04T12:23:00.813 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.808+0000 7f4b3bf11800 20 remove_watcher() i=5 2024-03-04T12:23:00.814 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.809+0000 7f4b3bf11800 20 remove_watcher() i=6 2024-03-04T12:23:00.815 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.810+0000 7f4b3bf11800 20 remove_watcher() i=7 2024-03-04T12:23:00.825 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-03-04T12:23:00.825 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:23:00.827 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-03-04T12:23:00.857 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:23:00.857 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:23:00.891 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.885+0000 7faba6615800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.892 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.886+0000 7faba6615800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.892 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.886+0000 7faba6615800 20 realm 2024-03-04T12:23:00.892 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.886+0000 7faba6615800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.892 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.886+0000 7faba6615800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.893 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.886+0000 7faba6615800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:23:00.893 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.886+0000 7faba6615800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.893 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.886+0000 7faba6615800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:00.893 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.886+0000 7faba6615800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.893 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.887+0000 7faba6615800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:00.894 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.887+0000 7faba6615800 20 rados->read ofs=0 len=0 2024-03-04T12:23:00.894 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.887+0000 7faba6615800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:23:00.894 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.887+0000 7faba6615800 20 searching for the correct realm 2024-03-04T12:23:00.895 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:00.889+0000 7faba1bde640 0 -- 172.21.15.110:0/149742480 >> [v2:172.21.15.110:6800/2482344533,v1:172.21.15.110:6801/2482344533] conn(0x56113e1d7cb0 msgr2=0x7fab9c057f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:23:01.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.094+0000 7faba23df640 0 -- 172.21.15.110:0/149742480 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7fab8c066040 msgr2=0x7fab8c03a660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:01.106 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.100+0000 7faba6615800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:23:01.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.100+0000 7faba6615800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:23:01.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.100+0000 7faba6615800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:23:01.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.100+0000 7faba6615800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:23:01.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.100+0000 7faba6615800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:23:01.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.100+0000 7faba6615800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:23:01.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.100+0000 7faba6615800 20 rados->read ofs=0 len=0 2024-03-04T12:23:01.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.100+0000 7faba6615800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:01.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.100+0000 7faba6615800 20 rados->read ofs=0 len=0 2024-03-04T12:23:01.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.101+0000 7faba6615800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:01.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.101+0000 7faba6615800 20 rados->read ofs=0 len=0 2024-03-04T12:23:01.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.101+0000 7faba6615800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:23:01.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.101+0000 7faba6615800 20 zone default found 2024-03-04T12:23:01.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.101+0000 7faba6615800 4 Realm: () 2024-03-04T12:23:01.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.101+0000 7faba6615800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:23:01.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.101+0000 7faba6615800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:23:01.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.101+0000 7faba6615800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:23:01.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.101+0000 7faba6615800 20 zonegroup default 2024-03-04T12:23:01.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.101+0000 7faba6615800 20 rados->read ofs=0 len=0 2024-03-04T12:23:01.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.101+0000 7faba6615800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:01.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.101+0000 7faba6615800 20 rados->read ofs=0 len=0 2024-03-04T12:23:01.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.102+0000 7faba6615800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:01.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.102+0000 7faba6615800 20 rados->read ofs=0 len=0 2024-03-04T12:23:01.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.102+0000 7faba6615800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:01.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.102+0000 7faba6615800 20 started sync module instance, tier type = 2024-03-04T12:23:01.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.102+0000 7faba6615800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:23:01.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.113+0000 7faba6615800 20 add_watcher() i=0 2024-03-04T12:23:01.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.113+0000 7faba6615800 20 add_watcher() i=1 2024-03-04T12:23:01.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.113+0000 7faba6615800 20 add_watcher() i=2 2024-03-04T12:23:01.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.113+0000 7faba6615800 20 add_watcher() i=3 2024-03-04T12:23:01.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.113+0000 7faba6615800 20 add_watcher() i=4 2024-03-04T12:23:01.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.113+0000 7faba6615800 20 add_watcher() i=5 2024-03-04T12:23:01.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.113+0000 7faba6615800 20 add_watcher() i=6 2024-03-04T12:23:01.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.114+0000 7faba6615800 20 add_watcher() i=7 2024-03-04T12:23:01.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.114+0000 7faba6615800 2 all 8 watchers are set, enabling cache 2024-03-04T12:23:01.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.116+0000 7faa537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:01.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.116+0000 7faba6615800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:23:01.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.116+0000 7faba6615800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:23:01.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.116+0000 7faba6615800 5 note: GC not initialized 2024-03-04T12:23:01.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.117+0000 7faa527fc640 20 reqs_thread_entry: start 2024-03-04T12:23:01.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.117+0000 7faba6615800 20 init_complete bucket index max shards: 11 2024-03-04T12:23:01.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.117+0000 7faba6615800 20 Filter name: none 2024-03-04T12:23:01.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.117+0000 7fa9c3fff640 20 reqs_thread_entry: start 2024-03-04T12:23:01.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.117+0000 7faba6615800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:23:01.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.117+0000 7faba6615800 20 rados->read ofs=0 len=0 2024-03-04T12:23:01.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.117+0000 7faba6615800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:23:01.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.117+0000 7faba6615800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:23:01.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.117+0000 7faba6615800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:23:01.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.117+0000 7faba6615800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 : miss 2024-03-04T12:23:01.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.117+0000 7faba6615800 20 rados->read ofs=0 len=0 2024-03-04T12:23:01.125 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.118+0000 7faba6615800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:23:01.125 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.118+0000 7faba6615800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 info.flags=0x17 2024-03-04T12:23:01.125 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.118+0000 7faba6615800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 to cache LRU end 2024-03-04T12:23:01.125 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.118+0000 7faba6615800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:23:01.125 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.118+0000 7faba6615800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:23:01.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.118+0000 7faba6615800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 2024-03-04T12:23:01.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.118+0000 7faba6615800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:23:01.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.118+0000 7faba6615800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-04T12:23:01.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.118+0000 7faba6615800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:23:01.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.119+0000 7faba6615800 1 NOTICE: finished shard 1 (0 entries found) 2024-03-04T12:23:01.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.119+0000 7faba6615800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:23:01.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.119+0000 7faba6615800 1 NOTICE: finished shard 2 (0 entries found) 2024-03-04T12:23:01.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.119+0000 7faba6615800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:23:01.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.120+0000 7faba6615800 1 NOTICE: finished shard 3 (0 entries found) 2024-03-04T12:23:01.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.120+0000 7faba6615800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:23:01.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.120+0000 7faba6615800 1 NOTICE: finished shard 4 (0 entries found) 2024-03-04T12:23:01.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.120+0000 7faba6615800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:01.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.121+0000 7faba6615800 1 NOTICE: finished shard 5 (0 entries found) 2024-03-04T12:23:01.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.121+0000 7faba6615800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:23:01.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.121+0000 7faba6615800 1 NOTICE: finished shard 6 (0 entries found) 2024-03-04T12:23:01.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.121+0000 7faba6615800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:23:01.128 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.121+0000 7faba6615800 1 NOTICE: finished shard 7 (0 entries found) 2024-03-04T12:23:01.128 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.121+0000 7faba6615800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:01.128 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.122+0000 7faba6615800 1 NOTICE: finished shard 8 (0 entries found) 2024-03-04T12:23:01.128 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.122+0000 7faba6615800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:23:01.128 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.122+0000 7faba6615800 1 NOTICE: finished shard 9 (0 entries found) 2024-03-04T12:23:01.128 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.122+0000 7faba6615800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:23:01.129 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.123+0000 7faba6615800 1 NOTICE: finished shard 10 (0 entries found) 2024-03-04T12:23:01.129 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.123+0000 7faba6615800 1 NOTICE: finished all shards (0 entries found) 2024-03-04T12:23:01.129 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.124+0000 7faa537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:01.132 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.126+0000 7faba6615800 20 remove_watcher() i=0 2024-03-04T12:23:01.132 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.126+0000 7faba6615800 2 removed watcher, disabling cache 2024-03-04T12:23:01.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.128+0000 7faba6615800 20 remove_watcher() i=1 2024-03-04T12:23:01.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.129+0000 7faba6615800 20 remove_watcher() i=2 2024-03-04T12:23:01.135 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.130+0000 7faba6615800 20 remove_watcher() i=3 2024-03-04T12:23:01.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.131+0000 7faba6615800 20 remove_watcher() i=4 2024-03-04T12:23:01.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.132+0000 7faba6615800 20 remove_watcher() i=5 2024-03-04T12:23:01.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.133+0000 7faba6615800 20 remove_watcher() i=6 2024-03-04T12:23:01.139 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:01.134+0000 7faba6615800 20 remove_watcher() i=7 2024-03-04T12:23:01.150 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-03-04T12:23:01.150 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:23:01.152 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.152 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.172 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.172 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.193 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.193 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.260 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-03-04T12:23:01.260 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:23:01.261 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.261 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.329 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.329 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.517 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.517 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.565 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.565 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.587 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.587 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.637 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.637 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.660 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.660 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.704 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.705 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.725 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.726 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.770 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.770 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.791 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.791 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.835 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.836 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.856 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.856 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.901 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:01.901 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:01.922 INFO:tasks.workunit.client.0.smithi110.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-03-04T12:23:02.303 INFO:tasks.workunit.client.0.smithi110.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-03-04T12:23:03.692 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:03.692 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:03.769 INFO:tasks.workunit.client.0.smithi110.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:23:03.798 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-04T12:23:03.801 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:23:03.802 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:23:03.837 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:03.831+0000 7f14d60c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:03.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:03.834+0000 7f14d60c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:03.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:03.834+0000 7f14d60c0800 20 realm 2024-03-04T12:23:03.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:03.834+0000 7f14d60c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:03.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:03.834+0000 7f14d60c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:03.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:03.834+0000 7f14d60c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:23:03.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:03.834+0000 7f14d60c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:03.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:03.834+0000 7f14d60c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:03.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:03.834+0000 7f14d60c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:03.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:03.835+0000 7f14d60c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:03.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:03.835+0000 7f14d60c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:03.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:03.836+0000 7f14d60c0800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:23:03.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:03.836+0000 7f14d60c0800 20 searching for the correct realm 2024-03-04T12:23:03.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:03.839+0000 7f14d43c4640 0 -- 172.21.15.110:0/3604455797 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f14bc0d2c20 msgr2=0x7f14bc001040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:03.848 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:03.843+0000 7f14d3bc3640 0 -- 172.21.15.110:0/3604455797 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f14bc071040 msgr2=0x7f14bc0ba130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:23:04.055 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.049+0000 7f14d60c0800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:23:04.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.049+0000 7f14d60c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:23:04.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.049+0000 7f14d60c0800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:23:04.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.049+0000 7f14d60c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:23:04.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.049+0000 7f14d60c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:23:04.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.049+0000 7f14d60c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:23:04.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.049+0000 7f14d60c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.049+0000 7f14d60c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.049+0000 7f14d60c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.050+0000 7f14d60c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:04.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.050+0000 7f14d60c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.058 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.050+0000 7f14d60c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:23:04.058 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.050+0000 7f14d60c0800 20 zone default found 2024-03-04T12:23:04.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.050+0000 7f14d60c0800 4 Realm: () 2024-03-04T12:23:04.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.050+0000 7f14d60c0800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:23:04.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.050+0000 7f14d60c0800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:23:04.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.050+0000 7f14d60c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:23:04.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.050+0000 7f14d60c0800 20 zonegroup default 2024-03-04T12:23:04.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.050+0000 7f14d60c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.050+0000 7f14d60c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.050+0000 7f14d60c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.051+0000 7f14d60c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.051+0000 7f14d60c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.051+0000 7f14d60c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.051+0000 7f14d60c0800 20 started sync module instance, tier type = 2024-03-04T12:23:04.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.051+0000 7f14d60c0800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:23:04.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.061+0000 7f14d60c0800 20 add_watcher() i=0 2024-03-04T12:23:04.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.061+0000 7f14d60c0800 20 add_watcher() i=1 2024-03-04T12:23:04.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.061+0000 7f14d60c0800 20 add_watcher() i=2 2024-03-04T12:23:04.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.061+0000 7f14d60c0800 20 add_watcher() i=3 2024-03-04T12:23:04.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.061+0000 7f14d60c0800 20 add_watcher() i=4 2024-03-04T12:23:04.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.061+0000 7f14d60c0800 20 add_watcher() i=5 2024-03-04T12:23:04.068 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.061+0000 7f14d60c0800 20 add_watcher() i=6 2024-03-04T12:23:04.068 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.062+0000 7f14d60c0800 20 add_watcher() i=7 2024-03-04T12:23:04.068 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.062+0000 7f14d60c0800 2 all 8 watchers are set, enabling cache 2024-03-04T12:23:04.070 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.064+0000 7f1389fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:04.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.065+0000 7f14d60c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:23:04.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.065+0000 7f14d60c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:23:04.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.065+0000 7f14d60c0800 5 note: GC not initialized 2024-03-04T12:23:04.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.065+0000 7f1388fe1640 20 reqs_thread_entry: start 2024-03-04T12:23:04.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.065+0000 7f14d60c0800 20 init_complete bucket index max shards: 11 2024-03-04T12:23:04.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.065+0000 7f14d60c0800 20 Filter name: none 2024-03-04T12:23:04.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.065+0000 7f13027fc640 20 reqs_thread_entry: start 2024-03-04T12:23:04.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.065+0000 7f14d60c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.065+0000 7f14d60c0800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:23:04.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.065+0000 7f14d60c0800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.066+0000 7f14d60c0800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:23:04.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.066+0000 7f14d60c0800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:23:04.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.066+0000 7f14d60c0800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:23:04.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.066+0000 7f14d60c0800 20 INFO: main: starting shard=0 2024-03-04T12:23:04.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.066+0000 7f14d60c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:23:04.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.066+0000 7f14d60c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.066+0000 7f14d60c0800 20 INFO: main: starting shard=1 2024-03-04T12:23:04.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.066+0000 7f14d60c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:23:04.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.067+0000 7f14d60c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.067+0000 7f14d60c0800 20 INFO: main: starting shard=2 2024-03-04T12:23:04.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.067+0000 7f14d60c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:23:04.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.067+0000 7f14d60c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.067+0000 7f14d60c0800 20 INFO: main: starting shard=3 2024-03-04T12:23:04.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.067+0000 7f14d60c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:23:04.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.068+0000 7f14d60c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.068+0000 7f14d60c0800 20 INFO: main: starting shard=4 2024-03-04T12:23:04.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.068+0000 7f14d60c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:23:04.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.068+0000 7f14d60c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.068+0000 7f14d60c0800 20 INFO: main: starting shard=5 2024-03-04T12:23:04.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.068+0000 7f14d60c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:04.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.069+0000 7f14d60c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.069+0000 7f14d60c0800 20 INFO: main: starting shard=6 2024-03-04T12:23:04.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.069+0000 7f14d60c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:23:04.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.069+0000 7f14d60c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.069+0000 7f14d60c0800 20 INFO: main: starting shard=7 2024-03-04T12:23:04.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.069+0000 7f14d60c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:23:04.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.070+0000 7f14d60c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.070+0000 7f14d60c0800 20 INFO: main: starting shard=8 2024-03-04T12:23:04.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.070+0000 7f14d60c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:04.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.070+0000 7f14d60c0800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-04T12:23:04.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.070+0000 7f14d60c0800 20 INFO: main: starting shard=9 2024-03-04T12:23:04.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.070+0000 7f14d60c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:23:04.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.071+0000 7f14d60c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.071+0000 7f14d60c0800 20 INFO: main: starting shard=10 2024-03-04T12:23:04.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.071+0000 7f14d60c0800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:23:04.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.071+0000 7f14d60c0800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.071+0000 7f14d60c0800 20 INFO: main: done 2024-03-04T12:23:04.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.072+0000 7f1389fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:04.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.075+0000 7f14d60c0800 20 remove_watcher() i=0 2024-03-04T12:23:04.081 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.075+0000 7f14d60c0800 2 removed watcher, disabling cache 2024-03-04T12:23:04.081 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.076+0000 7f14d60c0800 20 remove_watcher() i=1 2024-03-04T12:23:04.082 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.077+0000 7f14d60c0800 20 remove_watcher() i=2 2024-03-04T12:23:04.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.078+0000 7f14d60c0800 20 remove_watcher() i=3 2024-03-04T12:23:04.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.079+0000 7f14d60c0800 20 remove_watcher() i=4 2024-03-04T12:23:04.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.080+0000 7f14d60c0800 20 remove_watcher() i=5 2024-03-04T12:23:04.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.081+0000 7f14d60c0800 20 remove_watcher() i=6 2024-03-04T12:23:04.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.082+0000 7f14d60c0800 20 remove_watcher() i=7 2024-03-04T12:23:04.100 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:04.100 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:04.120 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:04.120 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:04.140 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:04.140 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:04.215 INFO:tasks.workunit.client.0.smithi110.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:23:04.216 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-04T12:23:04.246 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:23:04.246 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:23:04.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.272+0000 7f0006129800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.274+0000 7f0006129800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.274+0000 7f0006129800 20 realm 2024-03-04T12:23:04.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.274+0000 7f0006129800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.274+0000 7f0006129800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.274+0000 7f0006129800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:23:04.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.274+0000 7f0006129800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.274+0000 7f0006129800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.274+0000 7f0006129800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.275+0000 7f0006129800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:04.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.275+0000 7f0006129800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.275+0000 7f0006129800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:23:04.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.275+0000 7f0006129800 20 searching for the correct realm 2024-03-04T12:23:04.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.279+0000 7efffbfff640 0 -- 172.21.15.110:0/3393741155 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7efff4036070 msgr2=0x7efff4004780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:04.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.283+0000 7f0002551640 0 -- 172.21.15.110:0/3393741155 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7effec091960 msgr2=0x7effec06a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:04.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.286+0000 7f0006129800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:23:04.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.286+0000 7f0006129800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:23:04.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.286+0000 7f0006129800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:23:04.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.286+0000 7f0006129800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:23:04.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.286+0000 7f0006129800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:23:04.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.286+0000 7f0006129800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:23:04.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.286+0000 7f0006129800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.286+0000 7f0006129800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.286+0000 7f0006129800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.287+0000 7f0006129800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:04.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.287+0000 7f0006129800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.287+0000 7f0006129800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:23:04.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.287+0000 7f0006129800 20 zone default found 2024-03-04T12:23:04.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.287+0000 7f0006129800 4 Realm: () 2024-03-04T12:23:04.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.287+0000 7f0006129800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:23:04.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.287+0000 7f0006129800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:23:04.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.287+0000 7f0006129800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:23:04.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.287+0000 7f0006129800 20 zonegroup default 2024-03-04T12:23:04.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.287+0000 7f0006129800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.287+0000 7f0006129800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.287+0000 7f0006129800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.288+0000 7f0006129800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.288+0000 7f0006129800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.288+0000 7f0006129800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.288+0000 7f0006129800 20 started sync module instance, tier type = 2024-03-04T12:23:04.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.288+0000 7f0006129800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:23:04.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.297+0000 7f0006129800 20 add_watcher() i=0 2024-03-04T12:23:04.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.297+0000 7f0006129800 20 add_watcher() i=1 2024-03-04T12:23:04.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.297+0000 7f0006129800 20 add_watcher() i=2 2024-03-04T12:23:04.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.297+0000 7f0006129800 20 add_watcher() i=3 2024-03-04T12:23:04.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.297+0000 7f0006129800 20 add_watcher() i=4 2024-03-04T12:23:04.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.297+0000 7f0006129800 20 add_watcher() i=5 2024-03-04T12:23:04.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.297+0000 7f0006129800 20 add_watcher() i=6 2024-03-04T12:23:04.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.298+0000 7f0006129800 20 add_watcher() i=7 2024-03-04T12:23:04.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.298+0000 7f0006129800 2 all 8 watchers are set, enabling cache 2024-03-04T12:23:04.306 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.300+0000 7efeb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:04.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.301+0000 7f0006129800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:23:04.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.301+0000 7f0006129800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:23:04.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.301+0000 7f0006129800 5 note: GC not initialized 2024-03-04T12:23:04.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.301+0000 7efeb27fc640 20 reqs_thread_entry: start 2024-03-04T12:23:04.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.301+0000 7f0006129800 20 init_complete bucket index max shards: 11 2024-03-04T12:23:04.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.301+0000 7f0006129800 20 Filter name: none 2024-03-04T12:23:04.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.301+0000 7efe23fff640 20 reqs_thread_entry: start 2024-03-04T12:23:04.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.301+0000 7f0006129800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.301+0000 7f0006129800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:23:04.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.301+0000 7f0006129800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.302+0000 7f0006129800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:23:04.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.302+0000 7f0006129800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:23:04.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.302+0000 7f0006129800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:23:04.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.302+0000 7f0006129800 20 INFO: main: starting shard=0 2024-03-04T12:23:04.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.302+0000 7f0006129800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:23:04.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.303+0000 7f0006129800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.303+0000 7f0006129800 20 INFO: main: starting shard=1 2024-03-04T12:23:04.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.303+0000 7f0006129800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:23:04.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.303+0000 7f0006129800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.303+0000 7f0006129800 20 INFO: main: starting shard=2 2024-03-04T12:23:04.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.303+0000 7f0006129800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:23:04.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.303+0000 7f0006129800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.303+0000 7f0006129800 20 INFO: main: starting shard=3 2024-03-04T12:23:04.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.303+0000 7f0006129800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:23:04.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.304+0000 7f0006129800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.304+0000 7f0006129800 20 INFO: main: starting shard=4 2024-03-04T12:23:04.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.304+0000 7f0006129800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:23:04.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.304+0000 7f0006129800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.304+0000 7f0006129800 20 INFO: main: starting shard=5 2024-03-04T12:23:04.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.304+0000 7f0006129800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:04.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.305+0000 7f0006129800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-04T12:23:04.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.305+0000 7f0006129800 20 INFO: main: starting shard=6 2024-03-04T12:23:04.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.305+0000 7f0006129800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:23:04.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.305+0000 7f0006129800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.305+0000 7f0006129800 20 INFO: main: starting shard=7 2024-03-04T12:23:04.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.305+0000 7f0006129800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:23:04.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.306+0000 7f0006129800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.306+0000 7f0006129800 20 INFO: main: starting shard=8 2024-03-04T12:23:04.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.306+0000 7f0006129800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:04.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.306+0000 7f0006129800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.306+0000 7f0006129800 20 INFO: main: starting shard=9 2024-03-04T12:23:04.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.306+0000 7f0006129800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:23:04.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.307+0000 7f0006129800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.307+0000 7f0006129800 20 INFO: main: starting shard=10 2024-03-04T12:23:04.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.307+0000 7f0006129800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:23:04.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.307+0000 7f0006129800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.307+0000 7f0006129800 20 INFO: main: done 2024-03-04T12:23:04.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.308+0000 7efeb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:04.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.310+0000 7f0006129800 20 remove_watcher() i=0 2024-03-04T12:23:04.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.310+0000 7f0006129800 2 removed watcher, disabling cache 2024-03-04T12:23:04.317 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.311+0000 7f0006129800 20 remove_watcher() i=1 2024-03-04T12:23:04.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.312+0000 7f0006129800 20 remove_watcher() i=2 2024-03-04T12:23:04.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.313+0000 7f0006129800 20 remove_watcher() i=3 2024-03-04T12:23:04.320 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.314+0000 7f0006129800 20 remove_watcher() i=4 2024-03-04T12:23:04.321 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.315+0000 7f0006129800 20 remove_watcher() i=5 2024-03-04T12:23:04.322 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.316+0000 7f0006129800 20 remove_watcher() i=6 2024-03-04T12:23:04.323 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.317+0000 7f0006129800 20 remove_watcher() i=7 2024-03-04T12:23:04.336 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:04.336 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:04.358 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:04.358 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:04.378 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:04.378 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:04.453 INFO:tasks.workunit.client.0.smithi110.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:23:04.454 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-03-04T12:23:04.483 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:23:04.483 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:23:04.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.510+0000 7f276e131800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.512+0000 7f276e131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.512+0000 7f276e131800 20 realm 2024-03-04T12:23:04.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.512+0000 7f276e131800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.512+0000 7f276e131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.512+0000 7f276e131800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:23:04.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.512+0000 7f276e131800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.512+0000 7f276e131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.512+0000 7f276e131800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.513+0000 7f276e131800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:04.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.513+0000 7f276e131800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.513+0000 7f276e131800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:23:04.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.513+0000 7f276e131800 20 searching for the correct realm 2024-03-04T12:23:04.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.517+0000 7f276a5d4640 0 -- 172.21.15.110:0/3858248155 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f27540671f0 msgr2=0x7f275405de30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:04.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.520+0000 7f2769dd3640 0 -- 172.21.15.110:0/3858248155 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f275405d530 msgr2=0x7f275405f900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:04.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.726+0000 7f276e131800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:23:04.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.726+0000 7f276e131800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:23:04.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.726+0000 7f276e131800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:23:04.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.726+0000 7f276e131800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:23:04.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.726+0000 7f276e131800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:23:04.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.726+0000 7f276e131800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:23:04.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.726+0000 7f276e131800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.726+0000 7f276e131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.726+0000 7f276e131800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.727+0000 7f276e131800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:04.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.727+0000 7f276e131800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.727+0000 7f276e131800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:23:04.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.727+0000 7f276e131800 20 zone default found 2024-03-04T12:23:04.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.727+0000 7f276e131800 4 Realm: () 2024-03-04T12:23:04.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.727+0000 7f276e131800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:23:04.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.727+0000 7f276e131800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:23:04.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.727+0000 7f276e131800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:23:04.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.727+0000 7f276e131800 20 zonegroup default 2024-03-04T12:23:04.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.727+0000 7f276e131800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.727+0000 7f276e131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.727+0000 7f276e131800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.728+0000 7f276e131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.728+0000 7f276e131800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.728+0000 7f276e131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.728+0000 7f276e131800 20 started sync module instance, tier type = 2024-03-04T12:23:04.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.728+0000 7f276e131800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:23:04.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.738+0000 7f276e131800 20 add_watcher() i=0 2024-03-04T12:23:04.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.738+0000 7f276e131800 20 add_watcher() i=1 2024-03-04T12:23:04.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.738+0000 7f276e131800 20 add_watcher() i=2 2024-03-04T12:23:04.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.738+0000 7f276e131800 20 add_watcher() i=3 2024-03-04T12:23:04.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.738+0000 7f276e131800 20 add_watcher() i=4 2024-03-04T12:23:04.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.738+0000 7f276e131800 20 add_watcher() i=5 2024-03-04T12:23:04.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.738+0000 7f276e131800 20 add_watcher() i=6 2024-03-04T12:23:04.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.739+0000 7f276e131800 20 add_watcher() i=7 2024-03-04T12:23:04.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.739+0000 7f276e131800 2 all 8 watchers are set, enabling cache 2024-03-04T12:23:04.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.741+0000 7f261b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:04.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.741+0000 7f276e131800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:23:04.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.741+0000 7f276e131800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:23:04.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.741+0000 7f276e131800 5 note: GC not initialized 2024-03-04T12:23:04.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.741+0000 7f261a7fc640 20 reqs_thread_entry: start 2024-03-04T12:23:04.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.741+0000 7f276e131800 20 init_complete bucket index max shards: 11 2024-03-04T12:23:04.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.741+0000 7f276e131800 20 Filter name: none 2024-03-04T12:23:04.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.741+0000 7f258bfff640 20 reqs_thread_entry: start 2024-03-04T12:23:04.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.742+0000 7f276e131800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.742+0000 7f276e131800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:23:04.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.742+0000 7f276e131800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.742+0000 7f276e131800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:23:04.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.742+0000 7f276e131800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:23:04.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.742+0000 7f276e131800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:23:04.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.742+0000 7f276e131800 20 INFO: main: starting shard=0 2024-03-04T12:23:04.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.742+0000 7f276e131800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:23:04.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.743+0000 7f276e131800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.743+0000 7f276e131800 20 INFO: main: starting shard=1 2024-03-04T12:23:04.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.743+0000 7f276e131800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:23:04.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.743+0000 7f276e131800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-04T12:23:04.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.743+0000 7f276e131800 20 INFO: main: starting shard=2 2024-03-04T12:23:04.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.743+0000 7f276e131800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:23:04.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.744+0000 7f276e131800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.744+0000 7f276e131800 20 INFO: main: starting shard=3 2024-03-04T12:23:04.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.744+0000 7f276e131800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:23:04.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.744+0000 7f276e131800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.745+0000 7f276e131800 20 INFO: main: starting shard=4 2024-03-04T12:23:04.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.745+0000 7f276e131800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:23:04.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.745+0000 7f276e131800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.745+0000 7f276e131800 20 INFO: main: starting shard=5 2024-03-04T12:23:04.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.745+0000 7f276e131800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:04.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.745+0000 7f276e131800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.745+0000 7f276e131800 20 INFO: main: starting shard=6 2024-03-04T12:23:04.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.745+0000 7f276e131800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:23:04.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.746+0000 7f276e131800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.746+0000 7f276e131800 20 INFO: main: starting shard=7 2024-03-04T12:23:04.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.746+0000 7f276e131800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:23:04.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.746+0000 7f276e131800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.746+0000 7f276e131800 20 INFO: main: starting shard=8 2024-03-04T12:23:04.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.746+0000 7f276e131800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:04.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.746+0000 7f276e131800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.746+0000 7f276e131800 20 INFO: main: starting shard=9 2024-03-04T12:23:04.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.746+0000 7f276e131800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:23:04.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.747+0000 7f276e131800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.747+0000 7f276e131800 20 INFO: main: starting shard=10 2024-03-04T12:23:04.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.747+0000 7f276e131800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:23:04.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.748+0000 7f276e131800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:04.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.748+0000 7f276e131800 20 INFO: main: done 2024-03-04T12:23:04.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.748+0000 7f261b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:04.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.751+0000 7f276e131800 20 remove_watcher() i=0 2024-03-04T12:23:04.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.751+0000 7f276e131800 2 removed watcher, disabling cache 2024-03-04T12:23:04.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.752+0000 7f276e131800 20 remove_watcher() i=1 2024-03-04T12:23:04.759 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.753+0000 7f276e131800 20 remove_watcher() i=2 2024-03-04T12:23:04.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.754+0000 7f276e131800 20 remove_watcher() i=3 2024-03-04T12:23:04.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.755+0000 7f276e131800 20 remove_watcher() i=4 2024-03-04T12:23:04.762 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.756+0000 7f276e131800 20 remove_watcher() i=5 2024-03-04T12:23:04.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.757+0000 7f276e131800 20 remove_watcher() i=6 2024-03-04T12:23:04.764 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.758+0000 7f276e131800 20 remove_watcher() i=7 2024-03-04T12:23:04.776 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:04.776 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:04.796 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:04.796 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:04.870 INFO:tasks.workunit.client.0.smithi110.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:23:04.872 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-03-04T12:23:04.901 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:23:04.901 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:23:04.935 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.929+0000 7fb903067800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.936 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.930+0000 7fb903067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.936 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.930+0000 7fb903067800 20 realm 2024-03-04T12:23:04.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.930+0000 7fb903067800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.930+0000 7fb903067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.930+0000 7fb903067800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:23:04.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.930+0000 7fb903067800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.930+0000 7fb903067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:04.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.930+0000 7fb903067800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.931+0000 7fb903067800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:04.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.931+0000 7fb903067800 20 rados->read ofs=0 len=0 2024-03-04T12:23:04.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.932+0000 7fb903067800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:23:04.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.932+0000 7fb903067800 20 searching for the correct realm 2024-03-04T12:23:04.940 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:04.934+0000 7fb8f8362640 0 -- 172.21.15.110:0/3122516520 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7fb8f0016070 msgr2=0x7fb8f003f4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:05.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.140+0000 7fb900b63640 0 -- 172.21.15.110:0/3122516520 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fb8e8097cb0 msgr2=0x7fb8e80c2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:23:05.352 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.346+0000 7fb903067800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:23:05.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.346+0000 7fb903067800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:23:05.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.346+0000 7fb903067800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:23:05.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.346+0000 7fb903067800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:23:05.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.346+0000 7fb903067800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:23:05.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.346+0000 7fb903067800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:23:05.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.346+0000 7fb903067800 20 rados->read ofs=0 len=0 2024-03-04T12:23:05.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.346+0000 7fb903067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:05.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.346+0000 7fb903067800 20 rados->read ofs=0 len=0 2024-03-04T12:23:05.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.347+0000 7fb903067800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:05.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.347+0000 7fb903067800 20 rados->read ofs=0 len=0 2024-03-04T12:23:05.354 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.347+0000 7fb903067800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:23:05.354 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.347+0000 7fb903067800 20 zone default found 2024-03-04T12:23:05.354 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.347+0000 7fb903067800 4 Realm: () 2024-03-04T12:23:05.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.347+0000 7fb903067800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:23:05.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.347+0000 7fb903067800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:23:05.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.347+0000 7fb903067800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:23:05.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.347+0000 7fb903067800 20 zonegroup default 2024-03-04T12:23:05.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.347+0000 7fb903067800 20 rados->read ofs=0 len=0 2024-03-04T12:23:05.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.347+0000 7fb903067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:05.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.347+0000 7fb903067800 20 rados->read ofs=0 len=0 2024-03-04T12:23:05.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.348+0000 7fb903067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:05.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.348+0000 7fb903067800 20 rados->read ofs=0 len=0 2024-03-04T12:23:05.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.348+0000 7fb903067800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:05.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.348+0000 7fb903067800 20 started sync module instance, tier type = 2024-03-04T12:23:05.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.348+0000 7fb903067800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:23:05.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.359+0000 7fb903067800 20 add_watcher() i=0 2024-03-04T12:23:05.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.359+0000 7fb903067800 20 add_watcher() i=1 2024-03-04T12:23:05.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.359+0000 7fb903067800 20 add_watcher() i=2 2024-03-04T12:23:05.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.359+0000 7fb903067800 20 add_watcher() i=3 2024-03-04T12:23:05.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.359+0000 7fb903067800 20 add_watcher() i=4 2024-03-04T12:23:05.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.359+0000 7fb903067800 20 add_watcher() i=5 2024-03-04T12:23:05.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.359+0000 7fb903067800 20 add_watcher() i=6 2024-03-04T12:23:05.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.360+0000 7fb903067800 20 add_watcher() i=7 2024-03-04T12:23:05.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.360+0000 7fb903067800 2 all 8 watchers are set, enabling cache 2024-03-04T12:23:05.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.362+0000 7fb7b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:05.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.362+0000 7fb903067800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:23:05.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.362+0000 7fb903067800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:23:05.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.362+0000 7fb903067800 5 note: GC not initialized 2024-03-04T12:23:05.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.362+0000 7fb7b5fe3640 20 reqs_thread_entry: start 2024-03-04T12:23:05.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.362+0000 7fb903067800 20 init_complete bucket index max shards: 11 2024-03-04T12:23:05.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.362+0000 7fb903067800 20 Filter name: none 2024-03-04T12:23:05.370 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.363+0000 7fb7277fe640 20 reqs_thread_entry: start 2024-03-04T12:23:05.370 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.363+0000 7fb903067800 20 rados->read ofs=0 len=0 2024-03-04T12:23:05.370 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.363+0000 7fb903067800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:23:05.370 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.363+0000 7fb903067800 20 rados->read ofs=0 len=0 2024-03-04T12:23:05.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.363+0000 7fb903067800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:23:05.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.363+0000 7fb903067800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:23:05.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.363+0000 7fb903067800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-04T12:23:05.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.363+0000 7fb903067800 20 INFO: main: starting shard=0 2024-03-04T12:23:05.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.363+0000 7fb903067800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:23:05.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.364+0000 7fb903067800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:05.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.364+0000 7fb903067800 20 INFO: main: starting shard=1 2024-03-04T12:23:05.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.364+0000 7fb903067800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:23:05.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.365+0000 7fb903067800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:05.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.365+0000 7fb903067800 20 INFO: main: starting shard=2 2024-03-04T12:23:05.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.365+0000 7fb903067800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:23:05.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.365+0000 7fb903067800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:05.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.365+0000 7fb903067800 20 INFO: main: starting shard=3 2024-03-04T12:23:05.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.365+0000 7fb903067800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:23:05.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.366+0000 7fb903067800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:05.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.366+0000 7fb903067800 20 INFO: main: starting shard=4 2024-03-04T12:23:05.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.366+0000 7fb903067800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:23:05.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.366+0000 7fb903067800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:05.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.366+0000 7fb903067800 20 INFO: main: starting shard=5 2024-03-04T12:23:05.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.366+0000 7fb903067800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:05.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.367+0000 7fb903067800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:05.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.367+0000 7fb903067800 20 INFO: main: starting shard=6 2024-03-04T12:23:05.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.367+0000 7fb903067800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:23:05.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.367+0000 7fb903067800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:05.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.367+0000 7fb903067800 20 INFO: main: starting shard=7 2024-03-04T12:23:05.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.367+0000 7fb903067800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:23:05.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.368+0000 7fb903067800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:05.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.368+0000 7fb903067800 20 INFO: main: starting shard=8 2024-03-04T12:23:05.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.368+0000 7fb903067800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:05.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.368+0000 7fb903067800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:05.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.368+0000 7fb903067800 20 INFO: main: starting shard=9 2024-03-04T12:23:05.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.368+0000 7fb903067800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:23:05.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.369+0000 7fb903067800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:23:05.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.369+0000 7fb903067800 20 INFO: main: starting shard=10 2024-03-04T12:23:05.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.369+0000 7fb903067800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:23:05.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.369+0000 7fb903067800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-04T12:23:05.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.369+0000 7fb903067800 20 INFO: main: done 2024-03-04T12:23:05.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.370+0000 7fb7b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:05.378 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.372+0000 7fb903067800 20 remove_watcher() i=0 2024-03-04T12:23:05.378 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.372+0000 7fb903067800 2 removed watcher, disabling cache 2024-03-04T12:23:05.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.373+0000 7fb903067800 20 remove_watcher() i=1 2024-03-04T12:23:05.380 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.374+0000 7fb903067800 20 remove_watcher() i=2 2024-03-04T12:23:05.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.376+0000 7fb903067800 20 remove_watcher() i=3 2024-03-04T12:23:05.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.377+0000 7fb903067800 20 remove_watcher() i=4 2024-03-04T12:23:05.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.378+0000 7fb903067800 20 remove_watcher() i=5 2024-03-04T12:23:05.384 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.379+0000 7fb903067800 20 remove_watcher() i=6 2024-03-04T12:23:05.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:05.380+0000 7fb903067800 20 remove_watcher() i=7 2024-03-04T12:23:05.397 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:05.397 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:05.418 INFO:tasks.workunit.client.0.smithi110.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-03-04T12:23:05.802 INFO:tasks.workunit.client.0.smithi110.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-03-04T12:23:06.190 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-03-04T12:23:06.218 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:23:06.218 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:23:06.252 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.246+0000 7f4cd5024800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.253 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.247+0000 7f4cd5024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.253 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.247+0000 7f4cd5024800 20 realm 2024-03-04T12:23:06.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.247+0000 7f4cd5024800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.247+0000 7f4cd5024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.247+0000 7f4cd5024800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:23:06.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.247+0000 7f4cd5024800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.247+0000 7f4cd5024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.247+0000 7f4cd5024800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.255 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.248+0000 7f4cd5024800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:06.255 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.248+0000 7f4cd5024800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.255 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.249+0000 7f4cd5024800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:23:06.255 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.249+0000 7f4cd5024800 20 searching for the correct realm 2024-03-04T12:23:06.256 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.251+0000 7f4cd2b27640 0 -- 172.21.15.110:0/1988444813 >> [v2:172.21.15.110:6800/2482344533,v1:172.21.15.110:6801/2482344533] conn(0x7f4ccc025040 msgr2=0x7f4ccc025420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:06.261 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.255+0000 7f4cd3328640 0 -- 172.21.15.110:0/1988444813 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f4cbc03a060 msgr2=0x7f4cbc073a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:06.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.261+0000 7f4cd5024800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:23:06.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.261+0000 7f4cd5024800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:23:06.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.261+0000 7f4cd5024800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:23:06.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.261+0000 7f4cd5024800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:23:06.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.261+0000 7f4cd5024800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:23:06.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.261+0000 7f4cd5024800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:23:06.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.261+0000 7f4cd5024800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.261+0000 7f4cd5024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.261+0000 7f4cd5024800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.261+0000 7f4cd5024800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:06.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.261+0000 7f4cd5024800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.262+0000 7f4cd5024800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:23:06.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.262+0000 7f4cd5024800 20 zone default found 2024-03-04T12:23:06.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.262+0000 7f4cd5024800 4 Realm: () 2024-03-04T12:23:06.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.262+0000 7f4cd5024800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:23:06.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.262+0000 7f4cd5024800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:23:06.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.262+0000 7f4cd5024800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:23:06.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.262+0000 7f4cd5024800 20 zonegroup default 2024-03-04T12:23:06.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.262+0000 7f4cd5024800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.262+0000 7f4cd5024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.262+0000 7f4cd5024800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.262+0000 7f4cd5024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.262+0000 7f4cd5024800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.262+0000 7f4cd5024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.262+0000 7f4cd5024800 20 started sync module instance, tier type = 2024-03-04T12:23:06.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.262+0000 7f4cd5024800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:23:06.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.272+0000 7f4cd5024800 20 add_watcher() i=0 2024-03-04T12:23:06.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.272+0000 7f4cd5024800 20 add_watcher() i=1 2024-03-04T12:23:06.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.272+0000 7f4cd5024800 20 add_watcher() i=2 2024-03-04T12:23:06.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.272+0000 7f4cd5024800 20 add_watcher() i=3 2024-03-04T12:23:06.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.272+0000 7f4cd5024800 20 add_watcher() i=4 2024-03-04T12:23:06.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.272+0000 7f4cd5024800 20 add_watcher() i=5 2024-03-04T12:23:06.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.272+0000 7f4cd5024800 20 add_watcher() i=6 2024-03-04T12:23:06.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.273+0000 7f4cd5024800 20 add_watcher() i=7 2024-03-04T12:23:06.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.273+0000 7f4cd5024800 2 all 8 watchers are set, enabling cache 2024-03-04T12:23:06.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.275+0000 7f4b897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:06.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.275+0000 7f4cd5024800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:23:06.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.275+0000 7f4cd5024800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:23:06.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.275+0000 7f4cd5024800 5 note: GC not initialized 2024-03-04T12:23:06.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.276+0000 7f4b03fff640 20 reqs_thread_entry: start 2024-03-04T12:23:06.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.276+0000 7f4cd5024800 20 init_complete bucket index max shards: 11 2024-03-04T12:23:06.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.276+0000 7f4cd5024800 20 Filter name: none 2024-03-04T12:23:06.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.276+0000 7f4b01ffb640 20 reqs_thread_entry: start 2024-03-04T12:23:06.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.276+0000 7f4cd5024800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:23:06.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.276+0000 7f4cd5024800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.276+0000 7f4cd5024800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:23:06.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.276+0000 7f4cd5024800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:23:06.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.276+0000 7f4cd5024800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:23:06.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.276+0000 7f4cd5024800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 : miss 2024-03-04T12:23:06.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.276+0000 7f4cd5024800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.277+0000 7f4cd5024800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:23:06.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.277+0000 7f4cd5024800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 info.flags=0x17 2024-03-04T12:23:06.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.277+0000 7f4cd5024800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 to cache LRU end 2024-03-04T12:23:06.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.277+0000 7f4cd5024800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:23:06.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.277+0000 7f4cd5024800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:23:06.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.277+0000 7f4cd5024800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 2024-03-04T12:23:06.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.277+0000 7f4cd5024800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:23:06.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.277+0000 7f4cd5024800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:23:06.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.278+0000 7f4cd5024800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:23:06.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.278+0000 7f4cd5024800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:23:06.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.278+0000 7f4cd5024800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:23:06.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.278+0000 7f4cd5024800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:23:06.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.284+0000 7f4b897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:06.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.286+0000 7f4cd5024800 20 remove_watcher() i=0 2024-03-04T12:23:06.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.286+0000 7f4cd5024800 2 removed watcher, disabling cache 2024-03-04T12:23:06.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.287+0000 7f4cd5024800 20 remove_watcher() i=1 2024-03-04T12:23:06.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.288+0000 7f4cd5024800 20 remove_watcher() i=2 2024-03-04T12:23:06.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.289+0000 7f4cd5024800 20 remove_watcher() i=3 2024-03-04T12:23:06.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.291+0000 7f4cd5024800 20 remove_watcher() i=4 2024-03-04T12:23:06.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.292+0000 7f4cd5024800 20 remove_watcher() i=5 2024-03-04T12:23:06.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.293+0000 7f4cd5024800 20 remove_watcher() i=6 2024-03-04T12:23:06.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.294+0000 7f4cd5024800 20 remove_watcher() i=7 2024-03-04T12:23:06.310 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-04T12:23:06.344 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:23:06.345 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:23:06.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.371+0000 7fcc49142800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.372+0000 7fcc49142800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.372+0000 7fcc49142800 20 realm 2024-03-04T12:23:06.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.372+0000 7fcc49142800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.373+0000 7fcc49142800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.373+0000 7fcc49142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:23:06.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.373+0000 7fcc49142800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.373+0000 7fcc49142800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.373+0000 7fcc49142800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.380 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.374+0000 7fcc49142800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:06.380 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.374+0000 7fcc49142800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.380 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.374+0000 7fcc49142800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:23:06.380 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.374+0000 7fcc49142800 20 searching for the correct realm 2024-03-04T12:23:06.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.377+0000 7fcc45642640 0 -- 172.21.15.110:0/4159216436 >> [v2:172.21.15.110:6824/3005097257,v1:172.21.15.110:6825/3005097257] conn(0x55d674a4d4a0 msgr2=0x55d674a4f900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:23:06.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.381+0000 7fcc44e41640 0 -- 172.21.15.110:0/4159216436 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fcc2c00e7f0 msgr2=0x7fcc2c06fa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:06.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:23:06.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:23:06.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:23:06.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:23:06.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:23:06.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:23:06.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.393 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:06.393 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:23:06.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 20 zone default found 2024-03-04T12:23:06.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 4 Realm: () 2024-03-04T12:23:06.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:23:06.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:23:06.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:23:06.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 20 zonegroup default 2024-03-04T12:23:06.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.386+0000 7fcc49142800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.387+0000 7fcc49142800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.387+0000 7fcc49142800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.387+0000 7fcc49142800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.387+0000 7fcc49142800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.387+0000 7fcc49142800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.387+0000 7fcc49142800 20 started sync module instance, tier type = 2024-03-04T12:23:06.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.387+0000 7fcc49142800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:23:06.405 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.399+0000 7fcc49142800 20 add_watcher() i=0 2024-03-04T12:23:06.405 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.399+0000 7fcc49142800 20 add_watcher() i=1 2024-03-04T12:23:06.405 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.399+0000 7fcc49142800 20 add_watcher() i=2 2024-03-04T12:23:06.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.399+0000 7fcc49142800 20 add_watcher() i=3 2024-03-04T12:23:06.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.399+0000 7fcc49142800 20 add_watcher() i=4 2024-03-04T12:23:06.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.399+0000 7fcc49142800 20 add_watcher() i=5 2024-03-04T12:23:06.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.399+0000 7fcc49142800 20 add_watcher() i=6 2024-03-04T12:23:06.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.400+0000 7fcc49142800 20 add_watcher() i=7 2024-03-04T12:23:06.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.400+0000 7fcc49142800 2 all 8 watchers are set, enabling cache 2024-03-04T12:23:06.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.401+0000 7fcafafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:06.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.402+0000 7fcc49142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:23:06.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.402+0000 7fcc49142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:23:06.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.402+0000 7fcc49142800 5 note: GC not initialized 2024-03-04T12:23:06.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.402+0000 7fcaf9fe3640 20 reqs_thread_entry: start 2024-03-04T12:23:06.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.402+0000 7fcc49142800 20 init_complete bucket index max shards: 11 2024-03-04T12:23:06.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.402+0000 7fcc49142800 20 Filter name: none 2024-03-04T12:23:06.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.402+0000 7fca6b7fe640 20 reqs_thread_entry: start 2024-03-04T12:23:06.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.402+0000 7fcc49142800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-04T12:23:06.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.402+0000 7fcc49142800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.402+0000 7fcc49142800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:23:06.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.402+0000 7fcc49142800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-04T12:23:06.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.402+0000 7fcc49142800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-04T12:23:06.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.402+0000 7fcc49142800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 : miss 2024-03-04T12:23:06.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.402+0000 7fcc49142800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.403+0000 7fcc49142800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:23:06.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.403+0000 7fcc49142800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 info.flags=0x17 2024-03-04T12:23:06.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.403+0000 7fcc49142800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 to cache LRU end 2024-03-04T12:23:06.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.403+0000 7fcc49142800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:23:06.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.403+0000 7fcc49142800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-04T12:23:06.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.403+0000 7fcc49142800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2 2024-03-04T12:23:06.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.403+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.0 2024-03-04T12:23:06.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.404+0000 7fcc49142800 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-04T12:23:06.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.404+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:23:06.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.404+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.2 2024-03-04T12:23:06.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.405+0000 7fcc49142800 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-04T12:23:06.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.405+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.3 2024-03-04T12:23:06.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.406+0000 7fcc49142800 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-04T12:23:06.412 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.406+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.4 2024-03-04T12:23:06.412 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.406+0000 7fcc49142800 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-04T12:23:06.412 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.406+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:06.412 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.406+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.6 2024-03-04T12:23:06.413 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.407+0000 7fcc49142800 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-04T12:23:06.413 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.407+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.7 2024-03-04T12:23:06.413 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.407+0000 7fcc49142800 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-04T12:23:06.413 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.407+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:06.413 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.408+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.9 2024-03-04T12:23:06.414 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.408+0000 7fcc49142800 1 NOTICE: finished shard 9 (0 entries removed) 2024-03-04T12:23:06.414 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.408+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:23:06.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.409+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:23:06.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.409+0000 7fcc49142800 20 get_obj_state: octx=0x55d6747e93f0 obj=check-bucket:e state=0x55d674a87338 s->prefetch_data=0 2024-03-04T12:23:06.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.409+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:06.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.410+0000 7fcc49142800 20 get_obj_state: octx=0x55d6747e95d0 obj=check-bucket:d state=0x55d674a8af98 s->prefetch_data=0 2024-03-04T12:23:06.416 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.410+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:06.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.410+0000 7fcc49142800 20 get_obj_state: octx=0x55d674a8ecf0 obj=check-bucket:c state=0x55d674b23818 s->prefetch_data=0 2024-03-04T12:23:06.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.410+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:23:06.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.410+0000 7fcc49142800 20 get_obj_state: octx=0x55d674a85760 obj=check-bucket:f state=0x55d674b24378 s->prefetch_data=0 2024-03-04T12:23:06.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.410+0000 7fcc49142800 20 get_obj_state: setting s->obj_tag to 7l9f921kmm7gfkl8okx1zwm7t69ffg4w 2024-03-04T12:23:06.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.410+0000 7fcc49142800 20 get_obj_state_impl: setting s->olh_tag to rn0u9dqqcp3fodguvtk7beawrmrokxlj 2024-03-04T12:23:06.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.410+0000 7fcc49142800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rn0u9dqqcp3fodguvtk7beawrmrokxlj 2024-03-04T12:23:06.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.410+0000 7fcc49142800 20 get_obj_state: setting s->obj_tag to jmgylox973kbnaoszuaxcyazlkwhisrf 2024-03-04T12:23:06.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.410+0000 7fcc49142800 20 get_obj_state_impl: setting s->olh_tag to 5xnsefi47ecgi5n1zfmncmoos9ma3phb 2024-03-04T12:23:06.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.410+0000 7fcc49142800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=5xnsefi47ecgi5n1zfmncmoos9ma3phb 2024-03-04T12:23:06.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.410+0000 7fcc49142800 20 get_obj_state: setting s->obj_tag to 2onfm68ii0ct907p3q4mmmx3e23mpcxf 2024-03-04T12:23:06.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.410+0000 7fcc49142800 20 get_obj_state_impl: setting s->olh_tag to lapzxozbyow28cqacps9d38n5iy21u8b 2024-03-04T12:23:06.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.410+0000 7fcc49142800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lapzxozbyow28cqacps9d38n5iy21u8b 2024-03-04T12:23:06.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.411+0000 7fcc49142800 20 get_obj_state: setting s->obj_tag to oijicg05hkh4aelk72dil1e42xhtt3qq 2024-03-04T12:23:06.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.411+0000 7fcc49142800 20 get_obj_state_impl: setting s->olh_tag to vdkt2pxfmc3uohkvhu9ufogomd7v7hoe 2024-03-04T12:23:06.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.411+0000 7fcc49142800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vdkt2pxfmc3uohkvhu9ufogomd7v7hoe 2024-03-04T12:23:06.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.412+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:23:06.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.412+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:06.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.412+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:06.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.412+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:23:06.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.413+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:06.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.413+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:23:06.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.413+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:06.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.413+0000 7fcc49142800 20 olh_log_entry: epoch=3 op=3 key=d[eM7C5S5Erqf7bAsnfWg8ySx6fj5c6OB] 2024-03-04T12:23:06.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.413+0000 7fcc49142800 20 get_obj_state: octx=0x55d6747e95d0 obj=check-bucket:_:eM7C5S5Erqf7bAsnfWg8ySx6fj5c6OB_d state=0x55d674b36b98 s->prefetch_data=0 2024-03-04T12:23:06.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 olh_log_entry: epoch=3 op=3 key=c[t4cYWsTpOVlQs3pwRZ2HBy1Sv-2oPYM] 2024-03-04T12:23:06.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 get_obj_state: octx=0x55d674a8ecf0 obj=check-bucket:_:t4cYWsTpOVlQs3pwRZ2HBy1Sv-2oPYM_c state=0x55d674b3e658 s->prefetch_data=0 2024-03-04T12:23:06.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-03-04T12:23:06.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 olh_log_entry: epoch=2 op=3 key=e[hqfa-0oE3-qy.JxsIZkOm0qaAdMpJw2] 2024-03-04T12:23:06.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 get_obj_state: octx=0x55d6747e93f0 obj=check-bucket:_:hqfa-0oE3-qy.JxsIZkOm0qaAdMpJw2_e state=0x55d674b46b58 s->prefetch_data=0 2024-03-04T12:23:06.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 10 manifest: total_size = 22 2024-03-04T12:23:06.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2099592546280266113 2024-03-04T12:23:06.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 get_obj_state: octx=0x55d6747e95d0 obj=check-bucket:_:eM7C5S5Erqf7bAsnfWg8ySx6fj5c6OB_d state=0x55d674b36b98 s->prefetch_data=0 2024-03-04T12:23:06.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 prepare_atomic_modification: state is not atomic. state=0x55d674b36b98 2024-03-04T12:23:06.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:06.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 10 manifest: total_size = 9 2024-03-04T12:23:06.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10575690565402255957 2024-03-04T12:23:06.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 get_obj_state: octx=0x55d674a8ecf0 obj=check-bucket:_:t4cYWsTpOVlQs3pwRZ2HBy1Sv-2oPYM_c state=0x55d674b3e658 s->prefetch_data=0 2024-03-04T12:23:06.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 prepare_atomic_modification: state is not atomic. state=0x55d674b3e658 2024-03-04T12:23:06.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:06.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 10 manifest: total_size = 22 2024-03-04T12:23:06.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17941349261911910338 2024-03-04T12:23:06.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 get_obj_state: octx=0x55d6747e93f0 obj=check-bucket:_:hqfa-0oE3-qy.JxsIZkOm0qaAdMpJw2_e state=0x55d674b46b58 s->prefetch_data=0 2024-03-04T12:23:06.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 prepare_atomic_modification: state is not atomic. state=0x55d674b46b58 2024-03-04T12:23:06.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.414+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:23:06.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.416+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:23:06.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.416+0000 7fcc49142800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-03-04T12:23:06.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.416+0000 7fcc49142800 20 olh_log_entry: epoch=2 op=3 key=f[L6tfhKpJlF6ryMwypz1Ffpem4fI8t-Q] 2024-03-04T12:23:06.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.416+0000 7fcc49142800 20 get_obj_state: octx=0x55d674a85760 obj=check-bucket:_:L6tfhKpJlF6ryMwypz1Ffpem4fI8t-Q_f state=0x55d674b5aa18 s->prefetch_data=0 2024-03-04T12:23:06.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.417+0000 7fcc49142800 10 manifest: total_size = 22 2024-03-04T12:23:06.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.417+0000 7fcc49142800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.1557497664708501138 2024-03-04T12:23:06.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.417+0000 7fcc49142800 20 get_obj_state: octx=0x55d674a85760 obj=check-bucket:_:L6tfhKpJlF6ryMwypz1Ffpem4fI8t-Q_f state=0x55d674b5aa18 s->prefetch_data=0 2024-03-04T12:23:06.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.417+0000 7fcc49142800 20 prepare_atomic_modification: state is not atomic. state=0x55d674b5aa18 2024-03-04T12:23:06.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.417+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:23:06.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.418+0000 7fcb1bfff640 20 handle_completion(): completion ok for obj=c[t4cYWsTpOVlQs3pwRZ2HBy1Sv-2oPYM] 2024-03-04T12:23:06.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.418+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:06.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.418+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:06.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.419+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.8 2024-03-04T12:23:06.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.419+0000 7fcc49142800 1 NOTICE: finished shard 8 (1 entries removed) 2024-03-04T12:23:06.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.420+0000 7fcb1b7fe640 20 handle_completion(): completion ok for obj=e[hqfa-0oE3-qy.JxsIZkOm0qaAdMpJw2] 2024-03-04T12:23:06.427 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.422+0000 7fcc49142800 20 get_obj_state: octx=0x55d6747e93f0 obj=check-bucket:e state=0x55d674a87338 s->prefetch_data=0 2024-03-04T12:23:06.428 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.422+0000 7fcc49142800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rn0u9dqqcp3fodguvtk7beawrmrokxlj 2024-03-04T12:23:06.430 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.424+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:06.430 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.424+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:06.430 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.425+0000 7fcb1bfff640 20 handle_completion(): completion ok for obj=d[eM7C5S5Erqf7bAsnfWg8ySx6fj5c6OB] 2024-03-04T12:23:06.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.428+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.5 2024-03-04T12:23:06.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.428+0000 7fcc49142800 1 NOTICE: finished shard 5 (1 entries removed) 2024-03-04T12:23:06.436 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.430+0000 7fcb1bfff640 20 handle_completion(): completion ok for obj=f[L6tfhKpJlF6ryMwypz1Ffpem4fI8t-Q] 2024-03-04T12:23:06.436 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.430+0000 7fcc49142800 20 get_obj_state: octx=0x55d674a85760 obj=check-bucket:f state=0x55d674b24378 s->prefetch_data=0 2024-03-04T12:23:06.436 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.430+0000 7fcc49142800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vdkt2pxfmc3uohkvhu9ufogomd7v7hoe 2024-03-04T12:23:06.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.433+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:23:06.440 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.434+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.1 2024-03-04T12:23:06.440 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.434+0000 7fcc49142800 1 NOTICE: finished shard 1 (1 entries removed) 2024-03-04T12:23:06.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.436+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:23:06.443 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.437+0000 7fcc49142800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2.10 2024-03-04T12:23:06.443 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.437+0000 7fcc49142800 1 NOTICE: finished shard 10 (1 entries removed) 2024-03-04T12:23:06.443 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.437+0000 7fcc49142800 1 NOTICE: finished all shards (4 entries removed) 2024-03-04T12:23:06.444 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.438+0000 7fcafafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:06.446 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.440+0000 7fcc49142800 20 remove_watcher() i=0 2024-03-04T12:23:06.446 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.440+0000 7fcc49142800 2 removed watcher, disabling cache 2024-03-04T12:23:06.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.441+0000 7fcc49142800 20 remove_watcher() i=1 2024-03-04T12:23:06.449 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.443+0000 7fcc49142800 20 remove_watcher() i=2 2024-03-04T12:23:06.450 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.444+0000 7fcc49142800 20 remove_watcher() i=3 2024-03-04T12:23:06.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.445+0000 7fcc49142800 20 remove_watcher() i=4 2024-03-04T12:23:06.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.446+0000 7fcc49142800 20 remove_watcher() i=5 2024-03-04T12:23:06.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.447+0000 7fcc49142800 20 remove_watcher() i=6 2024-03-04T12:23:06.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.448+0000 7fcc49142800 20 remove_watcher() i=7 2024-03-04T12:23:06.465 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:06.465 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:06.501 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:06.501 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:06.662 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-03-04T12:23:06.690 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:23:06.690 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:23:06.722 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.716+0000 7f649e813800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.724 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.718+0000 7f649e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.724 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.718+0000 7f649e813800 20 realm 2024-03-04T12:23:06.724 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.718+0000 7f649e813800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.724 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.718+0000 7f649e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.724 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.718+0000 7f649e813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:23:06.724 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.718+0000 7f649e813800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.724 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.718+0000 7f649e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.724 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.718+0000 7f649e813800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.725 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.719+0000 7f649e813800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:06.725 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.719+0000 7f649e813800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.725 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.719+0000 7f649e813800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:23:06.725 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.719+0000 7f649e813800 20 searching for the correct realm 2024-03-04T12:23:06.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.722+0000 7f64995dd640 0 -- 172.21.15.110:0/2525285467 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f648c08ab70 msgr2=0x7f648c0698f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:06.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.725+0000 7f6499dde640 0 -- 172.21.15.110:0/2525285467 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f649003f900 msgr2=0x7f649001c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:23:06.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.931+0000 7f649e813800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:23:06.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.931+0000 7f649e813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:23:06.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.931+0000 7f649e813800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:23:06.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.931+0000 7f649e813800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:23:06.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.931+0000 7f649e813800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:23:06.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.931+0000 7f649e813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:23:06.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.931+0000 7f649e813800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.931+0000 7f649e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.931+0000 7f649e813800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.932+0000 7f649e813800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:23:06.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.932+0000 7f649e813800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.932+0000 7f649e813800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:23:06.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.932+0000 7f649e813800 20 zone default found 2024-03-04T12:23:06.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.932+0000 7f649e813800 4 Realm: () 2024-03-04T12:23:06.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.932+0000 7f649e813800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:23:06.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.932+0000 7f649e813800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:23:06.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.932+0000 7f649e813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:23:06.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.932+0000 7f649e813800 20 zonegroup default 2024-03-04T12:23:06.940 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.932+0000 7f649e813800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.940 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.932+0000 7f649e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.940 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.932+0000 7f649e813800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.940 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.933+0000 7f649e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.933+0000 7f649e813800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.933+0000 7f649e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.933+0000 7f649e813800 20 started sync module instance, tier type = 2024-03-04T12:23:06.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.933+0000 7f649e813800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:23:06.949 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.943+0000 7f649e813800 20 add_watcher() i=0 2024-03-04T12:23:06.949 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.943+0000 7f649e813800 20 add_watcher() i=1 2024-03-04T12:23:06.949 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.943+0000 7f649e813800 20 add_watcher() i=2 2024-03-04T12:23:06.949 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.943+0000 7f649e813800 20 add_watcher() i=3 2024-03-04T12:23:06.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.943+0000 7f649e813800 20 add_watcher() i=4 2024-03-04T12:23:06.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.943+0000 7f649e813800 20 add_watcher() i=5 2024-03-04T12:23:06.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.943+0000 7f649e813800 20 add_watcher() i=6 2024-03-04T12:23:06.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.944+0000 7f649e813800 20 add_watcher() i=7 2024-03-04T12:23:06.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.944+0000 7f649e813800 2 all 8 watchers are set, enabling cache 2024-03-04T12:23:06.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.946+0000 7f634b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:06.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.946+0000 7f649e813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:23:06.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.946+0000 7f649e813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:23:06.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.946+0000 7f649e813800 5 note: GC not initialized 2024-03-04T12:23:06.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.947+0000 7f634a7fc640 20 reqs_thread_entry: start 2024-03-04T12:23:06.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.947+0000 7f649e813800 20 init_complete bucket index max shards: 11 2024-03-04T12:23:06.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.947+0000 7f649e813800 20 Filter name: none 2024-03-04T12:23:06.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.947+0000 7f62bbfff640 20 reqs_thread_entry: start 2024-03-04T12:23:06.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.947+0000 7f649e813800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.954 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.947+0000 7f649e813800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:23:06.954 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.947+0000 7f649e813800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.955 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.948+0000 7f649e813800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:23:06.955 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.948+0000 7f649e813800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:23:06.955 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.948+0000 7f649e813800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.955 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.948+0000 7f649e813800 20 rados_obj.operate() r=0 bl.length=190 2024-03-04T12:23:06.955 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.948+0000 7f649e813800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.955 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.948+0000 7f649e813800 20 rados_obj.operate() r=0 bl.length=368 2024-03-04T12:23:06.955 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.948+0000 7f649e813800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:23:06.955 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.949+0000 7f649e813800 20 rados->read ofs=0 len=0 2024-03-04T12:23:06.956 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.950+0000 7f649e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:23:06.956 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.950+0000 7f634b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:23:06.958 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.953+0000 7f649e813800 20 remove_watcher() i=0 2024-03-04T12:23:06.958 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.953+0000 7f649e813800 2 removed watcher, disabling cache 2024-03-04T12:23:06.960 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.954+0000 7f649e813800 20 remove_watcher() i=1 2024-03-04T12:23:06.961 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.955+0000 7f649e813800 20 remove_watcher() i=2 2024-03-04T12:23:06.962 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.956+0000 7f649e813800 20 remove_watcher() i=3 2024-03-04T12:23:06.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.957+0000 7f649e813800 20 remove_watcher() i=4 2024-03-04T12:23:06.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.958+0000 7f649e813800 20 remove_watcher() i=5 2024-03-04T12:23:06.965 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.959+0000 7f649e813800 20 remove_watcher() i=6 2024-03-04T12:23:06.966 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:23:06.960+0000 7f649e813800 20 remove_watcher() i=7 2024-03-04T12:23:06.975 INFO:tasks.workunit.client.0.smithi110.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-03-04T12:23:06.976 INFO:tasks.workunit.client.0.smithi110.stderr:Deleting bucket check-bucket 2024-03-04T12:23:06.977 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:06.977 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:07.007 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:23:07.007 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:23:07.199 INFO:tasks.workunit.client.0.smithi110.stderr:Completed bucket check tests 2024-03-04T12:23:07.199 INFO:tasks.workunit.client.0.smithi110.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-03-04T12:23:07.199 INFO:tasks.workunit.client.0.smithi110.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-03-04T12:23:07.199 INFO:tasks.workunit.client.0.smithi110.stdout:connected to https://localhost:443 2024-03-04T12:23:07.257 INFO:tasks.workunit.client.0.smithi110.stderr:+ deactivate 2024-03-04T12:23:07.257 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-03-04T12:23:07.257 INFO:tasks.workunit.client.0.smithi110.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-04T12:23:07.258 INFO:tasks.workunit.client.0.smithi110.stderr:+ export PATH 2024-03-04T12:23:07.258 INFO:tasks.workunit.client.0.smithi110.stderr:+ unset _OLD_VIRTUAL_PATH 2024-03-04T12:23:07.258 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' -n '' ']' 2024-03-04T12:23:07.258 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-04T12:23:07.258 INFO:tasks.workunit.client.0.smithi110.stderr:+ hash -r 2024-03-04T12:23:07.258 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' -n '' ']' 2024-03-04T12:23:07.258 INFO:tasks.workunit.client.0.smithi110.stderr:+ unset VIRTUAL_ENV 2024-03-04T12:23:07.258 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' '!' '' = nondestructive ']' 2024-03-04T12:23:07.258 INFO:tasks.workunit.client.0.smithi110.stderr:+ unset -f deactivate 2024-03-04T12:23:07.258 INFO:tasks.workunit.client.0.smithi110.stderr:+ echo OK. 2024-03-04T12:23:07.259 INFO:tasks.workunit.client.0.smithi110.stdout:OK. 2024-03-04T12:23:07.259 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:23:07.260 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:23:07.340 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-03-04T12:23:07.340 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-04T12:23:07.700 DEBUG:teuthology.parallel:result is None 2024-03-04T12:23:07.701 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:23:07.740 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:23:07.740 DEBUG:teuthology.orchestra.run.smithi110:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:23:07.807 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:23:07.807 INFO:teuthology.run_tasks:Running task workunit... 2024-03-04T12:23:07.824 INFO:tasks.workunit:Pulling workunits from ref 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:23:07.824 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-04T12:23:07.824 DEBUG:teuthology.orchestra.run.smithi110:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:23:07.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:23:07.875 INFO:teuthology.orchestra.run.smithi110.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-04T12:23:07.875 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:23:07.945 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-04T12:23:07.945 DEBUG:teuthology.orchestra.run.smithi110:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-04T12:23:08.011 INFO:tasks.workunit:timeout=3h 2024-03-04T12:23:08.012 INFO:tasks.workunit:cleanup=True 2024-03-04T12:23:08.012 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/pritha-srivastava/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:23:08.080 INFO:tasks.workunit.client.0.smithi110.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-04T12:23:46.571 INFO:tasks.workunit.client.0.smithi110.stderr:Note: switching to '3aec390336fdfdc8f927818b718cfb0361bd47c8'. 2024-03-04T12:23:46.571 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:23:46.571 INFO:tasks.workunit.client.0.smithi110.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-04T12:23:46.571 INFO:tasks.workunit.client.0.smithi110.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-04T12:23:46.571 INFO:tasks.workunit.client.0.smithi110.stderr:state without impacting any branches by switching back to a branch. 2024-03-04T12:23:46.571 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:23:46.571 INFO:tasks.workunit.client.0.smithi110.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-04T12:23:46.572 INFO:tasks.workunit.client.0.smithi110.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-04T12:23:46.572 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:23:46.572 INFO:tasks.workunit.client.0.smithi110.stderr: git switch -c 2024-03-04T12:23:46.572 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:23:46.572 INFO:tasks.workunit.client.0.smithi110.stderr:Or undo this operation with: 2024-03-04T12:23:46.572 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:23:46.572 INFO:tasks.workunit.client.0.smithi110.stderr: git switch - 2024-03-04T12:23:46.572 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:23:46.572 INFO:tasks.workunit.client.0.smithi110.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-04T12:23:46.572 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:23:46.572 INFO:tasks.workunit.client.0.smithi110.stderr:HEAD is now at 3aec390336f qa/d4n: Start redis up before rgw 2024-03-04T12:23:46.576 DEBUG:teuthology.orchestra.run.smithi110:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-04T12:23:46.643 INFO:tasks.workunit.client.0.smithi110.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-04T12:23:46.645 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:23:46.646 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-04T12:23:46.694 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-04T12:23:46.744 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-04T12:23:46.783 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:23:46.784 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:23:46.784 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-04T12:23:46.824 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:23:46.827 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:23:46.827 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-04T12:23:46.895 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-03-04T12:23:46.896 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-03-04T12:23:46.897 DEBUG:teuthology.orchestra.run.smithi110:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-03-04T12:23:46.975 INFO:tasks.workunit.client.0.smithi110.stdout:Running main() from gmock_main.cc 2024-03-04T12:23:46.976 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 11 tests from 1 test suite. 2024-03-04T12:23:46.976 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:23:46.976 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 11 tests from ClsLock 2024-03-04T12:23:46.976 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-03-04T12:23:49.105 INFO:tasks.workunit.client.0.smithi110.stdout:lock: mylock 2024-03-04T12:23:49.105 INFO:tasks.workunit.client.0.smithi110.stdout: lock_type: exclusive 2024-03-04T12:23:49.105 INFO:tasks.workunit.client.0.smithi110.stdout: tag: 2024-03-04T12:23:49.105 INFO:tasks.workunit.client.0.smithi110.stdout: lockers: 2024-03-04T12:23:49.105 INFO:tasks.workunit.client.0.smithi110.stdout: client.5166 expiration=2024-03-04T12:25:49.094891+0000 addr=v1:172.21.15.110:0/3805864448 cookie= 2024-03-04T12:23:49.108 INFO:tasks.workunit.client.0.smithi110.stdout:lock: mylock 2024-03-04T12:23:49.108 INFO:tasks.workunit.client.0.smithi110.stdout: lock_type: shared 2024-03-04T12:23:49.108 INFO:tasks.workunit.client.0.smithi110.stdout: tag: 2024-03-04T12:23:49.108 INFO:tasks.workunit.client.0.smithi110.stdout: lockers: 2024-03-04T12:23:49.108 INFO:tasks.workunit.client.0.smithi110.stdout: client.5166 expiration=2024-03-04T12:25:49.102053+0000 addr=v1:172.21.15.110:0/3805864448 cookie= 2024-03-04T12:23:49.108 INFO:tasks.workunit.client.0.smithi110.stdout: client.5175 expiration=0.000000 addr=v1:172.21.15.110:0/241442461 cookie= 2024-03-04T12:23:49.110 INFO:tasks.workunit.client.0.smithi110.stdout:lock: mylock 2024-03-04T12:23:49.110 INFO:tasks.workunit.client.0.smithi110.stdout: lock_type: shared 2024-03-04T12:23:49.111 INFO:tasks.workunit.client.0.smithi110.stdout: tag: 2024-03-04T12:23:49.111 INFO:tasks.workunit.client.0.smithi110.stdout: lockers: 2024-03-04T12:23:49.111 INFO:tasks.workunit.client.0.smithi110.stdout: client.5175 expiration=0.000000 addr=v1:172.21.15.110:0/241442461 cookie= 2024-03-04T12:23:49.919 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] ClsLock.TestMultiLocking (2944 ms) 2024-03-04T12:23:49.919 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] ClsLock.TestMeta 2024-03-04T12:23:52.371 INFO:tasks.workunit.client.0.smithi110.stdout:lock: mylock 2024-03-04T12:23:52.371 INFO:tasks.workunit.client.0.smithi110.stdout: lock_type: shared 2024-03-04T12:23:52.371 INFO:tasks.workunit.client.0.smithi110.stdout: tag: 2024-03-04T12:23:52.371 INFO:tasks.workunit.client.0.smithi110.stdout: lockers: 2024-03-04T12:23:52.372 INFO:tasks.workunit.client.0.smithi110.stdout: client.5003 expiration=0.000000 addr=v1:172.21.15.110:0/4212535911 cookie= 2024-03-04T12:23:52.372 INFO:tasks.workunit.client.0.smithi110.stdout:lock: mylock 2024-03-04T12:23:52.372 INFO:tasks.workunit.client.0.smithi110.stdout: lock_type: exclusive 2024-03-04T12:23:52.372 INFO:tasks.workunit.client.0.smithi110.stdout: tag: new_tag 2024-03-04T12:23:52.372 INFO:tasks.workunit.client.0.smithi110.stdout: lockers: 2024-03-04T12:23:52.372 INFO:tasks.workunit.client.0.smithi110.stdout: client.5000 expiration=0.000000 addr=v1:172.21.15.110:0/3470376148 cookie= 2024-03-04T12:23:52.937 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] ClsLock.TestMeta (3018 ms) 2024-03-04T12:23:52.937 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] ClsLock.TestCookie 2024-03-04T12:23:54.962 INFO:tasks.workunit.client.0.smithi110.stdout:lock: mylock 2024-03-04T12:23:54.962 INFO:tasks.workunit.client.0.smithi110.stdout: lock_type: exclusive 2024-03-04T12:23:54.962 INFO:tasks.workunit.client.0.smithi110.stdout: tag: 2024-03-04T12:23:54.962 INFO:tasks.workunit.client.0.smithi110.stdout: lockers: 2024-03-04T12:23:54.964 INFO:tasks.workunit.client.0.smithi110.stdout:lock: mylock 2024-03-04T12:23:54.964 INFO:tasks.workunit.client.0.smithi110.stdout: lock_type: shared 2024-03-04T12:23:54.964 INFO:tasks.workunit.client.0.smithi110.stdout: tag: 2024-03-04T12:23:54.964 INFO:tasks.workunit.client.0.smithi110.stdout: lockers: 2024-03-04T12:23:54.965 INFO:tasks.workunit.client.0.smithi110.stdout: client.5009 expiration=0.000000 addr=v1:172.21.15.110:0/3557962882 cookie= 2024-03-04T12:23:54.965 INFO:tasks.workunit.client.0.smithi110.stdout: client.5009 expiration=0.000000 addr=v1:172.21.15.110:0/3557962882 cookie=new cookie 2024-03-04T12:23:55.951 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] ClsLock.TestCookie (3014 ms) 2024-03-04T12:23:55.952 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-03-04T12:23:58.965 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] ClsLock.TestMultipleLocks (3014 ms) 2024-03-04T12:23:58.965 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] ClsLock.TestLockDuration 2024-03-04T12:24:06.993 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] ClsLock.TestLockDuration (8028 ms) 2024-03-04T12:24:06.993 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-03-04T12:24:10.012 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] ClsLock.TestAssertLocked (3018 ms) 2024-03-04T12:24:10.012 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] ClsLock.TestSetCookie 2024-03-04T12:24:13.035 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] ClsLock.TestSetCookie (3023 ms) 2024-03-04T12:24:13.035 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] ClsLock.TestRenew 2024-03-04T12:24:33.080 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] ClsLock.TestRenew (20044 ms) 2024-03-04T12:24:33.080 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-03-04T12:24:39.179 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6100 ms) 2024-03-04T12:24:39.179 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-03-04T12:24:46.451 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7272 ms) 2024-03-04T12:24:46.452 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-03-04T12:24:54.486 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8035 ms) 2024-03-04T12:24:54.486 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 11 tests from ClsLock (67510 ms total) 2024-03-04T12:24:54.486 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:24:54.486 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:24:54.486 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 11 tests from 1 test suite ran. (67510 ms total) 2024-03-04T12:24:54.486 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 11 tests. 2024-03-04T12:24:54.489 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:24:54.489 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:24:54.575 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-03-04T12:24:54.577 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-03-04T12:24:54.577 DEBUG:teuthology.orchestra.run.smithi110:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-03-04T12:24:54.621 INFO:tasks.workunit.client.0.smithi110.stdout:Running main() from gmock_main.cc 2024-03-04T12:24:54.621 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 4 tests from 1 test suite. 2024-03-04T12:24:54.621 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:24:54.621 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 4 tests from cls_log 2024-03-04T12:24:54.621 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-03-04T12:24:57.513 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_log.test_log_add_same_time (2892 ms) 2024-03-04T12:24:57.513 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-03-04T12:25:00.527 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_log.test_log_add_different_time (3014 ms) 2024-03-04T12:25:00.527 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_log.trim_by_time 2024-03-04T12:25:03.540 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_log.trim_by_time (3013 ms) 2024-03-04T12:25:03.541 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_log.trim_by_marker 2024-03-04T12:25:06.552 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_log.trim_by_marker (3012 ms) 2024-03-04T12:25:06.553 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 4 tests from cls_log (11932 ms total) 2024-03-04T12:25:06.553 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:25:06.553 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:25:06.553 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 4 tests from 1 test suite ran. (11932 ms total) 2024-03-04T12:25:06.553 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 4 tests. 2024-03-04T12:25:06.556 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:25:06.556 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:25:06.642 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-03-04T12:25:06.644 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-03-04T12:25:06.644 DEBUG:teuthology.orchestra.run.smithi110:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-03-04T12:25:06.689 INFO:tasks.workunit.client.0.smithi110.stdout:Running main() from gmock_main.cc 2024-03-04T12:25:06.689 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 10 tests from 1 test suite. 2024-03-04T12:25:06.689 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:25:06.689 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 10 tests from cls_refcount 2024-03-04T12:25:06.690 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_refcount.test_implicit 2024-03-04T12:25:09.569 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_refcount.test_implicit (2881 ms) 2024-03-04T12:25:09.570 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-03-04T12:25:12.584 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3014 ms) 2024-03-04T12:25:12.585 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_refcount.test_put_snap 2024-03-04T12:25:21.628 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_refcount.test_put_snap (9044 ms) 2024-03-04T12:25:21.628 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_refcount.test_explicit 2024-03-04T12:25:24.641 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_refcount.test_explicit (3013 ms) 2024-03-04T12:25:24.641 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_refcount.set 2024-03-04T12:25:27.662 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_refcount.set (3021 ms) 2024-03-04T12:25:27.662 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-03-04T12:25:34.684 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_refcount.test_implicit_ec (7022 ms) 2024-03-04T12:25:34.688 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-03-04T12:25:41.697 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7013 ms) 2024-03-04T12:25:41.697 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-03-04T12:25:54.757 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_refcount.test_put_snap_ec (13060 ms) 2024-03-04T12:25:54.757 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-03-04T12:26:01.783 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_refcount.test_explicit_ec (7026 ms) 2024-03-04T12:26:01.784 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_refcount.set_ec 2024-03-04T12:26:08.824 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_refcount.set_ec (7041 ms) 2024-03-04T12:26:08.824 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 10 tests from cls_refcount (62135 ms total) 2024-03-04T12:26:08.824 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:26:08.824 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:26:08.824 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 10 tests from 1 test suite ran. (62135 ms total) 2024-03-04T12:26:08.824 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 10 tests. 2024-03-04T12:26:08.827 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:26:08.827 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:26:08.873 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-03-04T12:26:08.874 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-03-04T12:26:08.874 DEBUG:teuthology.orchestra.run.smithi110:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-03-04T12:26:08.918 INFO:tasks.workunit.client.0.smithi110.stdout:Running main() from gmock_main.cc 2024-03-04T12:26:08.918 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 16 tests from 1 test suite. 2024-03-04T12:26:08.918 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:26:08.918 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 16 tests from cls_rgw 2024-03-04T12:26:10.837 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw.index_basic 2024-03-04T12:26:10.877 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw.index_basic (40 ms) 2024-03-04T12:26:10.878 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-03-04T12:26:10.910 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (33 ms) 2024-03-04T12:26:10.910 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw.index_remove_object 2024-03-04T12:26:10.957 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw.index_remove_object (47 ms) 2024-03-04T12:26:10.957 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw.index_suggest 2024-03-04T12:26:12.455 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw.index_suggest (1498 ms) 2024-03-04T12:26:12.455 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-03-04T12:26:12.462 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw.index_suggest_complete (7 ms) 2024-03-04T12:26:12.462 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw.index_list 2024-03-04T12:26:12.495 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw.index_list (33 ms) 2024-03-04T12:26:12.495 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-03-04T12:26:30.557 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw.index_list_delimited (18062 ms) 2024-03-04T12:26:30.557 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw.bi_list 2024-03-04T12:26:30.630 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw.bi_list (73 ms) 2024-03-04T12:26:30.630 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw.gc_set 2024-03-04T12:26:30.639 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw.gc_set (9 ms) 2024-03-04T12:26:30.639 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw.gc_list 2024-03-04T12:26:30.648 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw.gc_list (9 ms) 2024-03-04T12:26:30.648 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw.gc_defer 2024-03-04T12:26:37.889 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw.gc_defer (7240 ms) 2024-03-04T12:26:37.889 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw.usage_basic 2024-03-04T12:26:37.989 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw.usage_basic (101 ms) 2024-03-04T12:26:37.989 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-03-04T12:26:37.990 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-03-04T12:26:37.990 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw.usage_clear 2024-03-04T12:26:38.090 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw.usage_clear (100 ms) 2024-03-04T12:26:38.090 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-03-04T12:26:38.129 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw.bi_log_trim (39 ms) 2024-03-04T12:26:38.129 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-03-04T12:26:38.141 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw.index_racing_removes (13 ms) 2024-03-04T12:26:38.888 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 16 tests from cls_rgw (27305 ms total) 2024-03-04T12:26:38.888 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:26:38.888 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:26:38.889 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 16 tests from 1 test suite ran. (29970 ms total) 2024-03-04T12:26:38.889 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 16 tests. 2024-03-04T12:26:38.891 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:26:38.891 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:26:38.934 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-03-04T12:26:38.935 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-03-04T12:26:38.935 DEBUG:teuthology.orchestra.run.smithi110:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-03-04T12:26:39.017 INFO:tasks.workunit.client.0.smithi110.stdout:Running main() from gmock_main.cc 2024-03-04T12:26:39.017 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 9 tests from 1 test suite. 2024-03-04T12:26:39.017 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:26:39.017 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 9 tests from cls_rgw_gc 2024-03-04T12:26:39.017 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw_gc.init 2024-03-04T12:26:40.900 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw_gc.init (1883 ms) 2024-03-04T12:26:40.900 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-03-04T12:26:40.922 INFO:tasks.workunit.client.0.smithi110.stderr:[ ] list info tag = chain-0 2024-03-04T12:26:40.922 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (22 ms) 2024-03-04T12:26:40.922 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-03-04T12:26:40.928 INFO:tasks.workunit.client.0.smithi110.stderr:[ ] next_marker is: = 0/4263 2024-03-04T12:26:40.928 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (6 ms) 2024-03-04T12:26:40.928 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-03-04T12:26:40.936 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (8 ms) 2024-03-04T12:26:40.936 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-03-04T12:26:41.191 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (255 ms) 2024-03-04T12:26:41.191 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-03-04T12:26:41.202 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (11 ms) 2024-03-04T12:26:41.202 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-03-04T12:26:41.210 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (8 ms) 2024-03-04T12:26:41.210 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-03-04T12:26:41.221 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (11 ms) 2024-03-04T12:26:41.221 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw_gc.finalize 2024-03-04T12:26:41.917 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw_gc.finalize (696 ms) 2024-03-04T12:26:41.918 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 9 tests from cls_rgw_gc (2900 ms total) 2024-03-04T12:26:41.918 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:26:41.918 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:26:41.918 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 9 tests from 1 test suite ran. (2900 ms total) 2024-03-04T12:26:41.918 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 9 tests. 2024-03-04T12:26:41.920 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:26:41.921 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:26:42.009 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-03-04T12:26:42.010 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-03-04T12:26:42.011 DEBUG:teuthology.orchestra.run.smithi110:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-03-04T12:26:42.062 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:26:42.062 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:26:42.062 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 1 test from 1 test suite. 2024-03-04T12:26:42.062 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:26:43.918 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 1 test from cls_rgw_stats 2024-03-04T12:26:43.918 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] cls_rgw_stats.simulate 2024-03-04T12:26:43.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.931+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~DFDJWSHZX8X2.0 size=560193 2024-03-04T12:26:43.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.931+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=DFDJWSHZX8X2 tag=U2GG0354CWVH type=write size=1608769 2024-03-04T12:26:43.940 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.934+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~TXCJIOC75UQU.0 size=1048576 2024-03-04T12:26:43.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.935+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~TXCJIOC75UQU.1 size=102524 2024-03-04T12:26:43.942 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.935+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=TXCJIOC75UQU tag=Z9PCULU2TJX7 type=write size=2199676 2024-03-04T12:26:43.943 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.936+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=IYVHUB84OBJ5 type=del size=3135444 2024-03-04T12:26:43.944 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.937+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=716WR66ABMYW type=del size=3657933 2024-03-04T12:26:43.946 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.939+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=XKBGXP6A7276 type=del size=3298370 2024-03-04T12:26:43.948 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.941+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~YD94U1P6BHAE.0 size=426192 2024-03-04T12:26:43.948 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.941+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=YD94U1P6BHAE tag=75U97L4OCWV0 type=write size=1474768 2024-03-04T12:26:43.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.943+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~O3XYXPVC511C.0 size=1048576 2024-03-04T12:26:43.951 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.944+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~O3XYXPVC511C.1 size=978358 2024-03-04T12:26:43.951 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.944+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=O3XYXPVC511C tag=Z1Q0YHU9TEI3 type=write size=3075510 2024-03-04T12:26:43.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.947+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~X6VTWVWXBSJC.0 size=1048576 2024-03-04T12:26:43.954 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.948+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~X6VTWVWXBSJC.1 size=1048576 2024-03-04T12:26:43.955 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.949+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~X6VTWVWXBSJC.2 size=262543 2024-03-04T12:26:43.955 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.949+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=X6VTWVWXBSJC tag=VK99ZQT5Y2H5 type=write size=3408271 2024-03-04T12:26:43.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.950+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=AA9VXSM7SM5V type=del size=456634 2024-03-04T12:26:43.958 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.951+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=KL7PUS1AJ5CY type=del size=3664722 2024-03-04T12:26:43.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.953+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=EXUWO3KZFXYF type=write size=525916 2024-03-04T12:26:43.961 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.954+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=VNYG9AAG8HA0 type=del size=271323 2024-03-04T12:26:43.962 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.955+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=2K2PH6PGFVUK type=del size=3208154 2024-03-04T12:26:43.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.957+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~RQN0P2MXQQF5.0 size=204593 2024-03-04T12:26:43.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.957+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=RQN0P2MXQQF5 tag=T2VIHYNNWVPK type=write size=1253169 2024-03-04T12:26:43.966 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.960+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~UTRO38ZPK1XC.0 size=568701 2024-03-04T12:26:43.966 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.960+0000 7fa4b3c3e780 1 > prepared multipart upload key=NVMIU38VM9Q1 upload=UTRO38ZPK1XC tag=KSJ73X0FFF6B type=write size=1617277 2024-03-04T12:26:43.968 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.961+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=1KYYYMNBA1YP type=del size=556872 2024-03-04T12:26:43.968 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.961+0000 7fa4b3c3e780 1 < canceled part key=_multipart_J53J0N99N30A.2~DFDJWSHZX8X2.0 size=560193 2024-03-04T12:26:43.970 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.963+0000 7fa4b3c3e780 1 < canceled multipart upload key=J53J0N99N30A upload=DFDJWSHZX8X2 tag=U2GG0354CWVH type=write size=1608769 2024-03-04T12:26:43.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.966+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~FE8XU44FRTMO.0 size=1048576 2024-03-04T12:26:43.973 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.966+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~FE8XU44FRTMO.1 size=1048576 2024-03-04T12:26:43.974 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.968+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~FE8XU44FRTMO.2 size=725753 2024-03-04T12:26:43.974 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.968+0000 7fa4b3c3e780 1 > prepared multipart upload key=G8G76PMSKJ0I upload=FE8XU44FRTMO tag=E9YPZEKNPNX6 type=write size=3871481 2024-03-04T12:26:43.976 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.969+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~TXCJIOC75UQU.0 size=1048576 2024-03-04T12:26:43.976 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.969+0000 7fa4b3c3e780 1 < canceled part key=_multipart_DHLTVH2AZBLR.2~TXCJIOC75UQU.1 size=102524 2024-03-04T12:26:43.978 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.971+0000 7fa4b3c3e780 1 < canceled multipart upload key=DHLTVH2AZBLR upload=TXCJIOC75UQU tag=Z9PCULU2TJX7 type=write size=2199676 2024-03-04T12:26:43.979 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.972+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=0X4DWAG36P6G type=write size=392504 2024-03-04T12:26:43.980 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.973+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=IYVHUB84OBJ5 type=del 2024-03-04T12:26:43.981 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.975+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=MB50V92KA795 type=write size=356929 2024-03-04T12:26:43.983 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.976+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=716WR66ABMYW type=del 2024-03-04T12:26:43.984 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.977+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=RVW0ND99DOF6 type=del size=2681275 2024-03-04T12:26:43.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.980+0000 7fa4b3c3e780 1 < suggested update operation key=KKQT9J9GSW0N tag=XKBGXP6A7276 type=del size=3298370 2024-03-04T12:26:43.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.982+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~3TRSNP19906Q.0 size=1048576 2024-03-04T12:26:43.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.983+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~3TRSNP19906Q.1 size=1048576 2024-03-04T12:26:43.990 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.984+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~3TRSNP19906Q.2 size=746438 2024-03-04T12:26:43.990 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.984+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=3TRSNP19906Q tag=9AV1SLQMBI0P type=write size=3892166 2024-03-04T12:26:43.992 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.985+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~YD94U1P6BHAE.0 size=426192 2024-03-04T12:26:43.993 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.987+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=YD94U1P6BHAE tag=75U97L4OCWV0 type=write size=1474768 2024-03-04T12:26:43.995 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.988+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=GJE970Q1T0B8 type=del size=3546000 2024-03-04T12:26:43.996 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.989+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~O3XYXPVC511C.0 size=1048576 2024-03-04T12:26:43.997 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.990+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~O3XYXPVC511C.1 size=978358 2024-03-04T12:26:43.999 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.992+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=O3XYXPVC511C tag=Z1Q0YHU9TEI3 type=write size=3075510 2024-03-04T12:26:44.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.993+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=G29S807HP2UV type=del size=2103646 2024-03-04T12:26:44.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.993+0000 7fa4b3c3e780 1 < canceled part key=_multipart_R6Y09EO6HGF0.2~X6VTWVWXBSJC.0 size=1048576 2024-03-04T12:26:44.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.994+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~X6VTWVWXBSJC.1 size=1048576 2024-03-04T12:26:44.002 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.995+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~X6VTWVWXBSJC.2 size=262543 2024-03-04T12:26:44.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.997+0000 7fa4b3c3e780 1 < canceled multipart upload key=R6Y09EO6HGF0 upload=X6VTWVWXBSJC tag=VK99ZQT5Y2H5 type=write size=3408271 2024-03-04T12:26:44.006 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:43.999+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~FMB98XV184SO.0 size=1048576 2024-03-04T12:26:44.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.000+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~FMB98XV184SO.1 size=335871 2024-03-04T12:26:44.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.000+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=FMB98XV184SO tag=OT76LTV4I2HM type=write size=2433023 2024-03-04T12:26:44.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.002+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=AA9VXSM7SM5V type=del 2024-03-04T12:26:44.010 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.004+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~TSYZPNSRT8N4.0 size=1048576 2024-03-04T12:26:44.011 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.005+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~TSYZPNSRT8N4.1 size=963015 2024-03-04T12:26:44.011 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.005+0000 7fa4b3c3e780 1 > prepared multipart upload key=NVMIU38VM9Q1 upload=TSYZPNSRT8N4 tag=0L1C0S84OYHQ type=write size=3060167 2024-03-04T12:26:44.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.006+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=KL7PUS1AJ5CY type=del 2024-03-04T12:26:44.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.008+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~GYXW2YE1TW9G.0 size=1048576 2024-03-04T12:26:44.016 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.009+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~GYXW2YE1TW9G.1 size=1048576 2024-03-04T12:26:44.017 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.010+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~GYXW2YE1TW9G.2 size=311589 2024-03-04T12:26:44.017 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.010+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=GYXW2YE1TW9G tag=1AK1MD9S2NTR type=write size=3457317 2024-03-04T12:26:44.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.011+0000 7fa4b3c3e780 1 < completed write operation key=YWJV4QMY6ZBI tag=EXUWO3KZFXYF type=write size=525916 2024-03-04T12:26:44.020 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.013+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~Z7CU2D0H0EOH.0 size=1002530 2024-03-04T12:26:44.021 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.013+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=Z7CU2D0H0EOH tag=YN2GY5PC5NNH type=write size=2051106 2024-03-04T12:26:44.022 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.015+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=VNYG9AAG8HA0 type=del 2024-03-04T12:26:44.023 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.016+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=5XVSTFTK0K5A type=del size=1699915 2024-03-04T12:26:44.024 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.017+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=2K2PH6PGFVUK type=del 2024-03-04T12:26:44.026 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.019+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=MSLLKV2QN5W3 type=write size=209225 2024-03-04T12:26:44.027 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.020+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~RQN0P2MXQQF5.0 size=204593 2024-03-04T12:26:44.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.022+0000 7fa4b3c3e780 1 < completed multipart upload key=BVMWQ9ZL4K0C upload=RQN0P2MXQQF5 tag=T2VIHYNNWVPK type=write size=1253169 2024-03-04T12:26:44.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.024+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~7Y0BCC6SIQLC.0 size=1048576 2024-03-04T12:26:44.032 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.025+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~7Y0BCC6SIQLC.1 size=1048576 2024-03-04T12:26:44.033 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.026+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~7Y0BCC6SIQLC.2 size=360202 2024-03-04T12:26:44.033 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.026+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=7Y0BCC6SIQLC tag=ER9RZL6E9762 type=write size=3505930 2024-03-04T12:26:44.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.027+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~UTRO38ZPK1XC.0 size=568701 2024-03-04T12:26:44.036 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.029+0000 7fa4b3c3e780 1 < completed multipart upload key=NVMIU38VM9Q1 upload=UTRO38ZPK1XC tag=KSJ73X0FFF6B type=write size=1617277 2024-03-04T12:26:44.038 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.031+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~AGPA4DG63VGI.0 size=797963 2024-03-04T12:26:44.038 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.031+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=AGPA4DG63VGI tag=2U2JKNW3Q0EI type=write size=1846539 2024-03-04T12:26:44.039 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.033+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=1KYYYMNBA1YP type=del 2024-03-04T12:26:44.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.035+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~FOTDKT9Q0AD7.0 size=1048576 2024-03-04T12:26:44.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.035+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~FOTDKT9Q0AD7.1 size=346639 2024-03-04T12:26:44.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.035+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=FOTDKT9Q0AD7 tag=902UTG4GMJ0G type=write size=2443791 2024-03-04T12:26:44.043 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.037+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~FE8XU44FRTMO.0 size=1048576 2024-03-04T12:26:44.044 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.037+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~FE8XU44FRTMO.1 size=1048576 2024-03-04T12:26:44.045 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.038+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~FE8XU44FRTMO.2 size=725753 2024-03-04T12:26:44.047 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.040+0000 7fa4b3c3e780 1 < completed multipart upload key=G8G76PMSKJ0I upload=FE8XU44FRTMO tag=E9YPZEKNPNX6 type=write size=3871481 2024-03-04T12:26:44.051 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.042+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~0GT7DLWKYY1C.0 size=1048576 2024-03-04T12:26:44.051 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.043+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~0GT7DLWKYY1C.1 size=1048576 2024-03-04T12:26:44.052 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.044+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~0GT7DLWKYY1C.2 size=833234 2024-03-04T12:26:44.052 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.044+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=0GT7DLWKYY1C tag=D8GH5YF9TC08 type=write size=3978962 2024-03-04T12:26:44.052 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.045+0000 7fa4b3c3e780 1 < completed write operation key=3TDMQXKLPX34 tag=0X4DWAG36P6G type=write size=392504 2024-03-04T12:26:44.054 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.047+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~DY0SGZ8T5Z7R.0 size=1048576 2024-03-04T12:26:44.055 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.048+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~DY0SGZ8T5Z7R.1 size=1048576 2024-03-04T12:26:44.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.049+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~DY0SGZ8T5Z7R.2 size=335861 2024-03-04T12:26:44.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.049+0000 7fa4b3c3e780 1 > prepared multipart upload key=G8G76PMSKJ0I upload=DY0SGZ8T5Z7R tag=BQ3IMAFKV2QM type=write size=3481589 2024-03-04T12:26:44.058 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.051+0000 7fa4b3c3e780 1 < completed write operation key=VAIY4J3CYONH tag=MB50V92KA795 type=write size=356929 2024-03-04T12:26:44.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.052+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=SSJOHKTRM07G type=del size=278385 2024-03-04T12:26:44.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.054+0000 7fa4b3c3e780 1 < completed delete operation key=YWJV4QMY6ZBI tag=RVW0ND99DOF6 type=del 2024-03-04T12:26:44.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.055+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=482RNHD89015 type=del size=3807715 2024-03-04T12:26:44.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.055+0000 7fa4b3c3e780 1 < canceled part key=_multipart_G70BJ2UARNCP.2~3TRSNP19906Q.0 size=1048576 2024-03-04T12:26:44.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.056+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~3TRSNP19906Q.1 size=1048576 2024-03-04T12:26:44.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.057+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~3TRSNP19906Q.2 size=746438 2024-03-04T12:26:44.066 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.059+0000 7fa4b3c3e780 1 < canceled multipart upload key=G70BJ2UARNCP upload=3TRSNP19906Q tag=9AV1SLQMBI0P type=write size=3892166 2024-03-04T12:26:44.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.061+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~EDVRA6A7SBZK.0 size=316314 2024-03-04T12:26:44.068 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.061+0000 7fa4b3c3e780 1 > prepared multipart upload key=NVMIU38VM9Q1 upload=EDVRA6A7SBZK tag=91WKIZVGYQ9X type=write size=1364890 2024-03-04T12:26:44.069 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.062+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=GJE970Q1T0B8 type=del 2024-03-04T12:26:44.070 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.063+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=T0ZL2ELI2U59 type=del size=4008772 2024-03-04T12:26:44.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.065+0000 7fa4b3c3e780 1 < suggested update operation key=YIS2SV4O5EZN tag=G29S807HP2UV type=del size=2103646 2024-03-04T12:26:44.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.066+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=G12H4U0YRZV9 type=del size=3263836 2024-03-04T12:26:44.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.068+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~FMB98XV184SO.0 size=1048576 2024-03-04T12:26:44.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.069+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~FMB98XV184SO.1 size=335871 2024-03-04T12:26:44.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.071+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=FMB98XV184SO tag=OT76LTV4I2HM type=write size=2433023 2024-03-04T12:26:44.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.072+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=C28PMKX8QJ2Y type=del size=133779 2024-03-04T12:26:44.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.072+0000 7fa4b3c3e780 1 < canceled part key=_multipart_NVMIU38VM9Q1.2~TSYZPNSRT8N4.0 size=1048576 2024-03-04T12:26:44.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.072+0000 7fa4b3c3e780 1 < canceled part key=_multipart_NVMIU38VM9Q1.2~TSYZPNSRT8N4.1 size=963015 2024-03-04T12:26:44.081 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.074+0000 7fa4b3c3e780 1 < canceled multipart upload key=NVMIU38VM9Q1 upload=TSYZPNSRT8N4 tag=0L1C0S84OYHQ type=write size=3060167 2024-03-04T12:26:44.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.076+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~2RDXQDSBMCCA.0 size=829118 2024-03-04T12:26:44.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.077+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=2RDXQDSBMCCA tag=YI03RMWA5J9J type=write size=1877694 2024-03-04T12:26:44.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.078+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~GYXW2YE1TW9G.0 size=1048576 2024-03-04T12:26:44.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.079+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~GYXW2YE1TW9G.1 size=1048576 2024-03-04T12:26:44.086 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.080+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~GYXW2YE1TW9G.2 size=311589 2024-03-04T12:26:44.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.081+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=GYXW2YE1TW9G tag=1AK1MD9S2NTR type=write size=3457317 2024-03-04T12:26:44.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.084+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~UT3ODUEJT365.0 size=1048576 2024-03-04T12:26:44.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.084+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~UT3ODUEJT365.1 size=285890 2024-03-04T12:26:44.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.084+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=UT3ODUEJT365 tag=5IZ41LKEOUPD type=write size=2383042 2024-03-04T12:26:44.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.086+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~Z7CU2D0H0EOH.0 size=1002530 2024-03-04T12:26:44.094 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.088+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=Z7CU2D0H0EOH tag=YN2GY5PC5NNH type=write size=2051106 2024-03-04T12:26:44.096 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.090+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~LRH583P0TAK7.0 size=1048576 2024-03-04T12:26:44.097 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.090+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~LRH583P0TAK7.1 size=1048576 2024-03-04T12:26:44.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.091+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~LRH583P0TAK7.2 size=407814 2024-03-04T12:26:44.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.091+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=LRH583P0TAK7 tag=Q1FHWZW57S4W type=write size=3553542 2024-03-04T12:26:44.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.093+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=5XVSTFTK0K5A type=del 2024-03-04T12:26:44.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.094+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=81YX7Q4EIUH3 type=del size=1507452 2024-03-04T12:26:44.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.095+0000 7fa4b3c3e780 1 < completed write operation key=UZRX3W3DE5VX tag=MSLLKV2QN5W3 type=write size=209225 2024-03-04T12:26:44.105 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.098+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~2ZM05Z0EWPWQ.0 size=283418 2024-03-04T12:26:44.105 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.098+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=2ZM05Z0EWPWQ tag=AMMNONXNRUPV type=write size=1331994 2024-03-04T12:26:44.105 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.098+0000 7fa4b3c3e780 1 < canceled part key=_multipart_GMIPCGYZRJ5L.2~7Y0BCC6SIQLC.0 size=1048576 2024-03-04T12:26:44.105 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.098+0000 7fa4b3c3e780 1 < canceled part key=_multipart_GMIPCGYZRJ5L.2~7Y0BCC6SIQLC.1 size=1048576 2024-03-04T12:26:44.106 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.099+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~7Y0BCC6SIQLC.2 size=360202 2024-03-04T12:26:44.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.101+0000 7fa4b3c3e780 1 < canceled multipart upload key=GMIPCGYZRJ5L upload=7Y0BCC6SIQLC tag=ER9RZL6E9762 type=write size=3505930 2024-03-04T12:26:44.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.102+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=48JIWLG9V1ZV type=del size=1856511 2024-03-04T12:26:44.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.104+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~AGPA4DG63VGI.0 size=797963 2024-03-04T12:26:44.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.106+0000 7fa4b3c3e780 1 < completed multipart upload key=YIS2SV4O5EZN upload=AGPA4DG63VGI tag=2U2JKNW3Q0EI type=write size=1846539 2024-03-04T12:26:44.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.107+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=85X3LBKXW2J6 type=del size=2963364 2024-03-04T12:26:44.115 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.108+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~FOTDKT9Q0AD7.0 size=1048576 2024-03-04T12:26:44.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.109+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~FOTDKT9Q0AD7.1 size=346639 2024-03-04T12:26:44.118 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.111+0000 7fa4b3c3e780 1 < completed multipart upload key=4989OME3IAJF upload=FOTDKT9Q0AD7 tag=902UTG4GMJ0G type=write size=2443791 2024-03-04T12:26:44.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.113+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~2886YV609B2X.0 size=1048576 2024-03-04T12:26:44.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.114+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~2886YV609B2X.1 size=55168 2024-03-04T12:26:44.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.114+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=2886YV609B2X tag=U7TPUSYTTTYB type=write size=2152320 2024-03-04T12:26:44.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.115+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~0GT7DLWKYY1C.0 size=1048576 2024-03-04T12:26:44.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.116+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~0GT7DLWKYY1C.1 size=1048576 2024-03-04T12:26:44.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.117+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~0GT7DLWKYY1C.2 size=833234 2024-03-04T12:26:44.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.119+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=0GT7DLWKYY1C tag=D8GH5YF9TC08 type=write size=3978962 2024-03-04T12:26:44.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.120+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=1MCICC27JY8S type=del size=3611985 2024-03-04T12:26:44.128 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.121+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~DY0SGZ8T5Z7R.0 size=1048576 2024-03-04T12:26:44.129 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.122+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~DY0SGZ8T5Z7R.1 size=1048576 2024-03-04T12:26:44.130 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.123+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~DY0SGZ8T5Z7R.2 size=335861 2024-03-04T12:26:44.132 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.125+0000 7fa4b3c3e780 1 < completed multipart upload key=G8G76PMSKJ0I upload=DY0SGZ8T5Z7R tag=BQ3IMAFKV2QM type=write size=3481589 2024-03-04T12:26:44.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.126+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=S6WGFBR5EAXY type=write size=939837 2024-03-04T12:26:44.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.127+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=SSJOHKTRM07G type=del 2024-03-04T12:26:44.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.129+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~NG08RUG8Z9ZX.0 size=1048576 2024-03-04T12:26:44.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.130+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~NG08RUG8Z9ZX.1 size=930401 2024-03-04T12:26:44.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.130+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=NG08RUG8Z9ZX tag=24XCS4MORJG4 type=write size=3027553 2024-03-04T12:26:44.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.131+0000 7fa4b3c3e780 1 < canceled operation key=R6Y09EO6HGF0 tag=482RNHD89015 type=del size=3807715 2024-03-04T12:26:44.140 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.133+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~ZC2WPAB7N8WL.0 size=1048576 2024-03-04T12:26:44.141 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.134+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~ZC2WPAB7N8WL.1 size=1048576 2024-03-04T12:26:44.142 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.135+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~ZC2WPAB7N8WL.2 size=500235 2024-03-04T12:26:44.142 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.135+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=ZC2WPAB7N8WL tag=YNI7H0INISXD type=write size=3645963 2024-03-04T12:26:44.143 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.136+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~EDVRA6A7SBZK.0 size=316314 2024-03-04T12:26:44.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.138+0000 7fa4b3c3e780 1 < completed multipart upload key=NVMIU38VM9Q1 upload=EDVRA6A7SBZK tag=91WKIZVGYQ9X type=write size=1364890 2024-03-04T12:26:44.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.139+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=8GHQ16KNUG97 type=del size=424603 2024-03-04T12:26:44.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.141+0000 7fa4b3c3e780 1 < suggested update operation key=3N6E09QF3866 tag=T0ZL2ELI2U59 type=del size=4008772 2024-03-04T12:26:44.149 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.143+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=O7WEUVOYT6RA type=del size=3516351 2024-03-04T12:26:44.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.144+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=G12H4U0YRZV9 type=del 2024-03-04T12:26:44.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.145+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=Z20RKMY0JMZB type=del size=1137614 2024-03-04T12:26:44.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.146+0000 7fa4b3c3e780 1 < completed delete operation key=UZRX3W3DE5VX tag=C28PMKX8QJ2Y type=del 2024-03-04T12:26:44.154 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.147+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=V5TTDA07CKHZ type=del size=3377925 2024-03-04T12:26:44.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.148+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~2RDXQDSBMCCA.0 size=829118 2024-03-04T12:26:44.157 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.150+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=2RDXQDSBMCCA tag=YI03RMWA5J9J type=write size=1877694 2024-03-04T12:26:44.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.152+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~XCL03FS67MSA.0 size=1048576 2024-03-04T12:26:44.160 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.153+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~XCL03FS67MSA.1 size=429354 2024-03-04T12:26:44.160 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.153+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=XCL03FS67MSA tag=IKWGMRABT1LL type=write size=2526506 2024-03-04T12:26:44.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.154+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~UT3ODUEJT365.0 size=1048576 2024-03-04T12:26:44.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.155+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~UT3ODUEJT365.1 size=285890 2024-03-04T12:26:44.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.158+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=UT3ODUEJT365 tag=5IZ41LKEOUPD type=write size=2383042 2024-03-04T12:26:44.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.159+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=H5GA0W3K2Z8Q type=write size=628549 2024-03-04T12:26:44.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.161+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~LRH583P0TAK7.0 size=1048576 2024-03-04T12:26:44.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.162+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~LRH583P0TAK7.1 size=1048576 2024-03-04T12:26:44.169 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.162+0000 7fa4b3c3e780 1 < canceled part key=_multipart_3TDMQXKLPX34.2~LRH583P0TAK7.2 size=407814 2024-03-04T12:26:44.170 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.163+0000 7fa4b3c3e780 1 < canceled multipart upload key=3TDMQXKLPX34 upload=LRH583P0TAK7 tag=Q1FHWZW57S4W type=write size=3553542 2024-03-04T12:26:44.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.165+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=T3PEJNCHGQ6E type=write size=531491 2024-03-04T12:26:44.172 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.166+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=81YX7Q4EIUH3 type=del 2024-03-04T12:26:44.174 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.167+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=VL23KFGLU1U5 type=write size=240062 2024-03-04T12:26:44.174 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.167+0000 7fa4b3c3e780 1 < canceled part key=_multipart_3TDMQXKLPX34.2~2ZM05Z0EWPWQ.0 size=283418 2024-03-04T12:26:44.176 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.169+0000 7fa4b3c3e780 1 < canceled multipart upload key=3TDMQXKLPX34 upload=2ZM05Z0EWPWQ tag=AMMNONXNRUPV type=write size=1331994 2024-03-04T12:26:44.177 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.170+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=2PM615DQXZ7V type=del size=1691701 2024-03-04T12:26:44.178 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.171+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=48JIWLG9V1ZV type=del 2024-03-04T12:26:44.179 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.172+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=4VG1WAEQUM8F type=del size=3764388 2024-03-04T12:26:44.180 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.173+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=85X3LBKXW2J6 type=del 2024-03-04T12:26:44.181 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.175+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=RLSI8FZHRFS5 type=write size=574229 2024-03-04T12:26:44.182 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.176+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~2886YV609B2X.0 size=1048576 2024-03-04T12:26:44.182 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.176+0000 7fa4b3c3e780 1 < canceled part key=_multipart_3N6E09QF3866.2~2886YV609B2X.1 size=55168 2024-03-04T12:26:44.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.178+0000 7fa4b3c3e780 1 < canceled multipart upload key=3N6E09QF3866 upload=2886YV609B2X tag=U7TPUSYTTTYB type=write size=2152320 2024-03-04T12:26:44.185 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.179+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=E8LWLY6WW58F type=del size=2471676 2024-03-04T12:26:44.187 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.180+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=1MCICC27JY8S type=del 2024-03-04T12:26:44.188 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.181+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=WJAEKVCRO20F type=write size=844509 2024-03-04T12:26:44.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.182+0000 7fa4b3c3e780 1 < completed write operation key=DHLTVH2AZBLR tag=S6WGFBR5EAXY type=write size=939837 2024-03-04T12:26:44.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.184+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=ZEGN88DHU7KH type=del size=2008878 2024-03-04T12:26:44.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.184+0000 7fa4b3c3e780 1 < canceled part key=_multipart_G70BJ2UARNCP.2~NG08RUG8Z9ZX.0 size=1048576 2024-03-04T12:26:44.192 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.185+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~NG08RUG8Z9ZX.1 size=930401 2024-03-04T12:26:44.194 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.187+0000 7fa4b3c3e780 1 < canceled multipart upload key=G70BJ2UARNCP upload=NG08RUG8Z9ZX tag=24XCS4MORJG4 type=write size=3027553 2024-03-04T12:26:44.195 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.188+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=Y9NRF7RRL1QA type=del size=1617887 2024-03-04T12:26:44.196 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.189+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~ZC2WPAB7N8WL.0 size=1048576 2024-03-04T12:26:44.197 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.190+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~ZC2WPAB7N8WL.1 size=1048576 2024-03-04T12:26:44.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.191+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~ZC2WPAB7N8WL.2 size=500235 2024-03-04T12:26:44.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.194+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=ZC2WPAB7N8WL tag=YNI7H0INISXD type=write size=3645963 2024-03-04T12:26:44.202 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.195+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=AR2TAF2NICSA type=del size=4044907 2024-03-04T12:26:44.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.196+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=8GHQ16KNUG97 type=del 2024-03-04T12:26:44.204 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.197+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=BIEWWKEG64UO type=del size=713682 2024-03-04T12:26:44.207 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.200+0000 7fa4b3c3e780 1 < suggested remove operation key=3N6E09QF3866 tag=O7WEUVOYT6RA type=del 2024-03-04T12:26:44.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.202+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~S09GUYATICWC.0 size=1048576 2024-03-04T12:26:44.210 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.203+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~S09GUYATICWC.1 size=1048576 2024-03-04T12:26:44.211 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.204+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~S09GUYATICWC.2 size=9624 2024-03-04T12:26:44.211 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.204+0000 7fa4b3c3e780 1 > prepared multipart upload key=G4SUQFVB936T upload=S09GUYATICWC tag=8G3BIEJWAF74 type=write size=3155352 2024-03-04T12:26:44.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.206+0000 7fa4b3c3e780 1 < suggested update operation key=ESHAMQWMMBJR tag=Z20RKMY0JMZB type=del size=1137614 2024-03-04T12:26:44.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.208+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=V65EEDFBR80Q type=del size=2514401 2024-03-04T12:26:44.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.209+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=V5TTDA07CKHZ type=del 2024-03-04T12:26:44.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.211+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~HSEIM8MJC407.0 size=1048576 2024-03-04T12:26:44.219 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.212+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~HSEIM8MJC407.1 size=473105 2024-03-04T12:26:44.219 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.212+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=HSEIM8MJC407 tag=8SA3ZV3W3US3 type=write size=2570257 2024-03-04T12:26:44.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.213+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~XCL03FS67MSA.0 size=1048576 2024-03-04T12:26:44.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.214+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~XCL03FS67MSA.1 size=429354 2024-03-04T12:26:44.223 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.216+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=XCL03FS67MSA tag=IKWGMRABT1LL type=write size=2526506 2024-03-04T12:26:44.225 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.218+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~ZY58NN05WNSS.0 size=602473 2024-03-04T12:26:44.225 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.218+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=ZY58NN05WNSS tag=YN7UGRS2BBMG type=write size=1651049 2024-03-04T12:26:44.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.220+0000 7fa4b3c3e780 1 < completed write operation key=G4SUQFVB936T tag=H5GA0W3K2Z8Q type=write size=628549 2024-03-04T12:26:44.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.221+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=3CSAVQEWWLWR type=del size=2238957 2024-03-04T12:26:44.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.223+0000 7fa4b3c3e780 1 < suggested remove operation key=R1DOKJPZRT5Q tag=T3PEJNCHGQ6E type=write 2024-03-04T12:26:44.231 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.224+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=VU5732JW7ZIT type=del size=356570 2024-03-04T12:26:44.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.225+0000 7fa4b3c3e780 1 < canceled operation key=3TDMQXKLPX34 tag=VL23KFGLU1U5 type=write size=240062 2024-03-04T12:26:44.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.226+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=WMYZ5SD24V0T type=del size=542937 2024-03-04T12:26:44.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.227+0000 7fa4b3c3e780 1 < completed delete operation key=RHU0QO8HS5SC tag=2PM615DQXZ7V type=del 2024-03-04T12:26:44.235 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.229+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=O3HT0NWZBMOO type=del size=321780 2024-03-04T12:26:44.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.230+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=4VG1WAEQUM8F type=del 2024-03-04T12:26:44.238 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.231+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=31HLTLMCDIOU type=del size=1968234 2024-03-04T12:26:44.239 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.232+0000 7fa4b3c3e780 1 < completed write operation key=NVMIU38VM9Q1 tag=RLSI8FZHRFS5 type=write size=574229 2024-03-04T12:26:44.240 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.233+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=J181V5OX8GND type=write size=199391 2024-03-04T12:26:44.241 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.234+0000 7fa4b3c3e780 1 < completed delete operation key=X0RVLNRWUAEM tag=E8LWLY6WW58F type=del 2024-03-04T12:26:44.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.236+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~3WYJK9OJU7G5.0 size=610239 2024-03-04T12:26:44.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.236+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=3WYJK9OJU7G5 tag=X3TLER5MFXO7 type=write size=1658815 2024-03-04T12:26:44.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.238+0000 7fa4b3c3e780 1 < canceled operation key=H5FWRNK8F7QT tag=WJAEKVCRO20F type=write size=844509 2024-03-04T12:26:44.246 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.239+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=1D6P0JJ1A4OD type=del size=892991 2024-03-04T12:26:44.247 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.240+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=ZEGN88DHU7KH type=del 2024-03-04T12:26:44.248 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.241+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=1HFME0X32RXF type=del size=2861451 2024-03-04T12:26:44.249 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.242+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=Y9NRF7RRL1QA type=del 2024-03-04T12:26:44.250 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.243+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=SF35B7QGR379 type=del size=3475946 2024-03-04T12:26:44.253 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.246+0000 7fa4b3c3e780 1 < suggested remove operation key=YWJV4QMY6ZBI tag=AR2TAF2NICSA type=del 2024-03-04T12:26:44.255 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.248+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~GXYP2AMUFQTR.0 size=1048576 2024-03-04T12:26:44.255 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.249+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~GXYP2AMUFQTR.1 size=1048576 2024-03-04T12:26:44.256 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.250+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~GXYP2AMUFQTR.2 size=919772 2024-03-04T12:26:44.256 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.250+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=GXYP2AMUFQTR tag=XI1SDOYSKU7S type=write size=4065500 2024-03-04T12:26:44.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.251+0000 7fa4b3c3e780 1 < canceled operation key=BVMWQ9ZL4K0C tag=BIEWWKEG64UO type=del size=713682 2024-03-04T12:26:44.259 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.252+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=WWTK97ZW04D4 type=del size=1687766 2024-03-04T12:26:44.260 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.253+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~S09GUYATICWC.0 size=1048576 2024-03-04T12:26:44.261 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.254+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~S09GUYATICWC.1 size=1048576 2024-03-04T12:26:44.261 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.254+0000 7fa4b3c3e780 1 < canceled part key=_multipart_G4SUQFVB936T.2~S09GUYATICWC.2 size=9624 2024-03-04T12:26:44.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.256+0000 7fa4b3c3e780 1 < canceled multipart upload key=G4SUQFVB936T upload=S09GUYATICWC tag=8G3BIEJWAF74 type=write size=3155352 2024-03-04T12:26:44.264 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.257+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=DT3GMH4TAM7F type=del size=1130320 2024-03-04T12:26:44.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.258+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=V65EEDFBR80Q type=del 2024-03-04T12:26:44.266 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.259+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=LQZ7SIOW8IWG type=del size=2503747 2024-03-04T12:26:44.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.260+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~HSEIM8MJC407.0 size=1048576 2024-03-04T12:26:44.268 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.261+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~HSEIM8MJC407.1 size=473105 2024-03-04T12:26:44.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.263+0000 7fa4b3c3e780 1 < completed multipart upload key=43HMF7NWNMU3 upload=HSEIM8MJC407 tag=8SA3ZV3W3US3 type=write size=2570257 2024-03-04T12:26:44.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.264+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=7H84WCUU8EJC type=del size=2132498 2024-03-04T12:26:44.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.266+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~ZY58NN05WNSS.0 size=602473 2024-03-04T12:26:44.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.268+0000 7fa4b3c3e780 1 < completed multipart upload key=J53J0N99N30A upload=ZY58NN05WNSS tag=YN7UGRS2BBMG type=write size=1651049 2024-03-04T12:26:44.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.271+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~2ADCMS0ZE2XJ.0 size=1048576 2024-03-04T12:26:44.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.271+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~2ADCMS0ZE2XJ.1 size=389405 2024-03-04T12:26:44.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.271+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=2ADCMS0ZE2XJ tag=X1WWQ32WCQSM type=write size=2486557 2024-03-04T12:26:44.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.273+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=3CSAVQEWWLWR type=del 2024-03-04T12:26:44.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.274+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=Y8NK4GHRHGUJ type=del size=4076295 2024-03-04T12:26:44.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.276+0000 7fa4b3c3e780 1 < suggested remove operation key=WRHB3XWDLSY2 tag=VU5732JW7ZIT type=del 2024-03-04T12:26:44.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.278+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~PLMNAXE3691E.0 size=458586 2024-03-04T12:26:44.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.278+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=PLMNAXE3691E tag=ECLMWG25TC28 type=write size=1507162 2024-03-04T12:26:44.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.279+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=WMYZ5SD24V0T type=del 2024-03-04T12:26:44.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.281+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~IQIE3GOVK2VJ.0 size=1048576 2024-03-04T12:26:44.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.282+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~IQIE3GOVK2VJ.1 size=902910 2024-03-04T12:26:44.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.282+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=IQIE3GOVK2VJ tag=SK2IH8BTQF0Z type=write size=3000062 2024-03-04T12:26:44.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.283+0000 7fa4b3c3e780 1 < canceled operation key=YQLH0WW7I7MW tag=O3HT0NWZBMOO type=del size=321780 2024-03-04T12:26:44.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.285+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~BXHW1CV0R998.0 size=168329 2024-03-04T12:26:44.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.285+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=BXHW1CV0R998 tag=AZGQU03BYLWF type=write size=1216905 2024-03-04T12:26:44.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.286+0000 7fa4b3c3e780 1 < completed delete operation key=GMIPCGYZRJ5L tag=31HLTLMCDIOU type=del 2024-03-04T12:26:44.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.288+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~BK1W3D92Q6TV.0 size=1048576 2024-03-04T12:26:44.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.289+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~BK1W3D92Q6TV.1 size=802004 2024-03-04T12:26:44.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.289+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=BK1W3D92Q6TV tag=PWQAXFN71DID type=write size=2899156 2024-03-04T12:26:44.297 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.290+0000 7fa4b3c3e780 1 < completed write operation key=H5FWRNK8F7QT tag=J181V5OX8GND type=write size=199391 2024-03-04T12:26:44.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.292+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=UEM7G8KA8N7Y type=del size=1430745 2024-03-04T12:26:44.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.293+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~3WYJK9OJU7G5.0 size=610239 2024-03-04T12:26:44.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.295+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=3WYJK9OJU7G5 tag=X3TLER5MFXO7 type=write size=1658815 2024-03-04T12:26:44.302 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.296+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=EJBQS8XHRL8M type=del size=1094388 2024-03-04T12:26:44.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.297+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=1D6P0JJ1A4OD type=del 2024-03-04T12:26:44.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.298+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=TEY13FKO5QS1 type=del size=4187588 2024-03-04T12:26:44.306 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.299+0000 7fa4b3c3e780 -1 < failed to complete operation key=WRHB3XWDLSY2 tag=1HFME0X32RXF type=del size=2861451: (22) Invalid argument 2024-03-04T12:26:44.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.301+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~99GTEMJ0DDK6.0 size=1048576 2024-03-04T12:26:44.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.302+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~99GTEMJ0DDK6.1 size=251222 2024-03-04T12:26:44.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.302+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=99GTEMJ0DDK6 tag=0MFE3PELGRO1 type=write size=2348374 2024-03-04T12:26:44.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.303+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=SF35B7QGR379 type=del 2024-03-04T12:26:44.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.305+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~5NV571Z7MZV9.0 size=1048576 2024-03-04T12:26:44.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.306+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~5NV571Z7MZV9.1 size=1048576 2024-03-04T12:26:44.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.307+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~5NV571Z7MZV9.2 size=106000 2024-03-04T12:26:44.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.307+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=5NV571Z7MZV9 tag=C3587IDSN8FT type=write size=3251728 2024-03-04T12:26:44.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.308+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~GXYP2AMUFQTR.0 size=1048576 2024-03-04T12:26:44.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.309+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~GXYP2AMUFQTR.1 size=1048576 2024-03-04T12:26:44.317 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.310+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~GXYP2AMUFQTR.2 size=919772 2024-03-04T12:26:44.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.312+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=GXYP2AMUFQTR tag=XI1SDOYSKU7S type=write size=4065500 2024-03-04T12:26:44.320 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.313+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=KUO30F1VIDLR type=write size=652013 2024-03-04T12:26:44.321 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.314+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=WWTK97ZW04D4 type=del 2024-03-04T12:26:44.322 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.316+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=3OKLXG06RFRT type=del size=3163787 2024-03-04T12:26:44.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.317+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=DT3GMH4TAM7F type=del 2024-03-04T12:26:44.325 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.318+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=U3R234UW1E7Q type=del size=1859799 2024-03-04T12:26:44.326 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.319+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=LQZ7SIOW8IWG type=del 2024-03-04T12:26:44.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.320+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=M3TLYJDE0077 type=del size=297391 2024-03-04T12:26:44.328 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.321+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=7H84WCUU8EJC type=del 2024-03-04T12:26:44.331 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.324+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~3YMYNVIPTG6Y.0 size=134361 2024-03-04T12:26:44.331 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.324+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=3YMYNVIPTG6Y tag=FB2WVXCAWLOH type=write size=1182937 2024-03-04T12:26:44.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.325+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~2ADCMS0ZE2XJ.0 size=1048576 2024-03-04T12:26:44.333 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.326+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~2ADCMS0ZE2XJ.1 size=389405 2024-03-04T12:26:44.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.328+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=2ADCMS0ZE2XJ tag=X1WWQ32WCQSM type=write size=2486557 2024-03-04T12:26:44.336 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.329+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=IYW54NVA6R6A type=del size=1065452 2024-03-04T12:26:44.338 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.331+0000 7fa4b3c3e780 1 < canceled operation key=RHU0QO8HS5SC tag=Y8NK4GHRHGUJ type=del size=4076295 2024-03-04T12:26:44.339 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.332+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=MWTHQX5D5PAD type=del size=1050356 2024-03-04T12:26:44.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.333+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~PLMNAXE3691E.0 size=458586 2024-03-04T12:26:44.342 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.335+0000 7fa4b3c3e780 1 < completed multipart upload key=YIS2SV4O5EZN upload=PLMNAXE3691E tag=ECLMWG25TC28 type=write size=1507162 2024-03-04T12:26:44.344 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.337+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~3WXF382HRN9V.0 size=1048576 2024-03-04T12:26:44.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.338+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~3WXF382HRN9V.1 size=40648 2024-03-04T12:26:44.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.338+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=3WXF382HRN9V tag=N5FSUK8E4JHS type=write size=2137800 2024-03-04T12:26:44.346 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.339+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~IQIE3GOVK2VJ.0 size=1048576 2024-03-04T12:26:44.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.340+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~IQIE3GOVK2VJ.1 size=902910 2024-03-04T12:26:44.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.342+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=IQIE3GOVK2VJ tag=SK2IH8BTQF0Z type=write size=3000062 2024-03-04T12:26:44.352 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.345+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~5BJ1NDBL63JU.0 size=1048576 2024-03-04T12:26:44.352 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.346+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~5BJ1NDBL63JU.1 size=243723 2024-03-04T12:26:44.352 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.346+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=5BJ1NDBL63JU tag=F09C5KLTDTKD type=write size=2340875 2024-03-04T12:26:44.354 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.347+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~BXHW1CV0R998.0 size=168329 2024-03-04T12:26:44.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.349+0000 7fa4b3c3e780 1 < completed multipart upload key=3N6E09QF3866 upload=BXHW1CV0R998 tag=AZGQU03BYLWF type=write size=1216905 2024-03-04T12:26:44.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.351+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~HFF5GBIFSIXJ.0 size=1048576 2024-03-04T12:26:44.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.351+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~HFF5GBIFSIXJ.1 size=1048576 2024-03-04T12:26:44.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.352+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~HFF5GBIFSIXJ.2 size=587760 2024-03-04T12:26:44.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.352+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=HFF5GBIFSIXJ tag=R227YUGAJM9G type=write size=3733488 2024-03-04T12:26:44.360 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.354+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~BK1W3D92Q6TV.0 size=1048576 2024-03-04T12:26:44.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.355+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~BK1W3D92Q6TV.1 size=802004 2024-03-04T12:26:44.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.357+0000 7fa4b3c3e780 1 < completed multipart upload key=G70BJ2UARNCP upload=BK1W3D92Q6TV tag=PWQAXFN71DID type=write size=2899156 2024-03-04T12:26:44.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.358+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=LZM86ZVXMWJP type=del size=2015725 2024-03-04T12:26:44.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.359+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=UEM7G8KA8N7Y type=del 2024-03-04T12:26:44.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.360+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=ZZ3UT92W4JVH type=del size=746314 2024-03-04T12:26:44.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.362+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=EJBQS8XHRL8M type=del 2024-03-04T12:26:44.370 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.364+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~5S8PF3QKO18I.0 size=378 2024-03-04T12:26:44.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.364+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=5S8PF3QKO18I tag=7TKOJSZFGYRA type=write size=1048954 2024-03-04T12:26:44.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.365+0000 7fa4b3c3e780 1 < canceled operation key=G70BJ2UARNCP tag=TEY13FKO5QS1 type=del size=4187588 2024-03-04T12:26:44.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.367+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~XYQNHV8MBBQO.0 size=489446 2024-03-04T12:26:44.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.367+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=XYQNHV8MBBQO tag=63YGHTDEKEZY type=write size=1538022 2024-03-04T12:26:44.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.368+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~99GTEMJ0DDK6.0 size=1048576 2024-03-04T12:26:44.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.369+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~99GTEMJ0DDK6.1 size=251222 2024-03-04T12:26:44.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.371+0000 7fa4b3c3e780 1 < completed multipart upload key=4989OME3IAJF upload=99GTEMJ0DDK6 tag=0MFE3PELGRO1 type=write size=2348374 2024-03-04T12:26:44.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.372+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=0BN25367C0KE type=del size=1763883 2024-03-04T12:26:44.380 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.373+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~5NV571Z7MZV9.0 size=1048576 2024-03-04T12:26:44.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.374+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~5NV571Z7MZV9.1 size=1048576 2024-03-04T12:26:44.382 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.375+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~5NV571Z7MZV9.2 size=106000 2024-03-04T12:26:44.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.378+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=5NV571Z7MZV9 tag=C3587IDSN8FT type=write size=3251728 2024-03-04T12:26:44.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.379+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=LZBKE6DR8YH2 type=write size=293970 2024-03-04T12:26:44.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.380+0000 7fa4b3c3e780 1 < completed write operation key=UZRX3W3DE5VX tag=KUO30F1VIDLR type=write size=652013 2024-03-04T12:26:44.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.381+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=0FC0I048IYPO type=del size=1642461 2024-03-04T12:26:44.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.382+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=3OKLXG06RFRT type=del 2024-03-04T12:26:44.390 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.383+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=OIAMTTUHN47C type=del size=3344211 2024-03-04T12:26:44.391 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.385+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=U3R234UW1E7Q type=del 2024-03-04T12:26:44.393 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.386+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=QS1KRJCOWEL4 type=del size=637476 2024-03-04T12:26:44.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.387+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=M3TLYJDE0077 type=del 2024-03-04T12:26:44.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.388+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=8X7QCID7HTSZ type=del size=947654 2024-03-04T12:26:44.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.389+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~3YMYNVIPTG6Y.0 size=134361 2024-03-04T12:26:44.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.391+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=3YMYNVIPTG6Y tag=FB2WVXCAWLOH type=write size=1182937 2024-03-04T12:26:44.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.392+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=CH6ARAHMS7YG type=del size=1277715 2024-03-04T12:26:44.401 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.394+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=IYW54NVA6R6A type=del 2024-03-04T12:26:44.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.395+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=NEG8IJWU5W0J type=write size=988671 2024-03-04T12:26:44.403 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.396+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=MWTHQX5D5PAD type=del 2024-03-04T12:26:44.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.397+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=B6Y6NRZ23MJ7 type=del size=2971196 2024-03-04T12:26:44.405 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.398+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~3WXF382HRN9V.0 size=1048576 2024-03-04T12:26:44.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.399+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~3WXF382HRN9V.1 size=40648 2024-03-04T12:26:44.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.401+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=3WXF382HRN9V tag=N5FSUK8E4JHS type=write size=2137800 2024-03-04T12:26:44.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.402+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=B7RRPF394FKL type=write size=667829 2024-03-04T12:26:44.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.403+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~5BJ1NDBL63JU.0 size=1048576 2024-03-04T12:26:44.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.404+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~5BJ1NDBL63JU.1 size=243723 2024-03-04T12:26:44.413 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.406+0000 7fa4b3c3e780 1 < completed multipart upload key=ESHAMQWMMBJR upload=5BJ1NDBL63JU tag=F09C5KLTDTKD type=write size=2340875 2024-03-04T12:26:44.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.408+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~5G5D8GPH3RZX.0 size=543084 2024-03-04T12:26:44.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.408+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=5G5D8GPH3RZX tag=7GEL9M91PQK1 type=write size=1591660 2024-03-04T12:26:44.416 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.409+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~HFF5GBIFSIXJ.0 size=1048576 2024-03-04T12:26:44.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.410+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~HFF5GBIFSIXJ.1 size=1048576 2024-03-04T12:26:44.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.411+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~HFF5GBIFSIXJ.2 size=587760 2024-03-04T12:26:44.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.413+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=HFF5GBIFSIXJ tag=R227YUGAJM9G type=write size=3733488 2024-03-04T12:26:44.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.414+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=O2G5H8U04QC7 type=del size=2640818 2024-03-04T12:26:44.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.415+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=LZM86ZVXMWJP type=del 2024-03-04T12:26:44.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.417+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~GI84WGNDOT8B.0 size=952323 2024-03-04T12:26:44.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.417+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=GI84WGNDOT8B tag=E1JGXYIFEMP2 type=write size=2000899 2024-03-04T12:26:44.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.420+0000 7fa4b3c3e780 1 < suggested update operation key=ZETES4AYZQHY tag=ZZ3UT92W4JVH type=del size=746314 2024-03-04T12:26:44.428 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.422+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~SP26HJD46R5L.0 size=1048576 2024-03-04T12:26:44.429 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.422+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~SP26HJD46R5L.1 size=385951 2024-03-04T12:26:44.429 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.422+0000 7fa4b3c3e780 1 > prepared multipart upload key=G4SUQFVB936T upload=SP26HJD46R5L tag=MN1IMNPQ4PRK type=write size=2483103 2024-03-04T12:26:44.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.424+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~5S8PF3QKO18I.0 size=378 2024-03-04T12:26:44.432 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.425+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=5S8PF3QKO18I tag=7TKOJSZFGYRA type=write size=1048954 2024-03-04T12:26:44.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.427+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=28RX2J31JHDH type=del size=2394680 2024-03-04T12:26:44.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.428+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~XYQNHV8MBBQO.0 size=489446 2024-03-04T12:26:44.436 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.429+0000 7fa4b3c3e780 1 < completed multipart upload key=J53J0N99N30A upload=XYQNHV8MBBQO tag=63YGHTDEKEZY type=write size=1538022 2024-03-04T12:26:44.438 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.432+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~63F72TN0U5WW.0 size=1048576 2024-03-04T12:26:44.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.432+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~63F72TN0U5WW.1 size=1048576 2024-03-04T12:26:44.440 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.434+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~63F72TN0U5WW.2 size=113873 2024-03-04T12:26:44.440 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.434+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=63F72TN0U5WW tag=9TDHHD094W23 type=write size=3259601 2024-03-04T12:26:44.441 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.435+0000 7fa4b3c3e780 1 < canceled operation key=BVMWQ9ZL4K0C tag=0BN25367C0KE type=del size=1763883 2024-03-04T12:26:44.443 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.436+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=HQWMKMIW2ZMH type=del size=3270987 2024-03-04T12:26:44.444 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.437+0000 7fa4b3c3e780 1 < completed write operation key=R6Y09EO6HGF0 tag=LZBKE6DR8YH2 type=write size=293970 2024-03-04T12:26:44.446 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.439+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~8K21NT64BAP6.0 size=585903 2024-03-04T12:26:44.446 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.439+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=8K21NT64BAP6 tag=3XP6K394GGTO type=write size=1634479 2024-03-04T12:26:44.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.440+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=0FC0I048IYPO type=del 2024-03-04T12:26:44.449 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.442+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=ODHO4SPYZC7Y type=del size=29240 2024-03-04T12:26:44.450 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.443+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=OIAMTTUHN47C type=del 2024-03-04T12:26:44.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.444+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=AGRHKSK62ATU type=del size=278973 2024-03-04T12:26:44.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.445+0000 7fa4b3c3e780 -1 < failed to complete operation key=ZETES4AYZQHY tag=QS1KRJCOWEL4 type=del size=637476: (22) Invalid argument 2024-03-04T12:26:44.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.447+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~MC9WIDEHHABV.0 size=1048576 2024-03-04T12:26:44.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.448+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~MC9WIDEHHABV.1 size=1048576 2024-03-04T12:26:44.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.449+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~MC9WIDEHHABV.2 size=990037 2024-03-04T12:26:44.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.449+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=MC9WIDEHHABV tag=OIVFVA06AWDV type=write size=4135765 2024-03-04T12:26:44.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.450+0000 7fa4b3c3e780 1 < canceled operation key=R6Y09EO6HGF0 tag=8X7QCID7HTSZ type=del size=947654 2024-03-04T12:26:44.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.451+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=9NYTGQF8WO1J type=del size=3916774 2024-03-04T12:26:44.460 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.453+0000 7fa4b3c3e780 1 < suggested remove operation key=V7N7MZ1GUNEV tag=CH6ARAHMS7YG type=del 2024-03-04T12:26:44.462 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.456+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~9HKK1K8WDQ98.0 size=1024164 2024-03-04T12:26:44.462 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.456+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=9HKK1K8WDQ98 tag=SCGBIPVTJO6W type=write size=2072740 2024-03-04T12:26:44.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.457+0000 7fa4b3c3e780 -1 < failed to complete operation key=V7N7MZ1GUNEV tag=NEG8IJWU5W0J type=write size=988671: (22) Invalid argument 2024-03-04T12:26:44.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.459+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~3O61W3TBRI8E.0 size=167001 2024-03-04T12:26:44.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.459+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=3O61W3TBRI8E tag=OO3FLVEZIWF2 type=write size=1215577 2024-03-04T12:26:44.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.460+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=B6Y6NRZ23MJ7 type=del 2024-03-04T12:26:44.468 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.461+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=CVBMMLR0HUZS type=del size=3905934 2024-03-04T12:26:44.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.463+0000 7fa4b3c3e780 1 < completed write operation key=YIS2SV4O5EZN tag=B7RRPF394FKL type=write size=667829 2024-03-04T12:26:44.472 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.465+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~G0ZJNI3430DT.0 size=491241 2024-03-04T12:26:44.472 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.465+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=G0ZJNI3430DT tag=N71IG17YJF9Q type=write size=1539817 2024-03-04T12:26:44.473 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.466+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~5G5D8GPH3RZX.0 size=543084 2024-03-04T12:26:44.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.468+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=5G5D8GPH3RZX tag=7GEL9M91PQK1 type=write size=1591660 2024-03-04T12:26:44.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.470+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~UX04DSHPAS3H.0 size=1048576 2024-03-04T12:26:44.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.471+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~UX04DSHPAS3H.1 size=327655 2024-03-04T12:26:44.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.471+0000 7fa4b3c3e780 1 > prepared multipart upload key=G4SUQFVB936T upload=UX04DSHPAS3H tag=ET6OUONO614I type=write size=2424807 2024-03-04T12:26:44.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.472+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=O2G5H8U04QC7 type=del 2024-03-04T12:26:44.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.474+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~4N9TPV6DK53V.0 size=1048576 2024-03-04T12:26:44.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.475+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~4N9TPV6DK53V.1 size=1048576 2024-03-04T12:26:44.483 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.476+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~4N9TPV6DK53V.2 size=74275 2024-03-04T12:26:44.483 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.476+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=4N9TPV6DK53V tag=REIIJ8YW425P type=write size=3220003 2024-03-04T12:26:44.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.477+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~GI84WGNDOT8B.0 size=952323 2024-03-04T12:26:44.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.479+0000 7fa4b3c3e780 1 < completed multipart upload key=BVMWQ9ZL4K0C upload=GI84WGNDOT8B tag=E1JGXYIFEMP2 type=write size=2000899 2024-03-04T12:26:44.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.481+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~WEQ837S7F8NI.0 size=80080 2024-03-04T12:26:44.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.481+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=WEQ837S7F8NI tag=TX7PVIQDBH5E type=write size=1128656 2024-03-04T12:26:44.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.482+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~SP26HJD46R5L.0 size=1048576 2024-03-04T12:26:44.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.484+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~SP26HJD46R5L.1 size=385951 2024-03-04T12:26:44.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.486+0000 7fa4b3c3e780 1 < completed multipart upload key=G4SUQFVB936T upload=SP26HJD46R5L tag=MN1IMNPQ4PRK type=write size=2483103 2024-03-04T12:26:44.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.487+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=9LXZ5YO1ANPR type=del size=50017 2024-03-04T12:26:44.495 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.488+0000 7fa4b3c3e780 1 < canceled operation key=3TDMQXKLPX34 tag=28RX2J31JHDH type=del size=2394680 2024-03-04T12:26:44.496 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.490+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~TOXWSHHM9MTM.0 size=1048576 2024-03-04T12:26:44.498 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.491+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~TOXWSHHM9MTM.1 size=1048576 2024-03-04T12:26:44.498 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.492+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~TOXWSHHM9MTM.2 size=543059 2024-03-04T12:26:44.498 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.492+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=TOXWSHHM9MTM tag=NQIC4MPLOJNS type=write size=3688787 2024-03-04T12:26:44.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.493+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~63F72TN0U5WW.0 size=1048576 2024-03-04T12:26:44.501 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.494+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~63F72TN0U5WW.1 size=1048576 2024-03-04T12:26:44.501 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.494+0000 7fa4b3c3e780 1 < canceled part key=_multipart_V7N7MZ1GUNEV.2~63F72TN0U5WW.2 size=113873 2024-03-04T12:26:44.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.496+0000 7fa4b3c3e780 1 < canceled multipart upload key=V7N7MZ1GUNEV upload=63F72TN0U5WW tag=9TDHHD094W23 type=write size=3259601 2024-03-04T12:26:44.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.498+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~P7T23TA7OG9T.0 size=209362 2024-03-04T12:26:44.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.498+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=P7T23TA7OG9T tag=REAI2USKDN4W type=write size=1257938 2024-03-04T12:26:44.506 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.499+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=HQWMKMIW2ZMH type=del 2024-03-04T12:26:44.507 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.500+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=X7B1V9BHLDJL type=del size=893410 2024-03-04T12:26:44.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.501+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~8K21NT64BAP6.0 size=585903 2024-03-04T12:26:44.510 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.503+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=8K21NT64BAP6 tag=3XP6K394GGTO type=write size=1634479 2024-03-04T12:26:44.512 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.505+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~FY5RC0X9CRGO.0 size=1048576 2024-03-04T12:26:44.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.506+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~FY5RC0X9CRGO.1 size=552055 2024-03-04T12:26:44.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.506+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=FY5RC0X9CRGO tag=PBZ8Q8F0TZE8 type=write size=2649207 2024-03-04T12:26:44.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.507+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=ODHO4SPYZC7Y type=del 2024-03-04T12:26:44.515 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.508+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=DRSL7WSGWVCA type=write size=682921 2024-03-04T12:26:44.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.511+0000 7fa4b3c3e780 1 < suggested update operation key=43HMF7NWNMU3 tag=AGRHKSK62ATU type=del size=278973 2024-03-04T12:26:44.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.512+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=S0724SBFYPSS type=del size=2295452 2024-03-04T12:26:44.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.513+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~MC9WIDEHHABV.0 size=1048576 2024-03-04T12:26:44.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.514+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~MC9WIDEHHABV.1 size=1048576 2024-03-04T12:26:44.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.514+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~MC9WIDEHHABV.2 size=990037 2024-03-04T12:26:44.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.516+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=MC9WIDEHHABV tag=OIVFVA06AWDV type=write size=4135765 2024-03-04T12:26:44.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.518+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~6V6NI0VF14IR.0 size=1048576 2024-03-04T12:26:44.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.519+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~6V6NI0VF14IR.1 size=1048576 2024-03-04T12:26:44.527 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.520+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~6V6NI0VF14IR.2 size=491205 2024-03-04T12:26:44.527 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.520+0000 7fa4b3c3e780 1 > prepared multipart upload key=G4SUQFVB936T upload=6V6NI0VF14IR tag=0RE7XXN5VDWP type=write size=3636933 2024-03-04T12:26:44.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.521+0000 7fa4b3c3e780 -1 < failed to complete operation key=43HMF7NWNMU3 tag=9NYTGQF8WO1J type=del size=3916774: (22) Invalid argument 2024-03-04T12:26:44.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.522+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=ZP4CX7KX3O7J type=del size=3254810 2024-03-04T12:26:44.530 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.523+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~9HKK1K8WDQ98.0 size=1024164 2024-03-04T12:26:44.532 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.525+0000 7fa4b3c3e780 1 < completed multipart upload key=G70BJ2UARNCP upload=9HKK1K8WDQ98 tag=SCGBIPVTJO6W type=write size=2072740 2024-03-04T12:26:44.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.526+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=2IXWPKYW50TD type=del size=2082012 2024-03-04T12:26:44.534 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.527+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~3O61W3TBRI8E.0 size=167001 2024-03-04T12:26:44.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.529+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=3O61W3TBRI8E tag=OO3FLVEZIWF2 type=write size=1215577 2024-03-04T12:26:44.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.531+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~G35WNTIF17LJ.0 size=1048576 2024-03-04T12:26:44.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.532+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~G35WNTIF17LJ.1 size=1048576 2024-03-04T12:26:44.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.533+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~G35WNTIF17LJ.2 size=666314 2024-03-04T12:26:44.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.533+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=G35WNTIF17LJ tag=RF1MOCO5WXTH type=write size=3812042 2024-03-04T12:26:44.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.534+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=CVBMMLR0HUZS type=del 2024-03-04T12:26:44.542 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.535+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=UCZBSLFLUF1K type=write size=265879 2024-03-04T12:26:44.543 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.536+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~G0ZJNI3430DT.0 size=491241 2024-03-04T12:26:44.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.537+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=G0ZJNI3430DT tag=N71IG17YJF9Q type=write size=1539817 2024-03-04T12:26:44.545 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.539+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=9HMUPI6ESGBG type=del size=2739896 2024-03-04T12:26:44.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.540+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~UX04DSHPAS3H.0 size=1048576 2024-03-04T12:26:44.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.540+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~UX04DSHPAS3H.1 size=327655 2024-03-04T12:26:44.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.542+0000 7fa4b3c3e780 1 < completed multipart upload key=G4SUQFVB936T upload=UX04DSHPAS3H tag=ET6OUONO614I type=write size=2424807 2024-03-04T12:26:44.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.544+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~BOE01L2DKNOE.0 size=391521 2024-03-04T12:26:44.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.544+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=BOE01L2DKNOE tag=N940DAAXAGPY type=write size=1440097 2024-03-04T12:26:44.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.545+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~4N9TPV6DK53V.0 size=1048576 2024-03-04T12:26:44.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.546+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~4N9TPV6DK53V.1 size=1048576 2024-03-04T12:26:44.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.547+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~4N9TPV6DK53V.2 size=74275 2024-03-04T12:26:44.556 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.549+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=4N9TPV6DK53V tag=REIIJ8YW425P type=write size=3220003 2024-03-04T12:26:44.557 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.550+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=S42OEII1S3TX type=write size=736455 2024-03-04T12:26:44.558 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.551+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~WEQ837S7F8NI.0 size=80080 2024-03-04T12:26:44.560 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.553+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=WEQ837S7F8NI tag=TX7PVIQDBH5E type=write size=1128656 2024-03-04T12:26:44.561 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.555+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~3H2CKC4TBAGO.0 size=713056 2024-03-04T12:26:44.561 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.555+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=3H2CKC4TBAGO tag=RGYLCKQ60I8E type=write size=1761632 2024-03-04T12:26:44.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.557+0000 7fa4b3c3e780 1 < suggested remove operation key=YIS2SV4O5EZN tag=9LXZ5YO1ANPR type=del 2024-03-04T12:26:44.565 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.558+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=CJK0KVW9SKNA type=write size=1007694 2024-03-04T12:26:44.565 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.558+0000 7fa4b3c3e780 1 < canceled part key=_multipart_G70BJ2UARNCP.2~TOXWSHHM9MTM.0 size=1048576 2024-03-04T12:26:44.566 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.559+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~TOXWSHHM9MTM.1 size=1048576 2024-03-04T12:26:44.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.560+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~TOXWSHHM9MTM.2 size=543059 2024-03-04T12:26:44.568 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.562+0000 7fa4b3c3e780 1 < canceled multipart upload key=G70BJ2UARNCP upload=TOXWSHHM9MTM tag=NQIC4MPLOJNS type=write size=3688787 2024-03-04T12:26:44.570 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.563+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=MZSJJ3MOKDQG type=del size=2904400 2024-03-04T12:26:44.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.564+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~P7T23TA7OG9T.0 size=209362 2024-03-04T12:26:44.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.566+0000 7fa4b3c3e780 1 < completed multipart upload key=V7N7MZ1GUNEV upload=P7T23TA7OG9T tag=REAI2USKDN4W type=write size=1257938 2024-03-04T12:26:44.574 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.567+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=3BB9BHC5BWQT type=del size=3359967 2024-03-04T12:26:44.575 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.568+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=X7B1V9BHLDJL type=del 2024-03-04T12:26:44.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.569+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=IB743PLO5ET9 type=del size=933588 2024-03-04T12:26:44.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.570+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~FY5RC0X9CRGO.0 size=1048576 2024-03-04T12:26:44.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.570+0000 7fa4b3c3e780 1 < canceled part key=_multipart_6XK4DQ940Z5J.2~FY5RC0X9CRGO.1 size=552055 2024-03-04T12:26:44.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.572+0000 7fa4b3c3e780 1 < canceled multipart upload key=6XK4DQ940Z5J upload=FY5RC0X9CRGO tag=PBZ8Q8F0TZE8 type=write size=2649207 2024-03-04T12:26:44.581 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.574+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~SO7CRZIDEUO7.0 size=1048576 2024-03-04T12:26:44.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.575+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~SO7CRZIDEUO7.1 size=459389 2024-03-04T12:26:44.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.575+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=SO7CRZIDEUO7 tag=EZ9XB94XND4J type=write size=2556541 2024-03-04T12:26:44.583 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.576+0000 7fa4b3c3e780 1 < completed write operation key=WRHB3XWDLSY2 tag=DRSL7WSGWVCA type=write size=682921 2024-03-04T12:26:44.584 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.578+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=JJ5L3AAL614C type=write size=514102 2024-03-04T12:26:44.585 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.579+0000 7fa4b3c3e780 1 < canceled operation key=WRHB3XWDLSY2 tag=S0724SBFYPSS type=del size=2295452 2024-03-04T12:26:44.587 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.580+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=URJADD1FTSS2 type=del size=789230 2024-03-04T12:26:44.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.581+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~6V6NI0VF14IR.0 size=1048576 2024-03-04T12:26:44.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.582+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~6V6NI0VF14IR.1 size=1048576 2024-03-04T12:26:44.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.583+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~6V6NI0VF14IR.2 size=491205 2024-03-04T12:26:44.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.585+0000 7fa4b3c3e780 1 < completed multipart upload key=G4SUQFVB936T upload=6V6NI0VF14IR tag=0RE7XXN5VDWP type=write size=3636933 2024-03-04T12:26:44.594 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.587+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~7L8IO6G29TP1.0 size=1048576 2024-03-04T12:26:44.595 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.588+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~7L8IO6G29TP1.1 size=1048576 2024-03-04T12:26:44.595 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.589+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~7L8IO6G29TP1.2 size=725927 2024-03-04T12:26:44.595 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.589+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=7L8IO6G29TP1 tag=LJJTW8XJ4YX0 type=write size=3871655 2024-03-04T12:26:44.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.590+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=ZP4CX7KX3O7J type=del 2024-03-04T12:26:44.598 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.591+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=Y90SVEY39OI2 type=del size=1672853 2024-03-04T12:26:44.600 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.593+0000 7fa4b3c3e780 1 < suggested update operation key=X0RVLNRWUAEM tag=2IXWPKYW50TD type=del size=2082012 2024-03-04T12:26:44.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.594+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=SD4GN2GAWN2O type=del size=3449129 2024-03-04T12:26:44.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.594+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YIS2SV4O5EZN.2~G35WNTIF17LJ.0 size=1048576 2024-03-04T12:26:44.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.595+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~G35WNTIF17LJ.1 size=1048576 2024-03-04T12:26:44.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.596+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~G35WNTIF17LJ.2 size=666314 2024-03-04T12:26:44.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.598+0000 7fa4b3c3e780 1 < canceled multipart upload key=YIS2SV4O5EZN upload=G35WNTIF17LJ tag=RF1MOCO5WXTH type=write size=3812042 2024-03-04T12:26:44.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.599+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=PHR014ST8IN2 type=del size=3475587 2024-03-04T12:26:44.607 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.600+0000 7fa4b3c3e780 1 < completed write operation key=NVMIU38VM9Q1 tag=UCZBSLFLUF1K type=write size=265879 2024-03-04T12:26:44.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.602+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~BUZVX2EHJGQI.0 size=1048576 2024-03-04T12:26:44.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.603+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~BUZVX2EHJGQI.1 size=842662 2024-03-04T12:26:44.610 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.603+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=BUZVX2EHJGQI tag=3MOEJA6YY4RU type=write size=2939814 2024-03-04T12:26:44.612 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.605+0000 7fa4b3c3e780 1 < suggested update operation key=G4SUQFVB936T tag=9HMUPI6ESGBG type=del size=2739896 2024-03-04T12:26:44.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.607+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~8C8Z0TCFXLL0.0 size=948000 2024-03-04T12:26:44.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.607+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=8C8Z0TCFXLL0 tag=Y8UG8TAZP5H8 type=write size=1996576 2024-03-04T12:26:44.615 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.608+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~BOE01L2DKNOE.0 size=391521 2024-03-04T12:26:44.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.610+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=BOE01L2DKNOE tag=N940DAAXAGPY type=write size=1440097 2024-03-04T12:26:44.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.611+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=FKN4PNHZIWHO type=write size=808302 2024-03-04T12:26:44.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.612+0000 7fa4b3c3e780 1 < completed write operation key=R6Y09EO6HGF0 tag=S42OEII1S3TX type=write size=736455 2024-03-04T12:26:44.620 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.613+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=I3AAGKJOE6FL type=del size=1360236 2024-03-04T12:26:44.621 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.614+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~3H2CKC4TBAGO.0 size=713056 2024-03-04T12:26:44.623 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.616+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=3H2CKC4TBAGO tag=RGYLCKQ60I8E type=write size=1761632 2024-03-04T12:26:44.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.618+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~Z96PVLQIAG64.0 size=687509 2024-03-04T12:26:44.625 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.618+0000 7fa4b3c3e780 1 > prepared multipart upload key=NVMIU38VM9Q1 upload=Z96PVLQIAG64 tag=5L458GX6POTH type=write size=1736085 2024-03-04T12:26:44.626 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.619+0000 7fa4b3c3e780 1 < canceled operation key=7IUV88NQLPN8 tag=CJK0KVW9SKNA type=write size=1007694 2024-03-04T12:26:44.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.620+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=GEY7UB252N8L type=del size=698806 2024-03-04T12:26:44.628 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.621+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=MZSJJ3MOKDQG type=del 2024-03-04T12:26:44.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.622+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=R9BQPKK9FZXR type=write size=54790 2024-03-04T12:26:44.631 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.624+0000 7fa4b3c3e780 1 < suggested update operation key=R1DOKJPZRT5Q tag=3BB9BHC5BWQT type=del size=3359967 2024-03-04T12:26:44.632 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.625+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=NQ3HJYULQBDD type=del size=3353965 2024-03-04T12:26:44.633 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.626+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=IB743PLO5ET9 type=del 2024-03-04T12:26:44.634 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.627+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=194RJ102X1LC type=del size=1657710 2024-03-04T12:26:44.635 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.628+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~SO7CRZIDEUO7.0 size=1048576 2024-03-04T12:26:44.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.629+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~SO7CRZIDEUO7.1 size=459389 2024-03-04T12:26:44.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.631+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=SO7CRZIDEUO7 tag=EZ9XB94XND4J type=write size=2556541 2024-03-04T12:26:44.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.632+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=RQ6UIMZTA4XC type=del size=4002722 2024-03-04T12:26:44.640 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.633+0000 7fa4b3c3e780 1 < completed write operation key=V7N7MZ1GUNEV tag=JJ5L3AAL614C type=write size=514102 2024-03-04T12:26:44.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.634+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=G3K1UOXXCNLW type=del size=3562518 2024-03-04T12:26:44.642 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.635+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=URJADD1FTSS2 type=del 2024-03-04T12:26:44.644 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.637+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~LYVLMF0XR7VM.0 size=1048576 2024-03-04T12:26:44.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.638+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~LYVLMF0XR7VM.1 size=178268 2024-03-04T12:26:44.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.638+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=LYVLMF0XR7VM tag=COMUQDUL8UF6 type=write size=2275420 2024-03-04T12:26:44.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.638+0000 7fa4b3c3e780 1 < canceled part key=_multipart_ZETES4AYZQHY.2~7L8IO6G29TP1.0 size=1048576 2024-03-04T12:26:44.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.638+0000 7fa4b3c3e780 1 < canceled part key=_multipart_ZETES4AYZQHY.2~7L8IO6G29TP1.1 size=1048576 2024-03-04T12:26:44.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.639+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~7L8IO6G29TP1.2 size=725927 2024-03-04T12:26:44.648 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.641+0000 7fa4b3c3e780 1 < canceled multipart upload key=ZETES4AYZQHY upload=7L8IO6G29TP1 tag=LJJTW8XJ4YX0 type=write size=3871655 2024-03-04T12:26:44.649 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.642+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=N7CAMAQ42Y5H type=del size=801136 2024-03-04T12:26:44.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.643+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=Y90SVEY39OI2 type=del 2024-03-04T12:26:44.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.644+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=N5331Y4CBR68 type=del size=1862259 2024-03-04T12:26:44.652 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.645+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=SD4GN2GAWN2O type=del 2024-03-04T12:26:44.653 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.646+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=MN7AQ94HTCXC type=del size=3703106 2024-03-04T12:26:44.654 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.648+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=PHR014ST8IN2 type=del 2024-03-04T12:26:44.656 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.649+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~7KJR4959FAUT.0 size=1048576 2024-03-04T12:26:44.657 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.650+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~7KJR4959FAUT.1 size=428534 2024-03-04T12:26:44.657 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.650+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=7KJR4959FAUT tag=L2KGK925FSI2 type=write size=2525686 2024-03-04T12:26:44.658 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.651+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~BUZVX2EHJGQI.0 size=1048576 2024-03-04T12:26:44.659 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.652+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~BUZVX2EHJGQI.1 size=842662 2024-03-04T12:26:44.661 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.654+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=BUZVX2EHJGQI tag=3MOEJA6YY4RU type=write size=2939814 2024-03-04T12:26:44.662 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.655+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=JFZEJYAIC5IJ type=del size=1953342 2024-03-04T12:26:44.663 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.656+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~8C8Z0TCFXLL0.0 size=948000 2024-03-04T12:26:44.668 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.658+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=8C8Z0TCFXLL0 tag=Y8UG8TAZP5H8 type=write size=1996576 2024-03-04T12:26:44.668 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.659+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=6XH44FNXQSV2 type=write size=452474 2024-03-04T12:26:44.668 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.660+0000 7fa4b3c3e780 1 < completed write operation key=DHLTVH2AZBLR tag=FKN4PNHZIWHO type=write size=808302 2024-03-04T12:26:44.668 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.661+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=SX2RUFGXBPPD type=del size=414985 2024-03-04T12:26:44.669 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.662+0000 7fa4b3c3e780 1 < completed delete operation key=R6Y09EO6HGF0 tag=I3AAGKJOE6FL type=del 2024-03-04T12:26:44.671 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.664+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~7RGHUQSYII1V.0 size=1048576 2024-03-04T12:26:44.672 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.665+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~7RGHUQSYII1V.1 size=2486 2024-03-04T12:26:44.672 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.665+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=7RGHUQSYII1V tag=NWFS4MVFY4PU type=write size=2099638 2024-03-04T12:26:44.672 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.666+0000 7fa4b3c3e780 1 < canceled part key=_multipart_NVMIU38VM9Q1.2~Z96PVLQIAG64.0 size=687509 2024-03-04T12:26:44.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.667+0000 7fa4b3c3e780 1 < canceled multipart upload key=NVMIU38VM9Q1 upload=Z96PVLQIAG64 tag=5L458GX6POTH type=write size=1736085 2024-03-04T12:26:44.675 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.668+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=VJTF4YP0BIA5 type=del size=3439015 2024-03-04T12:26:44.676 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.670+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=GEY7UB252N8L type=del 2024-03-04T12:26:44.677 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.671+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=M4I3AS7DM24P type=del size=611020 2024-03-04T12:26:44.679 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.672+0000 7fa4b3c3e780 1 < completed write operation key=R6Y09EO6HGF0 tag=R9BQPKK9FZXR type=write size=54790 2024-03-04T12:26:44.680 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.673+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=TR5Y73ME0V0U type=del size=1275504 2024-03-04T12:26:44.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.674+0000 7fa4b3c3e780 1 < canceled operation key=T301TK0FIOG4 tag=NQ3HJYULQBDD type=del size=3353965 2024-03-04T12:26:44.683 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.676+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~B4OTXGRWK40A.0 size=1048576 2024-03-04T12:26:44.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.677+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~B4OTXGRWK40A.1 size=116567 2024-03-04T12:26:44.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.677+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=B4OTXGRWK40A tag=X1GO5C15LJ1X type=write size=2213719 2024-03-04T12:26:44.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.679+0000 7fa4b3c3e780 1 < suggested remove operation key=UZRX3W3DE5VX tag=194RJ102X1LC type=del 2024-03-04T12:26:44.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.680+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=IF19F6C92RJG type=write size=428404 2024-03-04T12:26:44.688 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.681+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=RQ6UIMZTA4XC type=del 2024-03-04T12:26:44.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.683+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=BDYPZN2FU0P3 type=del size=1687138 2024-03-04T12:26:44.691 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.684+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=G3K1UOXXCNLW type=del 2024-03-04T12:26:44.693 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.687+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~1Z9M9HDUL15U.0 size=723307 2024-03-04T12:26:44.694 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.687+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=1Z9M9HDUL15U tag=1IYMSXQ3R679 type=write size=1771883 2024-03-04T12:26:44.695 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.688+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~LYVLMF0XR7VM.0 size=1048576 2024-03-04T12:26:44.695 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.688+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YQLH0WW7I7MW.2~LYVLMF0XR7VM.1 size=178268 2024-03-04T12:26:44.697 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.690+0000 7fa4b3c3e780 1 < canceled multipart upload key=YQLH0WW7I7MW upload=LYVLMF0XR7VM tag=COMUQDUL8UF6 type=write size=2275420 2024-03-04T12:26:44.699 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.692+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~XL9HHC3FUXVX.0 size=1048576 2024-03-04T12:26:44.700 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.693+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~XL9HHC3FUXVX.1 size=1048576 2024-03-04T12:26:44.700 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.694+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~XL9HHC3FUXVX.2 size=765753 2024-03-04T12:26:44.701 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.694+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=XL9HHC3FUXVX tag=Q576RXBDT8JI type=write size=3911481 2024-03-04T12:26:44.702 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.695+0000 7fa4b3c3e780 1 < canceled operation key=4LKTYP07OL5L tag=N7CAMAQ42Y5H type=del size=801136 2024-03-04T12:26:44.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.696+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=7QH9C8PVYOLM type=del size=3886672 2024-03-04T12:26:44.704 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.697+0000 7fa4b3c3e780 1 < completed delete operation key=GMIPCGYZRJ5L tag=N5331Y4CBR68 type=del 2024-03-04T12:26:44.706 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.699+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~UY5ON5UGFYIS.0 size=1048576 2024-03-04T12:26:44.707 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.700+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~UY5ON5UGFYIS.1 size=1048576 2024-03-04T12:26:44.708 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.702+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~UY5ON5UGFYIS.2 size=984899 2024-03-04T12:26:44.709 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.702+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=UY5ON5UGFYIS tag=3NMX8DT5FWMH type=write size=4130627 2024-03-04T12:26:44.710 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.703+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=MN7AQ94HTCXC type=del 2024-03-04T12:26:44.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.704+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=MV79FLGJ6SFM type=del size=232511 2024-03-04T12:26:44.712 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.705+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~7KJR4959FAUT.0 size=1048576 2024-03-04T12:26:44.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.706+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~7KJR4959FAUT.1 size=428534 2024-03-04T12:26:44.715 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.708+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=7KJR4959FAUT tag=L2KGK925FSI2 type=write size=2525686 2024-03-04T12:26:44.716 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.710+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~FC8HXFOCN2ZI.0 size=1048576 2024-03-04T12:26:44.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.711+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~FC8HXFOCN2ZI.1 size=1048576 2024-03-04T12:26:44.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.712+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~FC8HXFOCN2ZI.2 size=498959 2024-03-04T12:26:44.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.712+0000 7fa4b3c3e780 1 > prepared multipart upload key=G8G76PMSKJ0I upload=FC8HXFOCN2ZI tag=MIHN0JD9KPS0 type=write size=3644687 2024-03-04T12:26:44.719 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.712+0000 7fa4b3c3e780 -1 < no bi entry to suggest for operation key=UZRX3W3DE5VX tag=JFZEJYAIC5IJ type=del size=1953342: (2) No such file or directory 2024-03-04T12:26:44.721 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.714+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~P26MFWKJ3PMY.0 size=1048576 2024-03-04T12:26:44.722 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.715+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~P26MFWKJ3PMY.1 size=134725 2024-03-04T12:26:44.722 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.715+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=P26MFWKJ3PMY tag=V6CLRCFIB6BS type=write size=2231877 2024-03-04T12:26:44.723 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.716+0000 7fa4b3c3e780 1 < completed write operation key=43HMF7NWNMU3 tag=6XH44FNXQSV2 type=write size=452474 2024-03-04T12:26:44.725 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.718+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~YVMO6X0SSU0E.0 size=270639 2024-03-04T12:26:44.725 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.718+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=YVMO6X0SSU0E tag=ZE1VR3NTBJZP type=write size=1319215 2024-03-04T12:26:44.726 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.719+0000 7fa4b3c3e780 1 < completed delete operation key=R1DOKJPZRT5Q tag=SX2RUFGXBPPD type=del 2024-03-04T12:26:44.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.720+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=3II32I8YE3ZB type=del size=3324905 2024-03-04T12:26:44.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.722+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~7RGHUQSYII1V.0 size=1048576 2024-03-04T12:26:44.729 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.722+0000 7fa4b3c3e780 1 < canceled part key=_multipart_G70BJ2UARNCP.2~7RGHUQSYII1V.1 size=2486 2024-03-04T12:26:44.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.723+0000 7fa4b3c3e780 1 < canceled multipart upload key=G70BJ2UARNCP upload=7RGHUQSYII1V tag=NWFS4MVFY4PU type=write size=2099638 2024-03-04T12:26:44.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.726+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~ACBSHRVU9XPG.0 size=1048576 2024-03-04T12:26:44.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.726+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~ACBSHRVU9XPG.1 size=124851 2024-03-04T12:26:44.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.726+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=ACBSHRVU9XPG tag=QWCG7HAB3LEX type=write size=2222003 2024-03-04T12:26:44.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.727+0000 7fa4b3c3e780 1 < completed delete operation key=X0RVLNRWUAEM tag=VJTF4YP0BIA5 type=del 2024-03-04T12:26:44.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.729+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=80U7YT5S1LSG type=del size=2011823 2024-03-04T12:26:44.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.730+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=M4I3AS7DM24P type=del 2024-03-04T12:26:44.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.732+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~UE1Z6LXFBH98.0 size=1018236 2024-03-04T12:26:44.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.732+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=UE1Z6LXFBH98 tag=00RYYNT372FT type=write size=2066812 2024-03-04T12:26:44.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.733+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=TR5Y73ME0V0U type=del 2024-03-04T12:26:44.741 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.734+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=QELNIASWSPVJ type=write size=70789 2024-03-04T12:26:44.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.735+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~B4OTXGRWK40A.0 size=1048576 2024-03-04T12:26:44.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.735+0000 7fa4b3c3e780 1 < canceled part key=_multipart_G70BJ2UARNCP.2~B4OTXGRWK40A.1 size=116567 2024-03-04T12:26:44.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.737+0000 7fa4b3c3e780 1 < canceled multipart upload key=G70BJ2UARNCP upload=B4OTXGRWK40A tag=X1GO5C15LJ1X type=write size=2213719 2024-03-04T12:26:44.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.738+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=VUT2TVMH7KRR type=del size=753974 2024-03-04T12:26:44.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.739+0000 7fa4b3c3e780 1 < completed write operation key=T301TK0FIOG4 tag=IF19F6C92RJG type=write size=428404 2024-03-04T12:26:44.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.740+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=AMPXTROUVRVH type=del size=1208304 2024-03-04T12:26:44.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.742+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=BDYPZN2FU0P3 type=del 2024-03-04T12:26:44.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.743+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=AMDCO88KBSTM type=del size=2777494 2024-03-04T12:26:44.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.744+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~1Z9M9HDUL15U.0 size=723307 2024-03-04T12:26:44.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.746+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=1Z9M9HDUL15U tag=1IYMSXQ3R679 type=write size=1771883 2024-03-04T12:26:44.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.747+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=BRDZQD12BHKP type=del size=2508439 2024-03-04T12:26:44.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.748+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~XL9HHC3FUXVX.0 size=1048576 2024-03-04T12:26:44.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.749+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~XL9HHC3FUXVX.1 size=1048576 2024-03-04T12:26:44.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.750+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~XL9HHC3FUXVX.2 size=765753 2024-03-04T12:26:44.759 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.752+0000 7fa4b3c3e780 1 < completed multipart upload key=3N6E09QF3866 upload=XL9HHC3FUXVX tag=Q576RXBDT8JI type=write size=3911481 2024-03-04T12:26:44.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.754+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~IMWQQNKKAZV2.0 size=55447 2024-03-04T12:26:44.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.754+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=IMWQQNKKAZV2 tag=AVOWS6RI88TF type=write size=1104023 2024-03-04T12:26:44.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.757+0000 7fa4b3c3e780 1 < suggested remove operation key=YWJV4QMY6ZBI tag=7QH9C8PVYOLM type=del 2024-03-04T12:26:44.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.759+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~J5US11W20MDV.0 size=327062 2024-03-04T12:26:44.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.759+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=J5US11W20MDV tag=MUZCGIBQ1B07 type=write size=1375638 2024-03-04T12:26:44.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.760+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~UY5ON5UGFYIS.0 size=1048576 2024-03-04T12:26:44.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.761+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~UY5ON5UGFYIS.1 size=1048576 2024-03-04T12:26:44.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.761+0000 7fa4b3c3e780 1 < canceled part key=_multipart_V7N7MZ1GUNEV.2~UY5ON5UGFYIS.2 size=984899 2024-03-04T12:26:44.770 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.763+0000 7fa4b3c3e780 1 < canceled multipart upload key=V7N7MZ1GUNEV upload=UY5ON5UGFYIS tag=3NMX8DT5FWMH type=write size=4130627 2024-03-04T12:26:44.771 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.764+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=GOJCM2F84KDO type=del size=1521678 2024-03-04T12:26:44.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.765+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=MV79FLGJ6SFM type=del 2024-03-04T12:26:44.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.766+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=KWRPYS5BH8EC type=del size=2560310 2024-03-04T12:26:44.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.768+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~FC8HXFOCN2ZI.0 size=1048576 2024-03-04T12:26:44.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.769+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~FC8HXFOCN2ZI.1 size=1048576 2024-03-04T12:26:44.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.770+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~FC8HXFOCN2ZI.2 size=498959 2024-03-04T12:26:44.778 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.772+0000 7fa4b3c3e780 1 < completed multipart upload key=G8G76PMSKJ0I upload=FC8HXFOCN2ZI tag=MIHN0JD9KPS0 type=write size=3644687 2024-03-04T12:26:44.781 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.774+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~0R901JTX8D1O.0 size=1048576 2024-03-04T12:26:44.781 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.775+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~0R901JTX8D1O.1 size=388878 2024-03-04T12:26:44.781 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.775+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=0R901JTX8D1O tag=V6YN4TGVJD3F type=write size=2486030 2024-03-04T12:26:44.783 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.776+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~P26MFWKJ3PMY.0 size=1048576 2024-03-04T12:26:44.783 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.777+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~P26MFWKJ3PMY.1 size=134725 2024-03-04T12:26:44.785 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.778+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=P26MFWKJ3PMY tag=V6CLRCFIB6BS type=write size=2231877 2024-03-04T12:26:44.787 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.780+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~2GQY5PTD8BU4.0 size=106995 2024-03-04T12:26:44.788 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.780+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=2GQY5PTD8BU4 tag=7XZLGRPGRT0F type=write size=1155571 2024-03-04T12:26:44.788 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.782+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~YVMO6X0SSU0E.0 size=270639 2024-03-04T12:26:44.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.784+0000 7fa4b3c3e780 1 < completed multipart upload key=4989OME3IAJF upload=YVMO6X0SSU0E tag=ZE1VR3NTBJZP type=write size=1319215 2024-03-04T12:26:44.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.786+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~7AHD0WIUR2NE.0 size=1048576 2024-03-04T12:26:44.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.786+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~7AHD0WIUR2NE.1 size=1048576 2024-03-04T12:26:44.794 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.787+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~7AHD0WIUR2NE.2 size=401011 2024-03-04T12:26:44.794 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.787+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=7AHD0WIUR2NE tag=NCBGZRGLN7BY type=write size=3546739 2024-03-04T12:26:44.795 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.788+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=3II32I8YE3ZB type=del 2024-03-04T12:26:44.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.790+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=C69ENVU1TIDH type=del size=2597350 2024-03-04T12:26:44.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.791+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~ACBSHRVU9XPG.0 size=1048576 2024-03-04T12:26:44.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.792+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~ACBSHRVU9XPG.1 size=124851 2024-03-04T12:26:44.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.794+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=ACBSHRVU9XPG tag=QWCG7HAB3LEX type=write size=2222003 2024-03-04T12:26:44.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.795+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=HK4WZ6DVHZEO type=del size=3273578 2024-03-04T12:26:44.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.796+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=80U7YT5S1LSG type=del 2024-03-04T12:26:44.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.798+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~THPKXS2F74YV.0 size=394005 2024-03-04T12:26:44.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.798+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=THPKXS2F74YV tag=0T2WT0PY209G type=write size=1442581 2024-03-04T12:26:44.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.800+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~UE1Z6LXFBH98.0 size=1018236 2024-03-04T12:26:44.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.801+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=UE1Z6LXFBH98 tag=00RYYNT372FT type=write size=2066812 2024-03-04T12:26:44.809 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.803+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=XMT540XAND9O type=write size=773785 2024-03-04T12:26:44.810 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.804+0000 7fa4b3c3e780 1 < completed write operation key=43HMF7NWNMU3 tag=QELNIASWSPVJ type=write size=70789 2024-03-04T12:26:44.812 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.805+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=VIY0JJO1M235 type=write size=136858 2024-03-04T12:26:44.813 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.806+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=VUT2TVMH7KRR type=del 2024-03-04T12:26:44.814 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.807+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=RFEJAJIMWLD9 type=del size=1877053 2024-03-04T12:26:44.815 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.808+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=AMPXTROUVRVH type=del 2024-03-04T12:26:44.816 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.809+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=IL7MBWDSOEGT type=del size=905665 2024-03-04T12:26:44.817 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.810+0000 7fa4b3c3e780 1 < canceled operation key=43HMF7NWNMU3 tag=AMDCO88KBSTM type=del size=2777494 2024-03-04T12:26:44.818 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.811+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=PEO75Y37FKCN type=del size=3594545 2024-03-04T12:26:44.819 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.812+0000 7fa4b3c3e780 1 < completed delete operation key=G8G76PMSKJ0I tag=BRDZQD12BHKP type=del 2024-03-04T12:26:44.821 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.814+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~TKNECLRL2SEG.0 size=1048576 2024-03-04T12:26:44.822 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.815+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~TKNECLRL2SEG.1 size=1048576 2024-03-04T12:26:44.823 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.816+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~TKNECLRL2SEG.2 size=322707 2024-03-04T12:26:44.823 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.816+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=TKNECLRL2SEG tag=LF187HB4W5LA type=write size=3468435 2024-03-04T12:26:44.824 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.817+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~IMWQQNKKAZV2.0 size=55447 2024-03-04T12:26:44.826 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.819+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=IMWQQNKKAZV2 tag=AVOWS6RI88TF type=write size=1104023 2024-03-04T12:26:44.828 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.821+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~CHWTB0KWIXDL.0 size=1048576 2024-03-04T12:26:44.828 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.822+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~CHWTB0KWIXDL.1 size=1048576 2024-03-04T12:26:44.829 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.822+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~CHWTB0KWIXDL.2 size=745828 2024-03-04T12:26:44.829 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.822+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=CHWTB0KWIXDL tag=B5KM1P3DN8PG type=write size=3891556 2024-03-04T12:26:44.830 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.824+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~J5US11W20MDV.0 size=327062 2024-03-04T12:26:44.832 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.825+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=J5US11W20MDV tag=MUZCGIBQ1B07 type=write size=1375638 2024-03-04T12:26:44.834 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.827+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~QALCON0BQZ4M.0 size=1048576 2024-03-04T12:26:44.835 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.828+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~QALCON0BQZ4M.1 size=482358 2024-03-04T12:26:44.835 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.828+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=QALCON0BQZ4M tag=CTPZIXZ39WLI type=write size=2579510 2024-03-04T12:26:44.837 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.830+0000 7fa4b3c3e780 1 < suggested update operation key=4LKTYP07OL5L tag=GOJCM2F84KDO type=del size=1521678 2024-03-04T12:26:44.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.831+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=F73XC14YU61T type=del size=3663942 2024-03-04T12:26:44.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.834+0000 7fa4b3c3e780 1 < suggested update operation key=7IUV88NQLPN8 tag=KWRPYS5BH8EC type=del size=2560310 2024-03-04T12:26:44.842 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.836+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~UTSEOY8U2E8R.0 size=1048576 2024-03-04T12:26:44.843 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.836+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~UTSEOY8U2E8R.1 size=620748 2024-03-04T12:26:44.843 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.836+0000 7fa4b3c3e780 1 > prepared multipart upload key=NVMIU38VM9Q1 upload=UTSEOY8U2E8R tag=AU9EHLK5EWX1 type=write size=2717900 2024-03-04T12:26:44.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.838+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~0R901JTX8D1O.0 size=1048576 2024-03-04T12:26:44.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.839+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~0R901JTX8D1O.1 size=388878 2024-03-04T12:26:44.847 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.840+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=0R901JTX8D1O tag=V6YN4TGVJD3F type=write size=2486030 2024-03-04T12:26:44.849 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.843+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~QCBQIRA4D1XY.0 size=35666 2024-03-04T12:26:44.850 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.843+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=QCBQIRA4D1XY tag=UMLCB7HEP1F5 type=write size=1084242 2024-03-04T12:26:44.851 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.844+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~2GQY5PTD8BU4.0 size=106995 2024-03-04T12:26:44.853 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.846+0000 7fa4b3c3e780 1 < completed multipart upload key=G70BJ2UARNCP upload=2GQY5PTD8BU4 tag=7XZLGRPGRT0F type=write size=1155571 2024-03-04T12:26:44.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.847+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=PF7FQ8LG15BL type=del size=2421354 2024-03-04T12:26:44.855 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.848+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~7AHD0WIUR2NE.0 size=1048576 2024-03-04T12:26:44.856 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.849+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~7AHD0WIUR2NE.1 size=1048576 2024-03-04T12:26:44.857 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.850+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~7AHD0WIUR2NE.2 size=401011 2024-03-04T12:26:44.859 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.852+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=7AHD0WIUR2NE tag=NCBGZRGLN7BY type=write size=3546739 2024-03-04T12:26:44.861 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.854+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~9QP0OK59WH7F.0 size=1048576 2024-03-04T12:26:44.861 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.855+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~9QP0OK59WH7F.1 size=1048576 2024-03-04T12:26:44.862 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.856+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~9QP0OK59WH7F.2 size=672646 2024-03-04T12:26:44.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.856+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=9QP0OK59WH7F tag=RW3TVAY5MTLZ type=write size=3818374 2024-03-04T12:26:44.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.857+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=C69ENVU1TIDH type=del 2024-03-04T12:26:44.865 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.858+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=1FVLA63YNASM type=del size=1018592 2024-03-04T12:26:44.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.859+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=HK4WZ6DVHZEO type=del 2024-03-04T12:26:44.868 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.861+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~52AP13DWW92U.0 size=868072 2024-03-04T12:26:44.868 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.861+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=52AP13DWW92U tag=6EJRF85D4GJ1 type=write size=1916648 2024-03-04T12:26:44.871 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.863+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~THPKXS2F74YV.0 size=394005 2024-03-04T12:26:44.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.864+0000 7fa4b3c3e780 1 < completed multipart upload key=V7N7MZ1GUNEV upload=THPKXS2F74YV tag=0T2WT0PY209G type=write size=1442581 2024-03-04T12:26:44.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.865+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=RVIAHJG3C4GQ type=del size=2802716 2024-03-04T12:26:44.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.867+0000 7fa4b3c3e780 -1 < failed to complete operation key=7IUV88NQLPN8 tag=XMT540XAND9O type=write size=773785: (22) Invalid argument 2024-03-04T12:26:44.874 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.868+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=Q443R8XG8QLI type=del size=453171 2024-03-04T12:26:44.876 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.869+0000 7fa4b3c3e780 1 < completed write operation key=NVMIU38VM9Q1 tag=VIY0JJO1M235 type=write size=136858 2024-03-04T12:26:44.877 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.870+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=5UJZPZSSSW1E type=del size=1568279 2024-03-04T12:26:44.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.871+0000 7fa4b3c3e780 -1 < failed to complete operation key=4LKTYP07OL5L tag=RFEJAJIMWLD9 type=del size=1877053: (22) Invalid argument 2024-03-04T12:26:44.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.872+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=T8IF31L84MLQ type=del size=212366 2024-03-04T12:26:44.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.873+0000 7fa4b3c3e780 1 < completed delete operation key=R1DOKJPZRT5Q tag=IL7MBWDSOEGT type=del 2024-03-04T12:26:44.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.874+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=I6AHCJ5NB14G type=del size=3113347 2024-03-04T12:26:44.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.877+0000 7fa4b3c3e780 1 < suggested update operation key=ESHAMQWMMBJR tag=PEO75Y37FKCN type=del size=3594545 2024-03-04T12:26:44.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.879+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~ZDEQ04XWLK83.0 size=87545 2024-03-04T12:26:44.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.879+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=ZDEQ04XWLK83 tag=08QM83ER0SI5 type=write size=1136121 2024-03-04T12:26:44.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.880+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~TKNECLRL2SEG.0 size=1048576 2024-03-04T12:26:44.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.881+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~TKNECLRL2SEG.1 size=1048576 2024-03-04T12:26:44.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.882+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~TKNECLRL2SEG.2 size=322707 2024-03-04T12:26:44.891 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.884+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=TKNECLRL2SEG tag=LF187HB4W5LA type=write size=3468435 2024-03-04T12:26:44.893 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.886+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~AT4HJBM12T4D.0 size=486871 2024-03-04T12:26:44.893 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.886+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=AT4HJBM12T4D tag=24KPESV2QAGJ type=write size=1535447 2024-03-04T12:26:44.894 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.887+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~CHWTB0KWIXDL.0 size=1048576 2024-03-04T12:26:44.894 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.887+0000 7fa4b3c3e780 1 < canceled part key=_multipart_GMIPCGYZRJ5L.2~CHWTB0KWIXDL.1 size=1048576 2024-03-04T12:26:44.895 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.888+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~CHWTB0KWIXDL.2 size=745828 2024-03-04T12:26:44.897 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.890+0000 7fa4b3c3e780 1 < canceled multipart upload key=GMIPCGYZRJ5L upload=CHWTB0KWIXDL tag=B5KM1P3DN8PG type=write size=3891556 2024-03-04T12:26:44.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.892+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=WLLSMO93CYT6 type=write size=610882 2024-03-04T12:26:44.899 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.892+0000 7fa4b3c3e780 1 < canceled part key=_multipart_43HMF7NWNMU3.2~QALCON0BQZ4M.0 size=1048576 2024-03-04T12:26:44.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.893+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~QALCON0BQZ4M.1 size=482358 2024-03-04T12:26:44.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.895+0000 7fa4b3c3e780 1 < canceled multipart upload key=43HMF7NWNMU3 upload=QALCON0BQZ4M tag=CTPZIXZ39WLI type=write size=2579510 2024-03-04T12:26:44.905 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.898+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~F46GMVHQOKSU.0 size=4424 2024-03-04T12:26:44.905 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.898+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=F46GMVHQOKSU tag=HZEOA7LS852Q type=write size=1053000 2024-03-04T12:26:44.907 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.900+0000 7fa4b3c3e780 1 < suggested remove operation key=BVMWQ9ZL4K0C tag=F73XC14YU61T type=del 2024-03-04T12:26:44.909 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.902+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=FAK01FAKFT9T type=del size=261455 2024-03-04T12:26:44.910 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.903+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~UTSEOY8U2E8R.0 size=1048576 2024-03-04T12:26:44.911 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.904+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~UTSEOY8U2E8R.1 size=620748 2024-03-04T12:26:44.913 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.906+0000 7fa4b3c3e780 1 < completed multipart upload key=NVMIU38VM9Q1 upload=UTSEOY8U2E8R tag=AU9EHLK5EWX1 type=write size=2717900 2024-03-04T12:26:44.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.907+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=84ZH90YN83M3 type=del size=68012 2024-03-04T12:26:44.915 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.908+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~QCBQIRA4D1XY.0 size=35666 2024-03-04T12:26:44.917 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.910+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=QCBQIRA4D1XY tag=UMLCB7HEP1F5 type=write size=1084242 2024-03-04T12:26:44.919 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.912+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~AIH9WGVJWR2O.0 size=25986 2024-03-04T12:26:44.919 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.912+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=AIH9WGVJWR2O tag=UA3XRADJFFBS type=write size=1074562 2024-03-04T12:26:44.920 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.913+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=PF7FQ8LG15BL type=del 2024-03-04T12:26:44.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.914+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=QX9ZL9UQYJA6 type=del size=1194249 2024-03-04T12:26:44.923 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.916+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~9QP0OK59WH7F.0 size=1048576 2024-03-04T12:26:44.923 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.916+0000 7fa4b3c3e780 1 < canceled part key=_multipart_43HMF7NWNMU3.2~9QP0OK59WH7F.1 size=1048576 2024-03-04T12:26:44.924 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.917+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~9QP0OK59WH7F.2 size=672646 2024-03-04T12:26:44.932 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.925+0000 7fa4b3c3e780 1 < canceled multipart upload key=43HMF7NWNMU3 upload=9QP0OK59WH7F tag=RW3TVAY5MTLZ type=write size=3818374 2024-03-04T12:26:44.933 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.926+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=WGRZHV24Z5SG type=del size=913797 2024-03-04T12:26:44.934 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.928+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=1FVLA63YNASM type=del 2024-03-04T12:26:44.936 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.929+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=Z0JK44AFGX4V type=del size=1879332 2024-03-04T12:26:44.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.930+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~52AP13DWW92U.0 size=868072 2024-03-04T12:26:44.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.932+0000 7fa4b3c3e780 1 < completed multipart upload key=BVMWQ9ZL4K0C upload=52AP13DWW92U tag=6EJRF85D4GJ1 type=write size=1916648 2024-03-04T12:26:44.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.934+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~9HR6XVU2U552.0 size=662868 2024-03-04T12:26:44.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.934+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=9HR6XVU2U552 tag=TPW2ZNY9U92E type=write size=1711444 2024-03-04T12:26:44.942 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.935+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=RVIAHJG3C4GQ type=del 2024-03-04T12:26:44.944 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.937+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~SB6V3WPLPCAV.0 size=1048576 2024-03-04T12:26:44.945 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.938+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~SB6V3WPLPCAV.1 size=556351 2024-03-04T12:26:44.945 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.938+0000 7fa4b3c3e780 1 > prepared multipart upload key=G8G76PMSKJ0I upload=SB6V3WPLPCAV tag=BBMEV5T41LCY type=write size=2653503 2024-03-04T12:26:44.946 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.939+0000 7fa4b3c3e780 1 < canceled operation key=H5FWRNK8F7QT tag=Q443R8XG8QLI type=del size=453171 2024-03-04T12:26:44.947 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.940+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=731JQVMQU4QA type=del size=66132 2024-03-04T12:26:44.948 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.941+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=5UJZPZSSSW1E type=del 2024-03-04T12:26:44.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.943+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~9087CLVOE4CT.0 size=1048576 2024-03-04T12:26:44.951 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.944+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~9087CLVOE4CT.1 size=394787 2024-03-04T12:26:44.951 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.944+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=9087CLVOE4CT tag=Y3VWUZ32HPIA type=write size=2491939 2024-03-04T12:26:44.952 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.946+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=T8IF31L84MLQ type=del 2024-03-04T12:26:44.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.947+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=LEAB9AMHP5XR type=del size=2868478 2024-03-04T12:26:44.955 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.948+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=I6AHCJ5NB14G type=del 2024-03-04T12:26:44.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.950+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~UL3HM85XGKAB.0 size=1048576 2024-03-04T12:26:44.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.951+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~UL3HM85XGKAB.1 size=554578 2024-03-04T12:26:44.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.951+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=UL3HM85XGKAB tag=15CS5GX4KTQK type=write size=2651730 2024-03-04T12:26:44.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.952+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~ZDEQ04XWLK83.0 size=87545 2024-03-04T12:26:44.960 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.954+0000 7fa4b3c3e780 1 < completed multipart upload key=V7N7MZ1GUNEV upload=ZDEQ04XWLK83 tag=08QM83ER0SI5 type=write size=1136121 2024-03-04T12:26:44.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.956+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~V9HH22SRZHMJ.0 size=1048576 2024-03-04T12:26:44.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.957+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~V9HH22SRZHMJ.1 size=1040913 2024-03-04T12:26:44.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.957+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=V9HH22SRZHMJ tag=XFVS8WFEEJBH type=write size=3138065 2024-03-04T12:26:44.965 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.958+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~AT4HJBM12T4D.0 size=486871 2024-03-04T12:26:44.967 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.960+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=AT4HJBM12T4D tag=24KPESV2QAGJ type=write size=1535447 2024-03-04T12:26:44.968 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.961+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=GNQSJQZJKS08 type=del size=1536639 2024-03-04T12:26:44.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.962+0000 7fa4b3c3e780 1 < completed write operation key=YWJV4QMY6ZBI tag=WLLSMO93CYT6 type=write size=610882 2024-03-04T12:26:44.971 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.964+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~HW678U4A6E9O.0 size=291332 2024-03-04T12:26:44.971 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.964+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=HW678U4A6E9O tag=6CFHIL7R4GQ6 type=write size=1339908 2024-03-04T12:26:44.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.965+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~F46GMVHQOKSU.0 size=4424 2024-03-04T12:26:44.974 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.967+0000 7fa4b3c3e780 1 < completed multipart upload key=G70BJ2UARNCP upload=F46GMVHQOKSU tag=HZEOA7LS852Q type=write size=1053000 2024-03-04T12:26:44.975 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.968+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=IP0UP6M666R3 type=del size=351537 2024-03-04T12:26:44.976 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.969+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=FAK01FAKFT9T type=del 2024-03-04T12:26:44.978 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.971+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=ZJW4S6ZWMHV2 type=del size=1725218 2024-03-04T12:26:44.979 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.972+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=84ZH90YN83M3 type=del 2024-03-04T12:26:44.980 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.973+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=R9YTQ6LV9E5X type=write size=1008107 2024-03-04T12:26:44.981 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.974+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~AIH9WGVJWR2O.0 size=25986 2024-03-04T12:26:44.983 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.976+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=AIH9WGVJWR2O tag=UA3XRADJFFBS type=write size=1074562 2024-03-04T12:26:44.984 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.977+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=8DYMN2SSCF19 type=del size=3147009 2024-03-04T12:26:44.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.978+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=QX9ZL9UQYJA6 type=del 2024-03-04T12:26:44.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.980+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=VU46O7EMSAMZ type=del size=486922 2024-03-04T12:26:44.988 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.981+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=WGRZHV24Z5SG type=del 2024-03-04T12:26:44.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.982+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=RJF838R7FFR0 type=write size=864019 2024-03-04T12:26:44.990 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.983+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=Z0JK44AFGX4V type=del 2024-03-04T12:26:44.991 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.984+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=6IJM0FZ7J3YC type=del size=3471724 2024-03-04T12:26:44.992 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.985+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~9HR6XVU2U552.0 size=662868 2024-03-04T12:26:44.994 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.987+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=9HR6XVU2U552 tag=TPW2ZNY9U92E type=write size=1711444 2024-03-04T12:26:44.996 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.989+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~AI132QQRFFQV.0 size=184867 2024-03-04T12:26:44.996 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.989+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=AI132QQRFFQV tag=417W5RPW3POZ type=write size=1233443 2024-03-04T12:26:44.997 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.991+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~SB6V3WPLPCAV.0 size=1048576 2024-03-04T12:26:44.998 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.992+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~SB6V3WPLPCAV.1 size=556351 2024-03-04T12:26:45.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.994+0000 7fa4b3c3e780 1 < completed multipart upload key=G8G76PMSKJ0I upload=SB6V3WPLPCAV tag=BBMEV5T41LCY type=write size=2653503 2024-03-04T12:26:45.002 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.995+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=5P9TEP7WVLL6 type=del size=3903092 2024-03-04T12:26:45.003 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.996+0000 7fa4b3c3e780 1 < completed delete operation key=R6Y09EO6HGF0 tag=731JQVMQU4QA type=del 2024-03-04T12:26:45.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.998+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~X6YQB1CWUCTO.0 size=492823 2024-03-04T12:26:45.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.998+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=X6YQB1CWUCTO tag=AW0R644ILMT3 type=write size=1541399 2024-03-04T12:26:45.006 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:44.999+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~9087CLVOE4CT.0 size=1048576 2024-03-04T12:26:45.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.000+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~9087CLVOE4CT.1 size=394787 2024-03-04T12:26:45.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.002+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=9087CLVOE4CT tag=Y3VWUZ32HPIA type=write size=2491939 2024-03-04T12:26:45.011 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.004+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~2PR8E9Q3KH11.0 size=788880 2024-03-04T12:26:45.011 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.004+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=2PR8E9Q3KH11 tag=EANO0BZT0OJ5 type=write size=1837456 2024-03-04T12:26:45.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.005+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=LEAB9AMHP5XR type=del 2024-03-04T12:26:45.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.006+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=P8AI1EE4YF6I type=del size=2220602 2024-03-04T12:26:45.014 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.007+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~UL3HM85XGKAB.0 size=1048576 2024-03-04T12:26:45.016 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.009+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~UL3HM85XGKAB.1 size=554578 2024-03-04T12:26:45.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.012+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=UL3HM85XGKAB tag=15CS5GX4KTQK type=write size=2651730 2024-03-04T12:26:45.020 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.013+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=0LDYQW7YJVHG type=del size=1631501 2024-03-04T12:26:45.021 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.014+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~V9HH22SRZHMJ.0 size=1048576 2024-03-04T12:26:45.022 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.015+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~V9HH22SRZHMJ.1 size=1040913 2024-03-04T12:26:45.024 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.017+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=V9HH22SRZHMJ tag=XFVS8WFEEJBH type=write size=3138065 2024-03-04T12:26:45.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.018+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=V2G08Y18NCLB type=write size=467441 2024-03-04T12:26:45.026 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.020+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=GNQSJQZJKS08 type=del 2024-03-04T12:26:45.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.022+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~UFMZ73L412PM.0 size=1048576 2024-03-04T12:26:45.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.023+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~UFMZ73L412PM.1 size=1048576 2024-03-04T12:26:45.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.023+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~UFMZ73L412PM.2 size=74857 2024-03-04T12:26:45.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.023+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=UFMZ73L412PM tag=LUDL2NOFUKB0 type=write size=3220585 2024-03-04T12:26:45.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.024+0000 7fa4b3c3e780 1 < canceled part key=_multipart_KKQT9J9GSW0N.2~HW678U4A6E9O.0 size=291332 2024-03-04T12:26:45.032 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.025+0000 7fa4b3c3e780 1 < canceled multipart upload key=KKQT9J9GSW0N upload=HW678U4A6E9O tag=6CFHIL7R4GQ6 type=write size=1339908 2024-03-04T12:26:45.033 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.026+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=A2DM7J1MJMGP type=del size=2240311 2024-03-04T12:26:45.035 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.028+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=IP0UP6M666R3 type=del 2024-03-04T12:26:45.036 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.029+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~N4FEX3ZY9CY9.0 size=1048576 2024-03-04T12:26:45.037 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.030+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~N4FEX3ZY9CY9.1 size=1048576 2024-03-04T12:26:45.038 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.031+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~N4FEX3ZY9CY9.2 size=11686 2024-03-04T12:26:45.038 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.031+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=N4FEX3ZY9CY9 tag=Q5KRM7F0CR8W type=write size=3157414 2024-03-04T12:26:45.039 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.032+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=ZJW4S6ZWMHV2 type=del 2024-03-04T12:26:45.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.034+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~8KGQINBLHXX3.0 size=1048576 2024-03-04T12:26:45.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.035+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~8KGQINBLHXX3.1 size=1048576 2024-03-04T12:26:45.043 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.036+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~8KGQINBLHXX3.2 size=21796 2024-03-04T12:26:45.043 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.036+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=8KGQINBLHXX3 tag=FER4EQ3MZCVG type=write size=3167524 2024-03-04T12:26:45.044 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.037+0000 7fa4b3c3e780 1 < completed write operation key=BVMWQ9ZL4K0C tag=R9YTQ6LV9E5X type=write size=1008107 2024-03-04T12:26:45.045 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.038+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=342HFUJ2Y1EE type=del size=3374172 2024-03-04T12:26:45.047 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.040+0000 7fa4b3c3e780 1 < suggested remove operation key=BR8RTE2QEH9E tag=8DYMN2SSCF19 type=del 2024-03-04T12:26:45.049 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.042+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~12HB0EI9SGE6.0 size=1048576 2024-03-04T12:26:45.050 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.043+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~12HB0EI9SGE6.1 size=1048576 2024-03-04T12:26:45.051 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.044+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~12HB0EI9SGE6.2 size=85482 2024-03-04T12:26:45.051 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.044+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=12HB0EI9SGE6 tag=XFFKER4CTIB8 type=write size=3231210 2024-03-04T12:26:45.052 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.045+0000 7fa4b3c3e780 -1 < failed to complete operation key=BR8RTE2QEH9E tag=VU46O7EMSAMZ type=del size=486922: (22) Invalid argument 2024-03-04T12:26:45.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.046+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=4BVAPNT1E64K type=del size=4116447 2024-03-04T12:26:45.054 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.047+0000 7fa4b3c3e780 1 < completed write operation key=NVMIU38VM9Q1 tag=RJF838R7FFR0 type=write size=864019 2024-03-04T12:26:45.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.049+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~KJHTXL1ZA6N6.0 size=1048576 2024-03-04T12:26:45.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.050+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~KJHTXL1ZA6N6.1 size=1048576 2024-03-04T12:26:45.058 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.051+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~KJHTXL1ZA6N6.2 size=95132 2024-03-04T12:26:45.058 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.051+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=KJHTXL1ZA6N6 tag=4B5B3GTK53WK type=write size=3240860 2024-03-04T12:26:45.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.052+0000 7fa4b3c3e780 1 < canceled operation key=H5FWRNK8F7QT tag=6IJM0FZ7J3YC type=del size=3471724 2024-03-04T12:26:45.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.053+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=U1YZDQU2OYHF type=write size=467746 2024-03-04T12:26:45.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.054+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~AI132QQRFFQV.0 size=184867 2024-03-04T12:26:45.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.056+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=AI132QQRFFQV tag=417W5RPW3POZ type=write size=1233443 2024-03-04T12:26:45.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.058+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~M2NRAYNPA44M.0 size=1048576 2024-03-04T12:26:45.066 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.059+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~M2NRAYNPA44M.1 size=206410 2024-03-04T12:26:45.066 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.059+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=M2NRAYNPA44M tag=LEX71SS9HC9F type=write size=2303562 2024-03-04T12:26:45.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.060+0000 7fa4b3c3e780 1 < completed delete operation key=YWJV4QMY6ZBI tag=5P9TEP7WVLL6 type=del 2024-03-04T12:26:45.068 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.061+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=01L73ZYHQ86U type=del size=710288 2024-03-04T12:26:45.069 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.062+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~X6YQB1CWUCTO.0 size=492823 2024-03-04T12:26:45.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.064+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=X6YQB1CWUCTO tag=AW0R644ILMT3 type=write size=1541399 2024-03-04T12:26:45.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.066+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~KINL7TDGNLEF.0 size=691260 2024-03-04T12:26:45.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.066+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=KINL7TDGNLEF tag=LPOTC1P1NKQU type=write size=1739836 2024-03-04T12:26:45.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.066+0000 7fa4b3c3e780 1 < canceled part key=_multipart_GMIPCGYZRJ5L.2~2PR8E9Q3KH11.0 size=788880 2024-03-04T12:26:45.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.068+0000 7fa4b3c3e780 1 < canceled multipart upload key=GMIPCGYZRJ5L upload=2PR8E9Q3KH11 tag=EANO0BZT0OJ5 type=write size=1837456 2024-03-04T12:26:45.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.070+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~N9B3L21KNY59.0 size=1048576 2024-03-04T12:26:45.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.071+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~N9B3L21KNY59.1 size=413844 2024-03-04T12:26:45.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.071+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=N9B3L21KNY59 tag=44VP9Z1VI5FI type=write size=2510996 2024-03-04T12:26:45.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.073+0000 7fa4b3c3e780 1 < suggested update operation key=4LKTYP07OL5L tag=P8AI1EE4YF6I type=del size=2220602 2024-03-04T12:26:45.081 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.074+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=VAPIPNFLI27M type=del size=311254 2024-03-04T12:26:45.082 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.076+0000 7fa4b3c3e780 1 < completed delete operation key=RHU0QO8HS5SC tag=0LDYQW7YJVHG type=del 2024-03-04T12:26:45.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.077+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=5FE1B09EXJ1Z type=del size=3111812 2024-03-04T12:26:45.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.078+0000 7fa4b3c3e780 1 < completed write operation key=G8G76PMSKJ0I tag=V2G08Y18NCLB type=write size=467441 2024-03-04T12:26:45.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.080+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~8BFN53ICKD2W.0 size=1048576 2024-03-04T12:26:45.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.081+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~8BFN53ICKD2W.1 size=1048576 2024-03-04T12:26:45.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.082+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~8BFN53ICKD2W.2 size=563022 2024-03-04T12:26:45.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.082+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=8BFN53ICKD2W tag=E369L0EVT6OC type=write size=3708750 2024-03-04T12:26:45.089 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.083+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~UFMZ73L412PM.0 size=1048576 2024-03-04T12:26:45.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.084+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~UFMZ73L412PM.1 size=1048576 2024-03-04T12:26:45.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.085+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~UFMZ73L412PM.2 size=74857 2024-03-04T12:26:45.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.087+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=UFMZ73L412PM tag=LUDL2NOFUKB0 type=write size=3220585 2024-03-04T12:26:45.095 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.088+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=5XLLLG53HH4N type=del size=3328996 2024-03-04T12:26:45.096 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.089+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=A2DM7J1MJMGP type=del 2024-03-04T12:26:45.097 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.090+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=SE8W05CX6JYX type=del size=3255872 2024-03-04T12:26:45.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.092+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~N4FEX3ZY9CY9.0 size=1048576 2024-03-04T12:26:45.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.093+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~N4FEX3ZY9CY9.1 size=1048576 2024-03-04T12:26:45.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.094+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~N4FEX3ZY9CY9.2 size=11686 2024-03-04T12:26:45.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.095+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=N4FEX3ZY9CY9 tag=Q5KRM7F0CR8W type=write size=3157414 2024-03-04T12:26:45.104 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.098+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~8XLQYFWC0U90.0 size=1048576 2024-03-04T12:26:45.105 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.099+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~8XLQYFWC0U90.1 size=1048576 2024-03-04T12:26:45.106 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.099+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~8XLQYFWC0U90.2 size=949982 2024-03-04T12:26:45.106 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.099+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=8XLQYFWC0U90 tag=4DOPIEDXD0OA type=write size=4095710 2024-03-04T12:26:45.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.101+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~8KGQINBLHXX3.0 size=1048576 2024-03-04T12:26:45.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.102+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~8KGQINBLHXX3.1 size=1048576 2024-03-04T12:26:45.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.103+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~8KGQINBLHXX3.2 size=21796 2024-03-04T12:26:45.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.105+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=8KGQINBLHXX3 tag=FER4EQ3MZCVG type=write size=3167524 2024-03-04T12:26:45.113 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.106+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=B0NVBJKAD21J type=del size=4032691 2024-03-04T12:26:45.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.107+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=342HFUJ2Y1EE type=del 2024-03-04T12:26:45.115 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.108+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=77FKYFX0CZHW type=del size=1359369 2024-03-04T12:26:45.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.109+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~12HB0EI9SGE6.0 size=1048576 2024-03-04T12:26:45.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.110+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~12HB0EI9SGE6.1 size=1048576 2024-03-04T12:26:45.118 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.111+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~12HB0EI9SGE6.2 size=85482 2024-03-04T12:26:45.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.113+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=12HB0EI9SGE6 tag=XFFKER4CTIB8 type=write size=3231210 2024-03-04T12:26:45.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.115+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=36SZ89BYV1TZ type=write size=442201 2024-03-04T12:26:45.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.116+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=4BVAPNT1E64K type=del 2024-03-04T12:26:45.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.118+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=1VVBRCSLRE9O type=write size=404399 2024-03-04T12:26:45.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.119+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~KJHTXL1ZA6N6.0 size=1048576 2024-03-04T12:26:45.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.120+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~KJHTXL1ZA6N6.1 size=1048576 2024-03-04T12:26:45.128 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.121+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~KJHTXL1ZA6N6.2 size=95132 2024-03-04T12:26:45.130 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.123+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=KJHTXL1ZA6N6 tag=4B5B3GTK53WK type=write size=3240860 2024-03-04T12:26:45.131 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.124+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=VA7KN61PWW8G type=write size=579090 2024-03-04T12:26:45.132 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.125+0000 7fa4b3c3e780 1 < completed write operation key=V7N7MZ1GUNEV tag=U1YZDQU2OYHF type=write size=467746 2024-03-04T12:26:45.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.128+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~581Y0JWUVBHJ.0 size=1048576 2024-03-04T12:26:45.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.129+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~581Y0JWUVBHJ.1 size=893475 2024-03-04T12:26:45.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.129+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=581Y0JWUVBHJ tag=CB47K6GW38VJ type=write size=2990627 2024-03-04T12:26:45.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.130+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~M2NRAYNPA44M.0 size=1048576 2024-03-04T12:26:45.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.131+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~M2NRAYNPA44M.1 size=206410 2024-03-04T12:26:45.140 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.133+0000 7fa4b3c3e780 1 < completed multipart upload key=3N6E09QF3866 upload=M2NRAYNPA44M tag=LEX71SS9HC9F type=write size=2303562 2024-03-04T12:26:45.142 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.135+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~YJD602MEQYCQ.0 size=1048576 2024-03-04T12:26:45.143 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.136+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~YJD602MEQYCQ.1 size=237687 2024-03-04T12:26:45.143 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.136+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=YJD602MEQYCQ tag=AD6M55CJH162 type=write size=2334839 2024-03-04T12:26:45.144 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.137+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=01L73ZYHQ86U type=del 2024-03-04T12:26:45.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.138+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=QZEQ9LL9PSML type=del size=1869137 2024-03-04T12:26:45.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.139+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~KINL7TDGNLEF.0 size=691260 2024-03-04T12:26:45.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.141+0000 7fa4b3c3e780 1 < completed multipart upload key=R1DOKJPZRT5Q upload=KINL7TDGNLEF tag=LPOTC1P1NKQU type=write size=1739836 2024-03-04T12:26:45.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.143+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~7HGQ89CSJ1DL.0 size=1048576 2024-03-04T12:26:45.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.144+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~7HGQ89CSJ1DL.1 size=636570 2024-03-04T12:26:45.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.144+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=7HGQ89CSJ1DL tag=TZYOJTEU1GQN type=write size=2733722 2024-03-04T12:26:45.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.145+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~N9B3L21KNY59.0 size=1048576 2024-03-04T12:26:45.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.146+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~N9B3L21KNY59.1 size=413844 2024-03-04T12:26:45.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.148+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=N9B3L21KNY59 tag=44VP9Z1VI5FI type=write size=2510996 2024-03-04T12:26:45.156 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.149+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=524FPJV071L2 type=write size=50155 2024-03-04T12:26:45.157 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.150+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=VAPIPNFLI27M type=del 2024-03-04T12:26:45.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.152+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=T3CEW68079HF type=del size=2836601 2024-03-04T12:26:45.160 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.153+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=5FE1B09EXJ1Z type=del 2024-03-04T12:26:45.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.154+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=OH222I7ZI3FX type=del size=886662 2024-03-04T12:26:45.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.154+0000 7fa4b3c3e780 1 < canceled part key=_multipart_V7N7MZ1GUNEV.2~8BFN53ICKD2W.0 size=1048576 2024-03-04T12:26:45.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.155+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~8BFN53ICKD2W.1 size=1048576 2024-03-04T12:26:45.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.156+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~8BFN53ICKD2W.2 size=563022 2024-03-04T12:26:45.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.158+0000 7fa4b3c3e780 1 < canceled multipart upload key=V7N7MZ1GUNEV upload=8BFN53ICKD2W tag=E369L0EVT6OC type=write size=3708750 2024-03-04T12:26:45.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.160+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~0WZ9WD1V79EL.0 size=1048576 2024-03-04T12:26:45.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.161+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~0WZ9WD1V79EL.1 size=398762 2024-03-04T12:26:45.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.161+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=0WZ9WD1V79EL tag=H2J6N6F3UZZU type=write size=2495914 2024-03-04T12:26:45.169 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.162+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=5XLLLG53HH4N type=del 2024-03-04T12:26:45.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.164+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~BM0IYWBVNBX8.0 size=953709 2024-03-04T12:26:45.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.164+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=BM0IYWBVNBX8 tag=KDQ6HC1K9MWO type=write size=2002285 2024-03-04T12:26:45.172 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.165+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=SE8W05CX6JYX type=del 2024-03-04T12:26:45.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.166+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=JB0ZMIJO3WZ9 type=del size=3813950 2024-03-04T12:26:45.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.167+0000 7fa4b3c3e780 1 < canceled part key=_multipart_3TDMQXKLPX34.2~8XLQYFWC0U90.0 size=1048576 2024-03-04T12:26:45.174 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.168+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~8XLQYFWC0U90.1 size=1048576 2024-03-04T12:26:45.174 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.168+0000 7fa4b3c3e780 1 < canceled part key=_multipart_3TDMQXKLPX34.2~8XLQYFWC0U90.2 size=949982 2024-03-04T12:26:45.176 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.169+0000 7fa4b3c3e780 1 < canceled multipart upload key=3TDMQXKLPX34 upload=8XLQYFWC0U90 tag=4DOPIEDXD0OA type=write size=4095710 2024-03-04T12:26:45.178 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.171+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~7NZXGZD34G8A.0 size=303743 2024-03-04T12:26:45.178 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.171+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=7NZXGZD34G8A tag=4LBZYKYTKZVU type=write size=1352319 2024-03-04T12:26:45.180 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.174+0000 7fa4b3c3e780 1 < suggested remove operation key=R1DOKJPZRT5Q tag=B0NVBJKAD21J type=del 2024-03-04T12:26:45.182 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.175+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=F20KMX0K54ET type=del size=454419 2024-03-04T12:26:45.183 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.176+0000 7fa4b3c3e780 1 < completed delete operation key=R6Y09EO6HGF0 tag=77FKYFX0CZHW type=del 2024-03-04T12:26:45.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.178+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=4JXYD075ORCF type=del size=880976 2024-03-04T12:26:45.187 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.180+0000 7fa4b3c3e780 1 < suggested remove operation key=RHU0QO8HS5SC tag=36SZ89BYV1TZ type=write 2024-03-04T12:26:45.188 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.181+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=C9TQ9MNG6LLN type=write size=887373 2024-03-04T12:26:45.190 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.183+0000 7fa4b3c3e780 1 < completed write operation key=H5FWRNK8F7QT tag=1VVBRCSLRE9O type=write size=404399 2024-03-04T12:26:45.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.184+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=CAG5BZZF6IDY type=del size=2031515 2024-03-04T12:26:45.192 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.185+0000 7fa4b3c3e780 1 < completed write operation key=T301TK0FIOG4 tag=VA7KN61PWW8G type=write size=579090 2024-03-04T12:26:45.193 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.186+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=7VSI334M76AQ type=del size=349112 2024-03-04T12:26:45.194 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.188+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~581Y0JWUVBHJ.0 size=1048576 2024-03-04T12:26:45.195 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.188+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~581Y0JWUVBHJ.1 size=893475 2024-03-04T12:26:45.197 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.190+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=581Y0JWUVBHJ tag=CB47K6GW38VJ type=write size=2990627 2024-03-04T12:26:45.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.192+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~OOL0NQCX4LK2.0 size=671749 2024-03-04T12:26:45.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.192+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=OOL0NQCX4LK2 tag=SWFYA7INW4SF type=write size=1720325 2024-03-04T12:26:45.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.193+0000 7fa4b3c3e780 1 < canceled part key=_multipart_T301TK0FIOG4.2~YJD602MEQYCQ.0 size=1048576 2024-03-04T12:26:45.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.193+0000 7fa4b3c3e780 1 < canceled part key=_multipart_T301TK0FIOG4.2~YJD602MEQYCQ.1 size=237687 2024-03-04T12:26:45.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.194+0000 7fa4b3c3e780 1 < canceled multipart upload key=T301TK0FIOG4 upload=YJD602MEQYCQ tag=AD6M55CJH162 type=write size=2334839 2024-03-04T12:26:45.202 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.196+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=PA58DOAQONQO type=del size=699785 2024-03-04T12:26:45.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.197+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=QZEQ9LL9PSML type=del 2024-03-04T12:26:45.205 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.198+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=QO45KZJUFLDG type=del size=2766787 2024-03-04T12:26:45.206 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.199+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~7HGQ89CSJ1DL.0 size=1048576 2024-03-04T12:26:45.207 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.200+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~7HGQ89CSJ1DL.1 size=636570 2024-03-04T12:26:45.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.202+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=7HGQ89CSJ1DL tag=TZYOJTEU1GQN type=write size=2733722 2024-03-04T12:26:45.210 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.203+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=DLDMHB42HLTS type=del size=1950146 2024-03-04T12:26:45.212 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.205+0000 7fa4b3c3e780 1 < suggested update operation key=R6Y09EO6HGF0 tag=524FPJV071L2 type=write size=50155 2024-03-04T12:26:45.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.206+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=H2199IGCANZM type=write size=811935 2024-03-04T12:26:45.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.208+0000 7fa4b3c3e780 1 < suggested update operation key=BVMWQ9ZL4K0C tag=T3CEW68079HF type=del size=2836601 2024-03-04T12:26:45.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.209+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=4XWRX0C7OHQ4 type=del size=2148638 2024-03-04T12:26:45.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.210+0000 7fa4b3c3e780 1 < completed delete operation key=G8G76PMSKJ0I tag=OH222I7ZI3FX type=del 2024-03-04T12:26:45.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.212+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=NYOW7I5TGBTL type=del size=2167535 2024-03-04T12:26:45.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.213+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~0WZ9WD1V79EL.0 size=1048576 2024-03-04T12:26:45.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.214+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~0WZ9WD1V79EL.1 size=398762 2024-03-04T12:26:45.222 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.216+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=0WZ9WD1V79EL tag=H2J6N6F3UZZU type=write size=2495914 2024-03-04T12:26:45.223 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.217+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=6JQN1H730WD5 type=del size=510195 2024-03-04T12:26:45.225 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.218+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~BM0IYWBVNBX8.0 size=953709 2024-03-04T12:26:45.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.220+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=BM0IYWBVNBX8 tag=KDQ6HC1K9MWO type=write size=2002285 2024-03-04T12:26:45.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.222+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~RRKVLZT6TDU0.0 size=1025784 2024-03-04T12:26:45.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.222+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=RRKVLZT6TDU0 tag=E5IHTMOK3CTG type=write size=2074360 2024-03-04T12:26:45.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.224+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=JB0ZMIJO3WZ9 type=del 2024-03-04T12:26:45.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.225+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=QO56RA5C5ONE type=del size=2323417 2024-03-04T12:26:45.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.226+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~7NZXGZD34G8A.0 size=303743 2024-03-04T12:26:45.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.228+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=7NZXGZD34G8A tag=4LBZYKYTKZVU type=write size=1352319 2024-03-04T12:26:45.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.229+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=HTY6J2QFT7AJ type=del size=665998 2024-03-04T12:26:45.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.230+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=F20KMX0K54ET type=del 2024-03-04T12:26:45.238 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.231+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=83OMHXEI6EE9 type=del size=1372199 2024-03-04T12:26:45.239 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.232+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=4JXYD075ORCF type=del 2024-03-04T12:26:45.240 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.234+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=L1MMS4D7X4GS type=del size=253175 2024-03-04T12:26:45.241 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.235+0000 7fa4b3c3e780 1 < completed write operation key=VAIY4J3CYONH tag=C9TQ9MNG6LLN type=write size=887373 2024-03-04T12:26:45.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.237+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~313XJXRQBLU7.0 size=1048576 2024-03-04T12:26:45.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.238+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~313XJXRQBLU7.1 size=61225 2024-03-04T12:26:45.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.238+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=313XJXRQBLU7 tag=FHVLS0CY11Q3 type=write size=2158377 2024-03-04T12:26:45.245 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.239+0000 7fa4b3c3e780 -1 < failed to complete operation key=R6Y09EO6HGF0 tag=CAG5BZZF6IDY type=del size=2031515: (22) Invalid argument 2024-03-04T12:26:45.247 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.241+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~9VW2RY51A57Z.0 size=1048576 2024-03-04T12:26:45.249 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.242+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~9VW2RY51A57Z.1 size=858670 2024-03-04T12:26:45.249 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.242+0000 7fa4b3c3e780 1 > prepared multipart upload key=G8G76PMSKJ0I upload=9VW2RY51A57Z tag=SZ1ETJI5GQXQ type=write size=2955822 2024-03-04T12:26:45.251 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.244+0000 7fa4b3c3e780 1 < suggested update operation key=G4SUQFVB936T tag=7VSI334M76AQ type=del size=349112 2024-03-04T12:26:45.253 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.246+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~VEHH3K9DJURW.0 size=1048576 2024-03-04T12:26:45.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.247+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~VEHH3K9DJURW.1 size=611484 2024-03-04T12:26:45.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.247+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=VEHH3K9DJURW tag=DU231WC5V6DX type=write size=2708636 2024-03-04T12:26:45.255 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.248+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~OOL0NQCX4LK2.0 size=671749 2024-03-04T12:26:45.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.250+0000 7fa4b3c3e780 1 < completed multipart upload key=R1DOKJPZRT5Q upload=OOL0NQCX4LK2 tag=SWFYA7INW4SF type=write size=1720325 2024-03-04T12:26:45.259 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.252+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~V6DQDWNP318I.0 size=1048576 2024-03-04T12:26:45.260 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.253+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~V6DQDWNP318I.1 size=51779 2024-03-04T12:26:45.260 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.253+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=V6DQDWNP318I tag=NMK6Y9QOV7K4 type=write size=2148931 2024-03-04T12:26:45.262 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.256+0000 7fa4b3c3e780 1 < suggested update operation key=YQLH0WW7I7MW tag=PA58DOAQONQO type=del size=699785 2024-03-04T12:26:45.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.258+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~KEBBEJ9FFB7E.0 size=1048576 2024-03-04T12:26:45.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.259+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~KEBBEJ9FFB7E.1 size=736804 2024-03-04T12:26:45.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.259+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=KEBBEJ9FFB7E tag=IJZPK9UMWO04 type=write size=2833956 2024-03-04T12:26:45.266 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.260+0000 7fa4b3c3e780 -1 < failed to complete operation key=YQLH0WW7I7MW tag=QO45KZJUFLDG type=del size=2766787: (22) Invalid argument 2024-03-04T12:26:45.268 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.261+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=1NFXGWH1J7VZ type=del size=2723195 2024-03-04T12:26:45.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.262+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=DLDMHB42HLTS type=del 2024-03-04T12:26:45.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.263+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=JU92KXDIDZ1M type=del size=587150 2024-03-04T12:26:45.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.265+0000 7fa4b3c3e780 1 < suggested update operation key=UZRX3W3DE5VX tag=H2199IGCANZM type=write size=811935 2024-03-04T12:26:45.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.267+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=73X67130E63U type=write size=39983 2024-03-04T12:26:45.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.268+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=4XWRX0C7OHQ4 type=del 2024-03-04T12:26:45.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.270+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~HQQY7GPPQH9Y.0 size=194979 2024-03-04T12:26:45.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.270+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=HQQY7GPPQH9Y tag=AWZG6DJ3M5FN type=write size=1243555 2024-03-04T12:26:45.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.271+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=NYOW7I5TGBTL type=del 2024-03-04T12:26:45.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.272+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=88OM69X3UWUS type=write size=535572 2024-03-04T12:26:45.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.273+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=6JQN1H730WD5 type=del 2024-03-04T12:26:45.282 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.275+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~BAPH14PW1RN8.0 size=1048576 2024-03-04T12:26:45.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.276+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~BAPH14PW1RN8.1 size=1048576 2024-03-04T12:26:45.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.277+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~BAPH14PW1RN8.2 size=505273 2024-03-04T12:26:45.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.277+0000 7fa4b3c3e780 1 > prepared multipart upload key=G4SUQFVB936T upload=BAPH14PW1RN8 tag=QW6HL6N0EAJ5 type=write size=3651001 2024-03-04T12:26:45.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.278+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~RRKVLZT6TDU0.0 size=1025784 2024-03-04T12:26:45.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.280+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=RRKVLZT6TDU0 tag=E5IHTMOK3CTG type=write size=2074360 2024-03-04T12:26:45.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.281+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=4QUNY0IEFK1I type=write size=70605 2024-03-04T12:26:45.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.282+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=QO56RA5C5ONE type=del 2024-03-04T12:26:45.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.284+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~KYG5QIQM89VR.0 size=327128 2024-03-04T12:26:45.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.284+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=KYG5QIQM89VR tag=R58PPMGZTAKT type=write size=1375704 2024-03-04T12:26:45.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.285+0000 7fa4b3c3e780 1 < completed delete operation key=GMIPCGYZRJ5L tag=HTY6J2QFT7AJ type=del 2024-03-04T12:26:45.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.286+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=Q2W9CTMOTX5C type=del size=3680102 2024-03-04T12:26:45.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.287+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=83OMHXEI6EE9 type=del 2024-03-04T12:26:45.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.289+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~WK4D00DX16NO.0 size=243150 2024-03-04T12:26:45.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.289+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=WK4D00DX16NO tag=CNI8STZ0C31N type=write size=1291726 2024-03-04T12:26:45.297 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.290+0000 7fa4b3c3e780 -1 < failed to complete operation key=UZRX3W3DE5VX tag=L1MMS4D7X4GS type=del size=253175: (22) Invalid argument 2024-03-04T12:26:45.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.292+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=IE7BPXRADKVJ type=del size=1033481 2024-03-04T12:26:45.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.293+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~313XJXRQBLU7.0 size=1048576 2024-03-04T12:26:45.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.293+0000 7fa4b3c3e780 1 < canceled part key=_multipart_BVMWQ9ZL4K0C.2~313XJXRQBLU7.1 size=61225 2024-03-04T12:26:45.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.295+0000 7fa4b3c3e780 1 < canceled multipart upload key=BVMWQ9ZL4K0C upload=313XJXRQBLU7 tag=FHVLS0CY11Q3 type=write size=2158377 2024-03-04T12:26:45.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.297+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~B6QTCMRCRZPZ.0 size=1048576 2024-03-04T12:26:45.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.297+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~B6QTCMRCRZPZ.1 size=1048576 2024-03-04T12:26:45.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.298+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~B6QTCMRCRZPZ.2 size=589859 2024-03-04T12:26:45.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.298+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=B6QTCMRCRZPZ tag=E4M7205P6Q2S type=write size=3735587 2024-03-04T12:26:45.306 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.299+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~9VW2RY51A57Z.0 size=1048576 2024-03-04T12:26:45.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.300+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~9VW2RY51A57Z.1 size=858670 2024-03-04T12:26:45.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.302+0000 7fa4b3c3e780 1 < completed multipart upload key=G8G76PMSKJ0I upload=9VW2RY51A57Z tag=SZ1ETJI5GQXQ type=write size=2955822 2024-03-04T12:26:45.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.303+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=Q474G75GZVRE type=del size=2604701 2024-03-04T12:26:45.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.304+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~VEHH3K9DJURW.0 size=1048576 2024-03-04T12:26:45.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.305+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~VEHH3K9DJURW.1 size=611484 2024-03-04T12:26:45.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.307+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=VEHH3K9DJURW tag=DU231WC5V6DX type=write size=2708636 2024-03-04T12:26:45.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.308+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=E6QXP249GOOX type=del size=1641130 2024-03-04T12:26:45.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.310+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~V6DQDWNP318I.0 size=1048576 2024-03-04T12:26:45.317 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.310+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~V6DQDWNP318I.1 size=51779 2024-03-04T12:26:45.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.312+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=V6DQDWNP318I tag=NMK6Y9QOV7K4 type=write size=2148931 2024-03-04T12:26:45.320 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.313+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=PL0ZRE8GCWUP type=write size=691966 2024-03-04T12:26:45.321 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.314+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~KEBBEJ9FFB7E.0 size=1048576 2024-03-04T12:26:45.322 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.315+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~KEBBEJ9FFB7E.1 size=736804 2024-03-04T12:26:45.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.317+0000 7fa4b3c3e780 1 < completed multipart upload key=ESHAMQWMMBJR upload=KEBBEJ9FFB7E tag=IJZPK9UMWO04 type=write size=2833956 2024-03-04T12:26:45.325 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.318+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=1K9DIBRHIHEC type=del size=3175465 2024-03-04T12:26:45.326 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.319+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=1NFXGWH1J7VZ type=del 2024-03-04T12:26:45.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.320+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=18JT4Z558KNO type=write size=855795 2024-03-04T12:26:45.328 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.322+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=JU92KXDIDZ1M type=del 2024-03-04T12:26:45.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.323+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=7WU5Z79103UG type=write size=312955 2024-03-04T12:26:45.331 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.324+0000 7fa4b3c3e780 1 < completed write operation key=7IUV88NQLPN8 tag=73X67130E63U type=write size=39983 2024-03-04T12:26:45.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.325+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=WPV4M9KF730M type=del size=2268124 2024-03-04T12:26:45.333 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.326+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~HQQY7GPPQH9Y.0 size=194979 2024-03-04T12:26:45.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.328+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=HQQY7GPPQH9Y tag=AWZG6DJ3M5FN type=write size=1243555 2024-03-04T12:26:45.336 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.329+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=S34J84TLFRRT type=write size=155179 2024-03-04T12:26:45.337 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.331+0000 7fa4b3c3e780 1 < completed write operation key=ZETES4AYZQHY tag=88OM69X3UWUS type=write size=535572 2024-03-04T12:26:45.339 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.332+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~1PKC7XQ6JA4R.0 size=1048576 2024-03-04T12:26:45.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.333+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~1PKC7XQ6JA4R.1 size=608354 2024-03-04T12:26:45.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.333+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=1PKC7XQ6JA4R tag=AN2MDSTF2DPH type=write size=2705506 2024-03-04T12:26:45.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.334+0000 7fa4b3c3e780 1 < canceled part key=_multipart_G4SUQFVB936T.2~BAPH14PW1RN8.0 size=1048576 2024-03-04T12:26:45.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.334+0000 7fa4b3c3e780 1 < canceled part key=_multipart_G4SUQFVB936T.2~BAPH14PW1RN8.1 size=1048576 2024-03-04T12:26:45.341 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.334+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~BAPH14PW1RN8.2 size=505273 2024-03-04T12:26:45.343 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.336+0000 7fa4b3c3e780 1 < canceled multipart upload key=G4SUQFVB936T upload=BAPH14PW1RN8 tag=QW6HL6N0EAJ5 type=write size=3651001 2024-03-04T12:26:45.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.338+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~WLGV8LNQAE5W.0 size=1048576 2024-03-04T12:26:45.346 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.339+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~WLGV8LNQAE5W.1 size=127467 2024-03-04T12:26:45.346 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.339+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=WLGV8LNQAE5W tag=AOXDL1CBFKS7 type=write size=2224619 2024-03-04T12:26:45.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.340+0000 7fa4b3c3e780 1 < completed write operation key=VAIY4J3CYONH tag=4QUNY0IEFK1I type=write size=70605 2024-03-04T12:26:45.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.341+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=9LNKWWMSGDFP type=write size=843998 2024-03-04T12:26:45.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.342+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~KYG5QIQM89VR.0 size=327128 2024-03-04T12:26:45.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.344+0000 7fa4b3c3e780 1 < completed multipart upload key=J53J0N99N30A upload=KYG5QIQM89VR tag=R58PPMGZTAKT type=write size=1375704 2024-03-04T12:26:45.352 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.345+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=2E51M82I3NZJ type=write size=768526 2024-03-04T12:26:45.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.346+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=Q2W9CTMOTX5C type=del 2024-03-04T12:26:45.354 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.347+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=HLM9XA1AH1FV type=del size=1642869 2024-03-04T12:26:45.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.348+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~WK4D00DX16NO.0 size=243150 2024-03-04T12:26:45.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.350+0000 7fa4b3c3e780 1 < completed multipart upload key=4989OME3IAJF upload=WK4D00DX16NO tag=CNI8STZ0C31N type=write size=1291726 2024-03-04T12:26:45.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.351+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=EM181OL6Y0ZA type=del size=738532 2024-03-04T12:26:45.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.352+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=IE7BPXRADKVJ type=del 2024-03-04T12:26:45.360 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.353+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=3A037S23IE91 type=del size=659245 2024-03-04T12:26:45.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.354+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~B6QTCMRCRZPZ.0 size=1048576 2024-03-04T12:26:45.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.355+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~B6QTCMRCRZPZ.1 size=1048576 2024-03-04T12:26:45.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.356+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~B6QTCMRCRZPZ.2 size=589859 2024-03-04T12:26:45.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.358+0000 7fa4b3c3e780 1 < completed multipart upload key=V7N7MZ1GUNEV upload=B6QTCMRCRZPZ tag=E4M7205P6Q2S type=write size=3735587 2024-03-04T12:26:45.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.360+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~FE984AZPLKCC.0 size=339313 2024-03-04T12:26:45.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.360+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=FE984AZPLKCC tag=946651NY9ND2 type=write size=1387889 2024-03-04T12:26:45.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.361+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=Q474G75GZVRE type=del 2024-03-04T12:26:45.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.362+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=Y0S50L3CEXIN type=write size=371700 2024-03-04T12:26:45.370 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.363+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=E6QXP249GOOX type=del 2024-03-04T12:26:45.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.364+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=AHYW31Q10Q6G type=del size=1384754 2024-03-04T12:26:45.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.365+0000 7fa4b3c3e780 1 < canceled operation key=YQLH0WW7I7MW tag=PL0ZRE8GCWUP type=write size=691966 2024-03-04T12:26:45.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.367+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~L0QQNANC5PYL.0 size=521862 2024-03-04T12:26:45.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.367+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=L0QQNANC5PYL tag=5T4SV6TVT6W8 type=write size=1570438 2024-03-04T12:26:45.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.368+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=1K9DIBRHIHEC type=del 2024-03-04T12:26:45.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.370+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~5Y0AIWXUL0PW.0 size=232249 2024-03-04T12:26:45.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.370+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=5Y0AIWXUL0PW tag=C3R3FJQ9GR1J type=write size=1280825 2024-03-04T12:26:45.378 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.371+0000 7fa4b3c3e780 1 < completed write operation key=43HMF7NWNMU3 tag=18JT4Z558KNO type=write size=855795 2024-03-04T12:26:45.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.372+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=B8B4YZJ2PL09 type=write size=392255 2024-03-04T12:26:45.380 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.373+0000 7fa4b3c3e780 1 < completed write operation key=R1DOKJPZRT5Q tag=7WU5Z79103UG type=write size=312955 2024-03-04T12:26:45.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.374+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=9Q49D2PJJD92 type=write size=629666 2024-03-04T12:26:45.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.377+0000 7fa4b3c3e780 1 < suggested remove operation key=DHLTVH2AZBLR tag=WPV4M9KF730M type=del 2024-03-04T12:26:45.384 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.378+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=3R0DW0JRZGTP type=del size=315752 2024-03-04T12:26:45.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.379+0000 7fa4b3c3e780 1 < completed write operation key=YIS2SV4O5EZN tag=S34J84TLFRRT type=write size=155179 2024-03-04T12:26:45.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.381+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~96DEX7889PX2.0 size=1048576 2024-03-04T12:26:45.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.381+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~96DEX7889PX2.1 size=1048576 2024-03-04T12:26:45.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.382+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~96DEX7889PX2.2 size=866172 2024-03-04T12:26:45.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.382+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=96DEX7889PX2 tag=TB58KIPZUDX4 type=write size=4011900 2024-03-04T12:26:45.390 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.384+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~1PKC7XQ6JA4R.0 size=1048576 2024-03-04T12:26:45.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.385+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~1PKC7XQ6JA4R.1 size=608354 2024-03-04T12:26:45.393 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.387+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=1PKC7XQ6JA4R tag=AN2MDSTF2DPH type=write size=2705506 2024-03-04T12:26:45.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.389+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~2ET4E705MFMN.0 size=1048576 2024-03-04T12:26:45.397 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.390+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~2ET4E705MFMN.1 size=213674 2024-03-04T12:26:45.397 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.390+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=2ET4E705MFMN tag=ZMPB4KOW1T3L type=write size=2310826 2024-03-04T12:26:45.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.391+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~WLGV8LNQAE5W.0 size=1048576 2024-03-04T12:26:45.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.392+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~WLGV8LNQAE5W.1 size=127467 2024-03-04T12:26:45.401 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.394+0000 7fa4b3c3e780 1 < completed multipart upload key=H5FWRNK8F7QT upload=WLGV8LNQAE5W tag=AOXDL1CBFKS7 type=write size=2224619 2024-03-04T12:26:45.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.396+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=ENU0BB6CS32N type=del size=1438234 2024-03-04T12:26:45.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.397+0000 7fa4b3c3e780 1 < completed write operation key=7IUV88NQLPN8 tag=9LNKWWMSGDFP type=write size=843998 2024-03-04T12:26:45.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.399+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~9W0SGUBDW35E.0 size=146633 2024-03-04T12:26:45.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.399+0000 7fa4b3c3e780 1 > prepared multipart upload key=G4SUQFVB936T upload=9W0SGUBDW35E tag=U67G5AW5TJSN type=write size=1195209 2024-03-04T12:26:45.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.400+0000 7fa4b3c3e780 1 < completed write operation key=X0RVLNRWUAEM tag=2E51M82I3NZJ type=write size=768526 2024-03-04T12:26:45.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.401+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=CPOP8K7QWTOR type=del size=3395141 2024-03-04T12:26:45.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.402+0000 7fa4b3c3e780 1 < canceled operation key=NVMIU38VM9Q1 tag=HLM9XA1AH1FV type=del size=1642869 2024-03-04T12:26:45.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.404+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=Q83HLM89GNLT type=del size=287273 2024-03-04T12:26:45.412 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.405+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=EM181OL6Y0ZA type=del 2024-03-04T12:26:45.413 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.406+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=U8WBIVDYC6PO type=del size=471974 2024-03-04T12:26:45.414 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.407+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=3A037S23IE91 type=del 2024-03-04T12:26:45.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.408+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=XXT3QLOFRS7C type=del size=1769249 2024-03-04T12:26:45.416 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.409+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~FE984AZPLKCC.0 size=339313 2024-03-04T12:26:45.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.411+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=FE984AZPLKCC tag=946651NY9ND2 type=write size=1387889 2024-03-04T12:26:45.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.413+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~7G2FAIW80KLQ.0 size=1048576 2024-03-04T12:26:45.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.414+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~7G2FAIW80KLQ.1 size=479492 2024-03-04T12:26:45.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.414+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=7G2FAIW80KLQ tag=133NA4F5U59Q type=write size=2576644 2024-03-04T12:26:45.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.415+0000 7fa4b3c3e780 1 < completed write operation key=4989OME3IAJF tag=Y0S50L3CEXIN type=write size=371700 2024-03-04T12:26:45.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.416+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=P1O5V3B5O1XA type=write size=920191 2024-03-04T12:26:45.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.418+0000 7fa4b3c3e780 1 < canceled operation key=VAIY4J3CYONH tag=AHYW31Q10Q6G type=del size=1384754 2024-03-04T12:26:45.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.420+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~HTGV281HEWYU.0 size=1048576 2024-03-04T12:26:45.427 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.421+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~HTGV281HEWYU.1 size=686936 2024-03-04T12:26:45.427 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.421+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=HTGV281HEWYU tag=C4HDUU7EZCSL type=write size=2784088 2024-03-04T12:26:45.428 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.422+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~L0QQNANC5PYL.0 size=521862 2024-03-04T12:26:45.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.424+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=L0QQNANC5PYL tag=5T4SV6TVT6W8 type=write size=1570438 2024-03-04T12:26:45.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.426+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~IUIK0963OAA2.0 size=1048576 2024-03-04T12:26:45.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.427+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~IUIK0963OAA2.1 size=615902 2024-03-04T12:26:45.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.427+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=IUIK0963OAA2 tag=YHK1QR8AYFA0 type=write size=2713054 2024-03-04T12:26:45.435 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.428+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~5Y0AIWXUL0PW.0 size=232249 2024-03-04T12:26:45.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.430+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=5Y0AIWXUL0PW tag=C3R3FJQ9GR1J type=write size=1280825 2024-03-04T12:26:45.438 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.431+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=LTDETKRZG12W type=write size=494229 2024-03-04T12:26:45.440 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.433+0000 7fa4b3c3e780 1 < completed write operation key=RHU0QO8HS5SC tag=B8B4YZJ2PL09 type=write size=392255 2024-03-04T12:26:45.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.435+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~G2850K2FVQOC.0 size=186664 2024-03-04T12:26:45.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.435+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=G2850K2FVQOC tag=IF9487WPYNB2 type=write size=1235240 2024-03-04T12:26:45.443 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.436+0000 7fa4b3c3e780 1 < canceled operation key=GMIPCGYZRJ5L tag=9Q49D2PJJD92 type=write size=629666 2024-03-04T12:26:45.444 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.437+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=ZSZW755FR2MZ type=del size=1023351 2024-03-04T12:26:45.445 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.438+0000 7fa4b3c3e780 1 < completed delete operation key=X0RVLNRWUAEM tag=3R0DW0JRZGTP type=del 2024-03-04T12:26:45.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.440+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~F74EA3N6ENXE.0 size=1048576 2024-03-04T12:26:45.448 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.441+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~F74EA3N6ENXE.1 size=892638 2024-03-04T12:26:45.448 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.441+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=F74EA3N6ENXE tag=C34TPK9YZAOA type=write size=2989790 2024-03-04T12:26:45.449 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.442+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~96DEX7889PX2.0 size=1048576 2024-03-04T12:26:45.450 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.443+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~96DEX7889PX2.1 size=1048576 2024-03-04T12:26:45.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.444+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~96DEX7889PX2.2 size=866172 2024-03-04T12:26:45.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.446+0000 7fa4b3c3e780 1 < completed multipart upload key=BVMWQ9ZL4K0C upload=96DEX7889PX2 tag=TB58KIPZUDX4 type=write size=4011900 2024-03-04T12:26:45.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.448+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~HUYQDNU8UAI6.0 size=834104 2024-03-04T12:26:45.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.448+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=HUYQDNU8UAI6 tag=W2042RDM4OO9 type=write size=1882680 2024-03-04T12:26:45.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.449+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~2ET4E705MFMN.0 size=1048576 2024-03-04T12:26:45.457 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.450+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~2ET4E705MFMN.1 size=213674 2024-03-04T12:26:45.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.452+0000 7fa4b3c3e780 1 < completed multipart upload key=J53J0N99N30A upload=2ET4E705MFMN tag=ZMPB4KOW1T3L type=write size=2310826 2024-03-04T12:26:45.460 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.453+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=H4GLRYYYS2VS type=write size=70219 2024-03-04T12:26:45.461 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.454+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=ENU0BB6CS32N type=del 2024-03-04T12:26:45.462 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.455+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=MWRNU7VDF6WX type=write size=231492 2024-03-04T12:26:45.463 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.456+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~9W0SGUBDW35E.0 size=146633 2024-03-04T12:26:45.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.458+0000 7fa4b3c3e780 1 < completed multipart upload key=G4SUQFVB936T upload=9W0SGUBDW35E tag=U67G5AW5TJSN type=write size=1195209 2024-03-04T12:26:45.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.459+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=7U81QTL2A585 type=del size=3285972 2024-03-04T12:26:45.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.460+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=CPOP8K7QWTOR type=del 2024-03-04T12:26:45.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.462+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~4TB56WXEMZ5T.0 size=688695 2024-03-04T12:26:45.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.462+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=4TB56WXEMZ5T tag=BRGV8R5JWXPJ type=write size=1737271 2024-03-04T12:26:45.470 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.463+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=Q83HLM89GNLT type=del 2024-03-04T12:26:45.471 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.465+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=LF5ALT1D9NU1 type=del size=526529 2024-03-04T12:26:45.472 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.466+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=U8WBIVDYC6PO type=del 2024-03-04T12:26:45.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.468+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~2CMYUT14SE8N.0 size=250965 2024-03-04T12:26:45.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.468+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=2CMYUT14SE8N tag=DJ48UWYAQNOZ type=write size=1299541 2024-03-04T12:26:45.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.470+0000 7fa4b3c3e780 1 < suggested remove operation key=6XK4DQ940Z5J tag=XXT3QLOFRS7C type=del 2024-03-04T12:26:45.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.471+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=Y1SA5V5XBN3R type=write size=214707 2024-03-04T12:26:45.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.472+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~7G2FAIW80KLQ.0 size=1048576 2024-03-04T12:26:45.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.472+0000 7fa4b3c3e780 1 < canceled part key=_multipart_T301TK0FIOG4.2~7G2FAIW80KLQ.1 size=479492 2024-03-04T12:26:45.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.474+0000 7fa4b3c3e780 1 < canceled multipart upload key=T301TK0FIOG4 upload=7G2FAIW80KLQ tag=133NA4F5U59Q type=write size=2576644 2024-03-04T12:26:45.483 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.476+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~SFKGXNJWCPG2.0 size=1048576 2024-03-04T12:26:45.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.477+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~SFKGXNJWCPG2.1 size=1048576 2024-03-04T12:26:45.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.478+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~SFKGXNJWCPG2.2 size=597606 2024-03-04T12:26:45.485 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.478+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=SFKGXNJWCPG2 tag=OD9KP538L9OY type=write size=3743334 2024-03-04T12:26:45.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.479+0000 7fa4b3c3e780 1 < completed write operation key=BR8RTE2QEH9E tag=P1O5V3B5O1XA type=write size=920191 2024-03-04T12:26:45.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.480+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=UHTZ1U8M8OPE type=del size=2086669 2024-03-04T12:26:45.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.481+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~HTGV281HEWYU.0 size=1048576 2024-03-04T12:26:45.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.482+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~HTGV281HEWYU.1 size=686936 2024-03-04T12:26:45.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.484+0000 7fa4b3c3e780 1 < completed multipart upload key=ESHAMQWMMBJR upload=HTGV281HEWYU tag=C4HDUU7EZCSL type=write size=2784088 2024-03-04T12:26:45.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.486+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~E29DD90O0Z88.0 size=1048576 2024-03-04T12:26:45.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.487+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~E29DD90O0Z88.1 size=889490 2024-03-04T12:26:45.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.487+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=E29DD90O0Z88 tag=O0CUW6OTEVY6 type=write size=2986642 2024-03-04T12:26:45.494 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.488+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~IUIK0963OAA2.0 size=1048576 2024-03-04T12:26:45.495 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.489+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~IUIK0963OAA2.1 size=615902 2024-03-04T12:26:45.497 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.491+0000 7fa4b3c3e780 1 < completed multipart upload key=43HMF7NWNMU3 upload=IUIK0963OAA2 tag=YHK1QR8AYFA0 type=write size=2713054 2024-03-04T12:26:45.498 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.492+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=THO2CC4E35P7 type=write size=801327 2024-03-04T12:26:45.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.493+0000 7fa4b3c3e780 1 < completed write operation key=ZETES4AYZQHY tag=LTDETKRZG12W type=write size=494229 2024-03-04T12:26:45.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.495+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~CFME78CBY1J1.0 size=675959 2024-03-04T12:26:45.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.495+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=CFME78CBY1J1 tag=3CQS0SR7S261 type=write size=1724535 2024-03-04T12:26:45.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.496+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~G2850K2FVQOC.0 size=186664 2024-03-04T12:26:45.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.498+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=G2850K2FVQOC tag=IF9487WPYNB2 type=write size=1235240 2024-03-04T12:26:45.507 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.500+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~G1NZ096LRCH9.0 size=1048576 2024-03-04T12:26:45.507 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.501+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~G1NZ096LRCH9.1 size=1048576 2024-03-04T12:26:45.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.502+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~G1NZ096LRCH9.2 size=955760 2024-03-04T12:26:45.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.502+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=G1NZ096LRCH9 tag=AAKBU28A2FPA type=write size=4101488 2024-03-04T12:26:45.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.503+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=ZSZW755FR2MZ type=del 2024-03-04T12:26:45.511 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.505+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~Q65A1NCDYJUD.0 size=1048576 2024-03-04T12:26:45.512 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.506+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~Q65A1NCDYJUD.1 size=36965 2024-03-04T12:26:45.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.506+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=Q65A1NCDYJUD tag=CA8TVNKJ25EK type=write size=2134117 2024-03-04T12:26:45.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.507+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~F74EA3N6ENXE.0 size=1048576 2024-03-04T12:26:45.515 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.508+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~F74EA3N6ENXE.1 size=892638 2024-03-04T12:26:45.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.510+0000 7fa4b3c3e780 1 < completed multipart upload key=YIS2SV4O5EZN upload=F74EA3N6ENXE tag=C34TPK9YZAOA type=write size=2989790 2024-03-04T12:26:45.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.511+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=28IWBI900DQ3 type=del size=1666412 2024-03-04T12:26:45.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.512+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~HUYQDNU8UAI6.0 size=834104 2024-03-04T12:26:45.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.514+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=HUYQDNU8UAI6 tag=W2042RDM4OO9 type=write size=1882680 2024-03-04T12:26:45.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.516+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~R324TVRCJXDM.0 size=1048576 2024-03-04T12:26:45.524 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.517+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~R324TVRCJXDM.1 size=722768 2024-03-04T12:26:45.524 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.517+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=R324TVRCJXDM tag=FXYR7IBFN1AO type=write size=2819920 2024-03-04T12:26:45.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.518+0000 7fa4b3c3e780 1 < completed write operation key=J53J0N99N30A tag=H4GLRYYYS2VS type=write size=70219 2024-03-04T12:26:45.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.519+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=XTMT4248EVAB type=write size=270774 2024-03-04T12:26:45.527 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.520+0000 7fa4b3c3e780 1 < completed write operation key=43HMF7NWNMU3 tag=MWRNU7VDF6WX type=write size=231492 2024-03-04T12:26:45.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.522+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~B4L8NPZYEV2W.0 size=1048576 2024-03-04T12:26:45.530 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.523+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~B4L8NPZYEV2W.1 size=1048576 2024-03-04T12:26:45.531 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.524+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~B4L8NPZYEV2W.2 size=808127 2024-03-04T12:26:45.531 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.524+0000 7fa4b3c3e780 1 > prepared multipart upload key=4LKTYP07OL5L upload=B4L8NPZYEV2W tag=FAVX5FCBYUEP type=write size=3953855 2024-03-04T12:26:45.532 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.525+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=7U81QTL2A585 type=del 2024-03-04T12:26:45.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.527+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=V3EICOAUGKGV type=del size=912417 2024-03-04T12:26:45.534 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.527+0000 7fa4b3c3e780 1 < canceled part key=_multipart_GMIPCGYZRJ5L.2~4TB56WXEMZ5T.0 size=688695 2024-03-04T12:26:45.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.529+0000 7fa4b3c3e780 1 < canceled multipart upload key=GMIPCGYZRJ5L upload=4TB56WXEMZ5T tag=BRGV8R5JWXPJ type=write size=1737271 2024-03-04T12:26:45.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.530+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=3GJOPKW8WZW7 type=del size=2898694 2024-03-04T12:26:45.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.531+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=LF5ALT1D9NU1 type=del 2024-03-04T12:26:45.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.532+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=TIVWC85WW9RA type=del size=4170923 2024-03-04T12:26:45.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.533+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~2CMYUT14SE8N.0 size=250965 2024-03-04T12:26:45.542 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.536+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=2CMYUT14SE8N tag=DJ48UWYAQNOZ type=write size=1299541 2024-03-04T12:26:45.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.537+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=T4J2SNED6KGH type=write size=498039 2024-03-04T12:26:45.545 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.538+0000 7fa4b3c3e780 1 < completed write operation key=43HMF7NWNMU3 tag=Y1SA5V5XBN3R type=write size=214707 2024-03-04T12:26:45.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.541+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~GKIA9R48BVB2.0 size=1048576 2024-03-04T12:26:45.548 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.541+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~GKIA9R48BVB2.1 size=1048576 2024-03-04T12:26:45.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.542+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~GKIA9R48BVB2.2 size=116201 2024-03-04T12:26:45.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.542+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=GKIA9R48BVB2 tag=2DKTUJC8UB2X type=write size=3261929 2024-03-04T12:26:45.550 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.544+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~SFKGXNJWCPG2.0 size=1048576 2024-03-04T12:26:45.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.545+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~SFKGXNJWCPG2.1 size=1048576 2024-03-04T12:26:45.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.545+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~SFKGXNJWCPG2.2 size=597606 2024-03-04T12:26:45.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.547+0000 7fa4b3c3e780 1 < completed multipart upload key=V7N7MZ1GUNEV upload=SFKGXNJWCPG2 tag=OD9KP538L9OY type=write size=3743334 2024-03-04T12:26:45.556 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.549+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~5MU2Y1NKECHG.0 size=1048576 2024-03-04T12:26:45.557 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.550+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~5MU2Y1NKECHG.1 size=385873 2024-03-04T12:26:45.557 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.550+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=5MU2Y1NKECHG tag=MMZQ796T9943 type=write size=2483025 2024-03-04T12:26:45.559 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.552+0000 7fa4b3c3e780 1 < suggested remove operation key=YQLH0WW7I7MW tag=UHTZ1U8M8OPE type=del 2024-03-04T12:26:45.560 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.553+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=JSW924WGD4HO type=del size=31605 2024-03-04T12:26:45.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.555+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~E29DD90O0Z88.0 size=1048576 2024-03-04T12:26:45.563 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.556+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~E29DD90O0Z88.1 size=889490 2024-03-04T12:26:45.565 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.558+0000 7fa4b3c3e780 1 < completed multipart upload key=3N6E09QF3866 upload=E29DD90O0Z88 tag=O0CUW6OTEVY6 type=write size=2986642 2024-03-04T12:26:45.566 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.559+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=IS4J3Y3GEKGY type=del size=3822945 2024-03-04T12:26:45.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.561+0000 7fa4b3c3e780 1 < canceled operation key=BR8RTE2QEH9E tag=THO2CC4E35P7 type=write size=801327 2024-03-04T12:26:45.569 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.562+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=41AEB77MA8JH type=del size=1621847 2024-03-04T12:26:45.570 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.563+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~CFME78CBY1J1.0 size=675959 2024-03-04T12:26:45.572 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.565+0000 7fa4b3c3e780 1 < completed multipart upload key=J53J0N99N30A upload=CFME78CBY1J1 tag=3CQS0SR7S261 type=write size=1724535 2024-03-04T12:26:45.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.567+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~584OU7DWN6VT.0 size=1048576 2024-03-04T12:26:45.574 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.568+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~584OU7DWN6VT.1 size=1048576 2024-03-04T12:26:45.575 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.569+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~584OU7DWN6VT.2 size=831001 2024-03-04T12:26:45.575 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.569+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=584OU7DWN6VT tag=D8VBC9JDCWOR type=write size=3976729 2024-03-04T12:26:45.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.569+0000 7fa4b3c3e780 1 < canceled part key=_multipart_GMIPCGYZRJ5L.2~G1NZ096LRCH9.0 size=1048576 2024-03-04T12:26:45.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.569+0000 7fa4b3c3e780 1 < canceled part key=_multipart_GMIPCGYZRJ5L.2~G1NZ096LRCH9.1 size=1048576 2024-03-04T12:26:45.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.570+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~G1NZ096LRCH9.2 size=955760 2024-03-04T12:26:45.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.571+0000 7fa4b3c3e780 1 < canceled multipart upload key=GMIPCGYZRJ5L upload=G1NZ096LRCH9 tag=AAKBU28A2FPA type=write size=4101488 2024-03-04T12:26:45.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.573+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~8I3IZSVFSYCC.0 size=1048576 2024-03-04T12:26:45.581 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.574+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~8I3IZSVFSYCC.1 size=29266 2024-03-04T12:26:45.581 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.574+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=8I3IZSVFSYCC tag=JLCQZV6VQ24M type=write size=2126418 2024-03-04T12:26:45.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.575+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~Q65A1NCDYJUD.0 size=1048576 2024-03-04T12:26:45.583 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.576+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~Q65A1NCDYJUD.1 size=36965 2024-03-04T12:26:45.585 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.578+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=Q65A1NCDYJUD tag=CA8TVNKJ25EK type=write size=2134117 2024-03-04T12:26:45.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.580+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~Q9QXM0QGQB78.0 size=1048576 2024-03-04T12:26:45.587 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.581+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~Q9QXM0QGQB78.1 size=89046 2024-03-04T12:26:45.587 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.581+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=Q9QXM0QGQB78 tag=JK62GIYXY4ER type=write size=2186198 2024-03-04T12:26:45.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.583+0000 7fa4b3c3e780 1 < suggested remove operation key=WRHB3XWDLSY2 tag=28IWBI900DQ3 type=del 2024-03-04T12:26:45.591 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.584+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=QM1UKSWG3BR4 type=del size=3424095 2024-03-04T12:26:45.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.585+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~R324TVRCJXDM.0 size=1048576 2024-03-04T12:26:45.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.586+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~R324TVRCJXDM.1 size=722768 2024-03-04T12:26:45.594 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.588+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=R324TVRCJXDM tag=FXYR7IBFN1AO type=write size=2819920 2024-03-04T12:26:45.595 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.589+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=95BZ94Y0BV5S type=write size=156719 2024-03-04T12:26:45.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.590+0000 7fa4b3c3e780 1 < completed write operation key=43HMF7NWNMU3 tag=XTMT4248EVAB type=write size=270774 2024-03-04T12:26:45.598 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.591+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=3D5IF98N3NO8 type=del size=1692135 2024-03-04T12:26:45.599 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.592+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~B4L8NPZYEV2W.0 size=1048576 2024-03-04T12:26:45.600 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.593+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~B4L8NPZYEV2W.1 size=1048576 2024-03-04T12:26:45.600 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.593+0000 7fa4b3c3e780 1 < canceled part key=_multipart_4LKTYP07OL5L.2~B4L8NPZYEV2W.2 size=808127 2024-03-04T12:26:45.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.595+0000 7fa4b3c3e780 1 < canceled multipart upload key=4LKTYP07OL5L upload=B4L8NPZYEV2W tag=FAVX5FCBYUEP type=write size=3953855 2024-03-04T12:26:45.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.596+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=LAIL0TAAMZOP type=del size=4004185 2024-03-04T12:26:45.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.597+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=V3EICOAUGKGV type=del 2024-03-04T12:26:45.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.598+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=L6KWHIQYRL6J type=del size=1150538 2024-03-04T12:26:45.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.599+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=3GJOPKW8WZW7 type=del 2024-03-04T12:26:45.607 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.600+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=QPONQ3IRM1BA type=del size=716257 2024-03-04T12:26:45.608 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.602+0000 7fa4b3c3e780 1 < completed delete operation key=RHU0QO8HS5SC tag=TIVWC85WW9RA type=del 2024-03-04T12:26:45.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.603+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=7VD6E00LC0EC type=write size=1045889 2024-03-04T12:26:45.610 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.604+0000 7fa4b3c3e780 1 < completed write operation key=T301TK0FIOG4 tag=T4J2SNED6KGH type=write size=498039 2024-03-04T12:26:45.611 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.605+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=0ZDB8W02BTKQ type=del size=3896498 2024-03-04T12:26:45.613 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.606+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~GKIA9R48BVB2.0 size=1048576 2024-03-04T12:26:45.613 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.607+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~GKIA9R48BVB2.1 size=1048576 2024-03-04T12:26:45.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.607+0000 7fa4b3c3e780 1 < canceled part key=_multipart_6XK4DQ940Z5J.2~GKIA9R48BVB2.2 size=116201 2024-03-04T12:26:45.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.609+0000 7fa4b3c3e780 1 < canceled multipart upload key=6XK4DQ940Z5J upload=GKIA9R48BVB2 tag=2DKTUJC8UB2X type=write size=3261929 2024-03-04T12:26:45.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.611+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=30E6ZIHT1Q3I type=del size=2984600 2024-03-04T12:26:45.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.612+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~5MU2Y1NKECHG.0 size=1048576 2024-03-04T12:26:45.620 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.613+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~5MU2Y1NKECHG.1 size=385873 2024-03-04T12:26:45.622 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.615+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=5MU2Y1NKECHG tag=MMZQ796T9943 type=write size=2483025 2024-03-04T12:26:45.623 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.616+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=7BJSUSLEW2OU type=del size=1033700 2024-03-04T12:26:45.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.617+0000 7fa4b3c3e780 1 < canceled operation key=NVMIU38VM9Q1 tag=JSW924WGD4HO type=del size=31605 2024-03-04T12:26:45.625 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.618+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=FZIYZWM4XRGS type=del size=2379574 2024-03-04T12:26:45.626 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.619+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=IS4J3Y3GEKGY type=del 2024-03-04T12:26:45.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.621+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=T7O1SXXS3WKJ type=del size=349580 2024-03-04T12:26:45.628 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.622+0000 7fa4b3c3e780 1 < canceled operation key=RHU0QO8HS5SC tag=41AEB77MA8JH type=del size=1621847 2024-03-04T12:26:45.630 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.623+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=26SVL5GGQXCR type=write size=733299 2024-03-04T12:26:45.631 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.624+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~584OU7DWN6VT.0 size=1048576 2024-03-04T12:26:45.632 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.625+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~584OU7DWN6VT.1 size=1048576 2024-03-04T12:26:45.633 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.626+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~584OU7DWN6VT.2 size=831001 2024-03-04T12:26:45.635 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.628+0000 7fa4b3c3e780 1 < completed multipart upload key=BVMWQ9ZL4K0C upload=584OU7DWN6VT tag=D8VBC9JDCWOR type=write size=3976729 2024-03-04T12:26:45.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.629+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=DHF51YE332AF type=del size=552043 2024-03-04T12:26:45.637 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.630+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~8I3IZSVFSYCC.0 size=1048576 2024-03-04T12:26:45.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.631+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~8I3IZSVFSYCC.1 size=29266 2024-03-04T12:26:45.640 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.633+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=8I3IZSVFSYCC tag=JLCQZV6VQ24M type=write size=2126418 2024-03-04T12:26:45.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.634+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=X3X0E48K58OM type=del size=1933400 2024-03-04T12:26:45.642 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.635+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~Q9QXM0QGQB78.0 size=1048576 2024-03-04T12:26:45.643 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.636+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~Q9QXM0QGQB78.1 size=89046 2024-03-04T12:26:45.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.638+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=Q9QXM0QGQB78 tag=JK62GIYXY4ER type=write size=2186198 2024-03-04T12:26:45.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.640+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=WW5ZAFZ931CI type=del size=4030938 2024-03-04T12:26:45.648 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.642+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=QM1UKSWG3BR4 type=del 2024-03-04T12:26:45.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.644+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~6SGHMML5AZWK.0 size=821482 2024-03-04T12:26:45.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.644+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=6SGHMML5AZWK tag=WILLTK37G2LZ type=write size=1870058 2024-03-04T12:26:45.652 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.645+0000 7fa4b3c3e780 1 < completed write operation key=J53J0N99N30A tag=95BZ94Y0BV5S type=write size=156719 2024-03-04T12:26:45.653 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.646+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=RY8G6P6WAW86 type=del size=1977455 2024-03-04T12:26:45.654 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.647+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=3D5IF98N3NO8 type=del 2024-03-04T12:26:45.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.648+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=MZKSJ0FXADYU type=del size=2063195 2024-03-04T12:26:45.657 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.651+0000 7fa4b3c3e780 1 < suggested remove operation key=43HMF7NWNMU3 tag=LAIL0TAAMZOP type=del 2024-03-04T12:26:45.658 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.652+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=XSMS1GTCMDPB type=write size=1012168 2024-03-04T12:26:45.660 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.653+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=L6KWHIQYRL6J type=del 2024-03-04T12:26:45.662 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.655+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~91T05IBJSBCD.0 size=594177 2024-03-04T12:26:45.662 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.655+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=91T05IBJSBCD tag=UD1KW62JTHRF type=write size=1642753 2024-03-04T12:26:45.663 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.656+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=QPONQ3IRM1BA type=del 2024-03-04T12:26:45.664 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.657+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=Q9BTJRCOKP6K type=del size=966781 2024-03-04T12:26:45.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.658+0000 7fa4b3c3e780 1 < completed write operation key=VAIY4J3CYONH tag=7VD6E00LC0EC type=write size=1045889 2024-03-04T12:26:45.666 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.659+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=Q7DNA6H2CWX4 type=del size=2029413 2024-03-04T12:26:45.668 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.661+0000 7fa4b3c3e780 1 < suggested update operation key=G8G76PMSKJ0I tag=0ZDB8W02BTKQ type=del size=3896498 2024-03-04T12:26:45.669 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.662+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=5PRY54UA0WG5 type=del size=949242 2024-03-04T12:26:45.671 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.665+0000 7fa4b3c3e780 1 < suggested remove operation key=ZETES4AYZQHY tag=30E6ZIHT1Q3I type=del 2024-03-04T12:26:45.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.666+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~48LQZKQ1UWCH.0 size=1048576 2024-03-04T12:26:45.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.667+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~48LQZKQ1UWCH.1 size=809651 2024-03-04T12:26:45.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.667+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=48LQZKQ1UWCH tag=F0365PV5KMUB type=write size=2906803 2024-03-04T12:26:45.676 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.670+0000 7fa4b3c3e780 1 < suggested update operation key=3N6E09QF3866 tag=7BJSUSLEW2OU type=del size=1033700 2024-03-04T12:26:45.678 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.671+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~C0HS9Z9KOFYX.0 size=483087 2024-03-04T12:26:45.678 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.671+0000 7fa4b3c3e780 1 > prepared multipart upload key=G4SUQFVB936T upload=C0HS9Z9KOFYX tag=JJTM5DQ8G4A3 type=write size=1531663 2024-03-04T12:26:45.679 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.673+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=FZIYZWM4XRGS type=del 2024-03-04T12:26:45.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.675+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~3YMVAMPH4L6P.0 size=1048576 2024-03-04T12:26:45.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.676+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~3YMVAMPH4L6P.1 size=230048 2024-03-04T12:26:45.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.676+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=3YMVAMPH4L6P tag=P5O0J4R2R0YP type=write size=2327200 2024-03-04T12:26:45.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.678+0000 7fa4b3c3e780 1 < suggested update operation key=3N6E09QF3866 tag=T7O1SXXS3WKJ type=del size=349580 2024-03-04T12:26:45.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.680+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~Q010VCRN1162.0 size=1048576 2024-03-04T12:26:45.688 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.681+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~Q010VCRN1162.1 size=876369 2024-03-04T12:26:45.688 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.681+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=Q010VCRN1162 tag=W2RBDU3XWP85 type=write size=2973521 2024-03-04T12:26:45.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.682+0000 7fa4b3c3e780 1 < completed write operation key=NVMIU38VM9Q1 tag=26SVL5GGQXCR type=write size=733299 2024-03-04T12:26:45.691 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.684+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~MPYNSRRH7224.0 size=1048576 2024-03-04T12:26:45.692 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.685+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~MPYNSRRH7224.1 size=1048576 2024-03-04T12:26:45.693 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.686+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~MPYNSRRH7224.2 size=1008315 2024-03-04T12:26:45.693 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.686+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=MPYNSRRH7224 tag=CINKUG0UYEHH type=write size=4154043 2024-03-04T12:26:45.695 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.688+0000 7fa4b3c3e780 1 < suggested update operation key=GMIPCGYZRJ5L tag=DHF51YE332AF type=del size=552043 2024-03-04T12:26:45.696 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.689+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=VO106NFWQUOL type=del size=3280562 2024-03-04T12:26:45.697 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.691+0000 7fa4b3c3e780 1 < completed delete operation key=R6Y09EO6HGF0 tag=X3X0E48K58OM type=del 2024-03-04T12:26:45.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.692+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=1ZMK6QIHKV66 type=del size=2603109 2024-03-04T12:26:45.700 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.693+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=WW5ZAFZ931CI type=del 2024-03-04T12:26:45.701 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.694+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=WILXOZ5GYNCY type=write size=756968 2024-03-04T12:26:45.702 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.695+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~6SGHMML5AZWK.0 size=821482 2024-03-04T12:26:45.704 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.698+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=6SGHMML5AZWK tag=WILLTK37G2LZ type=write size=1870058 2024-03-04T12:26:45.706 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.699+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=ECGROU34BIG4 type=del size=1820838 2024-03-04T12:26:45.707 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.700+0000 7fa4b3c3e780 1 < canceled operation key=VAIY4J3CYONH tag=RY8G6P6WAW86 type=del size=1977455 2024-03-04T12:26:45.708 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.702+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=UABAKLMOAIY5 type=del size=252516 2024-03-04T12:26:45.710 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.703+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=MZKSJ0FXADYU type=del 2024-03-04T12:26:45.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.704+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=R82KZ12TZOLY type=del size=1327836 2024-03-04T12:26:45.712 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.705+0000 7fa4b3c3e780 1 < completed write operation key=4989OME3IAJF tag=XSMS1GTCMDPB type=write size=1012168 2024-03-04T12:26:45.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.706+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=FQ76977OO29K type=write size=917275 2024-03-04T12:26:45.714 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.707+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~91T05IBJSBCD.0 size=594177 2024-03-04T12:26:45.716 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.709+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=91T05IBJSBCD tag=UD1KW62JTHRF type=write size=1642753 2024-03-04T12:26:45.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.711+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~YEQV1KZLC6OV.0 size=547884 2024-03-04T12:26:45.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.711+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=YEQV1KZLC6OV tag=QBBXC9Q4QY4N type=write size=1596460 2024-03-04T12:26:45.719 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.712+0000 7fa4b3c3e780 1 < completed delete operation key=RHU0QO8HS5SC tag=Q9BTJRCOKP6K type=del 2024-03-04T12:26:45.721 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.714+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~U8KX2SGXA3TQ.0 size=1048576 2024-03-04T12:26:45.722 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.715+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~U8KX2SGXA3TQ.1 size=919434 2024-03-04T12:26:45.722 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.715+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=U8KX2SGXA3TQ tag=WFHXG6R14SUP type=write size=3016586 2024-03-04T12:26:45.724 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.717+0000 7fa4b3c3e780 1 < suggested update operation key=YIS2SV4O5EZN tag=Q7DNA6H2CWX4 type=del size=2029413 2024-03-04T12:26:45.726 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.719+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~DMF2UPU0T3VE.0 size=1048576 2024-03-04T12:26:45.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.720+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~DMF2UPU0T3VE.1 size=472414 2024-03-04T12:26:45.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.720+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=DMF2UPU0T3VE tag=IMOJVABRWVLI type=write size=2569566 2024-03-04T12:26:45.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.721+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=5PRY54UA0WG5 type=del 2024-03-04T12:26:45.729 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.723+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=E5R36DMH32WW type=del size=668129 2024-03-04T12:26:45.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.723+0000 7fa4b3c3e780 1 < canceled part key=_multipart_RHU0QO8HS5SC.2~48LQZKQ1UWCH.0 size=1048576 2024-03-04T12:26:45.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.724+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~48LQZKQ1UWCH.1 size=809651 2024-03-04T12:26:45.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.726+0000 7fa4b3c3e780 1 < canceled multipart upload key=RHU0QO8HS5SC upload=48LQZKQ1UWCH tag=F0365PV5KMUB type=write size=2906803 2024-03-04T12:26:45.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.727+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=0GHGT86D7Q5A type=del size=3811363 2024-03-04T12:26:45.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.728+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~C0HS9Z9KOFYX.0 size=483087 2024-03-04T12:26:45.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.730+0000 7fa4b3c3e780 1 < completed multipart upload key=G4SUQFVB936T upload=C0HS9Z9KOFYX tag=JJTM5DQ8G4A3 type=write size=1531663 2024-03-04T12:26:45.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.731+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=JN2K6HWRRJS4 type=del size=1680988 2024-03-04T12:26:45.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.732+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~3YMVAMPH4L6P.0 size=1048576 2024-03-04T12:26:45.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.733+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~3YMVAMPH4L6P.1 size=230048 2024-03-04T12:26:45.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.735+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=3YMVAMPH4L6P tag=P5O0J4R2R0YP type=write size=2327200 2024-03-04T12:26:45.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.736+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=M03Z41I6JI1M type=del size=2978361 2024-03-04T12:26:45.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.738+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~Q010VCRN1162.0 size=1048576 2024-03-04T12:26:45.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.739+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~Q010VCRN1162.1 size=876369 2024-03-04T12:26:45.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.741+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=Q010VCRN1162 tag=W2RBDU3XWP85 type=write size=2973521 2024-03-04T12:26:45.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.742+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=N3U456NBVHWB type=del size=2297717 2024-03-04T12:26:45.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.743+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~MPYNSRRH7224.0 size=1048576 2024-03-04T12:26:45.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.744+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~MPYNSRRH7224.1 size=1048576 2024-03-04T12:26:45.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.745+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~MPYNSRRH7224.2 size=1008315 2024-03-04T12:26:45.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.747+0000 7fa4b3c3e780 1 < completed multipart upload key=ESHAMQWMMBJR upload=MPYNSRRH7224 tag=CINKUG0UYEHH type=write size=4154043 2024-03-04T12:26:45.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.750+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~XUJZ0SMYX0XP.0 size=508072 2024-03-04T12:26:45.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.750+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=XUJZ0SMYX0XP tag=ZYJ9RYHO82SX type=write size=1556648 2024-03-04T12:26:45.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.752+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=VO106NFWQUOL type=del 2024-03-04T12:26:45.759 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.753+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=KMPQ5UFGMZQS type=del size=1294264 2024-03-04T12:26:45.762 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.755+0000 7fa4b3c3e780 1 < suggested update operation key=YIS2SV4O5EZN tag=1ZMK6QIHKV66 type=del size=2603109 2024-03-04T12:26:45.764 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.757+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~Z4C45QFW2IYR.0 size=1048576 2024-03-04T12:26:45.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.758+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~Z4C45QFW2IYR.1 size=1048576 2024-03-04T12:26:45.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.759+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~Z4C45QFW2IYR.2 size=458824 2024-03-04T12:26:45.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.759+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=Z4C45QFW2IYR tag=QJDH22UX624R type=write size=3604552 2024-03-04T12:26:45.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.760+0000 7fa4b3c3e780 1 < completed write operation key=G4SUQFVB936T tag=WILXOZ5GYNCY type=write size=756968 2024-03-04T12:26:45.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.761+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=IHMTWP3RTI8H type=write size=590014 2024-03-04T12:26:45.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.762+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=ECGROU34BIG4 type=del 2024-03-04T12:26:45.770 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.764+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=D8ACY9ZZIF2V type=del size=3493096 2024-03-04T12:26:45.771 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.765+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=UABAKLMOAIY5 type=del 2024-03-04T12:26:45.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.767+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~1AT51KE4TK8A.0 size=28890 2024-03-04T12:26:45.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.767+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=1AT51KE4TK8A tag=EVW03XPIOXPR type=write size=1077466 2024-03-04T12:26:45.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.768+0000 7fa4b3c3e780 1 < canceled operation key=WRHB3XWDLSY2 tag=R82KZ12TZOLY type=del size=1327836 2024-03-04T12:26:45.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.769+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=QZOLQKMR5UHH type=write size=969142 2024-03-04T12:26:45.777 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.770+0000 7fa4b3c3e780 1 < completed write operation key=43HMF7NWNMU3 tag=FQ76977OO29K type=write size=917275 2024-03-04T12:26:45.778 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.771+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=KEZTC2LPH4A4 type=del size=10611 2024-03-04T12:26:45.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.772+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~YEQV1KZLC6OV.0 size=547884 2024-03-04T12:26:45.781 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.774+0000 7fa4b3c3e780 1 < completed multipart upload key=V7N7MZ1GUNEV upload=YEQV1KZLC6OV tag=QBBXC9Q4QY4N type=write size=1596460 2024-03-04T12:26:45.782 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.775+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=3FIG7SBUAVSW type=del size=3821396 2024-03-04T12:26:45.783 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.776+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~U8KX2SGXA3TQ.0 size=1048576 2024-03-04T12:26:45.784 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.777+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~U8KX2SGXA3TQ.1 size=919434 2024-03-04T12:26:45.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.779+0000 7fa4b3c3e780 1 < completed multipart upload key=4989OME3IAJF upload=U8KX2SGXA3TQ tag=WFHXG6R14SUP type=write size=3016586 2024-03-04T12:26:45.787 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.780+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=GD0GLW5CFMJ0 type=del size=904699 2024-03-04T12:26:45.788 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.782+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~DMF2UPU0T3VE.0 size=1048576 2024-03-04T12:26:45.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.783+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~DMF2UPU0T3VE.1 size=472414 2024-03-04T12:26:45.791 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.785+0000 7fa4b3c3e780 1 < completed multipart upload key=YIS2SV4O5EZN upload=DMF2UPU0T3VE tag=IMOJVABRWVLI type=write size=2569566 2024-03-04T12:26:45.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.787+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~VJMSB1F0Y8NE.0 size=1048576 2024-03-04T12:26:45.794 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.788+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~VJMSB1F0Y8NE.1 size=1048576 2024-03-04T12:26:45.795 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.789+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~VJMSB1F0Y8NE.2 size=910291 2024-03-04T12:26:45.795 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.789+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=VJMSB1F0Y8NE tag=QT8HAA9P1OF4 type=write size=4056019 2024-03-04T12:26:45.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.791+0000 7fa4b3c3e780 1 < suggested update operation key=6XK4DQ940Z5J tag=E5R36DMH32WW type=del size=668129 2024-03-04T12:26:45.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.792+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=NI5J7P9GE81P type=del size=12209 2024-03-04T12:26:45.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.793+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=0GHGT86D7Q5A type=del 2024-03-04T12:26:45.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.794+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=TNQNLIVF435S type=write size=973126 2024-03-04T12:26:45.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.795+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=JN2K6HWRRJS4 type=del 2024-03-04T12:26:45.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.797+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~VNFA4OQG1BUA.0 size=1048576 2024-03-04T12:26:45.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.798+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~VNFA4OQG1BUA.1 size=1048576 2024-03-04T12:26:45.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.799+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~VNFA4OQG1BUA.2 size=491674 2024-03-04T12:26:45.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.799+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=VNFA4OQG1BUA tag=A0LG3EP6BCZM type=write size=3637402 2024-03-04T12:26:45.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.800+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=M03Z41I6JI1M type=del 2024-03-04T12:26:45.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.801+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=ETBQ7CTKEC6Z type=write size=257984 2024-03-04T12:26:45.809 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.802+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=N3U456NBVHWB type=del 2024-03-04T12:26:45.810 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.803+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=TJXZPMIIX80R type=del size=4026119 2024-03-04T12:26:45.811 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.804+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~XUJZ0SMYX0XP.0 size=508072 2024-03-04T12:26:45.813 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.806+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=XUJZ0SMYX0XP tag=ZYJ9RYHO82SX type=write size=1556648 2024-03-04T12:26:45.814 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.807+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=6C05ZF1PK2MP type=del size=434960 2024-03-04T12:26:45.815 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.808+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=KMPQ5UFGMZQS type=del 2024-03-04T12:26:45.816 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.810+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=VL3R1XGG9JE2 type=del size=815897 2024-03-04T12:26:45.818 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.811+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~Z4C45QFW2IYR.0 size=1048576 2024-03-04T12:26:45.818 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.812+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~Z4C45QFW2IYR.1 size=1048576 2024-03-04T12:26:45.819 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.813+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~Z4C45QFW2IYR.2 size=458824 2024-03-04T12:26:45.821 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.814+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=Z4C45QFW2IYR tag=QJDH22UX624R type=write size=3604552 2024-03-04T12:26:45.823 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.816+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~DPEN2UEN2RGA.0 size=866042 2024-03-04T12:26:45.823 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.816+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=DPEN2UEN2RGA tag=FMP1YUJECLSL type=write size=1914618 2024-03-04T12:26:45.824 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.818+0000 7fa4b3c3e780 1 < canceled operation key=3N6E09QF3866 tag=IHMTWP3RTI8H type=write size=590014 2024-03-04T12:26:45.826 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.820+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~TSPXAQHAH7WU.0 size=1048576 2024-03-04T12:26:45.827 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.821+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~TSPXAQHAH7WU.1 size=635772 2024-03-04T12:26:45.827 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.821+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=TSPXAQHAH7WU tag=T80MOQNCDQRM type=write size=2732924 2024-03-04T12:26:45.828 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.822+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=D8ACY9ZZIF2V type=del 2024-03-04T12:26:45.830 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.823+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=295F6Y4ZBXGL type=del size=1007305 2024-03-04T12:26:45.831 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.824+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~1AT51KE4TK8A.0 size=28890 2024-03-04T12:26:45.833 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.826+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=1AT51KE4TK8A tag=EVW03XPIOXPR type=write size=1077466 2024-03-04T12:26:45.834 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.827+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=X166OVYMIGDA type=del size=2056729 2024-03-04T12:26:45.835 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.828+0000 7fa4b3c3e780 1 < completed write operation key=GMIPCGYZRJ5L tag=QZOLQKMR5UHH type=write size=969142 2024-03-04T12:26:45.837 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.830+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~ARB7GIG625KL.0 size=1048576 2024-03-04T12:26:45.837 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.831+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~ARB7GIG625KL.1 size=1048576 2024-03-04T12:26:45.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.832+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~ARB7GIG625KL.2 size=398226 2024-03-04T12:26:45.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.832+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=ARB7GIG625KL tag=Y0BMCX25DKXG type=write size=3543954 2024-03-04T12:26:45.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.834+0000 7fa4b3c3e780 1 < suggested remove operation key=YWJV4QMY6ZBI tag=KEZTC2LPH4A4 type=del 2024-03-04T12:26:45.843 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.836+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~LBIWUFSEJ1S4.0 size=368773 2024-03-04T12:26:45.843 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.836+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=LBIWUFSEJ1S4 tag=XSP10O2YJQZ2 type=write size=1417349 2024-03-04T12:26:45.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.837+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=3FIG7SBUAVSW type=del 2024-03-04T12:26:45.846 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.839+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~L1RAN265WSWN.0 size=1048576 2024-03-04T12:26:45.847 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.840+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~L1RAN265WSWN.1 size=1036735 2024-03-04T12:26:45.847 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.840+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=L1RAN265WSWN tag=A2EF2O1ROSNS type=write size=3133887 2024-03-04T12:26:45.849 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.842+0000 7fa4b3c3e780 1 < suggested remove operation key=YQLH0WW7I7MW tag=GD0GLW5CFMJ0 type=del 2024-03-04T12:26:45.850 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.843+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=E2XISSGERUKY type=del size=4120070 2024-03-04T12:26:45.851 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.844+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~VJMSB1F0Y8NE.0 size=1048576 2024-03-04T12:26:45.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.845+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~VJMSB1F0Y8NE.1 size=1048576 2024-03-04T12:26:45.853 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.846+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~VJMSB1F0Y8NE.2 size=910291 2024-03-04T12:26:45.855 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.848+0000 7fa4b3c3e780 1 < completed multipart upload key=V7N7MZ1GUNEV upload=VJMSB1F0Y8NE tag=QT8HAA9P1OF4 type=write size=4056019 2024-03-04T12:26:45.857 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.850+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~6CFPN5S3FXTV.0 size=1048576 2024-03-04T12:26:45.858 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.851+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~6CFPN5S3FXTV.1 size=497183 2024-03-04T12:26:45.858 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.851+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=6CFPN5S3FXTV tag=J2M8ID5G471P type=write size=2594335 2024-03-04T12:26:45.859 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.852+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=NI5J7P9GE81P type=del 2024-03-04T12:26:45.860 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.853+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=DL1NJBD15FON type=del size=2582435 2024-03-04T12:26:45.862 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.855+0000 7fa4b3c3e780 1 < completed write operation key=T301TK0FIOG4 tag=TNQNLIVF435S type=write size=973126 2024-03-04T12:26:45.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.857+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=Z74F9ISNU7SX type=del size=681947 2024-03-04T12:26:45.865 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.858+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~VNFA4OQG1BUA.0 size=1048576 2024-03-04T12:26:45.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.859+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~VNFA4OQG1BUA.1 size=1048576 2024-03-04T12:26:45.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.860+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~VNFA4OQG1BUA.2 size=491674 2024-03-04T12:26:45.868 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.862+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=VNFA4OQG1BUA tag=A0LG3EP6BCZM type=write size=3637402 2024-03-04T12:26:45.869 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.863+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=69NGZEVN9SZL type=del size=1196289 2024-03-04T12:26:45.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.865+0000 7fa4b3c3e780 1 < suggested remove operation key=GMIPCGYZRJ5L tag=ETBQ7CTKEC6Z type=write 2024-03-04T12:26:45.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.866+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=J7ME15R7VC67 type=del size=1178985 2024-03-04T12:26:45.874 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.867+0000 7fa4b3c3e780 1 < canceled operation key=T301TK0FIOG4 tag=TJXZPMIIX80R type=del size=4026119 2024-03-04T12:26:45.876 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.870+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~TY05DTIEXFIT.0 size=1048576 2024-03-04T12:26:45.877 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.870+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~TY05DTIEXFIT.1 size=467191 2024-03-04T12:26:45.877 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.870+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=TY05DTIEXFIT tag=B6FFODJ01J9O type=write size=2564343 2024-03-04T12:26:45.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.872+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=6C05ZF1PK2MP type=del 2024-03-04T12:26:45.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.873+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=TAVSQ9XSUVIE type=del size=3136456 2024-03-04T12:26:45.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.874+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=VL3R1XGG9JE2 type=del 2024-03-04T12:26:45.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.876+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~JD6UAJHEH1C9.0 size=1048576 2024-03-04T12:26:45.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.877+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~JD6UAJHEH1C9.1 size=1048576 2024-03-04T12:26:45.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.878+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~JD6UAJHEH1C9.2 size=425681 2024-03-04T12:26:45.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.878+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=JD6UAJHEH1C9 tag=WUPWMP5XFY1F type=write size=3571409 2024-03-04T12:26:45.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.878+0000 7fa4b3c3e780 1 < canceled part key=_multipart_H5FWRNK8F7QT.2~DPEN2UEN2RGA.0 size=866042 2024-03-04T12:26:45.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.880+0000 7fa4b3c3e780 1 < canceled multipart upload key=H5FWRNK8F7QT upload=DPEN2UEN2RGA tag=FMP1YUJECLSL type=write size=1914618 2024-03-04T12:26:45.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.882+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~61IR0RC32QAS.0 size=1048576 2024-03-04T12:26:45.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.883+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~61IR0RC32QAS.1 size=1048576 2024-03-04T12:26:45.891 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.884+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~61IR0RC32QAS.2 size=405435 2024-03-04T12:26:45.891 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.884+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=61IR0RC32QAS tag=ASE14ZIMRODZ type=write size=3551163 2024-03-04T12:26:45.891 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.884+0000 7fa4b3c3e780 1 < canceled part key=_multipart_T301TK0FIOG4.2~TSPXAQHAH7WU.0 size=1048576 2024-03-04T12:26:45.892 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.885+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~TSPXAQHAH7WU.1 size=635772 2024-03-04T12:26:45.894 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.887+0000 7fa4b3c3e780 1 < canceled multipart upload key=T301TK0FIOG4 upload=TSPXAQHAH7WU tag=T80MOQNCDQRM type=write size=2732924 2024-03-04T12:26:45.895 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.888+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=RBXE94I980N4 type=write size=564402 2024-03-04T12:26:45.897 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.890+0000 7fa4b3c3e780 1 < suggested update operation key=KKQT9J9GSW0N tag=295F6Y4ZBXGL type=del size=1007305 2024-03-04T12:26:45.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.891+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=4BB4IX1SM9LF type=del size=3332039 2024-03-04T12:26:45.899 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.893+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=X166OVYMIGDA type=del 2024-03-04T12:26:45.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.894+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=A5QSH5IUKZGC type=del size=3764410 2024-03-04T12:26:45.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.895+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~ARB7GIG625KL.0 size=1048576 2024-03-04T12:26:45.903 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.896+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~ARB7GIG625KL.1 size=1048576 2024-03-04T12:26:45.904 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.897+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~ARB7GIG625KL.2 size=398226 2024-03-04T12:26:45.906 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.899+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=ARB7GIG625KL tag=Y0BMCX25DKXG type=write size=3543954 2024-03-04T12:26:45.907 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.900+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=PAPZKN4OEKT7 type=del size=13270 2024-03-04T12:26:45.907 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.900+0000 7fa4b3c3e780 1 < canceled part key=_multipart_BVMWQ9ZL4K0C.2~LBIWUFSEJ1S4.0 size=368773 2024-03-04T12:26:45.909 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.902+0000 7fa4b3c3e780 1 < canceled multipart upload key=BVMWQ9ZL4K0C upload=LBIWUFSEJ1S4 tag=XSP10O2YJQZ2 type=write size=1417349 2024-03-04T12:26:45.910 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.903+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=GIR00VRQOZQ7 type=del size=2823906 2024-03-04T12:26:45.911 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.905+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~L1RAN265WSWN.0 size=1048576 2024-03-04T12:26:45.911 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.905+0000 7fa4b3c3e780 1 < canceled part key=_multipart_BR8RTE2QEH9E.2~L1RAN265WSWN.1 size=1036735 2024-03-04T12:26:45.913 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.907+0000 7fa4b3c3e780 1 < canceled multipart upload key=BR8RTE2QEH9E upload=L1RAN265WSWN tag=A2EF2O1ROSNS type=write size=3133887 2024-03-04T12:26:45.915 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.909+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~ARC2H5TW8Q06.0 size=1048576 2024-03-04T12:26:45.916 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.909+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~ARC2H5TW8Q06.1 size=824535 2024-03-04T12:26:45.916 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.909+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=ARC2H5TW8Q06 tag=0MUR3WR1S2I2 type=write size=2921687 2024-03-04T12:26:45.917 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.911+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=E2XISSGERUKY type=del 2024-03-04T12:26:45.919 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.913+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~MXLFV3VOZVTK.0 size=1048576 2024-03-04T12:26:45.920 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.914+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~MXLFV3VOZVTK.1 size=1048576 2024-03-04T12:26:45.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.914+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~MXLFV3VOZVTK.2 size=940312 2024-03-04T12:26:45.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.914+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=MXLFV3VOZVTK tag=283L5HB043IO type=write size=4086040 2024-03-04T12:26:45.922 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.916+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~6CFPN5S3FXTV.0 size=1048576 2024-03-04T12:26:45.923 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.917+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~6CFPN5S3FXTV.1 size=497183 2024-03-04T12:26:45.925 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.918+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=6CFPN5S3FXTV tag=J2M8ID5G471P type=write size=2594335 2024-03-04T12:26:45.926 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.920+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=NPQTPWLHL2RQ type=del size=1874837 2024-03-04T12:26:45.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.921+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=DL1NJBD15FON type=del 2024-03-04T12:26:45.929 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.922+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=NJ2WQPORKNJT type=del size=2532855 2024-03-04T12:26:45.930 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.923+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=Z74F9ISNU7SX type=del 2024-03-04T12:26:45.931 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.925+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=M95YFV5Z0IFQ type=del size=2948665 2024-03-04T12:26:45.933 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.926+0000 7fa4b3c3e780 1 < completed delete operation key=G8G76PMSKJ0I tag=69NGZEVN9SZL type=del 2024-03-04T12:26:45.935 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.928+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~0LBPK04C66ZK.0 size=940453 2024-03-04T12:26:45.935 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.928+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=0LBPK04C66ZK tag=8QQS9WHZ0XAT type=write size=1989029 2024-03-04T12:26:45.936 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.930+0000 7fa4b3c3e780 1 < completed delete operation key=GMIPCGYZRJ5L tag=J7ME15R7VC67 type=del 2024-03-04T12:26:45.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.932+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~2C7N771TM4Z1.0 size=1048576 2024-03-04T12:26:45.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.933+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~2C7N771TM4Z1.1 size=1048576 2024-03-04T12:26:45.940 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.933+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~2C7N771TM4Z1.2 size=980517 2024-03-04T12:26:45.940 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.933+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=2C7N771TM4Z1 tag=4LDRX10X7QGL type=write size=4126245 2024-03-04T12:26:45.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.935+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~TY05DTIEXFIT.0 size=1048576 2024-03-04T12:26:45.942 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.936+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~TY05DTIEXFIT.1 size=467191 2024-03-04T12:26:45.944 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.937+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=TY05DTIEXFIT tag=B6FFODJ01J9O type=write size=2564343 2024-03-04T12:26:45.945 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.939+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=KNY85U0RRTSS type=del size=2616781 2024-03-04T12:26:45.948 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.941+0000 7fa4b3c3e780 1 < suggested remove operation key=WRHB3XWDLSY2 tag=TAVSQ9XSUVIE type=del 2024-03-04T12:26:45.949 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.942+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=7DV7NIGVCSO3 type=del size=2386058 2024-03-04T12:26:45.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.943+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~JD6UAJHEH1C9.0 size=1048576 2024-03-04T12:26:45.951 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.944+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~JD6UAJHEH1C9.1 size=1048576 2024-03-04T12:26:45.952 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.945+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~JD6UAJHEH1C9.2 size=425681 2024-03-04T12:26:45.954 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.947+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=JD6UAJHEH1C9 tag=WUPWMP5XFY1F type=write size=3571409 2024-03-04T12:26:45.956 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.949+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~9GK204JYXVGH.0 size=920688 2024-03-04T12:26:45.956 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.949+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=9GK204JYXVGH tag=1WFYXR5OZ721 type=write size=1969264 2024-03-04T12:26:45.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.950+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~61IR0RC32QAS.0 size=1048576 2024-03-04T12:26:45.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.950+0000 7fa4b3c3e780 1 < canceled part key=_multipart_R6Y09EO6HGF0.2~61IR0RC32QAS.1 size=1048576 2024-03-04T12:26:45.958 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.951+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~61IR0RC32QAS.2 size=405435 2024-03-04T12:26:45.960 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.953+0000 7fa4b3c3e780 1 < canceled multipart upload key=R6Y09EO6HGF0 upload=61IR0RC32QAS tag=ASE14ZIMRODZ type=write size=3551163 2024-03-04T12:26:45.962 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.955+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~0ACFMX1JF17H.0 size=110554 2024-03-04T12:26:45.962 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.955+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=0ACFMX1JF17H tag=VQUTJ6XB16IZ type=write size=1159130 2024-03-04T12:26:45.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.956+0000 7fa4b3c3e780 1 < completed write operation key=YQLH0WW7I7MW tag=RBXE94I980N4 type=write size=564402 2024-03-04T12:26:45.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.958+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=IWHLXYZEQIJI type=del size=1661851 2024-03-04T12:26:45.967 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.960+0000 7fa4b3c3e780 1 < suggested update operation key=YWJV4QMY6ZBI tag=4BB4IX1SM9LF type=del size=3332039 2024-03-04T12:26:45.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.963+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~JTMVCN3UIYOO.0 size=1048576 2024-03-04T12:26:45.970 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.964+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~JTMVCN3UIYOO.1 size=1048576 2024-03-04T12:26:45.971 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.964+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~JTMVCN3UIYOO.2 size=154324 2024-03-04T12:26:45.971 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.964+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=JTMVCN3UIYOO tag=0I0IUJ2JGJP5 type=write size=3300052 2024-03-04T12:26:45.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.966+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=A5QSH5IUKZGC type=del 2024-03-04T12:26:45.973 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.967+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=YK4Q7168M40O type=del size=3788815 2024-03-04T12:26:45.975 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.968+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=PAPZKN4OEKT7 type=del 2024-03-04T12:26:45.977 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.970+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~27014DUH1FJ6.0 size=1048576 2024-03-04T12:26:45.977 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.971+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~27014DUH1FJ6.1 size=937467 2024-03-04T12:26:45.978 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.971+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=27014DUH1FJ6 tag=RJZ68LNAGGU4 type=write size=3034619 2024-03-04T12:26:45.980 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.973+0000 7fa4b3c3e780 1 < suggested remove operation key=RHU0QO8HS5SC tag=GIR00VRQOZQ7 type=del 2024-03-04T12:26:45.981 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.974+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=S2NQ52N0HBAW type=del size=1630433 2024-03-04T12:26:45.982 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.975+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~ARC2H5TW8Q06.0 size=1048576 2024-03-04T12:26:45.983 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.976+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~ARC2H5TW8Q06.1 size=824535 2024-03-04T12:26:45.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.978+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=ARC2H5TW8Q06 tag=0MUR3WR1S2I2 type=write size=2921687 2024-03-04T12:26:45.987 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.980+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=5ZUVL2HVZNWJ type=del size=2211267 2024-03-04T12:26:45.988 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.981+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~MXLFV3VOZVTK.0 size=1048576 2024-03-04T12:26:45.988 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.981+0000 7fa4b3c3e780 1 < canceled part key=_multipart_T301TK0FIOG4.2~MXLFV3VOZVTK.1 size=1048576 2024-03-04T12:26:45.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.982+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~MXLFV3VOZVTK.2 size=940312 2024-03-04T12:26:45.991 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.984+0000 7fa4b3c3e780 1 < canceled multipart upload key=T301TK0FIOG4 upload=MXLFV3VOZVTK tag=283L5HB043IO type=write size=4086040 2024-03-04T12:26:45.993 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.986+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~KY8UX9L5D1A2.0 size=1048576 2024-03-04T12:26:45.994 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.987+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~KY8UX9L5D1A2.1 size=1048576 2024-03-04T12:26:45.995 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.988+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~KY8UX9L5D1A2.2 size=440458 2024-03-04T12:26:45.995 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.988+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=KY8UX9L5D1A2 tag=G39QOUYF584X type=write size=3586186 2024-03-04T12:26:45.997 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.990+0000 7fa4b3c3e780 1 < suggested update operation key=WRHB3XWDLSY2 tag=NPQTPWLHL2RQ type=del size=1874837 2024-03-04T12:26:45.998 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.991+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=WWHF1X526HNT type=del size=4193399 2024-03-04T12:26:45.999 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.992+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=NJ2WQPORKNJT type=del 2024-03-04T12:26:46.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.993+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=CWP0X2I6QOLX type=del size=1382477 2024-03-04T12:26:46.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.994+0000 7fa4b3c3e780 1 < completed delete operation key=UZRX3W3DE5VX tag=M95YFV5Z0IFQ type=del 2024-03-04T12:26:46.002 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.996+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=G8C7OE3OYBG7 type=del size=1255735 2024-03-04T12:26:46.003 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.996+0000 7fa4b3c3e780 1 < canceled part key=_multipart_VAIY4J3CYONH.2~0LBPK04C66ZK.0 size=940453 2024-03-04T12:26:46.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.997+0000 7fa4b3c3e780 1 < canceled multipart upload key=VAIY4J3CYONH upload=0LBPK04C66ZK tag=8QQS9WHZ0XAT type=write size=1989029 2024-03-04T12:26:46.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:45.999+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=UI85CXX0LK1W type=del size=2748618 2024-03-04T12:26:46.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.000+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~2C7N771TM4Z1.0 size=1048576 2024-03-04T12:26:46.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.000+0000 7fa4b3c3e780 1 < canceled part key=_multipart_VAIY4J3CYONH.2~2C7N771TM4Z1.1 size=1048576 2024-03-04T12:26:46.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.001+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~2C7N771TM4Z1.2 size=980517 2024-03-04T12:26:46.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.003+0000 7fa4b3c3e780 1 < canceled multipart upload key=VAIY4J3CYONH upload=2C7N771TM4Z1 tag=4LDRX10X7QGL type=write size=4126245 2024-03-04T12:26:46.010 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.004+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=CQHJU4QR977C type=del size=1722088 2024-03-04T12:26:46.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.006+0000 7fa4b3c3e780 1 < suggested update operation key=G70BJ2UARNCP tag=KNY85U0RRTSS type=del size=2616781 2024-03-04T12:26:46.014 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.007+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=54KM3T69LC59 type=del size=2847343 2024-03-04T12:26:46.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.009+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=7DV7NIGVCSO3 type=del 2024-03-04T12:26:46.017 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.010+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=XIRI4T9N7DS1 type=del size=838592 2024-03-04T12:26:46.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.011+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~9GK204JYXVGH.0 size=920688 2024-03-04T12:26:46.020 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.013+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=9GK204JYXVGH tag=1WFYXR5OZ721 type=write size=1969264 2024-03-04T12:26:46.021 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.014+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=7A65RYQFDGCX type=del size=377366 2024-03-04T12:26:46.022 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.015+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~0ACFMX1JF17H.0 size=110554 2024-03-04T12:26:46.024 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.017+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=0ACFMX1JF17H tag=VQUTJ6XB16IZ type=write size=1159130 2024-03-04T12:26:46.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.018+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=L0IM4PD8RJLU type=del size=1034137 2024-03-04T12:26:46.026 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.019+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=IWHLXYZEQIJI type=del 2024-03-04T12:26:46.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.022+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~TADB17OZYFVD.0 size=709175 2024-03-04T12:26:46.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.022+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=TADB17OZYFVD tag=D1TIAUK7S7DB type=write size=1757751 2024-03-04T12:26:46.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.023+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~JTMVCN3UIYOO.0 size=1048576 2024-03-04T12:26:46.030 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.024+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~JTMVCN3UIYOO.1 size=1048576 2024-03-04T12:26:46.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.025+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~JTMVCN3UIYOO.2 size=154324 2024-03-04T12:26:46.033 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.027+0000 7fa4b3c3e780 1 < completed multipart upload key=J53J0N99N30A upload=JTMVCN3UIYOO tag=0I0IUJ2JGJP5 type=write size=3300052 2024-03-04T12:26:46.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.028+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=7TTJSC46J00S type=write size=792560 2024-03-04T12:26:46.036 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.029+0000 7fa4b3c3e780 1 < completed delete operation key=G8G76PMSKJ0I tag=YK4Q7168M40O type=del 2024-03-04T12:26:46.037 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.030+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=ADPXIXG9D8XM type=del size=5672 2024-03-04T12:26:46.038 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.031+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~27014DUH1FJ6.0 size=1048576 2024-03-04T12:26:46.039 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.032+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~27014DUH1FJ6.1 size=937467 2024-03-04T12:26:46.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.034+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=27014DUH1FJ6 tag=RJZ68LNAGGU4 type=write size=3034619 2024-03-04T12:26:46.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.035+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=CT9P2ZALI609 type=del size=15846 2024-03-04T12:26:46.043 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.036+0000 7fa4b3c3e780 -1 < failed to complete operation key=WRHB3XWDLSY2 tag=S2NQ52N0HBAW type=del size=1630433: (22) Invalid argument 2024-03-04T12:26:46.045 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.038+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~3WDAWGD9ULD3.0 size=147118 2024-03-04T12:26:46.045 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.038+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=3WDAWGD9ULD3 tag=KSBD80F9396K type=write size=1195694 2024-03-04T12:26:46.046 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.040+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=5ZUVL2HVZNWJ type=del 2024-03-04T12:26:46.047 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.041+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=SWH4970J3Z2S type=del size=1996356 2024-03-04T12:26:46.049 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.042+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~KY8UX9L5D1A2.0 size=1048576 2024-03-04T12:26:46.050 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.043+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~KY8UX9L5D1A2.1 size=1048576 2024-03-04T12:26:46.051 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.044+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~KY8UX9L5D1A2.2 size=440458 2024-03-04T12:26:46.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.046+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=KY8UX9L5D1A2 tag=G39QOUYF584X type=write size=3586186 2024-03-04T12:26:46.055 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.048+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~9X36G6KSCGBZ.0 size=787224 2024-03-04T12:26:46.055 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.048+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=9X36G6KSCGBZ tag=OWTOOYMJDAQQ type=write size=1835800 2024-03-04T12:26:46.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.049+0000 7fa4b3c3e780 1 < completed delete operation key=R6Y09EO6HGF0 tag=WWHF1X526HNT type=del 2024-03-04T12:26:46.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.050+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=7FB6W4Q8DTK9 type=write size=969421 2024-03-04T12:26:46.058 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.051+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=CWP0X2I6QOLX type=del 2024-03-04T12:26:46.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.054+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~6S1ST7RRS4CP.0 size=1048576 2024-03-04T12:26:46.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.054+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~6S1ST7RRS4CP.1 size=367343 2024-03-04T12:26:46.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.054+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=6S1ST7RRS4CP tag=6IAD23PSQ810 type=write size=2464495 2024-03-04T12:26:46.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.057+0000 7fa4b3c3e780 1 < suggested update operation key=T301TK0FIOG4 tag=G8C7OE3OYBG7 type=del size=1255735 2024-03-04T12:26:46.066 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.059+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~OJPLE6SY2VV9.0 size=495658 2024-03-04T12:26:46.066 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.059+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=OJPLE6SY2VV9 tag=9OSB19TK32GJ type=write size=1544234 2024-03-04T12:26:46.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.060+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=UI85CXX0LK1W type=del 2024-03-04T12:26:46.068 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.061+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=HDJ01WPR92ND type=del size=4014045 2024-03-04T12:26:46.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.064+0000 7fa4b3c3e780 1 < suggested remove operation key=VAIY4J3CYONH tag=CQHJU4QR977C type=del 2024-03-04T12:26:46.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.065+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=VKPDE1JEWQHW type=del size=2534928 2024-03-04T12:26:46.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.066+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=54KM3T69LC59 type=del 2024-03-04T12:26:46.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.069+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~BTJ6SM0A0XS1.0 size=1048576 2024-03-04T12:26:46.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.070+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~BTJ6SM0A0XS1.1 size=1048576 2024-03-04T12:26:46.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.072+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~BTJ6SM0A0XS1.2 size=570537 2024-03-04T12:26:46.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.072+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=BTJ6SM0A0XS1 tag=YVXR4K5SREJG type=write size=3716265 2024-03-04T12:26:46.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.073+0000 7fa4b3c3e780 1 < completed delete operation key=RHU0QO8HS5SC tag=XIRI4T9N7DS1 type=del 2024-03-04T12:26:46.081 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.074+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=19EZZZGGJT82 type=del size=401974 2024-03-04T12:26:46.082 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.076+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=7A65RYQFDGCX type=del 2024-03-04T12:26:46.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.077+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=RD2Q3C7G9AXD type=del size=2680937 2024-03-04T12:26:46.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.078+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=L0IM4PD8RJLU type=del 2024-03-04T12:26:46.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.080+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~9JDB518Q010W.0 size=1016308 2024-03-04T12:26:46.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.080+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=9JDB518Q010W tag=XDUOJ7OWHC00 type=write size=2064884 2024-03-04T12:26:46.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.080+0000 7fa4b3c3e780 1 < canceled part key=_multipart_4989OME3IAJF.2~TADB17OZYFVD.0 size=709175 2024-03-04T12:26:46.089 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.082+0000 7fa4b3c3e780 1 < canceled multipart upload key=4989OME3IAJF upload=TADB17OZYFVD tag=D1TIAUK7S7DB type=write size=1757751 2024-03-04T12:26:46.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.083+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=JMWKFNZFTLM2 type=del size=2990209 2024-03-04T12:26:46.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.085+0000 7fa4b3c3e780 1 < completed write operation key=H5FWRNK8F7QT tag=7TTJSC46J00S type=write size=792560 2024-03-04T12:26:46.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.086+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=YDBGBRFBG6JB type=del size=580659 2024-03-04T12:26:46.095 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.088+0000 7fa4b3c3e780 1 < suggested remove operation key=RHU0QO8HS5SC tag=ADPXIXG9D8XM type=del 2024-03-04T12:26:46.096 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.089+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=0L7D19I02O8P type=write size=267874 2024-03-04T12:26:46.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.092+0000 7fa4b3c3e780 1 < suggested remove operation key=BVMWQ9ZL4K0C tag=CT9P2ZALI609 type=del 2024-03-04T12:26:46.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.093+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=ODDP1UXHMAZV type=del size=2690440 2024-03-04T12:26:46.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.094+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~3WDAWGD9ULD3.0 size=147118 2024-03-04T12:26:46.104 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.097+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=3WDAWGD9ULD3 tag=KSBD80F9396K type=write size=1195694 2024-03-04T12:26:46.106 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.099+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~IO60F38XDQ9O.0 size=1048576 2024-03-04T12:26:46.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.100+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~IO60F38XDQ9O.1 size=358177 2024-03-04T12:26:46.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.100+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=IO60F38XDQ9O tag=0TLI2TROA8IA type=write size=2455329 2024-03-04T12:26:46.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.101+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=SWH4970J3Z2S type=del 2024-03-04T12:26:46.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.102+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=CKQT7P0OUJ72 type=del size=1041800 2024-03-04T12:26:46.110 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.103+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~9X36G6KSCGBZ.0 size=787224 2024-03-04T12:26:46.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.105+0000 7fa4b3c3e780 1 < completed multipart upload key=J53J0N99N30A upload=9X36G6KSCGBZ tag=OWTOOYMJDAQQ type=write size=1835800 2024-03-04T12:26:46.113 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.106+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=BD3O0WLF0RPW type=write size=580480 2024-03-04T12:26:46.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.107+0000 7fa4b3c3e780 1 < completed write operation key=YWJV4QMY6ZBI tag=7FB6W4Q8DTK9 type=write size=969421 2024-03-04T12:26:46.115 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.108+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=WMFHIYI93DXD type=del size=1226957 2024-03-04T12:26:46.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.110+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~6S1ST7RRS4CP.0 size=1048576 2024-03-04T12:26:46.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.110+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~6S1ST7RRS4CP.1 size=367343 2024-03-04T12:26:46.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.112+0000 7fa4b3c3e780 1 < completed multipart upload key=H5FWRNK8F7QT upload=6S1ST7RRS4CP tag=6IAD23PSQ810 type=write size=2464495 2024-03-04T12:26:46.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.113+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=FS6FPNPPUFWS type=del size=3291350 2024-03-04T12:26:46.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.114+0000 7fa4b3c3e780 1 < canceled part key=_multipart_KKQT9J9GSW0N.2~OJPLE6SY2VV9.0 size=495658 2024-03-04T12:26:46.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.116+0000 7fa4b3c3e780 1 < canceled multipart upload key=KKQT9J9GSW0N upload=OJPLE6SY2VV9 tag=9OSB19TK32GJ type=write size=1544234 2024-03-04T12:26:46.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.117+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=NJLCNKAO3LTS type=write size=116552 2024-03-04T12:26:46.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.119+0000 7fa4b3c3e780 1 < suggested update operation key=3N6E09QF3866 tag=HDJ01WPR92ND type=del size=4014045 2024-03-04T12:26:46.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.120+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=NF2UNJM490YE type=del size=2309254 2024-03-04T12:26:46.128 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.121+0000 7fa4b3c3e780 1 < completed delete operation key=YWJV4QMY6ZBI tag=VKPDE1JEWQHW type=del 2024-03-04T12:26:46.130 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.123+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~9G893ZU1MB8H.0 size=1048576 2024-03-04T12:26:46.131 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.124+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~9G893ZU1MB8H.1 size=64999 2024-03-04T12:26:46.131 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.124+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=9G893ZU1MB8H tag=VVLSXNHXT2O9 type=write size=2162151 2024-03-04T12:26:46.131 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.124+0000 7fa4b3c3e780 1 < canceled part key=_multipart_BR8RTE2QEH9E.2~BTJ6SM0A0XS1.0 size=1048576 2024-03-04T12:26:46.132 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.124+0000 7fa4b3c3e780 1 < canceled part key=_multipart_BR8RTE2QEH9E.2~BTJ6SM0A0XS1.1 size=1048576 2024-03-04T12:26:46.132 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.125+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~BTJ6SM0A0XS1.2 size=570537 2024-03-04T12:26:46.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.127+0000 7fa4b3c3e780 1 < canceled multipart upload key=BR8RTE2QEH9E upload=BTJ6SM0A0XS1 tag=YVXR4K5SREJG type=write size=3716265 2024-03-04T12:26:46.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.129+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~4M0Q8EKM1C3P.0 size=1048576 2024-03-04T12:26:46.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.130+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~4M0Q8EKM1C3P.1 size=1048576 2024-03-04T12:26:46.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.131+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~4M0Q8EKM1C3P.2 size=758675 2024-03-04T12:26:46.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.131+0000 7fa4b3c3e780 1 > prepared multipart upload key=G8G76PMSKJ0I upload=4M0Q8EKM1C3P tag=DIZX24I45DT3 type=write size=3904403 2024-03-04T12:26:46.139 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.132+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=19EZZZGGJT82 type=del 2024-03-04T12:26:46.140 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.133+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=CK3OFF063GEH type=del size=1637329 2024-03-04T12:26:46.142 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.136+0000 7fa4b3c3e780 1 < suggested update operation key=R1DOKJPZRT5Q tag=RD2Q3C7G9AXD type=del size=2680937 2024-03-04T12:26:46.143 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.137+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=Y0CZOC67QUCI type=del size=3026739 2024-03-04T12:26:46.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.138+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~9JDB518Q010W.0 size=1016308 2024-03-04T12:26:46.147 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.140+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=9JDB518Q010W tag=XDUOJ7OWHC00 type=write size=2064884 2024-03-04T12:26:46.149 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.142+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~HVG4QW5V9E7O.0 size=1007236 2024-03-04T12:26:46.149 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.142+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=HVG4QW5V9E7O tag=SM4GOES049N1 type=write size=2055812 2024-03-04T12:26:46.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.143+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=JMWKFNZFTLM2 type=del 2024-03-04T12:26:46.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.145+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=O2LO20SHT5W5 type=del size=2501998 2024-03-04T12:26:46.154 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.147+0000 7fa4b3c3e780 1 < suggested update operation key=RHU0QO8HS5SC tag=YDBGBRFBG6JB type=del size=580659 2024-03-04T12:26:46.156 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.149+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~WBAA4FNWSEMS.0 size=499009 2024-03-04T12:26:46.156 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.149+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=WBAA4FNWSEMS tag=ATZDEEG54S0V type=write size=1547585 2024-03-04T12:26:46.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.151+0000 7fa4b3c3e780 1 < suggested remove operation key=YWJV4QMY6ZBI tag=0L7D19I02O8P type=write 2024-03-04T12:26:46.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.153+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=PRO5Z2EAD2DA type=del size=2388889 2024-03-04T12:26:46.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.154+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=ODDP1UXHMAZV type=del 2024-03-04T12:26:46.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.156+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~DMOTCEMWKGTU.0 size=485904 2024-03-04T12:26:46.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.156+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=DMOTCEMWKGTU tag=SOCRF1ZA5Z23 type=write size=1534480 2024-03-04T12:26:46.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.158+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~IO60F38XDQ9O.0 size=1048576 2024-03-04T12:26:46.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.158+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~IO60F38XDQ9O.1 size=358177 2024-03-04T12:26:46.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.161+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=IO60F38XDQ9O tag=0TLI2TROA8IA type=write size=2455329 2024-03-04T12:26:46.169 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.163+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~5Z2GVOR0EB1N.0 size=554448 2024-03-04T12:26:46.170 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.163+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=5Z2GVOR0EB1N tag=4HJMRM303G84 type=write size=1603024 2024-03-04T12:26:46.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.164+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=CKQT7P0OUJ72 type=del 2024-03-04T12:26:46.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.166+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~VKBX0GVXSJMC.0 size=1048576 2024-03-04T12:26:46.174 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.167+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~VKBX0GVXSJMC.1 size=360793 2024-03-04T12:26:46.174 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.167+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=VKBX0GVXSJMC tag=HY9S5ZWBCEHR type=write size=2457945 2024-03-04T12:26:46.175 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.168+0000 7fa4b3c3e780 1 < completed write operation key=BR8RTE2QEH9E tag=BD3O0WLF0RPW type=write size=580480 2024-03-04T12:26:46.176 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.169+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=HWLR6C4S1IFT type=del size=63724 2024-03-04T12:26:46.177 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.171+0000 7fa4b3c3e780 1 < completed delete operation key=X0RVLNRWUAEM tag=WMFHIYI93DXD type=del 2024-03-04T12:26:46.178 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.172+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=KE7OQDHLBZOG type=del size=1246918 2024-03-04T12:26:46.180 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.173+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=FS6FPNPPUFWS type=del 2024-03-04T12:26:46.182 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.175+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~8KAFMXNV1JAN.0 size=546777 2024-03-04T12:26:46.182 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.175+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=8KAFMXNV1JAN tag=BB7IZUBE5X1R type=write size=1595353 2024-03-04T12:26:46.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.177+0000 7fa4b3c3e780 1 < suggested remove operation key=BVMWQ9ZL4K0C tag=NJLCNKAO3LTS type=write 2024-03-04T12:26:46.185 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.178+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=3J0R9USLDL4L type=del size=730027 2024-03-04T12:26:46.186 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.179+0000 7fa4b3c3e780 -1 < failed to complete operation key=RHU0QO8HS5SC tag=NF2UNJM490YE type=del size=2309254: (22) Invalid argument 2024-03-04T12:26:46.187 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.181+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=897F6USL438B type=del size=565561 2024-03-04T12:26:46.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.182+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~9G893ZU1MB8H.0 size=1048576 2024-03-04T12:26:46.190 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.183+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~9G893ZU1MB8H.1 size=64999 2024-03-04T12:26:46.192 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.186+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=9G893ZU1MB8H tag=VVLSXNHXT2O9 type=write size=2162151 2024-03-04T12:26:46.194 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.187+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=MQ8GKQ7TA9TS type=del size=1242853 2024-03-04T12:26:46.195 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.188+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~4M0Q8EKM1C3P.0 size=1048576 2024-03-04T12:26:46.196 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.189+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~4M0Q8EKM1C3P.1 size=1048576 2024-03-04T12:26:46.197 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.190+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~4M0Q8EKM1C3P.2 size=758675 2024-03-04T12:26:46.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.192+0000 7fa4b3c3e780 1 < completed multipart upload key=G8G76PMSKJ0I upload=4M0Q8EKM1C3P tag=DIZX24I45DT3 type=write size=3904403 2024-03-04T12:26:46.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.193+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=1SWV6DWYI2YX type=del size=131067 2024-03-04T12:26:46.202 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.195+0000 7fa4b3c3e780 1 < suggested update operation key=VAIY4J3CYONH tag=CK3OFF063GEH type=del size=1637329 2024-03-04T12:26:46.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.196+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=O8K01VEEMHYC type=del size=3251829 2024-03-04T12:26:46.204 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.198+0000 7fa4b3c3e780 -1 < failed to complete operation key=VAIY4J3CYONH tag=Y0CZOC67QUCI type=del size=3026739: (22) Invalid argument 2024-03-04T12:26:46.206 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.200+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~Z1VHBH6TZM8V.0 size=1048576 2024-03-04T12:26:46.207 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.200+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~Z1VHBH6TZM8V.1 size=319530 2024-03-04T12:26:46.207 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.200+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=Z1VHBH6TZM8V tag=61R5QDQGDJGH type=write size=2416682 2024-03-04T12:26:46.208 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.201+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~HVG4QW5V9E7O.0 size=1007236 2024-03-04T12:26:46.210 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.203+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=HVG4QW5V9E7O tag=SM4GOES049N1 type=write size=2055812 2024-03-04T12:26:46.211 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.204+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=AWRXPU8ISC0K type=del size=3528281 2024-03-04T12:26:46.212 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.206+0000 7fa4b3c3e780 1 < completed delete operation key=GMIPCGYZRJ5L tag=O2LO20SHT5W5 type=del 2024-03-04T12:26:46.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.207+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=FX4YFR0B2SL5 type=del size=1967766 2024-03-04T12:26:46.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.208+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~WBAA4FNWSEMS.0 size=499009 2024-03-04T12:26:46.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.210+0000 7fa4b3c3e780 1 < completed multipart upload key=YIS2SV4O5EZN upload=WBAA4FNWSEMS tag=ATZDEEG54S0V type=write size=1547585 2024-03-04T12:26:46.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.212+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~GYEWIGHUXPIC.0 size=645364 2024-03-04T12:26:46.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.212+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=GYEWIGHUXPIC tag=L3ZABYU0E748 type=write size=1693940 2024-03-04T12:26:46.219 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.213+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=PRO5Z2EAD2DA type=del 2024-03-04T12:26:46.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.214+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=0HI8PE6VK725 type=del size=2118392 2024-03-04T12:26:46.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.214+0000 7fa4b3c3e780 1 < canceled part key=_multipart_R6Y09EO6HGF0.2~DMOTCEMWKGTU.0 size=485904 2024-03-04T12:26:46.222 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.216+0000 7fa4b3c3e780 1 < canceled multipart upload key=R6Y09EO6HGF0 upload=DMOTCEMWKGTU tag=SOCRF1ZA5Z23 type=write size=1534480 2024-03-04T12:26:46.224 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.217+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=1W04GGP6E7PZ type=del size=4061540 2024-03-04T12:26:46.225 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.218+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~5Z2GVOR0EB1N.0 size=554448 2024-03-04T12:26:46.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.220+0000 7fa4b3c3e780 1 < completed multipart upload key=4989OME3IAJF upload=5Z2GVOR0EB1N tag=4HJMRM303G84 type=write size=1603024 2024-03-04T12:26:46.228 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.221+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=2XQDPC8YK2LX type=del size=2258434 2024-03-04T12:26:46.228 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.221+0000 7fa4b3c3e780 1 < canceled part key=_multipart_4989OME3IAJF.2~VKBX0GVXSJMC.0 size=1048576 2024-03-04T12:26:46.228 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.221+0000 7fa4b3c3e780 1 < canceled part key=_multipart_4989OME3IAJF.2~VKBX0GVXSJMC.1 size=360793 2024-03-04T12:26:46.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.223+0000 7fa4b3c3e780 1 < canceled multipart upload key=4989OME3IAJF upload=VKBX0GVXSJMC tag=HY9S5ZWBCEHR type=write size=2457945 2024-03-04T12:26:46.231 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.224+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=RKOV6GDWGLPU type=del size=435763 2024-03-04T12:26:46.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.225+0000 7fa4b3c3e780 1 < completed delete operation key=X0RVLNRWUAEM tag=HWLR6C4S1IFT type=del 2024-03-04T12:26:46.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.226+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=Q6D7JQK6SVMT type=write size=679682 2024-03-04T12:26:46.235 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.229+0000 7fa4b3c3e780 1 < suggested remove operation key=6XK4DQ940Z5J tag=KE7OQDHLBZOG type=del 2024-03-04T12:26:46.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.231+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~A14MDWIR22U4.0 size=1048576 2024-03-04T12:26:46.238 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.232+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~A14MDWIR22U4.1 size=1048576 2024-03-04T12:26:46.239 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.233+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~A14MDWIR22U4.2 size=415407 2024-03-04T12:26:46.240 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.233+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=A14MDWIR22U4 tag=UIKCMB2ZOQVL type=write size=3561135 2024-03-04T12:26:46.241 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.234+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~8KAFMXNV1JAN.0 size=546777 2024-03-04T12:26:46.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.236+0000 7fa4b3c3e780 1 < completed multipart upload key=3N6E09QF3866 upload=8KAFMXNV1JAN tag=BB7IZUBE5X1R type=write size=1595353 2024-03-04T12:26:46.245 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.238+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~H3X6ZI0HB14L.0 size=1048576 2024-03-04T12:26:46.245 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.239+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~H3X6ZI0HB14L.1 size=291174 2024-03-04T12:26:46.245 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.239+0000 7fa4b3c3e780 1 > prepared multipart upload key=4LKTYP07OL5L upload=H3X6ZI0HB14L tag=0648EHHRJK8J type=write size=2388326 2024-03-04T12:26:46.246 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.240+0000 7fa4b3c3e780 1 < completed delete operation key=YWJV4QMY6ZBI tag=3J0R9USLDL4L type=del 2024-03-04T12:26:46.249 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.242+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~LW8SMK7XRQYK.0 size=1048576 2024-03-04T12:26:46.249 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.243+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~LW8SMK7XRQYK.1 size=1048576 2024-03-04T12:26:46.250 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.243+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~LW8SMK7XRQYK.2 size=486512 2024-03-04T12:26:46.250 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.243+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=LW8SMK7XRQYK tag=TOP3W3C5V8KT type=write size=3632240 2024-03-04T12:26:46.251 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.244+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=897F6USL438B type=del 2024-03-04T12:26:46.253 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.246+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~EH5JC3QEHAPZ.0 size=1048576 2024-03-04T12:26:46.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.247+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~EH5JC3QEHAPZ.1 size=1048576 2024-03-04T12:26:46.255 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.248+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~EH5JC3QEHAPZ.2 size=260098 2024-03-04T12:26:46.255 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.248+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=EH5JC3QEHAPZ tag=11CEQWFJ6VB4 type=write size=3405826 2024-03-04T12:26:46.256 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.249+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=MQ8GKQ7TA9TS type=del 2024-03-04T12:26:46.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.250+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=1T5HWXHKUNE7 type=del size=1578582 2024-03-04T12:26:46.259 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.252+0000 7fa4b3c3e780 1 < suggested update operation key=DHLTVH2AZBLR tag=1SWV6DWYI2YX type=del size=131067 2024-03-04T12:26:46.260 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.253+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=H7XOOCXA59A2 type=del size=2286432 2024-03-04T12:26:46.261 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.254+0000 7fa4b3c3e780 1 < canceled operation key=BVMWQ9ZL4K0C tag=O8K01VEEMHYC type=del size=3251829 2024-03-04T12:26:46.262 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.255+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=5925YVQRYZ16 type=del size=374150 2024-03-04T12:26:46.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.257+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~Z1VHBH6TZM8V.0 size=1048576 2024-03-04T12:26:46.264 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.257+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~Z1VHBH6TZM8V.1 size=319530 2024-03-04T12:26:46.266 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.259+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=Z1VHBH6TZM8V tag=61R5QDQGDJGH type=write size=2416682 2024-03-04T12:26:46.268 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.261+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~BFG1NIY9SREH.0 size=280844 2024-03-04T12:26:46.268 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.261+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=BFG1NIY9SREH tag=WHDF2GWA5D38 type=write size=1329420 2024-03-04T12:26:46.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.262+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=AWRXPU8ISC0K type=del 2024-03-04T12:26:46.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.263+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=5BW488IPRY6B type=write size=903037 2024-03-04T12:26:46.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.265+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=FX4YFR0B2SL5 type=del 2024-03-04T12:26:46.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.266+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=LJB949L03B5K type=del size=2335017 2024-03-04T12:26:46.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.267+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~GYEWIGHUXPIC.0 size=645364 2024-03-04T12:26:46.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.268+0000 7fa4b3c3e780 1 < completed multipart upload key=YIS2SV4O5EZN upload=GYEWIGHUXPIC tag=L3ZABYU0E748 type=write size=1693940 2024-03-04T12:26:46.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.269+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=TFRIR3WVDKM5 type=del size=934147 2024-03-04T12:26:46.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.271+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=0HI8PE6VK725 type=del 2024-03-04T12:26:46.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.273+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~OMRLDXV11VA0.0 size=768464 2024-03-04T12:26:46.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.273+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=OMRLDXV11VA0 tag=1JS1HC0LPO97 type=write size=1817040 2024-03-04T12:26:46.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.274+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=1W04GGP6E7PZ type=del 2024-03-04T12:26:46.282 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.275+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=6KM25NZF8E60 type=write size=463431 2024-03-04T12:26:46.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.276+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=2XQDPC8YK2LX type=del 2024-03-04T12:26:46.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.278+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=G2ACFA1KXNOT type=del size=1260885 2024-03-04T12:26:46.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.279+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=RKOV6GDWGLPU type=del 2024-03-04T12:26:46.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.281+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~WJL100KE0O78.0 size=1048576 2024-03-04T12:26:46.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.282+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~WJL100KE0O78.1 size=313563 2024-03-04T12:26:46.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.282+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=WJL100KE0O78 tag=4MBPHF5Z5EC8 type=write size=2410715 2024-03-04T12:26:46.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.284+0000 7fa4b3c3e780 1 < suggested update operation key=BVMWQ9ZL4K0C tag=Q6D7JQK6SVMT type=write size=679682 2024-03-04T12:26:46.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.285+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=YRAWBVPUKIEN type=del size=3480914 2024-03-04T12:26:46.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.286+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~A14MDWIR22U4.0 size=1048576 2024-03-04T12:26:46.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.288+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~A14MDWIR22U4.1 size=1048576 2024-03-04T12:26:46.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.289+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~A14MDWIR22U4.2 size=415407 2024-03-04T12:26:46.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.291+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=A14MDWIR22U4 tag=UIKCMB2ZOQVL type=write size=3561135 2024-03-04T12:26:46.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.292+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=RD2SWCE2M11J type=del size=750624 2024-03-04T12:26:46.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.293+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~H3X6ZI0HB14L.0 size=1048576 2024-03-04T12:26:46.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.294+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~H3X6ZI0HB14L.1 size=291174 2024-03-04T12:26:46.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.296+0000 7fa4b3c3e780 1 < completed multipart upload key=4LKTYP07OL5L upload=H3X6ZI0HB14L tag=0648EHHRJK8J type=write size=2388326 2024-03-04T12:26:46.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.298+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~F412NUEWT089.0 size=1048576 2024-03-04T12:26:46.306 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.299+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~F412NUEWT089.1 size=790165 2024-03-04T12:26:46.306 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.299+0000 7fa4b3c3e780 1 > prepared multipart upload key=NVMIU38VM9Q1 upload=F412NUEWT089 tag=L1TQ96F2NM3I type=write size=2887317 2024-03-04T12:26:46.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.300+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~LW8SMK7XRQYK.0 size=1048576 2024-03-04T12:26:46.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.301+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~LW8SMK7XRQYK.1 size=1048576 2024-03-04T12:26:46.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.302+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~LW8SMK7XRQYK.2 size=486512 2024-03-04T12:26:46.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.304+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=LW8SMK7XRQYK tag=TOP3W3C5V8KT type=write size=3632240 2024-03-04T12:26:46.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.305+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=70BAYXU3WWFM type=del size=2008735 2024-03-04T12:26:46.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.306+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~EH5JC3QEHAPZ.0 size=1048576 2024-03-04T12:26:46.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.307+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~EH5JC3QEHAPZ.1 size=1048576 2024-03-04T12:26:46.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.308+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~EH5JC3QEHAPZ.2 size=260098 2024-03-04T12:26:46.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.310+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=EH5JC3QEHAPZ tag=11CEQWFJ6VB4 type=write size=3405826 2024-03-04T12:26:46.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.311+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~F7FYIKXNCOAM.0 size=1048576 2024-03-04T12:26:46.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.312+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~F7FYIKXNCOAM.1 size=1048576 2024-03-04T12:26:46.320 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.313+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~F7FYIKXNCOAM.2 size=191641 2024-03-04T12:26:46.320 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.313+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=F7FYIKXNCOAM tag=CPUXD120N5AM type=write size=3337369 2024-03-04T12:26:46.321 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.314+0000 7fa4b3c3e780 1 < canceled operation key=RHU0QO8HS5SC tag=1T5HWXHKUNE7 type=del size=1578582 2024-03-04T12:26:46.322 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.315+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=80HGX698IZGM type=del size=3519888 2024-03-04T12:26:46.323 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.316+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=H7XOOCXA59A2 type=del 2024-03-04T12:26:46.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.318+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=JILU9Q9V0PIW type=del size=2660965 2024-03-04T12:26:46.326 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.319+0000 7fa4b3c3e780 1 < completed delete operation key=UZRX3W3DE5VX tag=5925YVQRYZ16 type=del 2024-03-04T12:26:46.328 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.321+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~2HG1ZE0AAMEY.0 size=146421 2024-03-04T12:26:46.328 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.321+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=2HG1ZE0AAMEY tag=O8HFPHZ3OVXG type=write size=1194997 2024-03-04T12:26:46.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.322+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~BFG1NIY9SREH.0 size=280844 2024-03-04T12:26:46.331 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.324+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=BFG1NIY9SREH tag=WHDF2GWA5D38 type=write size=1329420 2024-03-04T12:26:46.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.326+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=TW6NBI94OQX0 type=del size=3118091 2024-03-04T12:26:46.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.328+0000 7fa4b3c3e780 1 < suggested update operation key=7IUV88NQLPN8 tag=5BW488IPRY6B type=write size=903037 2024-03-04T12:26:46.336 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.329+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=2IOPED60LKDW type=del size=932710 2024-03-04T12:26:46.339 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.332+0000 7fa4b3c3e780 1 < suggested update operation key=43HMF7NWNMU3 tag=LJB949L03B5K type=del size=2335017 2024-03-04T12:26:46.341 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.334+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~9P8BSJVZAA8H.0 size=1048576 2024-03-04T12:26:46.341 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.335+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~9P8BSJVZAA8H.1 size=1048576 2024-03-04T12:26:46.342 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.335+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~9P8BSJVZAA8H.2 size=237139 2024-03-04T12:26:46.342 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.335+0000 7fa4b3c3e780 1 > prepared multipart upload key=4LKTYP07OL5L upload=9P8BSJVZAA8H tag=U0IYWHI6P4K1 type=write size=3382867 2024-03-04T12:26:46.343 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.337+0000 7fa4b3c3e780 1 < canceled operation key=6XK4DQ940Z5J tag=TFRIR3WVDKM5 type=del size=934147 2024-03-04T12:26:46.344 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.338+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=IKM78G0VMY9L type=del size=1913004 2024-03-04T12:26:46.346 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.339+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~OMRLDXV11VA0.0 size=768464 2024-03-04T12:26:46.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.341+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=OMRLDXV11VA0 tag=1JS1HC0LPO97 type=write size=1817040 2024-03-04T12:26:46.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.342+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=H9FF2Y994WBK type=del size=2587072 2024-03-04T12:26:46.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.343+0000 7fa4b3c3e780 1 < completed write operation key=J53J0N99N30A tag=6KM25NZF8E60 type=write size=463431 2024-03-04T12:26:46.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.344+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=Y2210M8M8MH0 type=del size=2952763 2024-03-04T12:26:46.352 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.346+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=G2ACFA1KXNOT type=del 2024-03-04T12:26:46.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.348+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~I88D8BXV0KJ3.0 size=1048576 2024-03-04T12:26:46.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.349+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~I88D8BXV0KJ3.1 size=112864 2024-03-04T12:26:46.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.349+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=I88D8BXV0KJ3 tag=IMZDZKAQHHUC type=write size=2210016 2024-03-04T12:26:46.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.350+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~WJL100KE0O78.0 size=1048576 2024-03-04T12:26:46.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.351+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~WJL100KE0O78.1 size=313563 2024-03-04T12:26:46.360 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.353+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=WJL100KE0O78 tag=4MBPHF5Z5EC8 type=write size=2410715 2024-03-04T12:26:46.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.354+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=VUW1R9WPFKVZ type=write size=210565 2024-03-04T12:26:46.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.357+0000 7fa4b3c3e780 1 < suggested update operation key=H5FWRNK8F7QT tag=YRAWBVPUKIEN type=del size=3480914 2024-03-04T12:26:46.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.358+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=O9K9V2C58D36 type=write size=546032 2024-03-04T12:26:46.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.359+0000 7fa4b3c3e780 1 < completed delete operation key=GMIPCGYZRJ5L tag=RD2SWCE2M11J type=del 2024-03-04T12:26:46.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.361+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~AL7TLBLE0DDC.0 size=1048576 2024-03-04T12:26:46.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.362+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~AL7TLBLE0DDC.1 size=390481 2024-03-04T12:26:46.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.362+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=AL7TLBLE0DDC tag=LWZ79NACAYAW type=write size=2487633 2024-03-04T12:26:46.370 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.363+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~F412NUEWT089.0 size=1048576 2024-03-04T12:26:46.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.364+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~F412NUEWT089.1 size=790165 2024-03-04T12:26:46.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.366+0000 7fa4b3c3e780 1 < completed multipart upload key=NVMIU38VM9Q1 upload=F412NUEWT089 tag=L1TQ96F2NM3I type=write size=2887317 2024-03-04T12:26:46.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.367+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=Q9GGIYGSW8CV type=write size=129542 2024-03-04T12:26:46.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.369+0000 7fa4b3c3e780 1 < canceled operation key=ZETES4AYZQHY tag=70BAYXU3WWFM type=del size=2008735 2024-03-04T12:26:46.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.371+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~F8YXZJBZ1DNH.0 size=1048576 2024-03-04T12:26:46.378 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.372+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~F8YXZJBZ1DNH.1 size=5016 2024-03-04T12:26:46.378 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.372+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=F8YXZJBZ1DNH tag=SYWAIVY53JV0 type=write size=2102168 2024-03-04T12:26:46.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.373+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~F7FYIKXNCOAM.0 size=1048576 2024-03-04T12:26:46.380 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.374+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~F7FYIKXNCOAM.1 size=1048576 2024-03-04T12:26:46.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.374+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~F7FYIKXNCOAM.2 size=191641 2024-03-04T12:26:46.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.376+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=F7FYIKXNCOAM tag=CPUXD120N5AM type=write size=3337369 2024-03-04T12:26:46.384 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.377+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=CYPXNJYTLL64 type=del size=2869635 2024-03-04T12:26:46.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.379+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=80HGX698IZGM type=del 2024-03-04T12:26:46.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.380+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=YG1H2WZ41UAH type=del size=2127649 2024-03-04T12:26:46.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.381+0000 7fa4b3c3e780 1 < canceled operation key=X0RVLNRWUAEM tag=JILU9Q9V0PIW type=del size=2660965 2024-03-04T12:26:46.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.383+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~O7F0NIAQ42NW.0 size=1048576 2024-03-04T12:26:46.390 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.384+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~O7F0NIAQ42NW.1 size=1048576 2024-03-04T12:26:46.391 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.385+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~O7F0NIAQ42NW.2 size=741822 2024-03-04T12:26:46.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.385+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=O7F0NIAQ42NW tag=DU7TPF0U2NIT type=write size=3887550 2024-03-04T12:26:46.393 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.386+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~2HG1ZE0AAMEY.0 size=146421 2024-03-04T12:26:46.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.387+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=2HG1ZE0AAMEY tag=O8HFPHZ3OVXG type=write size=1194997 2024-03-04T12:26:46.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.389+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=D78Q8VCOM6J0 type=del size=1528231 2024-03-04T12:26:46.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.390+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=TW6NBI94OQX0 type=del 2024-03-04T12:26:46.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.391+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=XRC8Z2G1VJL2 type=del size=556980 2024-03-04T12:26:46.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.392+0000 7fa4b3c3e780 1 < completed delete operation key=G8G76PMSKJ0I tag=2IOPED60LKDW type=del 2024-03-04T12:26:46.401 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.395+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~KGIT5XL9YWGI.0 size=414548 2024-03-04T12:26:46.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.395+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=KGIT5XL9YWGI tag=1CU411PHRDLY type=write size=1463124 2024-03-04T12:26:46.403 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.396+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~9P8BSJVZAA8H.0 size=1048576 2024-03-04T12:26:46.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.397+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~9P8BSJVZAA8H.1 size=1048576 2024-03-04T12:26:46.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.397+0000 7fa4b3c3e780 1 < canceled part key=_multipart_4LKTYP07OL5L.2~9P8BSJVZAA8H.2 size=237139 2024-03-04T12:26:46.405 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.399+0000 7fa4b3c3e780 1 < canceled multipart upload key=4LKTYP07OL5L upload=9P8BSJVZAA8H tag=U0IYWHI6P4K1 type=write size=3382867 2024-03-04T12:26:46.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.401+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~UXKDDXE21MYQ.0 size=1048576 2024-03-04T12:26:46.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.401+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~UXKDDXE21MYQ.1 size=549096 2024-03-04T12:26:46.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.401+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=UXKDDXE21MYQ tag=S2IMDKPYHD1P type=write size=2646248 2024-03-04T12:26:46.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.403+0000 7fa4b3c3e780 1 < canceled operation key=6XK4DQ940Z5J tag=IKM78G0VMY9L type=del size=1913004 2024-03-04T12:26:46.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.405+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~63Z5YNFAFS50.0 size=1048576 2024-03-04T12:26:46.412 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.406+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~63Z5YNFAFS50.1 size=1048576 2024-03-04T12:26:46.413 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.406+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~63Z5YNFAFS50.2 size=195921 2024-03-04T12:26:46.413 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.406+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=63Z5YNFAFS50 tag=KVU0QPY3B4YT type=write size=3341649 2024-03-04T12:26:46.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.409+0000 7fa4b3c3e780 1 < suggested update operation key=V7N7MZ1GUNEV tag=H9FF2Y994WBK type=del size=2587072 2024-03-04T12:26:46.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.411+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~AAEH2AEW80B8.0 size=1048576 2024-03-04T12:26:46.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.411+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~AAEH2AEW80B8.1 size=590233 2024-03-04T12:26:46.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.411+0000 7fa4b3c3e780 1 > prepared multipart upload key=NVMIU38VM9Q1 upload=AAEH2AEW80B8 tag=OPOWZ7WABPRU type=write size=2687385 2024-03-04T12:26:46.419 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.413+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=Y2210M8M8MH0 type=del 2024-03-04T12:26:46.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.414+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=AJQSF6GTUXSY type=del size=723805 2024-03-04T12:26:46.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.415+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~I88D8BXV0KJ3.0 size=1048576 2024-03-04T12:26:46.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.416+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~I88D8BXV0KJ3.1 size=112864 2024-03-04T12:26:46.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.417+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=I88D8BXV0KJ3 tag=IMZDZKAQHHUC type=write size=2210016 2024-03-04T12:26:46.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.418+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=1YN1SDC6VU9J type=del size=716706 2024-03-04T12:26:46.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.420+0000 7fa4b3c3e780 1 < completed write operation key=43HMF7NWNMU3 tag=VUW1R9WPFKVZ type=write size=210565 2024-03-04T12:26:46.428 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.421+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=0WMVL9X6VEZB type=del size=232772 2024-03-04T12:26:46.429 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.422+0000 7fa4b3c3e780 1 < completed write operation key=BVMWQ9ZL4K0C tag=O9K9V2C58D36 type=write size=546032 2024-03-04T12:26:46.430 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.423+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=C45W1K0NQ6WZ type=del size=1953540 2024-03-04T12:26:46.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.424+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~AL7TLBLE0DDC.0 size=1048576 2024-03-04T12:26:46.432 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.425+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~AL7TLBLE0DDC.1 size=390481 2024-03-04T12:26:46.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.427+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=AL7TLBLE0DDC tag=LWZ79NACAYAW type=write size=2487633 2024-03-04T12:26:46.436 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.429+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~GTDQP1LCJ5YY.0 size=1048576 2024-03-04T12:26:46.436 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.430+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~GTDQP1LCJ5YY.1 size=1048576 2024-03-04T12:26:46.438 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.431+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~GTDQP1LCJ5YY.2 size=501288 2024-03-04T12:26:46.438 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.431+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=GTDQP1LCJ5YY tag=2309Z3CIM7FV type=write size=3647016 2024-03-04T12:26:46.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.432+0000 7fa4b3c3e780 1 < completed write operation key=GMIPCGYZRJ5L tag=Q9GGIYGSW8CV type=write size=129542 2024-03-04T12:26:46.441 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.434+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~PGSXDM8QEFSW.0 size=1048576 2024-03-04T12:26:46.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.435+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~PGSXDM8QEFSW.1 size=494854 2024-03-04T12:26:46.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.435+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=PGSXDM8QEFSW tag=2FJ4XX9UO5OJ type=write size=2592006 2024-03-04T12:26:46.444 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.437+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~F8YXZJBZ1DNH.0 size=1048576 2024-03-04T12:26:46.445 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.438+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~F8YXZJBZ1DNH.1 size=5016 2024-03-04T12:26:46.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.440+0000 7fa4b3c3e780 1 < completed multipart upload key=G70BJ2UARNCP upload=F8YXZJBZ1DNH tag=SYWAIVY53JV0 type=write size=2102168 2024-03-04T12:26:46.449 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.442+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~M7SVS5O5NBME.0 size=781639 2024-03-04T12:26:46.449 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.442+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=M7SVS5O5NBME tag=SDV48SOXRFS3 type=write size=1830215 2024-03-04T12:26:46.450 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.444+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=CYPXNJYTLL64 type=del 2024-03-04T12:26:46.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.446+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~6KJOYIU4WZAA.0 size=1048576 2024-03-04T12:26:46.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.447+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~6KJOYIU4WZAA.1 size=193296 2024-03-04T12:26:46.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.447+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=6KJOYIU4WZAA tag=KXLNDGBQ5OAW type=write size=2290448 2024-03-04T12:26:46.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.449+0000 7fa4b3c3e780 1 < suggested update operation key=KKQT9J9GSW0N tag=YG1H2WZ41UAH type=del size=2127649 2024-03-04T12:26:46.458 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.452+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~4Q274ZGA2SNW.0 size=1048576 2024-03-04T12:26:46.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.453+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~4Q274ZGA2SNW.1 size=1048576 2024-03-04T12:26:46.460 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.454+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~4Q274ZGA2SNW.2 size=214014 2024-03-04T12:26:46.460 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.454+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=4Q274ZGA2SNW tag=TRZ9KMG8OQJ7 type=write size=3359742 2024-03-04T12:26:46.462 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.455+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~O7F0NIAQ42NW.0 size=1048576 2024-03-04T12:26:46.463 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.456+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~O7F0NIAQ42NW.1 size=1048576 2024-03-04T12:26:46.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.457+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~O7F0NIAQ42NW.2 size=741822 2024-03-04T12:26:46.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.459+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=O7F0NIAQ42NW tag=DU7TPF0U2NIT type=write size=3887550 2024-03-04T12:26:46.468 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.462+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~UIL9USLTXIG9.0 size=1048576 2024-03-04T12:26:46.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.463+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~UIL9USLTXIG9.1 size=1048576 2024-03-04T12:26:46.470 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.463+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~UIL9USLTXIG9.2 size=692527 2024-03-04T12:26:46.470 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.464+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=UIL9USLTXIG9 tag=CI1AF5LLMCVJ type=write size=3838255 2024-03-04T12:26:46.473 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.466+0000 7fa4b3c3e780 1 < suggested remove operation key=R1DOKJPZRT5Q tag=D78Q8VCOM6J0 type=del 2024-03-04T12:26:46.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.468+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~VKH32393Z4GI.0 size=1048576 2024-03-04T12:26:46.476 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.469+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~VKH32393Z4GI.1 size=497740 2024-03-04T12:26:46.476 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.469+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=VKH32393Z4GI tag=D5I6EFNVDHS5 type=write size=2594892 2024-03-04T12:26:46.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.470+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=XRC8Z2G1VJL2 type=del 2024-03-04T12:26:46.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.472+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=EDYV1MBOA76L type=del size=1765765 2024-03-04T12:26:46.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.473+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~KGIT5XL9YWGI.0 size=414548 2024-03-04T12:26:46.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.475+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=KGIT5XL9YWGI tag=1CU411PHRDLY type=write size=1463124 2024-03-04T12:26:46.483 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.476+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=H9IJ79JMSOSI type=del size=3195788 2024-03-04T12:26:46.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.477+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~UXKDDXE21MYQ.0 size=1048576 2024-03-04T12:26:46.485 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.478+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~UXKDDXE21MYQ.1 size=549096 2024-03-04T12:26:46.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.480+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=UXKDDXE21MYQ tag=S2IMDKPYHD1P type=write size=2646248 2024-03-04T12:26:46.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.483+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~QPG79132TA3L.0 size=1048576 2024-03-04T12:26:46.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.484+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~QPG79132TA3L.1 size=1048576 2024-03-04T12:26:46.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.484+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~QPG79132TA3L.2 size=187681 2024-03-04T12:26:46.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.484+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=QPG79132TA3L tag=L3YIV5ZUSODX type=write size=3333409 2024-03-04T12:26:46.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.486+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~63Z5YNFAFS50.0 size=1048576 2024-03-04T12:26:46.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.486+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~63Z5YNFAFS50.1 size=1048576 2024-03-04T12:26:46.494 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.487+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~63Z5YNFAFS50.2 size=195921 2024-03-04T12:26:46.496 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.489+0000 7fa4b3c3e780 1 < completed multipart upload key=J53J0N99N30A upload=63Z5YNFAFS50 tag=KVU0QPY3B4YT type=write size=3341649 2024-03-04T12:26:46.497 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.490+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=0GEGA95HXSTP type=del size=2351990 2024-03-04T12:26:46.498 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.492+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~AAEH2AEW80B8.0 size=1048576 2024-03-04T12:26:46.499 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.493+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~AAEH2AEW80B8.1 size=590233 2024-03-04T12:26:46.501 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.494+0000 7fa4b3c3e780 1 < completed multipart upload key=NVMIU38VM9Q1 upload=AAEH2AEW80B8 tag=OPOWZ7WABPRU type=write size=2687385 2024-03-04T12:26:46.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.496+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=Y6G75AFBDU1P type=del size=292108 2024-03-04T12:26:46.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.498+0000 7fa4b3c3e780 1 < suggested remove operation key=GMIPCGYZRJ5L tag=AJQSF6GTUXSY type=del 2024-03-04T12:26:46.506 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.499+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=J8A8DHXIHCXT type=del size=886467 2024-03-04T12:26:46.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.502+0000 7fa4b3c3e780 1 < suggested remove operation key=WRHB3XWDLSY2 tag=1YN1SDC6VU9J type=del 2024-03-04T12:26:46.510 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.503+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=9CJAOXQ526AL type=del size=978191 2024-03-04T12:26:46.511 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.504+0000 7fa4b3c3e780 1 < canceled operation key=J53J0N99N30A tag=0WMVL9X6VEZB type=del size=232772 2024-03-04T12:26:46.512 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.505+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=XMDELKDMT57V type=del size=2786763 2024-03-04T12:26:46.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.506+0000 7fa4b3c3e780 1 < canceled operation key=YIS2SV4O5EZN tag=C45W1K0NQ6WZ type=del size=1953540 2024-03-04T12:26:46.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.508+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=IWKK3US1DGPJ type=del size=1921454 2024-03-04T12:26:46.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.509+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~GTDQP1LCJ5YY.0 size=1048576 2024-03-04T12:26:46.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.510+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~GTDQP1LCJ5YY.1 size=1048576 2024-03-04T12:26:46.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.511+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~GTDQP1LCJ5YY.2 size=501288 2024-03-04T12:26:46.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.513+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=GTDQP1LCJ5YY tag=2309Z3CIM7FV type=write size=3647016 2024-03-04T12:26:46.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.514+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=ACA2ULZN2W0Z type=write size=777310 2024-03-04T12:26:46.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.515+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~PGSXDM8QEFSW.0 size=1048576 2024-03-04T12:26:46.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.516+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~PGSXDM8QEFSW.1 size=494854 2024-03-04T12:26:46.524 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.518+0000 7fa4b3c3e780 1 < completed multipart upload key=G70BJ2UARNCP upload=PGSXDM8QEFSW tag=2FJ4XX9UO5OJ type=write size=2592006 2024-03-04T12:26:46.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.519+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~0PC17BIJC67B.0 size=164894 2024-03-04T12:26:46.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.519+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=0PC17BIJC67B tag=E5EUUK2U66C4 type=write size=1213470 2024-03-04T12:26:46.527 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.521+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~M7SVS5O5NBME.0 size=781639 2024-03-04T12:26:46.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.522+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=M7SVS5O5NBME tag=SDV48SOXRFS3 type=write size=1830215 2024-03-04T12:26:46.530 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.523+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=CXDTIYJIR6JG type=del size=3955529 2024-03-04T12:26:46.531 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.525+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~6KJOYIU4WZAA.0 size=1048576 2024-03-04T12:26:46.532 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.525+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~6KJOYIU4WZAA.1 size=193296 2024-03-04T12:26:46.534 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.527+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=6KJOYIU4WZAA tag=KXLNDGBQ5OAW type=write size=2290448 2024-03-04T12:26:46.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.528+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=LD6HIY8US4MQ type=write size=277861 2024-03-04T12:26:46.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.529+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~4Q274ZGA2SNW.0 size=1048576 2024-03-04T12:26:46.537 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.530+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~4Q274ZGA2SNW.1 size=1048576 2024-03-04T12:26:46.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.531+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~4Q274ZGA2SNW.2 size=214014 2024-03-04T12:26:46.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.533+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=4Q274ZGA2SNW tag=TRZ9KMG8OQJ7 type=write size=3359742 2024-03-04T12:26:46.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.534+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=QT0JDTVY26I8 type=del size=2388322 2024-03-04T12:26:46.542 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.535+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~UIL9USLTXIG9.0 size=1048576 2024-03-04T12:26:46.542 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.536+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~UIL9USLTXIG9.1 size=1048576 2024-03-04T12:26:46.543 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.537+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~UIL9USLTXIG9.2 size=692527 2024-03-04T12:26:46.545 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.539+0000 7fa4b3c3e780 1 < completed multipart upload key=4989OME3IAJF upload=UIL9USLTXIG9 tag=CI1AF5LLMCVJ type=write size=3838255 2024-03-04T12:26:46.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.540+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=LH9FGYL4CIEG type=del size=1526067 2024-03-04T12:26:46.548 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.541+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~VKH32393Z4GI.0 size=1048576 2024-03-04T12:26:46.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.542+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~VKH32393Z4GI.1 size=497740 2024-03-04T12:26:46.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.544+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=VKH32393Z4GI tag=D5I6EFNVDHS5 type=write size=2594892 2024-03-04T12:26:46.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.545+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=1DJWCNR9SMI1 type=del size=3957062 2024-03-04T12:26:46.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.546+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=EDYV1MBOA76L type=del 2024-03-04T12:26:46.555 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.548+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~MIFIWNYZV3YG.0 size=1048576 2024-03-04T12:26:46.556 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.549+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~MIFIWNYZV3YG.1 size=1048576 2024-03-04T12:26:46.557 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.550+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~MIFIWNYZV3YG.2 size=206221 2024-03-04T12:26:46.557 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.550+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=MIFIWNYZV3YG tag=GEZY94KKHLWF type=write size=3351949 2024-03-04T12:26:46.558 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.551+0000 7fa4b3c3e780 -1 < failed to complete operation key=GMIPCGYZRJ5L tag=H9IJ79JMSOSI type=del size=3195788: (22) Invalid argument 2024-03-04T12:26:46.559 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.553+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=IBH1R70QNYD1 type=del size=4068837 2024-03-04T12:26:46.560 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.554+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~QPG79132TA3L.0 size=1048576 2024-03-04T12:26:46.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.555+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~QPG79132TA3L.1 size=1048576 2024-03-04T12:26:46.563 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.556+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~QPG79132TA3L.2 size=187681 2024-03-04T12:26:46.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.558+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=QPG79132TA3L tag=L3YIV5ZUSODX type=write size=3333409 2024-03-04T12:26:46.566 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.559+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=60X61693OI0D type=del size=893223 2024-03-04T12:26:46.568 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.561+0000 7fa4b3c3e780 1 < suggested remove operation key=43HMF7NWNMU3 tag=0GEGA95HXSTP type=del 2024-03-04T12:26:46.570 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.563+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~AQBKM2RH7ZEM.0 size=28130 2024-03-04T12:26:46.570 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.563+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=AQBKM2RH7ZEM tag=X8W9RVD6EVPV type=write size=1076706 2024-03-04T12:26:46.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.564+0000 7fa4b3c3e780 1 < canceled operation key=YQLH0WW7I7MW tag=Y6G75AFBDU1P type=del size=292108 2024-03-04T12:26:46.572 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.565+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=O018NUTU8CYX type=del size=3792587 2024-03-04T12:26:46.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.567+0000 7fa4b3c3e780 -1 < failed to complete operation key=43HMF7NWNMU3 tag=J8A8DHXIHCXT type=del size=886467: (22) Invalid argument 2024-03-04T12:26:46.575 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.568+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=WV3XJI5JQA1N type=del size=4147178 2024-03-04T12:26:46.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.569+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=9CJAOXQ526AL type=del 2024-03-04T12:26:46.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.570+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=ZKK71OGST6DZ type=del size=2236853 2024-03-04T12:26:46.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.571+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=XMDELKDMT57V type=del 2024-03-04T12:26:46.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.573+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~34WA4JODC2G5.0 size=1048576 2024-03-04T12:26:46.581 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.574+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~34WA4JODC2G5.1 size=1048576 2024-03-04T12:26:46.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.575+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~34WA4JODC2G5.2 size=981184 2024-03-04T12:26:46.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.575+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=34WA4JODC2G5 tag=NDCCIZ18J4IH type=write size=4126912 2024-03-04T12:26:46.583 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.576+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=IWKK3US1DGPJ type=del 2024-03-04T12:26:46.585 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.578+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~SYX637UIJWOX.0 size=1048576 2024-03-04T12:26:46.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.579+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~SYX637UIJWOX.1 size=77647 2024-03-04T12:26:46.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.579+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=SYX637UIJWOX tag=QDU3XW1PX24U type=write size=2174799 2024-03-04T12:26:46.587 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.580+0000 7fa4b3c3e780 1 < completed write operation key=3TDMQXKLPX34 tag=ACA2ULZN2W0Z type=write size=777310 2024-03-04T12:26:46.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.582+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~2RADS0TNH2GD.0 size=1048576 2024-03-04T12:26:46.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.583+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~2RADS0TNH2GD.1 size=1048576 2024-03-04T12:26:46.591 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.584+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~2RADS0TNH2GD.2 size=41051 2024-03-04T12:26:46.591 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.584+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=2RADS0TNH2GD tag=KYFHFOTBBH4L type=write size=3186779 2024-03-04T12:26:46.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.585+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~0PC17BIJC67B.0 size=164894 2024-03-04T12:26:46.594 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.587+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=0PC17BIJC67B tag=E5EUUK2U66C4 type=write size=1213470 2024-03-04T12:26:46.595 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.588+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=E2M2FMUV14AP type=del size=2531949 2024-03-04T12:26:46.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.589+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=CXDTIYJIR6JG type=del 2024-03-04T12:26:46.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.590+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=D4WD7KQW1BM2 type=del size=1194353 2024-03-04T12:26:46.598 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.592+0000 7fa4b3c3e780 1 < completed write operation key=7IUV88NQLPN8 tag=LD6HIY8US4MQ type=write size=277861 2024-03-04T12:26:46.600 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.593+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=8REJHX2YWB18 type=del size=3789734 2024-03-04T12:26:46.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.595+0000 7fa4b3c3e780 1 < suggested update operation key=7IUV88NQLPN8 tag=QT0JDTVY26I8 type=del size=2388322 2024-03-04T12:26:46.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.596+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=WZRSIOR82ID3 type=del size=3275285 2024-03-04T12:26:46.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.597+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=LH9FGYL4CIEG type=del 2024-03-04T12:26:46.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.598+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=FSUDY4FCCVRI type=del size=338315 2024-03-04T12:26:46.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.600+0000 7fa4b3c3e780 1 < canceled operation key=UZRX3W3DE5VX tag=1DJWCNR9SMI1 type=del size=3957062 2024-03-04T12:26:46.608 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.601+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=NX575GU2HOPU type=del size=341370 2024-03-04T12:26:46.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.602+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~MIFIWNYZV3YG.0 size=1048576 2024-03-04T12:26:46.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.603+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~MIFIWNYZV3YG.1 size=1048576 2024-03-04T12:26:46.611 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.604+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~MIFIWNYZV3YG.2 size=206221 2024-03-04T12:26:46.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.607+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=MIFIWNYZV3YG tag=GEZY94KKHLWF type=write size=3351949 2024-03-04T12:26:46.615 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.608+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=07DV3AOAZ5GI type=del size=610266 2024-03-04T12:26:46.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.609+0000 7fa4b3c3e780 1 < completed delete operation key=UZRX3W3DE5VX tag=IBH1R70QNYD1 type=del 2024-03-04T12:26:46.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.611+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=79NV4VUIBB01 type=write size=826471 2024-03-04T12:26:46.620 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.613+0000 7fa4b3c3e780 1 < suggested remove operation key=4LKTYP07OL5L tag=60X61693OI0D type=del 2024-03-04T12:26:46.621 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.614+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=NGLQT731N0K0 type=del size=3825510 2024-03-04T12:26:46.622 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.615+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~AQBKM2RH7ZEM.0 size=28130 2024-03-04T12:26:46.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.617+0000 7fa4b3c3e780 1 < completed multipart upload key=ESHAMQWMMBJR upload=AQBKM2RH7ZEM tag=X8W9RVD6EVPV type=write size=1076706 2024-03-04T12:26:46.626 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.619+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~LEGC91L8Z5CY.0 size=25124 2024-03-04T12:26:46.626 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.619+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=LEGC91L8Z5CY tag=OISVYSEZO920 type=write size=1073700 2024-03-04T12:26:46.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.620+0000 7fa4b3c3e780 1 < canceled operation key=4989OME3IAJF tag=O018NUTU8CYX type=del size=3792587 2024-03-04T12:26:46.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.622+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~G6E7FN4N9Q4V.0 size=1048576 2024-03-04T12:26:46.630 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.623+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~G6E7FN4N9Q4V.1 size=1048576 2024-03-04T12:26:46.631 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.624+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~G6E7FN4N9Q4V.2 size=43728 2024-03-04T12:26:46.631 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.624+0000 7fa4b3c3e780 1 > prepared multipart upload key=4LKTYP07OL5L upload=G6E7FN4N9Q4V tag=1QJFDUV5W4YN type=write size=3189456 2024-03-04T12:26:46.632 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.625+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=WV3XJI5JQA1N type=del 2024-03-04T12:26:46.634 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.627+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~LF0DOBH87SQJ.0 size=1048576 2024-03-04T12:26:46.635 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.628+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~LF0DOBH87SQJ.1 size=1048576 2024-03-04T12:26:46.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.629+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~LF0DOBH87SQJ.2 size=4456 2024-03-04T12:26:46.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.629+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=LF0DOBH87SQJ tag=1MAV3CJ8EQLE type=write size=3150184 2024-03-04T12:26:46.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.630+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=ZKK71OGST6DZ type=del 2024-03-04T12:26:46.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.632+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~SKEOINVZB0GC.0 size=1048576 2024-03-04T12:26:46.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.632+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~SKEOINVZB0GC.1 size=367887 2024-03-04T12:26:46.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.632+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=SKEOINVZB0GC tag=214ET823EVN8 type=write size=2465039 2024-03-04T12:26:46.640 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.634+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~34WA4JODC2G5.0 size=1048576 2024-03-04T12:26:46.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.634+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~34WA4JODC2G5.1 size=1048576 2024-03-04T12:26:46.642 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.635+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~34WA4JODC2G5.2 size=981184 2024-03-04T12:26:46.644 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.638+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=34WA4JODC2G5 tag=NDCCIZ18J4IH type=write size=4126912 2024-03-04T12:26:46.647 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.640+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~4ZYL4V6XQ4ZY.0 size=1048576 2024-03-04T12:26:46.648 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.641+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~4ZYL4V6XQ4ZY.1 size=1048576 2024-03-04T12:26:46.649 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.642+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~4ZYL4V6XQ4ZY.2 size=910276 2024-03-04T12:26:46.649 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.642+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=4ZYL4V6XQ4ZY tag=JRDG2SCLPG0S type=write size=4056004 2024-03-04T12:26:46.649 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.642+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YQLH0WW7I7MW.2~SYX637UIJWOX.0 size=1048576 2024-03-04T12:26:46.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.643+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~SYX637UIJWOX.1 size=77647 2024-03-04T12:26:46.652 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.645+0000 7fa4b3c3e780 1 < canceled multipart upload key=YQLH0WW7I7MW upload=SYX637UIJWOX tag=QDU3XW1PX24U type=write size=2174799 2024-03-04T12:26:46.653 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.646+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=1C43PKVE63AO type=del size=4086237 2024-03-04T12:26:46.654 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.648+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~2RADS0TNH2GD.0 size=1048576 2024-03-04T12:26:46.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.648+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~2RADS0TNH2GD.1 size=1048576 2024-03-04T12:26:46.656 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.648+0000 7fa4b3c3e780 1 < canceled part key=_multipart_4989OME3IAJF.2~2RADS0TNH2GD.2 size=41051 2024-03-04T12:26:46.657 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.650+0000 7fa4b3c3e780 1 < canceled multipart upload key=4989OME3IAJF upload=2RADS0TNH2GD tag=KYFHFOTBBH4L type=write size=3186779 2024-03-04T12:26:46.658 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.651+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=OAZQ3U3C0HFW type=del size=2897697 2024-03-04T12:26:46.659 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.653+0000 7fa4b3c3e780 1 < completed delete operation key=X0RVLNRWUAEM tag=E2M2FMUV14AP type=del 2024-03-04T12:26:46.661 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.655+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~7XD504MU29LX.0 size=1048576 2024-03-04T12:26:46.662 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.655+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~7XD504MU29LX.1 size=1048576 2024-03-04T12:26:46.663 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.656+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~7XD504MU29LX.2 size=704342 2024-03-04T12:26:46.663 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.656+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=7XD504MU29LX tag=68EUYQ38R3UU type=write size=3850070 2024-03-04T12:26:46.664 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.657+0000 7fa4b3c3e780 1 < completed delete operation key=UZRX3W3DE5VX tag=D4WD7KQW1BM2 type=del 2024-03-04T12:26:46.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.659+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=X0WITW9ER7N4 type=write size=499316 2024-03-04T12:26:46.666 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.660+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=8REJHX2YWB18 type=del 2024-03-04T12:26:46.668 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.661+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=JVX41XZSCIFN type=del size=585531 2024-03-04T12:26:46.669 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.662+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=WZRSIOR82ID3 type=del 2024-03-04T12:26:46.671 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.664+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~NHKUWT8IG16L.0 size=1048576 2024-03-04T12:26:46.672 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.665+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~NHKUWT8IG16L.1 size=1048576 2024-03-04T12:26:46.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.666+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~NHKUWT8IG16L.2 size=160478 2024-03-04T12:26:46.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.666+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=NHKUWT8IG16L tag=0L3X9GQOKZFZ type=write size=3306206 2024-03-04T12:26:46.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.667+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=FSUDY4FCCVRI type=del 2024-03-04T12:26:46.676 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.669+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~PKZ7346SYNX2.0 size=63702 2024-03-04T12:26:46.676 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.669+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=PKZ7346SYNX2 tag=4QQ3KZDJSURC type=write size=1112278 2024-03-04T12:26:46.677 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.670+0000 7fa4b3c3e780 -1 < failed to complete operation key=4LKTYP07OL5L tag=NX575GU2HOPU type=del size=341370: (22) Invalid argument 2024-03-04T12:26:46.678 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.671+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=A4L3VBLQH2SU type=del size=4167025 2024-03-04T12:26:46.679 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.673+0000 7fa4b3c3e780 1 < canceled operation key=G4SUQFVB936T tag=07DV3AOAZ5GI type=del size=610266 2024-03-04T12:26:46.680 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.674+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=E6Q0AJC2FCDD type=del size=2732853 2024-03-04T12:26:46.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.675+0000 7fa4b3c3e780 1 < completed write operation key=RHU0QO8HS5SC tag=79NV4VUIBB01 type=write size=826471 2024-03-04T12:26:46.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.677+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~XFFNSP6AQM5B.0 size=1048576 2024-03-04T12:26:46.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.678+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~XFFNSP6AQM5B.1 size=552917 2024-03-04T12:26:46.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.678+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=XFFNSP6AQM5B tag=X3KMRCIOOLEV type=write size=2650069 2024-03-04T12:26:46.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.679+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=NGLQT731N0K0 type=del 2024-03-04T12:26:46.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.680+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=OHIUXE8XWGQK type=write size=139841 2024-03-04T12:26:46.688 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.681+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~LEGC91L8Z5CY.0 size=25124 2024-03-04T12:26:46.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.683+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=LEGC91L8Z5CY tag=OISVYSEZO920 type=write size=1073700 2024-03-04T12:26:46.691 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.684+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=TST0LAKQ94KV type=del size=1835849 2024-03-04T12:26:46.691 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.684+0000 7fa4b3c3e780 1 < canceled part key=_multipart_4LKTYP07OL5L.2~G6E7FN4N9Q4V.0 size=1048576 2024-03-04T12:26:46.692 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.685+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~G6E7FN4N9Q4V.1 size=1048576 2024-03-04T12:26:46.693 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.686+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~G6E7FN4N9Q4V.2 size=43728 2024-03-04T12:26:46.695 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.688+0000 7fa4b3c3e780 1 < canceled multipart upload key=4LKTYP07OL5L upload=G6E7FN4N9Q4V tag=1QJFDUV5W4YN type=write size=3189456 2024-03-04T12:26:46.696 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.689+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=C9UNTO60Q0CF type=del size=1846284 2024-03-04T12:26:46.697 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.690+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~LF0DOBH87SQJ.0 size=1048576 2024-03-04T12:26:46.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.691+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~LF0DOBH87SQJ.1 size=1048576 2024-03-04T12:26:46.699 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.692+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~LF0DOBH87SQJ.2 size=4456 2024-03-04T12:26:46.701 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.694+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=LF0DOBH87SQJ tag=1MAV3CJ8EQLE type=write size=3150184 2024-03-04T12:26:46.702 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.695+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=L2GADVYBEB5C type=del size=3529402 2024-03-04T12:26:46.702 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.696+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YQLH0WW7I7MW.2~SKEOINVZB0GC.0 size=1048576 2024-03-04T12:26:46.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.697+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~SKEOINVZB0GC.1 size=367887 2024-03-04T12:26:46.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.698+0000 7fa4b3c3e780 1 < canceled multipart upload key=YQLH0WW7I7MW upload=SKEOINVZB0GC tag=214ET823EVN8 type=write size=2465039 2024-03-04T12:26:46.706 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.699+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=YL4N89DUO0R5 type=del size=1960331 2024-03-04T12:26:46.707 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.701+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~4ZYL4V6XQ4ZY.0 size=1048576 2024-03-04T12:26:46.708 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.702+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~4ZYL4V6XQ4ZY.1 size=1048576 2024-03-04T12:26:46.709 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.702+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~4ZYL4V6XQ4ZY.2 size=910276 2024-03-04T12:26:46.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.704+0000 7fa4b3c3e780 1 < completed multipart upload key=J53J0N99N30A upload=4ZYL4V6XQ4ZY tag=JRDG2SCLPG0S type=write size=4056004 2024-03-04T12:26:46.712 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.706+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=B80XE8JQH5DB type=del size=3075753 2024-03-04T12:26:46.714 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.707+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=1C43PKVE63AO type=del 2024-03-04T12:26:46.715 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.709+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~BMAO8A8OAQU7.0 size=506965 2024-03-04T12:26:46.716 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.709+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=BMAO8A8OAQU7 tag=5GZC40KU1AF2 type=write size=1555541 2024-03-04T12:26:46.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.711+0000 7fa4b3c3e780 1 < canceled operation key=3N6E09QF3866 tag=OAZQ3U3C0HFW type=del size=2897697 2024-03-04T12:26:46.719 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.712+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=CEQRLTGBM1K0 type=del size=74437 2024-03-04T12:26:46.720 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.713+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~7XD504MU29LX.0 size=1048576 2024-03-04T12:26:46.721 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.714+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~7XD504MU29LX.1 size=1048576 2024-03-04T12:26:46.722 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.715+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~7XD504MU29LX.2 size=704342 2024-03-04T12:26:46.724 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.717+0000 7fa4b3c3e780 1 < completed multipart upload key=43HMF7NWNMU3 upload=7XD504MU29LX tag=68EUYQ38R3UU type=write size=3850070 2024-03-04T12:26:46.725 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.718+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=A1DQ43IV97O6 type=del size=1465883 2024-03-04T12:26:46.726 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.719+0000 7fa4b3c3e780 1 < completed write operation key=6XK4DQ940Z5J tag=X0WITW9ER7N4 type=write size=499316 2024-03-04T12:26:46.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.720+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=UH06A1T4I2W0 type=del size=3366780 2024-03-04T12:26:46.729 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.722+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=JVX41XZSCIFN type=del 2024-03-04T12:26:46.729 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.723+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=9JHVL0H66AE1 type=del size=293925 2024-03-04T12:26:46.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.724+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~NHKUWT8IG16L.0 size=1048576 2024-03-04T12:26:46.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.725+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~NHKUWT8IG16L.1 size=1048576 2024-03-04T12:26:46.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.726+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~NHKUWT8IG16L.2 size=160478 2024-03-04T12:26:46.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.728+0000 7fa4b3c3e780 1 < completed multipart upload key=H5FWRNK8F7QT upload=NHKUWT8IG16L tag=0L3X9GQOKZFZ type=write size=3306206 2024-03-04T12:26:46.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.730+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~5PHPD1I2D8QI.0 size=124084 2024-03-04T12:26:46.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.730+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=5PHPD1I2D8QI tag=KC3RLCDCB4BD type=write size=1172660 2024-03-04T12:26:46.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.731+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~PKZ7346SYNX2.0 size=63702 2024-03-04T12:26:46.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.733+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=PKZ7346SYNX2 tag=4QQ3KZDJSURC type=write size=1112278 2024-03-04T12:26:46.741 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.735+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=I50KZLXE4HVO type=del size=2056397 2024-03-04T12:26:46.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.736+0000 7fa4b3c3e780 1 < canceled operation key=43HMF7NWNMU3 tag=A4L3VBLQH2SU type=del size=4167025 2024-03-04T12:26:46.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.738+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~JH8Q0IZBC46P.0 size=1048576 2024-03-04T12:26:46.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.739+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~JH8Q0IZBC46P.1 size=12259 2024-03-04T12:26:46.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.739+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=JH8Q0IZBC46P tag=FA48H2HO0FEE type=write size=2109411 2024-03-04T12:26:46.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.742+0000 7fa4b3c3e780 1 < suggested update operation key=NVMIU38VM9Q1 tag=E6Q0AJC2FCDD type=del size=2732853 2024-03-04T12:26:46.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.744+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~UHLJRX3BBQSM.0 size=1029355 2024-03-04T12:26:46.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.744+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=UHLJRX3BBQSM tag=C90A4JEDNSCN type=write size=2077931 2024-03-04T12:26:46.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.745+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~XFFNSP6AQM5B.0 size=1048576 2024-03-04T12:26:46.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.746+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~XFFNSP6AQM5B.1 size=552917 2024-03-04T12:26:46.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.748+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=XFFNSP6AQM5B tag=X3KMRCIOOLEV type=write size=2650069 2024-03-04T12:26:46.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.749+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=R60IIB3K5A74 type=del size=1032069 2024-03-04T12:26:46.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.751+0000 7fa4b3c3e780 1 < completed write operation key=ZETES4AYZQHY tag=OHIUXE8XWGQK type=write size=139841 2024-03-04T12:26:46.759 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.752+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=ZAAS3I5X6VAP type=del size=2894991 2024-03-04T12:26:46.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.753+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=TST0LAKQ94KV type=del 2024-03-04T12:26:46.762 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.755+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~JSM3YIV7AJTI.0 size=1048576 2024-03-04T12:26:46.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.756+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~JSM3YIV7AJTI.1 size=569036 2024-03-04T12:26:46.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.756+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=JSM3YIV7AJTI tag=60GUUXS4E58I type=write size=2666188 2024-03-04T12:26:46.764 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.758+0000 7fa4b3c3e780 1 < completed delete operation key=R6Y09EO6HGF0 tag=C9UNTO60Q0CF type=del 2024-03-04T12:26:46.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.759+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=3MP474O8KUBA type=write size=396570 2024-03-04T12:26:46.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.760+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=L2GADVYBEB5C type=del 2024-03-04T12:26:46.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.762+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~EU4R5V200NV1.0 size=931502 2024-03-04T12:26:46.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.762+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=EU4R5V200NV1 tag=QBUEJMBLIZWH type=write size=1980078 2024-03-04T12:26:46.770 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.763+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=YL4N89DUO0R5 type=del 2024-03-04T12:26:46.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.765+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~ZZ8SYPSL30OH.0 size=1048576 2024-03-04T12:26:46.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.766+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~ZZ8SYPSL30OH.1 size=1048576 2024-03-04T12:26:46.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.767+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~ZZ8SYPSL30OH.2 size=485244 2024-03-04T12:26:46.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.767+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=ZZ8SYPSL30OH tag=ONT70VAJMAJK type=write size=3630972 2024-03-04T12:26:46.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.770+0000 7fa4b3c3e780 1 < suggested remove operation key=V7N7MZ1GUNEV tag=B80XE8JQH5DB type=del 2024-03-04T12:26:46.778 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.771+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=K3IULDPXUL8T type=del size=2967029 2024-03-04T12:26:46.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.772+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~BMAO8A8OAQU7.0 size=506965 2024-03-04T12:26:46.781 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.774+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=BMAO8A8OAQU7 tag=5GZC40KU1AF2 type=write size=1555541 2024-03-04T12:26:46.782 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.776+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=P0S0XZ516THX type=write size=832738 2024-03-04T12:26:46.784 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.777+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=CEQRLTGBM1K0 type=del 2024-03-04T12:26:46.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.779+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~H64LF84SRJ21.0 size=1048576 2024-03-04T12:26:46.787 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.780+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~H64LF84SRJ21.1 size=725511 2024-03-04T12:26:46.787 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.780+0000 7fa4b3c3e780 1 > prepared multipart upload key=G8G76PMSKJ0I upload=H64LF84SRJ21 tag=KEJC11E91YLN type=write size=2822663 2024-03-04T12:26:46.788 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.781+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=A1DQ43IV97O6 type=del 2024-03-04T12:26:46.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.782+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=1P1DK8H5MVRG type=write size=507172 2024-03-04T12:26:46.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.783+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=UH06A1T4I2W0 type=del 2024-03-04T12:26:46.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.786+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~DVMHOQUV0EBR.0 size=956113 2024-03-04T12:26:46.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.786+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=DVMHOQUV0EBR tag=3J02O2Q4W0BX type=write size=2004689 2024-03-04T12:26:46.795 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.788+0000 7fa4b3c3e780 1 < suggested remove operation key=3N6E09QF3866 tag=9JHVL0H66AE1 type=del 2024-03-04T12:26:46.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.790+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=VCL2RTR3AONP type=write size=978888 2024-03-04T12:26:46.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.791+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~5PHPD1I2D8QI.0 size=124084 2024-03-04T12:26:46.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.793+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=5PHPD1I2D8QI tag=KC3RLCDCB4BD type=write size=1172660 2024-03-04T12:26:46.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.794+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=I6BA3VCV9G8R type=del size=975829 2024-03-04T12:26:46.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.796+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=I50KZLXE4HVO type=del 2024-03-04T12:26:46.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.797+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=2MF7J6SS7KDQ type=del size=1132490 2024-03-04T12:26:46.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.798+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~JH8Q0IZBC46P.0 size=1048576 2024-03-04T12:26:46.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.799+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~JH8Q0IZBC46P.1 size=12259 2024-03-04T12:26:46.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.801+0000 7fa4b3c3e780 1 < completed multipart upload key=R1DOKJPZRT5Q upload=JH8Q0IZBC46P tag=FA48H2HO0FEE type=write size=2109411 2024-03-04T12:26:46.809 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.802+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=J3M7N6D4LE1M type=del size=2594654 2024-03-04T12:26:46.811 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.804+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~UHLJRX3BBQSM.0 size=1029355 2024-03-04T12:26:46.813 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.806+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=UHLJRX3BBQSM tag=C90A4JEDNSCN type=write size=2077931 2024-03-04T12:26:46.815 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.808+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~BZZLNFVCS1AN.0 size=1048576 2024-03-04T12:26:46.816 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.809+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~BZZLNFVCS1AN.1 size=585263 2024-03-04T12:26:46.816 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.809+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=BZZLNFVCS1AN tag=ECEAXRG3E3RH type=write size=2682415 2024-03-04T12:26:46.817 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.810+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=R60IIB3K5A74 type=del 2024-03-04T12:26:46.819 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.812+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~RLD3MMEOZ90Q.0 size=1048576 2024-03-04T12:26:46.820 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.813+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~RLD3MMEOZ90Q.1 size=350301 2024-03-04T12:26:46.820 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.813+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=RLD3MMEOZ90Q tag=H4LA372WF9FH type=write size=2447453 2024-03-04T12:26:46.821 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.815+0000 7fa4b3c3e780 1 < canceled operation key=G8G76PMSKJ0I tag=ZAAS3I5X6VAP type=del size=2894991 2024-03-04T12:26:46.823 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.816+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=8OGCYA0I1PQ8 type=del size=3298290 2024-03-04T12:26:46.824 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.817+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~JSM3YIV7AJTI.0 size=1048576 2024-03-04T12:26:46.825 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.818+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~JSM3YIV7AJTI.1 size=569036 2024-03-04T12:26:46.826 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.820+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=JSM3YIV7AJTI tag=60GUUXS4E58I type=write size=2666188 2024-03-04T12:26:46.828 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.821+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=IMEK1FNS6IH3 type=write size=654202 2024-03-04T12:26:46.829 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.822+0000 7fa4b3c3e780 1 < completed write operation key=G70BJ2UARNCP tag=3MP474O8KUBA type=write size=396570 2024-03-04T12:26:46.832 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.825+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=54B5JJ3PUKBG type=del size=1993427 2024-03-04T12:26:46.832 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.826+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~EU4R5V200NV1.0 size=931502 2024-03-04T12:26:46.834 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.828+0000 7fa4b3c3e780 1 < completed multipart upload key=H5FWRNK8F7QT upload=EU4R5V200NV1 tag=QBUEJMBLIZWH type=write size=1980078 2024-03-04T12:26:46.836 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.829+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=R2233EQCOTGZ type=write size=1018060 2024-03-04T12:26:46.837 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.830+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~ZZ8SYPSL30OH.0 size=1048576 2024-03-04T12:26:46.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.831+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~ZZ8SYPSL30OH.1 size=1048576 2024-03-04T12:26:46.839 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.832+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~ZZ8SYPSL30OH.2 size=485244 2024-03-04T12:26:46.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.834+0000 7fa4b3c3e780 1 < completed multipart upload key=43HMF7NWNMU3 upload=ZZ8SYPSL30OH tag=ONT70VAJMAJK type=write size=3630972 2024-03-04T12:26:46.842 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.835+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=LAFVGHSH7YYL type=write size=540446 2024-03-04T12:26:46.843 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.836+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=K3IULDPXUL8T type=del 2024-03-04T12:26:46.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.837+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=3EK07XLKZJNN type=del size=1200352 2024-03-04T12:26:46.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.838+0000 7fa4b3c3e780 1 < completed write operation key=4989OME3IAJF tag=P0S0XZ516THX type=write size=832738 2024-03-04T12:26:46.846 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.839+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=JT1AT5QXSBZ5 type=del size=447481 2024-03-04T12:26:46.848 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.841+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~H64LF84SRJ21.0 size=1048576 2024-03-04T12:26:46.848 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.842+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~H64LF84SRJ21.1 size=725511 2024-03-04T12:26:46.850 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.844+0000 7fa4b3c3e780 1 < completed multipart upload key=G8G76PMSKJ0I upload=H64LF84SRJ21 tag=KEJC11E91YLN type=write size=2822663 2024-03-04T12:26:46.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.845+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=I1N1R2JHY3PP type=del size=3830056 2024-03-04T12:26:46.853 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.846+0000 7fa4b3c3e780 1 < completed write operation key=GMIPCGYZRJ5L tag=1P1DK8H5MVRG type=write size=507172 2024-03-04T12:26:46.855 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.848+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~DCF9CG0F1PYY.0 size=915108 2024-03-04T12:26:46.855 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.848+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=DCF9CG0F1PYY tag=EUJ3CS9SJS91 type=write size=1963684 2024-03-04T12:26:46.856 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.850+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~DVMHOQUV0EBR.0 size=956113 2024-03-04T12:26:46.858 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.852+0000 7fa4b3c3e780 1 < completed multipart upload key=G70BJ2UARNCP upload=DVMHOQUV0EBR tag=3J02O2Q4W0BX type=write size=2004689 2024-03-04T12:26:46.859 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.853+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=92PGYP14379E type=del size=1335226 2024-03-04T12:26:46.861 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.854+0000 7fa4b3c3e780 1 < completed write operation key=YIS2SV4O5EZN tag=VCL2RTR3AONP type=write size=978888 2024-03-04T12:26:46.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.856+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~A9OP4G6SYV1B.0 size=425273 2024-03-04T12:26:46.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.856+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=A9OP4G6SYV1B tag=7TQCUWRREZUU type=write size=1473849 2024-03-04T12:26:46.864 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.858+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=I6BA3VCV9G8R type=del 2024-03-04T12:26:46.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.859+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=T469VVK38R27 type=del size=3190145 2024-03-04T12:26:46.869 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.862+0000 7fa4b3c3e780 1 < suggested remove operation key=ZETES4AYZQHY tag=2MF7J6SS7KDQ type=del 2024-03-04T12:26:46.870 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.863+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=JWYX4MAH1L4G type=del size=577351 2024-03-04T12:26:46.871 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.864+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=J3M7N6D4LE1M type=del 2024-03-04T12:26:46.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.865+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=8QAV9OBNGYAD type=del size=1210475 2024-03-04T12:26:46.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.866+0000 7fa4b3c3e780 1 < canceled part key=_multipart_4989OME3IAJF.2~BZZLNFVCS1AN.0 size=1048576 2024-03-04T12:26:46.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.867+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~BZZLNFVCS1AN.1 size=585263 2024-03-04T12:26:46.875 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.868+0000 7fa4b3c3e780 1 < canceled multipart upload key=4989OME3IAJF upload=BZZLNFVCS1AN tag=ECEAXRG3E3RH type=write size=2682415 2024-03-04T12:26:46.876 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.870+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=AIT6L9ROHQCY type=del size=435408 2024-03-04T12:26:46.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.871+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~RLD3MMEOZ90Q.0 size=1048576 2024-03-04T12:26:46.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.872+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~RLD3MMEOZ90Q.1 size=350301 2024-03-04T12:26:46.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.873+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=RLD3MMEOZ90Q tag=H4LA372WF9FH type=write size=2447453 2024-03-04T12:26:46.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.875+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~M58AEO5ETST4.0 size=1048576 2024-03-04T12:26:46.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.876+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~M58AEO5ETST4.1 size=176235 2024-03-04T12:26:46.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.876+0000 7fa4b3c3e780 1 > prepared multipart upload key=G4SUQFVB936T upload=M58AEO5ETST4 tag=ZCJMIZVQMKCA type=write size=2273387 2024-03-04T12:26:46.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.877+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=8OGCYA0I1PQ8 type=del 2024-03-04T12:26:46.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.879+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~AIIB99WTYP04.0 size=318511 2024-03-04T12:26:46.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.879+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=AIIB99WTYP04 tag=F8VGDYZ3M8Y9 type=write size=1367087 2024-03-04T12:26:46.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.881+0000 7fa4b3c3e780 1 < completed write operation key=BVMWQ9ZL4K0C tag=IMEK1FNS6IH3 type=write size=654202 2024-03-04T12:26:46.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.882+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=JWC2NMNWM1RN type=del size=368674 2024-03-04T12:26:46.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.883+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=54B5JJ3PUKBG type=del 2024-03-04T12:26:46.892 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.885+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~OXQLJRLAC11K.0 size=1048576 2024-03-04T12:26:46.892 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.886+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~OXQLJRLAC11K.1 size=1048576 2024-03-04T12:26:46.893 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.886+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~OXQLJRLAC11K.2 size=520593 2024-03-04T12:26:46.893 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.886+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=OXQLJRLAC11K tag=2VR6IOFP9URZ type=write size=3666321 2024-03-04T12:26:46.894 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.888+0000 7fa4b3c3e780 -1 < failed to complete operation key=ZETES4AYZQHY tag=R2233EQCOTGZ type=write size=1018060: (22) Invalid argument 2024-03-04T12:26:46.896 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.889+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~C34XE8V75GWL.0 size=477261 2024-03-04T12:26:46.896 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.889+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=C34XE8V75GWL tag=MMW66LJTJYFC type=write size=1525837 2024-03-04T12:26:46.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.892+0000 7fa4b3c3e780 1 < suggested remove operation key=YWJV4QMY6ZBI tag=LAFVGHSH7YYL type=write 2024-03-04T12:26:46.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.894+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~Z1W9J30CQC2W.0 size=772325 2024-03-04T12:26:46.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.894+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=Z1W9J30CQC2W tag=Y19TGZBF0PSJ type=write size=1820901 2024-03-04T12:26:46.903 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.896+0000 7fa4b3c3e780 1 < suggested remove operation key=V7N7MZ1GUNEV tag=3EK07XLKZJNN type=del 2024-03-04T12:26:46.904 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.897+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=EUVS40MNC3MM type=write size=604134 2024-03-04T12:26:46.905 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.898+0000 7fa4b3c3e780 1 < canceled operation key=J53J0N99N30A tag=JT1AT5QXSBZ5 type=del size=447481 2024-03-04T12:26:46.907 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.900+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~HH5HMUDXSW82.0 size=1048576 2024-03-04T12:26:46.908 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.901+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~HH5HMUDXSW82.1 size=688027 2024-03-04T12:26:46.908 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.901+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=HH5HMUDXSW82 tag=9N3T92F7Z7UK type=write size=2785179 2024-03-04T12:26:46.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.902+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=I1N1R2JHY3PP type=del 2024-03-04T12:26:46.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.904+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=1UGADQ45T0GZ type=del size=1909634 2024-03-04T12:26:46.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.905+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~DCF9CG0F1PYY.0 size=915108 2024-03-04T12:26:46.913 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.907+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=DCF9CG0F1PYY tag=EUJ3CS9SJS91 type=write size=1963684 2024-03-04T12:26:46.916 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.909+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~DIJC84YVUC91.0 size=461545 2024-03-04T12:26:46.916 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.909+0000 7fa4b3c3e780 1 > prepared multipart upload key=NVMIU38VM9Q1 upload=DIJC84YVUC91 tag=ARGC6T05BPO4 type=write size=1510121 2024-03-04T12:26:46.917 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.910+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=92PGYP14379E type=del 2024-03-04T12:26:46.919 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.912+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~DWW6Y1AS6748.0 size=906612 2024-03-04T12:26:46.919 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.912+0000 7fa4b3c3e780 1 > prepared multipart upload key=G4SUQFVB936T upload=DWW6Y1AS6748 tag=ICAAH5Q8E1SD type=write size=1955188 2024-03-04T12:26:46.920 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.914+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~A9OP4G6SYV1B.0 size=425273 2024-03-04T12:26:46.922 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.916+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=A9OP4G6SYV1B tag=7TQCUWRREZUU type=write size=1473849 2024-03-04T12:26:46.925 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.918+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~U44PMQOSPKAY.0 size=1048576 2024-03-04T12:26:46.925 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.919+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~U44PMQOSPKAY.1 size=1048576 2024-03-04T12:26:46.926 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.920+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~U44PMQOSPKAY.2 size=277887 2024-03-04T12:26:46.926 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.920+0000 7fa4b3c3e780 1 > prepared multipart upload key=NVMIU38VM9Q1 upload=U44PMQOSPKAY tag=PZ1OSIN1C0AQ type=write size=3423615 2024-03-04T12:26:46.928 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.921+0000 7fa4b3c3e780 1 < completed delete operation key=R1DOKJPZRT5Q tag=T469VVK38R27 type=del 2024-03-04T12:26:46.929 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.923+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~VDRLGHRGJCDX.0 size=468226 2024-03-04T12:26:46.929 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.923+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=VDRLGHRGJCDX tag=BQGZR78DM1FF type=write size=1516802 2024-03-04T12:26:46.932 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.925+0000 7fa4b3c3e780 1 < suggested update operation key=UZRX3W3DE5VX tag=JWYX4MAH1L4G type=del size=577351 2024-03-04T12:26:46.933 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.926+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=PN2UIY2VHR8T type=del size=886620 2024-03-04T12:26:46.934 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.927+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=8QAV9OBNGYAD type=del 2024-03-04T12:26:46.935 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.928+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=MVO76TIXEOP2 type=write size=523609 2024-03-04T12:26:46.936 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.930+0000 7fa4b3c3e780 1 < canceled operation key=4989OME3IAJF tag=AIT6L9ROHQCY type=del size=435408 2024-03-04T12:26:46.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.931+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=9ISWNU61E2C8 type=del size=2349609 2024-03-04T12:26:46.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.932+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~M58AEO5ETST4.0 size=1048576 2024-03-04T12:26:46.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.934+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~M58AEO5ETST4.1 size=176235 2024-03-04T12:26:46.943 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.936+0000 7fa4b3c3e780 1 < completed multipart upload key=G4SUQFVB936T upload=M58AEO5ETST4 tag=ZCJMIZVQMKCA type=write size=2273387 2024-03-04T12:26:46.944 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.937+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=S2LONSY96ZMX type=del size=1328426 2024-03-04T12:26:46.945 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.938+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~AIIB99WTYP04.0 size=318511 2024-03-04T12:26:46.947 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.940+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=AIIB99WTYP04 tag=F8VGDYZ3M8Y9 type=write size=1367087 2024-03-04T12:26:46.948 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.942+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=GOR4A035G0IS type=del size=224299 2024-03-04T12:26:46.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.943+0000 7fa4b3c3e780 1 < canceled operation key=RHU0QO8HS5SC tag=JWC2NMNWM1RN type=del size=368674 2024-03-04T12:26:46.951 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.944+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=U6B3DJKC67QC type=del size=3361947 2024-03-04T12:26:46.952 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.945+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~OXQLJRLAC11K.0 size=1048576 2024-03-04T12:26:46.952 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.945+0000 7fa4b3c3e780 1 < canceled part key=_multipart_T301TK0FIOG4.2~OXQLJRLAC11K.1 size=1048576 2024-03-04T12:26:46.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.946+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~OXQLJRLAC11K.2 size=520593 2024-03-04T12:26:46.955 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.948+0000 7fa4b3c3e780 1 < canceled multipart upload key=T301TK0FIOG4 upload=OXQLJRLAC11K tag=2VR6IOFP9URZ type=write size=3666321 2024-03-04T12:26:46.956 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.949+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=XJFYH1CCRJ2H type=del size=2991453 2024-03-04T12:26:46.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.950+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~C34XE8V75GWL.0 size=477261 2024-03-04T12:26:46.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.952+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=C34XE8V75GWL tag=MMW66LJTJYFC type=write size=1525837 2024-03-04T12:26:46.960 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.953+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=EA90EYS3WCB2 type=del size=1377949 2024-03-04T12:26:46.961 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.955+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~Z1W9J30CQC2W.0 size=772325 2024-03-04T12:26:46.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.957+0000 7fa4b3c3e780 1 < completed multipart upload key=4989OME3IAJF upload=Z1W9J30CQC2W tag=Y19TGZBF0PSJ type=write size=1820901 2024-03-04T12:26:46.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.958+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=SIJ6841QBUZX type=del size=215720 2024-03-04T12:26:46.966 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.959+0000 7fa4b3c3e780 1 < completed write operation key=WRHB3XWDLSY2 tag=EUVS40MNC3MM type=write size=604134 2024-03-04T12:26:46.968 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.961+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~V624Y2HHZCUX.0 size=1048576 2024-03-04T12:26:46.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.962+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~V624Y2HHZCUX.1 size=806768 2024-03-04T12:26:46.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.962+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=V624Y2HHZCUX tag=2ZUNHFN5CFNB type=write size=2903920 2024-03-04T12:26:46.970 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.963+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~HH5HMUDXSW82.0 size=1048576 2024-03-04T12:26:46.971 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.964+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~HH5HMUDXSW82.1 size=688027 2024-03-04T12:26:46.973 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.966+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=HH5HMUDXSW82 tag=9N3T92F7Z7UK type=write size=2785179 2024-03-04T12:26:46.975 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.968+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~GD7W1F8BVWUR.0 size=1048576 2024-03-04T12:26:46.976 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.969+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~GD7W1F8BVWUR.1 size=670495 2024-03-04T12:26:46.976 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.969+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=GD7W1F8BVWUR tag=PH4XM20VFOHM type=write size=2767647 2024-03-04T12:26:46.977 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.970+0000 7fa4b3c3e780 1 < completed delete operation key=R6Y09EO6HGF0 tag=1UGADQ45T0GZ type=del 2024-03-04T12:26:46.978 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.971+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=SOJ6V09DI3RC type=del size=1603756 2024-03-04T12:26:46.979 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.972+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~DIJC84YVUC91.0 size=461545 2024-03-04T12:26:46.981 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.974+0000 7fa4b3c3e780 1 < completed multipart upload key=NVMIU38VM9Q1 upload=DIJC84YVUC91 tag=ARGC6T05BPO4 type=write size=1510121 2024-03-04T12:26:46.982 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.975+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=O0IMZUUFPNB1 type=del size=1381729 2024-03-04T12:26:46.983 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.976+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~DWW6Y1AS6748.0 size=906612 2024-03-04T12:26:46.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.978+0000 7fa4b3c3e780 1 < completed multipart upload key=G4SUQFVB936T upload=DWW6Y1AS6748 tag=ICAAH5Q8E1SD type=write size=1955188 2024-03-04T12:26:46.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.980+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=MKTI13324XVH type=del size=3318638 2024-03-04T12:26:46.988 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.981+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~U44PMQOSPKAY.0 size=1048576 2024-03-04T12:26:46.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.982+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~U44PMQOSPKAY.1 size=1048576 2024-03-04T12:26:46.990 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.983+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~U44PMQOSPKAY.2 size=277887 2024-03-04T12:26:46.992 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.985+0000 7fa4b3c3e780 1 < completed multipart upload key=NVMIU38VM9Q1 upload=U44PMQOSPKAY tag=PZ1OSIN1C0AQ type=write size=3423615 2024-03-04T12:26:46.993 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.986+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=XIDSNRNBAO7E type=del size=3801449 2024-03-04T12:26:46.993 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.986+0000 7fa4b3c3e780 1 < canceled part key=_multipart_DHLTVH2AZBLR.2~VDRLGHRGJCDX.0 size=468226 2024-03-04T12:26:46.995 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.988+0000 7fa4b3c3e780 1 < canceled multipart upload key=DHLTVH2AZBLR upload=VDRLGHRGJCDX tag=BQGZR78DM1FF type=write size=1516802 2024-03-04T12:26:46.997 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.990+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~5ZCJD5KUHW3A.0 size=1048576 2024-03-04T12:26:46.998 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.991+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~5ZCJD5KUHW3A.1 size=573091 2024-03-04T12:26:46.998 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.991+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=5ZCJD5KUHW3A tag=CAYIBJH2WVE4 type=write size=2670243 2024-03-04T12:26:46.999 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.993+0000 7fa4b3c3e780 1 < canceled operation key=WRHB3XWDLSY2 tag=PN2UIY2VHR8T type=del size=886620 2024-03-04T12:26:47.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.994+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=TNKPP3RG09D1 type=write size=580925 2024-03-04T12:26:47.003 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.996+0000 7fa4b3c3e780 1 < suggested remove operation key=J53J0N99N30A tag=MVO76TIXEOP2 type=write 2024-03-04T12:26:47.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.997+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=12CY9N0LTQTH type=del size=2401812 2024-03-04T12:26:47.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.998+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=9ISWNU61E2C8 type=del 2024-03-04T12:26:47.006 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:46.999+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=PN46WVON0FO0 type=del size=3730605 2024-03-04T12:26:47.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.001+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=S2LONSY96ZMX type=del 2024-03-04T12:26:47.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.003+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~GIRFO6U1F45I.0 size=1048576 2024-03-04T12:26:47.010 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.004+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~GIRFO6U1F45I.1 size=237917 2024-03-04T12:26:47.010 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.004+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=GIRFO6U1F45I tag=AE77Q1QIT2O0 type=write size=2335069 2024-03-04T12:26:47.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.005+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=GOR4A035G0IS type=del 2024-03-04T12:26:47.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.006+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=JFEKZ8JKFK85 type=del size=2847082 2024-03-04T12:26:47.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.008+0000 7fa4b3c3e780 1 < suggested remove operation key=3TDMQXKLPX34 tag=U6B3DJKC67QC type=del 2024-03-04T12:26:47.017 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.010+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~X69HOYQWDBFV.0 size=56437 2024-03-04T12:26:47.017 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.010+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=X69HOYQWDBFV tag=EP931TU1UBQ2 type=write size=1105013 2024-03-04T12:26:47.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.012+0000 7fa4b3c3e780 1 < suggested remove operation key=KKQT9J9GSW0N tag=XJFYH1CCRJ2H type=del 2024-03-04T12:26:47.021 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.014+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~TYBQ4UFMR5GM.0 size=534888 2024-03-04T12:26:47.021 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.014+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=TYBQ4UFMR5GM tag=SV6SIPRMX8FO type=write size=1583464 2024-03-04T12:26:47.022 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.016+0000 7fa4b3c3e780 1 < completed delete operation key=G8G76PMSKJ0I tag=EA90EYS3WCB2 type=del 2024-03-04T12:26:47.023 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.017+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=SS7G85WDWGYF type=del size=1634427 2024-03-04T12:26:47.024 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.018+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=SIJ6841QBUZX type=del 2024-03-04T12:26:47.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.019+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=BB48P9GVVXDB type=del size=1467892 2024-03-04T12:26:47.027 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.020+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~V624Y2HHZCUX.0 size=1048576 2024-03-04T12:26:47.027 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.020+0000 7fa4b3c3e780 1 < canceled part key=_multipart_7IUV88NQLPN8.2~V624Y2HHZCUX.1 size=806768 2024-03-04T12:26:47.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.022+0000 7fa4b3c3e780 1 < canceled multipart upload key=7IUV88NQLPN8 upload=V624Y2HHZCUX tag=2ZUNHFN5CFNB type=write size=2903920 2024-03-04T12:26:47.030 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.023+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=TVH422VL04JN type=write size=722182 2024-03-04T12:26:47.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.024+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~GD7W1F8BVWUR.0 size=1048576 2024-03-04T12:26:47.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.024+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YIS2SV4O5EZN.2~GD7W1F8BVWUR.1 size=670495 2024-03-04T12:26:47.032 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.025+0000 7fa4b3c3e780 1 < canceled multipart upload key=YIS2SV4O5EZN upload=GD7W1F8BVWUR tag=PH4XM20VFOHM type=write size=2767647 2024-03-04T12:26:47.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.027+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~WCZZNO4CP78J.0 size=1048576 2024-03-04T12:26:47.035 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.028+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~WCZZNO4CP78J.1 size=1048576 2024-03-04T12:26:47.036 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.029+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~WCZZNO4CP78J.2 size=264807 2024-03-04T12:26:47.036 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.029+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=WCZZNO4CP78J tag=QMD984QRST8B type=write size=3410535 2024-03-04T12:26:47.037 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.030+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=SOJ6V09DI3RC type=del 2024-03-04T12:26:47.039 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.032+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~TY3DAP8TRXPE.0 size=432978 2024-03-04T12:26:47.039 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.032+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=TY3DAP8TRXPE tag=1IA0Q8AIZ4UN type=write size=1481554 2024-03-04T12:26:47.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.034+0000 7fa4b3c3e780 1 < suggested update operation key=NVMIU38VM9Q1 tag=O0IMZUUFPNB1 type=del size=1381729 2024-03-04T12:26:47.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.036+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=ZQ9R2Y3E1MJW type=del size=1759969 2024-03-04T12:26:47.044 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.037+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=MKTI13324XVH type=del 2024-03-04T12:26:47.045 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.039+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~5Q75EN3ER1YE.0 size=895997 2024-03-04T12:26:47.046 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.039+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=5Q75EN3ER1YE tag=QPUDCDFOQVZN type=write size=1944573 2024-03-04T12:26:47.048 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.041+0000 7fa4b3c3e780 -1 < failed to complete operation key=NVMIU38VM9Q1 tag=XIDSNRNBAO7E type=del size=3801449: (22) Invalid argument 2024-03-04T12:26:47.049 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.042+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=JGLZ77EMGBDW type=del size=4084958 2024-03-04T12:26:47.050 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.044+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~5ZCJD5KUHW3A.0 size=1048576 2024-03-04T12:26:47.051 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.044+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~5ZCJD5KUHW3A.1 size=573091 2024-03-04T12:26:47.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.046+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=5ZCJD5KUHW3A tag=CAYIBJH2WVE4 type=write size=2670243 2024-03-04T12:26:47.054 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.047+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=CS0KVL0MC7QF type=del size=4177318 2024-03-04T12:26:47.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.049+0000 7fa4b3c3e780 1 < suggested remove operation key=WRHB3XWDLSY2 tag=TNKPP3RG09D1 type=write 2024-03-04T12:26:47.058 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.051+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~EOF5SB2VAEFJ.0 size=965244 2024-03-04T12:26:47.058 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.051+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=EOF5SB2VAEFJ tag=E9STBXRLCYAN type=write size=2013820 2024-03-04T12:26:47.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.052+0000 7fa4b3c3e780 -1 < failed to complete operation key=NVMIU38VM9Q1 tag=12CY9N0LTQTH type=del size=2401812: (22) Invalid argument 2024-03-04T12:26:47.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.054+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=7WY0UR7HSZ0Z type=write size=650747 2024-03-04T12:26:47.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.055+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=PN46WVON0FO0 type=del 2024-03-04T12:26:47.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.056+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=I2LINMXXBUTJ type=del size=877131 2024-03-04T12:26:47.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.057+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~GIRFO6U1F45I.0 size=1048576 2024-03-04T12:26:47.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.058+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~GIRFO6U1F45I.1 size=237917 2024-03-04T12:26:47.066 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.060+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=GIRFO6U1F45I tag=AE77Q1QIT2O0 type=write size=2335069 2024-03-04T12:26:47.069 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.062+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~WB2Z0B2J6PEM.0 size=1048576 2024-03-04T12:26:47.069 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.063+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~WB2Z0B2J6PEM.1 size=874436 2024-03-04T12:26:47.069 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.063+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=WB2Z0B2J6PEM tag=3QFP4GKC4AO7 type=write size=2971588 2024-03-04T12:26:47.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.065+0000 7fa4b3c3e780 1 < suggested update operation key=R1DOKJPZRT5Q tag=JFEKZ8JKFK85 type=del size=2847082 2024-03-04T12:26:47.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.066+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=KUC1OLFXYTS1 type=write size=366874 2024-03-04T12:26:47.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.067+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~X69HOYQWDBFV.0 size=56437 2024-03-04T12:26:47.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.069+0000 7fa4b3c3e780 1 < completed multipart upload key=4989OME3IAJF upload=X69HOYQWDBFV tag=EP931TU1UBQ2 type=write size=1105013 2024-03-04T12:26:47.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.070+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=GIWO4WPB3RH5 type=del size=2211446 2024-03-04T12:26:47.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.071+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~TYBQ4UFMR5GM.0 size=534888 2024-03-04T12:26:47.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.073+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=TYBQ4UFMR5GM tag=SV6SIPRMX8FO type=write size=1583464 2024-03-04T12:26:47.081 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.074+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=AVGEXYL6K88T type=write size=269019 2024-03-04T12:26:47.082 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.075+0000 7fa4b3c3e780 -1 < failed to complete operation key=NVMIU38VM9Q1 tag=SS7G85WDWGYF type=del size=1634427: (22) Invalid argument 2024-03-04T12:26:47.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.077+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~HG979TYK2PTC.0 size=1048576 2024-03-04T12:26:47.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.078+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~HG979TYK2PTC.1 size=1048576 2024-03-04T12:26:47.086 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.079+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~HG979TYK2PTC.2 size=921634 2024-03-04T12:26:47.086 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.079+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=HG979TYK2PTC tag=C0IID9W7F6MT type=write size=4067362 2024-03-04T12:26:47.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.081+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=BB48P9GVVXDB type=del 2024-03-04T12:26:47.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.082+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=1C00U6MJ3RL4 type=del size=3078878 2024-03-04T12:26:47.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.084+0000 7fa4b3c3e780 1 < suggested remove operation key=GMIPCGYZRJ5L tag=TVH422VL04JN type=write 2024-03-04T12:26:47.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.085+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=FZCS5JQ07GSM type=del size=3815614 2024-03-04T12:26:47.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.086+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~WCZZNO4CP78J.0 size=1048576 2024-03-04T12:26:47.094 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.087+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~WCZZNO4CP78J.1 size=1048576 2024-03-04T12:26:47.095 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.088+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~WCZZNO4CP78J.2 size=264807 2024-03-04T12:26:47.097 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.090+0000 7fa4b3c3e780 1 < completed multipart upload key=4989OME3IAJF upload=WCZZNO4CP78J tag=QMD984QRST8B type=write size=3410535 2024-03-04T12:26:47.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.092+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~J7EEEIKWSWGF.0 size=932713 2024-03-04T12:26:47.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.092+0000 7fa4b3c3e780 1 > prepared multipart upload key=4LKTYP07OL5L upload=J7EEEIKWSWGF tag=NXKGAWQAPB7B type=write size=1981289 2024-03-04T12:26:47.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.093+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~TY3DAP8TRXPE.0 size=432978 2024-03-04T12:26:47.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.095+0000 7fa4b3c3e780 1 < completed multipart upload key=BVMWQ9ZL4K0C upload=TY3DAP8TRXPE tag=1IA0Q8AIZ4UN type=write size=1481554 2024-03-04T12:26:47.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.096+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=3964A3QVRFUW type=del size=1372293 2024-03-04T12:26:47.105 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.099+0000 7fa4b3c3e780 1 < suggested update operation key=G4SUQFVB936T tag=ZQ9R2Y3E1MJW type=del size=1759969 2024-03-04T12:26:47.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.100+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=3VQB8HQZ1FAT type=del size=1789324 2024-03-04T12:26:47.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.101+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~5Q75EN3ER1YE.0 size=895997 2024-03-04T12:26:47.110 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.103+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=5Q75EN3ER1YE tag=QPUDCDFOQVZN type=write size=1944573 2024-03-04T12:26:47.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.104+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=E2TE9PPO0CXC type=del size=3693217 2024-03-04T12:26:47.113 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.106+0000 7fa4b3c3e780 1 < suggested update operation key=ESHAMQWMMBJR tag=JGLZ77EMGBDW type=del size=4084958 2024-03-04T12:26:47.115 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.108+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~UXVV9LV2WQWV.0 size=601665 2024-03-04T12:26:47.115 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.108+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=UXVV9LV2WQWV tag=X09X4L38SZJ5 type=write size=1650241 2024-03-04T12:26:47.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.110+0000 7fa4b3c3e780 -1 < failed to complete operation key=ESHAMQWMMBJR tag=CS0KVL0MC7QF type=del size=4177318: (22) Invalid argument 2024-03-04T12:26:47.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.112+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~5KBBWWLHCHPG.0 size=1048576 2024-03-04T12:26:47.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.113+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~5KBBWWLHCHPG.1 size=1048576 2024-03-04T12:26:47.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.114+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~5KBBWWLHCHPG.2 size=101047 2024-03-04T12:26:47.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.114+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=5KBBWWLHCHPG tag=LSVP7DR3B7MC type=write size=3246775 2024-03-04T12:26:47.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.115+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~EOF5SB2VAEFJ.0 size=965244 2024-03-04T12:26:47.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.117+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=EOF5SB2VAEFJ tag=E9STBXRLCYAN type=write size=2013820 2024-03-04T12:26:47.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.119+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~L6RIK2P9XXE3.0 size=1048576 2024-03-04T12:26:47.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.120+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~L6RIK2P9XXE3.1 size=1001005 2024-03-04T12:26:47.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.120+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=L6RIK2P9XXE3 tag=0UGQB3I3PH46 type=write size=3098157 2024-03-04T12:26:47.128 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.122+0000 7fa4b3c3e780 1 < completed write operation key=43HMF7NWNMU3 tag=7WY0UR7HSZ0Z type=write size=650747 2024-03-04T12:26:47.131 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.124+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~6IX76DXQTHSA.0 size=1048576 2024-03-04T12:26:47.132 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.125+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~6IX76DXQTHSA.1 size=1048576 2024-03-04T12:26:47.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.126+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~6IX76DXQTHSA.2 size=292073 2024-03-04T12:26:47.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.126+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=6IX76DXQTHSA tag=ELNKZWKYXDIB type=write size=3437801 2024-03-04T12:26:47.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.127+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=I2LINMXXBUTJ type=del 2024-03-04T12:26:47.135 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.128+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=0GUP4L084TL8 type=del size=1521804 2024-03-04T12:26:47.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.130+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~WB2Z0B2J6PEM.0 size=1048576 2024-03-04T12:26:47.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.131+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~WB2Z0B2J6PEM.1 size=874436 2024-03-04T12:26:47.140 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.133+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=WB2Z0B2J6PEM tag=3QFP4GKC4AO7 type=write size=2971588 2024-03-04T12:26:47.142 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.135+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~AYORZB03ZM0B.0 size=146295 2024-03-04T12:26:47.142 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.135+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=AYORZB03ZM0B tag=Y0LJGQW6SA80 type=write size=1194871 2024-03-04T12:26:47.143 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.136+0000 7fa4b3c3e780 1 < completed write operation key=RHU0QO8HS5SC tag=KUC1OLFXYTS1 type=write size=366874 2024-03-04T12:26:47.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.138+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~3ESLK6ROGYL7.0 size=41963 2024-03-04T12:26:47.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.138+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=3ESLK6ROGYL7 tag=W4ZZ712XMF16 type=write size=1090539 2024-03-04T12:26:47.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.140+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=GIWO4WPB3RH5 type=del 2024-03-04T12:26:47.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.142+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~0JC2BUX71R03.0 size=1048576 2024-03-04T12:26:47.149 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.142+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~0JC2BUX71R03.1 size=1048576 2024-03-04T12:26:47.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.143+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~0JC2BUX71R03.2 size=358387 2024-03-04T12:26:47.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.143+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=0JC2BUX71R03 tag=WZOX7XXVHQO6 type=write size=3504115 2024-03-04T12:26:47.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.144+0000 7fa4b3c3e780 1 < completed write operation key=R6Y09EO6HGF0 tag=AVGEXYL6K88T type=write size=269019 2024-03-04T12:26:47.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.146+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=3Z98RL6DGZ4A type=del size=2111292 2024-03-04T12:26:47.154 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.147+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~HG979TYK2PTC.0 size=1048576 2024-03-04T12:26:47.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.148+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~HG979TYK2PTC.1 size=1048576 2024-03-04T12:26:47.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.148+0000 7fa4b3c3e780 1 < canceled part key=_multipart_RHU0QO8HS5SC.2~HG979TYK2PTC.2 size=921634 2024-03-04T12:26:47.157 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.150+0000 7fa4b3c3e780 1 < canceled multipart upload key=RHU0QO8HS5SC upload=HG979TYK2PTC tag=C0IID9W7F6MT type=write size=4067362 2024-03-04T12:26:47.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.152+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~QRVWKLH119YS.0 size=819358 2024-03-04T12:26:47.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.152+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=QRVWKLH119YS tag=TZ4H2V7EHCVF type=write size=1867934 2024-03-04T12:26:47.160 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.153+0000 7fa4b3c3e780 -1 < failed to complete operation key=ESHAMQWMMBJR tag=1C00U6MJ3RL4 type=del size=3078878: (22) Invalid argument 2024-03-04T12:26:47.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.155+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=WQVEKY78LXK9 type=del size=1487882 2024-03-04T12:26:47.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.156+0000 7fa4b3c3e780 -1 < failed to complete operation key=ESHAMQWMMBJR tag=FZCS5JQ07GSM type=del size=3815614: (22) Invalid argument 2024-03-04T12:26:47.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.157+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=1CVBAP79B5HN type=del size=903272 2024-03-04T12:26:47.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.158+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~J7EEEIKWSWGF.0 size=932713 2024-03-04T12:26:47.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.160+0000 7fa4b3c3e780 1 < completed multipart upload key=4LKTYP07OL5L upload=J7EEEIKWSWGF tag=NXKGAWQAPB7B type=write size=1981289 2024-03-04T12:26:47.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.162+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=2F4EBTY620IZ type=del size=3761745 2024-03-04T12:26:47.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.164+0000 7fa4b3c3e780 1 < suggested remove operation key=43HMF7NWNMU3 tag=3964A3QVRFUW type=del 2024-03-04T12:26:47.172 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.165+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=GP24287YTXCC type=del size=2326694 2024-03-04T12:26:47.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.166+0000 7fa4b3c3e780 1 < canceled operation key=KKQT9J9GSW0N tag=3VQB8HQZ1FAT type=del size=1789324 2024-03-04T12:26:47.176 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.169+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~OZYJKXTC2ZBK.0 size=1048576 2024-03-04T12:26:47.176 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.170+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~OZYJKXTC2ZBK.1 size=1048576 2024-03-04T12:26:47.177 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.170+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~OZYJKXTC2ZBK.2 size=460329 2024-03-04T12:26:47.177 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.170+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=OZYJKXTC2ZBK tag=E5GS0H40CHD1 type=write size=3606057 2024-03-04T12:26:47.179 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.172+0000 7fa4b3c3e780 1 < completed delete operation key=R1DOKJPZRT5Q tag=E2TE9PPO0CXC type=del 2024-03-04T12:26:47.180 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.173+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=K97M9OCRFDB6 type=del size=2661007 2024-03-04T12:26:47.180 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.173+0000 7fa4b3c3e780 1 < canceled part key=_multipart_GMIPCGYZRJ5L.2~UXVV9LV2WQWV.0 size=601665 2024-03-04T12:26:47.182 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.175+0000 7fa4b3c3e780 1 < canceled multipart upload key=GMIPCGYZRJ5L upload=UXVV9LV2WQWV tag=X09X4L38SZJ5 type=write size=1650241 2024-03-04T12:26:47.183 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.176+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=63012GWN2Y9F type=write size=502618 2024-03-04T12:26:47.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.178+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~5KBBWWLHCHPG.0 size=1048576 2024-03-04T12:26:47.185 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.178+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~5KBBWWLHCHPG.1 size=1048576 2024-03-04T12:26:47.186 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.179+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~5KBBWWLHCHPG.2 size=101047 2024-03-04T12:26:47.188 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.181+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=5KBBWWLHCHPG tag=LSVP7DR3B7MC type=write size=3246775 2024-03-04T12:26:47.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.182+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=FSS2XDMMJE11 type=del size=3236836 2024-03-04T12:26:47.190 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.183+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~L6RIK2P9XXE3.0 size=1048576 2024-03-04T12:26:47.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.184+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~L6RIK2P9XXE3.1 size=1001005 2024-03-04T12:26:47.193 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.186+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=L6RIK2P9XXE3 tag=0UGQB3I3PH46 type=write size=3098157 2024-03-04T12:26:47.195 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.188+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~TJ1R0XVR2P8I.0 size=1048576 2024-03-04T12:26:47.196 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.189+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~TJ1R0XVR2P8I.1 size=1048576 2024-03-04T12:26:47.197 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.190+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~TJ1R0XVR2P8I.2 size=616859 2024-03-04T12:26:47.197 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.190+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=TJ1R0XVR2P8I tag=V6SN23HZQGI4 type=write size=3762587 2024-03-04T12:26:47.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.191+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~6IX76DXQTHSA.0 size=1048576 2024-03-04T12:26:47.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.192+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~6IX76DXQTHSA.1 size=1048576 2024-03-04T12:26:47.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.193+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~6IX76DXQTHSA.2 size=292073 2024-03-04T12:26:47.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.195+0000 7fa4b3c3e780 1 < completed multipart upload key=V7N7MZ1GUNEV upload=6IX76DXQTHSA tag=ELNKZWKYXDIB type=write size=3437801 2024-03-04T12:26:47.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.196+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=0GM6K4PPM7JV type=del size=1269721 2024-03-04T12:26:47.204 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.197+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=0GUP4L084TL8 type=del 2024-03-04T12:26:47.205 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.198+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=3KPL188WUZWD type=del size=1280484 2024-03-04T12:26:47.205 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.198+0000 7fa4b3c3e780 1 < canceled part key=_multipart_KKQT9J9GSW0N.2~AYORZB03ZM0B.0 size=146295 2024-03-04T12:26:47.207 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.200+0000 7fa4b3c3e780 1 < canceled multipart upload key=KKQT9J9GSW0N upload=AYORZB03ZM0B tag=Y0LJGQW6SA80 type=write size=1194871 2024-03-04T12:26:47.208 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.201+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=UHHFA44TQGB6 type=del size=2144672 2024-03-04T12:26:47.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.202+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~3ESLK6ROGYL7.0 size=41963 2024-03-04T12:26:47.211 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.204+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=3ESLK6ROGYL7 tag=W4ZZ712XMF16 type=write size=1090539 2024-03-04T12:26:47.212 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.205+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=K0XNDUX5MLZQ type=del size=601837 2024-03-04T12:26:47.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.207+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~0JC2BUX71R03.0 size=1048576 2024-03-04T12:26:47.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.207+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~0JC2BUX71R03.1 size=1048576 2024-03-04T12:26:47.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.208+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~0JC2BUX71R03.2 size=358387 2024-03-04T12:26:47.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.210+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=0JC2BUX71R03 tag=WZOX7XXVHQO6 type=write size=3504115 2024-03-04T12:26:47.219 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.212+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~IW752LPE0T6M.0 size=1048576 2024-03-04T12:26:47.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.213+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~IW752LPE0T6M.1 size=1048576 2024-03-04T12:26:47.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.214+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~IW752LPE0T6M.2 size=724144 2024-03-04T12:26:47.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.214+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=IW752LPE0T6M tag=0ZZGB2QOHU0E type=write size=3869872 2024-03-04T12:26:47.222 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.215+0000 7fa4b3c3e780 1 < completed delete operation key=X0RVLNRWUAEM tag=3Z98RL6DGZ4A type=del 2024-03-04T12:26:47.225 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.218+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~J1ACCC85HAJV.0 size=781198 2024-03-04T12:26:47.225 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.218+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=J1ACCC85HAJV tag=76NDE4SXL32C type=write size=1829774 2024-03-04T12:26:47.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.219+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~QRVWKLH119YS.0 size=819358 2024-03-04T12:26:47.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.221+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=QRVWKLH119YS tag=TZ4H2V7EHCVF type=write size=1867934 2024-03-04T12:26:47.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.222+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=XCD1AA815AE8 type=del size=1956179 2024-03-04T12:26:47.231 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.224+0000 7fa4b3c3e780 1 < suggested remove operation key=NVMIU38VM9Q1 tag=WQVEKY78LXK9 type=del 2024-03-04T12:26:47.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.226+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~6V0WU1LFH05L.0 size=1048576 2024-03-04T12:26:47.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.227+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~6V0WU1LFH05L.1 size=1048576 2024-03-04T12:26:47.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.228+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~6V0WU1LFH05L.2 size=903060 2024-03-04T12:26:47.235 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.228+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=6V0WU1LFH05L tag=OQWIQUDN32SR type=write size=4048788 2024-03-04T12:26:47.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.230+0000 7fa4b3c3e780 1 < suggested remove operation key=V7N7MZ1GUNEV tag=1CVBAP79B5HN type=del 2024-03-04T12:26:47.238 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.231+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=LER3NXZUHJWV type=del size=2709496 2024-03-04T12:26:47.239 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.232+0000 7fa4b3c3e780 1 < canceled operation key=7IUV88NQLPN8 tag=2F4EBTY620IZ type=del size=3761745 2024-03-04T12:26:47.240 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.234+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=AK5WND33OK2U type=del size=4188615 2024-03-04T12:26:47.242 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.235+0000 7fa4b3c3e780 1 < completed delete operation key=G8G76PMSKJ0I tag=GP24287YTXCC type=del 2024-03-04T12:26:47.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.236+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=MYK1S92YN3R5 type=del size=334551 2024-03-04T12:26:47.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.237+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~OZYJKXTC2ZBK.0 size=1048576 2024-03-04T12:26:47.245 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.238+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~OZYJKXTC2ZBK.1 size=1048576 2024-03-04T12:26:47.245 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.238+0000 7fa4b3c3e780 1 < canceled part key=_multipart_UZRX3W3DE5VX.2~OZYJKXTC2ZBK.2 size=460329 2024-03-04T12:26:47.247 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.240+0000 7fa4b3c3e780 1 < canceled multipart upload key=UZRX3W3DE5VX upload=OZYJKXTC2ZBK tag=E5GS0H40CHD1 type=write size=3606057 2024-03-04T12:26:47.248 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.242+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=OBLMG31YYISM type=del size=1422704 2024-03-04T12:26:47.250 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.243+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=K97M9OCRFDB6 type=del 2024-03-04T12:26:47.251 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.244+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=HV9ZVL9YLU63 type=del size=551274 2024-03-04T12:26:47.252 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.245+0000 7fa4b3c3e780 1 < completed write operation key=KKQT9J9GSW0N tag=63012GWN2Y9F type=write size=502618 2024-03-04T12:26:47.253 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.247+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=MVZ9ODM8L3RU type=write size=412467 2024-03-04T12:26:47.255 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.248+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=FSS2XDMMJE11 type=del 2024-03-04T12:26:47.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.250+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~QK39NND2L44Q.0 size=712636 2024-03-04T12:26:47.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.250+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=QK39NND2L44Q tag=73S1L31OSRU7 type=write size=1761212 2024-03-04T12:26:47.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.251+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~TJ1R0XVR2P8I.0 size=1048576 2024-03-04T12:26:47.259 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.252+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~TJ1R0XVR2P8I.1 size=1048576 2024-03-04T12:26:47.260 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.253+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~TJ1R0XVR2P8I.2 size=616859 2024-03-04T12:26:47.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.256+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=TJ1R0XVR2P8I tag=V6SN23HZQGI4 type=write size=3762587 2024-03-04T12:26:47.264 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.257+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=SI24QVIZJYOP type=del size=3583632 2024-03-04T12:26:47.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.258+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=0GM6K4PPM7JV type=del 2024-03-04T12:26:47.266 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.259+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=5N3LYQKU23UL type=del size=2453184 2024-03-04T12:26:47.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.261+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=3KPL188WUZWD type=del 2024-03-04T12:26:47.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.263+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~9OHHQI2HOU01.0 size=864458 2024-03-04T12:26:47.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.263+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=9OHHQI2HOU01 tag=NUG6MJISPV30 type=write size=1913034 2024-03-04T12:26:47.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.264+0000 7fa4b3c3e780 1 < completed delete operation key=YWJV4QMY6ZBI tag=UHHFA44TQGB6 type=del 2024-03-04T12:26:47.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.265+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=EXH0K7M9XCPE type=del size=2024046 2024-03-04T12:26:47.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.266+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=K0XNDUX5MLZQ type=del 2024-03-04T12:26:47.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.267+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=60R3WXDI1U27 type=del size=271775 2024-03-04T12:26:47.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.268+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~IW752LPE0T6M.0 size=1048576 2024-03-04T12:26:47.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.269+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~IW752LPE0T6M.1 size=1048576 2024-03-04T12:26:47.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.270+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~IW752LPE0T6M.2 size=724144 2024-03-04T12:26:47.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.272+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=IW752LPE0T6M tag=0ZZGB2QOHU0E type=write size=3869872 2024-03-04T12:26:47.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.274+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~7GPHHT8S0JCP.0 size=1048576 2024-03-04T12:26:47.282 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.275+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~7GPHHT8S0JCP.1 size=1048576 2024-03-04T12:26:47.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.276+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~7GPHHT8S0JCP.2 size=398928 2024-03-04T12:26:47.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.276+0000 7fa4b3c3e780 1 > prepared multipart upload key=NVMIU38VM9Q1 upload=7GPHHT8S0JCP tag=2P6YAMV4CCAF type=write size=3544656 2024-03-04T12:26:47.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.276+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YWJV4QMY6ZBI.2~J1ACCC85HAJV.0 size=781198 2024-03-04T12:26:47.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.278+0000 7fa4b3c3e780 1 < canceled multipart upload key=YWJV4QMY6ZBI upload=J1ACCC85HAJV tag=76NDE4SXL32C type=write size=1829774 2024-03-04T12:26:47.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.279+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=3QSVBQBS1CQV type=del size=1473408 2024-03-04T12:26:47.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.280+0000 7fa4b3c3e780 -1 < failed to complete operation key=NVMIU38VM9Q1 tag=XCD1AA815AE8 type=del size=1956179: (22) Invalid argument 2024-03-04T12:26:47.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.282+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=YAA4NPAWZU8P type=del size=2356427 2024-03-04T12:26:47.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.283+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~6V0WU1LFH05L.0 size=1048576 2024-03-04T12:26:47.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.284+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~6V0WU1LFH05L.1 size=1048576 2024-03-04T12:26:47.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.285+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~6V0WU1LFH05L.2 size=903060 2024-03-04T12:26:47.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.287+0000 7fa4b3c3e780 1 < completed multipart upload key=V7N7MZ1GUNEV upload=6V0WU1LFH05L tag=OQWIQUDN32SR type=write size=4048788 2024-03-04T12:26:47.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.288+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=P3BBKRMJSIUE type=del size=205016 2024-03-04T12:26:47.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.289+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=LER3NXZUHJWV type=del 2024-03-04T12:26:47.297 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.290+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=WRAVI5T1RLO6 type=del size=144859 2024-03-04T12:26:47.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.291+0000 7fa4b3c3e780 1 < completed delete operation key=X0RVLNRWUAEM tag=AK5WND33OK2U type=del 2024-03-04T12:26:47.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.292+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=GWKY1JX22E0L type=write size=565663 2024-03-04T12:26:47.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.295+0000 7fa4b3c3e780 1 < suggested remove operation key=ESHAMQWMMBJR tag=MYK1S92YN3R5 type=del 2024-03-04T12:26:47.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.297+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~X4TQ608KQJHE.0 size=148385 2024-03-04T12:26:47.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.297+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=X4TQ608KQJHE tag=Z2D5QMQGIJRH type=write size=1196961 2024-03-04T12:26:47.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.298+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=OBLMG31YYISM type=del 2024-03-04T12:26:47.306 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.299+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=HPLNKC3PJ0XS type=del size=218134 2024-03-04T12:26:47.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.300+0000 7fa4b3c3e780 1 < completed delete operation key=X0RVLNRWUAEM tag=HV9ZVL9YLU63 type=del 2024-03-04T12:26:47.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.301+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=004KCP655YIY type=del size=111571 2024-03-04T12:26:47.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.303+0000 7fa4b3c3e780 1 < suggested remove operation key=J53J0N99N30A tag=MVZ9ODM8L3RU type=write 2024-03-04T12:26:47.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.305+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~J2T78PB08ACB.0 size=311178 2024-03-04T12:26:47.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.305+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=J2T78PB08ACB tag=9974SQG6N913 type=write size=1359754 2024-03-04T12:26:47.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.306+0000 7fa4b3c3e780 1 < canceled part key=_multipart_J53J0N99N30A.2~QK39NND2L44Q.0 size=712636 2024-03-04T12:26:47.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.308+0000 7fa4b3c3e780 1 < canceled multipart upload key=J53J0N99N30A upload=QK39NND2L44Q tag=73S1L31OSRU7 type=write size=1761212 2024-03-04T12:26:47.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.309+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=2LG0EHRDKXT1 type=del size=2870876 2024-03-04T12:26:47.317 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.310+0000 7fa4b3c3e780 1 < completed delete operation key=UZRX3W3DE5VX tag=SI24QVIZJYOP type=del 2024-03-04T12:26:47.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.312+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~FZS7UJW3KLLF.0 size=1048576 2024-03-04T12:26:47.320 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.313+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~FZS7UJW3KLLF.1 size=492544 2024-03-04T12:26:47.320 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.313+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=FZS7UJW3KLLF tag=UBRBCWV1W2ZS type=write size=2589696 2024-03-04T12:26:47.321 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.314+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=5N3LYQKU23UL type=del 2024-03-04T12:26:47.323 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.316+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~NNK4RGLE9G3S.0 size=1048576 2024-03-04T12:26:47.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.317+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~NNK4RGLE9G3S.1 size=731361 2024-03-04T12:26:47.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.317+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=NNK4RGLE9G3S tag=4TUBE3BA1XGF type=write size=2828513 2024-03-04T12:26:47.325 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.318+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~9OHHQI2HOU01.0 size=864458 2024-03-04T12:26:47.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.320+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=9OHHQI2HOU01 tag=NUG6MJISPV30 type=write size=1913034 2024-03-04T12:26:47.328 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.321+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=MI0G8R3QIGXF type=write size=401324 2024-03-04T12:26:47.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.322+0000 7fa4b3c3e780 1 < canceled operation key=R1DOKJPZRT5Q tag=EXH0K7M9XCPE type=del size=2024046 2024-03-04T12:26:47.330 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.324+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=KL2J9NNO2YXN type=write size=746752 2024-03-04T12:26:47.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.325+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=60R3WXDI1U27 type=del 2024-03-04T12:26:47.333 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.326+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=3ZXQDQRKT52J type=del size=3087553 2024-03-04T12:26:47.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.327+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~7GPHHT8S0JCP.0 size=1048576 2024-03-04T12:26:47.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.328+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~7GPHHT8S0JCP.1 size=1048576 2024-03-04T12:26:47.336 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.329+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~7GPHHT8S0JCP.2 size=398928 2024-03-04T12:26:47.338 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.331+0000 7fa4b3c3e780 1 < completed multipart upload key=NVMIU38VM9Q1 upload=7GPHHT8S0JCP tag=2P6YAMV4CCAF type=write size=3544656 2024-03-04T12:26:47.339 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.332+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=S9PJWWRTVHL0 type=del size=1762545 2024-03-04T12:26:47.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.334+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=3QSVBQBS1CQV type=del 2024-03-04T12:26:47.342 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.335+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=NKXOLG6B50PV type=del size=2681353 2024-03-04T12:26:47.343 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.336+0000 7fa4b3c3e780 1 < completed delete operation key=G8G76PMSKJ0I tag=YAA4NPAWZU8P type=del 2024-03-04T12:26:47.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.338+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~OCPD6KWIJ7XE.0 size=269248 2024-03-04T12:26:47.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.338+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=OCPD6KWIJ7XE tag=8R90NQR0VBUK type=write size=1317824 2024-03-04T12:26:47.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.340+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=P3BBKRMJSIUE type=del 2024-03-04T12:26:47.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.342+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~XPZ8I9C594Z5.0 size=1048576 2024-03-04T12:26:47.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.343+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~XPZ8I9C594Z5.1 size=1048576 2024-03-04T12:26:47.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.344+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~XPZ8I9C594Z5.2 size=614601 2024-03-04T12:26:47.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.344+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=XPZ8I9C594Z5 tag=XPVCMD9N6JTU type=write size=3760329 2024-03-04T12:26:47.352 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.345+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=WRAVI5T1RLO6 type=del 2024-03-04T12:26:47.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.346+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=BGFR0QH4E7J2 type=del size=1145457 2024-03-04T12:26:47.354 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.347+0000 7fa4b3c3e780 1 < completed write operation key=YIS2SV4O5EZN tag=GWKY1JX22E0L type=write size=565663 2024-03-04T12:26:47.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.350+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~TN7DGHP3L5NH.0 size=1048576 2024-03-04T12:26:47.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.351+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~TN7DGHP3L5NH.1 size=392528 2024-03-04T12:26:47.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.351+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=TN7DGHP3L5NH tag=P79JUQ0DEIU0 type=write size=2489680 2024-03-04T12:26:47.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.353+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~X4TQ608KQJHE.0 size=148385 2024-03-04T12:26:47.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.354+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=X4TQ608KQJHE tag=Z2D5QMQGIJRH type=write size=1196961 2024-03-04T12:26:47.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.356+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=6T3CYZ0RL4PE type=del size=632094 2024-03-04T12:26:47.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.357+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=HPLNKC3PJ0XS type=del 2024-03-04T12:26:47.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.358+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=PIC52T811QYS type=del size=3290038 2024-03-04T12:26:47.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.359+0000 7fa4b3c3e780 1 < completed delete operation key=RHU0QO8HS5SC tag=004KCP655YIY type=del 2024-03-04T12:26:47.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.361+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~1LJPVJEVDW8O.0 size=38780 2024-03-04T12:26:47.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.361+0000 7fa4b3c3e780 1 > prepared multipart upload key=4LKTYP07OL5L upload=1LJPVJEVDW8O tag=PB59EECHOXZT type=write size=1087356 2024-03-04T12:26:47.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.362+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~J2T78PB08ACB.0 size=311178 2024-03-04T12:26:47.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.364+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=J2T78PB08ACB tag=9974SQG6N913 type=write size=1359754 2024-03-04T12:26:47.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.367+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=LGWU8XS1LQTG type=del size=1341208 2024-03-04T12:26:47.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.368+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=2LG0EHRDKXT1 type=del 2024-03-04T12:26:47.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.369+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=7KMY624Y10JL type=del size=2903450 2024-03-04T12:26:47.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.370+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~FZS7UJW3KLLF.0 size=1048576 2024-03-04T12:26:47.378 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.371+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~FZS7UJW3KLLF.1 size=492544 2024-03-04T12:26:47.380 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.373+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=FZS7UJW3KLLF tag=UBRBCWV1W2ZS type=write size=2589696 2024-03-04T12:26:47.382 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.375+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~R8OMLTSK661B.0 size=1048576 2024-03-04T12:26:47.382 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.376+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~R8OMLTSK661B.1 size=99448 2024-03-04T12:26:47.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.376+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=R8OMLTSK661B tag=2JFX421F2GVL type=write size=2196600 2024-03-04T12:26:47.384 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.377+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~NNK4RGLE9G3S.0 size=1048576 2024-03-04T12:26:47.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.378+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~NNK4RGLE9G3S.1 size=731361 2024-03-04T12:26:47.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.380+0000 7fa4b3c3e780 1 < completed multipart upload key=V7N7MZ1GUNEV upload=NNK4RGLE9G3S tag=4TUBE3BA1XGF type=write size=2828513 2024-03-04T12:26:47.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.381+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=FXHT5WGOX9B3 type=del size=1909312 2024-03-04T12:26:47.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.382+0000 7fa4b3c3e780 1 < completed write operation key=H5FWRNK8F7QT tag=MI0G8R3QIGXF type=write size=401324 2024-03-04T12:26:47.390 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.383+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=B6PLQ76NC11P type=del size=1069003 2024-03-04T12:26:47.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.385+0000 7fa4b3c3e780 1 < suggested remove operation key=R1DOKJPZRT5Q tag=KL2J9NNO2YXN type=write 2024-03-04T12:26:47.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.387+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~U99KPOTKDTAP.0 size=1048576 2024-03-04T12:26:47.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.388+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~U99KPOTKDTAP.1 size=1048576 2024-03-04T12:26:47.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.389+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~U99KPOTKDTAP.2 size=798424 2024-03-04T12:26:47.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.389+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=U99KPOTKDTAP tag=IP8F84NWKY4A type=write size=3944152 2024-03-04T12:26:47.397 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.390+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=3ZXQDQRKT52J type=del 2024-03-04T12:26:47.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.392+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=03TYNJ2YPJXB type=del size=1188197 2024-03-04T12:26:47.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.393+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=S9PJWWRTVHL0 type=del 2024-03-04T12:26:47.401 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.394+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=IYB554ZL5YPB type=write size=254687 2024-03-04T12:26:47.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.395+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=NKXOLG6B50PV type=del 2024-03-04T12:26:47.403 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.396+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=LWB39I98J6IB type=del size=2708381 2024-03-04T12:26:47.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.398+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~OCPD6KWIJ7XE.0 size=269248 2024-03-04T12:26:47.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.400+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=OCPD6KWIJ7XE tag=8R90NQR0VBUK type=write size=1317824 2024-03-04T12:26:47.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.401+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=MUDJ44Q5IXXK type=del size=2628165 2024-03-04T12:26:47.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.402+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~XPZ8I9C594Z5.0 size=1048576 2024-03-04T12:26:47.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.402+0000 7fa4b3c3e780 1 < canceled part key=_multipart_GMIPCGYZRJ5L.2~XPZ8I9C594Z5.1 size=1048576 2024-03-04T12:26:47.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.403+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~XPZ8I9C594Z5.2 size=614601 2024-03-04T12:26:47.412 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.405+0000 7fa4b3c3e780 1 < canceled multipart upload key=GMIPCGYZRJ5L upload=XPZ8I9C594Z5 tag=XPVCMD9N6JTU type=write size=3760329 2024-03-04T12:26:47.414 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.407+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~260H86VOTVNU.0 size=1048576 2024-03-04T12:26:47.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.408+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~260H86VOTVNU.1 size=541908 2024-03-04T12:26:47.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.408+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=260H86VOTVNU tag=1W7SWEI2RYRT type=write size=2639060 2024-03-04T12:26:47.416 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.409+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=BGFR0QH4E7J2 type=del 2024-03-04T12:26:47.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.412+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~DRPQLJI11F9H.0 size=1048576 2024-03-04T12:26:47.419 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.413+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~DRPQLJI11F9H.1 size=1048576 2024-03-04T12:26:47.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.413+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~DRPQLJI11F9H.2 size=401156 2024-03-04T12:26:47.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.413+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=DRPQLJI11F9H tag=DJ0PJ135J51A type=write size=3546884 2024-03-04T12:26:47.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.415+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~TN7DGHP3L5NH.0 size=1048576 2024-03-04T12:26:47.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.415+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~TN7DGHP3L5NH.1 size=392528 2024-03-04T12:26:47.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.417+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=TN7DGHP3L5NH tag=P79JUQ0DEIU0 type=write size=2489680 2024-03-04T12:26:47.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.419+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=1UZU3KJN32CL type=write size=1027195 2024-03-04T12:26:47.427 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.420+0000 7fa4b3c3e780 1 < canceled operation key=YWJV4QMY6ZBI tag=6T3CYZ0RL4PE type=del size=632094 2024-03-04T12:26:47.428 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.421+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=8W0408YG8ZCB type=del size=2245743 2024-03-04T12:26:47.429 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.422+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=PIC52T811QYS type=del 2024-03-04T12:26:47.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.425+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~FR42I2AVFPUJ.0 size=964645 2024-03-04T12:26:47.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.425+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=FR42I2AVFPUJ tag=7VMOGBLFXVIK type=write size=2013221 2024-03-04T12:26:47.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.426+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~1LJPVJEVDW8O.0 size=38780 2024-03-04T12:26:47.435 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.428+0000 7fa4b3c3e780 1 < completed multipart upload key=4LKTYP07OL5L upload=1LJPVJEVDW8O tag=PB59EECHOXZT type=write size=1087356 2024-03-04T12:26:47.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.430+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~F6SOM2JU8QBG.0 size=863461 2024-03-04T12:26:47.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.430+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=F6SOM2JU8QBG tag=J4J8Z5791WY5 type=write size=1912037 2024-03-04T12:26:47.438 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.431+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=LGWU8XS1LQTG type=del 2024-03-04T12:26:47.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.432+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=PZMA2YC4UFNZ type=del size=1006134 2024-03-04T12:26:47.440 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.433+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=7KMY624Y10JL type=del 2024-03-04T12:26:47.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.436+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~VHYSH9288J5U.0 size=1016645 2024-03-04T12:26:47.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.436+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=VHYSH9288J5U tag=JN2P0I04GT3Z type=write size=2065221 2024-03-04T12:26:47.443 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.437+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~R8OMLTSK661B.0 size=1048576 2024-03-04T12:26:47.443 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.437+0000 7fa4b3c3e780 1 < canceled part key=_multipart_43HMF7NWNMU3.2~R8OMLTSK661B.1 size=99448 2024-03-04T12:26:47.445 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.439+0000 7fa4b3c3e780 1 < canceled multipart upload key=43HMF7NWNMU3 upload=R8OMLTSK661B tag=2JFX421F2GVL type=write size=2196600 2024-03-04T12:26:47.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.440+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=8MPWPN1JY5P4 type=write size=1014023 2024-03-04T12:26:47.448 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.441+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=FXHT5WGOX9B3 type=del 2024-03-04T12:26:47.450 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.443+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~78636QD1XXFX.0 size=184679 2024-03-04T12:26:47.450 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.443+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=78636QD1XXFX tag=UV0ZMKLL0ISI type=write size=1233255 2024-03-04T12:26:47.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.445+0000 7fa4b3c3e780 1 < suggested update operation key=ZETES4AYZQHY tag=B6PLQ76NC11P type=del size=1069003 2024-03-04T12:26:47.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.446+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=6NOZ20QPU2N7 type=del size=2565682 2024-03-04T12:26:47.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.447+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~U99KPOTKDTAP.0 size=1048576 2024-03-04T12:26:47.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.448+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~U99KPOTKDTAP.1 size=1048576 2024-03-04T12:26:47.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.449+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~U99KPOTKDTAP.2 size=798424 2024-03-04T12:26:47.458 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.451+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=U99KPOTKDTAP tag=IP8F84NWKY4A type=write size=3944152 2024-03-04T12:26:47.460 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.453+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~33G6TRFSLEHN.0 size=1048576 2024-03-04T12:26:47.461 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.454+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~33G6TRFSLEHN.1 size=1048576 2024-03-04T12:26:47.462 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.455+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~33G6TRFSLEHN.2 size=147704 2024-03-04T12:26:47.462 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.455+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=33G6TRFSLEHN tag=825T2UW1ESCG type=write size=3293432 2024-03-04T12:26:47.463 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.456+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=03TYNJ2YPJXB type=del 2024-03-04T12:26:47.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.457+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=1GSLTXSKB1LR type=del size=575388 2024-03-04T12:26:47.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.460+0000 7fa4b3c3e780 1 < suggested update operation key=3N6E09QF3866 tag=IYB554ZL5YPB type=write size=254687 2024-03-04T12:26:47.468 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.462+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~W4HDJJ1BIB2B.0 size=1048576 2024-03-04T12:26:47.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.463+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~W4HDJJ1BIB2B.1 size=597036 2024-03-04T12:26:47.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.463+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=W4HDJJ1BIB2B tag=73MI01QVRRX1 type=write size=2694188 2024-03-04T12:26:47.471 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.464+0000 7fa4b3c3e780 -1 < failed to complete operation key=3N6E09QF3866 tag=LWB39I98J6IB type=del size=2708381: (22) Invalid argument 2024-03-04T12:26:47.473 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.466+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~O5GUW13JFZE3.0 size=1048576 2024-03-04T12:26:47.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.467+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~O5GUW13JFZE3.1 size=882447 2024-03-04T12:26:47.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.467+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=O5GUW13JFZE3 tag=33Z7VJBA3HIN type=write size=2979599 2024-03-04T12:26:47.476 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.469+0000 7fa4b3c3e780 1 < suggested remove operation key=YWJV4QMY6ZBI tag=MUDJ44Q5IXXK type=del 2024-03-04T12:26:47.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.470+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=4B9750FOTPLI type=del size=646181 2024-03-04T12:26:47.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.472+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~260H86VOTVNU.0 size=1048576 2024-03-04T12:26:47.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.472+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~260H86VOTVNU.1 size=541908 2024-03-04T12:26:47.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.475+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=260H86VOTVNU tag=1W7SWEI2RYRT type=write size=2639060 2024-03-04T12:26:47.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.477+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~Y02YCUURC3ZK.0 size=1048576 2024-03-04T12:26:47.485 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.478+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~Y02YCUURC3ZK.1 size=1031784 2024-03-04T12:26:47.485 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.478+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=Y02YCUURC3ZK tag=CPNB1CEVM6SN type=write size=3128936 2024-03-04T12:26:47.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.479+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~DRPQLJI11F9H.0 size=1048576 2024-03-04T12:26:47.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.480+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~DRPQLJI11F9H.1 size=1048576 2024-03-04T12:26:47.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.480+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YQLH0WW7I7MW.2~DRPQLJI11F9H.2 size=401156 2024-03-04T12:26:47.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.482+0000 7fa4b3c3e780 1 < canceled multipart upload key=YQLH0WW7I7MW upload=DRPQLJI11F9H tag=DJ0PJ135J51A type=write size=3546884 2024-03-04T12:26:47.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.483+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=VIO8LIGP3B6B type=del size=2957146 2024-03-04T12:26:47.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.484+0000 7fa4b3c3e780 1 < completed write operation key=R1DOKJPZRT5Q tag=1UZU3KJN32CL type=write size=1027195 2024-03-04T12:26:47.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.485+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=XN6101AFYOIR type=del size=320044 2024-03-04T12:26:47.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.487+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=8W0408YG8ZCB type=del 2024-03-04T12:26:47.495 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.489+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~GL2ES5HWHR8W.0 size=1048576 2024-03-04T12:26:47.496 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.490+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~GL2ES5HWHR8W.1 size=1016797 2024-03-04T12:26:47.496 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.490+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=GL2ES5HWHR8W tag=FBV0CF5IOVAZ type=write size=3113949 2024-03-04T12:26:47.497 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.491+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~FR42I2AVFPUJ.0 size=964645 2024-03-04T12:26:47.499 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.493+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=FR42I2AVFPUJ tag=7VMOGBLFXVIK type=write size=2013221 2024-03-04T12:26:47.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.494+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=FXLEY88R23GO type=del size=4162862 2024-03-04T12:26:47.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.495+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~F6SOM2JU8QBG.0 size=863461 2024-03-04T12:26:47.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.497+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=F6SOM2JU8QBG tag=J4J8Z5791WY5 type=write size=1912037 2024-03-04T12:26:47.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.499+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~SUPR3OHPBNZ3.0 size=746442 2024-03-04T12:26:47.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.499+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=SUPR3OHPBNZ3 tag=47ZCTELY248W type=write size=1795018 2024-03-04T12:26:47.507 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.500+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=PZMA2YC4UFNZ type=del 2024-03-04T12:26:47.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.502+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~0JVUVO6I22XF.0 size=1048576 2024-03-04T12:26:47.510 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.503+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~0JVUVO6I22XF.1 size=1048576 2024-03-04T12:26:47.510 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.503+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~0JVUVO6I22XF.2 size=589003 2024-03-04T12:26:47.510 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.504+0000 7fa4b3c3e780 1 > prepared multipart upload key=NVMIU38VM9Q1 upload=0JVUVO6I22XF tag=FONJBMO49KQW type=write size=3734731 2024-03-04T12:26:47.512 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.505+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~VHYSH9288J5U.0 size=1016645 2024-03-04T12:26:47.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.507+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=VHYSH9288J5U tag=JN2P0I04GT3Z type=write size=2065221 2024-03-04T12:26:47.515 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.508+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=1UMUHJILI7P0 type=del size=2826272 2024-03-04T12:26:47.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.509+0000 7fa4b3c3e780 1 < canceled operation key=R1DOKJPZRT5Q tag=8MPWPN1JY5P4 type=write size=1014023 2024-03-04T12:26:47.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.510+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=RTLX2DNIJH4A type=del size=3196156 2024-03-04T12:26:47.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.511+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~78636QD1XXFX.0 size=184679 2024-03-04T12:26:47.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.513+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=78636QD1XXFX tag=UV0ZMKLL0ISI type=write size=1233255 2024-03-04T12:26:47.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.514+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=CEXEU1OMYYUS type=del size=1120472 2024-03-04T12:26:47.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.516+0000 7fa4b3c3e780 1 < canceled operation key=BVMWQ9ZL4K0C tag=6NOZ20QPU2N7 type=del size=2565682 2024-03-04T12:26:47.524 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.518+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~0XZMK1GOGHGX.0 size=1048576 2024-03-04T12:26:47.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.519+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~0XZMK1GOGHGX.1 size=1048576 2024-03-04T12:26:47.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.519+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~0XZMK1GOGHGX.2 size=93247 2024-03-04T12:26:47.527 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.519+0000 7fa4b3c3e780 1 > prepared multipart upload key=G8G76PMSKJ0I upload=0XZMK1GOGHGX tag=ZQNH7AA2BCT5 type=write size=3238975 2024-03-04T12:26:47.527 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.521+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~33G6TRFSLEHN.0 size=1048576 2024-03-04T12:26:47.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.522+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~33G6TRFSLEHN.1 size=1048576 2024-03-04T12:26:47.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.522+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~33G6TRFSLEHN.2 size=147704 2024-03-04T12:26:47.531 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.524+0000 7fa4b3c3e780 1 < completed multipart upload key=G70BJ2UARNCP upload=33G6TRFSLEHN tag=825T2UW1ESCG type=write size=3293432 2024-03-04T12:26:47.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.526+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~OMMFS2LN8475.0 size=1048576 2024-03-04T12:26:47.534 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.527+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~OMMFS2LN8475.1 size=170966 2024-03-04T12:26:47.534 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.527+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=OMMFS2LN8475 tag=OMOW73ZDADIE type=write size=2268118 2024-03-04T12:26:47.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.528+0000 7fa4b3c3e780 -1 < failed to complete operation key=YWJV4QMY6ZBI tag=1GSLTXSKB1LR type=del size=575388: (22) Invalid argument 2024-03-04T12:26:47.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.529+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=ZCN549EXD68O type=del size=2191337 2024-03-04T12:26:47.537 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.531+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~W4HDJJ1BIB2B.0 size=1048576 2024-03-04T12:26:47.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.532+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~W4HDJJ1BIB2B.1 size=597036 2024-03-04T12:26:47.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.533+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=W4HDJJ1BIB2B tag=73MI01QVRRX1 type=write size=2694188 2024-03-04T12:26:47.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.535+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=FECHI9N8X9CP type=write size=1033944 2024-03-04T12:26:47.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.535+0000 7fa4b3c3e780 1 < canceled part key=_multipart_43HMF7NWNMU3.2~O5GUW13JFZE3.0 size=1048576 2024-03-04T12:26:47.542 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.536+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~O5GUW13JFZE3.1 size=882447 2024-03-04T12:26:47.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.537+0000 7fa4b3c3e780 1 < canceled multipart upload key=43HMF7NWNMU3 upload=O5GUW13JFZE3 tag=33Z7VJBA3HIN type=write size=2979599 2024-03-04T12:26:47.546 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.539+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=NN2VKRGBZGUR type=del size=681739 2024-03-04T12:26:47.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.540+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=4B9750FOTPLI type=del 2024-03-04T12:26:47.548 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.541+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=MFG7PC5WEGFD type=del size=2151620 2024-03-04T12:26:47.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.542+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~Y02YCUURC3ZK.0 size=1048576 2024-03-04T12:26:47.550 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.543+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~Y02YCUURC3ZK.1 size=1031784 2024-03-04T12:26:47.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.545+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=Y02YCUURC3ZK tag=CPNB1CEVM6SN type=write size=3128936 2024-03-04T12:26:47.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.546+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=10L7DH550TKE type=write size=545826 2024-03-04T12:26:47.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.548+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=VIO8LIGP3B6B type=del 2024-03-04T12:26:47.557 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.550+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~N1QJTIL78JS8.0 size=609928 2024-03-04T12:26:47.557 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.550+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=N1QJTIL78JS8 tag=9O9UI2GMF3SV type=write size=1658504 2024-03-04T12:26:47.559 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.552+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=XN6101AFYOIR type=del 2024-03-04T12:26:47.561 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.554+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~VIUZ1C6GFJZY.0 size=1048576 2024-03-04T12:26:47.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.555+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~VIUZ1C6GFJZY.1 size=1048576 2024-03-04T12:26:47.563 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.556+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~VIUZ1C6GFJZY.2 size=420732 2024-03-04T12:26:47.563 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.556+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=VIUZ1C6GFJZY tag=TR51TO3MYMTF type=write size=3566460 2024-03-04T12:26:47.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.557+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~GL2ES5HWHR8W.0 size=1048576 2024-03-04T12:26:47.565 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.558+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~GL2ES5HWHR8W.1 size=1016797 2024-03-04T12:26:47.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.560+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=GL2ES5HWHR8W tag=FBV0CF5IOVAZ type=write size=3113949 2024-03-04T12:26:47.569 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.562+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~79FZL0DX1JID.0 size=1048576 2024-03-04T12:26:47.569 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.563+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~79FZL0DX1JID.1 size=230307 2024-03-04T12:26:47.569 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.563+0000 7fa4b3c3e780 1 > prepared multipart upload key=NVMIU38VM9Q1 upload=79FZL0DX1JID tag=8XBYMAM3GJMO type=write size=2327459 2024-03-04T12:26:47.572 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.565+0000 7fa4b3c3e780 1 < suggested update operation key=VAIY4J3CYONH tag=FXLEY88R23GO type=del size=4162862 2024-03-04T12:26:47.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.566+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=EA51ENTOHFRE type=write size=819944 2024-03-04T12:26:47.574 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.567+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~SUPR3OHPBNZ3.0 size=746442 2024-03-04T12:26:47.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.569+0000 7fa4b3c3e780 1 < completed multipart upload key=G70BJ2UARNCP upload=SUPR3OHPBNZ3 tag=47ZCTELY248W type=write size=1795018 2024-03-04T12:26:47.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.570+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=OKEQZA75KZ5U type=del size=588460 2024-03-04T12:26:47.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.572+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~0JVUVO6I22XF.0 size=1048576 2024-03-04T12:26:47.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.573+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~0JVUVO6I22XF.1 size=1048576 2024-03-04T12:26:47.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.573+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~0JVUVO6I22XF.2 size=589003 2024-03-04T12:26:47.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.575+0000 7fa4b3c3e780 1 < completed multipart upload key=NVMIU38VM9Q1 upload=0JVUVO6I22XF tag=FONJBMO49KQW type=write size=3734731 2024-03-04T12:26:47.583 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.577+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=7EDXYACDYXBF type=del size=2313982 2024-03-04T12:26:47.587 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.580+0000 7fa4b3c3e780 1 < suggested remove operation key=R1DOKJPZRT5Q tag=1UMUHJILI7P0 type=del 2024-03-04T12:26:47.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.582+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=0LP4ZEUAD54T type=write size=63303 2024-03-04T12:26:47.591 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.584+0000 7fa4b3c3e780 1 < suggested update operation key=BVMWQ9ZL4K0C tag=RTLX2DNIJH4A type=del size=3196156 2024-03-04T12:26:47.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.585+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=Q3GBAX7UKSPD type=del size=3920011 2024-03-04T12:26:47.594 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.587+0000 7fa4b3c3e780 1 < suggested update operation key=ZETES4AYZQHY tag=CEXEU1OMYYUS type=del size=1120472 2024-03-04T12:26:47.595 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.589+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=YS5GK8L4HMYS type=del size=1071051 2024-03-04T12:26:47.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.590+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~0XZMK1GOGHGX.0 size=1048576 2024-03-04T12:26:47.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.591+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~0XZMK1GOGHGX.1 size=1048576 2024-03-04T12:26:47.598 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.592+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~0XZMK1GOGHGX.2 size=93247 2024-03-04T12:26:47.600 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.594+0000 7fa4b3c3e780 1 < completed multipart upload key=G8G76PMSKJ0I upload=0XZMK1GOGHGX tag=ZQNH7AA2BCT5 type=write size=3238975 2024-03-04T12:26:47.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.595+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=8O34ZNUO0P1O type=del size=1258500 2024-03-04T12:26:47.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.595+0000 7fa4b3c3e780 1 < canceled part key=_multipart_3TDMQXKLPX34.2~OMMFS2LN8475.0 size=1048576 2024-03-04T12:26:47.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.596+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~OMMFS2LN8475.1 size=170966 2024-03-04T12:26:47.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.598+0000 7fa4b3c3e780 1 < canceled multipart upload key=3TDMQXKLPX34 upload=OMMFS2LN8475 tag=OMOW73ZDADIE type=write size=2268118 2024-03-04T12:26:47.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.599+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=8C6D4IDK3WVJ type=write size=283449 2024-03-04T12:26:47.607 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.600+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=ZCN549EXD68O type=del 2024-03-04T12:26:47.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.602+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~Y5PF9K3EVGH1.0 size=1048576 2024-03-04T12:26:47.610 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.603+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~Y5PF9K3EVGH1.1 size=3103 2024-03-04T12:26:47.610 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.603+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=Y5PF9K3EVGH1 tag=265JAGW4GOPB type=write size=2100255 2024-03-04T12:26:47.612 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.605+0000 7fa4b3c3e780 1 < completed write operation key=4LKTYP07OL5L tag=FECHI9N8X9CP type=write size=1033944 2024-03-04T12:26:47.613 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.606+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=NR0NASP6NMJC type=write size=515593 2024-03-04T12:26:47.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.607+0000 7fa4b3c3e780 1 < completed delete operation key=G8G76PMSKJ0I tag=NN2VKRGBZGUR type=del 2024-03-04T12:26:47.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.609+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~5U0V7W0JS0ND.0 size=1048576 2024-03-04T12:26:47.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.610+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~5U0V7W0JS0ND.1 size=1048576 2024-03-04T12:26:47.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.611+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~5U0V7W0JS0ND.2 size=373285 2024-03-04T12:26:47.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.611+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=5U0V7W0JS0ND tag=AE2DVCBYCOQ4 type=write size=3519013 2024-03-04T12:26:47.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.612+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=MFG7PC5WEGFD type=del 2024-03-04T12:26:47.621 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.614+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=71LGII8SNU07 type=del size=1709721 2024-03-04T12:26:47.622 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.615+0000 7fa4b3c3e780 1 < completed write operation key=V7N7MZ1GUNEV tag=10L7DH550TKE type=write size=545826 2024-03-04T12:26:47.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.617+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~ANQII7XI10BZ.0 size=1048576 2024-03-04T12:26:47.625 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.618+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~ANQII7XI10BZ.1 size=34554 2024-03-04T12:26:47.625 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.618+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=ANQII7XI10BZ tag=9UJFD21RZP6Z type=write size=2131706 2024-03-04T12:26:47.626 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.619+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~N1QJTIL78JS8.0 size=609928 2024-03-04T12:26:47.628 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.621+0000 7fa4b3c3e780 1 < completed multipart upload key=ESHAMQWMMBJR upload=N1QJTIL78JS8 tag=9O9UI2GMF3SV type=write size=1658504 2024-03-04T12:26:47.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.622+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=JNWQKKK65NO4 type=del size=2030366 2024-03-04T12:26:47.630 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.623+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~VIUZ1C6GFJZY.0 size=1048576 2024-03-04T12:26:47.631 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.624+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~VIUZ1C6GFJZY.1 size=1048576 2024-03-04T12:26:47.632 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.625+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~VIUZ1C6GFJZY.2 size=420732 2024-03-04T12:26:47.634 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.627+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=VIUZ1C6GFJZY tag=TR51TO3MYMTF type=write size=3566460 2024-03-04T12:26:47.635 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.628+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=670BKKKSSFGG type=del size=1184209 2024-03-04T12:26:47.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.630+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~79FZL0DX1JID.0 size=1048576 2024-03-04T12:26:47.637 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.631+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~79FZL0DX1JID.1 size=230307 2024-03-04T12:26:47.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.633+0000 7fa4b3c3e780 1 < completed multipart upload key=NVMIU38VM9Q1 upload=79FZL0DX1JID tag=8XBYMAM3GJMO type=write size=2327459 2024-03-04T12:26:47.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.634+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=7F7PK3V8UWVI type=write size=914408 2024-03-04T12:26:47.642 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.635+0000 7fa4b3c3e780 1 < completed write operation key=KKQT9J9GSW0N tag=EA51ENTOHFRE type=write size=819944 2024-03-04T12:26:47.643 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.636+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=T4E9DDY5T44H type=write size=934058 2024-03-04T12:26:47.644 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.637+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=OKEQZA75KZ5U type=del 2024-03-04T12:26:47.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.638+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=US1EOUX2VW9K type=write size=38511 2024-03-04T12:26:47.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.640+0000 7fa4b3c3e780 1 < canceled operation key=T301TK0FIOG4 tag=7EDXYACDYXBF type=del size=2313982 2024-03-04T12:26:47.648 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.642+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~4RMRBYEIIQCO.0 size=1048576 2024-03-04T12:26:47.649 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.642+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~4RMRBYEIIQCO.1 size=1048576 2024-03-04T12:26:47.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.643+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~4RMRBYEIIQCO.2 size=37444 2024-03-04T12:26:47.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.643+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=4RMRBYEIIQCO tag=IQ4F1B44T2TT type=write size=3183172 2024-03-04T12:26:47.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.644+0000 7fa4b3c3e780 1 < completed write operation key=3N6E09QF3866 tag=0LP4ZEUAD54T type=write size=63303 2024-03-04T12:26:47.652 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.646+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=OJXX86HP9VJG type=del size=1308846 2024-03-04T12:26:47.653 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.647+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=Q3GBAX7UKSPD type=del 2024-03-04T12:26:47.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.649+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~ICF0DHIK7MW2.0 size=561972 2024-03-04T12:26:47.656 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.649+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=ICF0DHIK7MW2 tag=GBB2S9ZBQLL9 type=write size=1610548 2024-03-04T12:26:47.657 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.650+0000 7fa4b3c3e780 1 < canceled operation key=ZETES4AYZQHY tag=YS5GK8L4HMYS type=del size=1071051 2024-03-04T12:26:47.658 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.651+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=FCUMHMW202D0 type=del size=2668191 2024-03-04T12:26:47.659 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.652+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=8O34ZNUO0P1O type=del 2024-03-04T12:26:47.660 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.653+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=6BITHNO193P5 type=del size=4021124 2024-03-04T12:26:47.862 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.855+0000 7fa4b3c3e780 1 < completed write operation key=BR8RTE2QEH9E tag=8C6D4IDK3WVJ type=write size=283449 2024-03-04T12:26:47.864 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.857+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=13VBJ09744E1 type=del size=3202371 2024-03-04T12:26:47.865 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.858+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~Y5PF9K3EVGH1.0 size=1048576 2024-03-04T12:26:47.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.859+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~Y5PF9K3EVGH1.1 size=3103 2024-03-04T12:26:47.868 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.862+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=Y5PF9K3EVGH1 tag=265JAGW4GOPB type=write size=2100255 2024-03-04T12:26:47.870 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.863+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=MPZLD7LKRVN4 type=del size=3057747 2024-03-04T12:26:47.871 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.864+0000 7fa4b3c3e780 1 < completed write operation key=4989OME3IAJF tag=NR0NASP6NMJC type=write size=515593 2024-03-04T12:26:47.874 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.867+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~5KRD0XSC3XWN.0 size=1048576 2024-03-04T12:26:47.875 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.868+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~5KRD0XSC3XWN.1 size=883545 2024-03-04T12:26:47.875 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.868+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=5KRD0XSC3XWN tag=MD08K0T6X8YA type=write size=2980697 2024-03-04T12:26:47.876 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.869+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~5U0V7W0JS0ND.0 size=1048576 2024-03-04T12:26:47.877 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.870+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~5U0V7W0JS0ND.1 size=1048576 2024-03-04T12:26:47.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.871+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~5U0V7W0JS0ND.2 size=373285 2024-03-04T12:26:47.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.874+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=5U0V7W0JS0ND tag=AE2DVCBYCOQ4 type=write size=3519013 2024-03-04T12:26:47.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.875+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=DIIRN3QQ2Q5R type=del size=2149207 2024-03-04T12:26:47.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.878+0000 7fa4b3c3e780 1 < suggested remove operation key=4LKTYP07OL5L tag=71LGII8SNU07 type=del 2024-03-04T12:26:47.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.879+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=HWFJBOD7NQTX type=del size=3244852 2024-03-04T12:26:47.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.880+0000 7fa4b3c3e780 1 < canceled part key=_multipart_DHLTVH2AZBLR.2~ANQII7XI10BZ.0 size=1048576 2024-03-04T12:26:47.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.880+0000 7fa4b3c3e780 1 < canceled part key=_multipart_DHLTVH2AZBLR.2~ANQII7XI10BZ.1 size=34554 2024-03-04T12:26:47.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.882+0000 7fa4b3c3e780 1 < canceled multipart upload key=DHLTVH2AZBLR upload=ANQII7XI10BZ tag=9UJFD21RZP6Z type=write size=2131706 2024-03-04T12:26:47.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.883+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=BO8PLO27TQUI type=del size=3181733 2024-03-04T12:26:47.892 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.885+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=JNWQKKK65NO4 type=del 2024-03-04T12:26:47.893 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.886+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=9ENHYXJ1YI33 type=del size=1594612 2024-03-04T12:26:47.896 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.889+0000 7fa4b3c3e780 1 < suggested remove operation key=4989OME3IAJF tag=670BKKKSSFGG type=del 2024-03-04T12:26:47.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.891+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~OMGAKMWRB277.0 size=1048576 2024-03-04T12:26:47.899 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.892+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~OMGAKMWRB277.1 size=966602 2024-03-04T12:26:47.899 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.892+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=OMGAKMWRB277 tag=8MYPC06PEX1N type=write size=3063754 2024-03-04T12:26:47.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.893+0000 7fa4b3c3e780 1 < completed write operation key=X0RVLNRWUAEM tag=7F7PK3V8UWVI type=write size=914408 2024-03-04T12:26:47.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.895+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=3911W5B52V90 type=write size=959767 2024-03-04T12:26:47.904 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.897+0000 7fa4b3c3e780 1 < completed write operation key=R6Y09EO6HGF0 tag=T4E9DDY5T44H type=write size=934058 2024-03-04T12:26:47.906 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.899+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=AWW0OL0EBJYL type=del size=519046 2024-03-04T12:26:47.906 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.900+0000 7fa4b3c3e780 1 < completed write operation key=ESHAMQWMMBJR tag=US1EOUX2VW9K type=write size=38511 2024-03-04T12:26:47.909 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.902+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~1G4M67Z00A5C.0 size=636774 2024-03-04T12:26:47.909 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.902+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=1G4M67Z00A5C tag=JZS93XLKW11D type=write size=1685350 2024-03-04T12:26:47.910 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.903+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~4RMRBYEIIQCO.0 size=1048576 2024-03-04T12:26:47.911 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.904+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~4RMRBYEIIQCO.1 size=1048576 2024-03-04T12:26:47.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.905+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~4RMRBYEIIQCO.2 size=37444 2024-03-04T12:26:47.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.907+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=4RMRBYEIIQCO tag=IQ4F1B44T2TT type=write size=3183172 2024-03-04T12:26:47.916 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.909+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~AHSP68HXYDJ6.0 size=1048576 2024-03-04T12:26:47.917 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.910+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~AHSP68HXYDJ6.1 size=1048576 2024-03-04T12:26:47.918 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.911+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~AHSP68HXYDJ6.2 size=62725 2024-03-04T12:26:47.918 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.911+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=AHSP68HXYDJ6 tag=0CQ4CW3H56OQ type=write size=3208453 2024-03-04T12:26:47.919 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.912+0000 7fa4b3c3e780 1 < completed delete operation key=G8G76PMSKJ0I tag=OJXX86HP9VJG type=del 2024-03-04T12:26:47.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.914+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~CXARKJDOSJFS.0 size=1048576 2024-03-04T12:26:47.922 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.915+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~CXARKJDOSJFS.1 size=628618 2024-03-04T12:26:47.922 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.915+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=CXARKJDOSJFS tag=81QAOK9I90N9 type=write size=2725770 2024-03-04T12:26:47.923 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.917+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~ICF0DHIK7MW2.0 size=561972 2024-03-04T12:26:47.925 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.919+0000 7fa4b3c3e780 1 < completed multipart upload key=4989OME3IAJF upload=ICF0DHIK7MW2 tag=GBB2S9ZBQLL9 type=write size=1610548 2024-03-04T12:26:47.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.920+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=ZW811N1425WK type=write size=117598 2024-03-04T12:26:47.928 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.921+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=FCUMHMW202D0 type=del 2024-03-04T12:26:47.929 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.922+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=1HF16M14MSZU type=del size=1607351 2024-03-04T12:26:47.931 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.925+0000 7fa4b3c3e780 1 < suggested remove operation key=T301TK0FIOG4 tag=6BITHNO193P5 type=del 2024-03-04T12:26:47.935 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.926+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=FHTIG2LJ8OT6 type=del size=4158290 2024-03-04T12:26:47.936 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.928+0000 7fa4b3c3e780 1 < suggested update operation key=3N6E09QF3866 tag=13VBJ09744E1 type=del size=3202371 2024-03-04T12:26:47.936 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.929+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=ND5800C2DACX type=del size=77359 2024-03-04T12:26:47.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.931+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=MPZLD7LKRVN4 type=del 2024-03-04T12:26:47.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.932+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=T4LRL0K1JUFU type=del size=3068424 2024-03-04T12:26:47.940 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.933+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~5KRD0XSC3XWN.0 size=1048576 2024-03-04T12:26:47.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.934+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~5KRD0XSC3XWN.1 size=883545 2024-03-04T12:26:47.943 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.936+0000 7fa4b3c3e780 1 < completed multipart upload key=4989OME3IAJF upload=5KRD0XSC3XWN tag=MD08K0T6X8YA type=write size=2980697 2024-03-04T12:26:47.944 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.937+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=8QTNALGCEVCB type=del size=2222914 2024-03-04T12:26:47.945 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.939+0000 7fa4b3c3e780 -1 < failed to complete operation key=4LKTYP07OL5L tag=DIIRN3QQ2Q5R type=del size=2149207: (22) Invalid argument 2024-03-04T12:26:47.947 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.940+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=BP3JBA5EXH4Z type=write size=76311 2024-03-04T12:26:47.949 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.942+0000 7fa4b3c3e780 1 < suggested update operation key=R1DOKJPZRT5Q tag=HWFJBOD7NQTX type=del size=3244852 2024-03-04T12:26:47.951 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.944+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~OCO6MTS830NN.0 size=496872 2024-03-04T12:26:47.951 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.944+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=OCO6MTS830NN tag=XGTCIM8GOWPB type=write size=1545448 2024-03-04T12:26:47.952 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.946+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=BO8PLO27TQUI type=del 2024-03-04T12:26:47.954 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.947+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=GWHAYRABGIY2 type=del size=2562036 2024-03-04T12:26:47.956 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.949+0000 7fa4b3c3e780 1 < suggested remove operation key=WRHB3XWDLSY2 tag=9ENHYXJ1YI33 type=del 2024-03-04T12:26:47.958 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.951+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~37V82C8GCV4C.0 size=1048576 2024-03-04T12:26:47.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.952+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~37V82C8GCV4C.1 size=1048576 2024-03-04T12:26:47.960 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.953+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~37V82C8GCV4C.2 size=207098 2024-03-04T12:26:47.960 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.953+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=37V82C8GCV4C tag=5PXPM6KAK6JM type=write size=3352826 2024-03-04T12:26:47.961 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.954+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~OMGAKMWRB277.0 size=1048576 2024-03-04T12:26:47.962 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.955+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~OMGAKMWRB277.1 size=966602 2024-03-04T12:26:47.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.957+0000 7fa4b3c3e780 1 < completed multipart upload key=J53J0N99N30A upload=OMGAKMWRB277 tag=8MYPC06PEX1N type=write size=3063754 2024-03-04T12:26:47.965 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.959+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=0Z070GZCNHOK type=del size=3595434 2024-03-04T12:26:47.968 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.961+0000 7fa4b3c3e780 1 < suggested update operation key=4989OME3IAJF tag=3911W5B52V90 type=write size=959767 2024-03-04T12:26:47.970 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.963+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~F9923LBDE4G5.0 size=1048576 2024-03-04T12:26:47.971 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.964+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~F9923LBDE4G5.1 size=25791 2024-03-04T12:26:47.971 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.964+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=F9923LBDE4G5 tag=4U87ZN11BR50 type=write size=2122943 2024-03-04T12:26:47.973 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.966+0000 7fa4b3c3e780 1 < suggested remove operation key=4989OME3IAJF tag=AWW0OL0EBJYL type=del 2024-03-04T12:26:47.974 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.967+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=1RK3NHU960P7 type=del size=3434978 2024-03-04T12:26:47.976 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.969+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~1G4M67Z00A5C.0 size=636774 2024-03-04T12:26:47.978 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.971+0000 7fa4b3c3e780 1 < completed multipart upload key=43HMF7NWNMU3 upload=1G4M67Z00A5C tag=JZS93XLKW11D type=write size=1685350 2024-03-04T12:26:47.980 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.973+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~ODCDHRPE4WR4.0 size=1048576 2024-03-04T12:26:47.981 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.974+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~ODCDHRPE4WR4.1 size=1048576 2024-03-04T12:26:47.982 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.975+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~ODCDHRPE4WR4.2 size=957849 2024-03-04T12:26:47.982 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.975+0000 7fa4b3c3e780 1 > prepared multipart upload key=4LKTYP07OL5L upload=ODCDHRPE4WR4 tag=VMC4SGUN107A type=write size=4103577 2024-03-04T12:26:47.983 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.976+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~AHSP68HXYDJ6.0 size=1048576 2024-03-04T12:26:47.984 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.977+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~AHSP68HXYDJ6.1 size=1048576 2024-03-04T12:26:47.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.978+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~AHSP68HXYDJ6.2 size=62725 2024-03-04T12:26:47.987 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.981+0000 7fa4b3c3e780 1 < completed multipart upload key=H5FWRNK8F7QT upload=AHSP68HXYDJ6 tag=0CQ4CW3H56OQ type=write size=3208453 2024-03-04T12:26:47.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.982+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=6EPDM9IUH70A type=del size=1086467 2024-03-04T12:26:47.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.982+0000 7fa4b3c3e780 1 < canceled part key=_multipart_T301TK0FIOG4.2~CXARKJDOSJFS.0 size=1048576 2024-03-04T12:26:47.990 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.983+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~CXARKJDOSJFS.1 size=628618 2024-03-04T12:26:47.992 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.985+0000 7fa4b3c3e780 1 < canceled multipart upload key=T301TK0FIOG4 upload=CXARKJDOSJFS tag=81QAOK9I90N9 type=write size=2725770 2024-03-04T12:26:47.993 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.987+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=6UW2NIGLXE3U type=del size=3263240 2024-03-04T12:26:47.995 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.988+0000 7fa4b3c3e780 1 < completed write operation key=J53J0N99N30A tag=ZW811N1425WK type=write size=117598 2024-03-04T12:26:47.996 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.989+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=0D4LDIJEH1DO type=del size=2115158 2024-03-04T12:26:47.997 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.990+0000 7fa4b3c3e780 1 < canceled operation key=UZRX3W3DE5VX tag=1HF16M14MSZU type=del size=1607351 2024-03-04T12:26:47.998 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.991+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=GBGWOYB80WJM type=del size=686687 2024-03-04T12:26:48.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.994+0000 7fa4b3c3e780 1 < suggested remove operation key=DHLTVH2AZBLR tag=FHTIG2LJ8OT6 type=del 2024-03-04T12:26:48.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.995+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=MUR9EYK0FZQY type=write size=197053 2024-03-04T12:26:48.003 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.996+0000 7fa4b3c3e780 1 < canceled operation key=G4SUQFVB936T tag=ND5800C2DACX type=del size=77359 2024-03-04T12:26:48.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.997+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=G3OTBHD7F4LT type=del size=1233845 2024-03-04T12:26:48.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.998+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=T4LRL0K1JUFU type=del 2024-03-04T12:26:48.006 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:47.999+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=C6877ZZ7UOSB type=del size=3636496 2024-03-04T12:26:48.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.001+0000 7fa4b3c3e780 -1 < failed to complete operation key=DHLTVH2AZBLR tag=8QTNALGCEVCB type=del size=2222914: (22) Invalid argument 2024-03-04T12:26:48.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.002+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=C92TEWZJHLHR type=del size=3117636 2024-03-04T12:26:48.011 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.004+0000 7fa4b3c3e780 1 < suggested remove operation key=YIS2SV4O5EZN tag=BP3JBA5EXH4Z type=write 2024-03-04T12:26:48.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.005+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=K9R4NWK3A35D type=del size=2581547 2024-03-04T12:26:48.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.006+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~OCO6MTS830NN.0 size=496872 2024-03-04T12:26:48.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.008+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=OCO6MTS830NN tag=XGTCIM8GOWPB type=write size=1545448 2024-03-04T12:26:48.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.011+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~H2LOHEAU1CL7.0 size=1048576 2024-03-04T12:26:48.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.012+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~H2LOHEAU1CL7.1 size=1048576 2024-03-04T12:26:48.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.013+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~H2LOHEAU1CL7.2 size=191760 2024-03-04T12:26:48.020 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.013+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=H2LOHEAU1CL7 tag=VPAVIOPFNL99 type=write size=3337488 2024-03-04T12:26:48.021 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.014+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=GWHAYRABGIY2 type=del 2024-03-04T12:26:48.023 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.016+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~ARZWM2PZ2XMR.0 size=1048576 2024-03-04T12:26:48.024 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.017+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~ARZWM2PZ2XMR.1 size=1048576 2024-03-04T12:26:48.024 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.018+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~ARZWM2PZ2XMR.2 size=764796 2024-03-04T12:26:48.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.018+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=ARZWM2PZ2XMR tag=GG2N2K72BQT2 type=write size=3910524 2024-03-04T12:26:48.026 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.019+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~37V82C8GCV4C.0 size=1048576 2024-03-04T12:26:48.026 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.020+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~37V82C8GCV4C.1 size=1048576 2024-03-04T12:26:48.027 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.021+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~37V82C8GCV4C.2 size=207098 2024-03-04T12:26:48.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.022+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=37V82C8GCV4C tag=5PXPM6KAK6JM type=write size=3352826 2024-03-04T12:26:48.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.024+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~13QH2HB0XTME.0 size=173566 2024-03-04T12:26:48.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.024+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=13QH2HB0XTME tag=E7TLJLHFTAYQ type=write size=1222142 2024-03-04T12:26:48.032 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.026+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=0Z070GZCNHOK type=del 2024-03-04T12:26:48.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.027+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=A2ZVK32Z0003 type=del size=2937806 2024-03-04T12:26:48.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.027+0000 7fa4b3c3e780 1 < canceled part key=_multipart_H5FWRNK8F7QT.2~F9923LBDE4G5.0 size=1048576 2024-03-04T12:26:48.035 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.028+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~F9923LBDE4G5.1 size=25791 2024-03-04T12:26:48.037 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.030+0000 7fa4b3c3e780 1 < canceled multipart upload key=H5FWRNK8F7QT upload=F9923LBDE4G5 tag=4U87ZN11BR50 type=write size=2122943 2024-03-04T12:26:48.038 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.031+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=ERF41GPC152T type=del size=2925549 2024-03-04T12:26:48.039 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.032+0000 7fa4b3c3e780 1 < canceled operation key=7IUV88NQLPN8 tag=1RK3NHU960P7 type=del size=3434978 2024-03-04T12:26:48.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.034+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=AS16FBHOHMOT type=del size=2089348 2024-03-04T12:26:48.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.035+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~ODCDHRPE4WR4.0 size=1048576 2024-03-04T12:26:48.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.035+0000 7fa4b3c3e780 1 < canceled part key=_multipart_4LKTYP07OL5L.2~ODCDHRPE4WR4.1 size=1048576 2024-03-04T12:26:48.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.036+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~ODCDHRPE4WR4.2 size=957849 2024-03-04T12:26:48.044 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.038+0000 7fa4b3c3e780 1 < canceled multipart upload key=4LKTYP07OL5L upload=ODCDHRPE4WR4 tag=VMC4SGUN107A type=write size=4103577 2024-03-04T12:26:48.046 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.040+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~UEGPHC9YI0N1.0 size=606094 2024-03-04T12:26:48.046 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.040+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=UEGPHC9YI0N1 tag=KTYRT2LHWQAO type=write size=1654670 2024-03-04T12:26:48.047 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.041+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=6EPDM9IUH70A type=del 2024-03-04T12:26:48.048 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.042+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=5V9DANA6OBU4 type=del size=2495535 2024-03-04T12:26:48.050 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.043+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=6UW2NIGLXE3U type=del 2024-03-04T12:26:48.052 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.045+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~DGVZHI6KHHO2.0 size=1048576 2024-03-04T12:26:48.052 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.046+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~DGVZHI6KHHO2.1 size=683445 2024-03-04T12:26:48.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.046+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=DGVZHI6KHHO2 tag=7F7URPKVUPXW type=write size=2780597 2024-03-04T12:26:48.054 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.047+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=0D4LDIJEH1DO type=del 2024-03-04T12:26:48.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.049+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~BX31I83TU4Y3.0 size=1048576 2024-03-04T12:26:48.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.050+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~BX31I83TU4Y3.1 size=329104 2024-03-04T12:26:48.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.050+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=BX31I83TU4Y3 tag=1RGB7P4Q2UOJ type=write size=2426256 2024-03-04T12:26:48.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.052+0000 7fa4b3c3e780 1 < suggested remove operation key=43HMF7NWNMU3 tag=GBGWOYB80WJM type=del 2024-03-04T12:26:48.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.054+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=JPKU9SR7JQWA type=del size=510206 2024-03-04T12:26:48.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.055+0000 7fa4b3c3e780 1 < completed write operation key=H5FWRNK8F7QT tag=MUR9EYK0FZQY type=write size=197053 2024-03-04T12:26:48.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.057+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~1MIWZC142OJA.0 size=1048576 2024-03-04T12:26:48.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.058+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~1MIWZC142OJA.1 size=149695 2024-03-04T12:26:48.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.058+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=1MIWZC142OJA tag=WF7QURC9RCBN type=write size=2246847 2024-03-04T12:26:48.066 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.059+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=G3OTBHD7F4LT type=del 2024-03-04T12:26:48.068 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.061+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~Z4G22NCGINEN.0 size=1048576 2024-03-04T12:26:48.069 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.062+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~Z4G22NCGINEN.1 size=854733 2024-03-04T12:26:48.069 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.062+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=Z4G22NCGINEN tag=0BDW3FQPFZRS type=write size=2951885 2024-03-04T12:26:48.070 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.063+0000 7fa4b3c3e780 1 < completed delete operation key=UZRX3W3DE5VX tag=C6877ZZ7UOSB type=del 2024-03-04T12:26:48.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.065+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=MYGJ8O4ZHNEW type=del size=3232475 2024-03-04T12:26:48.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.066+0000 7fa4b3c3e780 -1 < failed to complete operation key=43HMF7NWNMU3 tag=C92TEWZJHLHR type=del size=3117636: (22) Invalid argument 2024-03-04T12:26:48.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.067+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=YWD6BI2SAIDZ type=del size=83359 2024-03-04T12:26:48.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.068+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=K9R4NWK3A35D type=del 2024-03-04T12:26:48.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.069+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=RR2D7X4Q0TS4 type=del size=2452463 2024-03-04T12:26:48.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.070+0000 7fa4b3c3e780 1 < canceled part key=_multipart_ZETES4AYZQHY.2~H2LOHEAU1CL7.0 size=1048576 2024-03-04T12:26:48.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.070+0000 7fa4b3c3e780 1 < canceled part key=_multipart_ZETES4AYZQHY.2~H2LOHEAU1CL7.1 size=1048576 2024-03-04T12:26:48.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.071+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~H2LOHEAU1CL7.2 size=191760 2024-03-04T12:26:48.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.073+0000 7fa4b3c3e780 1 < canceled multipart upload key=ZETES4AYZQHY upload=H2LOHEAU1CL7 tag=VPAVIOPFNL99 type=write size=3337488 2024-03-04T12:26:48.081 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.074+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=6M1J3MVVSZZ0 type=del size=4028911 2024-03-04T12:26:48.082 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.075+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~ARZWM2PZ2XMR.0 size=1048576 2024-03-04T12:26:48.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.076+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~ARZWM2PZ2XMR.1 size=1048576 2024-03-04T12:26:48.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.077+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~ARZWM2PZ2XMR.2 size=764796 2024-03-04T12:26:48.086 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.079+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=ARZWM2PZ2XMR tag=GG2N2K72BQT2 type=write size=3910524 2024-03-04T12:26:48.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.080+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=13BDHGRU82LR type=del size=184988 2024-03-04T12:26:48.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.081+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~13QH2HB0XTME.0 size=173566 2024-03-04T12:26:48.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.083+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=13QH2HB0XTME tag=E7TLJLHFTAYQ type=write size=1222142 2024-03-04T12:26:48.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.085+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~TQBVBEOQAFGY.0 size=1048576 2024-03-04T12:26:48.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.086+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~TQBVBEOQAFGY.1 size=824181 2024-03-04T12:26:48.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.086+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=TQBVBEOQAFGY tag=SX577SE95MBH type=write size=2921333 2024-03-04T12:26:48.095 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.089+0000 7fa4b3c3e780 1 < suggested remove operation key=4989OME3IAJF tag=A2ZVK32Z0003 type=del 2024-03-04T12:26:48.096 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.090+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=VWS50XXHHBXY type=del size=4162242 2024-03-04T12:26:48.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.091+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=ERF41GPC152T type=del 2024-03-04T12:26:48.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.093+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~46RCBMD9APEY.0 size=1048576 2024-03-04T12:26:48.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.094+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~46RCBMD9APEY.1 size=198800 2024-03-04T12:26:48.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.094+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=46RCBMD9APEY tag=3NCLY0G0WZCQ type=write size=2295952 2024-03-04T12:26:48.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.096+0000 7fa4b3c3e780 1 < suggested update operation key=H5FWRNK8F7QT tag=AS16FBHOHMOT type=del size=2089348 2024-03-04T12:26:48.104 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.097+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=C259T508HCUE type=del size=3422959 2024-03-04T12:26:48.105 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.098+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~UEGPHC9YI0N1.0 size=606094 2024-03-04T12:26:48.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.100+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=UEGPHC9YI0N1 tag=KTYRT2LHWQAO type=write size=1654670 2024-03-04T12:26:48.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.102+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~OJY28525CKGU.0 size=636069 2024-03-04T12:26:48.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.102+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=OJY28525CKGU tag=FU6Z7L7ZT7YF type=write size=1684645 2024-03-04T12:26:48.110 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.103+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=5V9DANA6OBU4 type=del 2024-03-04T12:26:48.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.104+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=OGFL9O1W68ZJ type=del size=4022958 2024-03-04T12:26:48.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.106+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~DGVZHI6KHHO2.0 size=1048576 2024-03-04T12:26:48.113 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.107+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~DGVZHI6KHHO2.1 size=683445 2024-03-04T12:26:48.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.109+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=DGVZHI6KHHO2 tag=7F7URPKVUPXW type=write size=2780597 2024-03-04T12:26:48.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.110+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=35O7TUZT5ZRZ type=del size=1966865 2024-03-04T12:26:48.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.110+0000 7fa4b3c3e780 1 < canceled part key=_multipart_R1DOKJPZRT5Q.2~BX31I83TU4Y3.0 size=1048576 2024-03-04T12:26:48.118 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.111+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~BX31I83TU4Y3.1 size=329104 2024-03-04T12:26:48.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.113+0000 7fa4b3c3e780 1 < canceled multipart upload key=R1DOKJPZRT5Q upload=BX31I83TU4Y3 tag=1RGB7P4Q2UOJ type=write size=2426256 2024-03-04T12:26:48.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.114+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=0YDQVLDA62VV type=write size=925913 2024-03-04T12:26:48.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.115+0000 7fa4b3c3e780 -1 < failed to complete operation key=4989OME3IAJF tag=JPKU9SR7JQWA type=del size=510206: (22) Invalid argument 2024-03-04T12:26:48.125 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.118+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=JV6VXJYSF9W1 type=del size=1210112 2024-03-04T12:26:48.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.119+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~1MIWZC142OJA.0 size=1048576 2024-03-04T12:26:48.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.120+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~1MIWZC142OJA.1 size=149695 2024-03-04T12:26:48.129 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.122+0000 7fa4b3c3e780 1 < completed multipart upload key=V7N7MZ1GUNEV upload=1MIWZC142OJA tag=WF7QURC9RCBN type=write size=2246847 2024-03-04T12:26:48.130 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.123+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=R1RB0QXFCI9S type=del size=3577998 2024-03-04T12:26:48.131 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.124+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~Z4G22NCGINEN.0 size=1048576 2024-03-04T12:26:48.132 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.125+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~Z4G22NCGINEN.1 size=854733 2024-03-04T12:26:48.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.127+0000 7fa4b3c3e780 1 < completed multipart upload key=3N6E09QF3866 upload=Z4G22NCGINEN tag=0BDW3FQPFZRS type=write size=2951885 2024-03-04T12:26:48.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.130+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~ZG6HWA63BV8U.0 size=1048576 2024-03-04T12:26:48.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.131+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~ZG6HWA63BV8U.1 size=1048576 2024-03-04T12:26:48.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.131+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~ZG6HWA63BV8U.2 size=271256 2024-03-04T12:26:48.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.131+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=ZG6HWA63BV8U tag=AM31UFZRTNYA type=write size=3416984 2024-03-04T12:26:48.139 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.133+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=MYGJ8O4ZHNEW type=del 2024-03-04T12:26:48.141 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.135+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~0CMIU7VV5Z4Y.0 size=1048576 2024-03-04T12:26:48.142 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.135+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~0CMIU7VV5Z4Y.1 size=1048576 2024-03-04T12:26:48.143 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.136+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~0CMIU7VV5Z4Y.2 size=352227 2024-03-04T12:26:48.143 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.136+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=0CMIU7VV5Z4Y tag=KS3723V9KCFT type=write size=3497955 2024-03-04T12:26:48.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.139+0000 7fa4b3c3e780 1 < suggested remove operation key=YQLH0WW7I7MW tag=YWD6BI2SAIDZ type=del 2024-03-04T12:26:48.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.140+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=90XN0TB4X45N type=del size=887671 2024-03-04T12:26:48.147 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.141+0000 7fa4b3c3e780 1 < canceled operation key=3TDMQXKLPX34 tag=RR2D7X4Q0TS4 type=del size=2452463 2024-03-04T12:26:48.149 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.142+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=8T54D9NX0PSA type=del size=1408987 2024-03-04T12:26:48.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.143+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=6M1J3MVVSZZ0 type=del 2024-03-04T12:26:48.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.144+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=F9ZWE5BQ2DNX type=del size=2345300 2024-03-04T12:26:48.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.145+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=13BDHGRU82LR type=del 2024-03-04T12:26:48.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.146+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=31EK6I32LXEQ type=del size=3739796 2024-03-04T12:26:48.154 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.147+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~TQBVBEOQAFGY.0 size=1048576 2024-03-04T12:26:48.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.148+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~TQBVBEOQAFGY.1 size=824181 2024-03-04T12:26:48.157 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.150+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=TQBVBEOQAFGY tag=SX577SE95MBH type=write size=2921333 2024-03-04T12:26:48.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.151+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=RONYDWETJQ6I type=del size=3257116 2024-03-04T12:26:48.160 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.153+0000 7fa4b3c3e780 1 < suggested update operation key=4LKTYP07OL5L tag=VWS50XXHHBXY type=del size=4162242 2024-03-04T12:26:48.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.155+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~F65TGAFPM2YM.0 size=747266 2024-03-04T12:26:48.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.155+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=F65TGAFPM2YM tag=8FJO75TWSNMY type=write size=1795842 2024-03-04T12:26:48.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.156+0000 7fa4b3c3e780 1 < canceled part key=_multipart_6XK4DQ940Z5J.2~46RCBMD9APEY.0 size=1048576 2024-03-04T12:26:48.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.157+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~46RCBMD9APEY.1 size=198800 2024-03-04T12:26:48.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.158+0000 7fa4b3c3e780 1 < canceled multipart upload key=6XK4DQ940Z5J upload=46RCBMD9APEY tag=3NCLY0G0WZCQ type=write size=2295952 2024-03-04T12:26:48.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.160+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=IC9I0QBY0Y72 type=del size=3972883 2024-03-04T12:26:48.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.161+0000 7fa4b3c3e780 -1 < failed to complete operation key=YQLH0WW7I7MW tag=C259T508HCUE type=del size=3422959: (22) Invalid argument 2024-03-04T12:26:48.170 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.163+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~KR6T3J8NLNBR.0 size=845660 2024-03-04T12:26:48.170 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.163+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=KR6T3J8NLNBR tag=154VSCMKCQBH type=write size=1894236 2024-03-04T12:26:48.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.164+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~OJY28525CKGU.0 size=636069 2024-03-04T12:26:48.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.166+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=OJY28525CKGU tag=FU6Z7L7ZT7YF type=write size=1684645 2024-03-04T12:26:48.175 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.168+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~4MM3XECYWZRX.0 size=1048576 2024-03-04T12:26:48.176 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.169+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~4MM3XECYWZRX.1 size=1048576 2024-03-04T12:26:48.176 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.170+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~4MM3XECYWZRX.2 size=678045 2024-03-04T12:26:48.177 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.170+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=4MM3XECYWZRX tag=B1FKOOGEDUG4 type=write size=3823773 2024-03-04T12:26:48.178 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.171+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=OGFL9O1W68ZJ type=del 2024-03-04T12:26:48.180 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.173+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~BH66CSO7APEJ.0 size=1048576 2024-03-04T12:26:48.181 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.174+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~BH66CSO7APEJ.1 size=184203 2024-03-04T12:26:48.181 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.174+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=BH66CSO7APEJ tag=KVA88AFIMM7W type=write size=2281355 2024-03-04T12:26:48.182 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.175+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=35O7TUZT5ZRZ type=del 2024-03-04T12:26:48.183 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.176+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=DRHAYV95J1FL type=del size=3271124 2024-03-04T12:26:48.185 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.178+0000 7fa4b3c3e780 1 < suggested update operation key=G70BJ2UARNCP tag=0YDQVLDA62VV type=write size=925913 2024-03-04T12:26:48.186 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.180+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=VRX069KTK89A type=del size=2222630 2024-03-04T12:26:48.187 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.181+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=JV6VXJYSF9W1 type=del 2024-03-04T12:26:48.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.182+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=7DGAWNYZUIIT type=write size=904729 2024-03-04T12:26:48.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.184+0000 7fa4b3c3e780 1 < suggested remove operation key=ZETES4AYZQHY tag=R1RB0QXFCI9S type=del 2024-03-04T12:26:48.192 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.185+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=HNFAW1OLE5YO type=del size=4015147 2024-03-04T12:26:48.193 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.186+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~ZG6HWA63BV8U.0 size=1048576 2024-03-04T12:26:48.194 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.187+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~ZG6HWA63BV8U.1 size=1048576 2024-03-04T12:26:48.195 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.188+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~ZG6HWA63BV8U.2 size=271256 2024-03-04T12:26:48.197 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.190+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=ZG6HWA63BV8U tag=AM31UFZRTNYA type=write size=3416984 2024-03-04T12:26:48.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.192+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~O5I157OZR3JU.0 size=1048576 2024-03-04T12:26:48.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.193+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~O5I157OZR3JU.1 size=1048576 2024-03-04T12:26:48.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.194+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~O5I157OZR3JU.2 size=515861 2024-03-04T12:26:48.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.194+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=O5I157OZR3JU tag=P3HQYVWXW3N8 type=write size=3661589 2024-03-04T12:26:48.202 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.195+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~0CMIU7VV5Z4Y.0 size=1048576 2024-03-04T12:26:48.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.196+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~0CMIU7VV5Z4Y.1 size=1048576 2024-03-04T12:26:48.204 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.197+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~0CMIU7VV5Z4Y.2 size=352227 2024-03-04T12:26:48.205 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.199+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=0CMIU7VV5Z4Y tag=KS3723V9KCFT type=write size=3497955 2024-03-04T12:26:48.207 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.200+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=JN5YZW9OIC8Z type=write size=382026 2024-03-04T12:26:48.208 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.201+0000 7fa4b3c3e780 1 < completed delete operation key=GMIPCGYZRJ5L tag=90XN0TB4X45N type=del 2024-03-04T12:26:48.210 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.203+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~ZMWWNCQ3DE0Z.0 size=659599 2024-03-04T12:26:48.210 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.203+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=ZMWWNCQ3DE0Z tag=VE0OSOLT6QUL type=write size=1708175 2024-03-04T12:26:48.211 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.204+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=8T54D9NX0PSA type=del 2024-03-04T12:26:48.212 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.205+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=PH37TFQLVSYZ type=write size=225619 2024-03-04T12:26:48.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.206+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=F9ZWE5BQ2DNX type=del 2024-03-04T12:26:48.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.209+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~DPJX22S0L6F3.0 size=400651 2024-03-04T12:26:48.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.209+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=DPJX22S0L6F3 tag=XWYE4DZI5S13 type=write size=1449227 2024-03-04T12:26:48.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.210+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=31EK6I32LXEQ type=del 2024-03-04T12:26:48.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.211+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=YVUJLPJGN0K9 type=del size=3261008 2024-03-04T12:26:48.219 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.212+0000 7fa4b3c3e780 -1 < failed to complete operation key=G70BJ2UARNCP tag=RONYDWETJQ6I type=del size=3257116: (22) Invalid argument 2024-03-04T12:26:48.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.214+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=NKKM837T23L0 type=del size=430666 2024-03-04T12:26:48.222 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.215+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~F65TGAFPM2YM.0 size=747266 2024-03-04T12:26:48.224 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.217+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=F65TGAFPM2YM tag=8FJO75TWSNMY type=write size=1795842 2024-03-04T12:26:48.225 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.218+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=4FTWMHWX2FTV type=del size=60183 2024-03-04T12:26:48.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.220+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=IC9I0QBY0Y72 type=del 2024-03-04T12:26:48.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.221+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=FVC6S107VKYV type=write size=367059 2024-03-04T12:26:48.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.222+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~KR6T3J8NLNBR.0 size=845660 2024-03-04T12:26:48.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.225+0000 7fa4b3c3e780 1 < completed multipart upload key=YIS2SV4O5EZN upload=KR6T3J8NLNBR tag=154VSCMKCQBH type=write size=1894236 2024-03-04T12:26:48.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.226+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=WXT3DODEWCYI type=write size=3226 2024-03-04T12:26:48.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.228+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~4MM3XECYWZRX.0 size=1048576 2024-03-04T12:26:48.235 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.229+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~4MM3XECYWZRX.1 size=1048576 2024-03-04T12:26:48.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.229+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YIS2SV4O5EZN.2~4MM3XECYWZRX.2 size=678045 2024-03-04T12:26:48.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.231+0000 7fa4b3c3e780 1 < canceled multipart upload key=YIS2SV4O5EZN upload=4MM3XECYWZRX tag=B1FKOOGEDUG4 type=write size=3823773 2024-03-04T12:26:48.239 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.233+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~8OETYHQET2ET.0 size=738810 2024-03-04T12:26:48.240 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.233+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=8OETYHQET2ET tag=ZTXZ5308CYMC type=write size=1787386 2024-03-04T12:26:48.241 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.234+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~BH66CSO7APEJ.0 size=1048576 2024-03-04T12:26:48.241 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.235+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~BH66CSO7APEJ.1 size=184203 2024-03-04T12:26:48.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.236+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=BH66CSO7APEJ tag=KVA88AFIMM7W type=write size=2281355 2024-03-04T12:26:48.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.238+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=GNLKZYKKZZQV type=write size=515610 2024-03-04T12:26:48.245 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.239+0000 7fa4b3c3e780 1 < canceled operation key=43HMF7NWNMU3 tag=DRHAYV95J1FL type=del size=3271124 2024-03-04T12:26:48.246 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.240+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=ZR6H54G6WVM9 type=del size=1907031 2024-03-04T12:26:48.248 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.241+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=VRX069KTK89A type=del 2024-03-04T12:26:48.249 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.242+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=W3BQOUU64UFP type=del size=2907929 2024-03-04T12:26:48.250 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.243+0000 7fa4b3c3e780 1 < completed write operation key=G8G76PMSKJ0I tag=7DGAWNYZUIIT type=write size=904729 2024-03-04T12:26:48.252 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.245+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~WDN1NL1AAGRE.0 size=1048576 2024-03-04T12:26:48.252 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.246+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~WDN1NL1AAGRE.1 size=1048576 2024-03-04T12:26:48.253 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.247+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~WDN1NL1AAGRE.2 size=945705 2024-03-04T12:26:48.253 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.247+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=WDN1NL1AAGRE tag=XCMC17R0NV0E type=write size=4091433 2024-03-04T12:26:48.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.248+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=HNFAW1OLE5YO type=del 2024-03-04T12:26:48.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.250+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~74QE9CYPWSAM.0 size=1048576 2024-03-04T12:26:48.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.251+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~74QE9CYPWSAM.1 size=374678 2024-03-04T12:26:48.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.251+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=74QE9CYPWSAM tag=PRPUMN1AO3UB type=write size=2471830 2024-03-04T12:26:48.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.252+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~O5I157OZR3JU.0 size=1048576 2024-03-04T12:26:48.259 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.253+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~O5I157OZR3JU.1 size=1048576 2024-03-04T12:26:48.260 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.253+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~O5I157OZR3JU.2 size=515861 2024-03-04T12:26:48.262 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.255+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=O5I157OZR3JU tag=P3HQYVWXW3N8 type=write size=3661589 2024-03-04T12:26:48.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.256+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=3B013O4P6TY2 type=del size=4029540 2024-03-04T12:26:48.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.258+0000 7fa4b3c3e780 1 < suggested remove operation key=BR8RTE2QEH9E tag=JN5YZW9OIC8Z type=write 2024-03-04T12:26:48.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.260+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~DJEBTCJNCJEE.0 size=1048576 2024-03-04T12:26:48.268 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.261+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~DJEBTCJNCJEE.1 size=273264 2024-03-04T12:26:48.268 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.261+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=DJEBTCJNCJEE tag=SV72ZZ0Q0CUB type=write size=2370416 2024-03-04T12:26:48.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.262+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~ZMWWNCQ3DE0Z.0 size=659599 2024-03-04T12:26:48.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.264+0000 7fa4b3c3e780 1 < completed multipart upload key=ESHAMQWMMBJR upload=ZMWWNCQ3DE0Z tag=VE0OSOLT6QUL type=write size=1708175 2024-03-04T12:26:48.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.265+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=R5P6IJ2PV2VF type=del size=2526703 2024-03-04T12:26:48.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.266+0000 7fa4b3c3e780 1 < completed write operation key=G4SUQFVB936T tag=PH37TFQLVSYZ type=write size=225619 2024-03-04T12:26:48.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.268+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=GSTGFWBJ0FEY type=del size=2950510 2024-03-04T12:26:48.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.269+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~DPJX22S0L6F3.0 size=400651 2024-03-04T12:26:48.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.271+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=DPJX22S0L6F3 tag=XWYE4DZI5S13 type=write size=1449227 2024-03-04T12:26:48.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.273+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~XXKHV7PCN813.0 size=586065 2024-03-04T12:26:48.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.273+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=XXKHV7PCN813 tag=P8B8E99PDJSU type=write size=1634641 2024-03-04T12:26:48.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.274+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=YVUJLPJGN0K9 type=del 2024-03-04T12:26:48.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.276+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~WKI0W3FTU9AU.0 size=1048576 2024-03-04T12:26:48.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.277+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~WKI0W3FTU9AU.1 size=1048576 2024-03-04T12:26:48.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.278+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~WKI0W3FTU9AU.2 size=384618 2024-03-04T12:26:48.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.278+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=WKI0W3FTU9AU tag=UOXBUB605W6B type=write size=3530346 2024-03-04T12:26:48.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.279+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=NKKM837T23L0 type=del 2024-03-04T12:26:48.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.280+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=MKEGP167S1LY type=del size=3059849 2024-03-04T12:26:48.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.283+0000 7fa4b3c3e780 1 < suggested update operation key=V7N7MZ1GUNEV tag=4FTWMHWX2FTV type=del size=60183 2024-03-04T12:26:48.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.284+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=DGSMOBW625FO type=del size=3648838 2024-03-04T12:26:48.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.285+0000 7fa4b3c3e780 1 < completed write operation key=YWJV4QMY6ZBI tag=FVC6S107VKYV type=write size=367059 2024-03-04T12:26:48.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.287+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~NRQW9LW7F43L.0 size=131292 2024-03-04T12:26:48.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.287+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=NRQW9LW7F43L tag=9WMTEUP44D2U type=write size=1179868 2024-03-04T12:26:48.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.288+0000 7fa4b3c3e780 1 < completed write operation key=3N6E09QF3866 tag=WXT3DODEWCYI type=write size=3226 2024-03-04T12:26:48.297 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.290+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~7GF88X1ITX44.0 size=1048576 2024-03-04T12:26:48.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.291+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~7GF88X1ITX44.1 size=1048576 2024-03-04T12:26:48.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.292+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~7GF88X1ITX44.2 size=205138 2024-03-04T12:26:48.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.292+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=7GF88X1ITX44 tag=513N10MUG6JE type=write size=3350866 2024-03-04T12:26:48.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.292+0000 7fa4b3c3e780 1 < canceled part key=_multipart_G70BJ2UARNCP.2~8OETYHQET2ET.0 size=738810 2024-03-04T12:26:48.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.294+0000 7fa4b3c3e780 1 < canceled multipart upload key=G70BJ2UARNCP upload=8OETYHQET2ET tag=ZTXZ5308CYMC type=write size=1787386 2024-03-04T12:26:48.302 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.295+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=SHF3B1ZDWP03 type=del size=606776 2024-03-04T12:26:48.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.297+0000 7fa4b3c3e780 1 < completed write operation key=VAIY4J3CYONH tag=GNLKZYKKZZQV type=write size=515610 2024-03-04T12:26:48.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.298+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=D08CZMEC4NHR type=del size=1336519 2024-03-04T12:26:48.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.300+0000 7fa4b3c3e780 1 < suggested update operation key=43HMF7NWNMU3 tag=ZR6H54G6WVM9 type=del size=1907031 2024-03-04T12:26:48.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.302+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~360KEMKUP0JX.0 size=1048576 2024-03-04T12:26:48.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.303+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~360KEMKUP0JX.1 size=1048576 2024-03-04T12:26:48.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.304+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~360KEMKUP0JX.2 size=821088 2024-03-04T12:26:48.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.304+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=360KEMKUP0JX tag=IAKCMSQKET08 type=write size=3966816 2024-03-04T12:26:48.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.305+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=W3BQOUU64UFP type=del 2024-03-04T12:26:48.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.307+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=34IWOQVB9K8L type=write size=267493 2024-03-04T12:26:48.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.308+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~WDN1NL1AAGRE.0 size=1048576 2024-03-04T12:26:48.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.309+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~WDN1NL1AAGRE.1 size=1048576 2024-03-04T12:26:48.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.310+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~WDN1NL1AAGRE.2 size=945705 2024-03-04T12:26:48.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.312+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=WDN1NL1AAGRE tag=XCMC17R0NV0E type=write size=4091433 2024-03-04T12:26:48.320 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.313+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=XVNAF4O0HSVW type=del size=3195965 2024-03-04T12:26:48.321 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.314+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~74QE9CYPWSAM.0 size=1048576 2024-03-04T12:26:48.321 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.314+0000 7fa4b3c3e780 1 < canceled part key=_multipart_3TDMQXKLPX34.2~74QE9CYPWSAM.1 size=374678 2024-03-04T12:26:48.323 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.316+0000 7fa4b3c3e780 1 < canceled multipart upload key=3TDMQXKLPX34 upload=74QE9CYPWSAM tag=PRPUMN1AO3UB type=write size=2471830 2024-03-04T12:26:48.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.317+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=YM14GRTWDE35 type=del size=2249068 2024-03-04T12:26:48.325 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.318+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=3B013O4P6TY2 type=del 2024-03-04T12:26:48.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.320+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~FA4ZWZ387JVV.0 size=1048576 2024-03-04T12:26:48.328 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.321+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~FA4ZWZ387JVV.1 size=1048576 2024-03-04T12:26:48.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.322+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~FA4ZWZ387JVV.2 size=359590 2024-03-04T12:26:48.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.322+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=FA4ZWZ387JVV tag=5ARG4A5IKLXE type=write size=3505318 2024-03-04T12:26:48.330 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.323+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~DJEBTCJNCJEE.0 size=1048576 2024-03-04T12:26:48.330 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.323+0000 7fa4b3c3e780 1 < canceled part key=_multipart_BR8RTE2QEH9E.2~DJEBTCJNCJEE.1 size=273264 2024-03-04T12:26:48.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.325+0000 7fa4b3c3e780 1 < canceled multipart upload key=BR8RTE2QEH9E upload=DJEBTCJNCJEE tag=SV72ZZ0Q0CUB type=write size=2370416 2024-03-04T12:26:48.333 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.326+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=H2UJ5VL979YH type=del size=2521132 2024-03-04T12:26:48.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.327+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=R5P6IJ2PV2VF type=del 2024-03-04T12:26:48.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.329+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=WA7JU0W2G7XK type=write size=552662 2024-03-04T12:26:48.339 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.332+0000 7fa4b3c3e780 1 < suggested remove operation key=X0RVLNRWUAEM tag=GSTGFWBJ0FEY type=del 2024-03-04T12:26:48.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.333+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=FMQ0SGL6BUW1 type=del size=3590658 2024-03-04T12:26:48.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.334+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YWJV4QMY6ZBI.2~XXKHV7PCN813.0 size=586065 2024-03-04T12:26:48.342 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.335+0000 7fa4b3c3e780 1 < canceled multipart upload key=YWJV4QMY6ZBI upload=XXKHV7PCN813 tag=P8B8E99PDJSU type=write size=1634641 2024-03-04T12:26:48.344 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.337+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~72YPS717GIT3.0 size=1048576 2024-03-04T12:26:48.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.338+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~72YPS717GIT3.1 size=1048576 2024-03-04T12:26:48.346 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.339+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~72YPS717GIT3.2 size=714527 2024-03-04T12:26:48.346 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.339+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=72YPS717GIT3 tag=G8CDJL0WWMWU type=write size=3860255 2024-03-04T12:26:48.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.340+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~WKI0W3FTU9AU.0 size=1048576 2024-03-04T12:26:48.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.341+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~WKI0W3FTU9AU.1 size=1048576 2024-03-04T12:26:48.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.342+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~WKI0W3FTU9AU.2 size=384618 2024-03-04T12:26:48.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.344+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=WKI0W3FTU9AU tag=UOXBUB605W6B type=write size=3530346 2024-03-04T12:26:48.352 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.345+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=HFXPFKOIUPQW type=del size=1363201 2024-03-04T12:26:48.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.346+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=MKEGP167S1LY type=del 2024-03-04T12:26:48.354 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.347+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=X0IL2O3EM533 type=write size=512735 2024-03-04T12:26:48.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.349+0000 7fa4b3c3e780 1 < completed delete operation key=UZRX3W3DE5VX tag=DGSMOBW625FO type=del 2024-03-04T12:26:48.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.351+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~5BJE625VI821.0 size=167095 2024-03-04T12:26:48.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.351+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=5BJE625VI821 tag=4NZYR0DD0AAP type=write size=1215671 2024-03-04T12:26:48.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.352+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~NRQW9LW7F43L.0 size=131292 2024-03-04T12:26:48.360 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.354+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=NRQW9LW7F43L tag=9WMTEUP44D2U type=write size=1179868 2024-03-04T12:26:48.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.356+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~PC96D1VTU8MR.0 size=282923 2024-03-04T12:26:48.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.356+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=PC96D1VTU8MR tag=T4A9KFM7X81Z type=write size=1331499 2024-03-04T12:26:48.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.356+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YIS2SV4O5EZN.2~7GF88X1ITX44.0 size=1048576 2024-03-04T12:26:48.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.357+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~7GF88X1ITX44.1 size=1048576 2024-03-04T12:26:48.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.358+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~7GF88X1ITX44.2 size=205138 2024-03-04T12:26:48.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.360+0000 7fa4b3c3e780 1 < canceled multipart upload key=YIS2SV4O5EZN upload=7GF88X1ITX44 tag=513N10MUG6JE type=write size=3350866 2024-03-04T12:26:48.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.361+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=L0FM04IB69UN type=del size=1885596 2024-03-04T12:26:48.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.362+0000 7fa4b3c3e780 1 < canceled operation key=BVMWQ9ZL4K0C tag=SHF3B1ZDWP03 type=del size=606776 2024-03-04T12:26:48.370 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.363+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=YCQ4DV51ZSPP type=del size=3782951 2024-03-04T12:26:48.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.364+0000 7fa4b3c3e780 1 < canceled operation key=BR8RTE2QEH9E tag=D08CZMEC4NHR type=del size=1336519 2024-03-04T12:26:48.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.365+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=AHG741QGVXYH type=del size=3383876 2024-03-04T12:26:48.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.366+0000 7fa4b3c3e780 1 < canceled part key=_multipart_DHLTVH2AZBLR.2~360KEMKUP0JX.0 size=1048576 2024-03-04T12:26:48.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.367+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~360KEMKUP0JX.1 size=1048576 2024-03-04T12:26:48.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.367+0000 7fa4b3c3e780 1 < canceled part key=_multipart_DHLTVH2AZBLR.2~360KEMKUP0JX.2 size=821088 2024-03-04T12:26:48.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.368+0000 7fa4b3c3e780 1 < canceled multipart upload key=DHLTVH2AZBLR upload=360KEMKUP0JX tag=IAKCMSQKET08 type=write size=3966816 2024-03-04T12:26:48.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.370+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=BARW0EKML8Q2 type=del size=2299116 2024-03-04T12:26:48.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.371+0000 7fa4b3c3e780 1 < completed write operation key=43HMF7NWNMU3 tag=34IWOQVB9K8L type=write size=267493 2024-03-04T12:26:48.378 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.372+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=RIIU0DFBU3J2 type=write size=608731 2024-03-04T12:26:48.380 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.373+0000 7fa4b3c3e780 1 < completed delete operation key=R1DOKJPZRT5Q tag=XVNAF4O0HSVW type=del 2024-03-04T12:26:48.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.374+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=RAF1TLHQKFYH type=del size=1747400 2024-03-04T12:26:48.382 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.375+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=YM14GRTWDE35 type=del 2024-03-04T12:26:48.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.376+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=N2VVGK00B5G8 type=del size=746838 2024-03-04T12:26:48.384 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.377+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~FA4ZWZ387JVV.0 size=1048576 2024-03-04T12:26:48.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.378+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~FA4ZWZ387JVV.1 size=1048576 2024-03-04T12:26:48.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.379+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~FA4ZWZ387JVV.2 size=359590 2024-03-04T12:26:48.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.381+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=FA4ZWZ387JVV tag=5ARG4A5IKLXE type=write size=3505318 2024-03-04T12:26:48.390 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.383+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~0SZB1J9ETRS8.0 size=1048576 2024-03-04T12:26:48.391 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.384+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~0SZB1J9ETRS8.1 size=378608 2024-03-04T12:26:48.391 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.384+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=0SZB1J9ETRS8 tag=D256G0KKQMM6 type=write size=2475760 2024-03-04T12:26:48.393 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.387+0000 7fa4b3c3e780 1 < suggested remove operation key=ESHAMQWMMBJR tag=H2UJ5VL979YH type=del 2024-03-04T12:26:48.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.388+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=HFV2T8X9QS5R type=del size=70620 2024-03-04T12:26:48.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.389+0000 7fa4b3c3e780 1 < completed write operation key=G8G76PMSKJ0I tag=WA7JU0W2G7XK type=write size=552662 2024-03-04T12:26:48.397 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.390+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=5ASBKFSYUAAT type=del size=2913770 2024-03-04T12:26:48.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.392+0000 7fa4b3c3e780 1 < completed delete operation key=R6Y09EO6HGF0 tag=FMQ0SGL6BUW1 type=del 2024-03-04T12:26:48.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.393+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=VREUNPGA3N9R type=del size=3315613 2024-03-04T12:26:48.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.393+0000 7fa4b3c3e780 1 < canceled part key=_multipart_43HMF7NWNMU3.2~72YPS717GIT3.0 size=1048576 2024-03-04T12:26:48.401 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.394+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~72YPS717GIT3.1 size=1048576 2024-03-04T12:26:48.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.395+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~72YPS717GIT3.2 size=714527 2024-03-04T12:26:48.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.397+0000 7fa4b3c3e780 1 < canceled multipart upload key=43HMF7NWNMU3 upload=72YPS717GIT3 tag=G8CDJL0WWMWU type=write size=3860255 2024-03-04T12:26:48.405 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.398+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=IRT6058S0GH8 type=del size=2058685 2024-03-04T12:26:48.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.401+0000 7fa4b3c3e780 1 < suggested remove operation key=BR8RTE2QEH9E tag=HFXPFKOIUPQW type=del 2024-03-04T12:26:48.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.403+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~HT4VGLCC9NTD.0 size=1048576 2024-03-04T12:26:48.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.404+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~HT4VGLCC9NTD.1 size=449298 2024-03-04T12:26:48.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.404+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=HT4VGLCC9NTD tag=VI70MOLKRVD2 type=write size=2546450 2024-03-04T12:26:48.412 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.405+0000 7fa4b3c3e780 1 < completed write operation key=3TDMQXKLPX34 tag=X0IL2O3EM533 type=write size=512735 2024-03-04T12:26:48.413 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.406+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=WDXCHBV9BBTR type=del size=3077395 2024-03-04T12:26:48.414 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.407+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~5BJE625VI821.0 size=167095 2024-03-04T12:26:48.416 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.409+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=5BJE625VI821 tag=4NZYR0DD0AAP type=write size=1215671 2024-03-04T12:26:48.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.411+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~8ZCR9KLWBZLD.0 size=1048576 2024-03-04T12:26:48.419 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.412+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~8ZCR9KLWBZLD.1 size=1048576 2024-03-04T12:26:48.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.413+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~8ZCR9KLWBZLD.2 size=471687 2024-03-04T12:26:48.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.413+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=8ZCR9KLWBZLD tag=OJG2LEHE1QAI type=write size=3617415 2024-03-04T12:26:48.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.413+0000 7fa4b3c3e780 1 < canceled part key=_multipart_ESHAMQWMMBJR.2~PC96D1VTU8MR.0 size=282923 2024-03-04T12:26:48.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.415+0000 7fa4b3c3e780 1 < canceled multipart upload key=ESHAMQWMMBJR upload=PC96D1VTU8MR tag=T4A9KFM7X81Z type=write size=1331499 2024-03-04T12:26:48.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.417+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~W3VBAXTGD7QQ.0 size=620538 2024-03-04T12:26:48.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.417+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=W3VBAXTGD7QQ tag=7GMS9V3HA771 type=write size=1669114 2024-03-04T12:26:48.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.420+0000 7fa4b3c3e780 1 < suggested remove operation key=T301TK0FIOG4 tag=L0FM04IB69UN type=del 2024-03-04T12:26:48.429 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.422+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~RRQKMRXNSWRC.0 size=1048576 2024-03-04T12:26:48.430 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.423+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~RRQKMRXNSWRC.1 size=265288 2024-03-04T12:26:48.430 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.423+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=RRQKMRXNSWRC tag=O52K7LY1JM5J type=write size=2362440 2024-03-04T12:26:48.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.424+0000 7fa4b3c3e780 1 < canceled operation key=UZRX3W3DE5VX tag=YCQ4DV51ZSPP type=del size=3782951 2024-03-04T12:26:48.432 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.425+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=C4H6I10I9M8O type=del size=1783642 2024-03-04T12:26:48.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.427+0000 7fa4b3c3e780 1 < suggested remove operation key=V7N7MZ1GUNEV tag=AHG741QGVXYH type=del 2024-03-04T12:26:48.436 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.429+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~CX7GQ1GW8W2H.0 size=418482 2024-03-04T12:26:48.436 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.429+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=CX7GQ1GW8W2H tag=W8EJSROFGHPS type=write size=1467058 2024-03-04T12:26:48.438 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.432+0000 7fa4b3c3e780 1 < suggested update operation key=X0RVLNRWUAEM tag=BARW0EKML8Q2 type=del size=2299116 2024-03-04T12:26:48.440 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.433+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=WRYG27ATK9DQ type=write size=361594 2024-03-04T12:26:48.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.435+0000 7fa4b3c3e780 1 < suggested update operation key=43HMF7NWNMU3 tag=RIIU0DFBU3J2 type=write size=608731 2024-03-04T12:26:48.443 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.436+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=GR0R93QJ92HJ type=write size=392536 2024-03-04T12:26:48.444 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.437+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=RAF1TLHQKFYH type=del 2024-03-04T12:26:48.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.441+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~Z80HG4R8WYWS.0 size=814373 2024-03-04T12:26:48.448 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.441+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=Z80HG4R8WYWS tag=JV55RMQQYXD0 type=write size=1862949 2024-03-04T12:26:48.449 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.442+0000 7fa4b3c3e780 -1 < failed to complete operation key=V7N7MZ1GUNEV tag=N2VVGK00B5G8 type=del size=746838: (22) Invalid argument 2024-03-04T12:26:48.450 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.443+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=QFIOE7Q1C2ZI type=del size=3668782 2024-03-04T12:26:48.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.444+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~0SZB1J9ETRS8.0 size=1048576 2024-03-04T12:26:48.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.445+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~0SZB1J9ETRS8.1 size=378608 2024-03-04T12:26:48.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.447+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=0SZB1J9ETRS8 tag=D256G0KKQMM6 type=write size=2475760 2024-03-04T12:26:48.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.449+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~IEOBUG09V4L0.0 size=1048576 2024-03-04T12:26:48.457 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.450+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~IEOBUG09V4L0.1 size=837005 2024-03-04T12:26:48.457 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.450+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=IEOBUG09V4L0 tag=04EOOLQCWKBK type=write size=2934157 2024-03-04T12:26:48.458 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.452+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=HFV2T8X9QS5R type=del 2024-03-04T12:26:48.460 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.453+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=EPOG1VGM6DR5 type=del size=939744 2024-03-04T12:26:48.462 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.455+0000 7fa4b3c3e780 1 < suggested remove operation key=G4SUQFVB936T tag=5ASBKFSYUAAT type=del 2024-03-04T12:26:48.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.457+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~ZMTOCOR8C6RN.0 size=47095 2024-03-04T12:26:48.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.457+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=ZMTOCOR8C6RN tag=X06MS3ZM89B6 type=write size=1095671 2024-03-04T12:26:48.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.458+0000 7fa4b3c3e780 1 < completed delete operation key=G8G76PMSKJ0I tag=VREUNPGA3N9R type=del 2024-03-04T12:26:48.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.459+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=2NEMT353TJSV type=del size=2465318 2024-03-04T12:26:48.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.460+0000 7fa4b3c3e780 1 < completed delete operation key=UZRX3W3DE5VX tag=IRT6058S0GH8 type=del 2024-03-04T12:26:48.468 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.461+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=Q1H0SWRK09EF type=del size=746236 2024-03-04T12:26:48.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.463+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~HT4VGLCC9NTD.0 size=1048576 2024-03-04T12:26:48.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.463+0000 7fa4b3c3e780 1 < canceled part key=_multipart_ESHAMQWMMBJR.2~HT4VGLCC9NTD.1 size=449298 2024-03-04T12:26:48.471 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.464+0000 7fa4b3c3e780 1 < canceled multipart upload key=ESHAMQWMMBJR upload=HT4VGLCC9NTD tag=VI70MOLKRVD2 type=write size=2546450 2024-03-04T12:26:48.472 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.466+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=S123D4V709DX type=del size=3838130 2024-03-04T12:26:48.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.467+0000 7fa4b3c3e780 1 < completed delete operation key=GMIPCGYZRJ5L tag=WDXCHBV9BBTR type=del 2024-03-04T12:26:48.476 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.469+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~GJ9NG6U4WHL1.0 size=693143 2024-03-04T12:26:48.476 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.469+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=GJ9NG6U4WHL1 tag=MM6D08BDQWBT type=write size=1741719 2024-03-04T12:26:48.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.470+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~8ZCR9KLWBZLD.0 size=1048576 2024-03-04T12:26:48.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.471+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~8ZCR9KLWBZLD.1 size=1048576 2024-03-04T12:26:48.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.472+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~8ZCR9KLWBZLD.2 size=471687 2024-03-04T12:26:48.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.474+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=8ZCR9KLWBZLD tag=OJG2LEHE1QAI type=write size=3617415 2024-03-04T12:26:48.483 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.476+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~TK42BOPO3UG8.0 size=718139 2024-03-04T12:26:48.483 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.476+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=TK42BOPO3UG8 tag=LGLC7TS47H88 type=write size=1766715 2024-03-04T12:26:48.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.477+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~W3VBAXTGD7QQ.0 size=620538 2024-03-04T12:26:48.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.479+0000 7fa4b3c3e780 1 < completed multipart upload key=BVMWQ9ZL4K0C upload=W3VBAXTGD7QQ tag=7GMS9V3HA771 type=write size=1669114 2024-03-04T12:26:48.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.481+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~WLM0XL6ST937.0 size=316681 2024-03-04T12:26:48.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.481+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=WLM0XL6ST937 tag=YZH2PT49Y45O type=write size=1365257 2024-03-04T12:26:48.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.482+0000 7fa4b3c3e780 1 < canceled part key=_multipart_UZRX3W3DE5VX.2~RRQKMRXNSWRC.0 size=1048576 2024-03-04T12:26:48.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.483+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~RRQKMRXNSWRC.1 size=265288 2024-03-04T12:26:48.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.484+0000 7fa4b3c3e780 1 < canceled multipart upload key=UZRX3W3DE5VX upload=RRQKMRXNSWRC tag=O52K7LY1JM5J type=write size=2362440 2024-03-04T12:26:48.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.485+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=VVN3I7A2XHR7 type=write size=867216 2024-03-04T12:26:48.495 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.488+0000 7fa4b3c3e780 1 < suggested remove operation key=KKQT9J9GSW0N tag=C4H6I10I9M8O type=del 2024-03-04T12:26:48.496 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.489+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=SCNN1XRQ8Z3K type=del size=2922514 2024-03-04T12:26:48.497 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.490+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~CX7GQ1GW8W2H.0 size=418482 2024-03-04T12:26:48.498 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.492+0000 7fa4b3c3e780 1 < completed multipart upload key=BVMWQ9ZL4K0C upload=CX7GQ1GW8W2H tag=W8EJSROFGHPS type=write size=1467058 2024-03-04T12:26:48.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.493+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=S3HK789X38AX type=del size=1737578 2024-03-04T12:26:48.501 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.494+0000 7fa4b3c3e780 1 < canceled operation key=3TDMQXKLPX34 tag=WRYG27ATK9DQ type=write size=361594 2024-03-04T12:26:48.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.495+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=NA5CUWU819TO type=del size=158592 2024-03-04T12:26:48.504 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.497+0000 7fa4b3c3e780 1 < suggested remove operation key=7IUV88NQLPN8 tag=GR0R93QJ92HJ type=write 2024-03-04T12:26:48.506 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.499+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~EN96EDISTO50.0 size=1048576 2024-03-04T12:26:48.507 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.500+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~EN96EDISTO50.1 size=1048576 2024-03-04T12:26:48.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.501+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~EN96EDISTO50.2 size=169981 2024-03-04T12:26:48.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.501+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=EN96EDISTO50 tag=9HPRQVGSQ8G0 type=write size=3315709 2024-03-04T12:26:48.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.502+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~Z80HG4R8WYWS.0 size=814373 2024-03-04T12:26:48.511 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.504+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=Z80HG4R8WYWS tag=JV55RMQQYXD0 type=write size=1862949 2024-03-04T12:26:48.512 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.505+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=ES23HQ9M7YFG type=del size=3709917 2024-03-04T12:26:48.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.506+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=QFIOE7Q1C2ZI type=del 2024-03-04T12:26:48.515 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.508+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~Q320OD2ME2MN.0 size=1048576 2024-03-04T12:26:48.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.509+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~Q320OD2ME2MN.1 size=783839 2024-03-04T12:26:48.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.509+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=Q320OD2ME2MN tag=M090GVOT59CO type=write size=2880991 2024-03-04T12:26:48.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.511+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~IEOBUG09V4L0.0 size=1048576 2024-03-04T12:26:48.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.512+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~IEOBUG09V4L0.1 size=837005 2024-03-04T12:26:48.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.514+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=IEOBUG09V4L0 tag=04EOOLQCWKBK type=write size=2934157 2024-03-04T12:26:48.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.516+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~1CFMFFOA2752.0 size=1048576 2024-03-04T12:26:48.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.516+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~1CFMFFOA2752.1 size=1048576 2024-03-04T12:26:48.524 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.517+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~1CFMFFOA2752.2 size=882344 2024-03-04T12:26:48.524 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.517+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=1CFMFFOA2752 tag=FI9KCA3QQQC8 type=write size=4028072 2024-03-04T12:26:48.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.518+0000 7fa4b3c3e780 -1 < failed to complete operation key=KKQT9J9GSW0N tag=EPOG1VGM6DR5 type=del size=939744: (22) Invalid argument 2024-03-04T12:26:48.527 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.520+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~KVNJ5333XPP7.0 size=1048576 2024-03-04T12:26:48.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.521+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~KVNJ5333XPP7.1 size=316837 2024-03-04T12:26:48.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.521+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=KVNJ5333XPP7 tag=P4IETVTH7MID type=write size=2413989 2024-03-04T12:26:48.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.523+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~ZMTOCOR8C6RN.0 size=47095 2024-03-04T12:26:48.531 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.524+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=ZMTOCOR8C6RN tag=X06MS3ZM89B6 type=write size=1095671 2024-03-04T12:26:48.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.527+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~R6Y5VOGSBW3H.0 size=1048576 2024-03-04T12:26:48.534 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.527+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~R6Y5VOGSBW3H.1 size=972749 2024-03-04T12:26:48.534 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.527+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=R6Y5VOGSBW3H tag=JPF849JA4B3D type=write size=3069901 2024-03-04T12:26:48.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.529+0000 7fa4b3c3e780 -1 < failed to complete operation key=7IUV88NQLPN8 tag=2NEMT353TJSV type=del size=2465318: (22) Invalid argument 2024-03-04T12:26:48.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.530+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=9XOIGDV6H9H0 type=del size=63769 2024-03-04T12:26:48.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.531+0000 7fa4b3c3e780 -1 < failed to complete operation key=7IUV88NQLPN8 tag=Q1H0SWRK09EF type=del size=746236: (22) Invalid argument 2024-03-04T12:26:48.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.533+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~ZT1TW532W13D.0 size=1048576 2024-03-04T12:26:48.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.534+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~ZT1TW532W13D.1 size=757960 2024-03-04T12:26:48.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.534+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=ZT1TW532W13D tag=RYTEIQWLUMEA type=write size=2855112 2024-03-04T12:26:48.542 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.535+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=S123D4V709DX type=del 2024-03-04T12:26:48.543 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.536+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=T000UTOJR2KC type=del size=2702135 2024-03-04T12:26:48.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.537+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~GJ9NG6U4WHL1.0 size=693143 2024-03-04T12:26:48.546 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.539+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=GJ9NG6U4WHL1 tag=MM6D08BDQWBT type=write size=1741719 2024-03-04T12:26:48.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.540+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=08CX6P1AGEWN type=del size=2743596 2024-03-04T12:26:48.548 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.541+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~TK42BOPO3UG8.0 size=718139 2024-03-04T12:26:48.550 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.543+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=TK42BOPO3UG8 tag=LGLC7TS47H88 type=write size=1766715 2024-03-04T12:26:48.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.545+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=P52MQUNK47D5 type=del size=1125779 2024-03-04T12:26:48.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.547+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~WLM0XL6ST937.0 size=316681 2024-03-04T12:26:48.555 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.549+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=WLM0XL6ST937 tag=YZH2PT49Y45O type=write size=1365257 2024-03-04T12:26:48.558 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.551+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~V1I1NVF30XGE.0 size=7213 2024-03-04T12:26:48.558 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.551+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=V1I1NVF30XGE tag=N3E3LR4Y6X9F type=write size=1055789 2024-03-04T12:26:48.559 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.552+0000 7fa4b3c3e780 1 < completed write operation key=V7N7MZ1GUNEV tag=VVN3I7A2XHR7 type=write size=867216 2024-03-04T12:26:48.560 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.553+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=T5ALB8WOBYJD type=write size=180529 2024-03-04T12:26:48.561 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.554+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=SCNN1XRQ8Z3K type=del 2024-03-04T12:26:48.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.555+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=80VMRVEACOOZ type=write size=416515 2024-03-04T12:26:48.563 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.556+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=S3HK789X38AX type=del 2024-03-04T12:26:48.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.557+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=HLS4C1XJRSU2 type=del size=911815 2024-03-04T12:26:48.565 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.559+0000 7fa4b3c3e780 1 < completed delete operation key=R6Y09EO6HGF0 tag=NA5CUWU819TO type=del 2024-03-04T12:26:48.566 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.560+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=2U129U5VWWYM type=write size=602928 2024-03-04T12:26:48.568 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.561+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~EN96EDISTO50.0 size=1048576 2024-03-04T12:26:48.568 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.562+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~EN96EDISTO50.1 size=1048576 2024-03-04T12:26:48.569 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.563+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~EN96EDISTO50.2 size=169981 2024-03-04T12:26:48.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.565+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=EN96EDISTO50 tag=9HPRQVGSQ8G0 type=write size=3315709 2024-03-04T12:26:48.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.567+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~ORI7C15CQ4WN.0 size=1048576 2024-03-04T12:26:48.574 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.568+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~ORI7C15CQ4WN.1 size=1048576 2024-03-04T12:26:48.575 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.568+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~ORI7C15CQ4WN.2 size=1033117 2024-03-04T12:26:48.575 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.568+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=ORI7C15CQ4WN tag=I3ZPH23UD9XI type=write size=4178845 2024-03-04T12:26:48.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.570+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=ES23HQ9M7YFG type=del 2024-03-04T12:26:48.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.571+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=AX08LYKV38T4 type=del size=644622 2024-03-04T12:26:48.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.571+0000 7fa4b3c3e780 1 < canceled part key=_multipart_BVMWQ9ZL4K0C.2~Q320OD2ME2MN.0 size=1048576 2024-03-04T12:26:48.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.572+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~Q320OD2ME2MN.1 size=783839 2024-03-04T12:26:48.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.574+0000 7fa4b3c3e780 1 < canceled multipart upload key=BVMWQ9ZL4K0C upload=Q320OD2ME2MN tag=M090GVOT59CO type=write size=2880991 2024-03-04T12:26:48.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.575+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=N5OALQAVDBQA type=del size=3775458 2024-03-04T12:26:48.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.575+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YQLH0WW7I7MW.2~1CFMFFOA2752.0 size=1048576 2024-03-04T12:26:48.583 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.576+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~1CFMFFOA2752.1 size=1048576 2024-03-04T12:26:48.584 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.577+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~1CFMFFOA2752.2 size=882344 2024-03-04T12:26:48.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.579+0000 7fa4b3c3e780 1 < canceled multipart upload key=YQLH0WW7I7MW upload=1CFMFFOA2752 tag=FI9KCA3QQQC8 type=write size=4028072 2024-03-04T12:26:48.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.581+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~7X2F1R2GRPF9.0 size=1048576 2024-03-04T12:26:48.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.582+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~7X2F1R2GRPF9.1 size=193140 2024-03-04T12:26:48.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.582+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=7X2F1R2GRPF9 tag=OZZ6SYINO23J type=write size=2290292 2024-03-04T12:26:48.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.583+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~KVNJ5333XPP7.0 size=1048576 2024-03-04T12:26:48.591 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.584+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~KVNJ5333XPP7.1 size=316837 2024-03-04T12:26:48.593 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.586+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=KVNJ5333XPP7 tag=P4IETVTH7MID type=write size=2413989 2024-03-04T12:26:48.595 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.588+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~V4UIMKC6O0P9.0 size=1048576 2024-03-04T12:26:48.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.589+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~V4UIMKC6O0P9.1 size=740434 2024-03-04T12:26:48.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.589+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=V4UIMKC6O0P9 tag=QXFR2JAI6KNW type=write size=2837586 2024-03-04T12:26:48.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.590+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~R6Y5VOGSBW3H.0 size=1048576 2024-03-04T12:26:48.598 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.591+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~R6Y5VOGSBW3H.1 size=972749 2024-03-04T12:26:48.600 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.593+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=R6Y5VOGSBW3H tag=JPF849JA4B3D type=write size=3069901 2024-03-04T12:26:48.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.594+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=GTA2FVXP4Q0U type=del size=2296567 2024-03-04T12:26:48.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.595+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=9XOIGDV6H9H0 type=del 2024-03-04T12:26:48.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.597+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~ERGMNMOW36ES.0 size=1048576 2024-03-04T12:26:48.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.598+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~ERGMNMOW36ES.1 size=1048576 2024-03-04T12:26:48.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.599+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~ERGMNMOW36ES.2 size=24571 2024-03-04T12:26:48.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.599+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=ERGMNMOW36ES tag=LZ3W9OTTHIEG type=write size=3170299 2024-03-04T12:26:48.607 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.600+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~ZT1TW532W13D.0 size=1048576 2024-03-04T12:26:48.607 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.600+0000 7fa4b3c3e780 1 < canceled part key=_multipart_ZETES4AYZQHY.2~ZT1TW532W13D.1 size=757960 2024-03-04T12:26:48.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.602+0000 7fa4b3c3e780 1 < canceled multipart upload key=ZETES4AYZQHY upload=ZT1TW532W13D tag=RYTEIQWLUMEA type=write size=2855112 2024-03-04T12:26:48.610 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.603+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=E1VTPTOATXG2 type=write size=58053 2024-03-04T12:26:48.612 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.605+0000 7fa4b3c3e780 1 < suggested update operation key=R6Y09EO6HGF0 tag=T000UTOJR2KC type=del size=2702135 2024-03-04T12:26:48.613 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.607+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=Y1XXZSSVYBAZ type=del size=2988237 2024-03-04T12:26:48.615 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.608+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=08CX6P1AGEWN type=del 2024-03-04T12:26:48.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.609+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=T5669V8I0S4S type=del size=2407053 2024-03-04T12:26:48.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.610+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=P52MQUNK47D5 type=del 2024-03-04T12:26:48.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.611+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=DBZT3GCV97TH type=del size=1583675 2024-03-04T12:26:48.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.612+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~V1I1NVF30XGE.0 size=7213 2024-03-04T12:26:48.621 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.614+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=V1I1NVF30XGE tag=N3E3LR4Y6X9F type=write size=1055789 2024-03-04T12:26:48.622 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.615+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=333FK330IXXY type=write size=285834 2024-03-04T12:26:48.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.617+0000 7fa4b3c3e780 1 < suggested update operation key=T301TK0FIOG4 tag=T5ALB8WOBYJD type=write size=180529 2024-03-04T12:26:48.626 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.619+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~Q9W7Z06E2L9F.0 size=1048576 2024-03-04T12:26:48.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.620+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~Q9W7Z06E2L9F.1 size=1048576 2024-03-04T12:26:48.628 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.621+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~Q9W7Z06E2L9F.2 size=398280 2024-03-04T12:26:48.628 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.621+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=Q9W7Z06E2L9F tag=UP57ZJPUIS9V type=write size=3544008 2024-03-04T12:26:48.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.622+0000 7fa4b3c3e780 1 < completed write operation key=J53J0N99N30A tag=80VMRVEACOOZ type=write size=416515 2024-03-04T12:26:48.630 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.623+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=G0IZWM1FY6LH type=del size=3244251 2024-03-04T12:26:48.631 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.624+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=HLS4C1XJRSU2 type=del 2024-03-04T12:26:48.632 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.625+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=H67L05PSSB9V type=del size=601236 2024-03-04T12:26:48.633 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.627+0000 7fa4b3c3e780 1 < completed write operation key=UZRX3W3DE5VX tag=2U129U5VWWYM type=write size=602928 2024-03-04T12:26:48.635 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.629+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~C4XIILLZC9YE.0 size=47467 2024-03-04T12:26:48.635 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.629+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=C4XIILLZC9YE tag=UMYZ207F7J1Y type=write size=1096043 2024-03-04T12:26:48.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.630+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~ORI7C15CQ4WN.0 size=1048576 2024-03-04T12:26:48.637 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.631+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~ORI7C15CQ4WN.1 size=1048576 2024-03-04T12:26:48.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.631+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~ORI7C15CQ4WN.2 size=1033117 2024-03-04T12:26:48.640 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.633+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=ORI7C15CQ4WN tag=I3ZPH23UD9XI type=write size=4178845 2024-03-04T12:26:48.642 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.635+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~Q6R8CWD1A7BO.0 size=1048576 2024-03-04T12:26:48.643 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.636+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~Q6R8CWD1A7BO.1 size=657201 2024-03-04T12:26:48.643 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.636+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=Q6R8CWD1A7BO tag=DPWAKTGT2PEP type=write size=2754353 2024-03-04T12:26:48.644 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.637+0000 7fa4b3c3e780 1 < completed delete operation key=G8G76PMSKJ0I tag=AX08LYKV38T4 type=del 2024-03-04T12:26:48.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.638+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=XZGLYJ7FD7LT type=del size=3368879 2024-03-04T12:26:48.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.639+0000 7fa4b3c3e780 1 < canceled operation key=YQLH0WW7I7MW tag=N5OALQAVDBQA type=del size=3775458 2024-03-04T12:26:48.647 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.641+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=EV4XBLEOQDJK type=del size=1629650 2024-03-04T12:26:48.649 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.642+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~7X2F1R2GRPF9.0 size=1048576 2024-03-04T12:26:48.649 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.643+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~7X2F1R2GRPF9.1 size=193140 2024-03-04T12:26:48.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.645+0000 7fa4b3c3e780 1 < completed multipart upload key=ESHAMQWMMBJR upload=7X2F1R2GRPF9 tag=OZZ6SYINO23J type=write size=2290292 2024-03-04T12:26:48.653 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.647+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~EEU0Y2PEXLIJ.0 size=563762 2024-03-04T12:26:48.653 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.647+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=EEU0Y2PEXLIJ tag=U8CS1ECZ8I5M type=write size=1612338 2024-03-04T12:26:48.654 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.648+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~V4UIMKC6O0P9.0 size=1048576 2024-03-04T12:26:48.656 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.650+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~V4UIMKC6O0P9.1 size=740434 2024-03-04T12:26:48.658 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.651+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=V4UIMKC6O0P9 tag=QXFR2JAI6KNW type=write size=2837586 2024-03-04T12:26:48.659 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.652+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=IDB30HR41ZDC type=del size=2074436 2024-03-04T12:26:48.661 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.655+0000 7fa4b3c3e780 1 < suggested remove operation key=J53J0N99N30A tag=GTA2FVXP4Q0U type=del 2024-03-04T12:26:48.662 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.656+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=5KPWW1D6B8KO type=write size=18963 2024-03-04T12:26:48.664 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.657+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~ERGMNMOW36ES.0 size=1048576 2024-03-04T12:26:48.664 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.658+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~ERGMNMOW36ES.1 size=1048576 2024-03-04T12:26:48.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.659+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~ERGMNMOW36ES.2 size=24571 2024-03-04T12:26:48.667 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.661+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=ERGMNMOW36ES tag=LZ3W9OTTHIEG type=write size=3170299 2024-03-04T12:26:48.669 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.663+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~764XSKQZMX5H.0 size=1048576 2024-03-04T12:26:48.670 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.663+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~764XSKQZMX5H.1 size=528509 2024-03-04T12:26:48.670 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.663+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=764XSKQZMX5H tag=FCE6SFMMDK7L type=write size=2625661 2024-03-04T12:26:48.671 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.664+0000 7fa4b3c3e780 -1 < failed to complete operation key=R6Y09EO6HGF0 tag=E1VTPTOATXG2 type=write size=58053: (22) Invalid argument 2024-03-04T12:26:48.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.667+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~3JECW1U1UNB8.0 size=1048576 2024-03-04T12:26:48.675 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.668+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~3JECW1U1UNB8.1 size=367721 2024-03-04T12:26:48.675 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.668+0000 7fa4b3c3e780 1 > prepared multipart upload key=4LKTYP07OL5L upload=3JECW1U1UNB8 tag=2UQHXBEU387E type=write size=2464873 2024-03-04T12:26:48.676 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.669+0000 7fa4b3c3e780 1 < completed delete operation key=X0RVLNRWUAEM tag=Y1XXZSSVYBAZ type=del 2024-03-04T12:26:48.678 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.671+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~GDKHGILHM0LQ.0 size=1048576 2024-03-04T12:26:48.679 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.672+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~GDKHGILHM0LQ.1 size=1048576 2024-03-04T12:26:48.680 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.673+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~GDKHGILHM0LQ.2 size=304710 2024-03-04T12:26:48.680 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.673+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=GDKHGILHM0LQ tag=QY0X8457DO11 type=write size=3450438 2024-03-04T12:26:48.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.675+0000 7fa4b3c3e780 1 < suggested remove operation key=DHLTVH2AZBLR tag=T5669V8I0S4S type=del 2024-03-04T12:26:48.683 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.677+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=M79FRS89UITL type=del size=2291481 2024-03-04T12:26:48.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.679+0000 7fa4b3c3e780 1 < suggested remove operation key=WRHB3XWDLSY2 tag=DBZT3GCV97TH type=del 2024-03-04T12:26:48.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.680+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=5M45SHXEIU48 type=del size=3066905 2024-03-04T12:26:48.688 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.682+0000 7fa4b3c3e780 1 < completed write operation key=G70BJ2UARNCP tag=333FK330IXXY type=write size=285834 2024-03-04T12:26:48.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.683+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=DDACCVR35OSE type=del size=3292447 2024-03-04T12:26:48.691 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.684+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~Q9W7Z06E2L9F.0 size=1048576 2024-03-04T12:26:48.692 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.685+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~Q9W7Z06E2L9F.1 size=1048576 2024-03-04T12:26:48.692 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.686+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~Q9W7Z06E2L9F.2 size=398280 2024-03-04T12:26:48.694 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.688+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=Q9W7Z06E2L9F tag=UP57ZJPUIS9V type=write size=3544008 2024-03-04T12:26:48.696 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.690+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~WWRMSKIHA19Z.0 size=1048576 2024-03-04T12:26:48.697 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.691+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~WWRMSKIHA19Z.1 size=1048576 2024-03-04T12:26:48.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.691+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~WWRMSKIHA19Z.2 size=815078 2024-03-04T12:26:48.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.691+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=WWRMSKIHA19Z tag=WXKOZI6EN4Q8 type=write size=3960806 2024-03-04T12:26:48.699 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.693+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=G0IZWM1FY6LH type=del 2024-03-04T12:26:48.701 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.695+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~V71PEHQTR70N.0 size=1048576 2024-03-04T12:26:48.702 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.696+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~V71PEHQTR70N.1 size=1048576 2024-03-04T12:26:48.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.696+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~V71PEHQTR70N.2 size=601231 2024-03-04T12:26:48.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.696+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=V71PEHQTR70N tag=MAEC3V0TWLGR type=write size=3746959 2024-03-04T12:26:48.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.699+0000 7fa4b3c3e780 1 < suggested update operation key=T301TK0FIOG4 tag=H67L05PSSB9V type=del size=601236 2024-03-04T12:26:48.706 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.700+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=QAXQBC3506RG type=del size=347416 2024-03-04T12:26:48.707 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.701+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~C4XIILLZC9YE.0 size=47467 2024-03-04T12:26:48.709 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.703+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=C4XIILLZC9YE tag=UMYZ207F7J1Y type=write size=1096043 2024-03-04T12:26:48.712 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.705+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~MF8FYQQCT3X2.0 size=152973 2024-03-04T12:26:48.712 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.705+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=MF8FYQQCT3X2 tag=2F5XMH6Y38HJ type=write size=1201549 2024-03-04T12:26:48.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.706+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~Q6R8CWD1A7BO.0 size=1048576 2024-03-04T12:26:48.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.706+0000 7fa4b3c3e780 1 < canceled part key=_multipart_43HMF7NWNMU3.2~Q6R8CWD1A7BO.1 size=657201 2024-03-04T12:26:48.715 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.708+0000 7fa4b3c3e780 1 < canceled multipart upload key=43HMF7NWNMU3 upload=Q6R8CWD1A7BO tag=DPWAKTGT2PEP type=write size=2754353 2024-03-04T12:26:48.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.710+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~7RTH4D03SVEJ.0 size=1048576 2024-03-04T12:26:48.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.711+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~7RTH4D03SVEJ.1 size=358870 2024-03-04T12:26:48.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.711+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=7RTH4D03SVEJ tag=7R8WXZAGDAO6 type=write size=2456022 2024-03-04T12:26:48.719 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.712+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=XZGLYJ7FD7LT type=del 2024-03-04T12:26:48.721 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.714+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~OK8EVCGBTZYR.0 size=358046 2024-03-04T12:26:48.721 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.714+0000 7fa4b3c3e780 1 > prepared multipart upload key=G4SUQFVB936T upload=OK8EVCGBTZYR tag=WB32UEI0LF51 type=write size=1406622 2024-03-04T12:26:48.722 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.716+0000 7fa4b3c3e780 1 < completed delete operation key=R1DOKJPZRT5Q tag=EV4XBLEOQDJK type=del 2024-03-04T12:26:48.725 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.718+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~CEC43RFIBWS7.0 size=984967 2024-03-04T12:26:48.725 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.718+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=CEC43RFIBWS7 tag=9PYZF41P8NG9 type=write size=2033543 2024-03-04T12:26:48.726 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.719+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~EEU0Y2PEXLIJ.0 size=563762 2024-03-04T12:26:48.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.721+0000 7fa4b3c3e780 1 < completed multipart upload key=4989OME3IAJF upload=EEU0Y2PEXLIJ tag=U8CS1ECZ8I5M type=write size=1612338 2024-03-04T12:26:48.729 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.722+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=ZDQIDM4Y1OM7 type=del size=523135 2024-03-04T12:26:48.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.725+0000 7fa4b3c3e780 1 < suggested update operation key=T301TK0FIOG4 tag=IDB30HR41ZDC type=del size=2074436 2024-03-04T12:26:48.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.726+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=Q04C25WX9LWE type=del size=257630 2024-03-04T12:26:48.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.727+0000 7fa4b3c3e780 1 < completed write operation key=YWJV4QMY6ZBI tag=5KPWW1D6B8KO type=write size=18963 2024-03-04T12:26:48.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.728+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=RQ01J9GP6Y3A type=del size=497080 2024-03-04T12:26:48.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.729+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~764XSKQZMX5H.0 size=1048576 2024-03-04T12:26:48.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.730+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~764XSKQZMX5H.1 size=528509 2024-03-04T12:26:48.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.732+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=764XSKQZMX5H tag=FCE6SFMMDK7L type=write size=2625661 2024-03-04T12:26:48.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.734+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=YAYJRZ6QYENG type=write size=1029967 2024-03-04T12:26:48.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.735+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~3JECW1U1UNB8.0 size=1048576 2024-03-04T12:26:48.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.736+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~3JECW1U1UNB8.1 size=367721 2024-03-04T12:26:48.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.738+0000 7fa4b3c3e780 1 < completed multipart upload key=4LKTYP07OL5L upload=3JECW1U1UNB8 tag=2UQHXBEU387E type=write size=2464873 2024-03-04T12:26:48.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.740+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~IF5X5XH3SC0B.0 size=608225 2024-03-04T12:26:48.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.740+0000 7fa4b3c3e780 1 > prepared multipart upload key=G8G76PMSKJ0I upload=IF5X5XH3SC0B tag=U37X2OWFS7KX type=write size=1656801 2024-03-04T12:26:48.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.740+0000 7fa4b3c3e780 1 < canceled part key=_multipart_VAIY4J3CYONH.2~GDKHGILHM0LQ.0 size=1048576 2024-03-04T12:26:48.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.740+0000 7fa4b3c3e780 1 < canceled part key=_multipart_VAIY4J3CYONH.2~GDKHGILHM0LQ.1 size=1048576 2024-03-04T12:26:48.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.741+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~GDKHGILHM0LQ.2 size=304710 2024-03-04T12:26:48.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.743+0000 7fa4b3c3e780 1 < canceled multipart upload key=VAIY4J3CYONH upload=GDKHGILHM0LQ tag=QY0X8457DO11 type=write size=3450438 2024-03-04T12:26:48.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.745+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~FH0RK66WPRXK.0 size=1048576 2024-03-04T12:26:48.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.746+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~FH0RK66WPRXK.1 size=1048576 2024-03-04T12:26:48.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.747+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~FH0RK66WPRXK.2 size=982339 2024-03-04T12:26:48.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.747+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=FH0RK66WPRXK tag=848VTFBVUOA5 type=write size=4128067 2024-03-04T12:26:48.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.749+0000 7fa4b3c3e780 1 < suggested remove operation key=NVMIU38VM9Q1 tag=M79FRS89UITL type=del 2024-03-04T12:26:48.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.750+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=VPA8NZKHOX6D type=del size=210895 2024-03-04T12:26:48.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.751+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=5M45SHXEIU48 type=del 2024-03-04T12:26:48.759 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.752+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=6YJ7Y0FFS4IG type=del size=1990914 2024-03-04T12:26:48.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.755+0000 7fa4b3c3e780 1 < suggested remove operation key=4989OME3IAJF tag=DDACCVR35OSE type=del 2024-03-04T12:26:48.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.757+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=HJTP32GU7S00 type=del size=2304761 2024-03-04T12:26:48.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.758+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~WWRMSKIHA19Z.0 size=1048576 2024-03-04T12:26:48.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.759+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~WWRMSKIHA19Z.1 size=1048576 2024-03-04T12:26:48.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.760+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~WWRMSKIHA19Z.2 size=815078 2024-03-04T12:26:48.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.761+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=WWRMSKIHA19Z tag=WXKOZI6EN4Q8 type=write size=3960806 2024-03-04T12:26:48.770 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.763+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~5MOQ9JIBBYON.0 size=894466 2024-03-04T12:26:48.770 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.763+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=5MOQ9JIBBYON tag=QWL817MJ608A type=write size=1943042 2024-03-04T12:26:48.771 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.765+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~V71PEHQTR70N.0 size=1048576 2024-03-04T12:26:48.771 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.765+0000 7fa4b3c3e780 1 < canceled part key=_multipart_VAIY4J3CYONH.2~V71PEHQTR70N.1 size=1048576 2024-03-04T12:26:48.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.765+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~V71PEHQTR70N.2 size=601231 2024-03-04T12:26:48.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.767+0000 7fa4b3c3e780 1 < canceled multipart upload key=VAIY4J3CYONH upload=V71PEHQTR70N tag=MAEC3V0TWLGR type=write size=3746959 2024-03-04T12:26:48.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.768+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=YOOIKKP1O13B type=del size=321289 2024-03-04T12:26:48.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.769+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=QAXQBC3506RG type=del 2024-03-04T12:26:48.777 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.770+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=3MI58MIDZCBT type=del size=315822 2024-03-04T12:26:48.777 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.771+0000 7fa4b3c3e780 1 < canceled part key=_multipart_R6Y09EO6HGF0.2~MF8FYQQCT3X2.0 size=152973 2024-03-04T12:26:48.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.772+0000 7fa4b3c3e780 1 < canceled multipart upload key=R6Y09EO6HGF0 upload=MF8FYQQCT3X2 tag=2F5XMH6Y38HJ type=write size=1201549 2024-03-04T12:26:48.780 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.774+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=N5GB4P1EFXEP type=del size=2271315 2024-03-04T12:26:48.781 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.775+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~7RTH4D03SVEJ.0 size=1048576 2024-03-04T12:26:48.782 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.776+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~7RTH4D03SVEJ.1 size=358870 2024-03-04T12:26:48.784 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.777+0000 7fa4b3c3e780 1 < completed multipart upload key=3N6E09QF3866 upload=7RTH4D03SVEJ tag=7R8WXZAGDAO6 type=write size=2456022 2024-03-04T12:26:48.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.779+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~W13D0IG46XOX.0 size=867525 2024-03-04T12:26:48.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.779+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=W13D0IG46XOX tag=QHSBQDRCQYZC type=write size=1916101 2024-03-04T12:26:48.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.780+0000 7fa4b3c3e780 1 < canceled part key=_multipart_G4SUQFVB936T.2~OK8EVCGBTZYR.0 size=358046 2024-03-04T12:26:48.788 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.781+0000 7fa4b3c3e780 1 < canceled multipart upload key=G4SUQFVB936T upload=OK8EVCGBTZYR tag=WB32UEI0LF51 type=write size=1406622 2024-03-04T12:26:48.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.783+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~HHFCRUYNEKBG.0 size=558230 2024-03-04T12:26:48.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.783+0000 7fa4b3c3e780 1 > prepared multipart upload key=NVMIU38VM9Q1 upload=HHFCRUYNEKBG tag=PJK28NYDGV8U type=write size=1606806 2024-03-04T12:26:48.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.784+0000 7fa4b3c3e780 1 < canceled part key=_multipart_BVMWQ9ZL4K0C.2~CEC43RFIBWS7.0 size=984967 2024-03-04T12:26:48.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.785+0000 7fa4b3c3e780 1 < canceled multipart upload key=BVMWQ9ZL4K0C upload=CEC43RFIBWS7 tag=9PYZF41P8NG9 type=write size=2033543 2024-03-04T12:26:48.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.786+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=P0DI77ICQ6WN type=del size=1467962 2024-03-04T12:26:48.794 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.788+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=ZDQIDM4Y1OM7 type=del 2024-03-04T12:26:48.795 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.789+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=1W2BBLV9AFT3 type=del size=4151549 2024-03-04T12:26:48.797 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.791+0000 7fa4b3c3e780 1 < suggested update operation key=T301TK0FIOG4 tag=Q04C25WX9LWE type=del size=257630 2024-03-04T12:26:48.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.792+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=ES3HC2KXXZ0D type=del size=2625419 2024-03-04T12:26:48.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.793+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=RQ01J9GP6Y3A type=del 2024-03-04T12:26:48.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.794+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=LAG9F8CN3KEQ type=del size=863178 2024-03-04T12:26:48.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.795+0000 7fa4b3c3e780 1 < canceled operation key=G4SUQFVB936T tag=YAYJRZ6QYENG type=write size=1029967 2024-03-04T12:26:48.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.796+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=8VVZ2L1403ZF type=del size=1607428 2024-03-04T12:26:48.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.797+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~IF5X5XH3SC0B.0 size=608225 2024-03-04T12:26:48.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.799+0000 7fa4b3c3e780 1 < completed multipart upload key=G8G76PMSKJ0I upload=IF5X5XH3SC0B tag=U37X2OWFS7KX type=write size=1656801 2024-03-04T12:26:48.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.800+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=ZXRIWRLC01FK type=del size=1170532 2024-03-04T12:26:48.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.801+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~FH0RK66WPRXK.0 size=1048576 2024-03-04T12:26:48.809 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.802+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~FH0RK66WPRXK.1 size=1048576 2024-03-04T12:26:48.810 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.803+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~FH0RK66WPRXK.2 size=982339 2024-03-04T12:26:48.812 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.805+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=FH0RK66WPRXK tag=848VTFBVUOA5 type=write size=4128067 2024-03-04T12:26:48.813 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.806+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=IMLZVBTK5CJP type=del size=3274451 2024-03-04T12:26:48.814 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.808+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=VPA8NZKHOX6D type=del 2024-03-04T12:26:48.816 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.809+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~Q6GDU3IJC2XR.0 size=1048576 2024-03-04T12:26:48.817 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.810+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~Q6GDU3IJC2XR.1 size=1048576 2024-03-04T12:26:48.818 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.811+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~Q6GDU3IJC2XR.2 size=976006 2024-03-04T12:26:48.818 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.811+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=Q6GDU3IJC2XR tag=7ZNVMN783KN9 type=write size=4121734 2024-03-04T12:26:48.819 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.812+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=6YJ7Y0FFS4IG type=del 2024-03-04T12:26:48.820 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.813+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=N2F6W9XD9SFO type=del size=3057529 2024-03-04T12:26:48.821 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.814+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=HJTP32GU7S00 type=del 2024-03-04T12:26:48.823 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.816+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~7M9R2U648CZC.0 size=1048576 2024-03-04T12:26:48.824 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.817+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~7M9R2U648CZC.1 size=783006 2024-03-04T12:26:48.824 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.817+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=7M9R2U648CZC tag=59QWCJVE4IRZ type=write size=2880158 2024-03-04T12:26:48.825 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.818+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~5MOQ9JIBBYON.0 size=894466 2024-03-04T12:26:48.827 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.820+0000 7fa4b3c3e780 1 < completed multipart upload key=R1DOKJPZRT5Q upload=5MOQ9JIBBYON tag=QWL817MJ608A type=write size=1943042 2024-03-04T12:26:48.828 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.821+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=QA99U6H3RS0K type=del size=2033119 2024-03-04T12:26:48.829 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.822+0000 7fa4b3c3e780 1 < canceled operation key=VAIY4J3CYONH tag=YOOIKKP1O13B type=del size=321289 2024-03-04T12:26:48.831 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.824+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~DOS340WQDEZ7.0 size=1048576 2024-03-04T12:26:48.832 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.825+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~DOS340WQDEZ7.1 size=224572 2024-03-04T12:26:48.832 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.825+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=DOS340WQDEZ7 tag=E69LYB43VUIV type=write size=2321724 2024-03-04T12:26:48.834 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.827+0000 7fa4b3c3e780 1 < suggested remove operation key=J53J0N99N30A tag=3MI58MIDZCBT type=del 2024-03-04T12:26:48.836 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.829+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~QGJ86YV7ZZQR.0 size=204462 2024-03-04T12:26:48.836 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.829+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=QGJ86YV7ZZQR tag=P6B2Y28TD2Q1 type=write size=1253038 2024-03-04T12:26:48.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.831+0000 7fa4b3c3e780 1 < suggested remove operation key=3TDMQXKLPX34 tag=N5GB4P1EFXEP type=del 2024-03-04T12:26:48.839 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.832+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=W18JKUPOG2JH type=del size=2071016 2024-03-04T12:26:48.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.833+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~W13D0IG46XOX.0 size=867525 2024-03-04T12:26:48.842 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.835+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=W13D0IG46XOX tag=QHSBQDRCQYZC type=write size=1916101 2024-03-04T12:26:48.843 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.836+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=AHA4PGHAHU5C type=del size=552216 2024-03-04T12:26:48.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.837+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~HHFCRUYNEKBG.0 size=558230 2024-03-04T12:26:48.846 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.839+0000 7fa4b3c3e780 1 < completed multipart upload key=NVMIU38VM9Q1 upload=HHFCRUYNEKBG tag=PJK28NYDGV8U type=write size=1606806 2024-03-04T12:26:48.847 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.840+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=O2KUZW0W8H62 type=del size=852099 2024-03-04T12:26:48.848 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.841+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=P0DI77ICQ6WN type=del 2024-03-04T12:26:48.850 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.844+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~GF1HW6ZRI2PG.0 size=1048576 2024-03-04T12:26:48.851 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.845+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~GF1HW6ZRI2PG.1 size=1048576 2024-03-04T12:26:48.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.846+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~GF1HW6ZRI2PG.2 size=930707 2024-03-04T12:26:48.853 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.846+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=GF1HW6ZRI2PG tag=R3NHQUUA3FL2 type=write size=4076435 2024-03-04T12:26:48.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.847+0000 7fa4b3c3e780 1 < completed delete operation key=R6Y09EO6HGF0 tag=1W2BBLV9AFT3 type=del 2024-03-04T12:26:48.855 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.848+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=W5D0SGV0XOC9 type=write size=1016277 2024-03-04T12:26:48.856 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.849+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=ES3HC2KXXZ0D type=del 2024-03-04T12:26:48.857 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.850+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=L80K4O1GU6AL type=del size=1916276 2024-03-04T12:26:48.858 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.852+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=LAG9F8CN3KEQ type=del 2024-03-04T12:26:48.861 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.854+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~TAZLWWUQNHEW.0 size=1048576 2024-03-04T12:26:48.862 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.855+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~TAZLWWUQNHEW.1 size=73012 2024-03-04T12:26:48.862 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.855+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=TAZLWWUQNHEW tag=D5A12PXF3L2H type=write size=2170164 2024-03-04T12:26:48.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.856+0000 7fa4b3c3e780 1 < canceled operation key=YWJV4QMY6ZBI tag=8VVZ2L1403ZF type=del size=1607428 2024-03-04T12:26:48.864 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.857+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=304KC05IPACG type=del size=4123507 2024-03-04T12:26:48.865 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.859+0000 7fa4b3c3e780 -1 < failed to complete operation key=3TDMQXKLPX34 tag=ZXRIWRLC01FK type=del size=1170532: (22) Invalid argument 2024-03-04T12:26:48.868 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.861+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=9E9U41GEDNSD type=del size=2410562 2024-03-04T12:26:48.870 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.862+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=IMLZVBTK5CJP type=del 2024-03-04T12:26:48.870 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.864+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=JH4ESBBRS1IG type=del size=1061231 2024-03-04T12:26:48.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.865+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~Q6GDU3IJC2XR.0 size=1048576 2024-03-04T12:26:48.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.866+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~Q6GDU3IJC2XR.1 size=1048576 2024-03-04T12:26:48.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.866+0000 7fa4b3c3e780 1 < canceled part key=_multipart_3N6E09QF3866.2~Q6GDU3IJC2XR.2 size=976006 2024-03-04T12:26:48.875 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.868+0000 7fa4b3c3e780 1 < canceled multipart upload key=3N6E09QF3866 upload=Q6GDU3IJC2XR tag=7ZNVMN783KN9 type=write size=4121734 2024-03-04T12:26:48.877 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.870+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~7ZK4XR547OW6.0 size=419298 2024-03-04T12:26:48.877 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.870+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=7ZK4XR547OW6 tag=MA4XIWB67TRK type=write size=1467874 2024-03-04T12:26:48.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.871+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=N2F6W9XD9SFO type=del 2024-03-04T12:26:48.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.872+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=9OHK51VNMU14 type=del size=2634534 2024-03-04T12:26:48.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.874+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~7M9R2U648CZC.0 size=1048576 2024-03-04T12:26:48.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.875+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~7M9R2U648CZC.1 size=783006 2024-03-04T12:26:48.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.877+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=7M9R2U648CZC tag=59QWCJVE4IRZ type=write size=2880158 2024-03-04T12:26:48.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.878+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=N821FVY6P8RL type=write size=958824 2024-03-04T12:26:48.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.879+0000 7fa4b3c3e780 1 < completed delete operation key=GMIPCGYZRJ5L tag=QA99U6H3RS0K type=del 2024-03-04T12:26:48.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.881+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~FNQHQ1FXJJP3.0 size=1048576 2024-03-04T12:26:48.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.882+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~FNQHQ1FXJJP3.1 size=1048576 2024-03-04T12:26:48.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.883+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~FNQHQ1FXJJP3.2 size=1034446 2024-03-04T12:26:48.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.883+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=FNQHQ1FXJJP3 tag=VC8VEKM5Z300 type=write size=4180174 2024-03-04T12:26:48.891 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.884+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~DOS340WQDEZ7.0 size=1048576 2024-03-04T12:26:48.892 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.885+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~DOS340WQDEZ7.1 size=224572 2024-03-04T12:26:48.893 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.887+0000 7fa4b3c3e780 1 < completed multipart upload key=BVMWQ9ZL4K0C upload=DOS340WQDEZ7 tag=E69LYB43VUIV type=write size=2321724 2024-03-04T12:26:48.895 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.888+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=CX1WZ8X92Z6P type=write size=43767 2024-03-04T12:26:48.895 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.888+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YWJV4QMY6ZBI.2~QGJ86YV7ZZQR.0 size=204462 2024-03-04T12:26:48.897 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.890+0000 7fa4b3c3e780 1 < canceled multipart upload key=YWJV4QMY6ZBI upload=QGJ86YV7ZZQR tag=P6B2Y28TD2Q1 type=write size=1253038 2024-03-04T12:26:48.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.891+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=8T1YGV4AHKUT type=del size=4030364 2024-03-04T12:26:48.899 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.893+0000 7fa4b3c3e780 1 < completed delete operation key=UZRX3W3DE5VX tag=W18JKUPOG2JH type=del 2024-03-04T12:26:48.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.894+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=G3XXN95MBKHQ type=del size=759339 2024-03-04T12:26:48.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.895+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=AHA4PGHAHU5C type=del 2024-03-04T12:26:48.904 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.897+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~JIV1DFLTSN0G.0 size=1048576 2024-03-04T12:26:48.905 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.898+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~JIV1DFLTSN0G.1 size=336254 2024-03-04T12:26:48.905 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.898+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=JIV1DFLTSN0G tag=T7C52SV92ALQ type=write size=2433406 2024-03-04T12:26:48.906 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.900+0000 7fa4b3c3e780 1 < completed delete operation key=GMIPCGYZRJ5L tag=O2KUZW0W8H62 type=del 2024-03-04T12:26:48.907 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.901+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=06RYDBF3JFST type=del size=3423767 2024-03-04T12:26:48.909 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.902+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~GF1HW6ZRI2PG.0 size=1048576 2024-03-04T12:26:48.910 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.903+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~GF1HW6ZRI2PG.1 size=1048576 2024-03-04T12:26:48.910 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.904+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~GF1HW6ZRI2PG.2 size=930707 2024-03-04T12:26:48.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.906+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=GF1HW6ZRI2PG tag=R3NHQUUA3FL2 type=write size=4076435 2024-03-04T12:26:49.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.908+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~DROK490FX1U9.0 size=1048576 2024-03-04T12:26:49.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.908+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~DROK490FX1U9.1 size=565486 2024-03-04T12:26:49.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.908+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=DROK490FX1U9 tag=PNI04QOFAKBK type=write size=2662638 2024-03-04T12:26:49.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.909+0000 7fa4b3c3e780 1 < completed write operation key=YQLH0WW7I7MW tag=W5D0SGV0XOC9 type=write size=1016277 2024-03-04T12:26:49.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.910+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=Z6B9MWLPVZJN type=del size=3175096 2024-03-04T12:26:49.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.998+0000 7fa4b3c3e780 1 < canceled operation key=R6Y09EO6HGF0 tag=L80K4O1GU6AL type=del size=1916276 2024-03-04T12:26:49.006 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:48.999+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=QTP08B3J2BN9 type=write size=688260 2024-03-04T12:26:49.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.000+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~TAZLWWUQNHEW.0 size=1048576 2024-03-04T12:26:49.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.001+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~TAZLWWUQNHEW.1 size=73012 2024-03-04T12:26:49.010 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.003+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=TAZLWWUQNHEW tag=D5A12PXF3L2H type=write size=2170164 2024-03-04T12:26:49.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.004+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=RCM8FX3J26AT type=del size=2661984 2024-03-04T12:26:49.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.006+0000 7fa4b3c3e780 1 < canceled operation key=V7N7MZ1GUNEV tag=304KC05IPACG type=del size=4123507 2024-03-04T12:26:49.014 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.007+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=EQ3N5GZ61Q22 type=write size=1019723 2024-03-04T12:26:49.016 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.009+0000 7fa4b3c3e780 1 < suggested update operation key=H5FWRNK8F7QT tag=9E9U41GEDNSD type=del size=2410562 2024-03-04T12:26:49.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.011+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~TRLPJ2Z8R7UK.0 size=277279 2024-03-04T12:26:49.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.011+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=TRLPJ2Z8R7UK tag=1N2AXC5U9P0W type=write size=1325855 2024-03-04T12:26:49.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.012+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=JH4ESBBRS1IG type=del 2024-03-04T12:26:49.020 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.014+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=EZWNKV09CEMG type=del size=1700094 2024-03-04T12:26:49.022 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.015+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~7ZK4XR547OW6.0 size=419298 2024-03-04T12:26:49.024 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.017+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=7ZK4XR547OW6 tag=MA4XIWB67TRK type=write size=1467874 2024-03-04T12:26:49.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.019+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~QZLN93F0V52D.0 size=1048576 2024-03-04T12:26:49.026 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.019+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~QZLN93F0V52D.1 size=1048576 2024-03-04T12:26:49.027 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.020+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~QZLN93F0V52D.2 size=276938 2024-03-04T12:26:49.027 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.020+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=QZLN93F0V52D tag=UIB20TYAIVXM type=write size=3422666 2024-03-04T12:26:49.030 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.023+0000 7fa4b3c3e780 1 < suggested update operation key=43HMF7NWNMU3 tag=9OHK51VNMU14 type=del size=2634534 2024-03-04T12:26:49.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.024+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=WQQ1ZPI24DCE type=del size=1998923 2024-03-04T12:26:49.033 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.026+0000 7fa4b3c3e780 1 < suggested remove operation key=G70BJ2UARNCP tag=N821FVY6P8RL type=write 2024-03-04T12:26:49.035 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.028+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~TRI7FUWJ8OZ6.0 size=1048576 2024-03-04T12:26:49.036 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.029+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~TRI7FUWJ8OZ6.1 size=509044 2024-03-04T12:26:49.036 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.029+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=TRI7FUWJ8OZ6 tag=K69QREAEBNSS type=write size=2606196 2024-03-04T12:26:49.037 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.030+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~FNQHQ1FXJJP3.0 size=1048576 2024-03-04T12:26:49.038 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.031+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~FNQHQ1FXJJP3.1 size=1048576 2024-03-04T12:26:49.039 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.032+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~FNQHQ1FXJJP3.2 size=1034446 2024-03-04T12:26:49.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.034+0000 7fa4b3c3e780 1 < completed multipart upload key=BVMWQ9ZL4K0C upload=FNQHQ1FXJJP3 tag=VC8VEKM5Z300 type=write size=4180174 2024-03-04T12:26:49.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.036+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~LNTU1EHAHUN2.0 size=1048576 2024-03-04T12:26:49.044 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.037+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~LNTU1EHAHUN2.1 size=1048576 2024-03-04T12:26:49.044 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.038+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~LNTU1EHAHUN2.2 size=1005270 2024-03-04T12:26:49.044 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.038+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=LNTU1EHAHUN2 tag=7ECRUU6Q80RF type=write size=4150998 2024-03-04T12:26:49.046 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.039+0000 7fa4b3c3e780 1 < completed write operation key=YWJV4QMY6ZBI tag=CX1WZ8X92Z6P type=write size=43767 2024-03-04T12:26:49.047 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.040+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=K70D4NSADJ3J type=del size=3269509 2024-03-04T12:26:49.048 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.041+0000 7fa4b3c3e780 1 < completed delete operation key=R1DOKJPZRT5Q tag=8T1YGV4AHKUT type=del 2024-03-04T12:26:49.049 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.042+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=J2E3ZVH3SQ23 type=write size=303163 2024-03-04T12:26:49.050 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.044+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=G3XXN95MBKHQ type=del 2024-03-04T12:26:49.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.046+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~6C0IIY0Z0NPQ.0 size=1048576 2024-03-04T12:26:49.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.047+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~6C0IIY0Z0NPQ.1 size=407922 2024-03-04T12:26:49.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.047+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=6C0IIY0Z0NPQ tag=LD5NUAIMPGOH type=write size=2505074 2024-03-04T12:26:49.054 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.048+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~JIV1DFLTSN0G.0 size=1048576 2024-03-04T12:26:49.055 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.049+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~JIV1DFLTSN0G.1 size=336254 2024-03-04T12:26:49.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.050+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=JIV1DFLTSN0G tag=T7C52SV92ALQ type=write size=2433406 2024-03-04T12:26:49.058 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.052+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=76SREENM120I type=del size=164129 2024-03-04T12:26:49.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.053+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=06RYDBF3JFST type=del 2024-03-04T12:26:49.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.056+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~LBIY0KMZT10D.0 size=1048576 2024-03-04T12:26:49.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.057+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~LBIY0KMZT10D.1 size=1048576 2024-03-04T12:26:49.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.058+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~LBIY0KMZT10D.2 size=926139 2024-03-04T12:26:49.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.058+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=LBIY0KMZT10D tag=5G4K6CPFZB77 type=write size=4071867 2024-03-04T12:26:49.066 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.059+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~DROK490FX1U9.0 size=1048576 2024-03-04T12:26:49.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.060+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~DROK490FX1U9.1 size=565486 2024-03-04T12:26:49.069 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.062+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=DROK490FX1U9 tag=PNI04QOFAKBK type=write size=2662638 2024-03-04T12:26:49.070 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.063+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=737547R57S0V type=del size=1774187 2024-03-04T12:26:49.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.065+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=Z6B9MWLPVZJN type=del 2024-03-04T12:26:49.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.067+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~MAJTP3TAT8DZ.0 size=1048576 2024-03-04T12:26:49.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.068+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~MAJTP3TAT8DZ.1 size=1048576 2024-03-04T12:26:49.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.069+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~MAJTP3TAT8DZ.2 size=92095 2024-03-04T12:26:49.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.069+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=MAJTP3TAT8DZ tag=ZKXJL62SG92W type=write size=3237823 2024-03-04T12:26:49.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.070+0000 7fa4b3c3e780 1 < completed write operation key=ESHAMQWMMBJR tag=QTP08B3J2BN9 type=write size=688260 2024-03-04T12:26:49.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.072+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=LQHVS42B7CKJ type=del size=987066 2024-03-04T12:26:49.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.073+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=RCM8FX3J26AT type=del 2024-03-04T12:26:49.081 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.074+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=GHJEUXDA73XV type=del size=3808944 2024-03-04T12:26:49.082 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.075+0000 7fa4b3c3e780 1 < canceled operation key=ESHAMQWMMBJR tag=EQ3N5GZ61Q22 type=write size=1019723 2024-03-04T12:26:49.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.076+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=9LK0U8WVVVT8 type=del size=3011901 2024-03-04T12:26:49.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.077+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~TRLPJ2Z8R7UK.0 size=277279 2024-03-04T12:26:49.086 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.079+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=TRLPJ2Z8R7UK tag=1N2AXC5U9P0W type=write size=1325855 2024-03-04T12:26:49.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.081+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~9I8H89OTHKOX.0 size=1048576 2024-03-04T12:26:49.089 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.082+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~9I8H89OTHKOX.1 size=1048576 2024-03-04T12:26:49.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.083+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~9I8H89OTHKOX.2 size=768367 2024-03-04T12:26:49.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.083+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=9I8H89OTHKOX tag=T49TTIZIN73W type=write size=3914095 2024-03-04T12:26:49.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.084+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=EZWNKV09CEMG type=del 2024-03-04T12:26:49.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.085+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=V8KU199T9DH5 type=del size=3935517 2024-03-04T12:26:49.094 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.087+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~QZLN93F0V52D.0 size=1048576 2024-03-04T12:26:49.095 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.088+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~QZLN93F0V52D.1 size=1048576 2024-03-04T12:26:49.096 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.089+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~QZLN93F0V52D.2 size=276938 2024-03-04T12:26:49.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.091+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=QZLN93F0V52D tag=UIB20TYAIVXM type=write size=3422666 2024-03-04T12:26:49.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.092+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=00K8BAROSR4R type=del size=1704340 2024-03-04T12:26:49.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.095+0000 7fa4b3c3e780 1 < suggested update operation key=H5FWRNK8F7QT tag=WQQ1ZPI24DCE type=del size=1998923 2024-03-04T12:26:49.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.097+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~C2RNJ1JJF6M5.0 size=1048576 2024-03-04T12:26:49.104 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.097+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~C2RNJ1JJF6M5.1 size=1048576 2024-03-04T12:26:49.105 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.098+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~C2RNJ1JJF6M5.2 size=641128 2024-03-04T12:26:49.105 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.098+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=C2RNJ1JJF6M5 tag=8NIEOTZZN9ZS type=write size=3786856 2024-03-04T12:26:49.106 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.100+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~TRI7FUWJ8OZ6.0 size=1048576 2024-03-04T12:26:49.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.100+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~TRI7FUWJ8OZ6.1 size=509044 2024-03-04T12:26:49.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.102+0000 7fa4b3c3e780 1 < completed multipart upload key=J53J0N99N30A upload=TRI7FUWJ8OZ6 tag=K69QREAEBNSS type=write size=2606196 2024-03-04T12:26:49.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.104+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~1ASXGZSS3KP5.0 size=1048576 2024-03-04T12:26:49.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.105+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~1ASXGZSS3KP5.1 size=1048576 2024-03-04T12:26:49.113 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.106+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~1ASXGZSS3KP5.2 size=197086 2024-03-04T12:26:49.113 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.106+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=1ASXGZSS3KP5 tag=5G51I0T2KYAC type=write size=3342814 2024-03-04T12:26:49.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.108+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~LNTU1EHAHUN2.0 size=1048576 2024-03-04T12:26:49.115 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.108+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~LNTU1EHAHUN2.1 size=1048576 2024-03-04T12:26:49.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.109+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~LNTU1EHAHUN2.2 size=1005270 2024-03-04T12:26:49.118 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.111+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=LNTU1EHAHUN2 tag=7ECRUU6Q80RF type=write size=4150998 2024-03-04T12:26:49.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.112+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=KO97TYOVTO7K type=del size=2780318 2024-03-04T12:26:49.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.115+0000 7fa4b3c3e780 1 < suggested remove operation key=H5FWRNK8F7QT tag=K70D4NSADJ3J type=del 2024-03-04T12:26:49.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.116+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=ZBFMRLPSUSTA type=write size=286002 2024-03-04T12:26:49.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.117+0000 7fa4b3c3e780 1 < completed write operation key=X0RVLNRWUAEM tag=J2E3ZVH3SQ23 type=write size=303163 2024-03-04T12:26:49.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.119+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~60RSZF0RWEGC.0 size=1048576 2024-03-04T12:26:49.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.120+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~60RSZF0RWEGC.1 size=944509 2024-03-04T12:26:49.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.120+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=60RSZF0RWEGC tag=I210WOPLTGY0 type=write size=3041661 2024-03-04T12:26:49.128 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.122+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~6C0IIY0Z0NPQ.0 size=1048576 2024-03-04T12:26:49.130 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.123+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~6C0IIY0Z0NPQ.1 size=407922 2024-03-04T12:26:49.132 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.125+0000 7fa4b3c3e780 1 < completed multipart upload key=J53J0N99N30A upload=6C0IIY0Z0NPQ tag=LD5NUAIMPGOH type=write size=2505074 2024-03-04T12:26:49.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.126+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=XBH7EU4KSG8J type=del size=2438344 2024-03-04T12:26:49.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.127+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=76SREENM120I type=del 2024-03-04T12:26:49.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.129+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=ID3FVV570O60 type=write size=983084 2024-03-04T12:26:49.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.130+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~LBIY0KMZT10D.0 size=1048576 2024-03-04T12:26:49.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.131+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~LBIY0KMZT10D.1 size=1048576 2024-03-04T12:26:49.139 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.132+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~LBIY0KMZT10D.2 size=926139 2024-03-04T12:26:49.141 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.134+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=LBIY0KMZT10D tag=5G4K6CPFZB77 type=write size=4071867 2024-03-04T12:26:49.143 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.136+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~G69RT4TR4RWQ.0 size=141647 2024-03-04T12:26:49.143 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.136+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=G69RT4TR4RWQ tag=0Y63ZJK0K4C4 type=write size=1190223 2024-03-04T12:26:49.144 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.137+0000 7fa4b3c3e780 1 < canceled operation key=R1DOKJPZRT5Q tag=737547R57S0V type=del size=1774187 2024-03-04T12:26:49.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.138+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=OECB72R0AXK5 type=del size=2216595 2024-03-04T12:26:49.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.139+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~MAJTP3TAT8DZ.0 size=1048576 2024-03-04T12:26:49.147 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.140+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~MAJTP3TAT8DZ.1 size=1048576 2024-03-04T12:26:49.147 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.140+0000 7fa4b3c3e780 1 < canceled part key=_multipart_3N6E09QF3866.2~MAJTP3TAT8DZ.2 size=92095 2024-03-04T12:26:49.149 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.142+0000 7fa4b3c3e780 1 < canceled multipart upload key=3N6E09QF3866 upload=MAJTP3TAT8DZ tag=ZKXJL62SG92W type=write size=3237823 2024-03-04T12:26:49.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.143+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=BPH98DECNSDE type=del size=966227 2024-03-04T12:26:49.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.146+0000 7fa4b3c3e780 1 < suggested remove operation key=3N6E09QF3866 tag=LQHVS42B7CKJ type=del 2024-03-04T12:26:49.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.147+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=ZJAKB3EC724Z type=del size=2020701 2024-03-04T12:26:49.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.148+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=GHJEUXDA73XV type=del 2024-03-04T12:26:49.156 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.149+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=1BTQQLFTCK3P type=write size=901448 2024-03-04T12:26:49.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.151+0000 7fa4b3c3e780 1 < suggested update operation key=X0RVLNRWUAEM tag=9LK0U8WVVVT8 type=del size=3011901 2024-03-04T12:26:49.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.152+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=PUBA6L0M3GGH type=del size=36893 2024-03-04T12:26:49.160 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.153+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~9I8H89OTHKOX.0 size=1048576 2024-03-04T12:26:49.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.154+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~9I8H89OTHKOX.1 size=1048576 2024-03-04T12:26:49.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.154+0000 7fa4b3c3e780 1 < canceled part key=_multipart_R1DOKJPZRT5Q.2~9I8H89OTHKOX.2 size=768367 2024-03-04T12:26:49.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.156+0000 7fa4b3c3e780 1 < canceled multipart upload key=R1DOKJPZRT5Q upload=9I8H89OTHKOX tag=T49TTIZIN73W type=write size=3914095 2024-03-04T12:26:49.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.158+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~UK7DFL5TRI9Z.0 size=1048576 2024-03-04T12:26:49.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.159+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~UK7DFL5TRI9Z.1 size=1048576 2024-03-04T12:26:49.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.160+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~UK7DFL5TRI9Z.2 size=708336 2024-03-04T12:26:49.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.160+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=UK7DFL5TRI9Z tag=0O6LL57NU4F3 type=write size=3854064 2024-03-04T12:26:49.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.161+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=V8KU199T9DH5 type=del 2024-03-04T12:26:49.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.164+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~1UFQXFR8S8IR.0 size=1048576 2024-03-04T12:26:49.172 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.165+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~1UFQXFR8S8IR.1 size=1048576 2024-03-04T12:26:49.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.166+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~1UFQXFR8S8IR.2 size=48287 2024-03-04T12:26:49.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.166+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=1UFQXFR8S8IR tag=A3S5ZGEOBE4O type=write size=3194015 2024-03-04T12:26:49.174 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.167+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=00K8BAROSR4R type=del 2024-03-04T12:26:49.175 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.169+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=F7B9UCFZECWJ type=del size=914635 2024-03-04T12:26:49.177 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.170+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~C2RNJ1JJF6M5.0 size=1048576 2024-03-04T12:26:49.178 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.171+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~C2RNJ1JJF6M5.1 size=1048576 2024-03-04T12:26:49.179 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.172+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~C2RNJ1JJF6M5.2 size=641128 2024-03-04T12:26:49.181 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.174+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=C2RNJ1JJF6M5 tag=8NIEOTZZN9ZS type=write size=3786856 2024-03-04T12:26:49.183 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.176+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~Z8GSV0J24L3M.0 size=1048576 2024-03-04T12:26:49.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.177+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~Z8GSV0J24L3M.1 size=97491 2024-03-04T12:26:49.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.177+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=Z8GSV0J24L3M tag=DZSMAU5IR07F type=write size=2194643 2024-03-04T12:26:49.185 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.179+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~1ASXGZSS3KP5.0 size=1048576 2024-03-04T12:26:49.187 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.180+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~1ASXGZSS3KP5.1 size=1048576 2024-03-04T12:26:49.187 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.180+0000 7fa4b3c3e780 1 < canceled part key=_multipart_BR8RTE2QEH9E.2~1ASXGZSS3KP5.2 size=197086 2024-03-04T12:26:49.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.182+0000 7fa4b3c3e780 1 < canceled multipart upload key=BR8RTE2QEH9E upload=1ASXGZSS3KP5 tag=5G51I0T2KYAC type=write size=3342814 2024-03-04T12:26:49.190 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.183+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=QUELRI3YDG52 type=del size=3666891 2024-03-04T12:26:49.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.185+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=KO97TYOVTO7K type=del 2024-03-04T12:26:49.193 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.187+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~YDY9Q1UA3I0N.0 size=1048576 2024-03-04T12:26:49.194 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.187+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~YDY9Q1UA3I0N.1 size=192372 2024-03-04T12:26:49.194 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.187+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=YDY9Q1UA3I0N tag=47FZCZ2X7HET type=write size=2289524 2024-03-04T12:26:49.195 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.189+0000 7fa4b3c3e780 1 < completed write operation key=R6Y09EO6HGF0 tag=ZBFMRLPSUSTA type=write size=286002 2024-03-04T12:26:49.197 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.190+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=UU6AWBBN8626 type=del size=1475749 2024-03-04T12:26:49.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.191+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~60RSZF0RWEGC.0 size=1048576 2024-03-04T12:26:49.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.192+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~60RSZF0RWEGC.1 size=944509 2024-03-04T12:26:49.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.194+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=60RSZF0RWEGC tag=I210WOPLTGY0 type=write size=3041661 2024-03-04T12:26:49.202 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.195+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=VNVWQOPCVAVM type=write size=444540 2024-03-04T12:26:49.204 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.197+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=XBH7EU4KSG8J type=del 2024-03-04T12:26:49.205 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.198+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=XTWRG4DDM6B7 type=del size=2447153 2024-03-04T12:26:49.206 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.200+0000 7fa4b3c3e780 1 < completed write operation key=ESHAMQWMMBJR tag=ID3FVV570O60 type=write size=983084 2024-03-04T12:26:49.208 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.201+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=NBT0VVYY5JNL type=del size=2514912 2024-03-04T12:26:49.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.202+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~G69RT4TR4RWQ.0 size=141647 2024-03-04T12:26:49.211 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.204+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=G69RT4TR4RWQ tag=0Y63ZJK0K4C4 type=write size=1190223 2024-03-04T12:26:49.212 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.205+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=ITGMHA2729QG type=del size=3047681 2024-03-04T12:26:49.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.207+0000 7fa4b3c3e780 1 < completed delete operation key=RHU0QO8HS5SC tag=OECB72R0AXK5 type=del 2024-03-04T12:26:49.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.209+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~TYV2TZSC33H0.0 size=1048576 2024-03-04T12:26:49.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.209+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~TYV2TZSC33H0.1 size=1048576 2024-03-04T12:26:49.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.210+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~TYV2TZSC33H0.2 size=281873 2024-03-04T12:26:49.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.210+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=TYV2TZSC33H0 tag=0VLNY2J1SF37 type=write size=3427601 2024-03-04T12:26:49.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.211+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=BPH98DECNSDE type=del 2024-03-04T12:26:49.219 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.212+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=EL89MN728VL8 type=del size=1302382 2024-03-04T12:26:49.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.214+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=ZJAKB3EC724Z type=del 2024-03-04T12:26:49.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.215+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=PN9KNPGMXSDR type=del size=119232 2024-03-04T12:26:49.223 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.216+0000 7fa4b3c3e780 1 < completed write operation key=GMIPCGYZRJ5L tag=1BTQQLFTCK3P type=write size=901448 2024-03-04T12:26:49.225 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.218+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~V4UH8XU1YF6R.0 size=1048576 2024-03-04T12:26:49.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.219+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~V4UH8XU1YF6R.1 size=1048576 2024-03-04T12:26:49.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.220+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~V4UH8XU1YF6R.2 size=784075 2024-03-04T12:26:49.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.220+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=V4UH8XU1YF6R tag=H9N0FKDCDMI6 type=write size=3929803 2024-03-04T12:26:49.228 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.221+0000 7fa4b3c3e780 1 < completed delete operation key=R6Y09EO6HGF0 tag=PUBA6L0M3GGH type=del 2024-03-04T12:26:49.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.222+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=01PIPQ09O1D9 type=del size=2631810 2024-03-04T12:26:49.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.223+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~UK7DFL5TRI9Z.0 size=1048576 2024-03-04T12:26:49.231 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.224+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~UK7DFL5TRI9Z.1 size=1048576 2024-03-04T12:26:49.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.225+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~UK7DFL5TRI9Z.2 size=708336 2024-03-04T12:26:49.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.227+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=UK7DFL5TRI9Z tag=0O6LL57NU4F3 type=write size=3854064 2024-03-04T12:26:49.235 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.229+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=0KZLDC32O7S8 type=write size=652496 2024-03-04T12:26:49.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.230+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~1UFQXFR8S8IR.0 size=1048576 2024-03-04T12:26:49.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.231+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~1UFQXFR8S8IR.1 size=1048576 2024-03-04T12:26:49.238 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.232+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~1UFQXFR8S8IR.2 size=48287 2024-03-04T12:26:49.240 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.233+0000 7fa4b3c3e780 1 < completed multipart upload key=43HMF7NWNMU3 upload=1UFQXFR8S8IR tag=A3S5ZGEOBE4O type=write size=3194015 2024-03-04T12:26:49.241 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.235+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=AE7P8HV1MNU6 type=del size=1466827 2024-03-04T12:26:49.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.237+0000 7fa4b3c3e780 1 < suggested remove operation key=ESHAMQWMMBJR tag=F7B9UCFZECWJ type=del 2024-03-04T12:26:49.246 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.239+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~7F7Q78U173FG.0 size=1048576 2024-03-04T12:26:49.247 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.240+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~7F7Q78U173FG.1 size=1048576 2024-03-04T12:26:49.248 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.241+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~7F7Q78U173FG.2 size=115015 2024-03-04T12:26:49.248 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.241+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=7F7Q78U173FG tag=SH5X0HTLIQG3 type=write size=3260743 2024-03-04T12:26:49.249 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.242+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~Z8GSV0J24L3M.0 size=1048576 2024-03-04T12:26:49.250 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.243+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~Z8GSV0J24L3M.1 size=97491 2024-03-04T12:26:49.252 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.245+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=Z8GSV0J24L3M tag=DZSMAU5IR07F type=write size=2194643 2024-03-04T12:26:49.253 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.246+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=7NLW8WD9JXIT type=del size=1843127 2024-03-04T12:26:49.255 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.248+0000 7fa4b3c3e780 1 < suggested update operation key=YWJV4QMY6ZBI tag=QUELRI3YDG52 type=del size=3666891 2024-03-04T12:26:49.256 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.250+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=TBPI9ZPH4P9E type=del size=3201647 2024-03-04T12:26:49.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.251+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~YDY9Q1UA3I0N.0 size=1048576 2024-03-04T12:26:49.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.252+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~YDY9Q1UA3I0N.1 size=192372 2024-03-04T12:26:49.260 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.254+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=YDY9Q1UA3I0N tag=47FZCZ2X7HET type=write size=2289524 2024-03-04T12:26:49.262 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.255+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=K0CY2FEHG885 type=del size=3117279 2024-03-04T12:26:49.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.256+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=UU6AWBBN8626 type=del 2024-03-04T12:26:49.264 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.257+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=7JQXADTF1I2O type=del size=2638100 2024-03-04T12:26:49.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.258+0000 7fa4b3c3e780 1 < completed write operation key=V7N7MZ1GUNEV tag=VNVWQOPCVAVM type=write size=444540 2024-03-04T12:26:49.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.260+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~2K1Y9L8WCCJW.0 size=1048576 2024-03-04T12:26:49.268 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.261+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~2K1Y9L8WCCJW.1 size=842571 2024-03-04T12:26:49.268 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.261+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=2K1Y9L8WCCJW tag=Z1W5XKKRFGW9 type=write size=2939723 2024-03-04T12:26:49.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.262+0000 7fa4b3c3e780 1 < completed delete operation key=RHU0QO8HS5SC tag=XTWRG4DDM6B7 type=del 2024-03-04T12:26:49.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.263+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=EYVBR04FDUV6 type=del size=1246932 2024-03-04T12:26:49.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.264+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=NBT0VVYY5JNL type=del 2024-03-04T12:26:49.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.266+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~F5O0724D3NA3.0 size=1048576 2024-03-04T12:26:49.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.267+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~F5O0724D3NA3.1 size=1026443 2024-03-04T12:26:49.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.267+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=F5O0724D3NA3 tag=N6O2L2I974VM type=write size=3123595 2024-03-04T12:26:49.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.270+0000 7fa4b3c3e780 1 < suggested update operation key=G4SUQFVB936T tag=ITGMHA2729QG type=del size=3047681 2024-03-04T12:26:49.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.273+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~LXXW3OXM61PN.0 size=1048576 2024-03-04T12:26:49.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.274+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~LXXW3OXM61PN.1 size=600625 2024-03-04T12:26:49.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.274+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=LXXW3OXM61PN tag=0HXK3SRXIZ4Z type=write size=2697777 2024-03-04T12:26:49.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.275+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~TYV2TZSC33H0.0 size=1048576 2024-03-04T12:26:49.282 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.276+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~TYV2TZSC33H0.1 size=1048576 2024-03-04T12:26:49.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.276+0000 7fa4b3c3e780 1 < canceled part key=_multipart_BVMWQ9ZL4K0C.2~TYV2TZSC33H0.2 size=281873 2024-03-04T12:26:49.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.278+0000 7fa4b3c3e780 1 < canceled multipart upload key=BVMWQ9ZL4K0C upload=TYV2TZSC33H0 tag=0VLNY2J1SF37 type=write size=3427601 2024-03-04T12:26:49.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.279+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=BILGHN42BWAU type=write size=259071 2024-03-04T12:26:49.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.280+0000 7fa4b3c3e780 1 < canceled operation key=G70BJ2UARNCP tag=EL89MN728VL8 type=del size=1302382 2024-03-04T12:26:49.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.282+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~O125601EG44Q.0 size=1048576 2024-03-04T12:26:49.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.283+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~O125601EG44Q.1 size=1048576 2024-03-04T12:26:49.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.284+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~O125601EG44Q.2 size=712604 2024-03-04T12:26:49.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.284+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=O125601EG44Q tag=PDZ6UCX4RFTB type=write size=3858332 2024-03-04T12:26:49.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.285+0000 7fa4b3c3e780 1 < completed delete operation key=RHU0QO8HS5SC tag=PN9KNPGMXSDR type=del 2024-03-04T12:26:49.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.286+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=5O0MEHWUQD2I type=del size=1222593 2024-03-04T12:26:49.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.287+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~V4UH8XU1YF6R.0 size=1048576 2024-03-04T12:26:49.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.288+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~V4UH8XU1YF6R.1 size=1048576 2024-03-04T12:26:49.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.288+0000 7fa4b3c3e780 1 < canceled part key=_multipart_R1DOKJPZRT5Q.2~V4UH8XU1YF6R.2 size=784075 2024-03-04T12:26:49.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.290+0000 7fa4b3c3e780 1 < canceled multipart upload key=R1DOKJPZRT5Q upload=V4UH8XU1YF6R tag=H9N0FKDCDMI6 type=write size=3929803 2024-03-04T12:26:49.297 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.291+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=CWTFOVOPNKIN type=del size=3624847 2024-03-04T12:26:49.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.292+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=01PIPQ09O1D9 type=del 2024-03-04T12:26:49.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.294+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~YLQ05QZZP3DY.0 size=105234 2024-03-04T12:26:49.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.294+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=YLQ05QZZP3DY tag=XDYMCM0RVGDS type=write size=1153810 2024-03-04T12:26:49.302 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.295+0000 7fa4b3c3e780 1 < completed write operation key=WRHB3XWDLSY2 tag=0KZLDC32O7S8 type=write size=652496 2024-03-04T12:26:49.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.296+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=21LYAO318PEY type=write size=804693 2024-03-04T12:26:49.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.298+0000 7fa4b3c3e780 1 < suggested update operation key=NVMIU38VM9Q1 tag=AE7P8HV1MNU6 type=del size=1466827 2024-03-04T12:26:49.306 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.300+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=D297BCKF2GJ9 type=del size=1447696 2024-03-04T12:26:49.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.301+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~7F7Q78U173FG.0 size=1048576 2024-03-04T12:26:49.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.302+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~7F7Q78U173FG.1 size=1048576 2024-03-04T12:26:49.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.302+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~7F7Q78U173FG.2 size=115015 2024-03-04T12:26:49.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.304+0000 7fa4b3c3e780 1 < completed multipart upload key=YIS2SV4O5EZN upload=7F7Q78U173FG tag=SH5X0HTLIQG3 type=write size=3260743 2024-03-04T12:26:49.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.305+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=0EE7DG73E7JC type=del size=3776938 2024-03-04T12:26:49.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.307+0000 7fa4b3c3e780 1 < canceled operation key=ESHAMQWMMBJR tag=7NLW8WD9JXIT type=del size=1843127 2024-03-04T12:26:49.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.308+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=0TKR11WRUO1X type=del size=426127 2024-03-04T12:26:49.317 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.310+0000 7fa4b3c3e780 1 < suggested update operation key=GMIPCGYZRJ5L tag=TBPI9ZPH4P9E type=del size=3201647 2024-03-04T12:26:49.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.312+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~5FGFBI016I61.0 size=226037 2024-03-04T12:26:49.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.312+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=5FGFBI016I61 tag=GIWHQY60T6II type=write size=1274613 2024-03-04T12:26:49.320 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.313+0000 7fa4b3c3e780 1 < completed delete operation key=R6Y09EO6HGF0 tag=K0CY2FEHG885 type=del 2024-03-04T12:26:49.321 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.314+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=TDIPQ2GHBP9M type=del size=2536734 2024-03-04T12:26:49.322 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.315+0000 7fa4b3c3e780 1 < canceled operation key=R1DOKJPZRT5Q tag=7JQXADTF1I2O type=del size=2638100 2024-03-04T12:26:49.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.317+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~0XBV8KX1UVXK.0 size=1048576 2024-03-04T12:26:49.325 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.318+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~0XBV8KX1UVXK.1 size=1048576 2024-03-04T12:26:49.326 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.319+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~0XBV8KX1UVXK.2 size=394811 2024-03-04T12:26:49.326 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.319+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=0XBV8KX1UVXK tag=CIW2DRGOT9LF type=write size=3540539 2024-03-04T12:26:49.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.320+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~2K1Y9L8WCCJW.0 size=1048576 2024-03-04T12:26:49.328 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.321+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~2K1Y9L8WCCJW.1 size=842571 2024-03-04T12:26:49.330 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.324+0000 7fa4b3c3e780 1 < completed multipart upload key=G70BJ2UARNCP upload=2K1Y9L8WCCJW tag=Z1W5XKKRFGW9 type=write size=2939723 2024-03-04T12:26:49.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.326+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~J6S04QDPI766.0 size=1048576 2024-03-04T12:26:49.333 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.327+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~J6S04QDPI766.1 size=1048576 2024-03-04T12:26:49.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.327+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~J6S04QDPI766.2 size=991258 2024-03-04T12:26:49.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.327+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=J6S04QDPI766 tag=SFCURBWQ4LBW type=write size=4136986 2024-03-04T12:26:49.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.329+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=EYVBR04FDUV6 type=del 2024-03-04T12:26:49.337 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.330+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=VL11K9L4VMXC type=write size=782048 2024-03-04T12:26:49.338 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.331+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~F5O0724D3NA3.0 size=1048576 2024-03-04T12:26:49.338 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.331+0000 7fa4b3c3e780 1 < canceled part key=_multipart_ZETES4AYZQHY.2~F5O0724D3NA3.1 size=1026443 2024-03-04T12:26:49.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.333+0000 7fa4b3c3e780 1 < canceled multipart upload key=ZETES4AYZQHY upload=F5O0724D3NA3 tag=N6O2L2I974VM type=write size=3123595 2024-03-04T12:26:49.341 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.334+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=7STCCKFCGRSR type=del size=3972845 2024-03-04T12:26:49.342 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.335+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~LXXW3OXM61PN.0 size=1048576 2024-03-04T12:26:49.343 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.337+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~LXXW3OXM61PN.1 size=600625 2024-03-04T12:26:49.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.339+0000 7fa4b3c3e780 1 < completed multipart upload key=BVMWQ9ZL4K0C upload=LXXW3OXM61PN tag=0HXK3SRXIZ4Z type=write size=2697777 2024-03-04T12:26:49.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.340+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=Q90123OWSSCP type=del size=1939306 2024-03-04T12:26:49.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.341+0000 7fa4b3c3e780 1 < completed write operation key=43HMF7NWNMU3 tag=BILGHN42BWAU type=write size=259071 2024-03-04T12:26:49.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.342+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=3OXAHLIC9WG9 type=del size=3470836 2024-03-04T12:26:49.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.344+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~O125601EG44Q.0 size=1048576 2024-03-04T12:26:49.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.344+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~O125601EG44Q.1 size=1048576 2024-03-04T12:26:49.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.344+0000 7fa4b3c3e780 1 < canceled part key=_multipart_WRHB3XWDLSY2.2~O125601EG44Q.2 size=712604 2024-03-04T12:26:49.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.346+0000 7fa4b3c3e780 1 < canceled multipart upload key=WRHB3XWDLSY2 upload=O125601EG44Q tag=PDZ6UCX4RFTB type=write size=3858332 2024-03-04T12:26:49.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.348+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~UCCADTW2WLUP.0 size=385183 2024-03-04T12:26:49.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.348+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=UCCADTW2WLUP tag=3PUI3JEHVDXY type=write size=1433759 2024-03-04T12:26:49.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.350+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=5O0MEHWUQD2I type=del 2024-03-04T12:26:49.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.351+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~BHPAIQY54YFT.0 size=300367 2024-03-04T12:26:49.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.351+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=BHPAIQY54YFT tag=741UFJ0ZB2MZ type=write size=1348943 2024-03-04T12:26:49.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.353+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=CWTFOVOPNKIN type=del 2024-03-04T12:26:49.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.354+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=0L1Y9PTFMSUZ type=del size=1068045 2024-03-04T12:26:49.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.355+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~YLQ05QZZP3DY.0 size=105234 2024-03-04T12:26:49.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.357+0000 7fa4b3c3e780 1 < completed multipart upload key=YIS2SV4O5EZN upload=YLQ05QZZP3DY tag=XDYMCM0RVGDS type=write size=1153810 2024-03-04T12:26:49.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.358+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=PNSGWTNGOPJ6 type=del size=1039834 2024-03-04T12:26:49.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.359+0000 7fa4b3c3e780 1 < completed write operation key=YQLH0WW7I7MW tag=21LYAO318PEY type=write size=804693 2024-03-04T12:26:49.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.361+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~V6JF78MX8E4W.0 size=332828 2024-03-04T12:26:49.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.361+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=V6JF78MX8E4W tag=A7A4179YXH80 type=write size=1381404 2024-03-04T12:26:49.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.362+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=D297BCKF2GJ9 type=del 2024-03-04T12:26:49.370 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.364+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=BFYA6YFYXXG4 type=del size=2566371 2024-03-04T12:26:49.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.365+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=0EE7DG73E7JC type=del 2024-03-04T12:26:49.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.366+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=53XLVRQFLM2Q type=write size=558129 2024-03-04T12:26:49.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.368+0000 7fa4b3c3e780 1 < suggested update operation key=V7N7MZ1GUNEV tag=0TKR11WRUO1X type=del size=426127 2024-03-04T12:26:49.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.369+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=2RG74ZU4YM58 type=del size=4191872 2024-03-04T12:26:49.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.371+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~5FGFBI016I61.0 size=226037 2024-03-04T12:26:49.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.373+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=5FGFBI016I61 tag=GIWHQY60T6II type=write size=1274613 2024-03-04T12:26:49.380 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.374+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=2OP4A46B545J type=write size=908261 2024-03-04T12:26:49.382 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.375+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=TDIPQ2GHBP9M type=del 2024-03-04T12:26:49.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.376+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=DFC2ECRVKURQ type=write size=344012 2024-03-04T12:26:49.384 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.377+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~0XBV8KX1UVXK.0 size=1048576 2024-03-04T12:26:49.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.378+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~0XBV8KX1UVXK.1 size=1048576 2024-03-04T12:26:49.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.380+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~0XBV8KX1UVXK.2 size=394811 2024-03-04T12:26:49.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.382+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=0XBV8KX1UVXK tag=CIW2DRGOT9LF type=write size=3540539 2024-03-04T12:26:49.390 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.383+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=CS23GULLERYX type=del size=4124047 2024-03-04T12:26:49.391 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.384+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~J6S04QDPI766.0 size=1048576 2024-03-04T12:26:49.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.385+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~J6S04QDPI766.1 size=1048576 2024-03-04T12:26:49.393 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.386+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~J6S04QDPI766.2 size=991258 2024-03-04T12:26:49.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.388+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=J6S04QDPI766 tag=SFCURBWQ4LBW type=write size=4136986 2024-03-04T12:26:49.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.389+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=2IBZ5EKLQELS type=del size=3681953 2024-03-04T12:26:49.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.391+0000 7fa4b3c3e780 1 < suggested update operation key=3TDMQXKLPX34 tag=VL11K9L4VMXC type=write size=782048 2024-03-04T12:26:49.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.392+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=B0HCSMNAF5AU type=del size=3669011 2024-03-04T12:26:49.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.393+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=7STCCKFCGRSR type=del 2024-03-04T12:26:49.401 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.395+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=XDLPO9MCJE9W type=del size=1261616 2024-03-04T12:26:49.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.396+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=Q90123OWSSCP type=del 2024-03-04T12:26:49.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.397+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=NI36JFJTYG8M type=del size=2335363 2024-03-04T12:26:49.405 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.398+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=3OXAHLIC9WG9 type=del 2024-03-04T12:26:49.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.399+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=C2CQUNI3D1P7 type=del size=3327683 2024-03-04T12:26:49.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.401+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~UCCADTW2WLUP.0 size=385183 2024-03-04T12:26:49.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.402+0000 7fa4b3c3e780 1 < completed multipart upload key=3N6E09QF3866 upload=UCCADTW2WLUP tag=3PUI3JEHVDXY type=write size=1433759 2024-03-04T12:26:49.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.404+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=RQEOOGVO79GB type=del size=1432548 2024-03-04T12:26:49.412 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.405+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~BHPAIQY54YFT.0 size=300367 2024-03-04T12:26:49.414 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.407+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=BHPAIQY54YFT tag=741UFJ0ZB2MZ type=write size=1348943 2024-03-04T12:26:49.416 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.409+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~G782N1K7A148.0 size=1048576 2024-03-04T12:26:49.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.410+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~G782N1K7A148.1 size=319857 2024-03-04T12:26:49.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.410+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=G782N1K7A148 tag=VCDZGGSSR69F type=write size=2417009 2024-03-04T12:26:49.419 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.412+0000 7fa4b3c3e780 1 < suggested remove operation key=UZRX3W3DE5VX tag=0L1Y9PTFMSUZ type=del 2024-03-04T12:26:49.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.414+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=Z5PFAF063F56 type=del size=3689172 2024-03-04T12:26:49.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.415+0000 7fa4b3c3e780 1 < canceled operation key=G4SUQFVB936T tag=PNSGWTNGOPJ6 type=del size=1039834 2024-03-04T12:26:49.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.417+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~C7Y1B7OAEBHA.0 size=1048576 2024-03-04T12:26:49.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.418+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~C7Y1B7OAEBHA.1 size=1048576 2024-03-04T12:26:49.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.419+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~C7Y1B7OAEBHA.2 size=416198 2024-03-04T12:26:49.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.419+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=C7Y1B7OAEBHA tag=RNFU4ODBFHQW type=write size=3561926 2024-03-04T12:26:49.427 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.420+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~V6JF78MX8E4W.0 size=332828 2024-03-04T12:26:49.429 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.422+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=V6JF78MX8E4W tag=A7A4179YXH80 type=write size=1381404 2024-03-04T12:26:49.430 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.423+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=IKGZ634PXLD7 type=del size=3877332 2024-03-04T12:26:49.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.425+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=BFYA6YFYXXG4 type=del 2024-03-04T12:26:49.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.427+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~I49GUFFKOSH4.0 size=1048576 2024-03-04T12:26:49.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.428+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~I49GUFFKOSH4.1 size=755805 2024-03-04T12:26:49.435 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.428+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=I49GUFFKOSH4 tag=DP4C9S453WII type=write size=2852957 2024-03-04T12:26:49.436 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.429+0000 7fa4b3c3e780 1 < completed write operation key=WRHB3XWDLSY2 tag=53XLVRQFLM2Q type=write size=558129 2024-03-04T12:26:49.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.430+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=UX4OY5Z7F7NS type=del size=1223674 2024-03-04T12:26:49.438 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.431+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=2RG74ZU4YM58 type=del 2024-03-04T12:26:49.440 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.433+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~S6CT1B6ANXQ5.0 size=1048576 2024-03-04T12:26:49.441 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.434+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~S6CT1B6ANXQ5.1 size=814907 2024-03-04T12:26:49.441 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.434+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=S6CT1B6ANXQ5 tag=6X0KISYG28WJ type=write size=2912059 2024-03-04T12:26:49.444 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.437+0000 7fa4b3c3e780 1 < suggested update operation key=YWJV4QMY6ZBI tag=2OP4A46B545J type=write size=908261 2024-03-04T12:26:49.445 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.438+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=TE8M4EKN2226 type=del size=1805677 2024-03-04T12:26:49.446 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.439+0000 7fa4b3c3e780 1 < completed write operation key=X0RVLNRWUAEM tag=DFC2ECRVKURQ type=write size=344012 2024-03-04T12:26:49.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.441+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=DFOQ9VAY86UX type=del size=1859431 2024-03-04T12:26:49.449 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.442+0000 7fa4b3c3e780 1 < completed delete operation key=X0RVLNRWUAEM tag=CS23GULLERYX type=del 2024-03-04T12:26:49.450 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.443+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=6KRCLZP7AR3Q type=del size=2512532 2024-03-04T12:26:49.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.444+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=2IBZ5EKLQELS type=del 2024-03-04T12:26:49.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.447+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~5BKY7R1WGXEH.0 size=1048576 2024-03-04T12:26:49.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.447+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~5BKY7R1WGXEH.1 size=1048576 2024-03-04T12:26:49.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.448+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~5BKY7R1WGXEH.2 size=165432 2024-03-04T12:26:49.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.448+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=5BKY7R1WGXEH tag=F35VZ6OK0RXS type=write size=3311160 2024-03-04T12:26:49.457 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.451+0000 7fa4b3c3e780 1 < suggested remove operation key=NVMIU38VM9Q1 tag=B0HCSMNAF5AU type=del 2024-03-04T12:26:49.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.453+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~XB2JLL42O603.0 size=1048576 2024-03-04T12:26:49.460 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.454+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~XB2JLL42O603.1 size=866825 2024-03-04T12:26:49.460 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.454+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=XB2JLL42O603 tag=1FZ0NONVX1EY type=write size=2963977 2024-03-04T12:26:49.461 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.455+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=XDLPO9MCJE9W type=del 2024-03-04T12:26:49.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.457+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~GTQNPVI7L1G3.0 size=121685 2024-03-04T12:26:49.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.457+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=GTQNPVI7L1G3 tag=5889N5E4PPGR type=write size=1170261 2024-03-04T12:26:49.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.459+0000 7fa4b3c3e780 1 < suggested update operation key=BVMWQ9ZL4K0C tag=NI36JFJTYG8M type=del size=2335363 2024-03-04T12:26:49.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.460+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=4K8YQP4OQE3H type=write size=436742 2024-03-04T12:26:49.468 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.461+0000 7fa4b3c3e780 -1 < failed to complete operation key=YWJV4QMY6ZBI tag=C2CQUNI3D1P7 type=del size=3327683: (22) Invalid argument 2024-03-04T12:26:49.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.462+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=WW8AIKULOPHL type=del size=3335633 2024-03-04T12:26:49.471 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.465+0000 7fa4b3c3e780 1 < suggested update operation key=KKQT9J9GSW0N tag=RQEOOGVO79GB type=del size=1432548 2024-03-04T12:26:49.473 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.466+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=S7D60ZET49PJ type=del size=2358621 2024-03-04T12:26:49.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.467+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~G782N1K7A148.0 size=1048576 2024-03-04T12:26:49.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.468+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~G782N1K7A148.1 size=319857 2024-03-04T12:26:49.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.470+0000 7fa4b3c3e780 1 < completed multipart upload key=43HMF7NWNMU3 upload=G782N1K7A148 tag=VCDZGGSSR69F type=write size=2417009 2024-03-04T12:26:49.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.471+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=5R15ZN4WK223 type=del size=1322183 2024-03-04T12:26:49.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.473+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=Z5PFAF063F56 type=del 2024-03-04T12:26:49.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.475+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~7XVYK21AYOMD.0 size=1048576 2024-03-04T12:26:49.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.475+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~7XVYK21AYOMD.1 size=920684 2024-03-04T12:26:49.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.475+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=7XVYK21AYOMD tag=S2L7J335B5Q2 type=write size=3017836 2024-03-04T12:26:49.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.477+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~C7Y1B7OAEBHA.0 size=1048576 2024-03-04T12:26:49.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.477+0000 7fa4b3c3e780 1 < canceled part key=_multipart_H5FWRNK8F7QT.2~C7Y1B7OAEBHA.1 size=1048576 2024-03-04T12:26:49.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.478+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~C7Y1B7OAEBHA.2 size=416198 2024-03-04T12:26:49.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.480+0000 7fa4b3c3e780 1 < canceled multipart upload key=H5FWRNK8F7QT upload=C7Y1B7OAEBHA tag=RNFU4ODBFHQW type=write size=3561926 2024-03-04T12:26:49.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.481+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=B4UCBZYMHZGS type=del size=1807997 2024-03-04T12:26:49.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.482+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=IKGZ634PXLD7 type=del 2024-03-04T12:26:49.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.484+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~WF2BS5N21ANS.0 size=1048576 2024-03-04T12:26:49.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.485+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~WF2BS5N21ANS.1 size=1048576 2024-03-04T12:26:49.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.486+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~WF2BS5N21ANS.2 size=337239 2024-03-04T12:26:49.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.486+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=WF2BS5N21ANS tag=VB9REA3J5W22 type=write size=3482967 2024-03-04T12:26:49.494 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.487+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~I49GUFFKOSH4.0 size=1048576 2024-03-04T12:26:49.495 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.488+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~I49GUFFKOSH4.1 size=755805 2024-03-04T12:26:49.498 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.491+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=I49GUFFKOSH4 tag=DP4C9S453WII type=write size=2852957 2024-03-04T12:26:49.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.494+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~5PM1YFYCDZJF.0 size=1048576 2024-03-04T12:26:49.501 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.495+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~5PM1YFYCDZJF.1 size=904664 2024-03-04T12:26:49.501 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.495+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=5PM1YFYCDZJF tag=S21R2M5IGTMA type=write size=3001816 2024-03-04T12:26:49.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.496+0000 7fa4b3c3e780 1 < canceled operation key=UZRX3W3DE5VX tag=UX4OY5Z7F7NS type=del size=1223674 2024-03-04T12:26:49.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.498+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~VO136MSB4L1M.0 size=860041 2024-03-04T12:26:49.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.498+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=VO136MSB4L1M tag=EXLSY1MIYZ4Y type=write size=1908617 2024-03-04T12:26:49.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.498+0000 7fa4b3c3e780 1 < canceled part key=_multipart_3TDMQXKLPX34.2~S6CT1B6ANXQ5.0 size=1048576 2024-03-04T12:26:49.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.498+0000 7fa4b3c3e780 1 < canceled part key=_multipart_3TDMQXKLPX34.2~S6CT1B6ANXQ5.1 size=814907 2024-03-04T12:26:49.507 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.500+0000 7fa4b3c3e780 1 < canceled multipart upload key=3TDMQXKLPX34 upload=S6CT1B6ANXQ5 tag=6X0KISYG28WJ type=write size=2912059 2024-03-04T12:26:49.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.502+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~BN64QZR0ZSFB.0 size=1048576 2024-03-04T12:26:49.510 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.503+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~BN64QZR0ZSFB.1 size=517351 2024-03-04T12:26:49.510 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.503+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=BN64QZR0ZSFB tag=8VMLAXFFTFPV type=write size=2614503 2024-03-04T12:26:49.512 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.506+0000 7fa4b3c3e780 1 < suggested update operation key=BVMWQ9ZL4K0C tag=TE8M4EKN2226 type=del size=1805677 2024-03-04T12:26:49.515 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.508+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~CGFXOJJ2GYX5.0 size=1048576 2024-03-04T12:26:49.515 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.509+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~CGFXOJJ2GYX5.1 size=881174 2024-03-04T12:26:49.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.509+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=CGFXOJJ2GYX5 tag=EZ1P9O0RJ39W type=write size=2978326 2024-03-04T12:26:49.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.511+0000 7fa4b3c3e780 1 < suggested update operation key=KKQT9J9GSW0N tag=DFOQ9VAY86UX type=del size=1859431 2024-03-04T12:26:49.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.512+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=CQRTU0Q184SU type=del size=2730688 2024-03-04T12:26:49.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.513+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=6KRCLZP7AR3Q type=del 2024-03-04T12:26:49.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.515+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=W9P0MUOFBFXH type=write size=114279 2024-03-04T12:26:49.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.515+0000 7fa4b3c3e780 1 < canceled part key=_multipart_RHU0QO8HS5SC.2~5BKY7R1WGXEH.0 size=1048576 2024-03-04T12:26:49.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.516+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~5BKY7R1WGXEH.1 size=1048576 2024-03-04T12:26:49.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.517+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~5BKY7R1WGXEH.2 size=165432 2024-03-04T12:26:49.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.519+0000 7fa4b3c3e780 1 < canceled multipart upload key=RHU0QO8HS5SC upload=5BKY7R1WGXEH tag=F35VZ6OK0RXS type=write size=3311160 2024-03-04T12:26:49.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.520+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=KB0ZT5DD01WO type=del size=3439452 2024-03-04T12:26:49.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.521+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~XB2JLL42O603.0 size=1048576 2024-03-04T12:26:49.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.522+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~XB2JLL42O603.1 size=866825 2024-03-04T12:26:49.530 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.524+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=XB2JLL42O603 tag=1FZ0NONVX1EY type=write size=2963977 2024-03-04T12:26:49.532 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.525+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=NNP4HWKTEKUG type=del size=621007 2024-03-04T12:26:49.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.526+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~GTQNPVI7L1G3.0 size=121685 2024-03-04T12:26:49.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.528+0000 7fa4b3c3e780 1 < completed multipart upload key=G70BJ2UARNCP upload=GTQNPVI7L1G3 tag=5889N5E4PPGR type=write size=1170261 2024-03-04T12:26:49.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.530+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=F9J0LX0MXLCK type=del size=325173 2024-03-04T12:26:49.537 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.531+0000 7fa4b3c3e780 1 < completed write operation key=J53J0N99N30A tag=4K8YQP4OQE3H type=write size=436742 2024-03-04T12:26:49.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.532+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=8VZSJ4LQMZOR type=del size=693339 2024-03-04T12:26:49.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.533+0000 7fa4b3c3e780 1 < completed delete operation key=UZRX3W3DE5VX tag=WW8AIKULOPHL type=del 2024-03-04T12:26:49.542 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.535+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~ITMEZ9DN1P8D.0 size=1048576 2024-03-04T12:26:49.543 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.536+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~ITMEZ9DN1P8D.1 size=1048576 2024-03-04T12:26:49.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.537+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~ITMEZ9DN1P8D.2 size=726168 2024-03-04T12:26:49.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.537+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=ITMEZ9DN1P8D tag=J9VO2WAI7KRO type=write size=3871896 2024-03-04T12:26:49.545 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.538+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=S7D60ZET49PJ type=del 2024-03-04T12:26:49.546 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.539+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=I69WQV157KUC type=del size=1654800 2024-03-04T12:26:49.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.540+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=5R15ZN4WK223 type=del 2024-03-04T12:26:49.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.542+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~KM2JF3BW2JBH.0 size=1048576 2024-03-04T12:26:49.550 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.543+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~KM2JF3BW2JBH.1 size=1048576 2024-03-04T12:26:49.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.544+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~KM2JF3BW2JBH.2 size=106609 2024-03-04T12:26:49.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.544+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=KM2JF3BW2JBH tag=8J6ZJR5ULUKE type=write size=3252337 2024-03-04T12:26:49.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.545+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~7XVYK21AYOMD.0 size=1048576 2024-03-04T12:26:49.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.546+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~7XVYK21AYOMD.1 size=920684 2024-03-04T12:26:49.555 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.548+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=7XVYK21AYOMD tag=S2L7J335B5Q2 type=write size=3017836 2024-03-04T12:26:49.556 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.549+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=DAVPM7VDZVWL type=del size=472916 2024-03-04T12:26:49.557 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.550+0000 7fa4b3c3e780 1 < completed delete operation key=R1DOKJPZRT5Q tag=B4UCBZYMHZGS type=del 2024-03-04T12:26:49.559 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.553+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~54G5F4DH27HU.0 size=375250 2024-03-04T12:26:49.560 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.553+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=54G5F4DH27HU tag=RFH60LB2FR26 type=write size=1423826 2024-03-04T12:26:49.561 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.554+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~WF2BS5N21ANS.0 size=1048576 2024-03-04T12:26:49.561 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.554+0000 7fa4b3c3e780 1 < canceled part key=_multipart_GMIPCGYZRJ5L.2~WF2BS5N21ANS.1 size=1048576 2024-03-04T12:26:49.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.555+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~WF2BS5N21ANS.2 size=337239 2024-03-04T12:26:49.563 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.557+0000 7fa4b3c3e780 1 < canceled multipart upload key=GMIPCGYZRJ5L upload=WF2BS5N21ANS tag=VB9REA3J5W22 type=write size=3482967 2024-03-04T12:26:49.565 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.558+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=5R1HNHAGK5CQ type=del size=3587257 2024-03-04T12:26:49.566 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.559+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~5PM1YFYCDZJF.0 size=1048576 2024-03-04T12:26:49.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.560+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~5PM1YFYCDZJF.1 size=904664 2024-03-04T12:26:49.569 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.562+0000 7fa4b3c3e780 1 < completed multipart upload key=R1DOKJPZRT5Q upload=5PM1YFYCDZJF tag=S21R2M5IGTMA type=write size=3001816 2024-03-04T12:26:49.570 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.563+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=A56RQ0123KP9 type=del size=2806960 2024-03-04T12:26:49.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.565+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~VO136MSB4L1M.0 size=860041 2024-03-04T12:26:49.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.566+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=VO136MSB4L1M tag=EXLSY1MIYZ4Y type=write size=1908617 2024-03-04T12:26:49.574 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.568+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=PXK9HYVFPE3Y type=del size=2313744 2024-03-04T12:26:49.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.569+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~BN64QZR0ZSFB.0 size=1048576 2024-03-04T12:26:49.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.570+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~BN64QZR0ZSFB.1 size=517351 2024-03-04T12:26:49.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.572+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=BN64QZR0ZSFB tag=8VMLAXFFTFPV type=write size=2614503 2024-03-04T12:26:49.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.573+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=6UI1A57HR5CT type=del size=2094147 2024-03-04T12:26:49.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.573+0000 7fa4b3c3e780 1 < canceled part key=_multipart_GMIPCGYZRJ5L.2~CGFXOJJ2GYX5.0 size=1048576 2024-03-04T12:26:49.581 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.574+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~CGFXOJJ2GYX5.1 size=881174 2024-03-04T12:26:49.583 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.576+0000 7fa4b3c3e780 1 < canceled multipart upload key=GMIPCGYZRJ5L upload=CGFXOJJ2GYX5 tag=EZ1P9O0RJ39W type=write size=2978326 2024-03-04T12:26:49.585 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.578+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~UH5MZOSIDAG2.0 size=1048576 2024-03-04T12:26:49.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.579+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~UH5MZOSIDAG2.1 size=696229 2024-03-04T12:26:49.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.579+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=UH5MZOSIDAG2 tag=FA33OZJLV3OM type=write size=2793381 2024-03-04T12:26:49.587 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.580+0000 7fa4b3c3e780 1 < completed delete operation key=GMIPCGYZRJ5L tag=CQRTU0Q184SU type=del 2024-03-04T12:26:49.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.581+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=9DMMZRSXHVKU type=del size=3383393 2024-03-04T12:26:49.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.584+0000 7fa4b3c3e780 1 < suggested update operation key=BR8RTE2QEH9E tag=W9P0MUOFBFXH type=write size=114279 2024-03-04T12:26:49.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.585+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=D7WXL17Z3KR2 type=del size=3393163 2024-03-04T12:26:49.594 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.587+0000 7fa4b3c3e780 1 < suggested update operation key=3N6E09QF3866 tag=KB0ZT5DD01WO type=del size=3439452 2024-03-04T12:26:49.595 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.588+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=1XQEKPRECFHL type=del size=2038488 2024-03-04T12:26:49.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.589+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=NNP4HWKTEKUG type=del 2024-03-04T12:26:49.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.590+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=86F3GPHER1YE type=del size=3254810 2024-03-04T12:26:49.598 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.592+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=F9J0LX0MXLCK type=del 2024-03-04T12:26:49.599 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.593+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=0TKZZGAJGA8C type=del size=2397606 2024-03-04T12:26:49.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.594+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=8VZSJ4LQMZOR type=del 2024-03-04T12:26:49.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.596+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~XF7ZPUPWLMGW.0 size=29805 2024-03-04T12:26:49.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.596+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=XF7ZPUPWLMGW tag=F2YE00CV7A43 type=write size=1078381 2024-03-04T12:26:49.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.598+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~ITMEZ9DN1P8D.0 size=1048576 2024-03-04T12:26:49.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.600+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~ITMEZ9DN1P8D.1 size=1048576 2024-03-04T12:26:49.607 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.600+0000 7fa4b3c3e780 1 < canceled part key=_multipart_6XK4DQ940Z5J.2~ITMEZ9DN1P8D.2 size=726168 2024-03-04T12:26:49.608 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.602+0000 7fa4b3c3e780 1 < canceled multipart upload key=6XK4DQ940Z5J upload=ITMEZ9DN1P8D tag=J9VO2WAI7KRO type=write size=3871896 2024-03-04T12:26:49.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.603+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=42903QO8HXQJ type=del size=3478731 2024-03-04T12:26:49.611 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.604+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=I69WQV157KUC type=del 2024-03-04T12:26:49.613 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.606+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~O189HQSRDAQ7.0 size=1048576 2024-03-04T12:26:49.613 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.607+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~O189HQSRDAQ7.1 size=1048576 2024-03-04T12:26:49.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.608+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~O189HQSRDAQ7.2 size=146232 2024-03-04T12:26:49.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.608+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=O189HQSRDAQ7 tag=KJR7J1HJJCQC type=write size=3291960 2024-03-04T12:26:49.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.609+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~KM2JF3BW2JBH.0 size=1048576 2024-03-04T12:26:49.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.610+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~KM2JF3BW2JBH.1 size=1048576 2024-03-04T12:26:49.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.611+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~KM2JF3BW2JBH.2 size=106609 2024-03-04T12:26:49.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.612+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=KM2JF3BW2JBH tag=8J6ZJR5ULUKE type=write size=3252337 2024-03-04T12:26:49.621 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.615+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~TCLFOG53ATWR.0 size=1048576 2024-03-04T12:26:49.622 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.616+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~TCLFOG53ATWR.1 size=173956 2024-03-04T12:26:49.622 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.616+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=TCLFOG53ATWR tag=FJBNSVAWBPDK type=write size=2271108 2024-03-04T12:26:49.623 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.617+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=DAVPM7VDZVWL type=del 2024-03-04T12:26:49.625 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.618+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=YMG1PTLP8R8M type=del size=1188567 2024-03-04T12:26:49.626 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.619+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~54G5F4DH27HU.0 size=375250 2024-03-04T12:26:49.628 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.621+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=54G5F4DH27HU tag=RFH60LB2FR26 type=write size=1423826 2024-03-04T12:26:49.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.622+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=Y5CTV1EYPAT3 type=del size=1818303 2024-03-04T12:26:49.630 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.624+0000 7fa4b3c3e780 1 < completed delete operation key=GMIPCGYZRJ5L tag=5R1HNHAGK5CQ type=del 2024-03-04T12:26:49.632 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.626+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~9RB4Y8A9JMBD.0 size=1048576 2024-03-04T12:26:49.634 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.627+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~9RB4Y8A9JMBD.1 size=36015 2024-03-04T12:26:49.634 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.627+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=9RB4Y8A9JMBD tag=A8AOBG31OESY type=write size=2133167 2024-03-04T12:26:49.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.629+0000 7fa4b3c3e780 1 < suggested update operation key=GMIPCGYZRJ5L tag=A56RQ0123KP9 type=del size=2806960 2024-03-04T12:26:49.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.631+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~LDL45S82DTEI.0 size=8183 2024-03-04T12:26:49.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.631+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=LDL45S82DTEI tag=V7SS463N4C3O type=write size=1056759 2024-03-04T12:26:49.640 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.634+0000 7fa4b3c3e780 1 < suggested remove operation key=R1DOKJPZRT5Q tag=PXK9HYVFPE3Y type=del 2024-03-04T12:26:49.642 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.635+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=IG2TPMOM8PPD type=del size=456798 2024-03-04T12:26:49.643 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.636+0000 7fa4b3c3e780 1 < completed delete operation key=X0RVLNRWUAEM tag=6UI1A57HR5CT type=del 2024-03-04T12:26:49.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.638+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~RXLZYMECT2WE.0 size=1048576 2024-03-04T12:26:49.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.639+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~RXLZYMECT2WE.1 size=28517 2024-03-04T12:26:49.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.639+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=RXLZYMECT2WE tag=WB6YC0KT3OZP type=write size=2125669 2024-03-04T12:26:49.647 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.640+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~UH5MZOSIDAG2.0 size=1048576 2024-03-04T12:26:49.648 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.641+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~UH5MZOSIDAG2.1 size=696229 2024-03-04T12:26:49.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.643+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=UH5MZOSIDAG2 tag=FA33OZJLV3OM type=write size=2793381 2024-03-04T12:26:49.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.644+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=B3G0V3I9OPN3 type=del size=212654 2024-03-04T12:26:49.652 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.645+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=9DMMZRSXHVKU type=del 2024-03-04T12:26:49.653 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.646+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=RANVN3WL7EUI type=del size=2128582 2024-03-04T12:26:49.654 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.648+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=D7WXL17Z3KR2 type=del 2024-03-04T12:26:49.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.649+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=A2E4WGEW84DB type=write size=539116 2024-03-04T12:26:49.657 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.650+0000 7fa4b3c3e780 1 < canceled operation key=NVMIU38VM9Q1 tag=1XQEKPRECFHL type=del size=2038488 2024-03-04T12:26:49.659 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.652+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~KDGYTTUH2SPB.0 size=1048576 2024-03-04T12:26:49.659 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.653+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~KDGYTTUH2SPB.1 size=1048576 2024-03-04T12:26:49.660 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.654+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~KDGYTTUH2SPB.2 size=84394 2024-03-04T12:26:49.660 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.654+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=KDGYTTUH2SPB tag=O47KVXCLEU1I type=write size=3230122 2024-03-04T12:26:49.663 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.656+0000 7fa4b3c3e780 1 < suggested update operation key=T301TK0FIOG4 tag=86F3GPHER1YE type=del size=3254810 2024-03-04T12:26:49.664 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.657+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=6L0WIYSICUML type=del size=710946 2024-03-04T12:26:49.666 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.659+0000 7fa4b3c3e780 1 < suggested remove operation key=6XK4DQ940Z5J tag=0TKZZGAJGA8C type=del 2024-03-04T12:26:49.668 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.662+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~1864HNAJVDLG.0 size=1048576 2024-03-04T12:26:49.669 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.662+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~1864HNAJVDLG.1 size=1048576 2024-03-04T12:26:49.670 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.663+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~1864HNAJVDLG.2 size=1030643 2024-03-04T12:26:49.670 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.663+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=1864HNAJVDLG tag=QMN6MMR9K3JK type=write size=4176371 2024-03-04T12:26:49.671 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.665+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~XF7ZPUPWLMGW.0 size=29805 2024-03-04T12:26:49.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.666+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=XF7ZPUPWLMGW tag=F2YE00CV7A43 type=write size=1078381 2024-03-04T12:26:49.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.667+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=L6CC2FY0QLC0 type=del size=2289958 2024-03-04T12:26:49.676 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.670+0000 7fa4b3c3e780 1 < suggested update operation key=YIS2SV4O5EZN tag=42903QO8HXQJ type=del size=3478731 2024-03-04T12:26:49.677 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.671+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=UAKMRS2GV4II type=del size=486731 2024-03-04T12:26:49.678 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.672+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~O189HQSRDAQ7.0 size=1048576 2024-03-04T12:26:49.679 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.673+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~O189HQSRDAQ7.1 size=1048576 2024-03-04T12:26:49.680 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.673+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~O189HQSRDAQ7.2 size=146232 2024-03-04T12:26:49.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.675+0000 7fa4b3c3e780 1 < completed multipart upload key=43HMF7NWNMU3 upload=O189HQSRDAQ7 tag=KJR7J1HJJCQC type=write size=3291960 2024-03-04T12:26:49.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.677+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~WUBTCK4UDUEL.0 size=1048576 2024-03-04T12:26:49.685 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.678+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~WUBTCK4UDUEL.1 size=1048576 2024-03-04T12:26:49.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.679+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~WUBTCK4UDUEL.2 size=969432 2024-03-04T12:26:49.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.679+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=WUBTCK4UDUEL tag=D995JC6CZHB3 type=write size=4115160 2024-03-04T12:26:49.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.680+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~TCLFOG53ATWR.0 size=1048576 2024-03-04T12:26:49.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.680+0000 7fa4b3c3e780 1 < canceled part key=_multipart_UZRX3W3DE5VX.2~TCLFOG53ATWR.1 size=173956 2024-03-04T12:26:49.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.682+0000 7fa4b3c3e780 1 < canceled multipart upload key=UZRX3W3DE5VX upload=TCLFOG53ATWR tag=FJBNSVAWBPDK type=write size=2271108 2024-03-04T12:26:49.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.683+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=3SPW70HFK2S9 type=del size=3970997 2024-03-04T12:26:49.693 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.686+0000 7fa4b3c3e780 1 < suggested update operation key=RHU0QO8HS5SC tag=YMG1PTLP8R8M type=del size=1188567 2024-03-04T12:26:49.695 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.688+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~KM4DSQ5H6VT3.0 size=1048576 2024-03-04T12:26:49.696 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.689+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~KM4DSQ5H6VT3.1 size=1048576 2024-03-04T12:26:49.697 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.690+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~KM4DSQ5H6VT3.2 size=242608 2024-03-04T12:26:49.697 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.690+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=KM4DSQ5H6VT3 tag=TTTM7D0CW9D5 type=write size=3388336 2024-03-04T12:26:49.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.691+0000 7fa4b3c3e780 1 < completed delete operation key=YWJV4QMY6ZBI tag=Y5CTV1EYPAT3 type=del 2024-03-04T12:26:49.699 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.692+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=ZDIVSREX3WAL type=del size=4055792 2024-03-04T12:26:49.700 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.694+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~9RB4Y8A9JMBD.0 size=1048576 2024-03-04T12:26:49.701 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.695+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~9RB4Y8A9JMBD.1 size=36015 2024-03-04T12:26:49.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.697+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=9RB4Y8A9JMBD tag=A8AOBG31OESY type=write size=2133167 2024-03-04T12:26:49.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.699+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~6P01WF11L45R.0 size=1048576 2024-03-04T12:26:49.706 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.700+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~6P01WF11L45R.1 size=30560 2024-03-04T12:26:49.706 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.700+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=6P01WF11L45R tag=V04JR1RH8F8N type=write size=2127712 2024-03-04T12:26:49.708 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.701+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~LDL45S82DTEI.0 size=8183 2024-03-04T12:26:49.709 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.703+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=LDL45S82DTEI tag=V7SS463N4C3O type=write size=1056759 2024-03-04T12:26:49.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.704+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=L5CEK558SBJU type=del size=1806341 2024-03-04T12:26:49.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.706+0000 7fa4b3c3e780 1 < canceled operation key=3TDMQXKLPX34 tag=IG2TPMOM8PPD type=del size=456798 2024-03-04T12:26:49.715 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.708+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=209RR63SV863 type=del size=901574 2024-03-04T12:26:49.716 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.709+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~RXLZYMECT2WE.0 size=1048576 2024-03-04T12:26:49.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.710+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~RXLZYMECT2WE.1 size=28517 2024-03-04T12:26:49.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.712+0000 7fa4b3c3e780 1 < completed multipart upload key=YIS2SV4O5EZN upload=RXLZYMECT2WE tag=WB6YC0KT3OZP type=write size=2125669 2024-03-04T12:26:49.720 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.713+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=XB7YVQZLM46G type=del size=3626421 2024-03-04T12:26:49.721 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.714+0000 7fa4b3c3e780 1 < canceled operation key=V7N7MZ1GUNEV tag=B3G0V3I9OPN3 type=del size=212654 2024-03-04T12:26:49.722 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.715+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=C9NIYYW0EEQQ type=del size=2263380 2024-03-04T12:26:49.723 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.716+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=RANVN3WL7EUI type=del 2024-03-04T12:26:49.724 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.717+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=LUPWU6U6604T type=write size=830017 2024-03-04T12:26:49.725 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.718+0000 7fa4b3c3e780 1 < completed write operation key=VAIY4J3CYONH tag=A2E4WGEW84DB type=write size=539116 2024-03-04T12:26:49.726 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.720+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=ELH5DHOPXFQG type=del size=3224705 2024-03-04T12:26:49.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.721+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~KDGYTTUH2SPB.0 size=1048576 2024-03-04T12:26:49.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.721+0000 7fa4b3c3e780 1 < canceled part key=_multipart_DHLTVH2AZBLR.2~KDGYTTUH2SPB.1 size=1048576 2024-03-04T12:26:49.729 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.722+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~KDGYTTUH2SPB.2 size=84394 2024-03-04T12:26:49.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.724+0000 7fa4b3c3e780 1 < canceled multipart upload key=DHLTVH2AZBLR upload=KDGYTTUH2SPB tag=O47KVXCLEU1I type=write size=3230122 2024-03-04T12:26:49.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.726+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~24E95765MHC8.0 size=1048576 2024-03-04T12:26:49.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.727+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~24E95765MHC8.1 size=734661 2024-03-04T12:26:49.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.727+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=24E95765MHC8 tag=A5X6DRLXRX2X type=write size=2831813 2024-03-04T12:26:49.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.730+0000 7fa4b3c3e780 1 < suggested update operation key=YWJV4QMY6ZBI tag=6L0WIYSICUML type=del size=710946 2024-03-04T12:26:49.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.731+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=M1CXA83LAK1T type=del size=2785281 2024-03-04T12:26:49.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.732+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~1864HNAJVDLG.0 size=1048576 2024-03-04T12:26:49.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.733+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~1864HNAJVDLG.1 size=1048576 2024-03-04T12:26:49.741 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.734+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~1864HNAJVDLG.2 size=1030643 2024-03-04T12:26:49.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.736+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=1864HNAJVDLG tag=QMN6MMR9K3JK type=write size=4176371 2024-03-04T12:26:49.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.737+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=N8QOEXR81CVV type=write size=461585 2024-03-04T12:26:49.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.738+0000 7fa4b3c3e780 1 < canceled operation key=43HMF7NWNMU3 tag=L6CC2FY0QLC0 type=del size=2289958 2024-03-04T12:26:49.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.739+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=8C9NN1J5CBV4 type=write size=882332 2024-03-04T12:26:49.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.740+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=UAKMRS2GV4II type=del 2024-03-04T12:26:49.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.741+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=7IUM5X5794OB type=del size=1139369 2024-03-04T12:26:49.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.743+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~WUBTCK4UDUEL.0 size=1048576 2024-03-04T12:26:49.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.744+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~WUBTCK4UDUEL.1 size=1048576 2024-03-04T12:26:49.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.744+0000 7fa4b3c3e780 1 < canceled part key=_multipart_UZRX3W3DE5VX.2~WUBTCK4UDUEL.2 size=969432 2024-03-04T12:26:49.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.745+0000 7fa4b3c3e780 1 < canceled multipart upload key=UZRX3W3DE5VX upload=WUBTCK4UDUEL tag=D995JC6CZHB3 type=write size=4115160 2024-03-04T12:26:49.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.747+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~Y4NYT5SL0ZEM.0 size=1048576 2024-03-04T12:26:49.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.748+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~Y4NYT5SL0ZEM.1 size=799988 2024-03-04T12:26:49.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.748+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=Y4NYT5SL0ZEM tag=AMD02M91MTZM type=write size=2897140 2024-03-04T12:26:49.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.749+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=3SPW70HFK2S9 type=del 2024-03-04T12:26:49.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.750+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=YDCK5W3374V0 type=del size=1662700 2024-03-04T12:26:49.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.751+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~KM4DSQ5H6VT3.0 size=1048576 2024-03-04T12:26:49.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.751+0000 7fa4b3c3e780 1 < canceled part key=_multipart_GMIPCGYZRJ5L.2~KM4DSQ5H6VT3.1 size=1048576 2024-03-04T12:26:49.759 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.752+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~KM4DSQ5H6VT3.2 size=242608 2024-03-04T12:26:49.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.754+0000 7fa4b3c3e780 1 < canceled multipart upload key=GMIPCGYZRJ5L upload=KM4DSQ5H6VT3 tag=TTTM7D0CW9D5 type=write size=3388336 2024-03-04T12:26:49.762 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.755+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=H6R5325NN2DM type=write size=631153 2024-03-04T12:26:49.764 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.757+0000 7fa4b3c3e780 1 < suggested update operation key=J53J0N99N30A tag=ZDIVSREX3WAL type=del size=4055792 2024-03-04T12:26:49.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.759+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~I1JBRFQ39BBG.0 size=1048576 2024-03-04T12:26:49.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.760+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~I1JBRFQ39BBG.1 size=1048576 2024-03-04T12:26:49.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.761+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~I1JBRFQ39BBG.2 size=755177 2024-03-04T12:26:49.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.761+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=I1JBRFQ39BBG tag=6LUWQKBA72LD type=write size=3900905 2024-03-04T12:26:49.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.762+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~6P01WF11L45R.0 size=1048576 2024-03-04T12:26:49.770 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.763+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~6P01WF11L45R.1 size=30560 2024-03-04T12:26:49.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.765+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=6P01WF11L45R tag=V04JR1RH8F8N type=write size=2127712 2024-03-04T12:26:49.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.767+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=42PBPMWH8QKP type=del size=3053013 2024-03-04T12:26:49.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.768+0000 7fa4b3c3e780 1 < completed delete operation key=GMIPCGYZRJ5L tag=L5CEK558SBJU type=del 2024-03-04T12:26:49.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.769+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=S5HTH2FPLW51 type=del size=989638 2024-03-04T12:26:49.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.770+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=209RR63SV863 type=del 2024-03-04T12:26:49.780 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.771+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=7DJHQZQCNKW2 type=del size=2662498 2024-03-04T12:26:49.780 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.773+0000 7fa4b3c3e780 1 < canceled operation key=6XK4DQ940Z5J tag=XB7YVQZLM46G type=del size=3626421 2024-03-04T12:26:49.780 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.774+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=NCX886Z6H0RT type=write size=314395 2024-03-04T12:26:49.782 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.775+0000 7fa4b3c3e780 1 < completed delete operation key=R1DOKJPZRT5Q tag=C9NIYYW0EEQQ type=del 2024-03-04T12:26:49.784 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.777+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~IM5LQVMDHKJK.0 size=1048576 2024-03-04T12:26:49.785 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.778+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~IM5LQVMDHKJK.1 size=390550 2024-03-04T12:26:49.785 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.778+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=IM5LQVMDHKJK tag=WGH1HJC24R10 type=write size=2487702 2024-03-04T12:26:49.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.779+0000 7fa4b3c3e780 1 < canceled operation key=4LKTYP07OL5L tag=LUPWU6U6604T type=write size=830017 2024-03-04T12:26:49.787 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.781+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=B4VPKQ3MPB1F type=del size=2135549 2024-03-04T12:26:49.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.782+0000 7fa4b3c3e780 -1 < failed to complete operation key=YWJV4QMY6ZBI tag=ELH5DHOPXFQG type=del size=3224705: (22) Invalid argument 2024-03-04T12:26:49.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.783+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=R2LNEN5YCDV0 type=del size=1088711 2024-03-04T12:26:49.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.783+0000 7fa4b3c3e780 1 < canceled part key=_multipart_VAIY4J3CYONH.2~24E95765MHC8.0 size=1048576 2024-03-04T12:26:49.791 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.784+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~24E95765MHC8.1 size=734661 2024-03-04T12:26:49.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.786+0000 7fa4b3c3e780 1 < canceled multipart upload key=VAIY4J3CYONH upload=24E95765MHC8 tag=A5X6DRLXRX2X type=write size=2831813 2024-03-04T12:26:49.794 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.787+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=BXR1128WMTUV type=write size=563024 2024-03-04T12:26:49.795 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.789+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=M1CXA83LAK1T type=del 2024-03-04T12:26:49.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.790+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=1PZDFWZRG92U type=write size=354358 2024-03-04T12:26:49.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.792+0000 7fa4b3c3e780 1 < suggested update operation key=T301TK0FIOG4 tag=N8QOEXR81CVV type=write size=461585 2024-03-04T12:26:49.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.793+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=GJ5EA78NVEHT type=del size=1095020 2024-03-04T12:26:49.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.795+0000 7fa4b3c3e780 1 < suggested remove operation key=R1DOKJPZRT5Q tag=8C9NN1J5CBV4 type=write 2024-03-04T12:26:49.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.796+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=IJRIC4PQ37OF type=del size=145739 2024-03-04T12:26:49.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.798+0000 7fa4b3c3e780 1 < completed delete operation key=UZRX3W3DE5VX tag=7IUM5X5794OB type=del 2024-03-04T12:26:49.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.799+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~ZE0H5W7VTZFM.0 size=1048576 2024-03-04T12:26:49.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.800+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~ZE0H5W7VTZFM.1 size=503658 2024-03-04T12:26:49.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.800+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=ZE0H5W7VTZFM tag=Y32GA7SN0L65 type=write size=2600810 2024-03-04T12:26:49.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.802+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~Y4NYT5SL0ZEM.0 size=1048576 2024-03-04T12:26:49.809 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.803+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~Y4NYT5SL0ZEM.1 size=799988 2024-03-04T12:26:49.811 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.804+0000 7fa4b3c3e780 1 < completed multipart upload key=3N6E09QF3866 upload=Y4NYT5SL0ZEM tag=AMD02M91MTZM type=write size=2897140 2024-03-04T12:26:49.812 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.806+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=1BBOUI3DD934 type=write size=75807 2024-03-04T12:26:49.815 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.808+0000 7fa4b3c3e780 1 < suggested update operation key=7IUV88NQLPN8 tag=YDCK5W3374V0 type=del size=1662700 2024-03-04T12:26:49.816 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.809+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=ON91R6KS4KI8 type=del size=1622489 2024-03-04T12:26:49.817 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.810+0000 7fa4b3c3e780 1 < completed write operation key=WRHB3XWDLSY2 tag=H6R5325NN2DM type=write size=631153 2024-03-04T12:26:49.818 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.811+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=5934UK8DRPLR type=del size=3676726 2024-03-04T12:26:49.819 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.813+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~I1JBRFQ39BBG.0 size=1048576 2024-03-04T12:26:49.820 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.814+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~I1JBRFQ39BBG.1 size=1048576 2024-03-04T12:26:49.820 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.814+0000 7fa4b3c3e780 1 < canceled part key=_multipart_BR8RTE2QEH9E.2~I1JBRFQ39BBG.2 size=755177 2024-03-04T12:26:49.823 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.817+0000 7fa4b3c3e780 1 < canceled multipart upload key=BR8RTE2QEH9E upload=I1JBRFQ39BBG tag=6LUWQKBA72LD type=write size=3900905 2024-03-04T12:26:49.825 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.819+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~73D2542LEA47.0 size=1048576 2024-03-04T12:26:49.826 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.819+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~73D2542LEA47.1 size=1041992 2024-03-04T12:26:49.826 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.820+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=73D2542LEA47 tag=5T0L15AVGH37 type=write size=3139144 2024-03-04T12:26:49.828 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.822+0000 7fa4b3c3e780 1 < suggested remove operation key=KKQT9J9GSW0N tag=42PBPMWH8QKP type=del 2024-03-04T12:26:49.829 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.823+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=EPO5OMC1LHQX type=del size=263336 2024-03-04T12:26:49.832 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.825+0000 7fa4b3c3e780 1 < suggested update operation key=YQLH0WW7I7MW tag=S5HTH2FPLW51 type=del size=989638 2024-03-04T12:26:49.834 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.827+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~UCCHVWGS4Z99.0 size=343329 2024-03-04T12:26:49.834 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.827+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=UCCHVWGS4Z99 tag=T7A14XF2RWWZ type=write size=1391905 2024-03-04T12:26:49.835 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.828+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=7DJHQZQCNKW2 type=del 2024-03-04T12:26:49.836 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.829+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=1G92DOJ3JCQC type=write size=161538 2024-03-04T12:26:49.837 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.830+0000 7fa4b3c3e780 -1 < failed to complete operation key=KKQT9J9GSW0N tag=NCX886Z6H0RT type=write size=314395: (22) Invalid argument 2024-03-04T12:26:49.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.831+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=L9HMD1AC2UBL type=del size=2615994 2024-03-04T12:26:49.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.832+0000 7fa4b3c3e780 1 < canceled part key=_multipart_RHU0QO8HS5SC.2~IM5LQVMDHKJK.0 size=1048576 2024-03-04T12:26:49.839 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.833+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~IM5LQVMDHKJK.1 size=390550 2024-03-04T12:26:49.841 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.835+0000 7fa4b3c3e780 1 < canceled multipart upload key=RHU0QO8HS5SC upload=IM5LQVMDHKJK tag=WGH1HJC24R10 type=write size=2487702 2024-03-04T12:26:49.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.837+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~BZDWOPRRP1ZN.0 size=832833 2024-03-04T12:26:49.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.837+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=BZDWOPRRP1ZN tag=HBR97L7JO3KP type=write size=1881409 2024-03-04T12:26:49.847 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.840+0000 7fa4b3c3e780 1 < suggested remove operation key=RHU0QO8HS5SC tag=B4VPKQ3MPB1F type=del 2024-03-04T12:26:49.848 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.841+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=YV9G7QJFCMHZ type=del size=2985837 2024-03-04T12:26:49.850 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.844+0000 7fa4b3c3e780 1 < suggested update operation key=WRHB3XWDLSY2 tag=R2LNEN5YCDV0 type=del size=1088711 2024-03-04T12:26:49.853 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.846+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~HWNRTWA9N4HI.0 size=1048576 2024-03-04T12:26:49.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.847+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~HWNRTWA9N4HI.1 size=807479 2024-03-04T12:26:49.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.847+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=HWNRTWA9N4HI tag=13W831IO4JCF type=write size=2904631 2024-03-04T12:26:49.855 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.848+0000 7fa4b3c3e780 1 < completed write operation key=43HMF7NWNMU3 tag=BXR1128WMTUV type=write size=563024 2024-03-04T12:26:49.857 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.851+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~X32TDS2233EH.0 size=1048576 2024-03-04T12:26:49.858 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.851+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~X32TDS2233EH.1 size=1048576 2024-03-04T12:26:49.859 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.853+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~X32TDS2233EH.2 size=279318 2024-03-04T12:26:49.859 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.853+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=X32TDS2233EH tag=Z3X8IWQEOWV4 type=write size=3425046 2024-03-04T12:26:49.860 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.854+0000 7fa4b3c3e780 1 < completed write operation key=G8G76PMSKJ0I tag=1PZDFWZRG92U type=write size=354358 2024-03-04T12:26:49.862 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.855+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=DVGSCS1ECL79 type=del size=1545695 2024-03-04T12:26:49.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.856+0000 7fa4b3c3e780 1 < completed delete operation key=GMIPCGYZRJ5L tag=GJ5EA78NVEHT type=del 2024-03-04T12:26:49.865 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.858+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~462M0EICJUB9.0 size=56520 2024-03-04T12:26:49.865 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.858+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=462M0EICJUB9 tag=9306QBVXWPD0 type=write size=1105096 2024-03-04T12:26:49.867 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.860+0000 7fa4b3c3e780 -1 < failed to complete operation key=WRHB3XWDLSY2 tag=IJRIC4PQ37OF type=del size=145739: (22) Invalid argument 2024-03-04T12:26:49.868 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.861+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=FBOR1Q63AI2R type=del size=1007855 2024-03-04T12:26:49.869 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.862+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~ZE0H5W7VTZFM.0 size=1048576 2024-03-04T12:26:49.870 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.863+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~ZE0H5W7VTZFM.1 size=503658 2024-03-04T12:26:49.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.865+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=ZE0H5W7VTZFM tag=Y32GA7SN0L65 type=write size=2600810 2024-03-04T12:26:49.874 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.868+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~4UBBT4DMFS0K.0 size=1048576 2024-03-04T12:26:49.875 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.868+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~4UBBT4DMFS0K.1 size=376487 2024-03-04T12:26:49.875 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.868+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=4UBBT4DMFS0K tag=RI8S7PR9Q5ZK type=write size=2473639 2024-03-04T12:26:49.877 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.870+0000 7fa4b3c3e780 1 < completed write operation key=YIS2SV4O5EZN tag=1BBOUI3DD934 type=write size=75807 2024-03-04T12:26:49.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.871+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=UG4OPI4Y6GEM type=write size=585326 2024-03-04T12:26:49.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.872+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=ON91R6KS4KI8 type=del 2024-03-04T12:26:49.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.875+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~B3YCOZGP1V9Y.0 size=1048576 2024-03-04T12:26:49.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.876+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~B3YCOZGP1V9Y.1 size=70226 2024-03-04T12:26:49.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.876+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=B3YCOZGP1V9Y tag=MT30F8G71QZ7 type=write size=2167378 2024-03-04T12:26:49.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.877+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=5934UK8DRPLR type=del 2024-03-04T12:26:49.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.878+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=9UGZFPUICFHS type=del size=1956912 2024-03-04T12:26:49.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.880+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~73D2542LEA47.0 size=1048576 2024-03-04T12:26:49.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.880+0000 7fa4b3c3e780 1 < canceled part key=_multipart_R1DOKJPZRT5Q.2~73D2542LEA47.1 size=1041992 2024-03-04T12:26:49.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.881+0000 7fa4b3c3e780 1 < canceled multipart upload key=R1DOKJPZRT5Q upload=73D2542LEA47 tag=5T0L15AVGH37 type=write size=3139144 2024-03-04T12:26:49.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.883+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=8XN6BXCDP9K7 type=del size=1218334 2024-03-04T12:26:49.891 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.884+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=EPO5OMC1LHQX type=del 2024-03-04T12:26:49.892 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.885+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=14FTVNHLKBVG type=del size=3767185 2024-03-04T12:26:49.892 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.885+0000 7fa4b3c3e780 1 < canceled part key=_multipart_RHU0QO8HS5SC.2~UCCHVWGS4Z99.0 size=343329 2024-03-04T12:26:49.894 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.887+0000 7fa4b3c3e780 1 < canceled multipart upload key=RHU0QO8HS5SC upload=UCCHVWGS4Z99 tag=T7A14XF2RWWZ type=write size=1391905 2024-03-04T12:26:49.896 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.890+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~H426RKXP10J7.0 size=1048576 2024-03-04T12:26:49.897 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.891+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~H426RKXP10J7.1 size=1048576 2024-03-04T12:26:49.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.892+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~H426RKXP10J7.2 size=336832 2024-03-04T12:26:49.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.892+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=H426RKXP10J7 tag=JHV0YENO6G8L type=write size=3482560 2024-03-04T12:26:49.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.893+0000 7fa4b3c3e780 1 < completed write operation key=G70BJ2UARNCP tag=1G92DOJ3JCQC type=write size=161538 2024-03-04T12:26:49.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.894+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=L8BLRGZNSXI7 type=del size=4071897 2024-03-04T12:26:49.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.895+0000 7fa4b3c3e780 1 < completed delete operation key=R6Y09EO6HGF0 tag=L9HMD1AC2UBL type=del 2024-03-04T12:26:49.904 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.897+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~VNEMAQW9KEFV.0 size=940266 2024-03-04T12:26:49.904 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.897+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=VNEMAQW9KEFV tag=OXI1CE0GJUXT type=write size=1988842 2024-03-04T12:26:49.905 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.898+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~BZDWOPRRP1ZN.0 size=832833 2024-03-04T12:26:49.907 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.901+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=BZDWOPRRP1ZN tag=HBR97L7JO3KP type=write size=1881409 2024-03-04T12:26:49.910 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.903+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~LT3YNJZV52HX.0 size=1048576 2024-03-04T12:26:49.910 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.904+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~LT3YNJZV52HX.1 size=648306 2024-03-04T12:26:49.911 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.904+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=LT3YNJZV52HX tag=R7NT150DLOJ3 type=write size=2745458 2024-03-04T12:26:49.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.905+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=YV9G7QJFCMHZ type=del 2024-03-04T12:26:49.913 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.906+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=Y0NW5F0TCZ3I type=write size=869120 2024-03-04T12:26:49.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.908+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~HWNRTWA9N4HI.0 size=1048576 2024-03-04T12:26:49.915 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.909+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~HWNRTWA9N4HI.1 size=807479 2024-03-04T12:26:49.917 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.911+0000 7fa4b3c3e780 1 < completed multipart upload key=43HMF7NWNMU3 upload=HWNRTWA9N4HI tag=13W831IO4JCF type=write size=2904631 2024-03-04T12:26:49.919 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.912+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=AZS2EFEO6H50 type=del size=3310677 2024-03-04T12:26:49.920 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.913+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~X32TDS2233EH.0 size=1048576 2024-03-04T12:26:49.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.914+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~X32TDS2233EH.1 size=1048576 2024-03-04T12:26:49.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.914+0000 7fa4b3c3e780 1 < canceled part key=_multipart_GMIPCGYZRJ5L.2~X32TDS2233EH.2 size=279318 2024-03-04T12:26:49.923 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.916+0000 7fa4b3c3e780 1 < canceled multipart upload key=GMIPCGYZRJ5L upload=X32TDS2233EH tag=Z3X8IWQEOWV4 type=write size=3425046 2024-03-04T12:26:49.925 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.918+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~EAN3ZGJ72TMQ.0 size=1048576 2024-03-04T12:26:49.926 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.919+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~EAN3ZGJ72TMQ.1 size=1048576 2024-03-04T12:26:49.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.920+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~EAN3ZGJ72TMQ.2 size=141196 2024-03-04T12:26:49.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.920+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=EAN3ZGJ72TMQ tag=9RPCKHILJCF9 type=write size=3286924 2024-03-04T12:26:49.928 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.921+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=DVGSCS1ECL79 type=del 2024-03-04T12:26:49.929 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.922+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=O3TVP14OYOD5 type=write size=70432 2024-03-04T12:26:49.930 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.923+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~462M0EICJUB9.0 size=56520 2024-03-04T12:26:49.932 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.925+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=462M0EICJUB9 tag=9306QBVXWPD0 type=write size=1105096 2024-03-04T12:26:49.933 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.926+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=BPX74RB2LSMP type=del size=3894045 2024-03-04T12:26:49.935 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.928+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=FBOR1Q63AI2R type=del 2024-03-04T12:26:49.936 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.930+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=7Z80ZL7P917O type=write size=167223 2024-03-04T12:26:49.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.931+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~4UBBT4DMFS0K.0 size=1048576 2024-03-04T12:26:49.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.932+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~4UBBT4DMFS0K.1 size=376487 2024-03-04T12:26:49.940 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.934+0000 7fa4b3c3e780 1 < completed multipart upload key=H5FWRNK8F7QT upload=4UBBT4DMFS0K tag=RI8S7PR9Q5ZK type=write size=2473639 2024-03-04T12:26:49.942 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.936+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~NI7RDPE2KPWP.0 size=930973 2024-03-04T12:26:49.943 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.936+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=NI7RDPE2KPWP tag=CMJAFQ5DRZNF type=write size=1979549 2024-03-04T12:26:49.944 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.937+0000 7fa4b3c3e780 1 < completed write operation key=X0RVLNRWUAEM tag=UG4OPI4Y6GEM type=write size=585326 2024-03-04T12:26:49.945 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.938+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=7XAYVTFO7MXD type=del size=3619173 2024-03-04T12:26:49.945 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.938+0000 7fa4b3c3e780 1 < canceled part key=_multipart_ZETES4AYZQHY.2~B3YCOZGP1V9Y.0 size=1048576 2024-03-04T12:26:49.946 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.939+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~B3YCOZGP1V9Y.1 size=70226 2024-03-04T12:26:49.948 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.941+0000 7fa4b3c3e780 1 < canceled multipart upload key=ZETES4AYZQHY upload=B3YCOZGP1V9Y tag=MT30F8G71QZ7 type=write size=2167378 2024-03-04T12:26:49.949 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.942+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=HRQATAQSDT2A type=del size=1082837 2024-03-04T12:26:49.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.943+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=9UGZFPUICFHS type=del 2024-03-04T12:26:49.951 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.944+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=6K96FAWEG6TN type=del size=3753503 2024-03-04T12:26:49.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.947+0000 7fa4b3c3e780 1 < suggested remove operation key=GMIPCGYZRJ5L tag=8XN6BXCDP9K7 type=del 2024-03-04T12:26:49.955 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.949+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~35UKISXASW0W.0 size=1048576 2024-03-04T12:26:49.956 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.950+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~35UKISXASW0W.1 size=1048576 2024-03-04T12:26:49.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.950+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~35UKISXASW0W.2 size=912036 2024-03-04T12:26:49.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.950+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=35UKISXASW0W tag=IJ3XHAMOFBGV type=write size=4057764 2024-03-04T12:26:49.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.953+0000 7fa4b3c3e780 1 < suggested update operation key=X0RVLNRWUAEM tag=14FTVNHLKBVG type=del size=3767185 2024-03-04T12:26:49.961 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.955+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~ZC3232M0EUZ7.0 size=1048576 2024-03-04T12:26:49.962 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.955+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~ZC3232M0EUZ7.1 size=501364 2024-03-04T12:26:49.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.955+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=ZC3232M0EUZ7 tag=IFRE8GVC4IQ3 type=write size=2598516 2024-03-04T12:26:49.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.957+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~H426RKXP10J7.0 size=1048576 2024-03-04T12:26:49.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.958+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~H426RKXP10J7.1 size=1048576 2024-03-04T12:26:49.965 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.958+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~H426RKXP10J7.2 size=336832 2024-03-04T12:26:49.967 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.960+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=H426RKXP10J7 tag=JHV0YENO6G8L type=write size=3482560 2024-03-04T12:26:49.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.962+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~UNOSGX1EJ871.0 size=1048576 2024-03-04T12:26:49.970 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.963+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~UNOSGX1EJ871.1 size=1048576 2024-03-04T12:26:49.971 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.964+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~UNOSGX1EJ871.2 size=260096 2024-03-04T12:26:49.971 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.964+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=UNOSGX1EJ871 tag=XKFRHX0GOI13 type=write size=3405824 2024-03-04T12:26:49.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.965+0000 7fa4b3c3e780 1 < completed delete operation key=G8G76PMSKJ0I tag=L8BLRGZNSXI7 type=del 2024-03-04T12:26:49.974 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.968+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~MVPFDNAT007N.0 size=606215 2024-03-04T12:26:49.974 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.968+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=MVPFDNAT007N tag=RWE78MK1UNII type=write size=1654791 2024-03-04T12:26:49.976 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.969+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~VNEMAQW9KEFV.0 size=940266 2024-03-04T12:26:49.978 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.971+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=VNEMAQW9KEFV tag=OXI1CE0GJUXT type=write size=1988842 2024-03-04T12:26:49.979 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.972+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=8RJVWQSOF265 type=del size=2236784 2024-03-04T12:26:49.980 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.973+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~LT3YNJZV52HX.0 size=1048576 2024-03-04T12:26:49.981 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.974+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~LT3YNJZV52HX.1 size=648306 2024-03-04T12:26:49.983 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.976+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=LT3YNJZV52HX tag=R7NT150DLOJ3 type=write size=2745458 2024-03-04T12:26:49.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.978+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=M5TBLH9XQJ15 type=del size=4088549 2024-03-04T12:26:49.987 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.980+0000 7fa4b3c3e780 1 < suggested remove operation key=RHU0QO8HS5SC tag=Y0NW5F0TCZ3I type=write 2024-03-04T12:26:49.988 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.981+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=BXPPA2KP5W59 type=write size=43766 2024-03-04T12:26:49.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.983+0000 7fa4b3c3e780 1 < canceled operation key=H5FWRNK8F7QT tag=AZS2EFEO6H50 type=del size=3310677 2024-03-04T12:26:49.991 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.984+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=46DUYKXQTTBM type=write size=73647 2024-03-04T12:26:49.992 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.985+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~EAN3ZGJ72TMQ.0 size=1048576 2024-03-04T12:26:49.993 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.986+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~EAN3ZGJ72TMQ.1 size=1048576 2024-03-04T12:26:49.994 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.987+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~EAN3ZGJ72TMQ.2 size=141196 2024-03-04T12:26:49.996 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.989+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=EAN3ZGJ72TMQ tag=9RPCKHILJCF9 type=write size=3286924 2024-03-04T12:26:49.998 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.992+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~C7HSK70G16C7.0 size=1048576 2024-03-04T12:26:49.999 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.993+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~C7HSK70G16C7.1 size=1048576 2024-03-04T12:26:50.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.994+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~C7HSK70G16C7.2 size=722489 2024-03-04T12:26:50.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.994+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=C7HSK70G16C7 tag=IQ6M3WO3Z8HI type=write size=3868217 2024-03-04T12:26:50.002 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.995+0000 7fa4b3c3e780 1 < canceled operation key=V7N7MZ1GUNEV tag=O3TVP14OYOD5 type=write size=70432 2024-03-04T12:26:50.003 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.996+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=P69LXI13KBZU type=del size=3111206 2024-03-04T12:26:50.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.997+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=BPX74RB2LSMP type=del 2024-03-04T12:26:50.006 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.999+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~ZT0TAA6CAV5C.0 size=954335 2024-03-04T12:26:50.006 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:49.999+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=ZT0TAA6CAV5C tag=PAW6XZI7AUZY type=write size=2002911 2024-03-04T12:26:50.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.002+0000 7fa4b3c3e780 1 < suggested update operation key=6XK4DQ940Z5J tag=7Z80ZL7P917O type=write size=167223 2024-03-04T12:26:50.010 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.003+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=MF2D53ES29SS type=del size=3320361 2024-03-04T12:26:50.010 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.003+0000 7fa4b3c3e780 1 < canceled part key=_multipart_KKQT9J9GSW0N.2~NI7RDPE2KPWP.0 size=930973 2024-03-04T12:26:50.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.005+0000 7fa4b3c3e780 1 < canceled multipart upload key=KKQT9J9GSW0N upload=NI7RDPE2KPWP tag=CMJAFQ5DRZNF type=write size=1979549 2024-03-04T12:26:50.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.006+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=R0AN3QLRVSL4 type=del size=2177790 2024-03-04T12:26:50.014 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.008+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=7XAYVTFO7MXD type=del 2024-03-04T12:26:50.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.009+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=CBR59G37NSDW type=del size=2103871 2024-03-04T12:26:50.017 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.010+0000 7fa4b3c3e780 1 < completed delete operation key=G8G76PMSKJ0I tag=HRQATAQSDT2A type=del 2024-03-04T12:26:50.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.011+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=X6TIA1I0L71A type=write size=826767 2024-03-04T12:26:50.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.012+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=6K96FAWEG6TN type=del 2024-03-04T12:26:50.020 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.013+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=0W775CG92T73 type=write size=938291 2024-03-04T12:26:50.021 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.014+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~35UKISXASW0W.0 size=1048576 2024-03-04T12:26:50.022 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.015+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~35UKISXASW0W.1 size=1048576 2024-03-04T12:26:50.023 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.016+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~35UKISXASW0W.2 size=912036 2024-03-04T12:26:50.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.018+0000 7fa4b3c3e780 1 < completed multipart upload key=ESHAMQWMMBJR upload=35UKISXASW0W tag=IJ3XHAMOFBGV type=write size=4057764 2024-03-04T12:26:50.026 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.019+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=ZQ0OF85IH1DL type=write size=504841 2024-03-04T12:26:50.027 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.020+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~ZC3232M0EUZ7.0 size=1048576 2024-03-04T12:26:50.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.021+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~ZC3232M0EUZ7.1 size=501364 2024-03-04T12:26:50.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.023+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=ZC3232M0EUZ7 tag=IFRE8GVC4IQ3 type=write size=2598516 2024-03-04T12:26:50.030 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.024+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=T1PR0SU51WWY type=del size=232461 2024-03-04T12:26:50.032 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.025+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~UNOSGX1EJ871.0 size=1048576 2024-03-04T12:26:50.033 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.026+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~UNOSGX1EJ871.1 size=1048576 2024-03-04T12:26:50.033 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.027+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~UNOSGX1EJ871.2 size=260096 2024-03-04T12:26:50.035 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.028+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=UNOSGX1EJ871 tag=XKFRHX0GOI13 type=write size=3405824 2024-03-04T12:26:50.036 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.030+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=2YUI3A2IU01T type=del size=2283285 2024-03-04T12:26:50.038 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.031+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~MVPFDNAT007N.0 size=606215 2024-03-04T12:26:50.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.033+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=MVPFDNAT007N tag=RWE78MK1UNII type=write size=1654791 2024-03-04T12:26:50.043 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.036+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~SS4GRGJM6PZC.0 size=1048576 2024-03-04T12:26:50.044 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.037+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~SS4GRGJM6PZC.1 size=276090 2024-03-04T12:26:50.044 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.037+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=SS4GRGJM6PZC tag=49DKZMKPEWGM type=write size=2373242 2024-03-04T12:26:50.046 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.039+0000 7fa4b3c3e780 1 < suggested remove operation key=DHLTVH2AZBLR tag=8RJVWQSOF265 type=del 2024-03-04T12:26:50.047 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.040+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=Q7U65F56T70C type=del size=3008430 2024-03-04T12:26:50.048 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.042+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=M5TBLH9XQJ15 type=del 2024-03-04T12:26:50.049 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.043+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=ETVF0SLOQZN4 type=write size=872375 2024-03-04T12:26:50.051 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.044+0000 7fa4b3c3e780 1 < completed write operation key=YWJV4QMY6ZBI tag=BXPPA2KP5W59 type=write size=43766 2024-03-04T12:26:50.052 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.045+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=MG6UJKNWFZOT type=del size=729829 2024-03-04T12:26:50.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.046+0000 7fa4b3c3e780 1 < completed write operation key=YQLH0WW7I7MW tag=46DUYKXQTTBM type=write size=73647 2024-03-04T12:26:50.055 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.048+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~VYKMOTEE6VU0.0 size=1048576 2024-03-04T12:26:50.055 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.049+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~VYKMOTEE6VU0.1 size=1048576 2024-03-04T12:26:50.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.050+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~VYKMOTEE6VU0.2 size=506580 2024-03-04T12:26:50.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.050+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=VYKMOTEE6VU0 tag=7374UEYX4S1F type=write size=3652308 2024-03-04T12:26:50.058 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.051+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~C7HSK70G16C7.0 size=1048576 2024-03-04T12:26:50.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.052+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~C7HSK70G16C7.1 size=1048576 2024-03-04T12:26:50.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.053+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~C7HSK70G16C7.2 size=722489 2024-03-04T12:26:50.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.055+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=C7HSK70G16C7 tag=IQ6M3WO3Z8HI type=write size=3868217 2024-03-04T12:26:50.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.056+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=Q01UIHG280RK type=del size=4192946 2024-03-04T12:26:50.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.057+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=P69LXI13KBZU type=del 2024-03-04T12:26:50.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.058+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=VOQ7A3H78IXT type=del size=2162191 2024-03-04T12:26:50.066 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.059+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~ZT0TAA6CAV5C.0 size=954335 2024-03-04T12:26:50.068 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.061+0000 7fa4b3c3e780 1 < completed multipart upload key=ESHAMQWMMBJR upload=ZT0TAA6CAV5C tag=PAW6XZI7AUZY type=write size=2002911 2024-03-04T12:26:50.070 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.063+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~1QW7BLH7HM36.0 size=1048576 2024-03-04T12:26:50.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.064+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~1QW7BLH7HM36.1 size=1048576 2024-03-04T12:26:50.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.065+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~1QW7BLH7HM36.2 size=418059 2024-03-04T12:26:50.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.065+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=1QW7BLH7HM36 tag=7PHOFX8FTROS type=write size=3563787 2024-03-04T12:26:50.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.066+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=MF2D53ES29SS type=del 2024-03-04T12:26:50.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.067+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=QFT8IVCZTWZW type=del size=640727 2024-03-04T12:26:50.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.068+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=R0AN3QLRVSL4 type=del 2024-03-04T12:26:50.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.069+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=DQA428RXLMBW type=del size=1126660 2024-03-04T12:26:50.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.070+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=CBR59G37NSDW type=del 2024-03-04T12:26:50.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.072+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~N23DAMW3E31C.0 size=905827 2024-03-04T12:26:50.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.072+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=N23DAMW3E31C tag=NZ1U08VJXAU3 type=write size=1954403 2024-03-04T12:26:50.081 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.075+0000 7fa4b3c3e780 1 < suggested update operation key=NVMIU38VM9Q1 tag=X6TIA1I0L71A type=write size=826767 2024-03-04T12:26:50.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.076+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=DQJHZ67GUUXP type=del size=1260614 2024-03-04T12:26:50.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.077+0000 7fa4b3c3e780 1 < completed write operation key=G4SUQFVB936T tag=0W775CG92T73 type=write size=938291 2024-03-04T12:26:50.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.078+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=KDY4G1C3AJAM type=del size=3245449 2024-03-04T12:26:50.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.080+0000 7fa4b3c3e780 1 < completed write operation key=BR8RTE2QEH9E tag=ZQ0OF85IH1DL type=write size=504841 2024-03-04T12:26:50.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.081+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=Z3EM4SLF341O type=del size=2378991 2024-03-04T12:26:50.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.084+0000 7fa4b3c3e780 1 < suggested remove operation key=4989OME3IAJF tag=T1PR0SU51WWY type=del 2024-03-04T12:26:50.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.085+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=BZFPDASBVQUK type=del size=1540977 2024-03-04T12:26:50.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.086+0000 7fa4b3c3e780 -1 < failed to complete operation key=4989OME3IAJF tag=2YUI3A2IU01T type=del size=2283285: (22) Invalid argument 2024-03-04T12:26:50.094 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.088+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~DGL5YM4RWDFX.0 size=494265 2024-03-04T12:26:50.095 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.088+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=DGL5YM4RWDFX tag=ZQP5HDBW87KL type=write size=1542841 2024-03-04T12:26:50.096 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.089+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~SS4GRGJM6PZC.0 size=1048576 2024-03-04T12:26:50.097 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.090+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~SS4GRGJM6PZC.1 size=276090 2024-03-04T12:26:50.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.092+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=SS4GRGJM6PZC tag=49DKZMKPEWGM type=write size=2373242 2024-03-04T12:26:50.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.094+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~D6AQOSYT8JM6.0 size=1048576 2024-03-04T12:26:50.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.095+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~D6AQOSYT8JM6.1 size=1048576 2024-03-04T12:26:50.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.096+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~D6AQOSYT8JM6.2 size=772516 2024-03-04T12:26:50.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.096+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=D6AQOSYT8JM6 tag=KAAUTA6QIZJP type=write size=3918244 2024-03-04T12:26:50.105 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.098+0000 7fa4b3c3e780 1 < suggested update operation key=X0RVLNRWUAEM tag=Q7U65F56T70C type=del size=3008430 2024-03-04T12:26:50.106 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.099+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=CQT0T5YU90MH type=del size=2518278 2024-03-04T12:26:50.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.101+0000 7fa4b3c3e780 1 < suggested remove operation key=BVMWQ9ZL4K0C tag=ETVF0SLOQZN4 type=write 2024-03-04T12:26:50.110 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.103+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~P3CAIXL7LYCE.0 size=1048576 2024-03-04T12:26:50.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.104+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~P3CAIXL7LYCE.1 size=1048576 2024-03-04T12:26:50.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.105+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~P3CAIXL7LYCE.2 size=1041358 2024-03-04T12:26:50.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.105+0000 7fa4b3c3e780 1 > prepared multipart upload key=4LKTYP07OL5L upload=P3CAIXL7LYCE tag=PIV45H62V6QE type=write size=4187086 2024-03-04T12:26:50.113 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.106+0000 7fa4b3c3e780 1 < completed delete operation key=UZRX3W3DE5VX tag=MG6UJKNWFZOT type=del 2024-03-04T12:26:50.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.107+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=HLFLLDXQNH4X type=del size=76142 2024-03-04T12:26:50.115 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.108+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~VYKMOTEE6VU0.0 size=1048576 2024-03-04T12:26:50.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.109+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~VYKMOTEE6VU0.1 size=1048576 2024-03-04T12:26:50.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.110+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~VYKMOTEE6VU0.2 size=506580 2024-03-04T12:26:50.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.112+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=VYKMOTEE6VU0 tag=7374UEYX4S1F type=write size=3652308 2024-03-04T12:26:50.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.114+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~JT5BMJQXBI2S.0 size=1048576 2024-03-04T12:26:50.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.115+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~JT5BMJQXBI2S.1 size=626426 2024-03-04T12:26:50.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.115+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=JT5BMJQXBI2S tag=UL8NEEYZWLHS type=write size=2723578 2024-03-04T12:26:50.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.116+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=Q01UIHG280RK type=del 2024-03-04T12:26:50.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.117+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=GXHGHN2U3P12 type=del size=2019448 2024-03-04T12:26:50.125 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.118+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=VOQ7A3H78IXT type=del 2024-03-04T12:26:50.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.119+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=FLN6PQBSE0JD type=del size=1709216 2024-03-04T12:26:50.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.120+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~1QW7BLH7HM36.0 size=1048576 2024-03-04T12:26:50.128 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.121+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~1QW7BLH7HM36.1 size=1048576 2024-03-04T12:26:50.129 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.122+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~1QW7BLH7HM36.2 size=418059 2024-03-04T12:26:50.131 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.124+0000 7fa4b3c3e780 1 < completed multipart upload key=ESHAMQWMMBJR upload=1QW7BLH7HM36 tag=7PHOFX8FTROS type=write size=3563787 2024-03-04T12:26:50.132 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.125+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=5GPSUD3XDA0V type=del size=800958 2024-03-04T12:26:50.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.127+0000 7fa4b3c3e780 1 < suggested remove operation key=H5FWRNK8F7QT tag=QFT8IVCZTWZW type=del 2024-03-04T12:26:50.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.129+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~3U9G3MO30V7F.0 size=991640 2024-03-04T12:26:50.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.129+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=3U9G3MO30V7F tag=O4F93IPOZTJ5 type=write size=2040216 2024-03-04T12:26:50.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.130+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=DQA428RXLMBW type=del 2024-03-04T12:26:50.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.132+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=PTMLXWM6OR5M type=del size=2177959 2024-03-04T12:26:50.139 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.133+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~N23DAMW3E31C.0 size=905827 2024-03-04T12:26:50.141 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.135+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=N23DAMW3E31C tag=NZ1U08VJXAU3 type=write size=1954403 2024-03-04T12:26:50.143 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.136+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=1DE5R4CPTPXE type=write size=538722 2024-03-04T12:26:50.144 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.137+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=DQJHZ67GUUXP type=del 2024-03-04T12:26:50.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.138+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=EQ07TFD0VE49 type=del size=2592283 2024-03-04T12:26:50.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.141+0000 7fa4b3c3e780 1 < suggested remove operation key=3N6E09QF3866 tag=KDY4G1C3AJAM type=del 2024-03-04T12:26:50.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.143+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=RWYGT8BZHI9M type=del size=965266 2024-03-04T12:26:50.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.144+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=Z3EM4SLF341O type=del 2024-03-04T12:26:50.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.146+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=LHYXY9KPNAOK type=del size=2540248 2024-03-04T12:26:50.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.148+0000 7fa4b3c3e780 1 < suggested update operation key=VAIY4J3CYONH tag=BZFPDASBVQUK type=del size=1540977 2024-03-04T12:26:50.157 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.150+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~ETDIQTVDK3YR.0 size=1048576 2024-03-04T12:26:50.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.151+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~ETDIQTVDK3YR.1 size=5597 2024-03-04T12:26:50.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.151+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=ETDIQTVDK3YR tag=Q2DMFHQVVR4P type=write size=2102749 2024-03-04T12:26:50.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.152+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~DGL5YM4RWDFX.0 size=494265 2024-03-04T12:26:50.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.154+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=DGL5YM4RWDFX tag=ZQP5HDBW87KL type=write size=1542841 2024-03-04T12:26:50.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.155+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=205F2X5XI7NT type=del size=3701385 2024-03-04T12:26:50.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.156+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~D6AQOSYT8JM6.0 size=1048576 2024-03-04T12:26:50.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.157+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~D6AQOSYT8JM6.1 size=1048576 2024-03-04T12:26:50.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.158+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~D6AQOSYT8JM6.2 size=772516 2024-03-04T12:26:50.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.160+0000 7fa4b3c3e780 1 < completed multipart upload key=H5FWRNK8F7QT upload=D6AQOSYT8JM6 tag=KAAUTA6QIZJP type=write size=3918244 2024-03-04T12:26:50.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.161+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=IIURL0TXQPY2 type=del size=970054 2024-03-04T12:26:50.169 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.162+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=CQT0T5YU90MH type=del 2024-03-04T12:26:50.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.164+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~G2HPV50HT41Z.0 size=408097 2024-03-04T12:26:50.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.164+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=G2HPV50HT41Z tag=AZ2XMBJXY1KG type=write size=1456673 2024-03-04T12:26:50.172 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.165+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~P3CAIXL7LYCE.0 size=1048576 2024-03-04T12:26:50.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.166+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~P3CAIXL7LYCE.1 size=1048576 2024-03-04T12:26:50.174 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.167+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~P3CAIXL7LYCE.2 size=1041358 2024-03-04T12:26:50.176 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.169+0000 7fa4b3c3e780 1 < completed multipart upload key=4LKTYP07OL5L upload=P3CAIXL7LYCE tag=PIV45H62V6QE type=write size=4187086 2024-03-04T12:26:50.177 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.170+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=F5Y6K00X12JT type=del size=3183245 2024-03-04T12:26:50.178 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.171+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=HLFLLDXQNH4X type=del 2024-03-04T12:26:50.180 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.173+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~FO5RPZOL1IH1.0 size=968230 2024-03-04T12:26:50.180 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.173+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=FO5RPZOL1IH1 tag=1PAX0NY9FGWX type=write size=2016806 2024-03-04T12:26:50.181 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.175+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~JT5BMJQXBI2S.0 size=1048576 2024-03-04T12:26:50.182 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.176+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~JT5BMJQXBI2S.1 size=626426 2024-03-04T12:26:50.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.178+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=JT5BMJQXBI2S tag=UL8NEEYZWLHS type=write size=2723578 2024-03-04T12:26:50.185 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.179+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=TNYWSYS7WU59 type=write size=796001 2024-03-04T12:26:50.187 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.180+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=GXHGHN2U3P12 type=del 2024-03-04T12:26:50.188 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.181+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=6R7X0LH4RFDJ type=del size=736153 2024-03-04T12:26:50.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.182+0000 7fa4b3c3e780 1 < canceled operation key=YIS2SV4O5EZN tag=FLN6PQBSE0JD type=del size=1709216 2024-03-04T12:26:50.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.184+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~O219WSEFQY6Z.0 size=862707 2024-03-04T12:26:50.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.184+0000 7fa4b3c3e780 1 > prepared multipart upload key=G4SUQFVB936T upload=O219WSEFQY6Z tag=ZR9IX8V8SA87 type=write size=1911283 2024-03-04T12:26:50.192 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.186+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=5GPSUD3XDA0V type=del 2024-03-04T12:26:50.195 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.188+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~VQN07Q8WPR8Q.0 size=1048576 2024-03-04T12:26:50.195 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.189+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~VQN07Q8WPR8Q.1 size=1048576 2024-03-04T12:26:50.196 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.189+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~VQN07Q8WPR8Q.2 size=674963 2024-03-04T12:26:50.196 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.189+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=VQN07Q8WPR8Q tag=OXJKSFP1J5UR type=write size=3820691 2024-03-04T12:26:50.197 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.191+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~3U9G3MO30V7F.0 size=991640 2024-03-04T12:26:50.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.192+0000 7fa4b3c3e780 1 < completed multipart upload key=3N6E09QF3866 upload=3U9G3MO30V7F tag=O4F93IPOZTJ5 type=write size=2040216 2024-03-04T12:26:50.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.194+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~LSZWDK56AQ6B.0 size=1048576 2024-03-04T12:26:50.202 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.195+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~LSZWDK56AQ6B.1 size=1048576 2024-03-04T12:26:50.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.196+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~LSZWDK56AQ6B.2 size=982958 2024-03-04T12:26:50.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.196+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=LSZWDK56AQ6B tag=P406F1XIQYC3 type=write size=4128686 2024-03-04T12:26:50.204 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.197+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=PTMLXWM6OR5M type=del 2024-03-04T12:26:50.205 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.198+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=GTY8XTDEC4TV type=write size=493052 2024-03-04T12:26:50.206 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.199+0000 7fa4b3c3e780 1 < completed write operation key=7IUV88NQLPN8 tag=1DE5R4CPTPXE type=write size=538722 2024-03-04T12:26:50.208 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.201+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=S13FZWYR9MAD type=del size=2331142 2024-03-04T12:26:50.208 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.202+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=EQ07TFD0VE49 type=del 2024-03-04T12:26:50.210 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.204+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~A5F7WHXSQOO5.0 size=1048576 2024-03-04T12:26:50.211 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.205+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~A5F7WHXSQOO5.1 size=1048576 2024-03-04T12:26:50.212 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.205+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~A5F7WHXSQOO5.2 size=262011 2024-03-04T12:26:50.212 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.205+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=A5F7WHXSQOO5 tag=HG8HEQPOF34W type=write size=3407739 2024-03-04T12:26:50.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.206+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=RWYGT8BZHI9M type=del 2024-03-04T12:26:50.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.208+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=VKCJB5W0ZZY7 type=del size=2496023 2024-03-04T12:26:50.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.210+0000 7fa4b3c3e780 1 < suggested remove operation key=6XK4DQ940Z5J tag=LHYXY9KPNAOK type=del 2024-03-04T12:26:50.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.211+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=EIOBV3OQD2V1 type=del size=2955339 2024-03-04T12:26:50.219 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.212+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~ETDIQTVDK3YR.0 size=1048576 2024-03-04T12:26:50.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.213+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~ETDIQTVDK3YR.1 size=5597 2024-03-04T12:26:50.222 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.215+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=ETDIQTVDK3YR tag=Q2DMFHQVVR4P type=write size=2102749 2024-03-04T12:26:50.224 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.217+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~S4HIJFXW37B3.0 size=1048576 2024-03-04T12:26:50.225 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.218+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~S4HIJFXW37B3.1 size=1018818 2024-03-04T12:26:50.225 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.218+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=S4HIJFXW37B3 tag=Z7T03H39BGS7 type=write size=3115970 2024-03-04T12:26:50.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.219+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=205F2X5XI7NT type=del 2024-03-04T12:26:50.228 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.221+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~AQXEX0O7D633.0 size=1048576 2024-03-04T12:26:50.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.222+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~AQXEX0O7D633.1 size=387009 2024-03-04T12:26:50.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.222+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=AQXEX0O7D633 tag=I0HJ0T2P1ZD8 type=write size=2484161 2024-03-04T12:26:50.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.223+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=IIURL0TXQPY2 type=del 2024-03-04T12:26:50.231 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.224+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=PJQFCMQ9O3Y7 type=del size=2887741 2024-03-04T12:26:50.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.225+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~G2HPV50HT41Z.0 size=408097 2024-03-04T12:26:50.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.227+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=G2HPV50HT41Z tag=AZ2XMBJXY1KG type=write size=1456673 2024-03-04T12:26:50.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.229+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~BEN1V1JKL5UY.0 size=1048576 2024-03-04T12:26:50.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.230+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~BEN1V1JKL5UY.1 size=1048576 2024-03-04T12:26:50.238 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.231+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~BEN1V1JKL5UY.2 size=82924 2024-03-04T12:26:50.238 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.231+0000 7fa4b3c3e780 1 > prepared multipart upload key=NVMIU38VM9Q1 upload=BEN1V1JKL5UY tag=U3L53WKLX3OR type=write size=3228652 2024-03-04T12:26:50.238 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.232+0000 7fa4b3c3e780 -1 < no bi entry to suggest for operation key=6XK4DQ940Z5J tag=F5Y6K00X12JT type=del size=3183245: (2) No such file or directory 2024-03-04T12:26:50.239 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.233+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=SVKKVVJBRAMO type=del size=2091139 2024-03-04T12:26:50.240 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.233+0000 7fa4b3c3e780 1 < canceled part key=_multipart_R1DOKJPZRT5Q.2~FO5RPZOL1IH1.0 size=968230 2024-03-04T12:26:50.242 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.235+0000 7fa4b3c3e780 1 < canceled multipart upload key=R1DOKJPZRT5Q upload=FO5RPZOL1IH1 tag=1PAX0NY9FGWX type=write size=2016806 2024-03-04T12:26:50.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.236+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=JR0RY4SZISX7 type=write size=925744 2024-03-04T12:26:50.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.237+0000 7fa4b3c3e780 1 < completed write operation key=4989OME3IAJF tag=TNYWSYS7WU59 type=write size=796001 2024-03-04T12:26:50.246 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.239+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~9HPLT7MAMG7P.0 size=340428 2024-03-04T12:26:50.246 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.239+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=9HPLT7MAMG7P tag=GQLB8V7NZ3EK type=write size=1389004 2024-03-04T12:26:50.247 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.241+0000 7fa4b3c3e780 1 < canceled operation key=VAIY4J3CYONH tag=6R7X0LH4RFDJ type=del size=736153 2024-03-04T12:26:50.250 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.243+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~3WE32LUIQJFV.0 size=1048576 2024-03-04T12:26:50.250 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.244+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~3WE32LUIQJFV.1 size=22782 2024-03-04T12:26:50.251 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.244+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=3WE32LUIQJFV tag=7QB2C4Q0A1NW type=write size=2119934 2024-03-04T12:26:50.252 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.245+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~O219WSEFQY6Z.0 size=862707 2024-03-04T12:26:50.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.247+0000 7fa4b3c3e780 1 < completed multipart upload key=G4SUQFVB936T upload=O219WSEFQY6Z tag=ZR9IX8V8SA87 type=write size=1911283 2024-03-04T12:26:50.256 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.249+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=2R9ZNUUVRJRH type=del size=1510010 2024-03-04T12:26:50.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.250+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~VQN07Q8WPR8Q.0 size=1048576 2024-03-04T12:26:50.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.250+0000 7fa4b3c3e780 1 < canceled part key=_multipart_VAIY4J3CYONH.2~VQN07Q8WPR8Q.1 size=1048576 2024-03-04T12:26:50.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.251+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~VQN07Q8WPR8Q.2 size=674963 2024-03-04T12:26:50.260 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.253+0000 7fa4b3c3e780 1 < canceled multipart upload key=VAIY4J3CYONH upload=VQN07Q8WPR8Q tag=OXJKSFP1J5UR type=write size=3820691 2024-03-04T12:26:50.261 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.254+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=DF00T32AMUSC type=del size=2756583 2024-03-04T12:26:50.262 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.255+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~LSZWDK56AQ6B.0 size=1048576 2024-03-04T12:26:50.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.256+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~LSZWDK56AQ6B.1 size=1048576 2024-03-04T12:26:50.264 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.257+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~LSZWDK56AQ6B.2 size=982958 2024-03-04T12:26:50.266 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.259+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=LSZWDK56AQ6B tag=P406F1XIQYC3 type=write size=4128686 2024-03-04T12:26:50.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.260+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=OL1690KSJE15 type=del size=1555996 2024-03-04T12:26:50.268 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.261+0000 7fa4b3c3e780 1 < completed write operation key=YWJV4QMY6ZBI tag=GTY8XTDEC4TV type=write size=493052 2024-03-04T12:26:50.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.263+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~5GCK5DBST966.0 size=1048576 2024-03-04T12:26:50.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.264+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~5GCK5DBST966.1 size=1048576 2024-03-04T12:26:50.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.265+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~5GCK5DBST966.2 size=47702 2024-03-04T12:26:50.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.265+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=5GCK5DBST966 tag=P5LFRAXW84DH type=write size=3193430 2024-03-04T12:26:50.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.266+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=S13FZWYR9MAD type=del 2024-03-04T12:26:50.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.268+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=X174GNRDZNTK type=del size=1175482 2024-03-04T12:26:50.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.268+0000 7fa4b3c3e780 1 < canceled part key=_multipart_4989OME3IAJF.2~A5F7WHXSQOO5.0 size=1048576 2024-03-04T12:26:50.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.269+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~A5F7WHXSQOO5.1 size=1048576 2024-03-04T12:26:50.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.270+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~A5F7WHXSQOO5.2 size=262011 2024-03-04T12:26:50.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.272+0000 7fa4b3c3e780 1 < canceled multipart upload key=4989OME3IAJF upload=A5F7WHXSQOO5 tag=HG8HEQPOF34W type=write size=3407739 2024-03-04T12:26:50.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.273+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=TY66Y9I4E4W4 type=del size=683135 2024-03-04T12:26:50.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.274+0000 7fa4b3c3e780 1 < canceled operation key=H5FWRNK8F7QT tag=VKCJB5W0ZZY7 type=del size=2496023 2024-03-04T12:26:50.282 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.276+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=SXZ1L3LAFME5 type=del size=4098358 2024-03-04T12:26:50.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.277+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=EIOBV3OQD2V1 type=del 2024-03-04T12:26:50.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.279+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~E40GR7Q7M57I.0 size=965343 2024-03-04T12:26:50.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.279+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=E40GR7Q7M57I tag=JEQJRE77GDNI type=write size=2013919 2024-03-04T12:26:50.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.280+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~S4HIJFXW37B3.0 size=1048576 2024-03-04T12:26:50.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.280+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YQLH0WW7I7MW.2~S4HIJFXW37B3.1 size=1018818 2024-03-04T12:26:50.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.282+0000 7fa4b3c3e780 1 < canceled multipart upload key=YQLH0WW7I7MW upload=S4HIJFXW37B3 tag=Z7T03H39BGS7 type=write size=3115970 2024-03-04T12:26:50.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.284+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~TLF98NOLI6T9.0 size=724543 2024-03-04T12:26:50.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.284+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=TLF98NOLI6T9 tag=48ZDFWL4FTY7 type=write size=1773119 2024-03-04T12:26:50.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.285+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~AQXEX0O7D633.0 size=1048576 2024-03-04T12:26:50.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.286+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~AQXEX0O7D633.1 size=387009 2024-03-04T12:26:50.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.288+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=AQXEX0O7D633 tag=I0HJ0T2P1ZD8 type=write size=2484161 2024-03-04T12:26:50.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.289+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=TY48937MRYEV type=del size=706643 2024-03-04T12:26:50.297 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.290+0000 7fa4b3c3e780 1 < canceled operation key=R6Y09EO6HGF0 tag=PJQFCMQ9O3Y7 type=del size=2887741 2024-03-04T12:26:50.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.291+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=YOLUKJLHW05K type=del size=984931 2024-03-04T12:26:50.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.291+0000 7fa4b3c3e780 1 < canceled part key=_multipart_NVMIU38VM9Q1.2~BEN1V1JKL5UY.0 size=1048576 2024-03-04T12:26:50.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.292+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~BEN1V1JKL5UY.1 size=1048576 2024-03-04T12:26:50.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.293+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~BEN1V1JKL5UY.2 size=82924 2024-03-04T12:26:50.302 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.295+0000 7fa4b3c3e780 1 < canceled multipart upload key=NVMIU38VM9Q1 upload=BEN1V1JKL5UY tag=U3L53WKLX3OR type=write size=3228652 2024-03-04T12:26:50.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.297+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~5270PL38XNUP.0 size=182794 2024-03-04T12:26:50.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.297+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=5270PL38XNUP tag=1P5FHJIAAHDP type=write size=1231370 2024-03-04T12:26:50.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.298+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=SVKKVVJBRAMO type=del 2024-03-04T12:26:50.306 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.300+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=4T6TNG37O4YI type=write size=244628 2024-03-04T12:26:50.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.301+0000 7fa4b3c3e780 1 < completed write operation key=G8G76PMSKJ0I tag=JR0RY4SZISX7 type=write size=925744 2024-03-04T12:26:50.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.303+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~KUGQWR10A04L.0 size=1048576 2024-03-04T12:26:50.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.304+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~KUGQWR10A04L.1 size=1048576 2024-03-04T12:26:50.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.305+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~KUGQWR10A04L.2 size=346250 2024-03-04T12:26:50.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.305+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=KUGQWR10A04L tag=BXASE9J290BT type=write size=3491978 2024-03-04T12:26:50.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.306+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~9HPLT7MAMG7P.0 size=340428 2024-03-04T12:26:50.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.308+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=9HPLT7MAMG7P tag=GQLB8V7NZ3EK type=write size=1389004 2024-03-04T12:26:50.317 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.310+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~0NFL87DNAFC6.0 size=1048576 2024-03-04T12:26:50.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.311+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~0NFL87DNAFC6.1 size=332491 2024-03-04T12:26:50.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.311+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=0NFL87DNAFC6 tag=D4SA43PNZPZY type=write size=2429643 2024-03-04T12:26:50.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.312+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~3WE32LUIQJFV.0 size=1048576 2024-03-04T12:26:50.320 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.313+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~3WE32LUIQJFV.1 size=22782 2024-03-04T12:26:50.322 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.315+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=3WE32LUIQJFV tag=7QB2C4Q0A1NW type=write size=2119934 2024-03-04T12:26:50.323 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.316+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=VTMNSRW810IK type=del size=3587361 2024-03-04T12:26:50.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.317+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=2R9ZNUUVRJRH type=del 2024-03-04T12:26:50.325 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.318+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=692VOLAP1P7T type=del size=1088426 2024-03-04T12:26:50.326 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.319+0000 7fa4b3c3e780 1 < completed delete operation key=X0RVLNRWUAEM tag=DF00T32AMUSC type=del 2024-03-04T12:26:50.328 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.321+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~QHHC0XKYU6GE.0 size=1048576 2024-03-04T12:26:50.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.322+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~QHHC0XKYU6GE.1 size=1048576 2024-03-04T12:26:50.330 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.323+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~QHHC0XKYU6GE.2 size=620375 2024-03-04T12:26:50.330 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.323+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=QHHC0XKYU6GE tag=OS2HYNQ70TP4 type=write size=3766103 2024-03-04T12:26:50.331 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.324+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=OL1690KSJE15 type=del 2024-03-04T12:26:50.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.325+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=0F1HUZRJXVP1 type=del size=939259 2024-03-04T12:26:50.333 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.326+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~5GCK5DBST966.0 size=1048576 2024-03-04T12:26:50.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.327+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~5GCK5DBST966.1 size=1048576 2024-03-04T12:26:50.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.328+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~5GCK5DBST966.2 size=47702 2024-03-04T12:26:50.337 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.330+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=5GCK5DBST966 tag=P5LFRAXW84DH type=write size=3193430 2024-03-04T12:26:50.339 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.332+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~82CI0S50HIRY.0 size=505293 2024-03-04T12:26:50.339 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.332+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=82CI0S50HIRY tag=V90G6I7GF1O8 type=write size=1553869 2024-03-04T12:26:50.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.333+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=X174GNRDZNTK type=del 2024-03-04T12:26:50.342 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.335+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~UO230BWV98UT.0 size=117637 2024-03-04T12:26:50.342 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.335+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=UO230BWV98UT tag=M0F05BL0IKCZ type=write size=1166213 2024-03-04T12:26:50.343 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.337+0000 7fa4b3c3e780 1 < canceled operation key=T301TK0FIOG4 tag=TY66Y9I4E4W4 type=del size=683135 2024-03-04T12:26:50.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.338+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=NQ3P5AXA849E type=del size=1569781 2024-03-04T12:26:50.346 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.339+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=SXZ1L3LAFME5 type=del 2024-03-04T12:26:50.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.340+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=KZ7JOH6EPTFN type=write size=771773 2024-03-04T12:26:50.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.341+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~E40GR7Q7M57I.0 size=965343 2024-03-04T12:26:50.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.343+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=E40GR7Q7M57I tag=JEQJRE77GDNI type=write size=2013919 2024-03-04T12:26:50.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.344+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=RUUQJ778JB57 type=del size=3466230 2024-03-04T12:26:50.352 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.345+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~TLF98NOLI6T9.0 size=724543 2024-03-04T12:26:50.354 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.347+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=TLF98NOLI6T9 tag=48ZDFWL4FTY7 type=write size=1773119 2024-03-04T12:26:50.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.349+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~DGH8KTCU9487.0 size=1048576 2024-03-04T12:26:50.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.350+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~DGH8KTCU9487.1 size=539891 2024-03-04T12:26:50.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.350+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=DGH8KTCU9487 tag=3FDS7JFW4KL5 type=write size=2637043 2024-03-04T12:26:50.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.352+0000 7fa4b3c3e780 1 < suggested remove operation key=VAIY4J3CYONH tag=TY48937MRYEV type=del 2024-03-04T12:26:50.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.356+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~Q6B2PESS7NYE.0 size=1048576 2024-03-04T12:26:50.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.356+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~Q6B2PESS7NYE.1 size=1048576 2024-03-04T12:26:50.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.357+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~Q6B2PESS7NYE.2 size=467454 2024-03-04T12:26:50.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.357+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=Q6B2PESS7NYE tag=QX1XGB43TEKK type=write size=3613182 2024-03-04T12:26:50.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.360+0000 7fa4b3c3e780 1 < suggested update operation key=ZETES4AYZQHY tag=YOLUKJLHW05K type=del size=984931 2024-03-04T12:26:50.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.362+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~P1MDCL24T4J8.0 size=1048576 2024-03-04T12:26:50.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.362+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~P1MDCL24T4J8.1 size=1048576 2024-03-04T12:26:50.370 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.363+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~P1MDCL24T4J8.2 size=316661 2024-03-04T12:26:50.370 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.363+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=P1MDCL24T4J8 tag=JST2JRDC5TAW type=write size=3462389 2024-03-04T12:26:50.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.364+0000 7fa4b3c3e780 1 < canceled part key=_multipart_R6Y09EO6HGF0.2~5270PL38XNUP.0 size=182794 2024-03-04T12:26:50.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.365+0000 7fa4b3c3e780 1 < canceled multipart upload key=R6Y09EO6HGF0 upload=5270PL38XNUP tag=1P5FHJIAAHDP type=write size=1231370 2024-03-04T12:26:50.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.368+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~LUE64HAP1ZBY.0 size=1048576 2024-03-04T12:26:50.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.369+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~LUE64HAP1ZBY.1 size=452660 2024-03-04T12:26:50.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.369+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=LUE64HAP1ZBY tag=JUUM23ALPYAB type=write size=2549812 2024-03-04T12:26:50.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.370+0000 7fa4b3c3e780 1 < completed write operation key=UZRX3W3DE5VX tag=4T6TNG37O4YI type=write size=244628 2024-03-04T12:26:50.378 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.371+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=4YZH9NP4WKXE type=del size=2451558 2024-03-04T12:26:50.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.372+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~KUGQWR10A04L.0 size=1048576 2024-03-04T12:26:50.380 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.373+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~KUGQWR10A04L.1 size=1048576 2024-03-04T12:26:50.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.374+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~KUGQWR10A04L.2 size=346250 2024-03-04T12:26:50.382 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.376+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=KUGQWR10A04L tag=BXASE9J290BT type=write size=3491978 2024-03-04T12:26:50.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.377+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=VU5G8QXKG91R type=del size=2895251 2024-03-04T12:26:50.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.378+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~0NFL87DNAFC6.0 size=1048576 2024-03-04T12:26:50.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.379+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~0NFL87DNAFC6.1 size=332491 2024-03-04T12:26:50.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.381+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=0NFL87DNAFC6 tag=D4SA43PNZPZY type=write size=2429643 2024-03-04T12:26:50.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.382+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=HB17KE6IQJS2 type=del size=3465833 2024-03-04T12:26:50.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.383+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=VTMNSRW810IK type=del 2024-03-04T12:26:50.390 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.384+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=9GJ2RCFA8GQK type=del size=3619466 2024-03-04T12:26:50.393 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.386+0000 7fa4b3c3e780 1 < suggested remove operation key=NVMIU38VM9Q1 tag=692VOLAP1P7T type=del 2024-03-04T12:26:50.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.387+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=UI12KNT7NNL9 type=write size=312230 2024-03-04T12:26:50.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.388+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~QHHC0XKYU6GE.0 size=1048576 2024-03-04T12:26:50.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.389+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~QHHC0XKYU6GE.1 size=1048576 2024-03-04T12:26:50.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.390+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~QHHC0XKYU6GE.2 size=620375 2024-03-04T12:26:50.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.392+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=QHHC0XKYU6GE tag=OS2HYNQ70TP4 type=write size=3766103 2024-03-04T12:26:50.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.393+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=SUO7C7YZWZ01 type=del size=2078407 2024-03-04T12:26:50.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.395+0000 7fa4b3c3e780 1 < suggested update operation key=GMIPCGYZRJ5L tag=0F1HUZRJXVP1 type=del size=939259 2024-03-04T12:26:50.403 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.396+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=WSUXGT0BHOMH type=del size=74009 2024-03-04T12:26:50.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.397+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~82CI0S50HIRY.0 size=505293 2024-03-04T12:26:50.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.399+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=82CI0S50HIRY tag=V90G6I7GF1O8 type=write size=1553869 2024-03-04T12:26:50.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.400+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=M3NT8P5LAFQO type=del size=3409075 2024-03-04T12:26:50.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.402+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~UO230BWV98UT.0 size=117637 2024-03-04T12:26:50.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.403+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=UO230BWV98UT tag=M0F05BL0IKCZ type=write size=1166213 2024-03-04T12:26:50.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.404+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=X925Y1E20B0R type=del size=3511555 2024-03-04T12:26:50.412 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.405+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=NQ3P5AXA849E type=del 2024-03-04T12:26:50.413 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.407+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=7XU4KONE22SY type=del size=3770201 2024-03-04T12:26:50.414 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.408+0000 7fa4b3c3e780 1 < canceled operation key=UZRX3W3DE5VX tag=KZ7JOH6EPTFN type=write size=771773 2024-03-04T12:26:50.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.409+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=SQ3DLQ9WPFVX type=del size=3221432 2024-03-04T12:26:50.416 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.410+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=RUUQJ778JB57 type=del 2024-03-04T12:26:50.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.412+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~5XP3MVZWNEJB.0 size=195006 2024-03-04T12:26:50.419 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.412+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=5XP3MVZWNEJB tag=3M47IDNYDYVC type=write size=1243582 2024-03-04T12:26:50.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.413+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~DGH8KTCU9487.0 size=1048576 2024-03-04T12:26:50.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.414+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~DGH8KTCU9487.1 size=539891 2024-03-04T12:26:50.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.415+0000 7fa4b3c3e780 1 < completed multipart upload key=H5FWRNK8F7QT upload=DGH8KTCU9487 tag=3FDS7JFW4KL5 type=write size=2637043 2024-03-04T12:26:50.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.417+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~728M0BU2DL5Y.0 size=1048576 2024-03-04T12:26:50.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.418+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~728M0BU2DL5Y.1 size=1048576 2024-03-04T12:26:50.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.419+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~728M0BU2DL5Y.2 size=777467 2024-03-04T12:26:50.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.419+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=728M0BU2DL5Y tag=OG1F8S4E5G20 type=write size=3923195 2024-03-04T12:26:50.427 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.420+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~Q6B2PESS7NYE.0 size=1048576 2024-03-04T12:26:50.428 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.421+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~Q6B2PESS7NYE.1 size=1048576 2024-03-04T12:26:50.428 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.422+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~Q6B2PESS7NYE.2 size=467454 2024-03-04T12:26:50.430 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.424+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=Q6B2PESS7NYE tag=QX1XGB43TEKK type=write size=3613182 2024-03-04T12:26:50.432 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.425+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~A4S5Z2SYMCL5.0 size=1048576 2024-03-04T12:26:50.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.426+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~A4S5Z2SYMCL5.1 size=1048576 2024-03-04T12:26:50.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.427+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~A4S5Z2SYMCL5.2 size=230265 2024-03-04T12:26:50.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.427+0000 7fa4b3c3e780 1 > prepared multipart upload key=G4SUQFVB936T upload=A4S5Z2SYMCL5 tag=YJU5WU9JDDW2 type=write size=3375993 2024-03-04T12:26:50.435 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.428+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~P1MDCL24T4J8.0 size=1048576 2024-03-04T12:26:50.435 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.428+0000 7fa4b3c3e780 1 < canceled part key=_multipart_J53J0N99N30A.2~P1MDCL24T4J8.1 size=1048576 2024-03-04T12:26:50.436 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.429+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~P1MDCL24T4J8.2 size=316661 2024-03-04T12:26:50.438 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.431+0000 7fa4b3c3e780 1 < canceled multipart upload key=J53J0N99N30A upload=P1MDCL24T4J8 tag=JST2JRDC5TAW type=write size=3462389 2024-03-04T12:26:50.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.432+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=SQP2K0WE0352 type=del size=1826037 2024-03-04T12:26:50.440 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.433+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~LUE64HAP1ZBY.0 size=1048576 2024-03-04T12:26:50.441 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.434+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~LUE64HAP1ZBY.1 size=452660 2024-03-04T12:26:50.443 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.436+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=LUE64HAP1ZBY tag=JUUM23ALPYAB type=write size=2549812 2024-03-04T12:26:50.445 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.438+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~3VOCRWOZSBUH.0 size=1048576 2024-03-04T12:26:50.445 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.439+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~3VOCRWOZSBUH.1 size=855297 2024-03-04T12:26:50.445 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.439+0000 7fa4b3c3e780 1 > prepared multipart upload key=G4SUQFVB936T upload=3VOCRWOZSBUH tag=POPMQ4HVA9WE type=write size=2952449 2024-03-04T12:26:50.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.440+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=4YZH9NP4WKXE type=del 2024-03-04T12:26:50.449 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.442+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~NI06I68A2HS5.0 size=211984 2024-03-04T12:26:50.449 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.442+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=NI06I68A2HS5 tag=ICM5SJN2EA0R type=write size=1260560 2024-03-04T12:26:50.450 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.443+0000 7fa4b3c3e780 1 < completed delete operation key=R6Y09EO6HGF0 tag=VU5G8QXKG91R type=del 2024-03-04T12:26:50.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.444+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=FDHDQ3KR9HRY type=del size=687572 2024-03-04T12:26:50.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.445+0000 7fa4b3c3e780 1 < completed delete operation key=R6Y09EO6HGF0 tag=HB17KE6IQJS2 type=del 2024-03-04T12:26:50.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.446+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=O6HWGQHF472Z type=write size=56443 2024-03-04T12:26:50.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.447+0000 7fa4b3c3e780 -1 < failed to complete operation key=GMIPCGYZRJ5L tag=9GJ2RCFA8GQK type=del size=3619466: (22) Invalid argument 2024-03-04T12:26:50.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.448+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=N5FM3NJRJBPD type=del size=2240669 2024-03-04T12:26:50.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.450+0000 7fa4b3c3e780 1 < canceled operation key=BR8RTE2QEH9E tag=UI12KNT7NNL9 type=write size=312230 2024-03-04T12:26:50.458 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.452+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~L872V2W8YFOU.0 size=1048576 2024-03-04T12:26:50.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.452+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~L872V2W8YFOU.1 size=725961 2024-03-04T12:26:50.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.452+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=L872V2W8YFOU tag=3YP2HZ9MF7EB type=write size=2823113 2024-03-04T12:26:50.460 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.454+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=SUO7C7YZWZ01 type=del 2024-03-04T12:26:50.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.457+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~UXXRTIF18M4H.0 size=1048576 2024-03-04T12:26:50.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.458+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~UXXRTIF18M4H.1 size=670743 2024-03-04T12:26:50.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.458+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=UXXRTIF18M4H tag=J9DHK2WBAKG3 type=write size=2767895 2024-03-04T12:26:50.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.459+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=WSUXGT0BHOMH type=del 2024-03-04T12:26:50.468 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.461+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~X2YVP0EFXY4R.0 size=1048576 2024-03-04T12:26:50.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.462+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~X2YVP0EFXY4R.1 size=654041 2024-03-04T12:26:50.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.462+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=X2YVP0EFXY4R tag=3A0PF52A04CY type=write size=2751193 2024-03-04T12:26:50.470 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.463+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=M3NT8P5LAFQO type=del 2024-03-04T12:26:50.471 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.464+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=KNJ9XS9F63Y5 type=del size=1952058 2024-03-04T12:26:50.472 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.466+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=X925Y1E20B0R type=del 2024-03-04T12:26:50.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.468+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~FXXLUFN6UFZI.0 size=1048576 2024-03-04T12:26:50.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.468+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~FXXLUFN6UFZI.1 size=1048576 2024-03-04T12:26:50.476 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.469+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~FXXLUFN6UFZI.2 size=1012544 2024-03-04T12:26:50.476 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.469+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=FXXLUFN6UFZI tag=BHHG7YXPWM68 type=write size=4158272 2024-03-04T12:26:50.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.470+0000 7fa4b3c3e780 1 < canceled operation key=3N6E09QF3866 tag=7XU4KONE22SY type=del size=3770201 2024-03-04T12:26:50.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.472+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=0IMDODQTON8R type=del size=2472431 2024-03-04T12:26:50.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.473+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=SQ3DLQ9WPFVX type=del 2024-03-04T12:26:50.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.474+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=98DSQ3N78J8Y type=del size=1898672 2024-03-04T12:26:50.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.475+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~5XP3MVZWNEJB.0 size=195006 2024-03-04T12:26:50.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.477+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=5XP3MVZWNEJB tag=3M47IDNYDYVC type=write size=1243582 2024-03-04T12:26:50.485 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.478+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=8E9QB0ZT76H6 type=del size=1545649 2024-03-04T12:26:50.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.479+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~728M0BU2DL5Y.0 size=1048576 2024-03-04T12:26:50.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.480+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~728M0BU2DL5Y.1 size=1048576 2024-03-04T12:26:50.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.481+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~728M0BU2DL5Y.2 size=777467 2024-03-04T12:26:50.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.483+0000 7fa4b3c3e780 1 < completed multipart upload key=3N6E09QF3866 upload=728M0BU2DL5Y tag=OG1F8S4E5G20 type=write size=3923195 2024-03-04T12:26:50.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.484+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=2B3F78HKBTLE type=write size=53417 2024-03-04T12:26:50.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.485+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~A4S5Z2SYMCL5.0 size=1048576 2024-03-04T12:26:50.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.486+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~A4S5Z2SYMCL5.1 size=1048576 2024-03-04T12:26:50.494 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.487+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~A4S5Z2SYMCL5.2 size=230265 2024-03-04T12:26:50.496 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.489+0000 7fa4b3c3e780 1 < completed multipart upload key=G4SUQFVB936T upload=A4S5Z2SYMCL5 tag=YJU5WU9JDDW2 type=write size=3375993 2024-03-04T12:26:50.497 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.490+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=R2KBYI5AJY5S type=del size=4014217 2024-03-04T12:26:50.498 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.491+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=SQP2K0WE0352 type=del 2024-03-04T12:26:50.499 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.492+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=FDLHSD2AET9A type=del size=763796 2024-03-04T12:26:50.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.493+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~3VOCRWOZSBUH.0 size=1048576 2024-03-04T12:26:50.501 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.494+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~3VOCRWOZSBUH.1 size=855297 2024-03-04T12:26:50.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.496+0000 7fa4b3c3e780 1 < completed multipart upload key=G4SUQFVB936T upload=3VOCRWOZSBUH tag=POPMQ4HVA9WE type=write size=2952449 2024-03-04T12:26:50.504 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.497+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=CJV5YNUF5Q3F type=del size=595443 2024-03-04T12:26:50.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.498+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~NI06I68A2HS5.0 size=211984 2024-03-04T12:26:50.507 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.500+0000 7fa4b3c3e780 1 < completed multipart upload key=J53J0N99N30A upload=NI06I68A2HS5 tag=ICM5SJN2EA0R type=write size=1260560 2024-03-04T12:26:50.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.501+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=NWLM8NA76P79 type=del size=2299268 2024-03-04T12:26:50.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.502+0000 7fa4b3c3e780 1 < completed delete operation key=R1DOKJPZRT5Q tag=FDHDQ3KR9HRY type=del 2024-03-04T12:26:50.510 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.503+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=ZVRJKBN5Q747 type=del size=268204 2024-03-04T12:26:50.511 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.504+0000 7fa4b3c3e780 1 < completed write operation key=43HMF7NWNMU3 tag=O6HWGQHF472Z type=write size=56443 2024-03-04T12:26:50.512 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.505+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=E9HMQDJ1DWIJ type=del size=1932056 2024-03-04T12:26:50.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.506+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=N5FM3NJRJBPD type=del 2024-03-04T12:26:50.515 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.508+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~NIB18U4Q335F.0 size=1048576 2024-03-04T12:26:50.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.509+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~NIB18U4Q335F.1 size=1048576 2024-03-04T12:26:50.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.510+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~NIB18U4Q335F.2 size=893467 2024-03-04T12:26:50.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.510+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=NIB18U4Q335F tag=BI3PQZYIBDP1 type=write size=4039195 2024-03-04T12:26:50.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.511+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~L872V2W8YFOU.0 size=1048576 2024-03-04T12:26:50.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.511+0000 7fa4b3c3e780 1 < canceled part key=_multipart_T301TK0FIOG4.2~L872V2W8YFOU.1 size=725961 2024-03-04T12:26:50.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.513+0000 7fa4b3c3e780 1 < canceled multipart upload key=T301TK0FIOG4 upload=L872V2W8YFOU tag=3YP2HZ9MF7EB type=write size=2823113 2024-03-04T12:26:50.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.515+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~3OY5XA4QW8B9.0 size=1048576 2024-03-04T12:26:50.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.516+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~3OY5XA4QW8B9.1 size=5231 2024-03-04T12:26:50.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.516+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=3OY5XA4QW8B9 tag=XEEHTV94YDU5 type=write size=2102383 2024-03-04T12:26:50.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.516+0000 7fa4b3c3e780 1 < canceled part key=_multipart_7IUV88NQLPN8.2~UXXRTIF18M4H.0 size=1048576 2024-03-04T12:26:50.524 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.517+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~UXXRTIF18M4H.1 size=670743 2024-03-04T12:26:50.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.519+0000 7fa4b3c3e780 1 < canceled multipart upload key=7IUV88NQLPN8 upload=UXXRTIF18M4H tag=J9DHK2WBAKG3 type=write size=2767895 2024-03-04T12:26:50.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.521+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~AGMANAZD5KWP.0 size=1048576 2024-03-04T12:26:50.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.522+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~AGMANAZD5KWP.1 size=982005 2024-03-04T12:26:50.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.522+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=AGMANAZD5KWP tag=2G7BBR3IKTP0 type=write size=3079157 2024-03-04T12:26:50.530 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.523+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~X2YVP0EFXY4R.0 size=1048576 2024-03-04T12:26:50.531 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.524+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~X2YVP0EFXY4R.1 size=654041 2024-03-04T12:26:50.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.526+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=X2YVP0EFXY4R tag=3A0PF52A04CY type=write size=2751193 2024-03-04T12:26:50.534 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.527+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=65JW6FAVWJIS type=del size=3971520 2024-03-04T12:26:50.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.529+0000 7fa4b3c3e780 1 < suggested update operation key=YQLH0WW7I7MW tag=KNJ9XS9F63Y5 type=del size=1952058 2024-03-04T12:26:50.537 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.531+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=9JHGPPQCVRYT type=del size=638476 2024-03-04T12:26:50.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.532+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~FXXLUFN6UFZI.0 size=1048576 2024-03-04T12:26:50.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.533+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~FXXLUFN6UFZI.1 size=1048576 2024-03-04T12:26:50.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.534+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~FXXLUFN6UFZI.2 size=1012544 2024-03-04T12:26:50.542 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.536+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=FXXLUFN6UFZI tag=BHHG7YXPWM68 type=write size=4158272 2024-03-04T12:26:50.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.538+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~QIJ5A164DQMR.0 size=1048576 2024-03-04T12:26:50.545 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.538+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~QIJ5A164DQMR.1 size=1048576 2024-03-04T12:26:50.546 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.539+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~QIJ5A164DQMR.2 size=718768 2024-03-04T12:26:50.546 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.539+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=QIJ5A164DQMR tag=BTI2O1XMZOAF type=write size=3864496 2024-03-04T12:26:50.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.541+0000 7fa4b3c3e780 1 < suggested update operation key=G4SUQFVB936T tag=0IMDODQTON8R type=del size=2472431 2024-03-04T12:26:50.550 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.543+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~6WT4Y4Y2E31A.0 size=170629 2024-03-04T12:26:50.550 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.543+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=6WT4Y4Y2E31A tag=F2LZOKXBBGM2 type=write size=1219205 2024-03-04T12:26:50.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.544+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=98DSQ3N78J8Y type=del 2024-03-04T12:26:50.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.545+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=OOUJRX5W153C type=del size=3139007 2024-03-04T12:26:50.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.546+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=8E9QB0ZT76H6 type=del 2024-03-04T12:26:50.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.548+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=NC1OMYI2KZ7Q type=del size=999502 2024-03-04T12:26:50.557 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.550+0000 7fa4b3c3e780 1 < suggested remove operation key=YWJV4QMY6ZBI tag=2B3F78HKBTLE type=write 2024-03-04T12:26:50.558 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.551+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=5052IZ2YQF4C type=del size=3435348 2024-03-04T12:26:50.559 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.552+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=R2KBYI5AJY5S type=del 2024-03-04T12:26:50.560 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.553+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=C3QD9I8YY0JE type=del size=4117245 2024-03-04T12:26:50.561 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.554+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=FDLHSD2AET9A type=del 2024-03-04T12:26:50.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.555+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=1Z74A1INAV4W type=del size=1143759 2024-03-04T12:26:50.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.558+0000 7fa4b3c3e780 1 < suggested remove operation key=VAIY4J3CYONH tag=CJV5YNUF5Q3F type=del 2024-03-04T12:26:50.568 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.561+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~BFGGHQFKY9ME.0 size=63328 2024-03-04T12:26:50.568 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.561+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=BFGGHQFKY9ME tag=CCZ3YXBXL0UA type=write size=1111904 2024-03-04T12:26:50.569 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.562+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=NWLM8NA76P79 type=del 2024-03-04T12:26:50.570 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.563+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=8YS0AQXCZ83A type=del size=616466 2024-03-04T12:26:50.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.564+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=ZVRJKBN5Q747 type=del 2024-03-04T12:26:50.572 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.565+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=PZA8CFJ6TPZS type=del size=3233595 2024-03-04T12:26:50.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.566+0000 7fa4b3c3e780 1 < canceled operation key=R1DOKJPZRT5Q tag=E9HMQDJ1DWIJ type=del size=1932056 2024-03-04T12:26:50.575 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.568+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~MV9YNFP2PNBH.0 size=1048576 2024-03-04T12:26:50.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.569+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~MV9YNFP2PNBH.1 size=1048576 2024-03-04T12:26:50.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.570+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~MV9YNFP2PNBH.2 size=492883 2024-03-04T12:26:50.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.570+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=MV9YNFP2PNBH tag=N7FX0UTL7DTQ type=write size=3638611 2024-03-04T12:26:50.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.571+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~NIB18U4Q335F.0 size=1048576 2024-03-04T12:26:50.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.572+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~NIB18U4Q335F.1 size=1048576 2024-03-04T12:26:50.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.573+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~NIB18U4Q335F.2 size=893467 2024-03-04T12:26:50.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.575+0000 7fa4b3c3e780 1 < completed multipart upload key=J53J0N99N30A upload=NIB18U4Q335F tag=BI3PQZYIBDP1 type=write size=4039195 2024-03-04T12:26:50.584 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.577+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~IY3R97SM28Z6.0 size=133188 2024-03-04T12:26:50.584 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.577+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=IY3R97SM28Z6 tag=T46CTZSMC31N type=write size=1181764 2024-03-04T12:26:50.585 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.578+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~3OY5XA4QW8B9.0 size=1048576 2024-03-04T12:26:50.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.579+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~3OY5XA4QW8B9.1 size=5231 2024-03-04T12:26:50.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.581+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=3OY5XA4QW8B9 tag=XEEHTV94YDU5 type=write size=2102383 2024-03-04T12:26:50.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.583+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~H0NU3EYSMAWO.0 size=1048576 2024-03-04T12:26:50.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.584+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~H0NU3EYSMAWO.1 size=1048576 2024-03-04T12:26:50.591 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.585+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~H0NU3EYSMAWO.2 size=489987 2024-03-04T12:26:50.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.585+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=H0NU3EYSMAWO tag=9DLI9YR2ARZ2 type=write size=3635715 2024-03-04T12:26:50.593 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.586+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~AGMANAZD5KWP.0 size=1048576 2024-03-04T12:26:50.594 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.587+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~AGMANAZD5KWP.1 size=982005 2024-03-04T12:26:50.595 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.589+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=AGMANAZD5KWP tag=2G7BBR3IKTP0 type=write size=3079157 2024-03-04T12:26:50.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.590+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=58XT05O41OFM type=del size=702069 2024-03-04T12:26:50.598 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.591+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=65JW6FAVWJIS type=del 2024-03-04T12:26:50.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.593+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~5463YSU2HU9Y.0 size=1048576 2024-03-04T12:26:50.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.594+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~5463YSU2HU9Y.1 size=190393 2024-03-04T12:26:50.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.594+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=5463YSU2HU9Y tag=L0XEYTBTYTNA type=write size=2287545 2024-03-04T12:26:50.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.595+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=9JHGPPQCVRYT type=del 2024-03-04T12:26:50.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.598+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~0NKNHDT2BG5A.0 size=1048576 2024-03-04T12:26:50.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.599+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~0NKNHDT2BG5A.1 size=1048576 2024-03-04T12:26:50.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.599+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~0NKNHDT2BG5A.2 size=229209 2024-03-04T12:26:50.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.599+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=0NKNHDT2BG5A tag=T46RU81AI8WV type=write size=3374937 2024-03-04T12:26:50.607 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.600+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~QIJ5A164DQMR.0 size=1048576 2024-03-04T12:26:50.608 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.601+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~QIJ5A164DQMR.1 size=1048576 2024-03-04T12:26:50.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.602+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~QIJ5A164DQMR.2 size=718768 2024-03-04T12:26:50.611 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.604+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=QIJ5A164DQMR tag=BTI2O1XMZOAF type=write size=3864496 2024-03-04T12:26:50.612 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.605+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=MEXBUQVO3A88 type=del size=488764 2024-03-04T12:26:50.613 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.606+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~6WT4Y4Y2E31A.0 size=170629 2024-03-04T12:26:50.615 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.608+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=6WT4Y4Y2E31A tag=F2LZOKXBBGM2 type=write size=1219205 2024-03-04T12:26:50.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.610+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=XR22EEVKRR41 type=write size=771660 2024-03-04T12:26:50.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.611+0000 7fa4b3c3e780 1 < canceled operation key=7IUV88NQLPN8 tag=OOUJRX5W153C type=del size=3139007 2024-03-04T12:26:50.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.612+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=WCJMLJAIKEKS type=del size=2361789 2024-03-04T12:26:50.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.613+0000 7fa4b3c3e780 -1 < failed to complete operation key=YWJV4QMY6ZBI tag=NC1OMYI2KZ7Q type=del size=999502: (22) Invalid argument 2024-03-04T12:26:50.621 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.615+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~67HFN9QSL2TH.0 size=776550 2024-03-04T12:26:50.622 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.615+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=67HFN9QSL2TH tag=G7QO6HTB4NH3 type=write size=1825126 2024-03-04T12:26:50.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.617+0000 7fa4b3c3e780 1 < suggested update operation key=YIS2SV4O5EZN tag=5052IZ2YQF4C type=del size=3435348 2024-03-04T12:26:50.625 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.618+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=XV4JZ1TV15JG type=del size=2289319 2024-03-04T12:26:50.626 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.619+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=C3QD9I8YY0JE type=del 2024-03-04T12:26:50.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.620+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=B4EH8Z74U1U1 type=del size=2803665 2024-03-04T12:26:50.628 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.621+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=1Z74A1INAV4W type=del 2024-03-04T12:26:50.630 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.623+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~JJ6QDSNOL6DH.0 size=150933 2024-03-04T12:26:50.630 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.623+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=JJ6QDSNOL6DH tag=V41J25K4WBCO type=write size=1199509 2024-03-04T12:26:50.631 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.624+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~BFGGHQFKY9ME.0 size=63328 2024-03-04T12:26:50.633 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.626+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=BFGGHQFKY9ME tag=CCZ3YXBXL0UA type=write size=1111904 2024-03-04T12:26:50.635 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.628+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~RFLH56W7497B.0 size=1048576 2024-03-04T12:26:50.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.629+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~RFLH56W7497B.1 size=1048576 2024-03-04T12:26:50.637 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.630+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~RFLH56W7497B.2 size=133523 2024-03-04T12:26:50.637 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.630+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=RFLH56W7497B tag=107BZQ8CULN7 type=write size=3279251 2024-03-04T12:26:50.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.631+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=8YS0AQXCZ83A type=del 2024-03-04T12:26:50.640 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.633+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~2AT5HSB09PYJ.0 size=1048576 2024-03-04T12:26:50.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.634+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~2AT5HSB09PYJ.1 size=783632 2024-03-04T12:26:50.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.634+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=2AT5HSB09PYJ tag=9R2SJLGHW06M type=write size=2880784 2024-03-04T12:26:50.642 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.635+0000 7fa4b3c3e780 1 < canceled operation key=G70BJ2UARNCP tag=PZA8CFJ6TPZS type=del size=3233595 2024-03-04T12:26:50.643 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.636+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=TP9C4UZNQ796 type=del size=4010204 2024-03-04T12:26:50.644 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.638+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~MV9YNFP2PNBH.0 size=1048576 2024-03-04T12:26:50.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.638+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~MV9YNFP2PNBH.1 size=1048576 2024-03-04T12:26:50.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.639+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~MV9YNFP2PNBH.2 size=492883 2024-03-04T12:26:50.648 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.641+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=MV9YNFP2PNBH tag=N7FX0UTL7DTQ type=write size=3638611 2024-03-04T12:26:50.649 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.642+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=6WTFC5H3MLV1 type=del size=751771 2024-03-04T12:26:50.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.643+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~IY3R97SM28Z6.0 size=133188 2024-03-04T12:26:50.652 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.645+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=IY3R97SM28Z6 tag=T46CTZSMC31N type=write size=1181764 2024-03-04T12:26:50.654 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.647+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~TMAPTWUQ0BBU.0 size=89418 2024-03-04T12:26:50.654 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.647+0000 7fa4b3c3e780 1 > prepared multipart upload key=4LKTYP07OL5L upload=TMAPTWUQ0BBU tag=2DJZUAUW57R2 type=write size=1137994 2024-03-04T12:26:50.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.648+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~H0NU3EYSMAWO.0 size=1048576 2024-03-04T12:26:50.656 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.649+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~H0NU3EYSMAWO.1 size=1048576 2024-03-04T12:26:50.657 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.650+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~H0NU3EYSMAWO.2 size=489987 2024-03-04T12:26:50.659 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.652+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=H0NU3EYSMAWO tag=9DLI9YR2ARZ2 type=write size=3635715 2024-03-04T12:26:50.660 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.654+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~Z8H2LXI9XTNA.0 size=201229 2024-03-04T12:26:50.660 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.654+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=Z8H2LXI9XTNA tag=Z7GS75CAS2XU type=write size=1249805 2024-03-04T12:26:50.662 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.655+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=58XT05O41OFM type=del 2024-03-04T12:26:50.664 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.657+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~3VE0TXN3RNZK.0 size=1008997 2024-03-04T12:26:50.664 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.657+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=3VE0TXN3RNZK tag=J2D082QYQCCG type=write size=2057573 2024-03-04T12:26:50.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.658+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~5463YSU2HU9Y.0 size=1048576 2024-03-04T12:26:50.666 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.659+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~5463YSU2HU9Y.1 size=190393 2024-03-04T12:26:50.668 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.661+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=5463YSU2HU9Y tag=L0XEYTBTYTNA type=write size=2287545 2024-03-04T12:26:50.670 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.663+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=JQ4L3PM7JGPC type=del size=239978 2024-03-04T12:26:50.670 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.664+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~0NKNHDT2BG5A.0 size=1048576 2024-03-04T12:26:50.672 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.665+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~0NKNHDT2BG5A.1 size=1048576 2024-03-04T12:26:50.672 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.666+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~0NKNHDT2BG5A.2 size=229209 2024-03-04T12:26:50.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.667+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=0NKNHDT2BG5A tag=T46RU81AI8WV type=write size=3374937 2024-03-04T12:26:50.675 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.669+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=I06J806GTAHN type=del size=4100801 2024-03-04T12:26:50.678 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.671+0000 7fa4b3c3e780 1 < suggested remove operation key=VAIY4J3CYONH tag=MEXBUQVO3A88 type=del 2024-03-04T12:26:50.680 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.673+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~VENKBMTZU8HV.0 size=6912 2024-03-04T12:26:50.680 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.673+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=VENKBMTZU8HV tag=Y1JZFNZUB6CO type=write size=1055488 2024-03-04T12:26:50.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.675+0000 7fa4b3c3e780 1 < suggested update operation key=R1DOKJPZRT5Q tag=XR22EEVKRR41 type=write size=771660 2024-03-04T12:26:50.683 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.676+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=7BZ6YCVQFX3Q type=del size=939241 2024-03-04T12:26:50.685 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.678+0000 7fa4b3c3e780 1 < suggested remove operation key=YWJV4QMY6ZBI tag=WCJMLJAIKEKS type=del 2024-03-04T12:26:50.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.679+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=SF2597CA7QY1 type=del size=2604675 2024-03-04T12:26:50.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.680+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~67HFN9QSL2TH.0 size=776550 2024-03-04T12:26:50.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.682+0000 7fa4b3c3e780 1 < completed multipart upload key=R1DOKJPZRT5Q upload=67HFN9QSL2TH tag=G7QO6HTB4NH3 type=write size=1825126 2024-03-04T12:26:50.691 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.684+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=B11CPO9P21VL type=del size=667130 2024-03-04T12:26:50.692 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.685+0000 7fa4b3c3e780 1 < canceled operation key=BR8RTE2QEH9E tag=XV4JZ1TV15JG type=del size=2289319 2024-03-04T12:26:50.693 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.686+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=XHMOJ1YW0LK7 type=del size=2836698 2024-03-04T12:26:50.694 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.687+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=B4EH8Z74U1U1 type=del 2024-03-04T12:26:50.696 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.689+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~33WENCFNSJH6.0 size=1048576 2024-03-04T12:26:50.697 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.690+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~33WENCFNSJH6.1 size=625021 2024-03-04T12:26:50.697 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.690+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=33WENCFNSJH6 tag=3FF4PW2D3BL1 type=write size=2722173 2024-03-04T12:26:50.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.691+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~JJ6QDSNOL6DH.0 size=150933 2024-03-04T12:26:50.700 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.693+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=JJ6QDSNOL6DH tag=V41J25K4WBCO type=write size=1199509 2024-03-04T12:26:50.702 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.695+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~ZQM3YEZ40LL2.0 size=1048576 2024-03-04T12:26:50.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.696+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~ZQM3YEZ40LL2.1 size=439401 2024-03-04T12:26:50.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.696+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=ZQM3YEZ40LL2 tag=8VF1E8NUREUO type=write size=2536553 2024-03-04T12:26:50.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.698+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~RFLH56W7497B.0 size=1048576 2024-03-04T12:26:50.706 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.699+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~RFLH56W7497B.1 size=1048576 2024-03-04T12:26:50.706 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.699+0000 7fa4b3c3e780 1 < canceled part key=_multipart_6XK4DQ940Z5J.2~RFLH56W7497B.2 size=133523 2024-03-04T12:26:50.708 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.701+0000 7fa4b3c3e780 1 < canceled multipart upload key=6XK4DQ940Z5J upload=RFLH56W7497B tag=107BZQ8CULN7 type=write size=3279251 2024-03-04T12:26:50.709 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.702+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=A7D7IZHXASS0 type=del size=3446598 2024-03-04T12:26:50.710 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.703+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~2AT5HSB09PYJ.0 size=1048576 2024-03-04T12:26:50.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.704+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~2AT5HSB09PYJ.1 size=783632 2024-03-04T12:26:50.712 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.706+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=2AT5HSB09PYJ tag=9R2SJLGHW06M type=write size=2880784 2024-03-04T12:26:50.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.707+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=9MJJC16YHBUS type=write size=57497 2024-03-04T12:26:50.715 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.708+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=TP9C4UZNQ796 type=del 2024-03-04T12:26:50.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.710+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~T1UV8SU22RR9.0 size=1048576 2024-03-04T12:26:50.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.711+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~T1UV8SU22RR9.1 size=868618 2024-03-04T12:26:50.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.711+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=T1UV8SU22RR9 tag=69G8HA7PSMZE type=write size=2965770 2024-03-04T12:26:50.719 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.712+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=6WTFC5H3MLV1 type=del 2024-03-04T12:26:50.721 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.714+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~5KJQOE40KM7S.0 size=1048576 2024-03-04T12:26:50.722 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.715+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~5KJQOE40KM7S.1 size=165233 2024-03-04T12:26:50.722 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.715+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=5KJQOE40KM7S tag=XC7H7HHCKNR5 type=write size=2262385 2024-03-04T12:26:50.723 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.716+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~TMAPTWUQ0BBU.0 size=89418 2024-03-04T12:26:50.725 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.718+0000 7fa4b3c3e780 1 < completed multipart upload key=4LKTYP07OL5L upload=TMAPTWUQ0BBU tag=2DJZUAUW57R2 type=write size=1137994 2024-03-04T12:26:50.726 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.719+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=7FLQEOXQXJNG type=write size=492930 2024-03-04T12:26:50.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.720+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~Z8H2LXI9XTNA.0 size=201229 2024-03-04T12:26:50.729 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.722+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=Z8H2LXI9XTNA tag=Z7GS75CAS2XU type=write size=1249805 2024-03-04T12:26:50.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.724+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~66ROV2BFLVVP.0 size=1048576 2024-03-04T12:26:50.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.725+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~66ROV2BFLVVP.1 size=1048576 2024-03-04T12:26:50.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.726+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~66ROV2BFLVVP.2 size=161387 2024-03-04T12:26:50.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.726+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=66ROV2BFLVVP tag=7SNL4T4J205A type=write size=3307115 2024-03-04T12:26:50.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.726+0000 7fa4b3c3e780 1 < canceled part key=_multipart_GMIPCGYZRJ5L.2~3VE0TXN3RNZK.0 size=1008997 2024-03-04T12:26:50.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.728+0000 7fa4b3c3e780 1 < canceled multipart upload key=GMIPCGYZRJ5L upload=3VE0TXN3RNZK tag=J2D082QYQCCG type=write size=2057573 2024-03-04T12:26:50.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.730+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~PMMPWTXXHP53.0 size=1048576 2024-03-04T12:26:50.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.731+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~PMMPWTXXHP53.1 size=1048576 2024-03-04T12:26:50.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.732+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~PMMPWTXXHP53.2 size=811173 2024-03-04T12:26:50.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.732+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=PMMPWTXXHP53 tag=XJ6T5PP5HQ77 type=write size=3956901 2024-03-04T12:26:50.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.733+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=JQ4L3PM7JGPC type=del 2024-03-04T12:26:50.741 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.734+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=NTRAENQ8I5SU type=del size=397963 2024-03-04T12:26:50.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.735+0000 7fa4b3c3e780 -1 < failed to complete operation key=VAIY4J3CYONH tag=I06J806GTAHN type=del size=4100801: (22) Invalid argument 2024-03-04T12:26:50.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.737+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~WC31UAWUMUQB.0 size=1048576 2024-03-04T12:26:50.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.738+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~WC31UAWUMUQB.1 size=1048576 2024-03-04T12:26:50.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.739+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~WC31UAWUMUQB.2 size=473867 2024-03-04T12:26:50.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.739+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=WC31UAWUMUQB tag=RS5E5M0KFIC8 type=write size=3619595 2024-03-04T12:26:50.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.740+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~VENKBMTZU8HV.0 size=6912 2024-03-04T12:26:50.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.742+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=VENKBMTZU8HV tag=Y1JZFNZUB6CO type=write size=1055488 2024-03-04T12:26:50.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.744+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~LFVDFT2UOEXL.0 size=615762 2024-03-04T12:26:50.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.744+0000 7fa4b3c3e780 1 > prepared multipart upload key=4LKTYP07OL5L upload=LFVDFT2UOEXL tag=RW656Y9HS8VN type=write size=1664338 2024-03-04T12:26:50.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.746+0000 7fa4b3c3e780 1 < suggested update operation key=T301TK0FIOG4 tag=7BZ6YCVQFX3Q type=del size=939241 2024-03-04T12:26:50.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.749+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~WHVXO7MFV2LV.0 size=1048576 2024-03-04T12:26:50.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.749+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~WHVXO7MFV2LV.1 size=1048576 2024-03-04T12:26:50.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.750+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~WHVXO7MFV2LV.2 size=762310 2024-03-04T12:26:50.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.750+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=WHVXO7MFV2LV tag=0SWY4VC48W91 type=write size=3908038 2024-03-04T12:26:50.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.752+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=SF2597CA7QY1 type=del 2024-03-04T12:26:50.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.754+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~MG0HHXF0PD3M.0 size=545877 2024-03-04T12:26:50.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.754+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=MG0HHXF0PD3M tag=23XC44428425 type=write size=1594453 2024-03-04T12:26:50.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.755+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=B11CPO9P21VL type=del 2024-03-04T12:26:50.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.756+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=PGYERLUBXPTA type=del size=2280566 2024-03-04T12:26:50.764 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.757+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=XHMOJ1YW0LK7 type=del 2024-03-04T12:26:50.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.759+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~UJE8450DW8IU.0 size=1048576 2024-03-04T12:26:50.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.760+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~UJE8450DW8IU.1 size=1011410 2024-03-04T12:26:50.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.760+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=UJE8450DW8IU tag=31F0XADOI16Q type=write size=3108562 2024-03-04T12:26:50.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.761+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~33WENCFNSJH6.0 size=1048576 2024-03-04T12:26:50.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.762+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~33WENCFNSJH6.1 size=625021 2024-03-04T12:26:50.771 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.764+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=33WENCFNSJH6 tag=3FF4PW2D3BL1 type=write size=2722173 2024-03-04T12:26:50.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.766+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=2VEC0A8G1J0I type=del size=3572110 2024-03-04T12:26:50.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.767+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~ZQM3YEZ40LL2.0 size=1048576 2024-03-04T12:26:50.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.768+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~ZQM3YEZ40LL2.1 size=439401 2024-03-04T12:26:50.777 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.770+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=ZQM3YEZ40LL2 tag=8VF1E8NUREUO type=write size=2536553 2024-03-04T12:26:50.778 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.771+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=HT71KBMEJHN5 type=write size=317406 2024-03-04T12:26:50.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.772+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=A7D7IZHXASS0 type=del 2024-03-04T12:26:50.780 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.773+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=GZ8OXZUMR39G type=del size=699269 2024-03-04T12:26:50.781 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.774+0000 7fa4b3c3e780 1 < completed write operation key=4989OME3IAJF tag=9MJJC16YHBUS type=write size=57497 2024-03-04T12:26:50.782 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.775+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=ESY50JBK75MW type=del size=1339164 2024-03-04T12:26:50.783 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.776+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~T1UV8SU22RR9.0 size=1048576 2024-03-04T12:26:50.783 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.776+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YIS2SV4O5EZN.2~T1UV8SU22RR9.1 size=868618 2024-03-04T12:26:50.785 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.778+0000 7fa4b3c3e780 1 < canceled multipart upload key=YIS2SV4O5EZN upload=T1UV8SU22RR9 tag=69G8HA7PSMZE type=write size=2965770 2024-03-04T12:26:50.787 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.780+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~G3UXDC7KX28I.0 size=1048576 2024-03-04T12:26:50.788 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.781+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~G3UXDC7KX28I.1 size=1048576 2024-03-04T12:26:50.788 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.782+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~G3UXDC7KX28I.2 size=1036074 2024-03-04T12:26:50.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.782+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=G3UXDC7KX28I tag=Y3WK68TAJPZK type=write size=4181802 2024-03-04T12:26:50.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.783+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~5KJQOE40KM7S.0 size=1048576 2024-03-04T12:26:50.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.784+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~5KJQOE40KM7S.1 size=165233 2024-03-04T12:26:50.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.785+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=5KJQOE40KM7S tag=XC7H7HHCKNR5 type=write size=2262385 2024-03-04T12:26:50.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.787+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=2TKVOU7IFNT7 type=del size=2840547 2024-03-04T12:26:50.795 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.789+0000 7fa4b3c3e780 1 < suggested update operation key=UZRX3W3DE5VX tag=7FLQEOXQXJNG type=write size=492930 2024-03-04T12:26:50.797 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.791+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~ZQG7BRET7BDE.0 size=1048576 2024-03-04T12:26:50.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.791+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~ZQG7BRET7BDE.1 size=1048576 2024-03-04T12:26:50.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.792+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~ZQG7BRET7BDE.2 size=227965 2024-03-04T12:26:50.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.792+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=ZQG7BRET7BDE tag=YT4XWJKKLKQG type=write size=3373693 2024-03-04T12:26:50.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.794+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~66ROV2BFLVVP.0 size=1048576 2024-03-04T12:26:50.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.794+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~66ROV2BFLVVP.1 size=1048576 2024-03-04T12:26:50.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.795+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~66ROV2BFLVVP.2 size=161387 2024-03-04T12:26:50.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.797+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=66ROV2BFLVVP tag=7SNL4T4J205A type=write size=3307115 2024-03-04T12:26:50.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.799+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~UZC7SFQNHVPQ.0 size=642734 2024-03-04T12:26:50.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.799+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=UZC7SFQNHVPQ tag=F5DGS1ZWOCPC type=write size=1691310 2024-03-04T12:26:50.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.799+0000 7fa4b3c3e780 1 < canceled part key=_multipart_7IUV88NQLPN8.2~PMMPWTXXHP53.0 size=1048576 2024-03-04T12:26:50.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.800+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~PMMPWTXXHP53.1 size=1048576 2024-03-04T12:26:50.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.800+0000 7fa4b3c3e780 1 < canceled part key=_multipart_7IUV88NQLPN8.2~PMMPWTXXHP53.2 size=811173 2024-03-04T12:26:50.809 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.802+0000 7fa4b3c3e780 1 < canceled multipart upload key=7IUV88NQLPN8 upload=PMMPWTXXHP53 tag=XJ6T5PP5HQ77 type=write size=3956901 2024-03-04T12:26:50.810 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.803+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=11GCYDYETA1P type=del size=3009065 2024-03-04T12:26:50.811 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.804+0000 7fa4b3c3e780 1 < canceled operation key=6XK4DQ940Z5J tag=NTRAENQ8I5SU type=del size=397963 2024-03-04T12:26:50.812 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.805+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=XK0VK09A4Z1K type=del size=1721722 2024-03-04T12:26:50.813 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.806+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~WC31UAWUMUQB.0 size=1048576 2024-03-04T12:26:50.814 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.807+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~WC31UAWUMUQB.1 size=1048576 2024-03-04T12:26:50.815 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.808+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~WC31UAWUMUQB.2 size=473867 2024-03-04T12:26:50.816 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.810+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=WC31UAWUMUQB tag=RS5E5M0KFIC8 type=write size=3619595 2024-03-04T12:26:50.818 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.811+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=QKQF7RJ7CHJP type=del size=1370981 2024-03-04T12:26:50.819 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.812+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~LFVDFT2UOEXL.0 size=615762 2024-03-04T12:26:50.820 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.814+0000 7fa4b3c3e780 1 < completed multipart upload key=4LKTYP07OL5L upload=LFVDFT2UOEXL tag=RW656Y9HS8VN type=write size=1664338 2024-03-04T12:26:50.821 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.815+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=CMXGKVWA6FJF type=del size=377452 2024-03-04T12:26:50.822 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.816+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~WHVXO7MFV2LV.0 size=1048576 2024-03-04T12:26:50.822 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.816+0000 7fa4b3c3e780 1 < canceled part key=_multipart_WRHB3XWDLSY2.2~WHVXO7MFV2LV.1 size=1048576 2024-03-04T12:26:50.823 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.816+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~WHVXO7MFV2LV.2 size=762310 2024-03-04T12:26:50.825 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.818+0000 7fa4b3c3e780 1 < canceled multipart upload key=WRHB3XWDLSY2 upload=WHVXO7MFV2LV tag=0SWY4VC48W91 type=write size=3908038 2024-03-04T12:26:50.827 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.820+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~Z3EQ2FM71R7Z.0 size=24851 2024-03-04T12:26:50.827 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.820+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=Z3EQ2FM71R7Z tag=941VB2HLYSD6 type=write size=1073427 2024-03-04T12:26:50.828 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.821+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~MG0HHXF0PD3M.0 size=545877 2024-03-04T12:26:50.830 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.823+0000 7fa4b3c3e780 1 < completed multipart upload key=R1DOKJPZRT5Q upload=MG0HHXF0PD3M tag=23XC44428425 type=write size=1594453 2024-03-04T12:26:50.832 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.825+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~K3KO7GSL8DDC.0 size=1048576 2024-03-04T12:26:50.833 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.826+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~K3KO7GSL8DDC.1 size=1048576 2024-03-04T12:26:50.834 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.827+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~K3KO7GSL8DDC.2 size=731003 2024-03-04T12:26:50.834 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.827+0000 7fa4b3c3e780 1 > prepared multipart upload key=4LKTYP07OL5L upload=K3KO7GSL8DDC tag=X782U4J0G9UY type=write size=3876731 2024-03-04T12:26:50.836 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.829+0000 7fa4b3c3e780 1 < suggested update operation key=G8G76PMSKJ0I tag=PGYERLUBXPTA type=del size=2280566 2024-03-04T12:26:50.837 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.830+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=W0UXNMI1NAIF type=del size=1791546 2024-03-04T12:26:50.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.831+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~UJE8450DW8IU.0 size=1048576 2024-03-04T12:26:50.839 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.832+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~UJE8450DW8IU.1 size=1011410 2024-03-04T12:26:50.841 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.834+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=UJE8450DW8IU tag=31F0XADOI16Q type=write size=3108562 2024-03-04T12:26:50.843 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.836+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~FVPM69WI1X69.0 size=353648 2024-03-04T12:26:50.843 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.836+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=FVPM69WI1X69 tag=1EFIYTDE1OFR type=write size=1402224 2024-03-04T12:26:50.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.837+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=2VEC0A8G1J0I type=del 2024-03-04T12:26:50.846 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.839+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~3OQOJVMPAM8B.0 size=1048576 2024-03-04T12:26:50.847 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.840+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~3OQOJVMPAM8B.1 size=164416 2024-03-04T12:26:50.847 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.840+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=3OQOJVMPAM8B tag=PL1PSQT44MC6 type=write size=2261568 2024-03-04T12:26:50.848 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.841+0000 7fa4b3c3e780 1 < completed write operation key=KKQT9J9GSW0N tag=HT71KBMEJHN5 type=write size=317406 2024-03-04T12:26:50.849 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.842+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=Y5TU4CBDA71U type=write size=45721 2024-03-04T12:26:50.850 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.844+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=GZ8OXZUMR39G type=del 2024-03-04T12:26:50.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.846+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~AA9KWBXDIHYW.0 size=350783 2024-03-04T12:26:50.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.846+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=AA9KWBXDIHYW tag=4X3TFJLP4OQD type=write size=1399359 2024-03-04T12:26:50.853 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.847+0000 7fa4b3c3e780 1 < completed delete operation key=X0RVLNRWUAEM tag=ESY50JBK75MW type=del 2024-03-04T12:26:50.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.848+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=KDHQK8FUUD7B type=del size=282709 2024-03-04T12:26:50.856 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.849+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~G3UXDC7KX28I.0 size=1048576 2024-03-04T12:26:50.856 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.850+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~G3UXDC7KX28I.1 size=1048576 2024-03-04T12:26:50.857 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.851+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~G3UXDC7KX28I.2 size=1036074 2024-03-04T12:26:50.859 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.853+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=G3UXDC7KX28I tag=Y3WK68TAJPZK type=write size=4181802 2024-03-04T12:26:50.860 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.854+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=TNJOOAEPL8QY type=write size=928101 2024-03-04T12:26:50.862 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.855+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=2TKVOU7IFNT7 type=del 2024-03-04T12:26:50.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.856+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=S7AUYI668SJM type=del size=3982715 2024-03-04T12:26:50.864 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.857+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~ZQG7BRET7BDE.0 size=1048576 2024-03-04T12:26:50.865 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.858+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~ZQG7BRET7BDE.1 size=1048576 2024-03-04T12:26:50.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.859+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~ZQG7BRET7BDE.2 size=227965 2024-03-04T12:26:50.867 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.861+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=ZQG7BRET7BDE tag=YT4XWJKKLKQG type=write size=3373693 2024-03-04T12:26:50.870 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.863+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~SVFAMVESSZAB.0 size=1048576 2024-03-04T12:26:50.871 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.864+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~SVFAMVESSZAB.1 size=1048576 2024-03-04T12:26:50.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.866+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~SVFAMVESSZAB.2 size=254039 2024-03-04T12:26:50.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.866+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=SVFAMVESSZAB tag=179QAU8VR73V type=write size=3399767 2024-03-04T12:26:50.874 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.867+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~UZC7SFQNHVPQ.0 size=642734 2024-03-04T12:26:50.876 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.869+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=UZC7SFQNHVPQ tag=F5DGS1ZWOCPC type=write size=1691310 2024-03-04T12:26:50.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.871+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~DX0ZUUY8MQN5.0 size=1048576 2024-03-04T12:26:50.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.872+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~DX0ZUUY8MQN5.1 size=759876 2024-03-04T12:26:50.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.872+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=DX0ZUUY8MQN5 tag=FGE3KZ2U1802 type=write size=2857028 2024-03-04T12:26:50.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.873+0000 7fa4b3c3e780 1 < canceled operation key=3TDMQXKLPX34 tag=11GCYDYETA1P type=del size=3009065 2024-03-04T12:26:50.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.874+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=K440TLTO1MOI type=del size=3802916 2024-03-04T12:26:50.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.876+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=XK0VK09A4Z1K type=del 2024-03-04T12:26:50.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.878+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~HHFDZEF4IO8G.0 size=1048576 2024-03-04T12:26:50.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.879+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~HHFDZEF4IO8G.1 size=1028967 2024-03-04T12:26:50.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.879+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=HHFDZEF4IO8G tag=ICRZW6VCC2BR type=write size=3126119 2024-03-04T12:26:50.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.881+0000 7fa4b3c3e780 1 < suggested remove operation key=ZETES4AYZQHY tag=QKQF7RJ7CHJP type=del 2024-03-04T12:26:50.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.883+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~KLGXATOQLX2I.0 size=1048576 2024-03-04T12:26:50.891 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.884+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~KLGXATOQLX2I.1 size=1048576 2024-03-04T12:26:50.892 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.885+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~KLGXATOQLX2I.2 size=884415 2024-03-04T12:26:50.892 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.885+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=KLGXATOQLX2I tag=R9YOIHFFNMF2 type=write size=4030143 2024-03-04T12:26:50.893 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.887+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=CMXGKVWA6FJF type=del 2024-03-04T12:26:50.895 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.888+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=2G3OS2RQS3EW type=del size=924757 2024-03-04T12:26:50.896 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.889+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~Z3EQ2FM71R7Z.0 size=24851 2024-03-04T12:26:50.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.891+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=Z3EQ2FM71R7Z tag=941VB2HLYSD6 type=write size=1073427 2024-03-04T12:26:50.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.893+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~QLQT3FGH6CRC.0 size=218120 2024-03-04T12:26:50.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.893+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=QLQT3FGH6CRC tag=062PVV09NC80 type=write size=1266696 2024-03-04T12:26:50.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.894+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~K3KO7GSL8DDC.0 size=1048576 2024-03-04T12:26:50.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.895+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~K3KO7GSL8DDC.1 size=1048576 2024-03-04T12:26:50.903 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.896+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~K3KO7GSL8DDC.2 size=731003 2024-03-04T12:26:50.905 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.898+0000 7fa4b3c3e780 1 < completed multipart upload key=4LKTYP07OL5L upload=K3KO7GSL8DDC tag=X782U4J0G9UY type=write size=3876731 2024-03-04T12:26:50.906 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.899+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=LOV4ZHX9H8GM type=del size=2026901 2024-03-04T12:26:50.908 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.901+0000 7fa4b3c3e780 1 < suggested update operation key=X0RVLNRWUAEM tag=W0UXNMI1NAIF type=del size=1791546 2024-03-04T12:26:50.909 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.903+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=XNY2DGLC8VWZ type=del size=3592213 2024-03-04T12:26:50.910 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.904+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~FVPM69WI1X69.0 size=353648 2024-03-04T12:26:50.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.906+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=FVPM69WI1X69 tag=1EFIYTDE1OFR type=write size=1402224 2024-03-04T12:26:50.913 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.907+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=JMGDJ1Y11429 type=write size=88546 2024-03-04T12:26:50.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.908+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~3OQOJVMPAM8B.0 size=1048576 2024-03-04T12:26:50.915 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.909+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~3OQOJVMPAM8B.1 size=164416 2024-03-04T12:26:50.917 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.910+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=3OQOJVMPAM8B tag=PL1PSQT44MC6 type=write size=2261568 2024-03-04T12:26:50.918 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.911+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=7G2JC51SRWQW type=del size=3531955 2024-03-04T12:26:50.920 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.914+0000 7fa4b3c3e780 1 < suggested remove operation key=G4SUQFVB936T tag=Y5TU4CBDA71U type=write 2024-03-04T12:26:50.922 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.915+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=TI56EU2GOL7A type=del size=1580573 2024-03-04T12:26:50.923 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.916+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~AA9KWBXDIHYW.0 size=350783 2024-03-04T12:26:50.925 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.918+0000 7fa4b3c3e780 1 < completed multipart upload key=3N6E09QF3866 upload=AA9KWBXDIHYW tag=4X3TFJLP4OQD type=write size=1399359 2024-03-04T12:26:50.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.920+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~NZOARIIJ12O1.0 size=1048576 2024-03-04T12:26:50.928 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.921+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~NZOARIIJ12O1.1 size=935218 2024-03-04T12:26:50.928 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.921+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=NZOARIIJ12O1 tag=5H24Z4HYT8AL type=write size=3032370 2024-03-04T12:26:50.930 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.923+0000 7fa4b3c3e780 1 < suggested remove operation key=G8G76PMSKJ0I tag=KDHQK8FUUD7B type=del 2024-03-04T12:26:50.931 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.925+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=MGP8K26F11T3 type=del size=3325644 2024-03-04T12:26:50.933 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.927+0000 7fa4b3c3e780 1 < suggested update operation key=NVMIU38VM9Q1 tag=TNJOOAEPL8QY type=write size=928101 2024-03-04T12:26:50.935 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.928+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=1DJNCXCEBKXK type=del size=2374473 2024-03-04T12:26:50.935 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.928+0000 7fa4b3c3e780 -1 < no bi entry to suggest for operation key=ZETES4AYZQHY tag=S7AUYI668SJM type=del size=3982715: (2) No such file or directory 2024-03-04T12:26:50.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.930+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~5MOM3CHXQ236.0 size=1048576 2024-03-04T12:26:50.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.931+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~5MOM3CHXQ236.1 size=753505 2024-03-04T12:26:50.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.931+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=5MOM3CHXQ236 tag=BTHYN4GI1AFD type=write size=2850657 2024-03-04T12:26:50.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.933+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~SVFAMVESSZAB.0 size=1048576 2024-03-04T12:26:50.940 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.933+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~SVFAMVESSZAB.1 size=1048576 2024-03-04T12:26:50.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.934+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~SVFAMVESSZAB.2 size=254039 2024-03-04T12:26:50.943 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.936+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=SVFAMVESSZAB tag=179QAU8VR73V type=write size=3399767 2024-03-04T12:26:50.944 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.937+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=G1K1NMG56OQ1 type=del size=1761918 2024-03-04T12:26:50.945 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.939+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~DX0ZUUY8MQN5.0 size=1048576 2024-03-04T12:26:50.946 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.940+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~DX0ZUUY8MQN5.1 size=759876 2024-03-04T12:26:50.948 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.941+0000 7fa4b3c3e780 1 < completed multipart upload key=BVMWQ9ZL4K0C upload=DX0ZUUY8MQN5 tag=FGE3KZ2U1802 type=write size=2857028 2024-03-04T12:26:50.949 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.943+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=TFP5UV2GTEOK type=del size=1989172 2024-03-04T12:26:50.952 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.945+0000 7fa4b3c3e780 1 < suggested remove operation key=4LKTYP07OL5L tag=K440TLTO1MOI type=del 2024-03-04T12:26:50.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.946+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=9QY8BUMXF3F6 type=write size=209530 2024-03-04T12:26:50.954 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.947+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~HHFDZEF4IO8G.0 size=1048576 2024-03-04T12:26:50.955 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.948+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~HHFDZEF4IO8G.1 size=1028967 2024-03-04T12:26:50.956 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.950+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=HHFDZEF4IO8G tag=ICRZW6VCC2BR type=write size=3126119 2024-03-04T12:26:50.958 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.951+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=LTV8V8YR9XSB type=del size=1133662 2024-03-04T12:26:50.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.952+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~KLGXATOQLX2I.0 size=1048576 2024-03-04T12:26:50.960 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.953+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~KLGXATOQLX2I.1 size=1048576 2024-03-04T12:26:50.961 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.954+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~KLGXATOQLX2I.2 size=884415 2024-03-04T12:26:50.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.956+0000 7fa4b3c3e780 1 < completed multipart upload key=H5FWRNK8F7QT upload=KLGXATOQLX2I tag=R9YOIHFFNMF2 type=write size=4030143 2024-03-04T12:26:50.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.957+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=KHDF3C2JOLSP type=del size=2225306 2024-03-04T12:26:50.965 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.958+0000 7fa4b3c3e780 -1 < failed to complete operation key=G8G76PMSKJ0I tag=2G3OS2RQS3EW type=del size=924757: (22) Invalid argument 2024-03-04T12:26:50.966 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.959+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=CNCKGZNNKTN9 type=del size=1103653 2024-03-04T12:26:50.967 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.960+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~QLQT3FGH6CRC.0 size=218120 2024-03-04T12:26:50.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.962+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=QLQT3FGH6CRC tag=062PVV09NC80 type=write size=1266696 2024-03-04T12:26:50.970 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.963+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=VBQVB3BSSBTO type=del size=3672881 2024-03-04T12:26:50.971 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.965+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=LOV4ZHX9H8GM type=del 2024-03-04T12:26:50.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.966+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=Q9CW28FKMGJU type=del size=2359862 2024-03-04T12:26:50.973 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.967+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=XNY2DGLC8VWZ type=del 2024-03-04T12:26:50.975 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.969+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~SVUL107KEYPB.0 size=480052 2024-03-04T12:26:50.975 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.969+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=SVUL107KEYPB tag=ZI3LYYGB9GBQ type=write size=1528628 2024-03-04T12:26:50.976 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.970+0000 7fa4b3c3e780 1 < completed write operation key=V7N7MZ1GUNEV tag=JMGDJ1Y11429 type=write size=88546 2024-03-04T12:26:50.978 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.971+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=D7G0NX2LWBA4 type=del size=1498110 2024-03-04T12:26:50.980 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.973+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=7G2JC51SRWQW type=del 2024-03-04T12:26:50.981 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.974+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=5DEFL6E49Y4U type=write size=985388 2024-03-04T12:26:50.982 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.976+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=TI56EU2GOL7A type=del 2024-03-04T12:26:50.983 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.977+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=8CC1KVLASW4P type=del size=2392714 2024-03-04T12:26:50.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.978+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~NZOARIIJ12O1.0 size=1048576 2024-03-04T12:26:50.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.979+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~NZOARIIJ12O1.1 size=935218 2024-03-04T12:26:50.988 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.981+0000 7fa4b3c3e780 1 < completed multipart upload key=V7N7MZ1GUNEV upload=NZOARIIJ12O1 tag=5H24Z4HYT8AL type=write size=3032370 2024-03-04T12:26:50.988 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.982+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=XXNP44LE1J63 type=write size=493448 2024-03-04T12:26:50.990 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.983+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=MGP8K26F11T3 type=del 2024-03-04T12:26:50.991 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.984+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=FXKI3FOEWUCM type=del size=2449369 2024-03-04T12:26:50.992 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.986+0000 7fa4b3c3e780 1 < completed delete operation key=R1DOKJPZRT5Q tag=1DJNCXCEBKXK type=del 2024-03-04T12:26:50.994 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.987+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=8ZXDJY0IDRGS type=write size=1015532 2024-03-04T12:26:50.995 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.988+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~5MOM3CHXQ236.0 size=1048576 2024-03-04T12:26:50.996 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.989+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~5MOM3CHXQ236.1 size=753505 2024-03-04T12:26:50.997 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.991+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=5MOM3CHXQ236 tag=BTHYN4GI1AFD type=write size=2850657 2024-03-04T12:26:51.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.993+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~OE4SOCB367G3.0 size=1048576 2024-03-04T12:26:51.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.994+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~OE4SOCB367G3.1 size=1048576 2024-03-04T12:26:51.002 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.995+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~OE4SOCB367G3.2 size=107285 2024-03-04T12:26:51.002 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.995+0000 7fa4b3c3e780 1 > prepared multipart upload key=G8G76PMSKJ0I upload=OE4SOCB367G3 tag=8YQ8SUS1EL0P type=write size=3253013 2024-03-04T12:26:51.003 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.996+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=G1K1NMG56OQ1 type=del 2024-03-04T12:26:51.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.997+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=I82KQ0O4I0BY type=write size=996297 2024-03-04T12:26:51.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:50.998+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=TFP5UV2GTEOK type=del 2024-03-04T12:26:51.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.000+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~E64900246TP3.0 size=755875 2024-03-04T12:26:51.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.000+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=E64900246TP3 tag=4M1PVEXQ6KK0 type=write size=1804451 2024-03-04T12:26:51.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.001+0000 7fa4b3c3e780 1 < completed write operation key=J53J0N99N30A tag=9QY8BUMXF3F6 type=write size=209530 2024-03-04T12:26:51.010 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.003+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~8UVWK32M86AF.0 size=906174 2024-03-04T12:26:51.010 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.003+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=8UVWK32M86AF tag=83YA36LOMC13 type=write size=1954750 2024-03-04T12:26:51.011 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.004+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=LTV8V8YR9XSB type=del 2024-03-04T12:26:51.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.005+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=9A2NYQDEKBOV type=write size=558183 2024-03-04T12:26:51.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.007+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=KHDF3C2JOLSP type=del 2024-03-04T12:26:51.014 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.008+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=A8M4Y5IG7XYF type=write size=811468 2024-03-04T12:26:51.017 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.010+0000 7fa4b3c3e780 1 < suggested remove operation key=H5FWRNK8F7QT tag=CNCKGZNNKTN9 type=del 2024-03-04T12:26:51.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.011+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=D5M1KBKO1S4W type=del size=3557154 2024-03-04T12:26:51.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.012+0000 7fa4b3c3e780 1 < canceled operation key=7IUV88NQLPN8 tag=VBQVB3BSSBTO type=del size=3672881 2024-03-04T12:26:51.020 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.013+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=HNWKC66SNXEG type=write size=806488 2024-03-04T12:26:51.021 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.014+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=Q9CW28FKMGJU type=del 2024-03-04T12:26:51.023 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.016+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~ZG0EJ0RQZ0OI.0 size=835962 2024-03-04T12:26:51.023 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.016+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=ZG0EJ0RQZ0OI tag=0J1LQ8Q8MYX6 type=write size=1884538 2024-03-04T12:26:51.024 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.018+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~SVUL107KEYPB.0 size=480052 2024-03-04T12:26:51.026 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.019+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=SVUL107KEYPB tag=ZI3LYYGB9GBQ type=write size=1528628 2024-03-04T12:26:51.027 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.021+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=GO25HGA0E2G0 type=del size=1518240 2024-03-04T12:26:51.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.022+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=D7G0NX2LWBA4 type=del 2024-03-04T12:26:51.030 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.023+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=NA0WNUH3JR5O type=del size=81757 2024-03-04T12:26:51.031 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.024+0000 7fa4b3c3e780 -1 < failed to complete operation key=H5FWRNK8F7QT tag=5DEFL6E49Y4U type=write size=985388: (22) Invalid argument 2024-03-04T12:26:51.033 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.026+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~3KQQ26ACVWTT.0 size=1048576 2024-03-04T12:26:51.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.027+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~3KQQ26ACVWTT.1 size=1048576 2024-03-04T12:26:51.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.028+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~3KQQ26ACVWTT.2 size=799250 2024-03-04T12:26:51.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.028+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=3KQQ26ACVWTT tag=Q29ENXVQ7F4L type=write size=3944978 2024-03-04T12:26:51.036 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.029+0000 7fa4b3c3e780 -1 < failed to complete operation key=H5FWRNK8F7QT tag=8CC1KVLASW4P type=del size=2392714: (22) Invalid argument 2024-03-04T12:26:51.037 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.030+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=PN9VLTC5WTY7 type=del size=757394 2024-03-04T12:26:51.038 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.031+0000 7fa4b3c3e780 1 < canceled operation key=YWJV4QMY6ZBI tag=XXNP44LE1J63 type=write size=493448 2024-03-04T12:26:51.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.033+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~QFS6Y9ZU8VP7.0 size=1048576 2024-03-04T12:26:51.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.034+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~QFS6Y9ZU8VP7.1 size=345620 2024-03-04T12:26:51.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.034+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=QFS6Y9ZU8VP7 tag=LUSCJISAHJN3 type=write size=2442772 2024-03-04T12:26:51.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.035+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=FXKI3FOEWUCM type=del 2024-03-04T12:26:51.044 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.037+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~3V2Z931SVF3Z.0 size=1048576 2024-03-04T12:26:51.045 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.038+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~3V2Z931SVF3Z.1 size=1048576 2024-03-04T12:26:51.046 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.039+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~3V2Z931SVF3Z.2 size=705626 2024-03-04T12:26:51.046 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.039+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=3V2Z931SVF3Z tag=AETU66VJJ1WW type=write size=3851354 2024-03-04T12:26:51.047 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.040+0000 7fa4b3c3e780 1 < completed write operation key=4989OME3IAJF tag=8ZXDJY0IDRGS type=write size=1015532 2024-03-04T12:26:51.048 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.041+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=88VSBNANWBOY type=del size=115117 2024-03-04T12:26:51.049 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.043+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~OE4SOCB367G3.0 size=1048576 2024-03-04T12:26:51.050 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.043+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~OE4SOCB367G3.1 size=1048576 2024-03-04T12:26:51.051 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.044+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~OE4SOCB367G3.2 size=107285 2024-03-04T12:26:51.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.046+0000 7fa4b3c3e780 1 < completed multipart upload key=G8G76PMSKJ0I upload=OE4SOCB367G3 tag=8YQ8SUS1EL0P type=write size=3253013 2024-03-04T12:26:51.055 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.049+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~H46ZGXG7U5LP.0 size=492007 2024-03-04T12:26:51.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.049+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=H46ZGXG7U5LP tag=XMNR5ER74MHC type=write size=1540583 2024-03-04T12:26:51.058 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.051+0000 7fa4b3c3e780 1 < suggested remove operation key=3N6E09QF3866 tag=I82KQ0O4I0BY type=write 2024-03-04T12:26:51.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.053+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~SY5AIHFFDCF7.0 size=391757 2024-03-04T12:26:51.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.053+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=SY5AIHFFDCF7 tag=L2RC1BU8Y3ZB type=write size=1440333 2024-03-04T12:26:51.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.054+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~E64900246TP3.0 size=755875 2024-03-04T12:26:51.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.056+0000 7fa4b3c3e780 1 < completed multipart upload key=3N6E09QF3866 upload=E64900246TP3 tag=4M1PVEXQ6KK0 type=write size=1804451 2024-03-04T12:26:51.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.058+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=96AL0Z3DAVKJ type=write size=293753 2024-03-04T12:26:51.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.059+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~8UVWK32M86AF.0 size=906174 2024-03-04T12:26:51.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.061+0000 7fa4b3c3e780 1 < completed multipart upload key=H5FWRNK8F7QT upload=8UVWK32M86AF tag=83YA36LOMC13 type=write size=1954750 2024-03-04T12:26:51.068 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.062+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=UJXSKCIGWO9M type=del size=3986536 2024-03-04T12:26:51.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.064+0000 7fa4b3c3e780 1 < suggested remove operation key=4LKTYP07OL5L tag=9A2NYQDEKBOV type=write 2024-03-04T12:26:51.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.065+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=K7P7CWBDHNDP type=del size=1228741 2024-03-04T12:26:51.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.066+0000 7fa4b3c3e780 1 < canceled operation key=BR8RTE2QEH9E tag=A8M4Y5IG7XYF type=write size=811468 2024-03-04T12:26:51.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.068+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~OE8CFVIBN27I.0 size=429326 2024-03-04T12:26:51.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.068+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=OE8CFVIBN27I tag=S71L72AUTFHG type=write size=1477902 2024-03-04T12:26:51.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.069+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=D5M1KBKO1S4W type=del 2024-03-04T12:26:51.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.071+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=0LN40VPH4LHM type=del size=3073174 2024-03-04T12:26:51.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.072+0000 7fa4b3c3e780 1 < completed write operation key=G70BJ2UARNCP tag=HNWKC66SNXEG type=write size=806488 2024-03-04T12:26:51.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.074+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~EX0FR61S2DAX.0 size=1048576 2024-03-04T12:26:51.081 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.075+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~EX0FR61S2DAX.1 size=339907 2024-03-04T12:26:51.081 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.075+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=EX0FR61S2DAX tag=RZNN6DRF6HPT type=write size=2437059 2024-03-04T12:26:51.082 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.076+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~ZG0EJ0RQZ0OI.0 size=835962 2024-03-04T12:26:51.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.078+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=ZG0EJ0RQZ0OI tag=0J1LQ8Q8MYX6 type=write size=1884538 2024-03-04T12:26:51.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.081+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~MHQQT5YM4GJY.0 size=1048576 2024-03-04T12:26:51.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.081+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~MHQQT5YM4GJY.1 size=177102 2024-03-04T12:26:51.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.081+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=MHQQT5YM4GJY tag=GRE4WR23YFUX type=write size=2274254 2024-03-04T12:26:51.089 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.083+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=GO25HGA0E2G0 type=del 2024-03-04T12:26:51.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.084+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=150HKNI4PI9K type=del size=3328083 2024-03-04T12:26:51.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.085+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=NA0WNUH3JR5O type=del 2024-03-04T12:26:51.094 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.087+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~QI3210IQ4RAB.0 size=1048576 2024-03-04T12:26:51.095 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.088+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~QI3210IQ4RAB.1 size=202283 2024-03-04T12:26:51.095 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.088+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=QI3210IQ4RAB tag=WUA16ARUL8DF type=write size=2299435 2024-03-04T12:26:51.095 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.088+0000 7fa4b3c3e780 1 < canceled part key=_multipart_T301TK0FIOG4.2~3KQQ26ACVWTT.0 size=1048576 2024-03-04T12:26:51.096 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.089+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~3KQQ26ACVWTT.1 size=1048576 2024-03-04T12:26:51.096 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.089+0000 7fa4b3c3e780 1 < canceled part key=_multipart_T301TK0FIOG4.2~3KQQ26ACVWTT.2 size=799250 2024-03-04T12:26:51.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.091+0000 7fa4b3c3e780 1 < canceled multipart upload key=T301TK0FIOG4 upload=3KQQ26ACVWTT tag=Q29ENXVQ7F4L type=write size=3944978 2024-03-04T12:26:51.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.092+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=UV7AL32XTJNM type=del size=3963159 2024-03-04T12:26:51.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.093+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=PN9VLTC5WTY7 type=del 2024-03-04T12:26:51.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.095+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=R9YI8HFTI0PO type=del size=3934415 2024-03-04T12:26:51.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.096+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~QFS6Y9ZU8VP7.0 size=1048576 2024-03-04T12:26:51.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.097+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~QFS6Y9ZU8VP7.1 size=345620 2024-03-04T12:26:51.105 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.098+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=QFS6Y9ZU8VP7 tag=LUSCJISAHJN3 type=write size=2442772 2024-03-04T12:26:51.106 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.100+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=10HLRG9NF2Q1 type=del size=568527 2024-03-04T12:26:51.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.101+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~3V2Z931SVF3Z.0 size=1048576 2024-03-04T12:26:51.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.102+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~3V2Z931SVF3Z.1 size=1048576 2024-03-04T12:26:51.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.103+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~3V2Z931SVF3Z.2 size=705626 2024-03-04T12:26:51.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.104+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=3V2Z931SVF3Z tag=AETU66VJJ1WW type=write size=3851354 2024-03-04T12:26:51.113 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.106+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~HJ7LUWM902LM.0 size=1038222 2024-03-04T12:26:51.113 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.106+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=HJ7LUWM902LM tag=HACUN570I2S0 type=write size=2086798 2024-03-04T12:26:51.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.108+0000 7fa4b3c3e780 1 < completed delete operation key=YWJV4QMY6ZBI tag=88VSBNANWBOY type=del 2024-03-04T12:26:51.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.109+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=BTERU0M5WNBB type=del size=759208 2024-03-04T12:26:51.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.110+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~H46ZGXG7U5LP.0 size=492007 2024-03-04T12:26:51.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.112+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=H46ZGXG7U5LP tag=XMNR5ER74MHC type=write size=1540583 2024-03-04T12:26:51.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.113+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=9HBSCM1IMN75 type=del size=3214764 2024-03-04T12:26:51.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.114+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~SY5AIHFFDCF7.0 size=391757 2024-03-04T12:26:51.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.116+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=SY5AIHFFDCF7 tag=L2RC1BU8Y3ZB type=write size=1440333 2024-03-04T12:26:51.125 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.118+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~LDNYBFW4UYFT.0 size=1048576 2024-03-04T12:26:51.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.119+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~LDNYBFW4UYFT.1 size=1048576 2024-03-04T12:26:51.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.120+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~LDNYBFW4UYFT.2 size=838706 2024-03-04T12:26:51.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.120+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=LDNYBFW4UYFT tag=3D83OQ5SA1RO type=write size=3984434 2024-03-04T12:26:51.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.121+0000 7fa4b3c3e780 1 < completed write operation key=DHLTVH2AZBLR tag=96AL0Z3DAVKJ type=write size=293753 2024-03-04T12:26:51.129 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.123+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~XC6J6Y6CPIAN.0 size=1048576 2024-03-04T12:26:51.130 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.123+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~XC6J6Y6CPIAN.1 size=858428 2024-03-04T12:26:51.130 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.123+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=XC6J6Y6CPIAN tag=BFVLPHSKFT7X type=write size=2955580 2024-03-04T12:26:51.131 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.124+0000 7fa4b3c3e780 -1 < no bi entry to suggest for operation key=4LKTYP07OL5L tag=UJXSKCIGWO9M type=del size=3986536: (2) No such file or directory 2024-03-04T12:26:51.132 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.125+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=ETCRL2NRG751 type=del size=2622972 2024-03-04T12:26:51.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.126+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=K7P7CWBDHNDP type=del 2024-03-04T12:26:51.135 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.128+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~U4FBW6JQ7Z72.0 size=1048576 2024-03-04T12:26:51.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.129+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~U4FBW6JQ7Z72.1 size=104470 2024-03-04T12:26:51.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.129+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=U4FBW6JQ7Z72 tag=5W2K9F99CT38 type=write size=2201622 2024-03-04T12:26:51.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.130+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~OE8CFVIBN27I.0 size=429326 2024-03-04T12:26:51.139 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.132+0000 7fa4b3c3e780 1 < completed multipart upload key=R1DOKJPZRT5Q upload=OE8CFVIBN27I tag=S71L72AUTFHG type=write size=1477902 2024-03-04T12:26:51.140 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.133+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=9L05JUZEFRR8 type=del size=142374 2024-03-04T12:26:51.141 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.134+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=0LN40VPH4LHM type=del 2024-03-04T12:26:51.142 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.136+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=UBOO282PP562 type=del size=2665772 2024-03-04T12:26:51.144 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.137+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~EX0FR61S2DAX.0 size=1048576 2024-03-04T12:26:51.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.138+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~EX0FR61S2DAX.1 size=339907 2024-03-04T12:26:51.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.139+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=EX0FR61S2DAX tag=RZNN6DRF6HPT type=write size=2437059 2024-03-04T12:26:51.147 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.141+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=O3K5N3RLIL3H type=del size=869059 2024-03-04T12:26:51.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.142+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~MHQQT5YM4GJY.0 size=1048576 2024-03-04T12:26:51.149 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.143+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~MHQQT5YM4GJY.1 size=177102 2024-03-04T12:26:51.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.145+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=MHQQT5YM4GJY tag=GRE4WR23YFUX type=write size=2274254 2024-03-04T12:26:51.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.146+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=ML5GFAH4D0S7 type=write size=432546 2024-03-04T12:26:51.154 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.147+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=150HKNI4PI9K type=del 2024-03-04T12:26:51.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.148+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=DP2R24DU17FI type=del size=917835 2024-03-04T12:26:51.156 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.149+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~QI3210IQ4RAB.0 size=1048576 2024-03-04T12:26:51.157 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.150+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~QI3210IQ4RAB.1 size=202283 2024-03-04T12:26:51.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.152+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=QI3210IQ4RAB tag=WUA16ARUL8DF type=write size=2299435 2024-03-04T12:26:51.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.154+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~SZBB6XWXNHN5.0 size=1048576 2024-03-04T12:26:51.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.155+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~SZBB6XWXNHN5.1 size=371948 2024-03-04T12:26:51.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.155+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=SZBB6XWXNHN5 tag=HSOK2P0JJAZM type=write size=2469100 2024-03-04T12:26:51.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.156+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=UV7AL32XTJNM type=del 2024-03-04T12:26:51.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.157+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=OYG2850JBCUO type=del size=2592671 2024-03-04T12:26:51.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.158+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=R9YI8HFTI0PO type=del 2024-03-04T12:26:51.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.160+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~TLDOE66YJ2IA.0 size=984694 2024-03-04T12:26:51.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.160+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=TLDOE66YJ2IA tag=CHPOM1U7LBTI type=write size=2033270 2024-03-04T12:26:51.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.162+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=10HLRG9NF2Q1 type=del 2024-03-04T12:26:51.170 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.164+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~V8BYUGVF14P1.0 size=1048576 2024-03-04T12:26:51.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.164+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~V8BYUGVF14P1.1 size=886874 2024-03-04T12:26:51.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.164+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=V8BYUGVF14P1 tag=2VOVRBNH9Z5K type=write size=2984026 2024-03-04T12:26:51.172 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.166+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~HJ7LUWM902LM.0 size=1038222 2024-03-04T12:26:51.174 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.167+0000 7fa4b3c3e780 1 < completed multipart upload key=J53J0N99N30A upload=HJ7LUWM902LM tag=HACUN570I2S0 type=write size=2086798 2024-03-04T12:26:51.175 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.168+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=ZS0RGO911NI8 type=del size=3446617 2024-03-04T12:26:51.176 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.170+0000 7fa4b3c3e780 1 < completed delete operation key=R1DOKJPZRT5Q tag=BTERU0M5WNBB type=del 2024-03-04T12:26:51.177 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.171+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=X9SGNSWJ0B6A type=del size=1530677 2024-03-04T12:26:51.179 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.172+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=9HBSCM1IMN75 type=del 2024-03-04T12:26:51.180 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.173+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=DGSKM3XQF80Y type=del size=4044377 2024-03-04T12:26:51.181 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.174+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~LDNYBFW4UYFT.0 size=1048576 2024-03-04T12:26:51.182 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.175+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~LDNYBFW4UYFT.1 size=1048576 2024-03-04T12:26:51.183 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.176+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~LDNYBFW4UYFT.2 size=838706 2024-03-04T12:26:51.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.178+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=LDNYBFW4UYFT tag=3D83OQ5SA1RO type=write size=3984434 2024-03-04T12:26:51.186 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.179+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=2LPR859HFR2M type=del size=3156848 2024-03-04T12:26:51.187 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.180+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~XC6J6Y6CPIAN.0 size=1048576 2024-03-04T12:26:51.188 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.181+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~XC6J6Y6CPIAN.1 size=858428 2024-03-04T12:26:51.190 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.183+0000 7fa4b3c3e780 1 < completed multipart upload key=3N6E09QF3866 upload=XC6J6Y6CPIAN tag=BFVLPHSKFT7X type=write size=2955580 2024-03-04T12:26:51.193 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.186+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~GGHW94FY7MFF.0 size=1048576 2024-03-04T12:26:51.194 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.187+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~GGHW94FY7MFF.1 size=1048576 2024-03-04T12:26:51.195 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.188+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~GGHW94FY7MFF.2 size=183404 2024-03-04T12:26:51.195 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.188+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=GGHW94FY7MFF tag=UG93X93ZS1DP type=write size=3329132 2024-03-04T12:26:51.197 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.190+0000 7fa4b3c3e780 1 < suggested update operation key=ESHAMQWMMBJR tag=ETCRL2NRG751 type=del size=2622972 2024-03-04T12:26:51.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.191+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=32P00A8N6SOI type=write size=868006 2024-03-04T12:26:51.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.193+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~U4FBW6JQ7Z72.0 size=1048576 2024-03-04T12:26:51.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.194+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~U4FBW6JQ7Z72.1 size=104470 2024-03-04T12:26:51.202 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.195+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=U4FBW6JQ7Z72 tag=5W2K9F99CT38 type=write size=2201622 2024-03-04T12:26:51.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.197+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=65P65AKG8X6I type=del size=4183311 2024-03-04T12:26:51.206 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.199+0000 7fa4b3c3e780 1 < suggested remove operation key=YQLH0WW7I7MW tag=9L05JUZEFRR8 type=del 2024-03-04T12:26:51.208 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.201+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~Z3UVKE0MRGIW.0 size=104518 2024-03-04T12:26:51.208 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.201+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=Z3UVKE0MRGIW tag=6E6Z1BZ5VDXB type=write size=1153094 2024-03-04T12:26:51.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.202+0000 7fa4b3c3e780 1 < completed delete operation key=X0RVLNRWUAEM tag=UBOO282PP562 type=del 2024-03-04T12:26:51.211 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.204+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~GCNETZVZPHLE.0 size=762440 2024-03-04T12:26:51.211 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.204+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=GCNETZVZPHLE tag=Q32HD5N2BEF8 type=write size=1811016 2024-03-04T12:26:51.212 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.205+0000 7fa4b3c3e780 1 < completed delete operation key=RHU0QO8HS5SC tag=O3K5N3RLIL3H type=del 2024-03-04T12:26:51.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.206+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=9KIV97K17L59 type=del size=3075831 2024-03-04T12:26:51.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.208+0000 7fa4b3c3e780 1 < canceled operation key=BR8RTE2QEH9E tag=ML5GFAH4D0S7 type=write size=432546 2024-03-04T12:26:51.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.209+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=8YX387KVD4U1 type=write size=123626 2024-03-04T12:26:51.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.210+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=DP2R24DU17FI type=del 2024-03-04T12:26:51.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.211+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=PX1N0ZVVXYQV type=del size=1898689 2024-03-04T12:26:51.219 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.212+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~SZBB6XWXNHN5.0 size=1048576 2024-03-04T12:26:51.219 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.212+0000 7fa4b3c3e780 1 < canceled part key=_multipart_ESHAMQWMMBJR.2~SZBB6XWXNHN5.1 size=371948 2024-03-04T12:26:51.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.214+0000 7fa4b3c3e780 1 < canceled multipart upload key=ESHAMQWMMBJR upload=SZBB6XWXNHN5 tag=HSOK2P0JJAZM type=write size=2469100 2024-03-04T12:26:51.222 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.215+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=C91N6UH63PXG type=write size=1012897 2024-03-04T12:26:51.223 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.217+0000 7fa4b3c3e780 1 < completed delete operation key=YWJV4QMY6ZBI tag=OYG2850JBCUO type=del 2024-03-04T12:26:51.225 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.219+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~N8A7THAKSEGL.0 size=1048576 2024-03-04T12:26:51.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.220+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~N8A7THAKSEGL.1 size=1048576 2024-03-04T12:26:51.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.220+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~N8A7THAKSEGL.2 size=647065 2024-03-04T12:26:51.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.220+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=N8A7THAKSEGL tag=7M7Z0KJLKNWY type=write size=3792793 2024-03-04T12:26:51.228 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.221+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~TLDOE66YJ2IA.0 size=984694 2024-03-04T12:26:51.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.223+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=TLDOE66YJ2IA tag=CHPOM1U7LBTI type=write size=2033270 2024-03-04T12:26:51.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.225+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~ABQI8DHORD9O.0 size=1048576 2024-03-04T12:26:51.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.226+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~ABQI8DHORD9O.1 size=512199 2024-03-04T12:26:51.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.226+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=ABQI8DHORD9O tag=UP5HZ4DEKJ4U type=write size=2609351 2024-03-04T12:26:51.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.227+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~V8BYUGVF14P1.0 size=1048576 2024-03-04T12:26:51.235 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.228+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~V8BYUGVF14P1.1 size=886874 2024-03-04T12:26:51.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.230+0000 7fa4b3c3e780 1 < completed multipart upload key=ESHAMQWMMBJR upload=V8BYUGVF14P1 tag=2VOVRBNH9Z5K type=write size=2984026 2024-03-04T12:26:51.238 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.231+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=WEACOKXKKJF0 type=write size=125316 2024-03-04T12:26:51.240 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.234+0000 7fa4b3c3e780 1 < suggested update operation key=T301TK0FIOG4 tag=ZS0RGO911NI8 type=del size=3446617 2024-03-04T12:26:51.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.236+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~A669A1JUZPNT.0 size=1048576 2024-03-04T12:26:51.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.237+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~A669A1JUZPNT.1 size=581106 2024-03-04T12:26:51.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.237+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=A669A1JUZPNT tag=5OAPAP1OQI9I type=write size=2678258 2024-03-04T12:26:51.245 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.238+0000 7fa4b3c3e780 1 < canceled operation key=BR8RTE2QEH9E tag=X9SGNSWJ0B6A type=del size=1530677 2024-03-04T12:26:51.246 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.239+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=ZZS2CZYVU1B7 type=del size=1081419 2024-03-04T12:26:51.247 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.240+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=DGSKM3XQF80Y type=del 2024-03-04T12:26:51.248 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.241+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=JY04U1F72SU4 type=write size=696899 2024-03-04T12:26:51.249 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.242+0000 7fa4b3c3e780 1 < canceled operation key=YWJV4QMY6ZBI tag=2LPR859HFR2M type=del size=3156848 2024-03-04T12:26:51.250 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.244+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=4S1WUZX209BL type=del size=3666731 2024-03-04T12:26:51.251 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.245+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~GGHW94FY7MFF.0 size=1048576 2024-03-04T12:26:51.253 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.246+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~GGHW94FY7MFF.1 size=1048576 2024-03-04T12:26:51.253 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.247+0000 7fa4b3c3e780 1 < completed part key=_multipart_X0RVLNRWUAEM.2~GGHW94FY7MFF.2 size=183404 2024-03-04T12:26:51.255 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.248+0000 7fa4b3c3e780 1 < completed multipart upload key=X0RVLNRWUAEM upload=GGHW94FY7MFF tag=UG93X93ZS1DP type=write size=3329132 2024-03-04T12:26:51.256 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.250+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=Y989U4UT1RY5 type=del size=2527003 2024-03-04T12:26:51.259 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.252+0000 7fa4b3c3e780 1 < suggested update operation key=V7N7MZ1GUNEV tag=32P00A8N6SOI type=write size=868006 2024-03-04T12:26:51.261 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.254+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~S4F0AFW3046P.0 size=1048576 2024-03-04T12:26:51.262 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.255+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~S4F0AFW3046P.1 size=58765 2024-03-04T12:26:51.262 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.255+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=S4F0AFW3046P tag=F1BJRHTKGF2S type=write size=2155917 2024-03-04T12:26:51.264 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.257+0000 7fa4b3c3e780 1 < suggested update operation key=J53J0N99N30A tag=65P65AKG8X6I type=del size=4183311 2024-03-04T12:26:51.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.258+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=0STQ3UXNVLTX type=del size=4192093 2024-03-04T12:26:51.266 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.259+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~Z3UVKE0MRGIW.0 size=104518 2024-03-04T12:26:51.268 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.261+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=Z3UVKE0MRGIW tag=6E6Z1BZ5VDXB type=write size=1153094 2024-03-04T12:26:51.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.263+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~GFSR621SWJ5D.0 size=75731 2024-03-04T12:26:51.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.263+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=GFSR621SWJ5D tag=X5ATUZSL8QC6 type=write size=1124307 2024-03-04T12:26:51.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.265+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~GCNETZVZPHLE.0 size=762440 2024-03-04T12:26:51.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.267+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=GCNETZVZPHLE tag=Q32HD5N2BEF8 type=write size=1811016 2024-03-04T12:26:51.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.268+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=NIDEC7D2OT32 type=del size=2452216 2024-03-04T12:26:51.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.270+0000 7fa4b3c3e780 1 < canceled operation key=ZETES4AYZQHY tag=9KIV97K17L59 type=del size=3075831 2024-03-04T12:26:51.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.272+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~7OIUW9O0S3V1.0 size=2706 2024-03-04T12:26:51.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.272+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=7OIUW9O0S3V1 tag=UPWYKTX8KW83 type=write size=1051282 2024-03-04T12:26:51.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.273+0000 7fa4b3c3e780 1 < completed write operation key=WRHB3XWDLSY2 tag=8YX387KVD4U1 type=write size=123626 2024-03-04T12:26:51.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.274+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=RRTYF8FFPDN6 type=del size=2906874 2024-03-04T12:26:51.282 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.275+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=PX1N0ZVVXYQV type=del 2024-03-04T12:26:51.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.276+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=PZD4U44V86V6 type=del size=3014855 2024-03-04T12:26:51.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.279+0000 7fa4b3c3e780 1 < suggested remove operation key=V7N7MZ1GUNEV tag=C91N6UH63PXG type=write 2024-03-04T12:26:51.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.280+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=H83F0QKD98GL type=del size=2106808 2024-03-04T12:26:51.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.281+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~N8A7THAKSEGL.0 size=1048576 2024-03-04T12:26:51.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.282+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~N8A7THAKSEGL.1 size=1048576 2024-03-04T12:26:51.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.283+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~N8A7THAKSEGL.2 size=647065 2024-03-04T12:26:51.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.285+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=N8A7THAKSEGL tag=7M7Z0KJLKNWY type=write size=3792793 2024-03-04T12:26:51.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.286+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=Z4WAR42YP9TH type=del size=3592674 2024-03-04T12:26:51.297 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.286+0000 7fa4b3c3e780 1 < canceled part key=_multipart_3TDMQXKLPX34.2~ABQI8DHORD9O.0 size=1048576 2024-03-04T12:26:51.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.287+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~ABQI8DHORD9O.1 size=512199 2024-03-04T12:26:51.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.289+0000 7fa4b3c3e780 1 < canceled multipart upload key=3TDMQXKLPX34 upload=ABQI8DHORD9O tag=UP5HZ4DEKJ4U type=write size=2609351 2024-03-04T12:26:51.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.291+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~J8UP5Z8AF6RQ.0 size=542848 2024-03-04T12:26:51.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.291+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=J8UP5Z8AF6RQ tag=N39G8MM90S3B type=write size=1591424 2024-03-04T12:26:51.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.293+0000 7fa4b3c3e780 1 < completed write operation key=YIS2SV4O5EZN tag=WEACOKXKKJF0 type=write size=125316 2024-03-04T12:26:51.302 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.295+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~FG855UDBN838.0 size=1048576 2024-03-04T12:26:51.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.296+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~FG855UDBN838.1 size=1048576 2024-03-04T12:26:51.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.297+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~FG855UDBN838.2 size=536006 2024-03-04T12:26:51.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.297+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=FG855UDBN838 tag=EKCZZVN7KH7G type=write size=3681734 2024-03-04T12:26:51.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.298+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~A669A1JUZPNT.0 size=1048576 2024-03-04T12:26:51.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.298+0000 7fa4b3c3e780 1 < canceled part key=_multipart_43HMF7NWNMU3.2~A669A1JUZPNT.1 size=581106 2024-03-04T12:26:51.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.300+0000 7fa4b3c3e780 1 < canceled multipart upload key=43HMF7NWNMU3 upload=A669A1JUZPNT tag=5OAPAP1OQI9I type=write size=2678258 2024-03-04T12:26:51.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.302+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~888MAAXUL29C.0 size=288015 2024-03-04T12:26:51.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.302+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=888MAAXUL29C tag=H2ZQN5H4O1SJ type=write size=1336591 2024-03-04T12:26:51.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.303+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=ZZS2CZYVU1B7 type=del 2024-03-04T12:26:51.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.304+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=9LKJF56N1EQL type=del size=2649472 2024-03-04T12:26:51.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.305+0000 7fa4b3c3e780 1 < completed write operation key=G4SUQFVB936T tag=JY04U1F72SU4 type=write size=696899 2024-03-04T12:26:51.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.306+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=JUR7VCCNYSAD type=del size=1320992 2024-03-04T12:26:51.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.307+0000 7fa4b3c3e780 1 < canceled operation key=RHU0QO8HS5SC tag=4S1WUZX209BL type=del size=3666731 2024-03-04T12:26:51.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.309+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~BJATDVNSJGAX.0 size=1048576 2024-03-04T12:26:51.317 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.310+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~BJATDVNSJGAX.1 size=1048576 2024-03-04T12:26:51.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.311+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~BJATDVNSJGAX.2 size=642171 2024-03-04T12:26:51.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.311+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=BJATDVNSJGAX tag=MKMQKWX5XKS3 type=write size=3787899 2024-03-04T12:26:51.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.312+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=Y989U4UT1RY5 type=del 2024-03-04T12:26:51.320 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.313+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=VG3L9I7E90US type=del size=224942 2024-03-04T12:26:51.321 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.315+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~S4F0AFW3046P.0 size=1048576 2024-03-04T12:26:51.322 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.316+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~S4F0AFW3046P.1 size=58765 2024-03-04T12:26:51.325 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.318+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=S4F0AFW3046P tag=F1BJRHTKGF2S type=write size=2155917 2024-03-04T12:26:51.326 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.319+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=BVM27RWHQO6B type=write size=979243 2024-03-04T12:26:51.328 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.321+0000 7fa4b3c3e780 1 < suggested remove operation key=KKQT9J9GSW0N tag=0STQ3UXNVLTX type=del 2024-03-04T12:26:51.330 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.324+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~T386TUSNZMD1.0 size=1048576 2024-03-04T12:26:51.331 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.325+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~T386TUSNZMD1.1 size=1048576 2024-03-04T12:26:51.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.326+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~T386TUSNZMD1.2 size=889678 2024-03-04T12:26:51.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.326+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=T386TUSNZMD1 tag=UPWSFP62V56Z type=write size=4035406 2024-03-04T12:26:51.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.327+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~GFSR621SWJ5D.0 size=75731 2024-03-04T12:26:51.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.329+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=GFSR621SWJ5D tag=X5ATUZSL8QC6 type=write size=1124307 2024-03-04T12:26:51.337 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.330+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~AXIDCIUTZIPN.0 size=676637 2024-03-04T12:26:51.337 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.330+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=AXIDCIUTZIPN tag=WXDK6HVALAON type=write size=1725213 2024-03-04T12:26:51.338 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.332+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=NIDEC7D2OT32 type=del 2024-03-04T12:26:51.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.334+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~OWSKUR6VISO3.0 size=1048576 2024-03-04T12:26:51.341 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.334+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~OWSKUR6VISO3.1 size=77989 2024-03-04T12:26:51.342 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.334+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=OWSKUR6VISO3 tag=HUTSU2U0JNSG type=write size=2175141 2024-03-04T12:26:51.342 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.336+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~7OIUW9O0S3V1.0 size=2706 2024-03-04T12:26:51.344 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.338+0000 7fa4b3c3e780 1 < completed multipart upload key=YIS2SV4O5EZN upload=7OIUW9O0S3V1 tag=UPWYKTX8KW83 type=write size=1051282 2024-03-04T12:26:51.346 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.340+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~OUOEMVQ35FKK.0 size=1048576 2024-03-04T12:26:51.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.340+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~OUOEMVQ35FKK.1 size=1048576 2024-03-04T12:26:51.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.341+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~OUOEMVQ35FKK.2 size=793226 2024-03-04T12:26:51.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.341+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=OUOEMVQ35FKK tag=EKBYMNCU0JW7 type=write size=3938954 2024-03-04T12:26:51.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.342+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=RRTYF8FFPDN6 type=del 2024-03-04T12:26:51.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.344+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~252ATH2KKX9H.0 size=1048576 2024-03-04T12:26:51.352 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.345+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~252ATH2KKX9H.1 size=1048576 2024-03-04T12:26:51.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.346+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~252ATH2KKX9H.2 size=411851 2024-03-04T12:26:51.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.346+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=252ATH2KKX9H tag=C22EFLRTPWKH type=write size=3557579 2024-03-04T12:26:51.354 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.347+0000 7fa4b3c3e780 1 < completed delete operation key=UZRX3W3DE5VX tag=PZD4U44V86V6 type=del 2024-03-04T12:26:51.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.348+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=NC8AFX0BCJZP type=del size=2055680 2024-03-04T12:26:51.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.350+0000 7fa4b3c3e780 1 < suggested remove operation key=3TDMQXKLPX34 tag=H83F0QKD98GL type=del 2024-03-04T12:26:51.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.351+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=LVEOUSP4N5BJ type=del size=1789452 2024-03-04T12:26:51.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.353+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=Z4WAR42YP9TH type=del 2024-03-04T12:26:51.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.355+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~2KN2JQ2YF3S4.0 size=1048576 2024-03-04T12:26:51.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.356+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~2KN2JQ2YF3S4.1 size=1048576 2024-03-04T12:26:51.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.356+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~2KN2JQ2YF3S4.2 size=629361 2024-03-04T12:26:51.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.356+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=2KN2JQ2YF3S4 tag=VGI1E98DSIX7 type=write size=3775089 2024-03-04T12:26:51.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.358+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~J8UP5Z8AF6RQ.0 size=542848 2024-03-04T12:26:51.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.360+0000 7fa4b3c3e780 1 < completed multipart upload key=R1DOKJPZRT5Q upload=J8UP5Z8AF6RQ tag=N39G8MM90S3B type=write size=1591424 2024-03-04T12:26:51.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.361+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=0E7LHRKD7YYL type=del size=3497497 2024-03-04T12:26:51.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.362+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~FG855UDBN838.0 size=1048576 2024-03-04T12:26:51.370 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.363+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~FG855UDBN838.1 size=1048576 2024-03-04T12:26:51.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.364+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~FG855UDBN838.2 size=536006 2024-03-04T12:26:51.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.366+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=FG855UDBN838 tag=EKCZZVN7KH7G type=write size=3681734 2024-03-04T12:26:51.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.367+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=UC35SCBR8A50 type=del size=1084789 2024-03-04T12:26:51.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.369+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~888MAAXUL29C.0 size=288015 2024-03-04T12:26:51.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.371+0000 7fa4b3c3e780 1 < completed multipart upload key=43HMF7NWNMU3 upload=888MAAXUL29C tag=H2ZQN5H4O1SJ type=write size=1336591 2024-03-04T12:26:51.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.373+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~2PW0IGSSYBWC.0 size=1048576 2024-03-04T12:26:51.380 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.374+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~2PW0IGSSYBWC.1 size=1048576 2024-03-04T12:26:51.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.374+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~2PW0IGSSYBWC.2 size=305879 2024-03-04T12:26:51.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.374+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=2PW0IGSSYBWC tag=8U3BI9SI5VQL type=write size=3451607 2024-03-04T12:26:51.382 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.376+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=9LKJF56N1EQL type=del 2024-03-04T12:26:51.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.378+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~YKEWZ02JB38Y.0 size=269946 2024-03-04T12:26:51.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.378+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=YKEWZ02JB38Y tag=NGAECDFCK98U type=write size=1318522 2024-03-04T12:26:51.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.378+0000 7fa4b3c3e780 -1 < no bi entry to suggest for operation key=3TDMQXKLPX34 tag=JUR7VCCNYSAD type=del size=1320992: (2) No such file or directory 2024-03-04T12:26:51.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.380+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=MM2KL94MYC2C type=del size=3377428 2024-03-04T12:26:51.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.381+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~BJATDVNSJGAX.0 size=1048576 2024-03-04T12:26:51.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.382+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~BJATDVNSJGAX.1 size=1048576 2024-03-04T12:26:51.390 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.383+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~BJATDVNSJGAX.2 size=642171 2024-03-04T12:26:51.391 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.385+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=BJATDVNSJGAX tag=MKMQKWX5XKS3 type=write size=3787899 2024-03-04T12:26:51.393 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.386+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=2M0YAGU7WC28 type=del size=3709997 2024-03-04T12:26:51.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.388+0000 7fa4b3c3e780 1 < suggested remove operation key=4989OME3IAJF tag=VG3L9I7E90US type=del 2024-03-04T12:26:51.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.389+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=KYC8T39A8RR0 type=write size=546035 2024-03-04T12:26:51.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.391+0000 7fa4b3c3e780 -1 < failed to complete operation key=3TDMQXKLPX34 tag=BVM27RWHQO6B type=write size=979243: (22) Invalid argument 2024-03-04T12:26:51.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.392+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=BCQ26YX0M9RU type=del size=1876093 2024-03-04T12:26:51.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.392+0000 7fa4b3c3e780 1 < canceled part key=_multipart_WRHB3XWDLSY2.2~T386TUSNZMD1.0 size=1048576 2024-03-04T12:26:51.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.393+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~T386TUSNZMD1.1 size=1048576 2024-03-04T12:26:51.401 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.394+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~T386TUSNZMD1.2 size=889678 2024-03-04T12:26:51.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.396+0000 7fa4b3c3e780 1 < canceled multipart upload key=WRHB3XWDLSY2 upload=T386TUSNZMD1 tag=UPWSFP62V56Z type=write size=4035406 2024-03-04T12:26:51.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.397+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=J3RXZKXKEFRY type=del size=3436292 2024-03-04T12:26:51.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.399+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~AXIDCIUTZIPN.0 size=676637 2024-03-04T12:26:51.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.401+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=AXIDCIUTZIPN tag=WXDK6HVALAON type=write size=1725213 2024-03-04T12:26:51.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.402+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=Z1SC52ER3G6A type=del size=3875538 2024-03-04T12:26:51.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.403+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~OWSKUR6VISO3.0 size=1048576 2024-03-04T12:26:51.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.404+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~OWSKUR6VISO3.1 size=77989 2024-03-04T12:26:51.413 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.406+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=OWSKUR6VISO3 tag=HUTSU2U0JNSG type=write size=2175141 2024-03-04T12:26:51.414 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.407+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=KPCWDMPGO9PB type=del size=2367138 2024-03-04T12:26:51.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.409+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~OUOEMVQ35FKK.0 size=1048576 2024-03-04T12:26:51.416 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.409+0000 7fa4b3c3e780 1 < canceled part key=_multipart_BVMWQ9ZL4K0C.2~OUOEMVQ35FKK.1 size=1048576 2024-03-04T12:26:51.416 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.410+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~OUOEMVQ35FKK.2 size=793226 2024-03-04T12:26:51.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.411+0000 7fa4b3c3e780 1 < canceled multipart upload key=BVMWQ9ZL4K0C upload=OUOEMVQ35FKK tag=EKBYMNCU0JW7 type=write size=3938954 2024-03-04T12:26:51.419 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.413+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=YSYRMJMAZHSD type=del size=1583094 2024-03-04T12:26:51.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.414+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~252ATH2KKX9H.0 size=1048576 2024-03-04T12:26:51.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.414+0000 7fa4b3c3e780 1 < canceled part key=_multipart_RHU0QO8HS5SC.2~252ATH2KKX9H.1 size=1048576 2024-03-04T12:26:51.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.414+0000 7fa4b3c3e780 1 < canceled part key=_multipart_RHU0QO8HS5SC.2~252ATH2KKX9H.2 size=411851 2024-03-04T12:26:51.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.416+0000 7fa4b3c3e780 1 < canceled multipart upload key=RHU0QO8HS5SC upload=252ATH2KKX9H tag=C22EFLRTPWKH type=write size=3557579 2024-03-04T12:26:51.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.417+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=17UHH9ACW873 type=del size=1794619 2024-03-04T12:26:51.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.417+0000 7fa4b3c3e780 -1 < no bi entry to suggest for operation key=3TDMQXKLPX34 tag=NC8AFX0BCJZP type=del size=2055680: (2) No such file or directory 2024-03-04T12:26:51.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.419+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~ET3H2VZQHJGE.0 size=622761 2024-03-04T12:26:51.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.419+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=ET3H2VZQHJGE tag=0M6T9OVPFFE6 type=write size=1671337 2024-03-04T12:26:51.428 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.421+0000 7fa4b3c3e780 1 < suggested update operation key=YIS2SV4O5EZN tag=LVEOUSP4N5BJ type=del size=1789452 2024-03-04T12:26:51.430 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.423+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~6JSFCOSGJHBI.0 size=1048576 2024-03-04T12:26:51.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.424+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~6JSFCOSGJHBI.1 size=1048576 2024-03-04T12:26:51.432 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.425+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~6JSFCOSGJHBI.2 size=896338 2024-03-04T12:26:51.432 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.425+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=6JSFCOSGJHBI tag=S1UOSMCP37RA type=write size=4042066 2024-03-04T12:26:51.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.426+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~2KN2JQ2YF3S4.0 size=1048576 2024-03-04T12:26:51.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.426+0000 7fa4b3c3e780 1 < canceled part key=_multipart_ZETES4AYZQHY.2~2KN2JQ2YF3S4.1 size=1048576 2024-03-04T12:26:51.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.427+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~2KN2JQ2YF3S4.2 size=629361 2024-03-04T12:26:51.436 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.429+0000 7fa4b3c3e780 1 < canceled multipart upload key=ZETES4AYZQHY upload=2KN2JQ2YF3S4 tag=VGI1E98DSIX7 type=write size=3775089 2024-03-04T12:26:51.438 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.431+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=HBA5KC85KJ1W type=write size=119153 2024-03-04T12:26:51.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.432+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=0E7LHRKD7YYL type=del 2024-03-04T12:26:51.441 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.434+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~92HN0SUJBSRJ.0 size=1048576 2024-03-04T12:26:51.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.435+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~92HN0SUJBSRJ.1 size=761940 2024-03-04T12:26:51.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.435+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=92HN0SUJBSRJ tag=TOQPJ00Y02FV type=write size=2859092 2024-03-04T12:26:51.444 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.437+0000 7fa4b3c3e780 1 < suggested remove operation key=G70BJ2UARNCP tag=UC35SCBR8A50 type=del 2024-03-04T12:26:51.445 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.439+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=VY4N1KBG96WQ type=del size=1024314 2024-03-04T12:26:51.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.440+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~2PW0IGSSYBWC.0 size=1048576 2024-03-04T12:26:51.448 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.441+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~2PW0IGSSYBWC.1 size=1048576 2024-03-04T12:26:51.448 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.442+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~2PW0IGSSYBWC.2 size=305879 2024-03-04T12:26:51.450 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.444+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=2PW0IGSSYBWC tag=8U3BI9SI5VQL type=write size=3451607 2024-03-04T12:26:51.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.446+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~V17C08MTS4QJ.0 size=1048576 2024-03-04T12:26:51.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.446+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~V17C08MTS4QJ.1 size=777378 2024-03-04T12:26:51.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.446+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=V17C08MTS4QJ tag=OHYDRKJ07824 type=write size=2874530 2024-03-04T12:26:51.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.447+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YWJV4QMY6ZBI.2~YKEWZ02JB38Y.0 size=269946 2024-03-04T12:26:51.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.448+0000 7fa4b3c3e780 1 < canceled multipart upload key=YWJV4QMY6ZBI upload=YKEWZ02JB38Y tag=NGAECDFCK98U type=write size=1318522 2024-03-04T12:26:51.457 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.450+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~ADXG65SSCJHC.0 size=1048576 2024-03-04T12:26:51.458 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.451+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~ADXG65SSCJHC.1 size=1048576 2024-03-04T12:26:51.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.452+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~ADXG65SSCJHC.2 size=291737 2024-03-04T12:26:51.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.452+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=ADXG65SSCJHC tag=ZG2YK8RJ01KS type=write size=3437465 2024-03-04T12:26:51.460 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.453+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=MM2KL94MYC2C type=del 2024-03-04T12:26:51.461 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.454+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=T5ZFJ5E2E824 type=del size=3063793 2024-03-04T12:26:51.463 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.456+0000 7fa4b3c3e780 1 < completed delete operation key=G8G76PMSKJ0I tag=2M0YAGU7WC28 type=del 2024-03-04T12:26:51.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.458+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~7RZ5B56B44TS.0 size=1048576 2024-03-04T12:26:51.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.459+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~7RZ5B56B44TS.1 size=927030 2024-03-04T12:26:51.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.459+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=7RZ5B56B44TS tag=J8ZVF7DOSLXL type=write size=3024182 2024-03-04T12:26:51.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.460+0000 7fa4b3c3e780 1 < completed write operation key=DHLTVH2AZBLR tag=KYC8T39A8RR0 type=write size=546035 2024-03-04T12:26:51.468 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.461+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=7F70CTMB95VA type=del size=4113067 2024-03-04T12:26:51.471 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.464+0000 7fa4b3c3e780 1 < suggested remove operation key=H5FWRNK8F7QT tag=BCQ26YX0M9RU type=del 2024-03-04T12:26:51.472 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.465+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=BTWYTBHEF2W2 type=write size=123915 2024-03-04T12:26:51.473 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.466+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=J3RXZKXKEFRY type=del 2024-03-04T12:26:51.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.467+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=LEM0MIK06C8P type=del size=222761 2024-03-04T12:26:51.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.469+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=Z1SC52ER3G6A type=del 2024-03-04T12:26:51.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.470+0000 7fa4b3c3e780 1 > prepared operation key=J53J0N99N30A tag=APMLIMTJ3ATT type=del size=1992128 2024-03-04T12:26:51.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.471+0000 7fa4b3c3e780 1 < canceled operation key=UZRX3W3DE5VX tag=KPCWDMPGO9PB type=del size=2367138 2024-03-04T12:26:51.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.473+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~PKR7LDL4SJGC.0 size=1048576 2024-03-04T12:26:51.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.474+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~PKR7LDL4SJGC.1 size=838915 2024-03-04T12:26:51.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.474+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=PKR7LDL4SJGC tag=RIJ6F0ROXD57 type=write size=2936067 2024-03-04T12:26:51.483 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.476+0000 7fa4b3c3e780 1 < suggested update operation key=UZRX3W3DE5VX tag=YSYRMJMAZHSD type=del size=1583094 2024-03-04T12:26:51.485 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.478+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~D955O5A5438X.0 size=341626 2024-03-04T12:26:51.485 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.478+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=D955O5A5438X tag=N8WISOH9KR4Y type=write size=1390202 2024-03-04T12:26:51.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.479+0000 7fa4b3c3e780 -1 < failed to complete operation key=UZRX3W3DE5VX tag=17UHH9ACW873 type=del size=1794619: (22) Invalid argument 2024-03-04T12:26:51.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.481+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=21NZR6Y2PW0U type=del size=1812409 2024-03-04T12:26:51.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.482+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~ET3H2VZQHJGE.0 size=622761 2024-03-04T12:26:51.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.484+0000 7fa4b3c3e780 1 < completed multipart upload key=43HMF7NWNMU3 upload=ET3H2VZQHJGE tag=0M6T9OVPFFE6 type=write size=1671337 2024-03-04T12:26:51.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.486+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~LJEVYMULUJP1.0 size=1048576 2024-03-04T12:26:51.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.487+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~LJEVYMULUJP1.1 size=472942 2024-03-04T12:26:51.494 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.487+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=LJEVYMULUJP1 tag=0IMO4SSLGOOM type=write size=2570094 2024-03-04T12:26:51.495 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.488+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~6JSFCOSGJHBI.0 size=1048576 2024-03-04T12:26:51.496 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.489+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~6JSFCOSGJHBI.1 size=1048576 2024-03-04T12:26:51.497 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.490+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~6JSFCOSGJHBI.2 size=896338 2024-03-04T12:26:51.499 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.492+0000 7fa4b3c3e780 1 < completed multipart upload key=ESHAMQWMMBJR upload=6JSFCOSGJHBI tag=S1UOSMCP37RA type=write size=4042066 2024-03-04T12:26:51.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.493+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=SNK7LTFF08VT type=del size=1529943 2024-03-04T12:26:51.501 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.494+0000 7fa4b3c3e780 1 < completed write operation key=T301TK0FIOG4 tag=HBA5KC85KJ1W type=write size=119153 2024-03-04T12:26:51.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.495+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=HG4YSB511S82 type=del size=3968341 2024-03-04T12:26:51.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.496+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~92HN0SUJBSRJ.0 size=1048576 2024-03-04T12:26:51.504 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.497+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~92HN0SUJBSRJ.1 size=761940 2024-03-04T12:26:51.506 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.499+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=92HN0SUJBSRJ tag=TOQPJ00Y02FV type=write size=2859092 2024-03-04T12:26:51.507 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.500+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=67AHU0G4F708 type=del size=1344401 2024-03-04T12:26:51.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.501+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=VY4N1KBG96WQ type=del 2024-03-04T12:26:51.510 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.503+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~FDH1NWPAGKYA.0 size=1048576 2024-03-04T12:26:51.511 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.504+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~FDH1NWPAGKYA.1 size=986613 2024-03-04T12:26:51.511 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.504+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=FDH1NWPAGKYA tag=706N5DXWONA3 type=write size=3083765 2024-03-04T12:26:51.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.506+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~V17C08MTS4QJ.0 size=1048576 2024-03-04T12:26:51.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.507+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~V17C08MTS4QJ.1 size=777378 2024-03-04T12:26:51.515 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.509+0000 7fa4b3c3e780 1 < completed multipart upload key=YIS2SV4O5EZN upload=V17C08MTS4QJ tag=OHYDRKJ07824 type=write size=2874530 2024-03-04T12:26:51.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.510+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~82TDCBADO092.0 size=594337 2024-03-04T12:26:51.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.511+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=82TDCBADO092 tag=77C2JWCL64XK type=write size=1642913 2024-03-04T12:26:51.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.512+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~ADXG65SSCJHC.0 size=1048576 2024-03-04T12:26:51.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.512+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~ADXG65SSCJHC.1 size=1048576 2024-03-04T12:26:51.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.512+0000 7fa4b3c3e780 1 < canceled part key=_multipart_T301TK0FIOG4.2~ADXG65SSCJHC.2 size=291737 2024-03-04T12:26:51.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.514+0000 7fa4b3c3e780 1 < canceled multipart upload key=T301TK0FIOG4 upload=ADXG65SSCJHC tag=ZG2YK8RJ01KS type=write size=3437465 2024-03-04T12:26:51.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.515+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=H3Y001Q60BF0 type=del size=3018761 2024-03-04T12:26:51.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.516+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=T5ZFJ5E2E824 type=del 2024-03-04T12:26:51.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.518+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~G7HKHZWGT7AV.0 size=719884 2024-03-04T12:26:51.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.518+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=G7HKHZWGT7AV tag=ZDQI2GKRRUB3 type=write size=1768460 2024-03-04T12:26:51.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.519+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~7RZ5B56B44TS.0 size=1048576 2024-03-04T12:26:51.527 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.520+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~7RZ5B56B44TS.1 size=927030 2024-03-04T12:26:51.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.522+0000 7fa4b3c3e780 1 < completed multipart upload key=4989OME3IAJF upload=7RZ5B56B44TS tag=J8ZVF7DOSLXL type=write size=3024182 2024-03-04T12:26:51.531 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.524+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~QHEDUVWXG5W7.0 size=1048576 2024-03-04T12:26:51.532 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.525+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~QHEDUVWXG5W7.1 size=1048576 2024-03-04T12:26:51.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.526+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~QHEDUVWXG5W7.2 size=351660 2024-03-04T12:26:51.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.526+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=QHEDUVWXG5W7 tag=PA6I4K68GJ7I type=write size=3497388 2024-03-04T12:26:51.534 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.527+0000 7fa4b3c3e780 1 < canceled operation key=3TDMQXKLPX34 tag=7F70CTMB95VA type=del size=4113067 2024-03-04T12:26:51.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.529+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~MEMMVHL4QG4D.0 size=1048576 2024-03-04T12:26:51.537 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.530+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~MEMMVHL4QG4D.1 size=1048576 2024-03-04T12:26:51.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.531+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~MEMMVHL4QG4D.2 size=537275 2024-03-04T12:26:51.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.531+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=MEMMVHL4QG4D tag=4JZX8IX8MA3N type=write size=3683003 2024-03-04T12:26:51.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.532+0000 7fa4b3c3e780 1 < completed write operation key=H5FWRNK8F7QT tag=BTWYTBHEF2W2 type=write size=123915 2024-03-04T12:26:51.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.534+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~HZJA718YWDKV.0 size=278106 2024-03-04T12:26:51.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.534+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=HZJA718YWDKV tag=CR4PGZIE8Y8J type=write size=1326682 2024-03-04T12:26:51.542 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.535+0000 7fa4b3c3e780 1 < completed delete operation key=RHU0QO8HS5SC tag=LEM0MIK06C8P type=del 2024-03-04T12:26:51.543 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.537+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=F1PXSNYDZI2X type=write size=262533 2024-03-04T12:26:51.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.538+0000 7fa4b3c3e780 1 < completed delete operation key=J53J0N99N30A tag=APMLIMTJ3ATT type=del 2024-03-04T12:26:51.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.540+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~ICHBKTB4VRZM.0 size=124138 2024-03-04T12:26:51.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.540+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=ICHBKTB4VRZM tag=HORYBU80ON86 type=write size=1172714 2024-03-04T12:26:51.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.540+0000 7fa4b3c3e780 1 < canceled part key=_multipart_VAIY4J3CYONH.2~PKR7LDL4SJGC.0 size=1048576 2024-03-04T12:26:51.548 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.541+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~PKR7LDL4SJGC.1 size=838915 2024-03-04T12:26:51.550 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.543+0000 7fa4b3c3e780 1 < canceled multipart upload key=VAIY4J3CYONH upload=PKR7LDL4SJGC tag=RIJ6F0ROXD57 type=write size=2936067 2024-03-04T12:26:51.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.545+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~LDQK89RKTLSC.0 size=89551 2024-03-04T12:26:51.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.545+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=LDQK89RKTLSC tag=9DFRNI4GASGB type=write size=1138127 2024-03-04T12:26:51.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.546+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~D955O5A5438X.0 size=341626 2024-03-04T12:26:51.555 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.548+0000 7fa4b3c3e780 1 < completed multipart upload key=4989OME3IAJF upload=D955O5A5438X tag=N8WISOH9KR4Y type=write size=1390202 2024-03-04T12:26:51.556 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.549+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=JPUUI3CGH6FR type=del size=775101 2024-03-04T12:26:51.557 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.550+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=21NZR6Y2PW0U type=del 2024-03-04T12:26:51.558 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.551+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=D07USOQQL4YZ type=del size=851158 2024-03-04T12:26:51.559 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.552+0000 7fa4b3c3e780 1 < canceled part key=_multipart_R1DOKJPZRT5Q.2~LJEVYMULUJP1.0 size=1048576 2024-03-04T12:26:51.559 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.553+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~LJEVYMULUJP1.1 size=472942 2024-03-04T12:26:51.561 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.554+0000 7fa4b3c3e780 1 < canceled multipart upload key=R1DOKJPZRT5Q upload=LJEVYMULUJP1 tag=0IMO4SSLGOOM type=write size=2570094 2024-03-04T12:26:51.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.556+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=ESJSF3GQPYR3 type=write size=1040741 2024-03-04T12:26:51.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.558+0000 7fa4b3c3e780 1 < suggested remove operation key=7IUV88NQLPN8 tag=SNK7LTFF08VT type=del 2024-03-04T12:26:51.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.560+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~BWYCG22817AH.0 size=1048576 2024-03-04T12:26:51.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.561+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~BWYCG22817AH.1 size=477174 2024-03-04T12:26:51.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.561+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=BWYCG22817AH tag=MG7JEIC2U9FY type=write size=2574326 2024-03-04T12:26:51.569 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.562+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=HG4YSB511S82 type=del 2024-03-04T12:26:51.570 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.563+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=B6TQW97SAE80 type=del size=3932232 2024-03-04T12:26:51.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.564+0000 7fa4b3c3e780 1 < canceled operation key=DHLTVH2AZBLR tag=67AHU0G4F708 type=del size=1344401 2024-03-04T12:26:51.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.567+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~C29HZROPWJYK.0 size=1048576 2024-03-04T12:26:51.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.567+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~C29HZROPWJYK.1 size=105243 2024-03-04T12:26:51.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.567+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=C29HZROPWJYK tag=T4R5J2HKFZB3 type=write size=2202395 2024-03-04T12:26:51.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.568+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~FDH1NWPAGKYA.0 size=1048576 2024-03-04T12:26:51.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.569+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~FDH1NWPAGKYA.1 size=986613 2024-03-04T12:26:51.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.571+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=FDH1NWPAGKYA tag=706N5DXWONA3 type=write size=3083765 2024-03-04T12:26:51.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.572+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=Y9VEW26B7IE5 type=del size=4020508 2024-03-04T12:26:51.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.573+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~82TDCBADO092.0 size=594337 2024-03-04T12:26:51.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.575+0000 7fa4b3c3e780 1 < completed multipart upload key=G70BJ2UARNCP upload=82TDCBADO092 tag=77C2JWCL64XK type=write size=1642913 2024-03-04T12:26:51.583 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.576+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=MR2HNWAW66HF type=write size=193407 2024-03-04T12:26:51.584 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.577+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=H3Y001Q60BF0 type=del 2024-03-04T12:26:51.585 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.579+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=PPECLP56M250 type=del size=311318 2024-03-04T12:26:51.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.579+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YWJV4QMY6ZBI.2~G7HKHZWGT7AV.0 size=719884 2024-03-04T12:26:51.587 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.581+0000 7fa4b3c3e780 1 < canceled multipart upload key=YWJV4QMY6ZBI upload=G7HKHZWGT7AV tag=ZDQI2GKRRUB3 type=write size=1768460 2024-03-04T12:26:51.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.582+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=JF0WUW382M1O type=del size=1855472 2024-03-04T12:26:51.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.583+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~QHEDUVWXG5W7.0 size=1048576 2024-03-04T12:26:51.591 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.584+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~QHEDUVWXG5W7.1 size=1048576 2024-03-04T12:26:51.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.585+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~QHEDUVWXG5W7.2 size=351660 2024-03-04T12:26:51.594 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.587+0000 7fa4b3c3e780 1 < completed multipart upload key=43HMF7NWNMU3 upload=QHEDUVWXG5W7 tag=PA6I4K68GJ7I type=write size=3497388 2024-03-04T12:26:51.595 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.588+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=8Z0BFWZC9OUZ type=del size=3402269 2024-03-04T12:26:51.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.589+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~MEMMVHL4QG4D.0 size=1048576 2024-03-04T12:26:51.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.590+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~MEMMVHL4QG4D.1 size=1048576 2024-03-04T12:26:51.598 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.591+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~MEMMVHL4QG4D.2 size=537275 2024-03-04T12:26:51.600 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.593+0000 7fa4b3c3e780 1 < completed multipart upload key=V7N7MZ1GUNEV upload=MEMMVHL4QG4D tag=4JZX8IX8MA3N type=write size=3683003 2024-03-04T12:26:51.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.594+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=HU1IEQ6FUBMR type=write size=474848 2024-03-04T12:26:51.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.594+0000 7fa4b3c3e780 1 < canceled part key=_multipart_GMIPCGYZRJ5L.2~HZJA718YWDKV.0 size=278106 2024-03-04T12:26:51.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.596+0000 7fa4b3c3e780 1 < canceled multipart upload key=GMIPCGYZRJ5L upload=HZJA718YWDKV tag=CR4PGZIE8Y8J type=write size=1326682 2024-03-04T12:26:51.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.597+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=L1XYKU0ELDU5 type=del size=1064527 2024-03-04T12:26:51.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.599+0000 7fa4b3c3e780 1 < completed write operation key=RHU0QO8HS5SC tag=F1PXSNYDZI2X type=write size=262533 2024-03-04T12:26:51.608 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.601+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~BQKNUVCEH7OX.0 size=1048576 2024-03-04T12:26:51.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.602+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~BQKNUVCEH7OX.1 size=223189 2024-03-04T12:26:51.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.602+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=BQKNUVCEH7OX tag=3EJV7H4UZ0ZE type=write size=2320341 2024-03-04T12:26:51.610 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.603+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~ICHBKTB4VRZM.0 size=124138 2024-03-04T12:26:51.612 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.605+0000 7fa4b3c3e780 1 < completed multipart upload key=YIS2SV4O5EZN upload=ICHBKTB4VRZM tag=HORYBU80ON86 type=write size=1172714 2024-03-04T12:26:51.613 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.606+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=TON1DBS4FJ51 type=write size=289386 2024-03-04T12:26:51.615 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.608+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~LDQK89RKTLSC.0 size=89551 2024-03-04T12:26:51.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.611+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=LDQK89RKTLSC tag=9DFRNI4GASGB type=write size=1138127 2024-03-04T12:26:51.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.612+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=8R5AUCO483XP type=del size=2682625 2024-03-04T12:26:51.620 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.613+0000 7fa4b3c3e780 -1 < failed to complete operation key=7IUV88NQLPN8 tag=JPUUI3CGH6FR type=del size=775101: (22) Invalid argument 2024-03-04T12:26:51.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.615+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~UP5473MU21FK.0 size=1048576 2024-03-04T12:26:51.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.616+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~UP5473MU21FK.1 size=611632 2024-03-04T12:26:51.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.616+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=UP5473MU21FK tag=3LNS75Y54TH1 type=write size=2708784 2024-03-04T12:26:51.625 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.618+0000 7fa4b3c3e780 1 < suggested update operation key=ZETES4AYZQHY tag=D07USOQQL4YZ type=del size=851158 2024-03-04T12:26:51.626 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.619+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=47ZC67CSH8BK type=del size=1341422 2024-03-04T12:26:51.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.621+0000 7fa4b3c3e780 1 < completed write operation key=BR8RTE2QEH9E tag=ESJSF3GQPYR3 type=write size=1040741 2024-03-04T12:26:51.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.623+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~5LJDBQ3TZ8PH.0 size=1048576 2024-03-04T12:26:51.630 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.623+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~5LJDBQ3TZ8PH.1 size=969292 2024-03-04T12:26:51.630 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.623+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=5LJDBQ3TZ8PH tag=6FIY01Q6XYU3 type=write size=3066444 2024-03-04T12:26:51.631 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.625+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~BWYCG22817AH.0 size=1048576 2024-03-04T12:26:51.632 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.626+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~BWYCG22817AH.1 size=477174 2024-03-04T12:26:51.634 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.627+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=BWYCG22817AH tag=MG7JEIC2U9FY type=write size=2574326 2024-03-04T12:26:51.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.629+0000 7fa4b3c3e780 1 > prepared part key=_multipart_J53J0N99N30A.2~OOQ0H1I3X134.0 size=868264 2024-03-04T12:26:51.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.629+0000 7fa4b3c3e780 1 > prepared multipart upload key=J53J0N99N30A upload=OOQ0H1I3X134 tag=9SV8K7DC0U60 type=write size=1916840 2024-03-04T12:26:51.637 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.631+0000 7fa4b3c3e780 1 < completed delete operation key=YWJV4QMY6ZBI tag=B6TQW97SAE80 type=del 2024-03-04T12:26:51.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.633+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~P9VP1YLKQ4IS.0 size=356004 2024-03-04T12:26:51.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.633+0000 7fa4b3c3e780 1 > prepared multipart upload key=G8G76PMSKJ0I upload=P9VP1YLKQ4IS tag=MO650UCS9B26 type=write size=1404580 2024-03-04T12:26:51.640 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.634+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~C29HZROPWJYK.0 size=1048576 2024-03-04T12:26:51.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.634+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~C29HZROPWJYK.1 size=105243 2024-03-04T12:26:51.643 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.636+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=C29HZROPWJYK tag=T4R5J2HKFZB3 type=write size=2202395 2024-03-04T12:26:51.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.638+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~OKZJ37YKNVQB.0 size=1048576 2024-03-04T12:26:51.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.639+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~OKZJ37YKNVQB.1 size=349591 2024-03-04T12:26:51.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.639+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=OKZJ37YKNVQB tag=K20LU27J652W type=write size=2446743 2024-03-04T12:26:51.648 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.641+0000 7fa4b3c3e780 1 < suggested update operation key=UZRX3W3DE5VX tag=Y9VEW26B7IE5 type=del size=4020508 2024-03-04T12:26:51.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.643+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~XAQLH30SW1HE.0 size=1048576 2024-03-04T12:26:51.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.644+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~XAQLH30SW1HE.1 size=1048576 2024-03-04T12:26:51.652 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.645+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~XAQLH30SW1HE.2 size=728720 2024-03-04T12:26:51.652 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.645+0000 7fa4b3c3e780 1 > prepared multipart upload key=NVMIU38VM9Q1 upload=XAQLH30SW1HE tag=MQPWC26MKN3W type=write size=3874448 2024-03-04T12:26:51.653 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.646+0000 7fa4b3c3e780 1 < completed write operation key=G8G76PMSKJ0I tag=MR2HNWAW66HF type=write size=193407 2024-03-04T12:26:51.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.648+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~WVISJIHV2VPZ.0 size=223313 2024-03-04T12:26:51.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.648+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=WVISJIHV2VPZ tag=NZXVKD1FYGF9 type=write size=1271889 2024-03-04T12:26:51.656 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.649+0000 7fa4b3c3e780 1 < completed delete operation key=R6Y09EO6HGF0 tag=PPECLP56M250 type=del 2024-03-04T12:26:51.657 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.650+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=PCZ32JBED0KO type=del size=2665473 2024-03-04T12:26:51.658 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.651+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=JF0WUW382M1O type=del 2024-03-04T12:26:51.659 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.652+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=F3X009NQCO2G type=write size=689601 2024-03-04T12:26:51.661 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.654+0000 7fa4b3c3e780 -1 < failed to complete operation key=UZRX3W3DE5VX tag=8Z0BFWZC9OUZ type=del size=3402269: (22) Invalid argument 2024-03-04T12:26:51.662 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.655+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=V5S4SK1AV5VR type=del size=1279000 2024-03-04T12:26:51.663 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.656+0000 7fa4b3c3e780 1 < canceled operation key=G70BJ2UARNCP tag=HU1IEQ6FUBMR type=write size=474848 2024-03-04T12:26:51.664 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.658+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=JHZB36IO2QM4 type=del size=3774168 2024-03-04T12:26:51.666 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.659+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=L1XYKU0ELDU5 type=del 2024-03-04T12:26:51.667 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.660+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=ATBRO0I1I5ZU type=del size=2360199 2024-03-04T12:26:51.667 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.660+0000 7fa4b3c3e780 1 < canceled part key=_multipart_WRHB3XWDLSY2.2~BQKNUVCEH7OX.0 size=1048576 2024-03-04T12:26:51.668 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.661+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~BQKNUVCEH7OX.1 size=223189 2024-03-04T12:26:51.670 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.663+0000 7fa4b3c3e780 1 < canceled multipart upload key=WRHB3XWDLSY2 upload=BQKNUVCEH7OX tag=3EJV7H4UZ0ZE type=write size=2320341 2024-03-04T12:26:51.671 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.665+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~DJLFXTU5H97V.0 size=1048576 2024-03-04T12:26:51.672 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.666+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~DJLFXTU5H97V.1 size=735366 2024-03-04T12:26:51.672 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.666+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=DJLFXTU5H97V tag=XGYKYZKFBMG1 type=write size=2832518 2024-03-04T12:26:51.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.667+0000 7fa4b3c3e780 1 < canceled operation key=4LKTYP07OL5L tag=TON1DBS4FJ51 type=write size=289386 2024-03-04T12:26:51.675 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.669+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~T133YR4JXCO5.0 size=544141 2024-03-04T12:26:51.675 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.669+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=T133YR4JXCO5 tag=VS10Q99XPDQI type=write size=1592717 2024-03-04T12:26:51.677 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.670+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=8R5AUCO483XP type=del 2024-03-04T12:26:51.678 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.671+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=G8U8VHD0ZHPR type=del size=2062152 2024-03-04T12:26:51.679 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.672+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~UP5473MU21FK.0 size=1048576 2024-03-04T12:26:51.680 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.673+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~UP5473MU21FK.1 size=611632 2024-03-04T12:26:51.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.675+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=UP5473MU21FK tag=3LNS75Y54TH1 type=write size=2708784 2024-03-04T12:26:51.683 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.676+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=TB1S5P058MHI type=del size=2940246 2024-03-04T12:26:51.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.677+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=47ZC67CSH8BK type=del 2024-03-04T12:26:51.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.679+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~BQLAW7SHE055.0 size=1048576 2024-03-04T12:26:51.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.680+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~BQLAW7SHE055.1 size=410717 2024-03-04T12:26:51.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.680+0000 7fa4b3c3e780 1 > prepared multipart upload key=4LKTYP07OL5L upload=BQLAW7SHE055 tag=HHPPSFP8MLRN type=write size=2507869 2024-03-04T12:26:51.688 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.681+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~5LJDBQ3TZ8PH.0 size=1048576 2024-03-04T12:26:51.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.682+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~5LJDBQ3TZ8PH.1 size=969292 2024-03-04T12:26:51.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.684+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=5LJDBQ3TZ8PH tag=6FIY01Q6XYU3 type=write size=3066444 2024-03-04T12:26:51.692 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.685+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=HU2DAZP2Q2R4 type=del size=2121978 2024-03-04T12:26:51.693 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.686+0000 7fa4b3c3e780 1 < completed part key=_multipart_J53J0N99N30A.2~OOQ0H1I3X134.0 size=868264 2024-03-04T12:26:51.695 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.688+0000 7fa4b3c3e780 1 < completed multipart upload key=J53J0N99N30A upload=OOQ0H1I3X134 tag=9SV8K7DC0U60 type=write size=1916840 2024-03-04T12:26:51.696 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.689+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=T6JW7Z2PXIJN type=del size=863002 2024-03-04T12:26:51.697 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.690+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~P9VP1YLKQ4IS.0 size=356004 2024-03-04T12:26:51.699 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.692+0000 7fa4b3c3e780 1 < completed multipart upload key=G8G76PMSKJ0I upload=P9VP1YLKQ4IS tag=MO650UCS9B26 type=write size=1404580 2024-03-04T12:26:51.700 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.693+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=XDFRNQ8H9JMZ type=write size=89429 2024-03-04T12:26:51.701 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.695+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~OKZJ37YKNVQB.0 size=1048576 2024-03-04T12:26:51.702 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.696+0000 7fa4b3c3e780 1 < completed part key=_multipart_ESHAMQWMMBJR.2~OKZJ37YKNVQB.1 size=349591 2024-03-04T12:26:51.704 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.698+0000 7fa4b3c3e780 1 < completed multipart upload key=ESHAMQWMMBJR upload=OKZJ37YKNVQB tag=K20LU27J652W type=write size=2446743 2024-03-04T12:26:51.706 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.700+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~RCKQ4V8NVOMF.0 size=1048576 2024-03-04T12:26:51.707 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.700+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~RCKQ4V8NVOMF.1 size=515776 2024-03-04T12:26:51.707 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.700+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=RCKQ4V8NVOMF tag=2ZEL8GTK7J9Q type=write size=2612928 2024-03-04T12:26:51.708 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.702+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~XAQLH30SW1HE.0 size=1048576 2024-03-04T12:26:51.709 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.702+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~XAQLH30SW1HE.1 size=1048576 2024-03-04T12:26:51.710 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.703+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~XAQLH30SW1HE.2 size=728720 2024-03-04T12:26:51.712 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.705+0000 7fa4b3c3e780 1 < completed multipart upload key=NVMIU38VM9Q1 upload=XAQLH30SW1HE tag=MQPWC26MKN3W type=write size=3874448 2024-03-04T12:26:51.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.706+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=AXKYY0EEAB9W type=write size=891431 2024-03-04T12:26:51.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.706+0000 7fa4b3c3e780 1 < canceled part key=_multipart_KKQT9J9GSW0N.2~WVISJIHV2VPZ.0 size=223313 2024-03-04T12:26:51.715 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.708+0000 7fa4b3c3e780 1 < canceled multipart upload key=KKQT9J9GSW0N upload=WVISJIHV2VPZ tag=NZXVKD1FYGF9 type=write size=1271889 2024-03-04T12:26:51.716 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.709+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=V2FYH2BAKCAF type=del size=2493102 2024-03-04T12:26:51.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.710+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=PCZ32JBED0KO type=del 2024-03-04T12:26:51.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.712+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=FJZ98XE8G6UA type=del size=2960802 2024-03-04T12:26:51.719 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.713+0000 7fa4b3c3e780 1 < canceled operation key=V7N7MZ1GUNEV tag=F3X009NQCO2G type=write size=689601 2024-03-04T12:26:51.722 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.715+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=02Y7VNX9VQZ7 type=del size=622143 2024-03-04T12:26:51.724 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.717+0000 7fa4b3c3e780 1 < suggested update operation key=BVMWQ9ZL4K0C tag=V5S4SK1AV5VR type=del size=1279000 2024-03-04T12:26:51.726 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.719+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~SKUPRMPRJXE4.0 size=1048576 2024-03-04T12:26:51.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.720+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~SKUPRMPRJXE4.1 size=1048576 2024-03-04T12:26:51.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.721+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~SKUPRMPRJXE4.2 size=478985 2024-03-04T12:26:51.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.721+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=SKUPRMPRJXE4 tag=MLLGEOI8XJCT type=write size=3624713 2024-03-04T12:26:51.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.723+0000 7fa4b3c3e780 1 < suggested remove operation key=X0RVLNRWUAEM tag=JHZB36IO2QM4 type=del 2024-03-04T12:26:51.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.724+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=Y13H69R8U3V2 type=del size=1943542 2024-03-04T12:26:51.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.726+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=ATBRO0I1I5ZU type=del 2024-03-04T12:26:51.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.727+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=G0RU91YWYJP0 type=del size=628512 2024-03-04T12:26:51.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.728+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~DJLFXTU5H97V.0 size=1048576 2024-03-04T12:26:51.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.728+0000 7fa4b3c3e780 1 < canceled part key=_multipart_6XK4DQ940Z5J.2~DJLFXTU5H97V.1 size=735366 2024-03-04T12:26:51.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.730+0000 7fa4b3c3e780 1 < canceled multipart upload key=6XK4DQ940Z5J upload=DJLFXTU5H97V tag=XGYKYZKFBMG1 type=write size=2832518 2024-03-04T12:26:51.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.731+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=NS5BXBE5IF91 type=del size=1412751 2024-03-04T12:26:51.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.732+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~T133YR4JXCO5.0 size=544141 2024-03-04T12:26:51.741 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.734+0000 7fa4b3c3e780 1 < completed multipart upload key=BVMWQ9ZL4K0C upload=T133YR4JXCO5 tag=VS10Q99XPDQI type=write size=1592717 2024-03-04T12:26:51.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.736+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~5CZHQXLHK2K4.0 size=1048576 2024-03-04T12:26:51.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.737+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~5CZHQXLHK2K4.1 size=1048576 2024-03-04T12:26:51.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.738+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~5CZHQXLHK2K4.2 size=502910 2024-03-04T12:26:51.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.738+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=5CZHQXLHK2K4 tag=IFCIQX1W9UDD type=write size=3648638 2024-03-04T12:26:51.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.739+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=G8U8VHD0ZHPR type=del 2024-03-04T12:26:51.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.742+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~Z2QUJVPNP3G1.0 size=1048576 2024-03-04T12:26:51.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.742+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~Z2QUJVPNP3G1.1 size=1048576 2024-03-04T12:26:51.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.743+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~Z2QUJVPNP3G1.2 size=380087 2024-03-04T12:26:51.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.743+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=Z2QUJVPNP3G1 tag=WW3IR22K61VC type=write size=3525815 2024-03-04T12:26:51.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.744+0000 7fa4b3c3e780 1 < completed delete operation key=G8G76PMSKJ0I tag=TB1S5P058MHI type=del 2024-03-04T12:26:51.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.746+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=KM69FEWAPW13 type=write size=829736 2024-03-04T12:26:51.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.747+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~BQLAW7SHE055.0 size=1048576 2024-03-04T12:26:51.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.748+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~BQLAW7SHE055.1 size=410717 2024-03-04T12:26:51.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.750+0000 7fa4b3c3e780 1 < completed multipart upload key=4LKTYP07OL5L upload=BQLAW7SHE055 tag=HHPPSFP8MLRN type=write size=2507869 2024-03-04T12:26:51.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.751+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=3N2V6R33QLXL type=del size=836718 2024-03-04T12:26:51.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.753+0000 7fa4b3c3e780 1 < suggested remove operation key=YQLH0WW7I7MW tag=HU2DAZP2Q2R4 type=del 2024-03-04T12:26:51.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.754+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=AO2SH53JGQK9 type=del size=2371337 2024-03-04T12:26:51.762 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.755+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=T6JW7Z2PXIJN type=del 2024-03-04T12:26:51.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.756+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=L0P67GQ6H99Y type=del size=2245792 2024-03-04T12:26:51.764 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.758+0000 7fa4b3c3e780 1 < completed write operation key=UZRX3W3DE5VX tag=XDFRNQ8H9JMZ type=write size=89429 2024-03-04T12:26:51.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.760+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~0GSUV3ZQIPUT.0 size=1048576 2024-03-04T12:26:51.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.761+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~0GSUV3ZQIPUT.1 size=411309 2024-03-04T12:26:51.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.761+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=0GSUV3ZQIPUT tag=4XHJR33F31LA type=write size=2508461 2024-03-04T12:26:51.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.761+0000 7fa4b3c3e780 1 < canceled part key=_multipart_VAIY4J3CYONH.2~RCKQ4V8NVOMF.0 size=1048576 2024-03-04T12:26:51.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.762+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~RCKQ4V8NVOMF.1 size=515776 2024-03-04T12:26:51.771 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.764+0000 7fa4b3c3e780 1 < canceled multipart upload key=VAIY4J3CYONH upload=RCKQ4V8NVOMF tag=2ZEL8GTK7J9Q type=write size=2612928 2024-03-04T12:26:51.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.765+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=DVEJIH6054Y4 type=del size=3155210 2024-03-04T12:26:51.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.766+0000 7fa4b3c3e780 -1 < failed to complete operation key=YQLH0WW7I7MW tag=AXKYY0EEAB9W type=write size=891431: (22) Invalid argument 2024-03-04T12:26:51.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.768+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=6B9VEP8K6L1S type=del size=2172559 2024-03-04T12:26:51.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.769+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=V2FYH2BAKCAF type=del 2024-03-04T12:26:51.777 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.770+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=O1VA5QILUM5H type=del size=4071812 2024-03-04T12:26:51.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.772+0000 7fa4b3c3e780 1 < suggested remove operation key=NVMIU38VM9Q1 tag=FJZ98XE8G6UA type=del 2024-03-04T12:26:51.780 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.773+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=7S0Z5WVEQ8OM type=del size=2578720 2024-03-04T12:26:51.781 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.774+0000 7fa4b3c3e780 1 < canceled operation key=3TDMQXKLPX34 tag=02Y7VNX9VQZ7 type=del size=622143 2024-03-04T12:26:51.783 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.777+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~F7Q432BN387M.0 size=1048576 2024-03-04T12:26:51.784 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.777+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~F7Q432BN387M.1 size=181501 2024-03-04T12:26:51.784 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.777+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=F7Q432BN387M tag=CFFD678K4KUJ type=write size=2278653 2024-03-04T12:26:51.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.779+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~SKUPRMPRJXE4.0 size=1048576 2024-03-04T12:26:51.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.780+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~SKUPRMPRJXE4.1 size=1048576 2024-03-04T12:26:51.787 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.781+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~SKUPRMPRJXE4.2 size=478985 2024-03-04T12:26:51.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.783+0000 7fa4b3c3e780 1 < completed multipart upload key=YIS2SV4O5EZN upload=SKUPRMPRJXE4 tag=MLLGEOI8XJCT type=write size=3624713 2024-03-04T12:26:51.791 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.785+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~LK9PI6DITKJ3.0 size=533529 2024-03-04T12:26:51.791 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.785+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=LK9PI6DITKJ3 tag=SNLVGVCS4H1K type=write size=1582105 2024-03-04T12:26:51.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.787+0000 7fa4b3c3e780 1 < suggested remove operation key=GMIPCGYZRJ5L tag=Y13H69R8U3V2 type=del 2024-03-04T12:26:51.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.789+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~FWUX4E7BTDUB.0 size=1048576 2024-03-04T12:26:51.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.790+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~FWUX4E7BTDUB.1 size=172600 2024-03-04T12:26:51.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.790+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=FWUX4E7BTDUB tag=EEJH5VVGCTJL type=write size=2269752 2024-03-04T12:26:51.797 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.791+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=G0RU91YWYJP0 type=del 2024-03-04T12:26:51.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.793+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~NI5KPNHHCJV1.0 size=495090 2024-03-04T12:26:51.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.793+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=NI5KPNHHCJV1 tag=KNBEQSKJWRAC type=write size=1543666 2024-03-04T12:26:51.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.794+0000 7fa4b3c3e780 1 < completed delete operation key=YIS2SV4O5EZN tag=NS5BXBE5IF91 type=del 2024-03-04T12:26:51.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.795+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=9PKRBS3OG70S type=del size=1274690 2024-03-04T12:26:51.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.796+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~5CZHQXLHK2K4.0 size=1048576 2024-03-04T12:26:51.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.797+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~5CZHQXLHK2K4.1 size=1048576 2024-03-04T12:26:51.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.797+0000 7fa4b3c3e780 1 < canceled part key=_multipart_BVMWQ9ZL4K0C.2~5CZHQXLHK2K4.2 size=502910 2024-03-04T12:26:51.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.799+0000 7fa4b3c3e780 1 < canceled multipart upload key=BVMWQ9ZL4K0C upload=5CZHQXLHK2K4 tag=IFCIQX1W9UDD type=write size=3648638 2024-03-04T12:26:51.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.800+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=LRAQ1N4OGQ0S type=del size=1728208 2024-03-04T12:26:51.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.801+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~Z2QUJVPNP3G1.0 size=1048576 2024-03-04T12:26:51.809 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.802+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~Z2QUJVPNP3G1.1 size=1048576 2024-03-04T12:26:51.810 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.803+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~Z2QUJVPNP3G1.2 size=380087 2024-03-04T12:26:51.812 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.805+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=Z2QUJVPNP3G1 tag=WW3IR22K61VC type=write size=3525815 2024-03-04T12:26:51.813 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.807+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=QBNUWX3GR9NG type=del size=3352091 2024-03-04T12:26:51.814 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.808+0000 7fa4b3c3e780 1 < completed write operation key=6XK4DQ940Z5J tag=KM69FEWAPW13 type=write size=829736 2024-03-04T12:26:51.816 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.809+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=3GFWGXRXPDWE type=write size=907190 2024-03-04T12:26:51.817 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.810+0000 7fa4b3c3e780 1 < canceled operation key=BVMWQ9ZL4K0C tag=3N2V6R33QLXL type=del size=836718 2024-03-04T12:26:51.819 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.812+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~1FQGO24SHRRB.0 size=1048576 2024-03-04T12:26:51.820 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.813+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~1FQGO24SHRRB.1 size=839521 2024-03-04T12:26:51.820 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.813+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=1FQGO24SHRRB tag=1Q8M5IRH4M82 type=write size=2936673 2024-03-04T12:26:51.821 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.814+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=AO2SH53JGQK9 type=del 2024-03-04T12:26:51.823 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.816+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~1H23YFFIZ5E2.0 size=1048576 2024-03-04T12:26:51.824 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.817+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~1H23YFFIZ5E2.1 size=1048576 2024-03-04T12:26:51.828 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.818+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~1H23YFFIZ5E2.2 size=102216 2024-03-04T12:26:51.828 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.818+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=1H23YFFIZ5E2 tag=7IPZC6IQENM7 type=write size=3247944 2024-03-04T12:26:51.828 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.819+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=L0P67GQ6H99Y type=del 2024-03-04T12:26:51.829 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.822+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~IBMK7MJS5NG0.0 size=1048576 2024-03-04T12:26:51.830 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.823+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~IBMK7MJS5NG0.1 size=792939 2024-03-04T12:26:51.830 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.823+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=IBMK7MJS5NG0 tag=LBE5MSHV0WH5 type=write size=2890091 2024-03-04T12:26:51.831 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.824+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~0GSUV3ZQIPUT.0 size=1048576 2024-03-04T12:26:51.832 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.825+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~0GSUV3ZQIPUT.1 size=411309 2024-03-04T12:26:51.834 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.827+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=0GSUV3ZQIPUT tag=4XHJR33F31LA type=write size=2508461 2024-03-04T12:26:51.835 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.828+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=I50P1IXRD63Y type=del size=2120026 2024-03-04T12:26:51.836 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.829+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=DVEJIH6054Y4 type=del 2024-03-04T12:26:51.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.831+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~J417I0GM5735.0 size=843368 2024-03-04T12:26:51.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.831+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=J417I0GM5735 tag=3U861JFYYX2E type=write size=1891944 2024-03-04T12:26:51.839 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.832+0000 7fa4b3c3e780 1 < completed delete operation key=R1DOKJPZRT5Q tag=6B9VEP8K6L1S type=del 2024-03-04T12:26:51.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.834+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~UW3WSF1XQSA2.0 size=3668 2024-03-04T12:26:51.841 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.834+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=UW3WSF1XQSA2 tag=N74RZATXUIV4 type=write size=1052244 2024-03-04T12:26:51.843 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.836+0000 7fa4b3c3e780 1 < suggested remove operation key=V7N7MZ1GUNEV tag=O1VA5QILUM5H type=del 2024-03-04T12:26:51.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.838+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~O19K9ZYA8FKG.0 size=1048576 2024-03-04T12:26:51.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.838+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~O19K9ZYA8FKG.1 size=613629 2024-03-04T12:26:51.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.838+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=O19K9ZYA8FKG tag=UCXBEKTIGRQM type=write size=2710781 2024-03-04T12:26:51.847 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.841+0000 7fa4b3c3e780 1 < suggested update operation key=BVMWQ9ZL4K0C tag=7S0Z5WVEQ8OM type=del size=2578720 2024-03-04T12:26:51.849 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.843+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~G9IRKE6BX7RH.0 size=1048576 2024-03-04T12:26:51.850 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.843+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~G9IRKE6BX7RH.1 size=1048576 2024-03-04T12:26:51.851 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.844+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G4SUQFVB936T.2~G9IRKE6BX7RH.2 size=792392 2024-03-04T12:26:51.851 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.844+0000 7fa4b3c3e780 1 > prepared multipart upload key=G4SUQFVB936T upload=G9IRKE6BX7RH tag=LZ45CJR8XATJ type=write size=3938120 2024-03-04T12:26:51.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.845+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~F7Q432BN387M.0 size=1048576 2024-03-04T12:26:51.853 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.846+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~F7Q432BN387M.1 size=181501 2024-03-04T12:26:51.855 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.848+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=F7Q432BN387M tag=CFFD678K4KUJ type=write size=2278653 2024-03-04T12:26:51.857 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.850+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~EPTA3FJ1T9Z4.0 size=1048576 2024-03-04T12:26:51.858 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.851+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~EPTA3FJ1T9Z4.1 size=1048576 2024-03-04T12:26:51.859 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.852+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~EPTA3FJ1T9Z4.2 size=459868 2024-03-04T12:26:51.859 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.852+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=EPTA3FJ1T9Z4 tag=NIO48NS7473V type=write size=3605596 2024-03-04T12:26:51.860 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.854+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~LK9PI6DITKJ3.0 size=533529 2024-03-04T12:26:51.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.856+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=LK9PI6DITKJ3 tag=SNLVGVCS4H1K type=write size=1582105 2024-03-04T12:26:51.865 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.858+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~UDNLZL7C5QV3.0 size=1048576 2024-03-04T12:26:51.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.859+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~UDNLZL7C5QV3.1 size=1048576 2024-03-04T12:26:51.867 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.860+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~UDNLZL7C5QV3.2 size=397774 2024-03-04T12:26:51.867 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.860+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=UDNLZL7C5QV3 tag=TAD2DQ5NLLEX type=write size=3543502 2024-03-04T12:26:51.868 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.861+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~FWUX4E7BTDUB.0 size=1048576 2024-03-04T12:26:51.868 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.861+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YQLH0WW7I7MW.2~FWUX4E7BTDUB.1 size=172600 2024-03-04T12:26:51.870 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.863+0000 7fa4b3c3e780 1 < canceled multipart upload key=YQLH0WW7I7MW upload=FWUX4E7BTDUB tag=EEJH5VVGCTJL type=write size=2269752 2024-03-04T12:26:51.871 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.864+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=5J7ZZYQY4JCT type=del size=451460 2024-03-04T12:26:51.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.865+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~NI5KPNHHCJV1.0 size=495090 2024-03-04T12:26:51.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.867+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=NI5KPNHHCJV1 tag=KNBEQSKJWRAC type=write size=1543666 2024-03-04T12:26:51.874 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.868+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=393J6JVIYJ59 type=write size=1035113 2024-03-04T12:26:51.875 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.869+0000 7fa4b3c3e780 1 < completed delete operation key=YQLH0WW7I7MW tag=9PKRBS3OG70S type=del 2024-03-04T12:26:51.877 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.870+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=F2YKI0BKD3JH type=del size=281504 2024-03-04T12:26:51.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.871+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=LRAQ1N4OGQ0S type=del 2024-03-04T12:26:51.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.873+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~Z429G5PVIWKV.0 size=1048576 2024-03-04T12:26:51.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.874+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~Z429G5PVIWKV.1 size=1048576 2024-03-04T12:26:51.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.875+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~Z429G5PVIWKV.2 size=759636 2024-03-04T12:26:51.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.875+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=Z429G5PVIWKV tag=2DHBAPLBZNSE type=write size=3905364 2024-03-04T12:26:51.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.876+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=QBNUWX3GR9NG type=del 2024-03-04T12:26:51.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.877+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=RLCLUZ1DSILU type=write size=648320 2024-03-04T12:26:51.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.878+0000 7fa4b3c3e780 1 < completed write operation key=YQLH0WW7I7MW tag=3GFWGXRXPDWE type=write size=907190 2024-03-04T12:26:51.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.881+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~RDUH03V0B2IE.0 size=1002699 2024-03-04T12:26:51.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.881+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=RDUH03V0B2IE tag=UKVA3ZAQ2CX5 type=write size=2051275 2024-03-04T12:26:51.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.882+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~1FQGO24SHRRB.0 size=1048576 2024-03-04T12:26:51.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.883+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~1FQGO24SHRRB.1 size=839521 2024-03-04T12:26:51.891 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.885+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=1FQGO24SHRRB tag=1Q8M5IRH4M82 type=write size=2936673 2024-03-04T12:26:51.893 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.886+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~76PNVROU2ARZ.0 size=1048576 2024-03-04T12:26:51.894 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.887+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~76PNVROU2ARZ.1 size=1048576 2024-03-04T12:26:51.895 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.888+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~76PNVROU2ARZ.2 size=596641 2024-03-04T12:26:51.895 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.888+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=76PNVROU2ARZ tag=M1MYKJ1YGWUO type=write size=3742369 2024-03-04T12:26:51.896 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.889+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~1H23YFFIZ5E2.0 size=1048576 2024-03-04T12:26:51.897 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.890+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~1H23YFFIZ5E2.1 size=1048576 2024-03-04T12:26:51.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.891+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~1H23YFFIZ5E2.2 size=102216 2024-03-04T12:26:51.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.893+0000 7fa4b3c3e780 1 < completed multipart upload key=BVMWQ9ZL4K0C upload=1H23YFFIZ5E2 tag=7IPZC6IQENM7 type=write size=3247944 2024-03-04T12:26:51.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.894+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=7AWSICCBXLE4 type=del size=4158061 2024-03-04T12:26:51.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.896+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~IBMK7MJS5NG0.0 size=1048576 2024-03-04T12:26:51.903 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.896+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~IBMK7MJS5NG0.1 size=792939 2024-03-04T12:26:51.906 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.899+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=IBMK7MJS5NG0 tag=LBE5MSHV0WH5 type=write size=2890091 2024-03-04T12:26:51.908 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.901+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~59EKP4U0AX0G.0 size=1048576 2024-03-04T12:26:51.909 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.902+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~59EKP4U0AX0G.1 size=1048576 2024-03-04T12:26:51.909 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.902+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~59EKP4U0AX0G.2 size=146947 2024-03-04T12:26:51.909 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.903+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=59EKP4U0AX0G tag=TIAZO2MUVE7O type=write size=3292675 2024-03-04T12:26:51.910 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.904+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=I50P1IXRD63Y type=del 2024-03-04T12:26:51.913 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.906+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~93CGMPOIAK6C.0 size=1048576 2024-03-04T12:26:51.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.907+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~93CGMPOIAK6C.1 size=248702 2024-03-04T12:26:51.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.907+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=93CGMPOIAK6C tag=K3V7Z68HWH6W type=write size=2345854 2024-03-04T12:26:51.915 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.908+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~J417I0GM5735.0 size=843368 2024-03-04T12:26:51.917 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.910+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=J417I0GM5735 tag=3U861JFYYX2E type=write size=1891944 2024-03-04T12:26:51.919 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.912+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~EL06LWEU6E1S.0 size=1048576 2024-03-04T12:26:51.920 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.913+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~EL06LWEU6E1S.1 size=360957 2024-03-04T12:26:51.920 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.913+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=EL06LWEU6E1S tag=7R5ED3CBUACI type=write size=2458109 2024-03-04T12:26:51.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.914+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~UW3WSF1XQSA2.0 size=3668 2024-03-04T12:26:51.923 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.916+0000 7fa4b3c3e780 1 < completed multipart upload key=43HMF7NWNMU3 upload=UW3WSF1XQSA2 tag=N74RZATXUIV4 type=write size=1052244 2024-03-04T12:26:51.924 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.917+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=PS7RYC3D7Y5F type=del size=3734416 2024-03-04T12:26:51.925 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.918+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~O19K9ZYA8FKG.0 size=1048576 2024-03-04T12:26:51.926 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.919+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~O19K9ZYA8FKG.1 size=613629 2024-03-04T12:26:51.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.921+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=O19K9ZYA8FKG tag=UCXBEKTIGRQM type=write size=2710781 2024-03-04T12:26:51.929 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.922+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=QO90NZV8QNF1 type=del size=2110632 2024-03-04T12:26:51.931 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.924+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~G9IRKE6BX7RH.0 size=1048576 2024-03-04T12:26:51.931 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.925+0000 7fa4b3c3e780 1 < completed part key=_multipart_G4SUQFVB936T.2~G9IRKE6BX7RH.1 size=1048576 2024-03-04T12:26:51.932 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.925+0000 7fa4b3c3e780 1 < canceled part key=_multipart_G4SUQFVB936T.2~G9IRKE6BX7RH.2 size=792392 2024-03-04T12:26:51.933 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.927+0000 7fa4b3c3e780 1 < canceled multipart upload key=G4SUQFVB936T upload=G9IRKE6BX7RH tag=LZ45CJR8XATJ type=write size=3938120 2024-03-04T12:26:51.935 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.928+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=091L8GXI8HRS type=del size=1473852 2024-03-04T12:26:51.936 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.929+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~EPTA3FJ1T9Z4.0 size=1048576 2024-03-04T12:26:51.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.930+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~EPTA3FJ1T9Z4.1 size=1048576 2024-03-04T12:26:51.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.931+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~EPTA3FJ1T9Z4.2 size=459868 2024-03-04T12:26:51.939 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.933+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=EPTA3FJ1T9Z4 tag=NIO48NS7473V type=write size=3605596 2024-03-04T12:26:51.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.934+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=STYW3XE11DDC type=del size=577676 2024-03-04T12:26:51.942 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.935+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~UDNLZL7C5QV3.0 size=1048576 2024-03-04T12:26:51.943 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.936+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~UDNLZL7C5QV3.1 size=1048576 2024-03-04T12:26:51.944 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.937+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~UDNLZL7C5QV3.2 size=397774 2024-03-04T12:26:51.945 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.939+0000 7fa4b3c3e780 1 < completed multipart upload key=R1DOKJPZRT5Q upload=UDNLZL7C5QV3 tag=TAD2DQ5NLLEX type=write size=3543502 2024-03-04T12:26:51.946 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.940+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=81V1Z9CXXQQF type=write size=633082 2024-03-04T12:26:51.948 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.941+0000 7fa4b3c3e780 1 < completed delete operation key=GMIPCGYZRJ5L tag=5J7ZZYQY4JCT type=del 2024-03-04T12:26:51.949 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.942+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=YDMKWP5MR2DI type=del size=290322 2024-03-04T12:26:51.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.943+0000 7fa4b3c3e780 1 < canceled operation key=NVMIU38VM9Q1 tag=393J6JVIYJ59 type=write size=1035113 2024-03-04T12:26:51.952 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.945+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~Q6FZ34G5RXJ6.0 size=1048576 2024-03-04T12:26:51.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.946+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~Q6FZ34G5RXJ6.1 size=1048576 2024-03-04T12:26:51.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.947+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~Q6FZ34G5RXJ6.2 size=89135 2024-03-04T12:26:51.954 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.947+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=Q6FZ34G5RXJ6 tag=EY1PXRFYXZQT type=write size=3234863 2024-03-04T12:26:51.956 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.949+0000 7fa4b3c3e780 1 < suggested update operation key=43HMF7NWNMU3 tag=F2YKI0BKD3JH type=del size=281504 2024-03-04T12:26:51.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.951+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~A13IAVFWKUMQ.0 size=1048576 2024-03-04T12:26:51.958 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.951+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~A13IAVFWKUMQ.1 size=941546 2024-03-04T12:26:51.958 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.951+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=A13IAVFWKUMQ tag=Q9PMR9XX70Y9 type=write size=3038698 2024-03-04T12:26:51.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.953+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~Z429G5PVIWKV.0 size=1048576 2024-03-04T12:26:51.960 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.953+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~Z429G5PVIWKV.1 size=1048576 2024-03-04T12:26:51.961 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.954+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~Z429G5PVIWKV.2 size=759636 2024-03-04T12:26:51.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.956+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=Z429G5PVIWKV tag=2DHBAPLBZNSE type=write size=3905364 2024-03-04T12:26:51.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.957+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=MR9RTIQU7GVJ type=del size=309300 2024-03-04T12:26:51.965 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.958+0000 7fa4b3c3e780 1 < completed write operation key=UZRX3W3DE5VX tag=RLCLUZ1DSILU type=write size=648320 2024-03-04T12:26:51.966 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.959+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=JPPQ4CY1WNLE type=del size=399844 2024-03-04T12:26:51.966 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.960+0000 7fa4b3c3e780 1 < canceled part key=_multipart_6XK4DQ940Z5J.2~RDUH03V0B2IE.0 size=1002699 2024-03-04T12:26:51.968 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.961+0000 7fa4b3c3e780 1 < canceled multipart upload key=6XK4DQ940Z5J upload=RDUH03V0B2IE tag=UKVA3ZAQ2CX5 type=write size=2051275 2024-03-04T12:26:51.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.962+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=L86OJRND2C3Y type=del size=3790013 2024-03-04T12:26:51.970 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.964+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~76PNVROU2ARZ.0 size=1048576 2024-03-04T12:26:51.971 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.965+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~76PNVROU2ARZ.1 size=1048576 2024-03-04T12:26:51.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.965+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~76PNVROU2ARZ.2 size=596641 2024-03-04T12:26:51.974 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.967+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=76PNVROU2ARZ tag=M1MYKJ1YGWUO type=write size=3742369 2024-03-04T12:26:51.975 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.969+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=1UIKML71TD5T type=del size=3296361 2024-03-04T12:26:51.977 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.970+0000 7fa4b3c3e780 1 < canceled operation key=UZRX3W3DE5VX tag=7AWSICCBXLE4 type=del size=4158061 2024-03-04T12:26:51.979 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.972+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~PTWQPE4BEU5F.0 size=686839 2024-03-04T12:26:51.979 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.972+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=PTWQPE4BEU5F tag=PZKIKOHVYYC9 type=write size=1735415 2024-03-04T12:26:51.980 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.973+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~59EKP4U0AX0G.0 size=1048576 2024-03-04T12:26:51.981 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.974+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~59EKP4U0AX0G.1 size=1048576 2024-03-04T12:26:51.982 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.975+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~59EKP4U0AX0G.2 size=146947 2024-03-04T12:26:51.984 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.977+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=59EKP4U0AX0G tag=TIAZO2MUVE7O type=write size=3292675 2024-03-04T12:26:51.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.979+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~YQNUBLS07E4V.0 size=1048576 2024-03-04T12:26:51.987 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.980+0000 7fa4b3c3e780 1 > prepared part key=_multipart_V7N7MZ1GUNEV.2~YQNUBLS07E4V.1 size=551751 2024-03-04T12:26:51.987 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.980+0000 7fa4b3c3e780 1 > prepared multipart upload key=V7N7MZ1GUNEV upload=YQNUBLS07E4V tag=L9PO9IL35FRJ type=write size=2648903 2024-03-04T12:26:51.988 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.981+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~93CGMPOIAK6C.0 size=1048576 2024-03-04T12:26:51.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.982+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~93CGMPOIAK6C.1 size=248702 2024-03-04T12:26:51.991 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.984+0000 7fa4b3c3e780 1 < completed multipart upload key=H5FWRNK8F7QT upload=93CGMPOIAK6C tag=K3V7Z68HWH6W type=write size=2345854 2024-03-04T12:26:51.993 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.986+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~Y1CWLWL9B217.0 size=854618 2024-03-04T12:26:51.993 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.986+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=Y1CWLWL9B217 tag=NT1M31Q2WFDF type=write size=1903194 2024-03-04T12:26:51.994 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.988+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~EL06LWEU6E1S.0 size=1048576 2024-03-04T12:26:51.995 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.989+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~EL06LWEU6E1S.1 size=360957 2024-03-04T12:26:51.997 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.991+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=EL06LWEU6E1S tag=7R5ED3CBUACI type=write size=2458109 2024-03-04T12:26:51.999 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.992+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~3YD4FYQ6UROK.0 size=1048576 2024-03-04T12:26:52.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.993+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~3YD4FYQ6UROK.1 size=908700 2024-03-04T12:26:52.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.993+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=3YD4FYQ6UROK tag=FWOITZS5T4EZ type=write size=3005852 2024-03-04T12:26:52.002 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.996+0000 7fa4b3c3e780 1 < suggested remove operation key=G4SUQFVB936T tag=PS7RYC3D7Y5F type=del 2024-03-04T12:26:52.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.998+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~FT2BK1KDBUF6.0 size=1048576 2024-03-04T12:26:52.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.998+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~FT2BK1KDBUF6.1 size=1048576 2024-03-04T12:26:52.006 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.999+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~FT2BK1KDBUF6.2 size=130090 2024-03-04T12:26:52.006 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:51.999+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=FT2BK1KDBUF6 tag=ISE63O69CV4N type=write size=3275818 2024-03-04T12:26:52.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.000+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=QO90NZV8QNF1 type=del 2024-03-04T12:26:52.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.002+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=5K0TFUVENNF3 type=write size=63994 2024-03-04T12:26:52.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.003+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=091L8GXI8HRS type=del 2024-03-04T12:26:52.010 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.004+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=99SA1KL9IVBZ type=write size=378267 2024-03-04T12:26:52.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.005+0000 7fa4b3c3e780 1 < completed delete operation key=G70BJ2UARNCP tag=STYW3XE11DDC type=del 2024-03-04T12:26:52.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.006+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=7T21QXRE3JTA type=write size=252420 2024-03-04T12:26:52.014 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.007+0000 7fa4b3c3e780 1 < completed write operation key=NVMIU38VM9Q1 tag=81V1Z9CXXQQF type=write size=633082 2024-03-04T12:26:52.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.008+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=15ATXUYGW758 type=del size=538895 2024-03-04T12:26:52.017 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.010+0000 7fa4b3c3e780 1 < suggested update operation key=G70BJ2UARNCP tag=YDMKWP5MR2DI type=del size=290322 2024-03-04T12:26:52.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.012+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=O843OMRG9KJ2 type=del size=4156504 2024-03-04T12:26:52.020 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.013+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~Q6FZ34G5RXJ6.0 size=1048576 2024-03-04T12:26:52.021 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.014+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~Q6FZ34G5RXJ6.1 size=1048576 2024-03-04T12:26:52.022 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.015+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~Q6FZ34G5RXJ6.2 size=89135 2024-03-04T12:26:52.024 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.017+0000 7fa4b3c3e780 1 < completed multipart upload key=R1DOKJPZRT5Q upload=Q6FZ34G5RXJ6 tag=EY1PXRFYXZQT type=write size=3234863 2024-03-04T12:26:52.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.018+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=V0RRJQK0L64F type=del size=1196758 2024-03-04T12:26:52.026 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.019+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~A13IAVFWKUMQ.0 size=1048576 2024-03-04T12:26:52.027 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.020+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~A13IAVFWKUMQ.1 size=941546 2024-03-04T12:26:52.032 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.022+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=A13IAVFWKUMQ tag=Q9PMR9XX70Y9 type=write size=3038698 2024-03-04T12:26:52.032 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.024+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~J50U6W3G4BZI.0 size=1048576 2024-03-04T12:26:52.032 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.025+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~J50U6W3G4BZI.1 size=1048576 2024-03-04T12:26:52.033 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.027+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3TDMQXKLPX34.2~J50U6W3G4BZI.2 size=195375 2024-03-04T12:26:52.033 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.027+0000 7fa4b3c3e780 1 > prepared multipart upload key=3TDMQXKLPX34 upload=J50U6W3G4BZI tag=PMFS0UVLOSOH type=write size=3341103 2024-03-04T12:26:52.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.028+0000 7fa4b3c3e780 1 < completed delete operation key=RHU0QO8HS5SC tag=MR9RTIQU7GVJ type=del 2024-03-04T12:26:52.036 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.029+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=GJ5YA163XJDI type=del size=1597157 2024-03-04T12:26:52.037 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.030+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=JPPQ4CY1WNLE type=del 2024-03-04T12:26:52.039 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.032+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~560F0PZXAYVD.0 size=1048576 2024-03-04T12:26:52.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.033+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~560F0PZXAYVD.1 size=1000101 2024-03-04T12:26:52.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.033+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=560F0PZXAYVD tag=93LEAORA9TCH type=write size=3097253 2024-03-04T12:26:52.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.034+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=L86OJRND2C3Y type=del 2024-03-04T12:26:52.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.035+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=598FXQA9LEJ8 type=del size=974127 2024-03-04T12:26:52.043 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.036+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=1UIKML71TD5T type=del 2024-03-04T12:26:52.045 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.038+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~7I1H3MG7NGGC.0 size=1048576 2024-03-04T12:26:52.046 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.039+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~7I1H3MG7NGGC.1 size=1048576 2024-03-04T12:26:52.047 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.040+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~7I1H3MG7NGGC.2 size=276682 2024-03-04T12:26:52.047 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.040+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=7I1H3MG7NGGC tag=2RMDMP2AV6RB type=write size=3422410 2024-03-04T12:26:52.048 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.041+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~PTWQPE4BEU5F.0 size=686839 2024-03-04T12:26:52.050 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.043+0000 7fa4b3c3e780 1 < completed multipart upload key=3TDMQXKLPX34 upload=PTWQPE4BEU5F tag=PZKIKOHVYYC9 type=write size=1735415 2024-03-04T12:26:52.052 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.045+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~KUUNTQPHRMJY.0 size=1048576 2024-03-04T12:26:52.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.046+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~KUUNTQPHRMJY.1 size=305312 2024-03-04T12:26:52.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.046+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=KUUNTQPHRMJY tag=ANJP9QATI0S6 type=write size=2402464 2024-03-04T12:26:52.054 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.047+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~YQNUBLS07E4V.0 size=1048576 2024-03-04T12:26:52.055 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.048+0000 7fa4b3c3e780 1 < completed part key=_multipart_V7N7MZ1GUNEV.2~YQNUBLS07E4V.1 size=551751 2024-03-04T12:26:52.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.050+0000 7fa4b3c3e780 1 < completed multipart upload key=V7N7MZ1GUNEV upload=YQNUBLS07E4V tag=L9PO9IL35FRJ type=write size=2648903 2024-03-04T12:26:52.058 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.051+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=E35JGGAJXCEL type=del size=2495053 2024-03-04T12:26:52.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.052+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~Y1CWLWL9B217.0 size=854618 2024-03-04T12:26:52.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.054+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=Y1CWLWL9B217 tag=NT1M31Q2WFDF type=write size=1903194 2024-03-04T12:26:52.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.056+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~QD5BFDS9MRIM.0 size=1048576 2024-03-04T12:26:52.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.057+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~QD5BFDS9MRIM.1 size=1048576 2024-03-04T12:26:52.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.058+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~QD5BFDS9MRIM.2 size=542065 2024-03-04T12:26:52.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.058+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=QD5BFDS9MRIM tag=YOB7WG9F4WV0 type=write size=3687793 2024-03-04T12:26:52.066 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.059+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~3YD4FYQ6UROK.0 size=1048576 2024-03-04T12:26:52.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.060+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~3YD4FYQ6UROK.1 size=908700 2024-03-04T12:26:52.069 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.062+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=3YD4FYQ6UROK tag=FWOITZS5T4EZ type=write size=3005852 2024-03-04T12:26:52.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.064+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~O1KFQ77QGJ0T.0 size=1048576 2024-03-04T12:26:52.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.065+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~O1KFQ77QGJ0T.1 size=587914 2024-03-04T12:26:52.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.065+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=O1KFQ77QGJ0T tag=GQX3D4YIM7NU type=write size=2685066 2024-03-04T12:26:52.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.066+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~FT2BK1KDBUF6.0 size=1048576 2024-03-04T12:26:52.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.067+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~FT2BK1KDBUF6.1 size=1048576 2024-03-04T12:26:52.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.068+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~FT2BK1KDBUF6.2 size=130090 2024-03-04T12:26:52.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.070+0000 7fa4b3c3e780 1 < completed multipart upload key=R6Y09EO6HGF0 upload=FT2BK1KDBUF6 tag=ISE63O69CV4N type=write size=3275818 2024-03-04T12:26:52.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.072+0000 7fa4b3c3e780 1 > prepared part key=_multipart_7IUV88NQLPN8.2~D1VH5K49SFOW.0 size=368167 2024-03-04T12:26:52.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.072+0000 7fa4b3c3e780 1 > prepared multipart upload key=7IUV88NQLPN8 upload=D1VH5K49SFOW tag=HGURDDRXNCUN type=write size=1416743 2024-03-04T12:26:52.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.073+0000 7fa4b3c3e780 1 < completed write operation key=6XK4DQ940Z5J tag=5K0TFUVENNF3 type=write size=63994 2024-03-04T12:26:52.081 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.074+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=131W6Q93ESTL type=del size=3517257 2024-03-04T12:26:52.082 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.075+0000 7fa4b3c3e780 1 < completed write operation key=RHU0QO8HS5SC tag=99SA1KL9IVBZ type=write size=378267 2024-03-04T12:26:52.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.077+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~XYJHPWUMFES5.0 size=898532 2024-03-04T12:26:52.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.077+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=XYJHPWUMFES5 tag=8BZU3NJ4RPY0 type=write size=1947108 2024-03-04T12:26:52.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.079+0000 7fa4b3c3e780 1 < canceled operation key=G8G76PMSKJ0I tag=7T21QXRE3JTA type=write size=252420 2024-03-04T12:26:52.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.081+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~BVKZNVZUES4P.0 size=1048576 2024-03-04T12:26:52.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.081+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~BVKZNVZUES4P.1 size=490584 2024-03-04T12:26:52.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.081+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=BVKZNVZUES4P tag=LQ2FNA844JY0 type=write size=2587736 2024-03-04T12:26:52.089 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.083+0000 7fa4b3c3e780 1 < canceled operation key=YIS2SV4O5EZN tag=15ATXUYGW758 type=del size=538895 2024-03-04T12:26:52.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.084+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=D6JMWDHUMZNZ type=del size=1683241 2024-03-04T12:26:52.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.085+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=O843OMRG9KJ2 type=del 2024-03-04T12:26:52.094 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.087+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~CV05R8MOOA2F.0 size=1048576 2024-03-04T12:26:52.094 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.088+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~CV05R8MOOA2F.1 size=1048576 2024-03-04T12:26:52.095 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.089+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~CV05R8MOOA2F.2 size=203723 2024-03-04T12:26:52.095 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.089+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=CV05R8MOOA2F tag=8N75F23XG4FV type=write size=3349451 2024-03-04T12:26:52.096 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.090+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=V0RRJQK0L64F type=del 2024-03-04T12:26:52.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.092+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~B49S8HSL6YTF.0 size=1048576 2024-03-04T12:26:52.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.093+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~B49S8HSL6YTF.1 size=1048576 2024-03-04T12:26:52.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.094+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~B49S8HSL6YTF.2 size=42849 2024-03-04T12:26:52.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.094+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=B49S8HSL6YTF tag=RL19WCIXWDDX type=write size=3188577 2024-03-04T12:26:52.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.095+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~J50U6W3G4BZI.0 size=1048576 2024-03-04T12:26:52.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.095+0000 7fa4b3c3e780 1 < canceled part key=_multipart_3TDMQXKLPX34.2~J50U6W3G4BZI.1 size=1048576 2024-03-04T12:26:52.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.096+0000 7fa4b3c3e780 1 < completed part key=_multipart_3TDMQXKLPX34.2~J50U6W3G4BZI.2 size=195375 2024-03-04T12:26:52.105 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.098+0000 7fa4b3c3e780 1 < canceled multipart upload key=3TDMQXKLPX34 upload=J50U6W3G4BZI tag=PMFS0UVLOSOH type=write size=3341103 2024-03-04T12:26:52.106 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.099+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=JB820VUIMHZC type=del size=3191907 2024-03-04T12:26:52.107 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.100+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=GJ5YA163XJDI type=del 2024-03-04T12:26:52.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.102+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ESHAMQWMMBJR.2~46H4109ZQR74.0 size=191436 2024-03-04T12:26:52.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.102+0000 7fa4b3c3e780 1 > prepared multipart upload key=ESHAMQWMMBJR upload=46H4109ZQR74 tag=QQJM5P75ECFD type=write size=1240012 2024-03-04T12:26:52.110 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.104+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~560F0PZXAYVD.0 size=1048576 2024-03-04T12:26:52.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.105+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~560F0PZXAYVD.1 size=1000101 2024-03-04T12:26:52.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.107+0000 7fa4b3c3e780 1 < completed multipart upload key=KKQT9J9GSW0N upload=560F0PZXAYVD tag=93LEAORA9TCH type=write size=3097253 2024-03-04T12:26:52.115 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.108+0000 7fa4b3c3e780 1 > prepared operation key=ZETES4AYZQHY tag=PW27Q4VUKX33 type=del size=4176013 2024-03-04T12:26:52.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.109+0000 7fa4b3c3e780 1 < canceled operation key=3TDMQXKLPX34 tag=598FXQA9LEJ8 type=del size=974127 2024-03-04T12:26:52.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.110+0000 7fa4b3c3e780 1 > prepared operation key=YIS2SV4O5EZN tag=L67AUAO5AOI0 type=del size=2806149 2024-03-04T12:26:52.118 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.112+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~7I1H3MG7NGGC.0 size=1048576 2024-03-04T12:26:52.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.113+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~7I1H3MG7NGGC.1 size=1048576 2024-03-04T12:26:52.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.114+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~7I1H3MG7NGGC.2 size=276682 2024-03-04T12:26:52.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.115+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=7I1H3MG7NGGC tag=2RMDMP2AV6RB type=write size=3422410 2024-03-04T12:26:52.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.117+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=2O72RV7Q94HW type=del size=4127298 2024-03-04T12:26:52.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.118+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~KUUNTQPHRMJY.0 size=1048576 2024-03-04T12:26:52.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.118+0000 7fa4b3c3e780 1 < canceled part key=_multipart_3N6E09QF3866.2~KUUNTQPHRMJY.1 size=305312 2024-03-04T12:26:52.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.120+0000 7fa4b3c3e780 1 < canceled multipart upload key=3N6E09QF3866 upload=KUUNTQPHRMJY tag=ANJP9QATI0S6 type=write size=2402464 2024-03-04T12:26:52.128 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.121+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=635DE3OX5MDR type=del size=1727166 2024-03-04T12:26:52.129 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.122+0000 7fa4b3c3e780 1 < completed delete operation key=V7N7MZ1GUNEV tag=E35JGGAJXCEL type=del 2024-03-04T12:26:52.131 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.124+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~QI5ZLATWE1B1.0 size=1048576 2024-03-04T12:26:52.132 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.125+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~QI5ZLATWE1B1.1 size=127570 2024-03-04T12:26:52.132 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.125+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=QI5ZLATWE1B1 tag=TUBM3KRCVS7N type=write size=2224722 2024-03-04T12:26:52.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.126+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~QD5BFDS9MRIM.0 size=1048576 2024-03-04T12:26:52.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.126+0000 7fa4b3c3e780 1 < canceled part key=_multipart_R6Y09EO6HGF0.2~QD5BFDS9MRIM.1 size=1048576 2024-03-04T12:26:52.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.127+0000 7fa4b3c3e780 1 < completed part key=_multipart_R6Y09EO6HGF0.2~QD5BFDS9MRIM.2 size=542065 2024-03-04T12:26:52.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.129+0000 7fa4b3c3e780 1 < canceled multipart upload key=R6Y09EO6HGF0 upload=QD5BFDS9MRIM tag=YOB7WG9F4WV0 type=write size=3687793 2024-03-04T12:26:52.139 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.132+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~4G60N0G2H1WC.0 size=1048576 2024-03-04T12:26:52.140 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.134+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~4G60N0G2H1WC.1 size=1040933 2024-03-04T12:26:52.140 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.134+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=4G60N0G2H1WC tag=TN47WUQ49KK0 type=write size=3138085 2024-03-04T12:26:52.141 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.134+0000 7fa4b3c3e780 1 < canceled part key=_multipart_6XK4DQ940Z5J.2~O1KFQ77QGJ0T.0 size=1048576 2024-03-04T12:26:52.142 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.135+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~O1KFQ77QGJ0T.1 size=587914 2024-03-04T12:26:52.143 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.137+0000 7fa4b3c3e780 1 < canceled multipart upload key=6XK4DQ940Z5J upload=O1KFQ77QGJ0T tag=GQX3D4YIM7NU type=write size=2685066 2024-03-04T12:26:52.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.138+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=XQ1LRZQ80RSU type=del size=1970643 2024-03-04T12:26:52.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.139+0000 7fa4b3c3e780 1 < completed part key=_multipart_7IUV88NQLPN8.2~D1VH5K49SFOW.0 size=368167 2024-03-04T12:26:52.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.141+0000 7fa4b3c3e780 1 < completed multipart upload key=7IUV88NQLPN8 upload=D1VH5K49SFOW tag=HGURDDRXNCUN type=write size=1416743 2024-03-04T12:26:52.149 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.142+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=T5X1YHZYYWDW type=del size=1698066 2024-03-04T12:26:52.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.143+0000 7fa4b3c3e780 1 < canceled operation key=T301TK0FIOG4 tag=131W6Q93ESTL type=del size=3517257 2024-03-04T12:26:52.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.145+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~RAG0JPH21E0W.0 size=1048576 2024-03-04T12:26:52.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.146+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~RAG0JPH21E0W.1 size=1048576 2024-03-04T12:26:52.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.147+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~RAG0JPH21E0W.2 size=9022 2024-03-04T12:26:52.154 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.147+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=RAG0JPH21E0W tag=4NCC1H96D4H4 type=write size=3154750 2024-03-04T12:26:52.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.148+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~XYJHPWUMFES5.0 size=898532 2024-03-04T12:26:52.156 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.150+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=XYJHPWUMFES5 tag=8BZU3NJ4RPY0 type=write size=1947108 2024-03-04T12:26:52.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.152+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~G3JC0HSD5AI1.0 size=276604 2024-03-04T12:26:52.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.152+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=G3JC0HSD5AI1 tag=A6HGCNVXPJPM type=write size=1325180 2024-03-04T12:26:52.160 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.153+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~BVKZNVZUES4P.0 size=1048576 2024-03-04T12:26:52.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.154+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~BVKZNVZUES4P.1 size=490584 2024-03-04T12:26:52.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.156+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=BVKZNVZUES4P tag=LQ2FNA844JY0 type=write size=2587736 2024-03-04T12:26:52.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.157+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=XPGTV8R74TT5 type=del size=1993538 2024-03-04T12:26:52.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.158+0000 7fa4b3c3e780 1 < completed delete operation key=R1DOKJPZRT5Q tag=D6JMWDHUMZNZ type=del 2024-03-04T12:26:52.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.159+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=9N8KUJ6P9I9E type=del size=151277 2024-03-04T12:26:52.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.161+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~CV05R8MOOA2F.0 size=1048576 2024-03-04T12:26:52.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.161+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~CV05R8MOOA2F.1 size=1048576 2024-03-04T12:26:52.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.161+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YQLH0WW7I7MW.2~CV05R8MOOA2F.2 size=203723 2024-03-04T12:26:52.170 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.163+0000 7fa4b3c3e780 1 < canceled multipart upload key=YQLH0WW7I7MW upload=CV05R8MOOA2F tag=8N75F23XG4FV type=write size=3349451 2024-03-04T12:26:52.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.164+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=NRF0VPLYD4RB type=write size=220264 2024-03-04T12:26:52.172 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.166+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~B49S8HSL6YTF.0 size=1048576 2024-03-04T12:26:52.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.167+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~B49S8HSL6YTF.1 size=1048576 2024-03-04T12:26:52.174 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.168+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~B49S8HSL6YTF.2 size=42849 2024-03-04T12:26:52.176 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.169+0000 7fa4b3c3e780 1 < completed multipart upload key=VAIY4J3CYONH upload=B49S8HSL6YTF tag=RL19WCIXWDDX type=write size=3188577 2024-03-04T12:26:52.178 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.171+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~HIEQ92979PB0.0 size=1048576 2024-03-04T12:26:52.179 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.172+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~HIEQ92979PB0.1 size=677597 2024-03-04T12:26:52.179 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.172+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=HIEQ92979PB0 tag=L8C0NY49F2WW type=write size=2774749 2024-03-04T12:26:52.180 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.174+0000 7fa4b3c3e780 1 < completed delete operation key=H5FWRNK8F7QT tag=JB820VUIMHZC type=del 2024-03-04T12:26:52.183 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.176+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~307K3X1D5N5J.0 size=1048576 2024-03-04T12:26:52.183 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.177+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~307K3X1D5N5J.1 size=702361 2024-03-04T12:26:52.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.177+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=307K3X1D5N5J tag=8LE6EOEADYVJ type=write size=2799513 2024-03-04T12:26:52.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.177+0000 7fa4b3c3e780 1 < canceled part key=_multipart_ESHAMQWMMBJR.2~46H4109ZQR74.0 size=191436 2024-03-04T12:26:52.186 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.179+0000 7fa4b3c3e780 1 < canceled multipart upload key=ESHAMQWMMBJR upload=46H4109ZQR74 tag=QQJM5P75ECFD type=write size=1240012 2024-03-04T12:26:52.187 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.180+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=B9P0AX4IMTTH type=del size=2087827 2024-03-04T12:26:52.188 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.181+0000 7fa4b3c3e780 1 < completed delete operation key=ZETES4AYZQHY tag=PW27Q4VUKX33 type=del 2024-03-04T12:26:52.190 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.183+0000 7fa4b3c3e780 1 > prepared part key=_multipart_3N6E09QF3866.2~HEIKIJEO8CQ4.0 size=23439 2024-03-04T12:26:52.190 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.183+0000 7fa4b3c3e780 1 > prepared multipart upload key=3N6E09QF3866 upload=HEIKIJEO8CQ4 tag=1ZX54SAM75MV type=write size=1072015 2024-03-04T12:26:52.192 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.185+0000 7fa4b3c3e780 1 < suggested remove operation key=YIS2SV4O5EZN tag=L67AUAO5AOI0 type=del 2024-03-04T12:26:52.194 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.187+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~0H0AC63I1JW9.0 size=1048576 2024-03-04T12:26:52.195 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.188+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~0H0AC63I1JW9.1 size=1048576 2024-03-04T12:26:52.196 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.189+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~0H0AC63I1JW9.2 size=374120 2024-03-04T12:26:52.196 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.189+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=0H0AC63I1JW9 tag=ZVQ4NO8W0WVM type=write size=3519848 2024-03-04T12:26:52.197 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.190+0000 7fa4b3c3e780 1 < completed delete operation key=BR8RTE2QEH9E tag=2O72RV7Q94HW type=del 2024-03-04T12:26:52.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.191+0000 7fa4b3c3e780 1 > prepared operation key=R1DOKJPZRT5Q tag=1OUFVJQCR1DL type=write size=994247 2024-03-04T12:26:52.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.194+0000 7fa4b3c3e780 1 < suggested remove operation key=GMIPCGYZRJ5L tag=635DE3OX5MDR type=del 2024-03-04T12:26:52.202 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.196+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~WES7RXQFTGC3.0 size=1048576 2024-03-04T12:26:52.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.196+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~WES7RXQFTGC3.1 size=566699 2024-03-04T12:26:52.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.196+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=WES7RXQFTGC3 tag=NAOET8GT0W1P type=write size=2663851 2024-03-04T12:26:52.204 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.198+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~QI5ZLATWE1B1.0 size=1048576 2024-03-04T12:26:52.204 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.198+0000 7fa4b3c3e780 1 < canceled part key=_multipart_VAIY4J3CYONH.2~QI5ZLATWE1B1.1 size=127570 2024-03-04T12:26:52.206 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.199+0000 7fa4b3c3e780 1 < canceled multipart upload key=VAIY4J3CYONH upload=QI5ZLATWE1B1 tag=TUBM3KRCVS7N type=write size=2224722 2024-03-04T12:26:52.208 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.201+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~69390WWABHCB.0 size=234168 2024-03-04T12:26:52.208 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.201+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=69390WWABHCB tag=272A2AOYCHLN type=write size=1282744 2024-03-04T12:26:52.208 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.202+0000 7fa4b3c3e780 1 < canceled part key=_multipart_BR8RTE2QEH9E.2~4G60N0G2H1WC.0 size=1048576 2024-03-04T12:26:52.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.202+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~4G60N0G2H1WC.1 size=1040933 2024-03-04T12:26:52.211 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.204+0000 7fa4b3c3e780 1 < canceled multipart upload key=BR8RTE2QEH9E upload=4G60N0G2H1WC tag=TN47WUQ49KK0 type=write size=3138085 2024-03-04T12:26:52.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.206+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~U981D0N5K17N.0 size=1048576 2024-03-04T12:26:52.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.207+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~U981D0N5K17N.1 size=892534 2024-03-04T12:26:52.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.207+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=U981D0N5K17N tag=ICF8T6THHHEU type=write size=2989686 2024-03-04T12:26:52.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.208+0000 7fa4b3c3e780 1 < completed delete operation key=4LKTYP07OL5L tag=XQ1LRZQ80RSU type=del 2024-03-04T12:26:52.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.209+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=W61XI5UE7CHO type=del size=394314 2024-03-04T12:26:52.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.210+0000 7fa4b3c3e780 1 < completed delete operation key=R1DOKJPZRT5Q tag=T5X1YHZYYWDW type=del 2024-03-04T12:26:52.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.211+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=UJC765DVKIMQ type=del size=909698 2024-03-04T12:26:52.219 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.212+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~RAG0JPH21E0W.0 size=1048576 2024-03-04T12:26:52.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.212+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YQLH0WW7I7MW.2~RAG0JPH21E0W.1 size=1048576 2024-03-04T12:26:52.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.213+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~RAG0JPH21E0W.2 size=9022 2024-03-04T12:26:52.222 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.215+0000 7fa4b3c3e780 1 < canceled multipart upload key=YQLH0WW7I7MW upload=RAG0JPH21E0W tag=4NCC1H96D4H4 type=write size=3154750 2024-03-04T12:26:52.223 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.216+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=5Z49JTZYEKFP type=del size=2671491 2024-03-04T12:26:52.223 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.216+0000 7fa4b3c3e780 1 < canceled part key=_multipart_GMIPCGYZRJ5L.2~G3JC0HSD5AI1.0 size=276604 2024-03-04T12:26:52.225 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.218+0000 7fa4b3c3e780 1 < canceled multipart upload key=GMIPCGYZRJ5L upload=G3JC0HSD5AI1 tag=A6HGCNVXPJPM type=write size=1325180 2024-03-04T12:26:52.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.219+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=O7AYD02GBBN3 type=del size=716524 2024-03-04T12:26:52.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.220+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=XPGTV8R74TT5 type=del 2024-03-04T12:26:52.228 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.221+0000 7fa4b3c3e780 1 > prepared operation key=RHU0QO8HS5SC tag=F6WVI2LGAR1E type=del size=788778 2024-03-04T12:26:52.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.223+0000 7fa4b3c3e780 1 < completed delete operation key=6XK4DQ940Z5J tag=9N8KUJ6P9I9E type=del 2024-03-04T12:26:52.231 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.224+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=D0JWZNCNRYCK type=del size=1750723 2024-03-04T12:26:52.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.225+0000 7fa4b3c3e780 1 < completed write operation key=7IUV88NQLPN8 tag=NRF0VPLYD4RB type=write size=220264 2024-03-04T12:26:52.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.226+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=JR32KKUPKAU3 type=write size=423543 2024-03-04T12:26:52.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.227+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~HIEQ92979PB0.0 size=1048576 2024-03-04T12:26:52.235 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.228+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~HIEQ92979PB0.1 size=677597 2024-03-04T12:26:52.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.230+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=HIEQ92979PB0 tag=L8C0NY49F2WW type=write size=2774749 2024-03-04T12:26:52.238 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.231+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=YKRDVITS8Y7G type=del size=3387239 2024-03-04T12:26:52.239 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.233+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~307K3X1D5N5J.0 size=1048576 2024-03-04T12:26:52.240 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.234+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~307K3X1D5N5J.1 size=702361 2024-03-04T12:26:52.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.237+0000 7fa4b3c3e780 1 < completed multipart upload key=YIS2SV4O5EZN upload=307K3X1D5N5J tag=8LE6EOEADYVJ type=write size=2799513 2024-03-04T12:26:52.245 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.238+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=V2LH2PA6MSHL type=del size=1110718 2024-03-04T12:26:52.246 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.239+0000 7fa4b3c3e780 1 < canceled operation key=UZRX3W3DE5VX tag=B9P0AX4IMTTH type=del size=2087827 2024-03-04T12:26:52.247 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.240+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=SG24J3UL2DFZ type=del size=696815 2024-03-04T12:26:52.249 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.242+0000 7fa4b3c3e780 1 < completed part key=_multipart_3N6E09QF3866.2~HEIKIJEO8CQ4.0 size=23439 2024-03-04T12:26:52.250 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.244+0000 7fa4b3c3e780 1 < completed multipart upload key=3N6E09QF3866 upload=HEIKIJEO8CQ4 tag=1ZX54SAM75MV type=write size=1072015 2024-03-04T12:26:52.251 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.245+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=7G5CTGSXBGPN type=del size=727062 2024-03-04T12:26:52.253 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.246+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~0H0AC63I1JW9.0 size=1048576 2024-03-04T12:26:52.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.247+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~0H0AC63I1JW9.1 size=1048576 2024-03-04T12:26:52.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.248+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~0H0AC63I1JW9.2 size=374120 2024-03-04T12:26:52.256 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.249+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=0H0AC63I1JW9 tag=ZVQ4NO8W0WVM type=write size=3519848 2024-03-04T12:26:52.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.251+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=ULZ5IWQSRJIC type=del size=3973096 2024-03-04T12:26:52.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.252+0000 7fa4b3c3e780 1 < completed write operation key=R1DOKJPZRT5Q tag=1OUFVJQCR1DL type=write size=994247 2024-03-04T12:26:52.260 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.253+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=UJBBTCOWBS15 type=write size=557432 2024-03-04T12:26:52.261 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.254+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~WES7RXQFTGC3.0 size=1048576 2024-03-04T12:26:52.262 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.255+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~WES7RXQFTGC3.1 size=566699 2024-03-04T12:26:52.264 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.257+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=WES7RXQFTGC3 tag=NAOET8GT0W1P type=write size=2663851 2024-03-04T12:26:52.266 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.259+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~1S7Z0L08LXP1.0 size=429745 2024-03-04T12:26:52.266 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.259+0000 7fa4b3c3e780 1 > prepared multipart upload key=G8G76PMSKJ0I upload=1S7Z0L08LXP1 tag=KA2XW98WD5K5 type=write size=1478321 2024-03-04T12:26:52.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.260+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~69390WWABHCB.0 size=234168 2024-03-04T12:26:52.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.262+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=69390WWABHCB tag=272A2AOYCHLN type=write size=1282744 2024-03-04T12:26:52.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.263+0000 7fa4b3c3e780 1 > prepared operation key=4LKTYP07OL5L tag=4DMXGBZQFLO6 type=del size=1464849 2024-03-04T12:26:52.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.264+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~U981D0N5K17N.0 size=1048576 2024-03-04T12:26:52.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.265+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~U981D0N5K17N.1 size=892534 2024-03-04T12:26:52.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.267+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=U981D0N5K17N tag=ICF8T6THHHEU type=write size=2989686 2024-03-04T12:26:52.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.269+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~30XXBZ7BDZ01.0 size=1048576 2024-03-04T12:26:52.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.270+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~30XXBZ7BDZ01.1 size=1048576 2024-03-04T12:26:52.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.271+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~30XXBZ7BDZ01.2 size=164171 2024-03-04T12:26:52.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.271+0000 7fa4b3c3e780 1 > prepared multipart upload key=4LKTYP07OL5L upload=30XXBZ7BDZ01 tag=50O0TNAFXPMR type=write size=3309899 2024-03-04T12:26:52.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.274+0000 7fa4b3c3e780 1 < suggested update operation key=4LKTYP07OL5L tag=W61XI5UE7CHO type=del size=394314 2024-03-04T12:26:52.282 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.276+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~4HM8B8P09REJ.0 size=1048576 2024-03-04T12:26:52.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.277+0000 7fa4b3c3e780 1 > prepared part key=_multipart_DHLTVH2AZBLR.2~4HM8B8P09REJ.1 size=221530 2024-03-04T12:26:52.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.277+0000 7fa4b3c3e780 1 > prepared multipart upload key=DHLTVH2AZBLR upload=4HM8B8P09REJ tag=I5TJMN1NXOS9 type=write size=2318682 2024-03-04T12:26:52.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.278+0000 7fa4b3c3e780 1 < canceled operation key=R6Y09EO6HGF0 tag=UJC765DVKIMQ type=del size=909698 2024-03-04T12:26:52.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.280+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~JWBCN29EQ80H.0 size=1048576 2024-03-04T12:26:52.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.281+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~JWBCN29EQ80H.1 size=1048576 2024-03-04T12:26:52.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.281+0000 7fa4b3c3e780 1 > prepared part key=_multipart_43HMF7NWNMU3.2~JWBCN29EQ80H.2 size=990171 2024-03-04T12:26:52.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.281+0000 7fa4b3c3e780 1 > prepared multipart upload key=43HMF7NWNMU3 upload=JWBCN29EQ80H tag=QSD6CA4Y79UZ type=write size=4135899 2024-03-04T12:26:52.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.283+0000 7fa4b3c3e780 1 < completed delete operation key=GMIPCGYZRJ5L tag=5Z49JTZYEKFP type=del 2024-03-04T12:26:52.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.285+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~M3VQTYKIJOH3.0 size=1048576 2024-03-04T12:26:52.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.286+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BVMWQ9ZL4K0C.2~M3VQTYKIJOH3.1 size=268928 2024-03-04T12:26:52.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.286+0000 7fa4b3c3e780 1 > prepared multipart upload key=BVMWQ9ZL4K0C upload=M3VQTYKIJOH3 tag=CPFXWGDF7DK8 type=write size=2366080 2024-03-04T12:26:52.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.287+0000 7fa4b3c3e780 1 < completed delete operation key=4989OME3IAJF tag=O7AYD02GBBN3 type=del 2024-03-04T12:26:52.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.289+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~EOGPUJUEOMTF.0 size=531914 2024-03-04T12:26:52.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.289+0000 7fa4b3c3e780 1 > prepared multipart upload key=4LKTYP07OL5L upload=EOGPUJUEOMTF tag=F8SWKW7PELWV type=write size=1580490 2024-03-04T12:26:52.297 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.290+0000 7fa4b3c3e780 1 < completed delete operation key=RHU0QO8HS5SC tag=F6WVI2LGAR1E type=del 2024-03-04T12:26:52.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.291+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=UKP5AZ9KV6K0 type=del size=164465 2024-03-04T12:26:52.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.292+0000 7fa4b3c3e780 1 < completed delete operation key=DHLTVH2AZBLR tag=D0JWZNCNRYCK type=del 2024-03-04T12:26:52.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.294+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~CSXTCGZXYF1O.0 size=1048576 2024-03-04T12:26:52.302 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.295+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~CSXTCGZXYF1O.1 size=1048576 2024-03-04T12:26:52.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.296+0000 7fa4b3c3e780 1 > prepared part key=_multipart_NVMIU38VM9Q1.2~CSXTCGZXYF1O.2 size=462672 2024-03-04T12:26:52.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.296+0000 7fa4b3c3e780 1 > prepared multipart upload key=NVMIU38VM9Q1 upload=CSXTCGZXYF1O tag=I22GUTIZ47LJ type=write size=3608400 2024-03-04T12:26:52.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.297+0000 7fa4b3c3e780 1 < completed write operation key=BVMWQ9ZL4K0C tag=JR32KKUPKAU3 type=write size=423543 2024-03-04T12:26:52.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.298+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=D9NBV37B5TL6 type=del size=1489294 2024-03-04T12:26:52.306 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.299+0000 7fa4b3c3e780 1 < canceled operation key=G70BJ2UARNCP tag=YKRDVITS8Y7G type=del size=3387239 2024-03-04T12:26:52.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.301+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~5IWJB5WYVJ4A.0 size=1048576 2024-03-04T12:26:52.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.302+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~5IWJB5WYVJ4A.1 size=1048576 2024-03-04T12:26:52.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.303+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~5IWJB5WYVJ4A.2 size=135803 2024-03-04T12:26:52.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.303+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=5IWJB5WYVJ4A tag=HOBQMKB9GZJ1 type=write size=3281531 2024-03-04T12:26:52.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.304+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=V2LH2PA6MSHL type=del 2024-03-04T12:26:52.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.305+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=LVQ0GZZG5BT2 type=del size=1483297 2024-03-04T12:26:52.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.307+0000 7fa4b3c3e780 1 < suggested update operation key=NVMIU38VM9Q1 tag=SG24J3UL2DFZ type=del size=696815 2024-03-04T12:26:52.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.308+0000 7fa4b3c3e780 1 > prepared operation key=YWJV4QMY6ZBI tag=0SHN3QOR28FB type=del size=633389 2024-03-04T12:26:52.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.309+0000 7fa4b3c3e780 1 < canceled operation key=3N6E09QF3866 tag=7G5CTGSXBGPN type=del size=727062 2024-03-04T12:26:52.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.311+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~1QQ1H8AWTE3Y.0 size=1048576 2024-03-04T12:26:52.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.312+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~1QQ1H8AWTE3Y.1 size=1017057 2024-03-04T12:26:52.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.312+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=1QQ1H8AWTE3Y tag=WT69NCMPQBY6 type=write size=3114209 2024-03-04T12:26:52.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.313+0000 7fa4b3c3e780 1 < completed delete operation key=VAIY4J3CYONH tag=ULZ5IWQSRJIC type=del 2024-03-04T12:26:52.320 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.314+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=DKYXP2JIORZC type=del size=2586393 2024-03-04T12:26:52.321 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.315+0000 7fa4b3c3e780 1 < completed write operation key=VAIY4J3CYONH tag=UJBBTCOWBS15 type=write size=557432 2024-03-04T12:26:52.323 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.316+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=P5B5CYQUPLNO type=write size=576811 2024-03-04T12:26:52.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.317+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~1S7Z0L08LXP1.0 size=429745 2024-03-04T12:26:52.325 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.319+0000 7fa4b3c3e780 1 < completed multipart upload key=G8G76PMSKJ0I upload=1S7Z0L08LXP1 tag=KA2XW98WD5K5 type=write size=1478321 2024-03-04T12:26:52.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.321+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~QM9075RI74P1.0 size=1048576 2024-03-04T12:26:52.328 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.321+0000 7fa4b3c3e780 1 > prepared part key=_multipart_RHU0QO8HS5SC.2~QM9075RI74P1.1 size=593041 2024-03-04T12:26:52.328 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.321+0000 7fa4b3c3e780 1 > prepared multipart upload key=RHU0QO8HS5SC upload=QM9075RI74P1 tag=WU6ATCB7192W type=write size=2690193 2024-03-04T12:26:52.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.322+0000 7fa4b3c3e780 -1 < failed to complete operation key=4LKTYP07OL5L tag=4DMXGBZQFLO6 type=del size=1464849: (22) Invalid argument 2024-03-04T12:26:52.331 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.324+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~YW5IWW41K01T.0 size=1048576 2024-03-04T12:26:52.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.325+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~YW5IWW41K01T.1 size=73454 2024-03-04T12:26:52.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.325+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=YW5IWW41K01T tag=MLYHQN6ZK9SZ type=write size=2170606 2024-03-04T12:26:52.333 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.326+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~30XXBZ7BDZ01.0 size=1048576 2024-03-04T12:26:52.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.327+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~30XXBZ7BDZ01.1 size=1048576 2024-03-04T12:26:52.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.328+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~30XXBZ7BDZ01.2 size=164171 2024-03-04T12:26:52.337 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.330+0000 7fa4b3c3e780 1 < completed multipart upload key=4LKTYP07OL5L upload=30XXBZ7BDZ01 tag=50O0TNAFXPMR type=write size=3309899 2024-03-04T12:26:52.338 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.331+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=S3HWQK9ICIAT type=del size=841626 2024-03-04T12:26:52.339 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.332+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~4HM8B8P09REJ.0 size=1048576 2024-03-04T12:26:52.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.333+0000 7fa4b3c3e780 1 < completed part key=_multipart_DHLTVH2AZBLR.2~4HM8B8P09REJ.1 size=221530 2024-03-04T12:26:52.342 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.335+0000 7fa4b3c3e780 1 < completed multipart upload key=DHLTVH2AZBLR upload=4HM8B8P09REJ tag=I5TJMN1NXOS9 type=write size=2318682 2024-03-04T12:26:52.343 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.336+0000 7fa4b3c3e780 1 > prepared operation key=T301TK0FIOG4 tag=XLVFNG5VA5B0 type=del size=4040661 2024-03-04T12:26:52.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.338+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~JWBCN29EQ80H.0 size=1048576 2024-03-04T12:26:52.346 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.339+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~JWBCN29EQ80H.1 size=1048576 2024-03-04T12:26:52.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.340+0000 7fa4b3c3e780 1 < completed part key=_multipart_43HMF7NWNMU3.2~JWBCN29EQ80H.2 size=990171 2024-03-04T12:26:52.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.342+0000 7fa4b3c3e780 1 < completed multipart upload key=43HMF7NWNMU3 upload=JWBCN29EQ80H tag=QSD6CA4Y79UZ type=write size=4135899 2024-03-04T12:26:52.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.343+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=F4AU5QQ5ZA0S type=del size=875829 2024-03-04T12:26:52.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.344+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~M3VQTYKIJOH3.0 size=1048576 2024-03-04T12:26:52.352 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.345+0000 7fa4b3c3e780 1 < completed part key=_multipart_BVMWQ9ZL4K0C.2~M3VQTYKIJOH3.1 size=268928 2024-03-04T12:26:52.353 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.346+0000 7fa4b3c3e780 1 < completed multipart upload key=BVMWQ9ZL4K0C upload=M3VQTYKIJOH3 tag=CPFXWGDF7DK8 type=write size=2366080 2024-03-04T12:26:52.354 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.348+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=9T93GFNQD6LB type=del size=1403548 2024-03-04T12:26:52.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.349+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~EOGPUJUEOMTF.0 size=531914 2024-03-04T12:26:52.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.350+0000 7fa4b3c3e780 1 < completed multipart upload key=4LKTYP07OL5L upload=EOGPUJUEOMTF tag=F8SWKW7PELWV type=write size=1580490 2024-03-04T12:26:52.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.351+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=SE7MET4IQV1O type=del size=1133389 2024-03-04T12:26:52.360 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.353+0000 7fa4b3c3e780 1 < completed delete operation key=3N6E09QF3866 tag=UKP5AZ9KV6K0 type=del 2024-03-04T12:26:52.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.355+0000 7fa4b3c3e780 1 > prepared part key=_multipart_T301TK0FIOG4.2~GH5L9TOPGL1I.0 size=420497 2024-03-04T12:26:52.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.355+0000 7fa4b3c3e780 1 > prepared multipart upload key=T301TK0FIOG4 upload=GH5L9TOPGL1I tag=NS84H1FA0LQ2 type=write size=1469073 2024-03-04T12:26:52.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.356+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~CSXTCGZXYF1O.0 size=1048576 2024-03-04T12:26:52.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.357+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~CSXTCGZXYF1O.1 size=1048576 2024-03-04T12:26:52.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.358+0000 7fa4b3c3e780 1 < completed part key=_multipart_NVMIU38VM9Q1.2~CSXTCGZXYF1O.2 size=462672 2024-03-04T12:26:52.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.360+0000 7fa4b3c3e780 1 < completed multipart upload key=NVMIU38VM9Q1 upload=CSXTCGZXYF1O tag=I22GUTIZ47LJ type=write size=3608400 2024-03-04T12:26:52.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.362+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~GNJROSCY4DD1.0 size=1048576 2024-03-04T12:26:52.370 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.363+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~GNJROSCY4DD1.1 size=1048576 2024-03-04T12:26:52.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.364+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YIS2SV4O5EZN.2~GNJROSCY4DD1.2 size=728634 2024-03-04T12:26:52.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.364+0000 7fa4b3c3e780 1 > prepared multipart upload key=YIS2SV4O5EZN upload=GNJROSCY4DD1 tag=0POJMOTIJL1Y type=write size=3874362 2024-03-04T12:26:52.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.365+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=D9NBV37B5TL6 type=del 2024-03-04T12:26:52.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.367+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=TZNPUZDLHMFX type=del size=303959 2024-03-04T12:26:52.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.368+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~5IWJB5WYVJ4A.0 size=1048576 2024-03-04T12:26:52.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.369+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~5IWJB5WYVJ4A.1 size=1048576 2024-03-04T12:26:52.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.370+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~5IWJB5WYVJ4A.2 size=135803 2024-03-04T12:26:52.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.372+0000 7fa4b3c3e780 1 < completed multipart upload key=R1DOKJPZRT5Q upload=5IWJB5WYVJ4A tag=HOBQMKB9GZJ1 type=write size=3281531 2024-03-04T12:26:52.380 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.374+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=4IE5U5QKSV97 type=del size=536877 2024-03-04T12:26:52.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.376+0000 7fa4b3c3e780 1 < suggested update operation key=X0RVLNRWUAEM tag=LVQ0GZZG5BT2 type=del size=1483297 2024-03-04T12:26:52.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.378+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~HM1BM86XAR13.0 size=1048576 2024-03-04T12:26:52.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.379+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~HM1BM86XAR13.1 size=505902 2024-03-04T12:26:52.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.379+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=HM1BM86XAR13 tag=BD8VPAVOQEVV type=write size=2603054 2024-03-04T12:26:52.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.380+0000 7fa4b3c3e780 1 < completed delete operation key=YWJV4QMY6ZBI tag=0SHN3QOR28FB type=del 2024-03-04T12:26:52.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.382+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4989OME3IAJF.2~GXFD3HQ5S3DM.0 size=242553 2024-03-04T12:26:52.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.382+0000 7fa4b3c3e780 1 > prepared multipart upload key=4989OME3IAJF upload=GXFD3HQ5S3DM tag=DQ6XWO47I1YS type=write size=1291129 2024-03-04T12:26:52.390 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.383+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~1QQ1H8AWTE3Y.0 size=1048576 2024-03-04T12:26:52.391 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.384+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~1QQ1H8AWTE3Y.1 size=1017057 2024-03-04T12:26:52.393 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.386+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=1QQ1H8AWTE3Y tag=WT69NCMPQBY6 type=write size=3114209 2024-03-04T12:26:52.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.387+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=C0XPQI4C6JME type=del size=1237825 2024-03-04T12:26:52.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.388+0000 7fa4b3c3e780 1 < completed delete operation key=G4SUQFVB936T tag=DKYXP2JIORZC type=del 2024-03-04T12:26:52.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.389+0000 7fa4b3c3e780 1 > prepared operation key=G4SUQFVB936T tag=9ZQLHCMY6RIK type=write size=850166 2024-03-04T12:26:52.397 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.390+0000 7fa4b3c3e780 -1 < failed to complete operation key=X0RVLNRWUAEM tag=P5B5CYQUPLNO type=write size=576811: (22) Invalid argument 2024-03-04T12:26:52.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.392+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~KHMK1FSQ5DPJ.0 size=1048576 2024-03-04T12:26:52.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.393+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~KHMK1FSQ5DPJ.1 size=1048576 2024-03-04T12:26:52.401 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.394+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~KHMK1FSQ5DPJ.2 size=329469 2024-03-04T12:26:52.401 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.394+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=KHMK1FSQ5DPJ tag=1K3VKIPOULYH type=write size=3475197 2024-03-04T12:26:52.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.395+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~QM9075RI74P1.0 size=1048576 2024-03-04T12:26:52.403 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.396+0000 7fa4b3c3e780 1 < completed part key=_multipart_RHU0QO8HS5SC.2~QM9075RI74P1.1 size=593041 2024-03-04T12:26:52.405 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.398+0000 7fa4b3c3e780 1 < completed multipart upload key=RHU0QO8HS5SC upload=QM9075RI74P1 tag=WU6ATCB7192W type=write size=2690193 2024-03-04T12:26:52.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.399+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=WOLRXHO0K7I6 type=write size=82053 2024-03-04T12:26:52.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.400+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~YW5IWW41K01T.0 size=1048576 2024-03-04T12:26:52.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.401+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~YW5IWW41K01T.1 size=73454 2024-03-04T12:26:52.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.403+0000 7fa4b3c3e780 1 < completed multipart upload key=H5FWRNK8F7QT upload=YW5IWW41K01T tag=MLYHQN6ZK9SZ type=write size=2170606 2024-03-04T12:26:52.412 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.405+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~FPFZGAXHD8LX.0 size=1048576 2024-03-04T12:26:52.413 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.406+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~FPFZGAXHD8LX.1 size=901081 2024-03-04T12:26:52.413 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.406+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=FPFZGAXHD8LX tag=QBAZJ3LXCRL9 type=write size=2998233 2024-03-04T12:26:52.414 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.407+0000 7fa4b3c3e780 -1 < failed to complete operation key=X0RVLNRWUAEM tag=S3HWQK9ICIAT type=del size=841626: (22) Invalid argument 2024-03-04T12:26:52.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.408+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=GXNTEM4KXURD type=del size=3458870 2024-03-04T12:26:52.416 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.409+0000 7fa4b3c3e780 1 < completed delete operation key=T301TK0FIOG4 tag=XLVFNG5VA5B0 type=del 2024-03-04T12:26:52.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.411+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~HUQZHO1SF3T1.0 size=1048576 2024-03-04T12:26:52.419 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.412+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~HUQZHO1SF3T1.1 size=744607 2024-03-04T12:26:52.419 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.412+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=HUQZHO1SF3T1 tag=2YGUAZ0W13W0 type=write size=2841759 2024-03-04T12:26:52.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.413+0000 7fa4b3c3e780 1 < completed delete operation key=KKQT9J9GSW0N tag=F4AU5QQ5ZA0S type=del 2024-03-04T12:26:52.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.416+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~0MHHS1VCWZGW.0 size=1048576 2024-03-04T12:26:52.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.416+0000 7fa4b3c3e780 1 > prepared part key=_multipart_KKQT9J9GSW0N.2~0MHHS1VCWZGW.1 size=160289 2024-03-04T12:26:52.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.416+0000 7fa4b3c3e780 1 > prepared multipart upload key=KKQT9J9GSW0N upload=0MHHS1VCWZGW tag=HFO701QGVYZD type=write size=2257441 2024-03-04T12:26:52.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.418+0000 7fa4b3c3e780 1 < suggested update operation key=DHLTVH2AZBLR tag=9T93GFNQD6LB type=del size=1403548 2024-03-04T12:26:52.427 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.421+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~GJN9TDVHK6PU.0 size=926980 2024-03-04T12:26:52.427 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.421+0000 7fa4b3c3e780 1 > prepared multipart upload key=G8G76PMSKJ0I upload=GJN9TDVHK6PU tag=LVG9Y6USZT1H type=write size=1975556 2024-03-04T12:26:52.428 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.422+0000 7fa4b3c3e780 -1 < failed to complete operation key=DHLTVH2AZBLR tag=SE7MET4IQV1O type=del size=1133389: (22) Invalid argument 2024-03-04T12:26:52.430 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.423+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=D9UL5S8XTOQO type=del size=49455 2024-03-04T12:26:52.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.424+0000 7fa4b3c3e780 1 < completed part key=_multipart_T301TK0FIOG4.2~GH5L9TOPGL1I.0 size=420497 2024-03-04T12:26:52.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.426+0000 7fa4b3c3e780 1 < completed multipart upload key=T301TK0FIOG4 upload=GH5L9TOPGL1I tag=NS84H1FA0LQ2 type=write size=1469073 2024-03-04T12:26:52.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.427+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=GNKTYOTZQ7UE type=del size=1250242 2024-03-04T12:26:52.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.428+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YIS2SV4O5EZN.2~GNJROSCY4DD1.0 size=1048576 2024-03-04T12:26:52.435 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.429+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~GNJROSCY4DD1.1 size=1048576 2024-03-04T12:26:52.436 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.430+0000 7fa4b3c3e780 1 < completed part key=_multipart_YIS2SV4O5EZN.2~GNJROSCY4DD1.2 size=728634 2024-03-04T12:26:52.438 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.432+0000 7fa4b3c3e780 1 < canceled multipart upload key=YIS2SV4O5EZN upload=GNJROSCY4DD1 tag=0POJMOTIJL1Y type=write size=3874362 2024-03-04T12:26:52.440 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.433+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=BI407GN5RDJJ type=del size=3659650 2024-03-04T12:26:52.444 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.434+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=TZNPUZDLHMFX type=del 2024-03-04T12:26:52.444 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.435+0000 7fa4b3c3e780 1 > prepared operation key=V7N7MZ1GUNEV tag=EM7YSE95D8J6 type=del size=3557842 2024-03-04T12:26:52.444 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.436+0000 7fa4b3c3e780 1 < completed delete operation key=WRHB3XWDLSY2 tag=4IE5U5QKSV97 type=del 2024-03-04T12:26:52.445 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.438+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~DUYSHI0WHYYR.0 size=782460 2024-03-04T12:26:52.445 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.438+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=DUYSHI0WHYYR tag=0P0UY7BC1QF3 type=write size=1831036 2024-03-04T12:26:52.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.439+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~HM1BM86XAR13.0 size=1048576 2024-03-04T12:26:52.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.440+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~HM1BM86XAR13.1 size=505902 2024-03-04T12:26:52.450 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.443+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=HM1BM86XAR13 tag=BD8VPAVOQEVV type=write size=2603054 2024-03-04T12:26:52.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.444+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=T08CTVB7X0ND type=del size=112616 2024-03-04T12:26:52.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.445+0000 7fa4b3c3e780 1 < completed part key=_multipart_4989OME3IAJF.2~GXFD3HQ5S3DM.0 size=242553 2024-03-04T12:26:52.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.447+0000 7fa4b3c3e780 1 < completed multipart upload key=4989OME3IAJF upload=GXFD3HQ5S3DM tag=DQ6XWO47I1YS type=write size=1291129 2024-03-04T12:26:52.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.448+0000 7fa4b3c3e780 1 > prepared operation key=H5FWRNK8F7QT tag=BTZHO51Q6VSY type=del size=1790454 2024-03-04T12:26:52.456 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.450+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=C0XPQI4C6JME type=del 2024-03-04T12:26:52.457 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.451+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=XSH6QB4YEERN type=del size=404154 2024-03-04T12:26:52.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.452+0000 7fa4b3c3e780 1 < completed write operation key=G4SUQFVB936T tag=9ZQLHCMY6RIK type=write size=850166 2024-03-04T12:26:52.460 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.453+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=0RGTAHLH0GJH type=del size=3561004 2024-03-04T12:26:52.461 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.454+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~KHMK1FSQ5DPJ.0 size=1048576 2024-03-04T12:26:52.462 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.455+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~KHMK1FSQ5DPJ.1 size=1048576 2024-03-04T12:26:52.463 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.456+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~KHMK1FSQ5DPJ.2 size=329469 2024-03-04T12:26:52.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.458+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=KHMK1FSQ5DPJ tag=1K3VKIPOULYH type=write size=3475197 2024-03-04T12:26:52.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.460+0000 7fa4b3c3e780 1 > prepared part key=_multipart_6XK4DQ940Z5J.2~AJD1QLCVZ5BW.0 size=229203 2024-03-04T12:26:52.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.460+0000 7fa4b3c3e780 1 > prepared multipart upload key=6XK4DQ940Z5J upload=AJD1QLCVZ5BW tag=Z04XAOND6GZH type=write size=1277779 2024-03-04T12:26:52.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.462+0000 7fa4b3c3e780 1 < suggested update operation key=H5FWRNK8F7QT tag=WOLRXHO0K7I6 type=write size=82053 2024-03-04T12:26:52.470 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.463+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=6F7NVTLP26ID type=del size=870827 2024-03-04T12:26:52.471 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.464+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~FPFZGAXHD8LX.0 size=1048576 2024-03-04T12:26:52.471 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.464+0000 7fa4b3c3e780 1 < canceled part key=_multipart_YWJV4QMY6ZBI.2~FPFZGAXHD8LX.1 size=901081 2024-03-04T12:26:52.473 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.466+0000 7fa4b3c3e780 1 < canceled multipart upload key=YWJV4QMY6ZBI upload=FPFZGAXHD8LX tag=QBAZJ3LXCRL9 type=write size=2998233 2024-03-04T12:26:52.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.467+0000 7fa4b3c3e780 1 > prepared operation key=YQLH0WW7I7MW tag=XB3Q882FWY4T type=write size=534144 2024-03-04T12:26:52.476 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.469+0000 7fa4b3c3e780 1 < suggested update operation key=GMIPCGYZRJ5L tag=GXNTEM4KXURD type=del size=3458870 2024-03-04T12:26:52.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.471+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~GEXK3ZQ0WVYL.0 size=288165 2024-03-04T12:26:52.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.471+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=GEXK3ZQ0WVYL tag=D20L47PG6P8H type=write size=1336741 2024-03-04T12:26:52.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.472+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~HUQZHO1SF3T1.0 size=1048576 2024-03-04T12:26:52.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.473+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~HUQZHO1SF3T1.1 size=744607 2024-03-04T12:26:52.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.475+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=HUQZHO1SF3T1 tag=2YGUAZ0W13W0 type=write size=2841759 2024-03-04T12:26:52.483 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.476+0000 7fa4b3c3e780 1 > prepared operation key=BR8RTE2QEH9E tag=TAYVFCJN3DZG type=del size=3400673 2024-03-04T12:26:52.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.477+0000 7fa4b3c3e780 1 < completed part key=_multipart_KKQT9J9GSW0N.2~0MHHS1VCWZGW.0 size=1048576 2024-03-04T12:26:52.484 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.477+0000 7fa4b3c3e780 1 < canceled part key=_multipart_KKQT9J9GSW0N.2~0MHHS1VCWZGW.1 size=160289 2024-03-04T12:26:52.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.479+0000 7fa4b3c3e780 1 < canceled multipart upload key=KKQT9J9GSW0N upload=0MHHS1VCWZGW tag=HFO701QGVYZD type=write size=2257441 2024-03-04T12:26:52.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.480+0000 7fa4b3c3e780 1 > prepared operation key=3N6E09QF3866 tag=GNQ4CVVLX11W type=del size=2048276 2024-03-04T12:26:52.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.481+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~GJN9TDVHK6PU.0 size=926980 2024-03-04T12:26:52.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.483+0000 7fa4b3c3e780 1 < completed multipart upload key=G8G76PMSKJ0I upload=GJN9TDVHK6PU tag=LVG9Y6USZT1H type=write size=1975556 2024-03-04T12:26:52.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.484+0000 7fa4b3c3e780 1 > prepared operation key=X0RVLNRWUAEM tag=NPC0NN144FTE type=write size=363847 2024-03-04T12:26:52.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.487+0000 7fa4b3c3e780 1 < suggested update operation key=G70BJ2UARNCP tag=D9UL5S8XTOQO type=del size=49455 2024-03-04T12:26:52.495 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.488+0000 7fa4b3c3e780 1 > prepared part key=_multipart_H5FWRNK8F7QT.2~ZU8N4PT59D6J.0 size=903964 2024-03-04T12:26:52.495 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.488+0000 7fa4b3c3e780 1 > prepared multipart upload key=H5FWRNK8F7QT upload=ZU8N4PT59D6J tag=ZGUVIL88RGG7 type=write size=1952540 2024-03-04T12:26:52.496 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.490+0000 7fa4b3c3e780 1 < completed delete operation key=UZRX3W3DE5VX tag=GNKTYOTZQ7UE type=del 2024-03-04T12:26:52.498 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.492+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~O6NBNURVO8M8.0 size=1048576 2024-03-04T12:26:52.499 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.492+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~O6NBNURVO8M8.1 size=1048576 2024-03-04T12:26:52.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.493+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~O6NBNURVO8M8.2 size=826500 2024-03-04T12:26:52.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.493+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=O6NBNURVO8M8 tag=XOJ7QJ7B6ROI type=write size=3972228 2024-03-04T12:26:52.501 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.494+0000 7fa4b3c3e780 1 < canceled operation key=ESHAMQWMMBJR tag=BI407GN5RDJJ type=del size=3659650 2024-03-04T12:26:52.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.496+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~CWJ1S0DRTZ7G.0 size=951563 2024-03-04T12:26:52.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.496+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=CWJ1S0DRTZ7G tag=30233UFJE4VK type=write size=2000139 2024-03-04T12:26:52.505 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.499+0000 7fa4b3c3e780 1 < suggested update operation key=V7N7MZ1GUNEV tag=EM7YSE95D8J6 type=del size=3557842 2024-03-04T12:26:52.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.501+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R1DOKJPZRT5Q.2~PA10KKA9K9RQ.0 size=462982 2024-03-04T12:26:52.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.501+0000 7fa4b3c3e780 1 > prepared multipart upload key=R1DOKJPZRT5Q upload=PA10KKA9K9RQ tag=2N776DMK84NC type=write size=1511558 2024-03-04T12:26:52.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.502+0000 7fa4b3c3e780 1 < completed part key=_multipart_YQLH0WW7I7MW.2~DUYSHI0WHYYR.0 size=782460 2024-03-04T12:26:52.511 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.504+0000 7fa4b3c3e780 1 < completed multipart upload key=YQLH0WW7I7MW upload=DUYSHI0WHYYR tag=0P0UY7BC1QF3 type=write size=1831036 2024-03-04T12:26:52.512 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.505+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=W8TLLUAMSPK9 type=write size=856858 2024-03-04T12:26:52.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.506+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=T08CTVB7X0ND type=del 2024-03-04T12:26:52.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.508+0000 7fa4b3c3e780 1 > prepared operation key=7IUV88NQLPN8 tag=0OL4TXP9JQN1 type=del size=533648 2024-03-04T12:26:52.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.510+0000 7fa4b3c3e780 1 < suggested remove operation key=H5FWRNK8F7QT tag=BTZHO51Q6VSY type=del 2024-03-04T12:26:52.518 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.511+0000 7fa4b3c3e780 1 > prepared operation key=43HMF7NWNMU3 tag=RDTGOQE4VJEY type=del size=2273502 2024-03-04T12:26:52.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.512+0000 7fa4b3c3e780 1 < completed delete operation key=NVMIU38VM9Q1 tag=XSH6QB4YEERN type=del 2024-03-04T12:26:52.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.514+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=CA1RNMBTUF2S type=del size=308075 2024-03-04T12:26:52.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.515+0000 7fa4b3c3e780 1 < canceled operation key=VAIY4J3CYONH tag=0RGTAHLH0GJH type=del size=3561004 2024-03-04T12:26:52.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.516+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=FPVYW903RCHE type=write size=630832 2024-03-04T12:26:52.524 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.517+0000 7fa4b3c3e780 1 < completed part key=_multipart_6XK4DQ940Z5J.2~AJD1QLCVZ5BW.0 size=229203 2024-03-04T12:26:52.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.519+0000 7fa4b3c3e780 1 < completed multipart upload key=6XK4DQ940Z5J upload=AJD1QLCVZ5BW tag=Z04XAOND6GZH type=write size=1277779 2024-03-04T12:26:52.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.522+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~5DX6SBP5SNPF.0 size=1048576 2024-03-04T12:26:52.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.523+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~5DX6SBP5SNPF.1 size=1048576 2024-03-04T12:26:52.530 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.523+0000 7fa4b3c3e780 1 > prepared part key=_multipart_ZETES4AYZQHY.2~5DX6SBP5SNPF.2 size=64335 2024-03-04T12:26:52.530 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.523+0000 7fa4b3c3e780 1 > prepared multipart upload key=ZETES4AYZQHY upload=5DX6SBP5SNPF tag=INI5HBVF8C6O type=write size=3210063 2024-03-04T12:26:52.531 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.525+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=6F7NVTLP26ID type=del 2024-03-04T12:26:52.533 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.527+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~B6GD25YEKBMR.0 size=1048576 2024-03-04T12:26:52.534 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.528+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~B6GD25YEKBMR.1 size=1048576 2024-03-04T12:26:52.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.528+0000 7fa4b3c3e780 1 > prepared part key=_multipart_VAIY4J3CYONH.2~B6GD25YEKBMR.2 size=169813 2024-03-04T12:26:52.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.528+0000 7fa4b3c3e780 1 > prepared multipart upload key=VAIY4J3CYONH upload=B6GD25YEKBMR tag=ZSKLVD0W6JRP type=write size=3315541 2024-03-04T12:26:52.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.530+0000 7fa4b3c3e780 1 < completed write operation key=YQLH0WW7I7MW tag=XB3Q882FWY4T type=write size=534144 2024-03-04T12:26:52.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.532+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~4B6PFYXLUZKS.0 size=1048576 2024-03-04T12:26:52.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.533+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~4B6PFYXLUZKS.1 size=1048576 2024-03-04T12:26:52.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.534+0000 7fa4b3c3e780 1 > prepared part key=_multipart_4LKTYP07OL5L.2~4B6PFYXLUZKS.2 size=23896 2024-03-04T12:26:52.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.534+0000 7fa4b3c3e780 1 > prepared multipart upload key=4LKTYP07OL5L upload=4B6PFYXLUZKS tag=22RQ50S594U1 type=write size=3169624 2024-03-04T12:26:52.542 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.535+0000 7fa4b3c3e780 1 < completed part key=_multipart_H5FWRNK8F7QT.2~GEXK3ZQ0WVYL.0 size=288165 2024-03-04T12:26:52.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.537+0000 7fa4b3c3e780 1 < completed multipart upload key=H5FWRNK8F7QT upload=GEXK3ZQ0WVYL tag=D20L47PG6P8H type=write size=1336741 2024-03-04T12:26:52.546 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.539+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~AXOMPOFBCRZT.0 size=1048576 2024-03-04T12:26:52.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.540+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~AXOMPOFBCRZT.1 size=1048576 2024-03-04T12:26:52.548 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.541+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YWJV4QMY6ZBI.2~AXOMPOFBCRZT.2 size=439427 2024-03-04T12:26:52.548 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.541+0000 7fa4b3c3e780 1 > prepared multipart upload key=YWJV4QMY6ZBI upload=AXOMPOFBCRZT tag=PUQN61S48RU1 type=write size=3585155 2024-03-04T12:26:52.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.542+0000 7fa4b3c3e780 1 < canceled operation key=BR8RTE2QEH9E tag=TAYVFCJN3DZG type=del size=3400673 2024-03-04T12:26:52.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.544+0000 7fa4b3c3e780 1 > prepared part key=_multipart_UZRX3W3DE5VX.2~RCF657EQ7Z7W.0 size=165699 2024-03-04T12:26:52.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.544+0000 7fa4b3c3e780 1 > prepared multipart upload key=UZRX3W3DE5VX upload=RCF657EQ7Z7W tag=RZJHZG4X3OC7 type=write size=1214275 2024-03-04T12:26:52.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.546+0000 7fa4b3c3e780 1 < suggested remove operation key=3N6E09QF3866 tag=GNQ4CVVLX11W type=del 2024-03-04T12:26:52.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.548+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=VBI3HPZA4GBS type=del size=1118565 2024-03-04T12:26:52.557 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.550+0000 7fa4b3c3e780 1 < completed write operation key=X0RVLNRWUAEM tag=NPC0NN144FTE type=write size=363847 2024-03-04T12:26:52.558 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.551+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=V7Y4B5CDC24G type=del size=2556476 2024-03-04T12:26:52.558 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.552+0000 7fa4b3c3e780 1 < canceled part key=_multipart_H5FWRNK8F7QT.2~ZU8N4PT59D6J.0 size=903964 2024-03-04T12:26:52.560 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.553+0000 7fa4b3c3e780 1 < canceled multipart upload key=H5FWRNK8F7QT upload=ZU8N4PT59D6J tag=ZGUVIL88RGG7 type=write size=1952540 2024-03-04T12:26:52.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.555+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~HXNYWQ93X86Z.0 size=1048576 2024-03-04T12:26:52.563 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.556+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~HXNYWQ93X86Z.1 size=1048576 2024-03-04T12:26:52.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.557+0000 7fa4b3c3e780 1 > prepared part key=_multipart_WRHB3XWDLSY2.2~HXNYWQ93X86Z.2 size=632336 2024-03-04T12:26:52.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.557+0000 7fa4b3c3e780 1 > prepared multipart upload key=WRHB3XWDLSY2 upload=HXNYWQ93X86Z tag=H597KH7Y39HB type=write size=3778064 2024-03-04T12:26:52.565 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.558+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~O6NBNURVO8M8.0 size=1048576 2024-03-04T12:26:52.566 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.559+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~O6NBNURVO8M8.1 size=1048576 2024-03-04T12:26:52.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.560+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~O6NBNURVO8M8.2 size=826500 2024-03-04T12:26:52.569 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.562+0000 7fa4b3c3e780 1 < completed multipart upload key=R1DOKJPZRT5Q upload=O6NBNURVO8M8 tag=XOJ7QJ7B6ROI type=write size=3972228 2024-03-04T12:26:52.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.564+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~94T3JDK0IX5S.0 size=1048576 2024-03-04T12:26:52.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.565+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~94T3JDK0IX5S.1 size=1048576 2024-03-04T12:26:52.572 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.566+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G8G76PMSKJ0I.2~94T3JDK0IX5S.2 size=60384 2024-03-04T12:26:52.572 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.566+0000 7fa4b3c3e780 1 > prepared multipart upload key=G8G76PMSKJ0I upload=94T3JDK0IX5S tag=IFDZE0F9RAIE type=write size=3206112 2024-03-04T12:26:52.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.567+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~CWJ1S0DRTZ7G.0 size=951563 2024-03-04T12:26:52.575 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.568+0000 7fa4b3c3e780 1 < completed multipart upload key=R1DOKJPZRT5Q upload=CWJ1S0DRTZ7G tag=30233UFJE4VK type=write size=2000139 2024-03-04T12:26:52.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.570+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~ZEGVXXPWYHNQ.0 size=1048576 2024-03-04T12:26:52.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.571+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~ZEGVXXPWYHNQ.1 size=1048576 2024-03-04T12:26:52.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.572+0000 7fa4b3c3e780 1 > prepared part key=_multipart_GMIPCGYZRJ5L.2~ZEGVXXPWYHNQ.2 size=142181 2024-03-04T12:26:52.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.572+0000 7fa4b3c3e780 1 > prepared multipart upload key=GMIPCGYZRJ5L upload=ZEGVXXPWYHNQ tag=8K2T73BZPG6P type=write size=3287909 2024-03-04T12:26:52.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.573+0000 7fa4b3c3e780 1 < completed part key=_multipart_R1DOKJPZRT5Q.2~PA10KKA9K9RQ.0 size=462982 2024-03-04T12:26:52.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.575+0000 7fa4b3c3e780 1 < completed multipart upload key=R1DOKJPZRT5Q upload=PA10KKA9K9RQ tag=2N776DMK84NC type=write size=1511558 2024-03-04T12:26:52.584 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.577+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~FCI13TECNGJG.0 size=1048576 2024-03-04T12:26:52.584 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.578+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~FCI13TECNGJG.1 size=1048576 2024-03-04T12:26:52.585 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.579+0000 7fa4b3c3e780 1 > prepared part key=_multipart_G70BJ2UARNCP.2~FCI13TECNGJG.2 size=412868 2024-03-04T12:26:52.585 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.579+0000 7fa4b3c3e780 1 > prepared multipart upload key=G70BJ2UARNCP upload=FCI13TECNGJG tag=37CNRJ3W2HUJ type=write size=3558596 2024-03-04T12:26:52.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.580+0000 7fa4b3c3e780 1 < completed write operation key=G8G76PMSKJ0I tag=W8TLLUAMSPK9 type=write size=856858 2024-03-04T12:26:52.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.581+0000 7fa4b3c3e780 1 > prepared operation key=ESHAMQWMMBJR tag=2O63JA6VKIGQ type=del size=3666326 2024-03-04T12:26:52.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.582+0000 7fa4b3c3e780 1 < completed delete operation key=7IUV88NQLPN8 tag=0OL4TXP9JQN1 type=del 2024-03-04T12:26:52.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.583+0000 7fa4b3c3e780 1 > prepared operation key=G8G76PMSKJ0I tag=UKNXTDI7MESV type=del size=2034596 2024-03-04T12:26:52.591 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.584+0000 7fa4b3c3e780 1 < completed delete operation key=43HMF7NWNMU3 tag=RDTGOQE4VJEY type=del 2024-03-04T12:26:52.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.585+0000 7fa4b3c3e780 1 > prepared operation key=BVMWQ9ZL4K0C tag=BXEFPZF2QEJX type=write size=671128 2024-03-04T12:26:52.593 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.586+0000 7fa4b3c3e780 1 < canceled operation key=G8G76PMSKJ0I tag=CA1RNMBTUF2S type=del size=308075 2024-03-04T12:26:52.595 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.588+0000 7fa4b3c3e780 1 > prepared part key=_multipart_BR8RTE2QEH9E.2~U4GYMUD3OAZO.0 size=503461 2024-03-04T12:26:52.595 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.588+0000 7fa4b3c3e780 1 > prepared multipart upload key=BR8RTE2QEH9E upload=U4GYMUD3OAZO tag=1KG0GAEUDGG8 type=write size=1552037 2024-03-04T12:26:52.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.589+0000 7fa4b3c3e780 1 < canceled operation key=DHLTVH2AZBLR tag=FPVYW903RCHE type=write size=630832 2024-03-04T12:26:52.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.590+0000 7fa4b3c3e780 1 > prepared operation key=VAIY4J3CYONH tag=3YVJBAB95XRE type=write size=448394 2024-03-04T12:26:52.598 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.592+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~5DX6SBP5SNPF.0 size=1048576 2024-03-04T12:26:52.599 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.592+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~5DX6SBP5SNPF.1 size=1048576 2024-03-04T12:26:52.600 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.593+0000 7fa4b3c3e780 1 < completed part key=_multipart_ZETES4AYZQHY.2~5DX6SBP5SNPF.2 size=64335 2024-03-04T12:26:52.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.595+0000 7fa4b3c3e780 1 < completed multipart upload key=ZETES4AYZQHY upload=5DX6SBP5SNPF tag=INI5HBVF8C6O type=write size=3210063 2024-03-04T12:26:52.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.596+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=RZ59ZBS9T6S4 type=write size=481601 2024-03-04T12:26:52.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.597+0000 7fa4b3c3e780 1 < canceled part key=_multipart_VAIY4J3CYONH.2~B6GD25YEKBMR.0 size=1048576 2024-03-04T12:26:52.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.598+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~B6GD25YEKBMR.1 size=1048576 2024-03-04T12:26:52.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.599+0000 7fa4b3c3e780 1 < completed part key=_multipart_VAIY4J3CYONH.2~B6GD25YEKBMR.2 size=169813 2024-03-04T12:26:52.607 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.600+0000 7fa4b3c3e780 1 < canceled multipart upload key=VAIY4J3CYONH upload=B6GD25YEKBMR tag=ZSKLVD0W6JRP type=write size=3315541 2024-03-04T12:26:52.608 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.602+0000 7fa4b3c3e780 1 > prepared operation key=4989OME3IAJF tag=P8JLSU6OEYIK type=del size=1867591 2024-03-04T12:26:52.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.602+0000 7fa4b3c3e780 1 < canceled part key=_multipart_4LKTYP07OL5L.2~4B6PFYXLUZKS.0 size=1048576 2024-03-04T12:26:52.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.602+0000 7fa4b3c3e780 1 < canceled part key=_multipart_4LKTYP07OL5L.2~4B6PFYXLUZKS.1 size=1048576 2024-03-04T12:26:52.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.603+0000 7fa4b3c3e780 1 < completed part key=_multipart_4LKTYP07OL5L.2~4B6PFYXLUZKS.2 size=23896 2024-03-04T12:26:52.612 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.605+0000 7fa4b3c3e780 1 < canceled multipart upload key=4LKTYP07OL5L upload=4B6PFYXLUZKS tag=22RQ50S594U1 type=write size=3169624 2024-03-04T12:26:52.613 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.607+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~BQ9648SHRKNG.0 size=1048576 2024-03-04T12:26:52.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.608+0000 7fa4b3c3e780 1 > prepared part key=_multipart_R6Y09EO6HGF0.2~BQ9648SHRKNG.1 size=853870 2024-03-04T12:26:52.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.608+0000 7fa4b3c3e780 1 > prepared multipart upload key=R6Y09EO6HGF0 upload=BQ9648SHRKNG tag=XGIK76AN4XKX type=write size=2951022 2024-03-04T12:26:52.615 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.609+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~AXOMPOFBCRZT.0 size=1048576 2024-03-04T12:26:52.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.610+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~AXOMPOFBCRZT.1 size=1048576 2024-03-04T12:26:52.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.611+0000 7fa4b3c3e780 1 < completed part key=_multipart_YWJV4QMY6ZBI.2~AXOMPOFBCRZT.2 size=439427 2024-03-04T12:26:52.619 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.613+0000 7fa4b3c3e780 1 < completed multipart upload key=YWJV4QMY6ZBI upload=AXOMPOFBCRZT tag=PUQN61S48RU1 type=write size=3585155 2024-03-04T12:26:52.621 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.614+0000 7fa4b3c3e780 1 > prepared operation key=G70BJ2UARNCP tag=5S0YI1SLZT93 type=del size=2452348 2024-03-04T12:26:52.622 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.615+0000 7fa4b3c3e780 1 < completed part key=_multipart_UZRX3W3DE5VX.2~RCF657EQ7Z7W.0 size=165699 2024-03-04T12:26:52.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.617+0000 7fa4b3c3e780 1 < completed multipart upload key=UZRX3W3DE5VX upload=RCF657EQ7Z7W tag=RZJHZG4X3OC7 type=write size=1214275 2024-03-04T12:26:52.626 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.619+0000 7fa4b3c3e780 1 > prepared part key=_multipart_YQLH0WW7I7MW.2~K5M80Q4U6XW1.0 size=117981 2024-03-04T12:26:52.626 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.619+0000 7fa4b3c3e780 1 > prepared multipart upload key=YQLH0WW7I7MW upload=K5M80Q4U6XW1 tag=6XCFJ8GCC0E0 type=write size=1166557 2024-03-04T12:26:52.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.620+0000 7fa4b3c3e780 1 < completed delete operation key=BVMWQ9ZL4K0C tag=VBI3HPZA4GBS type=del 2024-03-04T12:26:52.628 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.621+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=RHY4ERGQMC5N type=write size=186524 2024-03-04T12:26:52.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.622+0000 7fa4b3c3e780 1 < completed delete operation key=3TDMQXKLPX34 tag=V7Y4B5CDC24G type=del 2024-03-04T12:26:52.630 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.624+0000 7fa4b3c3e780 1 > prepared operation key=GMIPCGYZRJ5L tag=31S3DE15FLBP type=del size=48828 2024-03-04T12:26:52.632 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.625+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~HXNYWQ93X86Z.0 size=1048576 2024-03-04T12:26:52.632 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.626+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~HXNYWQ93X86Z.1 size=1048576 2024-03-04T12:26:52.633 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.627+0000 7fa4b3c3e780 1 < completed part key=_multipart_WRHB3XWDLSY2.2~HXNYWQ93X86Z.2 size=632336 2024-03-04T12:26:52.635 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.628+0000 7fa4b3c3e780 1 < completed multipart upload key=WRHB3XWDLSY2 upload=HXNYWQ93X86Z tag=H597KH7Y39HB type=write size=3778064 2024-03-04T12:26:52.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.630+0000 7fa4b3c3e780 1 > prepared operation key=DHLTVH2AZBLR tag=7DWF1OKGN9MG type=del size=44043 2024-03-04T12:26:52.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.631+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~94T3JDK0IX5S.0 size=1048576 2024-03-04T12:26:52.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.632+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~94T3JDK0IX5S.1 size=1048576 2024-03-04T12:26:52.640 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.633+0000 7fa4b3c3e780 1 < completed part key=_multipart_G8G76PMSKJ0I.2~94T3JDK0IX5S.2 size=60384 2024-03-04T12:26:52.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.635+0000 7fa4b3c3e780 1 < completed multipart upload key=G8G76PMSKJ0I upload=94T3JDK0IX5S tag=IFDZE0F9RAIE type=write size=3206112 2024-03-04T12:26:52.643 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.636+0000 7fa4b3c3e780 1 > prepared operation key=UZRX3W3DE5VX tag=78DK1YFWFRZI type=del size=3372514 2024-03-04T12:26:52.644 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.637+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~ZEGVXXPWYHNQ.0 size=1048576 2024-03-04T12:26:52.648 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.638+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~ZEGVXXPWYHNQ.1 size=1048576 2024-03-04T12:26:52.648 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.639+0000 7fa4b3c3e780 1 < completed part key=_multipart_GMIPCGYZRJ5L.2~ZEGVXXPWYHNQ.2 size=142181 2024-03-04T12:26:52.648 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.641+0000 7fa4b3c3e780 1 < completed multipart upload key=GMIPCGYZRJ5L upload=ZEGVXXPWYHNQ tag=8K2T73BZPG6P type=write size=3287909 2024-03-04T12:26:52.649 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.642+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=7KHKBLG7VMW1 type=del size=2575091 2024-03-04T12:26:52.650 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.643+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~FCI13TECNGJG.0 size=1048576 2024-03-04T12:26:52.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.644+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~FCI13TECNGJG.1 size=1048576 2024-03-04T12:26:52.652 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.645+0000 7fa4b3c3e780 1 < completed part key=_multipart_G70BJ2UARNCP.2~FCI13TECNGJG.2 size=412868 2024-03-04T12:26:52.654 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.647+0000 7fa4b3c3e780 1 < completed multipart upload key=G70BJ2UARNCP upload=FCI13TECNGJG tag=37CNRJ3W2HUJ type=write size=3558596 2024-03-04T12:26:52.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.648+0000 7fa4b3c3e780 1 > prepared operation key=NVMIU38VM9Q1 tag=HDDK1P2OSMII type=del size=2071051 2024-03-04T12:26:52.656 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.649+0000 7fa4b3c3e780 1 < completed delete operation key=ESHAMQWMMBJR tag=2O63JA6VKIGQ type=del 2024-03-04T12:26:52.659 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.652+0000 7fa4b3c3e780 1 > prepared part key=_multipart_X0RVLNRWUAEM.2~M5NY256H5C7X.0 size=653739 2024-03-04T12:26:52.659 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.652+0000 7fa4b3c3e780 1 > prepared multipart upload key=X0RVLNRWUAEM upload=M5NY256H5C7X tag=XV5XIZY8R2LX type=write size=1702315 2024-03-04T12:26:52.660 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.653+0000 7fa4b3c3e780 1 < canceled operation key=G8G76PMSKJ0I tag=UKNXTDI7MESV type=del size=2034596 2024-03-04T12:26:52.661 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.654+0000 7fa4b3c3e780 1 > prepared operation key=R6Y09EO6HGF0 tag=P3WSFK4XAN1X type=del size=4079815 2024-03-04T12:26:52.663 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.656+0000 7fa4b3c3e780 1 < suggested remove operation key=BVMWQ9ZL4K0C tag=BXEFPZF2QEJX type=write 2024-03-04T12:26:52.664 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.657+0000 7fa4b3c3e780 1 > prepared operation key=3TDMQXKLPX34 tag=RUG17H2Y2VJP type=del size=3054700 2024-03-04T12:26:52.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.659+0000 7fa4b3c3e780 1 < completed part key=_multipart_BR8RTE2QEH9E.2~U4GYMUD3OAZO.0 size=503461 2024-03-04T12:26:52.667 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.660+0000 7fa4b3c3e780 1 < completed multipart upload key=BR8RTE2QEH9E upload=U4GYMUD3OAZO tag=1KG0GAEUDGG8 type=write size=1552037 2024-03-04T12:26:52.668 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.662+0000 7fa4b3c3e780 1 > prepared operation key=WRHB3XWDLSY2 tag=SFZ4K5R743F6 type=del size=3011935 2024-03-04T12:26:52.670 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.663+0000 7fa4b3c3e780 1 < completed write operation key=VAIY4J3CYONH tag=3YVJBAB95XRE type=write size=448394 2024-03-04T12:26:52.670 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.664+0000 7fa4b3c3e780 1 > prepared operation key=KKQT9J9GSW0N tag=TTXL80E9NGMZ type=del size=320457 2024-03-04T12:26:52.672 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.665+0000 7fa4b3c3e780 1 < completed write operation key=GMIPCGYZRJ5L tag=RZ59ZBS9T6S4 type=write size=481601 2024-03-04T12:26:52.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:26:52.666+0000 7fa4b3c3e780 1 > prepared operation key=6XK4DQ940Z5J tag=AE5OS4J4IEFX type=del size=70245 2024-03-04T12:26:52.673 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] cls_rgw_stats.simulate (8755 ms) 2024-03-04T12:26:52.673 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 1 test from cls_rgw_stats (8755 ms total) 2024-03-04T12:26:52.673 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:26:52.673 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:26:52.994 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 1 test from 1 test suite ran. (10932 ms total) 2024-03-04T12:26:52.995 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 1 test. 2024-03-04T12:26:52.997 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:26:52.997 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:26:53.076 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-03-04T12:26:53.077 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-03-04T12:26:53.077 DEBUG:teuthology.orchestra.run.smithi110:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-03-04T12:26:53.157 INFO:tasks.workunit.client.0.smithi110.stdout:Running main() from gmock_main.cc 2024-03-04T12:26:53.157 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 31 tests from 1 test suite. 2024-03-04T12:26:53.157 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:26:55.008 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 31 tests from CmpOmap 2024-03-04T12:26:55.009 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-03-04T12:26:55.026 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (18 ms) 2024-03-04T12:26:55.026 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-03-04T12:26:55.030 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (4 ms) 2024-03-04T12:26:55.030 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-03-04T12:26:55.033 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-03-04T12:26:55.033 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-03-04T12:26:55.036 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-03-04T12:26:55.036 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-03-04T12:26:55.042 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2024-03-04T12:26:55.043 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-03-04T12:26:55.048 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_vals_u64 (5 ms) 2024-03-04T12:26:55.048 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-03-04T12:26:55.051 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-03-04T12:26:55.051 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-03-04T12:26:55.055 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-03-04T12:26:55.055 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-03-04T12:26:55.059 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-03-04T12:26:55.059 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-03-04T12:26:55.064 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (5 ms) 2024-03-04T12:26:55.064 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-03-04T12:26:55.065 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-03-04T12:26:55.065 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-03-04T12:26:55.065 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-03-04T12:26:55.066 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-03-04T12:26:55.073 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-03-04T12:26:55.073 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-03-04T12:26:55.080 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2024-03-04T12:26:55.080 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-03-04T12:26:55.085 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (5 ms) 2024-03-04T12:26:55.086 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-03-04T12:26:55.091 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (6 ms) 2024-03-04T12:26:55.091 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-03-04T12:26:55.098 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2024-03-04T12:26:55.099 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-03-04T12:26:55.108 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (9 ms) 2024-03-04T12:26:55.108 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-03-04T12:26:55.111 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-03-04T12:26:55.111 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-03-04T12:26:55.113 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (2 ms) 2024-03-04T12:26:55.113 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-03-04T12:26:55.114 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-03-04T12:26:55.114 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-03-04T12:26:55.115 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-03-04T12:26:55.115 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-03-04T12:26:55.120 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (6 ms) 2024-03-04T12:26:55.121 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-03-04T12:26:55.126 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (5 ms) 2024-03-04T12:26:55.127 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-03-04T12:26:55.133 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-03-04T12:26:55.133 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-03-04T12:26:55.142 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (9 ms) 2024-03-04T12:26:55.142 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-03-04T12:26:55.144 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-03-04T12:26:55.144 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-03-04T12:26:55.146 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (2 ms) 2024-03-04T12:26:55.146 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-03-04T12:26:55.147 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-03-04T12:26:55.147 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-03-04T12:26:55.148 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-03-04T12:26:55.148 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-03-04T12:26:55.155 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-03-04T12:26:55.155 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 31 tests from CmpOmap (147 ms total) 2024-03-04T12:26:55.155 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:26:55.156 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:26:56.018 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 31 tests from 1 test suite ran. (2861 ms total) 2024-03-04T12:26:56.018 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 31 tests. 2024-03-04T12:26:56.021 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:26:56.021 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:26:56.107 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-03-04T12:26:56.108 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-03-04T12:26:56.109 DEBUG:teuthology.orchestra.run.smithi110:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-03-04T12:26:56.153 INFO:tasks.workunit.client.0.smithi110.stdout:Running main() from gmock_main.cc 2024-03-04T12:26:56.153 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-04T12:26:56.153 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:26:56.153 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 24 tests from TestCls2PCQueue 2024-03-04T12:26:56.153 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-03-04T12:26:59.037 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2885 ms) 2024-03-04T12:26:59.038 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-03-04T12:27:02.060 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3020 ms) 2024-03-04T12:27:02.060 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-03-04T12:27:05.060 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.Reserve (3003 ms) 2024-03-04T12:27:05.060 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-03-04T12:27:08.092 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3031 ms) 2024-03-04T12:27:08.092 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-03-04T12:27:11.104 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.Commit (3013 ms) 2024-03-04T12:27:11.104 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-03-04T12:27:14.130 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.Stats (3026 ms) 2024-03-04T12:27:14.130 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-03-04T12:27:18.151 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4021 ms) 2024-03-04T12:27:18.152 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-03-04T12:27:21.170 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.Abort (3019 ms) 2024-03-04T12:27:21.171 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-03-04T12:27:24.191 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.ReserveError (3020 ms) 2024-03-04T12:27:24.191 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-03-04T12:27:27.200 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.CommitError (3010 ms) 2024-03-04T12:27:27.201 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-03-04T12:27:30.216 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.AbortError (3015 ms) 2024-03-04T12:27:30.217 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-03-04T12:27:33.234 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3019 ms) 2024-03-04T12:27:33.234 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-03-04T12:27:36.259 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3025 ms) 2024-03-04T12:27:36.259 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-03-04T12:27:39.277 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3018 ms) 2024-03-04T12:27:39.278 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-03-04T12:27:42.288 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3010 ms) 2024-03-04T12:27:42.288 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-03-04T12:27:45.314 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3026 ms) 2024-03-04T12:27:45.315 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-03-04T12:27:48.338 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3024 ms) 2024-03-04T12:27:48.339 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-03-04T12:27:51.347 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.Cleanup (3009 ms) 2024-03-04T12:27:51.347 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-03-04T12:28:01.516 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10168 ms) 2024-03-04T12:28:01.516 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-03-04T12:28:04.532 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3016 ms) 2024-03-04T12:28:04.532 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-03-04T12:28:16.566 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (12034 ms) 2024-03-04T12:28:16.566 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-03-04T12:28:20.593 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4026 ms) 2024-03-04T12:28:20.593 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-03-04T12:28:26.621 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6029 ms) 2024-03-04T12:28:26.621 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-03-04T12:28:32.643 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (6023 ms) 2024-03-04T12:28:32.644 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 24 tests from TestCls2PCQueue (96491 ms total) 2024-03-04T12:28:32.644 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:28:32.644 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:28:32.644 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 24 tests from 1 test suite ran. (96491 ms total) 2024-03-04T12:28:32.644 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 24 tests. 2024-03-04T12:28:32.647 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:28:32.647 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:28:32.691 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-03-04T12:28:32.693 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-03-04T12:28:32.693 DEBUG:teuthology.orchestra.run.smithi110:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-03-04T12:28:32.783 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:28:32.783 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:28:32.784 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 6 tests from 1 test suite. 2024-03-04T12:28:32.784 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:28:34.656 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 6 tests from rgw_gc_log 2024-03-04T12:28:34.657 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-03-04T12:28:35.531 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] rgw_gc_log.init_existing_queue (875 ms) 2024-03-04T12:28:35.531 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-03-04T12:28:35.534 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2024-03-04T12:28:35.535 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-03-04T12:28:35.538 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2024-03-04T12:28:35.538 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-03-04T12:28:35.540 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2024-03-04T12:28:35.540 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-03-04T12:28:35.544 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-03-04T12:28:35.544 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-03-04T12:28:35.545 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-03-04T12:28:35.545 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 6 tests from rgw_gc_log (890 ms total) 2024-03-04T12:28:35.545 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:28:35.545 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:28:35.668 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 6 tests from 1 test suite ran. (2885 ms total) 2024-03-04T12:28:35.668 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 6 tests. 2024-03-04T12:28:35.672 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:28:35.673 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:28:35.715 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-03-04T12:28:35.716 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-03-04T12:28:35.716 DEBUG:teuthology.orchestra.run.smithi110:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-03-04T12:28:35.808 INFO:tasks.workunit.client.0.smithi110.stdout:Running main() from gmock_main.cc 2024-03-04T12:28:35.808 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 4 tests from 1 test suite. 2024-03-04T12:28:35.808 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:28:35.809 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 4 tests from TestRGWObj 2024-03-04T12:28:35.809 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestRGWObj.underscore 2024-03-04T12:28:35.809 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj 2024-03-04T12:28:35.809 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj 2024-03-04T12:28:35.809 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: _obj ns= i= 2024-03-04T12:28:35.809 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj 2024-03-04T12:28:35.809 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj 2024-03-04T12:28:35.809 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: _obj ns= i= 2024-03-04T12:28:35.809 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj 2024-03-04T12:28:35.809 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj 2024-03-04T12:28:35.809 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: _obj ns= i= 2024-03-04T12:28:35.809 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.809 INFO:tasks.workunit.client.0.smithi110.stdout: "obj1": { 2024-03-04T12:28:35.809 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.809 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.810 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.810 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.810 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.810 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.810 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.810 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.810 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.810 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.810 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.810 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.810 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_obj", 2024-03-04T12:28:35.810 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.810 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.810 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.810 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.811 INFO:tasks.workunit.client.0.smithi110.stdout: "obj2": { 2024-03-04T12:28:35.811 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.811 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.811 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.811 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.811 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.811 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.811 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.811 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.811 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.811 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.811 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.811 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.811 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_obj", 2024-03-04T12:28:35.811 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.812 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.812 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.812 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.812 INFO:tasks.workunit.client.0.smithi110.stdout: "obj3": { 2024-03-04T12:28:35.812 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.812 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.812 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.812 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.812 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.812 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.812 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.812 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.812 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.812 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.813 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.813 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.813 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_obj", 2024-03-04T12:28:35.813 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.813 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.813 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.813 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.813 INFO:tasks.workunit.client.0.smithi110.stdout: "obj3-2": { 2024-03-04T12:28:35.813 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.813 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.813 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.813 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.813 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.813 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.813 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.814 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.814 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.814 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.814 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.814 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.814 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_obj", 2024-03-04T12:28:35.814 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.814 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.814 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.814 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.814 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.814 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj 2024-03-04T12:28:35.814 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj 2024-03-04T12:28:35.814 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: _obj ns=ns i= 2024-03-04T12:28:35.814 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj 2024-03-04T12:28:35.815 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj 2024-03-04T12:28:35.815 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: _obj ns=ns i= 2024-03-04T12:28:35.815 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj 2024-03-04T12:28:35.815 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj 2024-03-04T12:28:35.815 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: _obj ns=ns i= 2024-03-04T12:28:35.815 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.815 INFO:tasks.workunit.client.0.smithi110.stdout: "obj1": { 2024-03-04T12:28:35.815 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.815 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.815 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.815 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.815 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.815 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.815 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.815 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.816 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.816 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.816 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.816 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.816 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_obj", 2024-03-04T12:28:35.816 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.816 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.816 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.816 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.816 INFO:tasks.workunit.client.0.smithi110.stdout: "obj2": { 2024-03-04T12:28:35.816 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.816 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.816 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.816 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.816 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.816 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.817 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.817 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.817 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.817 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.817 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.817 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.817 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_obj", 2024-03-04T12:28:35.817 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.817 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.817 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.817 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.817 INFO:tasks.workunit.client.0.smithi110.stdout: "obj3": { 2024-03-04T12:28:35.817 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.817 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.817 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.817 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_obj", 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: "obj3-2": { 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.818 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_obj", 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj[v1] 2024-03-04T12:28:35.819 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj[v1] 2024-03-04T12:28:35.820 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: _obj ns= i=v1 2024-03-04T12:28:35.820 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj[v1] 2024-03-04T12:28:35.820 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj[v1] 2024-03-04T12:28:35.820 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: _obj ns= i=v1 2024-03-04T12:28:35.820 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj[v1] 2024-03-04T12:28:35.820 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj[v1] 2024-03-04T12:28:35.820 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: _obj ns= i=v1 2024-03-04T12:28:35.820 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.820 INFO:tasks.workunit.client.0.smithi110.stdout: "obj1": { 2024-03-04T12:28:35.820 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.820 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.820 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.820 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.820 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.820 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.820 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.821 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.821 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.821 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.821 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.821 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.821 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_obj", 2024-03-04T12:28:35.821 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "v1", 2024-03-04T12:28:35.821 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.821 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.821 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.821 INFO:tasks.workunit.client.0.smithi110.stdout: "obj2": { 2024-03-04T12:28:35.821 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.821 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.821 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.821 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_obj", 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "v1", 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: "obj3": { 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.822 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.823 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.823 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.823 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.823 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.823 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.823 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.823 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.823 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.823 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.823 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_obj", 2024-03-04T12:28:35.823 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.823 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.823 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.823 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.824 INFO:tasks.workunit.client.0.smithi110.stdout: "obj3-2": { 2024-03-04T12:28:35.824 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.824 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.824 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.824 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.824 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.824 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.824 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.824 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.824 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.824 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.824 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.824 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.824 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_obj", 2024-03-04T12:28:35.824 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "v1", 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj[v1] 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj[v1] 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: _obj ns=ns i=v1 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj[v1] 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj[v1] 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: _obj ns=ns i=v1 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj[v1] 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: _obj[v1] 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: _obj ns=ns i=v1 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout: "obj1": { 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.825 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.826 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.826 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.826 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.826 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.826 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.826 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.826 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.826 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.826 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.826 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.826 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_obj", 2024-03-04T12:28:35.826 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "v1", 2024-03-04T12:28:35.826 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.826 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.826 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.826 INFO:tasks.workunit.client.0.smithi110.stdout: "obj2": { 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_obj", 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "v1", 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.827 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.828 INFO:tasks.workunit.client.0.smithi110.stdout: "obj3": { 2024-03-04T12:28:35.828 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.828 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.828 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.828 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.828 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.828 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.828 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.828 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.828 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.828 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.828 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.828 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.828 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_obj", 2024-03-04T12:28:35.828 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.828 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.829 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.829 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.829 INFO:tasks.workunit.client.0.smithi110.stdout: "obj3-2": { 2024-03-04T12:28:35.829 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.829 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.829 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.829 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.829 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.829 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.829 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.829 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.829 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.829 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.829 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.830 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.830 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_obj", 2024-03-04T12:28:35.830 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "v1", 2024-03-04T12:28:35.830 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.830 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.830 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.830 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.830 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-03-04T12:28:35.830 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestRGWObj.no_underscore 2024-03-04T12:28:35.830 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj 2024-03-04T12:28:35.830 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj 2024-03-04T12:28:35.830 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: obj ns= i= 2024-03-04T12:28:35.830 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj 2024-03-04T12:28:35.830 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj 2024-03-04T12:28:35.830 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: obj ns= i= 2024-03-04T12:28:35.831 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj 2024-03-04T12:28:35.831 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj 2024-03-04T12:28:35.831 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: obj ns= i= 2024-03-04T12:28:35.831 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.831 INFO:tasks.workunit.client.0.smithi110.stdout: "obj1": { 2024-03-04T12:28:35.831 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.831 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.831 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.831 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.831 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.831 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.831 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.831 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.831 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.831 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.831 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.832 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.832 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "obj", 2024-03-04T12:28:35.832 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.832 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.832 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.832 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.832 INFO:tasks.workunit.client.0.smithi110.stdout: "obj2": { 2024-03-04T12:28:35.832 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.832 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.832 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.832 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.832 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.832 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.833 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.833 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.833 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.833 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.833 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.833 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.833 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "obj", 2024-03-04T12:28:35.833 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.833 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.833 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.833 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.833 INFO:tasks.workunit.client.0.smithi110.stdout: "obj3": { 2024-03-04T12:28:35.833 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.833 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.834 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.834 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.834 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.834 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.834 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.834 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.834 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.834 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.834 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.834 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.834 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "obj", 2024-03-04T12:28:35.834 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.834 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.834 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.834 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.834 INFO:tasks.workunit.client.0.smithi110.stdout: "obj3-2": { 2024-03-04T12:28:35.835 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.835 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.835 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.835 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.835 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.835 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.835 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.835 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.835 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.835 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.835 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.835 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.835 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "obj", 2024-03-04T12:28:35.835 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.835 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.835 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.836 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.836 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.836 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj 2024-03-04T12:28:35.836 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj 2024-03-04T12:28:35.836 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: obj ns=ns i= 2024-03-04T12:28:35.836 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj 2024-03-04T12:28:35.836 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj 2024-03-04T12:28:35.836 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: obj ns=ns i= 2024-03-04T12:28:35.836 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj 2024-03-04T12:28:35.836 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj 2024-03-04T12:28:35.836 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: obj ns=ns i= 2024-03-04T12:28:35.836 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.836 INFO:tasks.workunit.client.0.smithi110.stdout: "obj1": { 2024-03-04T12:28:35.836 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.837 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.837 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.837 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.837 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.837 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.837 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.837 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.837 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.837 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.837 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.837 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.837 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "obj", 2024-03-04T12:28:35.837 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.837 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.837 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.837 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: "obj2": { 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "obj", 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.838 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: "obj3": { 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "obj", 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.839 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.840 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.840 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.840 INFO:tasks.workunit.client.0.smithi110.stdout: "obj3-2": { 2024-03-04T12:28:35.840 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.840 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.840 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.840 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.840 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.840 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.840 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.840 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.840 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.840 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.840 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.840 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "obj", 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj[v1] 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj[v1] 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: obj ns= i=v1 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj[v1] 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj[v1] 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: obj ns= i=v1 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj[v1] 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj[v1] 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: obj ns= i=v1 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.841 INFO:tasks.workunit.client.0.smithi110.stdout: "obj1": { 2024-03-04T12:28:35.842 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.842 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.842 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.842 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.842 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.842 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.842 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.842 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.842 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.842 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.842 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.842 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.842 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "obj", 2024-03-04T12:28:35.842 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "v1", 2024-03-04T12:28:35.842 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: "obj2": { 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "obj", 2024-03-04T12:28:35.843 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "v1", 2024-03-04T12:28:35.844 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.844 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.844 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.844 INFO:tasks.workunit.client.0.smithi110.stdout: "obj3": { 2024-03-04T12:28:35.844 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.844 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.844 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.844 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.844 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.844 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.844 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.844 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.844 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.844 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.844 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.845 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.845 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "obj", 2024-03-04T12:28:35.845 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.845 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.845 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.845 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.845 INFO:tasks.workunit.client.0.smithi110.stdout: "obj3-2": { 2024-03-04T12:28:35.845 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.845 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.845 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.845 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.845 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.845 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.845 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.845 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "obj", 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "v1", 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj[v1] 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj[v1] 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: obj ns=ns i=v1 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj[v1] 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj[v1] 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: obj ns=ns i=v1 2024-03-04T12:28:35.846 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj[v1] 2024-03-04T12:28:35.847 INFO:tasks.workunit.client.0.smithi110.stdout:parsed: obj[v1] 2024-03-04T12:28:35.847 INFO:tasks.workunit.client.0.smithi110.stdout:stripped: obj ns=ns i=v1 2024-03-04T12:28:35.847 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.847 INFO:tasks.workunit.client.0.smithi110.stdout: "obj1": { 2024-03-04T12:28:35.847 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.847 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.847 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.847 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.847 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.847 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.847 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.847 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.847 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.847 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.848 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.848 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.848 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "obj", 2024-03-04T12:28:35.848 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "v1", 2024-03-04T12:28:35.848 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.848 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.848 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.848 INFO:tasks.workunit.client.0.smithi110.stdout: "obj2": { 2024-03-04T12:28:35.848 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.848 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.848 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.848 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.848 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.848 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.849 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.849 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.849 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.849 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.849 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.849 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.849 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "obj", 2024-03-04T12:28:35.849 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "v1", 2024-03-04T12:28:35.849 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.849 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.849 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.849 INFO:tasks.workunit.client.0.smithi110.stdout: "obj3": { 2024-03-04T12:28:35.849 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.849 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.850 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.850 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.850 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.850 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.850 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.850 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.850 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.850 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.850 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.850 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.850 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "obj", 2024-03-04T12:28:35.850 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.850 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.850 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.850 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.850 INFO:tasks.workunit.client.0.smithi110.stdout: "obj3-2": { 2024-03-04T12:28:35.851 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.851 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.851 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.851 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.851 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.851 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.851 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.851 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.851 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.851 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.851 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.851 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.851 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "obj", 2024-03-04T12:28:35.851 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "v1", 2024-03-04T12:28:35.851 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.852 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.852 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.852 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.852 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-03-04T12:28:35.852 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-03-04T12:28:35.852 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.852 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.852 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.852 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.852 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.852 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.852 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.852 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.852 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.853 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.853 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.853 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.853 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.853 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.853 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.853 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.853 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.853 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.853 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.853 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.853 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.853 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.853 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.853 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.854 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.854 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.854 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.854 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.854 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.854 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.854 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.854 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.854 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.854 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.854 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.854 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": "default-placement.data", 2024-03-04T12:28:35.854 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker_myobj", 2024-03-04T12:28:35.854 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.854 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.855 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.855 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.855 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.855 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.855 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.855 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.855 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.855 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.855 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.855 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.855 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.855 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.855 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.855 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.856 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.856 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.856 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.856 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.856 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.856 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.856 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.856 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.857 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.857 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.857 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.857 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.857 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.857 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.857 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.857 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.857 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.857 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.857 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.857 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.857 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.857 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.858 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.858 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.858 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.858 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.858 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.858 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.858 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.858 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.858 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.858 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.858 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.858 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.858 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.858 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.858 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.859 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.859 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.859 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.859 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.859 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.859 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.859 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker_myobj", 2024-03-04T12:28:35.859 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.859 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.859 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.859 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.859 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.859 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.859 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.859 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.860 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.860 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.860 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.860 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.860 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.860 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.860 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.860 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.860 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.860 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.860 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.860 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.860 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.860 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.861 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.861 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.861 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.861 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.861 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.861 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.861 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.861 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.861 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.861 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.861 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.861 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.861 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.861 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.862 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.862 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.862 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.862 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.862 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.862 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.862 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.862 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.862 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.862 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.862 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.862 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.862 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.862 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.863 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.863 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.863 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.863 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.863 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.863 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.863 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.863 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.863 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": "default-placement.data", 2024-03-04T12:28:35.863 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns_myobj", 2024-03-04T12:28:35.863 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.863 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.863 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.863 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.863 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.864 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.864 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.864 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.864 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.864 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.864 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.864 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.864 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.864 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.864 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.864 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.864 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.864 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.864 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.865 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.865 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.865 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.865 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.865 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.865 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.865 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.865 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.865 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.865 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.865 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.865 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.865 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.865 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.865 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.866 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.866 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.866 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.866 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.866 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.866 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.866 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.866 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.866 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.866 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.866 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.866 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.866 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.866 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.866 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.867 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.867 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.867 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.867 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.867 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.867 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.867 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.867 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.867 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.867 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.867 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns_myobj", 2024-03-04T12:28:35.867 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.867 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.867 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.867 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.867 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.868 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.868 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.868 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.868 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.868 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.868 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.868 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.868 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.868 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.868 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.868 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.868 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.868 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.868 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.869 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.869 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.869 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.869 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.869 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.869 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.869 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.869 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.869 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.869 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.869 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.869 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.869 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.869 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.869 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.870 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.870 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.870 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.870 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.870 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.870 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.870 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.870 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.870 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.870 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.870 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.870 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.870 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.870 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.870 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.871 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.871 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.871 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.871 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.871 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.871 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.871 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.871 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.871 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.871 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": "default-placement.data", 2024-03-04T12:28:35.871 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__:inst_myobj", 2024-03-04T12:28:35.871 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.871 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.871 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.871 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.872 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.872 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.872 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.872 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.872 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.872 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.872 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.872 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.872 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.872 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.872 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.872 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.872 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.872 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.872 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.873 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.873 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.873 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.873 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.873 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.873 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.873 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.873 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.873 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.873 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.873 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.873 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.873 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.873 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.873 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.874 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.874 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.874 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.874 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.874 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.874 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.874 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.874 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.874 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.874 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.874 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.874 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.874 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.874 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.874 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.875 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.875 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.875 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.875 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.875 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.875 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.875 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.875 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.875 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.875 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.875 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__:inst_myobj", 2024-03-04T12:28:35.875 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.875 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.875 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.875 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.876 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.876 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.876 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.876 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.876 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.876 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.876 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.876 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.876 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.876 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.876 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.876 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.876 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.876 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.877 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.877 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.877 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.877 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.877 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.877 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.877 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.877 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.877 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.877 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.877 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.877 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.877 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.877 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.878 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.878 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.878 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.878 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.878 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.878 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.878 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.878 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.878 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.878 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.878 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.878 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.878 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.878 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.878 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.878 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.879 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.879 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.879 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.879 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.879 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.879 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.879 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.879 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.879 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.879 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.879 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": "default-placement.data", 2024-03-04T12:28:35.879 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns:inst_myobj", 2024-03-04T12:28:35.879 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.879 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.879 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.880 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.880 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.880 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.880 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.880 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.880 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.880 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.880 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.880 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.880 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.880 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.880 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.880 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.881 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.881 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.881 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.881 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.881 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.881 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.881 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.881 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.881 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.881 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.881 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.881 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.881 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.881 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.882 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.882 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.882 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.882 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.882 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.882 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.882 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.882 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.882 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.882 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.882 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.882 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.882 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.882 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.882 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.883 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.883 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.883 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.883 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.883 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.883 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.883 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.883 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.883 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.883 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.883 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.883 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.883 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.883 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.884 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns:inst_myobj", 2024-03-04T12:28:35.884 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.884 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.884 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.884 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.884 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.884 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.884 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.884 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.884 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.884 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.884 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.884 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.884 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.885 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.885 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.885 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.885 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.885 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.885 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.885 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.885 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.885 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.885 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.885 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.885 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.885 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.885 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.885 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.886 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.886 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.886 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.886 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.886 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.886 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.886 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.886 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.886 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.886 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.886 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.886 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.886 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.886 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.886 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.887 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.887 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.887 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.887 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.887 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.887 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.887 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.887 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.887 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.887 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.887 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.887 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.887 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.887 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.888 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.888 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": "default-placement.data", 2024-03-04T12:28:35.888 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker___myobj", 2024-03-04T12:28:35.888 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "marker__myobj" 2024-03-04T12:28:35.888 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.888 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.888 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.888 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.888 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.888 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.888 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.888 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.888 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.888 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.889 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.889 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.889 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.889 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.889 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.889 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.889 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.889 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.889 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.889 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.889 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.889 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.889 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.889 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.889 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.890 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.890 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.890 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.890 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.890 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.890 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.890 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.890 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.890 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.890 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.890 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.890 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.890 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.890 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.890 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.890 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.891 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.891 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.891 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.891 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.891 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.891 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.891 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.891 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.891 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.891 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.891 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.891 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.891 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.891 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.891 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.892 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.892 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.892 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker___myobj", 2024-03-04T12:28:35.892 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "marker__myobj" 2024-03-04T12:28:35.892 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.892 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.892 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.892 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.892 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.892 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.892 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.892 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.892 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.892 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.893 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.893 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.893 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.893 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.893 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.893 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.893 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.893 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.893 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.893 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.893 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.893 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.893 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.893 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.893 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.893 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.894 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.894 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.894 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.894 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.894 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.894 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.894 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.894 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.894 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.894 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.894 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.894 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.894 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.894 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.894 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.895 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.895 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.895 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.895 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.895 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.895 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.895 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.895 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.895 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.895 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.895 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.895 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.895 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.895 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.895 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.896 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.896 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": "default-placement.data", 2024-03-04T12:28:35.896 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns__myobj", 2024-03-04T12:28:35.896 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.896 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.896 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.896 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.896 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.896 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.896 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.896 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.896 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.896 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.896 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.897 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.897 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.897 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.897 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.897 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.897 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.897 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.897 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.897 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.897 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.897 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.897 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.897 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.897 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.897 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.897 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.898 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.898 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.898 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.898 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.898 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.898 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.898 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.898 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.898 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.898 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.898 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.898 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.898 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.898 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.899 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.899 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.899 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.899 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.899 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.899 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.899 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.899 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.899 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.899 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.899 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.899 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.899 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.899 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.899 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.899 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.900 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.900 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.900 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns__myobj", 2024-03-04T12:28:35.900 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.900 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.900 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.900 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.900 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.900 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.900 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.900 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.900 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.900 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.900 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.901 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.901 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.901 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.901 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.901 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.901 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.901 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.901 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.901 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.901 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.901 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.901 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.901 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.901 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.901 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.902 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.902 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.902 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.902 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.902 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.902 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.902 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.902 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.902 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.902 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.902 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.902 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.902 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.902 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.903 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.903 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.903 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.903 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.903 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.903 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.903 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.903 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.903 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.903 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.903 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.903 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.903 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.903 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.903 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.904 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.904 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.904 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.904 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": "default-placement.data", 2024-03-04T12:28:35.904 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__:inst__myobj", 2024-03-04T12:28:35.904 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "marker__myobj" 2024-03-04T12:28:35.904 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.904 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.904 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.904 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.904 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.904 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.904 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.905 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.905 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.905 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.905 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.905 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.905 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.905 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.905 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.905 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.905 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.905 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.905 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.905 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.905 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.905 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.906 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.906 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.906 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.906 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.906 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.906 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.906 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.906 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.906 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.906 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.906 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.906 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.906 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.906 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.907 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.907 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.907 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.907 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.907 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.907 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.907 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.907 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.907 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.907 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.907 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.907 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.907 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.907 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.908 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.908 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.908 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.908 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.908 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.908 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.908 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.908 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.908 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__:inst__myobj", 2024-03-04T12:28:35.908 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "marker__myobj" 2024-03-04T12:28:35.908 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.908 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.908 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.908 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.909 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.909 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.909 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.909 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.909 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.909 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.909 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.909 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.909 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.909 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.909 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.909 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.909 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.909 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.909 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.910 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.911 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.912 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.912 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.912 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.912 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.912 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": "default-placement.data", 2024-03-04T12:28:35.912 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns:inst__myobj", 2024-03-04T12:28:35.912 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.912 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.912 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.912 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.912 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.912 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.912 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.912 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.913 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.913 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.913 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.913 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.913 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.913 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.913 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.913 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.913 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.913 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.913 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.913 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.913 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.913 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.913 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.914 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.914 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.914 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.914 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.914 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.914 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.914 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.914 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.914 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.914 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.914 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.914 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.914 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.914 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.914 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.915 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.915 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.915 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.915 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.915 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.915 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.915 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.915 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.915 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.915 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.915 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.915 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.915 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.915 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.915 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.915 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.916 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.916 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.916 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.916 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.916 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.916 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns:inst__myobj", 2024-03-04T12:28:35.916 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.916 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.916 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.916 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.916 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.916 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.916 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.916 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.917 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.917 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.917 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.917 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.917 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.917 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.917 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.917 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.917 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.917 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.917 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.917 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.917 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.917 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.917 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.918 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.918 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.918 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.918 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.918 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.918 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.918 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.918 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.918 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.918 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.918 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.918 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.918 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.918 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.918 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.918 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.919 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.919 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.919 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.919 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.919 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.919 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.919 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.919 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.919 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.919 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.919 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.919 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.919 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.919 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.919 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.920 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.920 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.920 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.920 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.920 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": "default-placement.data", 2024-03-04T12:28:35.920 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker___myobj_", 2024-03-04T12:28:35.920 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "marker__myobj_" 2024-03-04T12:28:35.920 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.920 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.920 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.920 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.920 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.920 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.920 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.921 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.921 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.921 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.921 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.921 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.921 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.921 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.921 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.921 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.921 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.921 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.921 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.921 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.921 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.921 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.921 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.922 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.923 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.923 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.923 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.923 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.923 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.923 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.923 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.923 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.923 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.923 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.923 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.923 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.923 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.923 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.923 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.924 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.924 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.924 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.924 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker___myobj_", 2024-03-04T12:28:35.924 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "marker__myobj_" 2024-03-04T12:28:35.924 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.924 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.924 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.924 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.924 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.924 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.924 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.924 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.924 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.924 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.925 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.926 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.926 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.926 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.926 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.926 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.926 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.926 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.926 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.926 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.926 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.926 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.926 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.926 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.926 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.926 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.926 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": "default-placement.data", 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns__myobj_", 2024-03-04T12:28:35.927 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.928 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.928 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.928 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.928 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.928 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.928 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.928 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.928 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.928 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.928 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.928 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.928 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.928 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.928 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.929 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.930 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.931 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.931 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.931 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.931 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.931 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.931 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.931 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.931 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.931 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.931 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.931 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns__myobj_", 2024-03-04T12:28:35.931 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.931 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.931 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.931 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.931 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.932 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.932 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.932 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.932 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.932 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.932 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.932 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.932 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.932 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.932 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.932 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.932 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.932 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.932 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.933 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.933 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.933 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.933 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.933 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.933 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.933 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.933 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.933 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.933 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.933 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.933 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.933 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.933 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.933 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.934 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.935 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.935 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.935 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.935 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.935 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.935 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.935 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.935 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": "default-placement.data", 2024-03-04T12:28:35.935 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__:inst__myobj_", 2024-03-04T12:28:35.935 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "marker__myobj_" 2024-03-04T12:28:35.935 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.935 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.935 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.935 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.935 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.936 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.936 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.936 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.936 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.936 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.936 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.936 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.936 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.936 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.936 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.936 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.936 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.936 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.936 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.936 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.937 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.937 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.937 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.937 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.937 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.937 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.937 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.937 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.937 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.937 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.937 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.937 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.937 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.937 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.937 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.938 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.938 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.938 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.938 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.938 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.938 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.938 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.938 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.938 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.938 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.938 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.938 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.938 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.938 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.938 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.938 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__:inst__myobj_", 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "marker__myobj_" 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.939 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.940 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.940 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.940 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.940 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.940 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.940 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.940 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.940 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.940 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.940 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.940 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.940 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.940 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.940 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.940 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.941 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.942 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.942 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.942 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.942 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.942 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.942 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.942 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.942 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.942 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.942 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.942 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.942 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.942 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.942 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.942 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.942 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.943 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.943 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": "default-placement.data", 2024-03-04T12:28:35.943 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-04T12:28:35.943 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.943 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.943 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.943 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.943 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.943 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.943 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "test", 2024-03-04T12:28:35.943 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.943 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.943 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.943 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.943 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": "", 2024-03-04T12:28:35.943 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.944 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": "" 2024-03-04T12:28:35.944 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.944 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.944 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.944 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.944 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.944 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.944 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.944 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.944 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.944 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.944 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.944 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.944 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.944 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.944 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.945 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.945 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.945 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.945 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.945 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.945 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.945 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.945 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.945 INFO:tasks.workunit.client.0.smithi110.stdout: "obj": { 2024-03-04T12:28:35.945 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.945 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.945 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.945 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.945 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.945 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.946 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.946 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.946 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.946 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.946 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.946 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.946 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.946 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.946 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.946 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.946 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.946 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.946 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.946 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.946 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.946 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.947 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.948 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.948 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.948 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.948 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.948 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.948 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.948 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-03-04T12:28:35.948 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-03-04T12:28:35.948 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.948 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.948 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.948 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker_myobj", 2024-03-04T12:28:35.948 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.948 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.948 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.949 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.950 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.950 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.950 INFO:tasks.workunit.client.0.smithi110.stdout:raw=.data-pool:marker_myobj 2024-03-04T12:28:35.950 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.950 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj2": { 2024-03-04T12:28:35.950 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.950 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker_myobj", 2024-03-04T12:28:35.950 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.950 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.950 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.950 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.950 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj2": { 2024-03-04T12:28:35.950 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.950 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.950 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout:raw2=.data-pool:marker_myobj 2024-03-04T12:28:35.951 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns_myobj", 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.952 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout:raw=.data-pool:marker__ns_myobj 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj2": { 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns_myobj", 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.953 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.954 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.954 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj2": { 2024-03-04T12:28:35.954 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.954 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.954 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.954 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.954 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.954 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.954 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.954 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.954 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.954 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.954 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.954 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.954 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.955 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.955 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.955 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.955 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.955 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.955 INFO:tasks.workunit.client.0.smithi110.stdout:raw2=.data-pool:marker__ns_myobj 2024-03-04T12:28:35.955 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.955 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.955 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.955 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__:inst_myobj", 2024-03-04T12:28:35.955 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.955 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.955 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.955 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.955 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.955 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.956 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.956 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.956 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.956 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.956 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.956 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.956 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.956 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.956 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.956 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.956 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.956 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.956 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.956 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.957 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.957 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.957 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.957 INFO:tasks.workunit.client.0.smithi110.stdout:raw=.data-pool:marker__:inst_myobj 2024-03-04T12:28:35.957 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.957 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj2": { 2024-03-04T12:28:35.957 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.957 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__:inst_myobj", 2024-03-04T12:28:35.957 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.957 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.957 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.957 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.957 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj2": { 2024-03-04T12:28:35.957 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.957 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.957 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.958 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.958 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.958 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.958 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.958 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.958 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.958 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.958 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.958 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.958 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.958 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.958 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.958 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.958 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.958 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.958 INFO:tasks.workunit.client.0.smithi110.stdout:raw2=.data-pool:marker__:inst_myobj 2024-03-04T12:28:35.959 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.959 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.959 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.959 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns:inst_myobj", 2024-03-04T12:28:35.959 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.959 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.959 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.959 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.959 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.959 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.959 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.959 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.959 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.959 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.959 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.960 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.960 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.960 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.960 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.960 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.960 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.960 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.960 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.960 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.960 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.960 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.960 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.960 INFO:tasks.workunit.client.0.smithi110.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-03-04T12:28:35.960 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.960 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj2": { 2024-03-04T12:28:35.961 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.961 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns:inst_myobj", 2024-03-04T12:28:35.961 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.961 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.961 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.961 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.961 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj2": { 2024-03-04T12:28:35.961 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.961 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.961 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.961 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.961 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.961 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.961 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.961 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.962 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.962 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.962 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.962 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.962 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "myobj", 2024-03-04T12:28:35.962 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.962 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.962 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.962 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.962 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.962 INFO:tasks.workunit.client.0.smithi110.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-03-04T12:28:35.962 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.962 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.962 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.962 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker___myobj", 2024-03-04T12:28:35.962 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "marker__myobj" 2024-03-04T12:28:35.963 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.963 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.963 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.963 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.963 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.963 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.963 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.963 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.963 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.963 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.963 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.963 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.963 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.963 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.963 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.964 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.964 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.964 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.964 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.964 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.964 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.964 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.964 INFO:tasks.workunit.client.0.smithi110.stdout:raw=.data-pool:marker___myobj 2024-03-04T12:28:35.964 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.964 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj2": { 2024-03-04T12:28:35.964 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.964 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker___myobj", 2024-03-04T12:28:35.964 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "marker__myobj" 2024-03-04T12:28:35.964 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.964 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.964 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj2": { 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.965 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.966 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.966 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.966 INFO:tasks.workunit.client.0.smithi110.stdout:raw2=.data-pool:marker___myobj 2024-03-04T12:28:35.966 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.966 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.966 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.966 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns__myobj", 2024-03-04T12:28:35.966 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.966 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.966 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.966 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.966 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.966 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.966 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.966 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.966 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.967 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.967 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.967 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.967 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.967 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.967 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.967 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.967 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.967 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.967 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.967 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.967 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.967 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.967 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.968 INFO:tasks.workunit.client.0.smithi110.stdout:raw=.data-pool:marker__ns__myobj 2024-03-04T12:28:35.968 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.968 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj2": { 2024-03-04T12:28:35.968 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.968 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns__myobj", 2024-03-04T12:28:35.968 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.968 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.968 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.968 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.968 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj2": { 2024-03-04T12:28:35.968 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.968 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.968 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.968 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.968 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout:raw2=.data-pool:marker__ns__myobj 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.969 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.970 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__:inst__myobj", 2024-03-04T12:28:35.970 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "marker__myobj" 2024-03-04T12:28:35.970 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.970 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.970 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.970 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.970 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.970 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.970 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.970 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.970 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.970 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.970 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.970 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.970 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.970 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout:raw=.data-pool:marker__:inst__myobj 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj2": { 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__:inst__myobj", 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "marker__myobj" 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.971 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj2": { 2024-03-04T12:28:35.972 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.972 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.972 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.972 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.972 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.972 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.972 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.972 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.972 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.972 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.972 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.972 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.972 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.972 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout:raw2=.data-pool:marker__:inst__myobj 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns:inst__myobj", 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.973 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-03-04T12:28:35.974 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.975 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj2": { 2024-03-04T12:28:35.975 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.975 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns:inst__myobj", 2024-03-04T12:28:35.975 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.975 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.975 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.975 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.975 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj2": { 2024-03-04T12:28:35.975 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.975 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.975 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.975 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.975 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.975 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.975 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.975 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.976 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.976 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.976 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.976 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.976 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj", 2024-03-04T12:28:35.976 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.976 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.976 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.976 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.976 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.976 INFO:tasks.workunit.client.0.smithi110.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-03-04T12:28:35.976 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.976 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.976 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.976 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker___myobj_", 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "marker__myobj_" 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.977 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.978 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.978 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.978 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.978 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.978 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.978 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.978 INFO:tasks.workunit.client.0.smithi110.stdout:raw=.data-pool:marker___myobj_ 2024-03-04T12:28:35.978 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.978 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj2": { 2024-03-04T12:28:35.978 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.978 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker___myobj_", 2024-03-04T12:28:35.978 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "marker__myobj_" 2024-03-04T12:28:35.978 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.978 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.978 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.978 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj2": { 2024-03-04T12:28:35.979 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.979 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.979 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.979 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.979 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.979 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.979 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.979 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.979 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.979 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.979 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.979 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.979 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.979 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.979 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.979 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.980 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.980 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.980 INFO:tasks.workunit.client.0.smithi110.stdout:raw2=.data-pool:marker___myobj_ 2024-03-04T12:28:35.980 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.980 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.980 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.980 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns__myobj_", 2024-03-04T12:28:35.980 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.980 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.980 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.980 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.980 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.980 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.980 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.980 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.980 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.981 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.981 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.981 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.981 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.981 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.981 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.981 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.981 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.981 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.981 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.981 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.981 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.981 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.981 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.981 INFO:tasks.workunit.client.0.smithi110.stdout:raw=.data-pool:marker__ns__myobj_ 2024-03-04T12:28:35.981 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.982 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj2": { 2024-03-04T12:28:35.982 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.982 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns__myobj_", 2024-03-04T12:28:35.982 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.982 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.982 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.982 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.982 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj2": { 2024-03-04T12:28:35.982 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.982 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.982 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.982 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.982 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.982 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.982 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.983 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.983 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.983 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.983 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.983 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.983 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.983 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "", 2024-03-04T12:28:35.983 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.983 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.983 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.983 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.983 INFO:tasks.workunit.client.0.smithi110.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-03-04T12:28:35.983 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.983 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.983 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.983 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__:inst__myobj_", 2024-03-04T12:28:35.984 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "marker__myobj_" 2024-03-04T12:28:35.984 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.984 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.984 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.984 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.984 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.984 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.984 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.984 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.984 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.984 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.984 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.984 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.984 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.984 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj2": { 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__:inst__myobj_", 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "marker__myobj_" 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.985 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.986 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj2": { 2024-03-04T12:28:35.986 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.986 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.986 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.986 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.986 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.986 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.986 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.986 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.986 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.986 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.986 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.986 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.986 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.986 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.987 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "" 2024-03-04T12:28:35.987 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.987 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.987 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.987 INFO:tasks.workunit.client.0.smithi110.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-03-04T12:28:35.987 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.987 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj": { 2024-03-04T12:28:35.987 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.987 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-04T12:28:35.987 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.987 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.987 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.987 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.987 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj": { 2024-03-04T12:28:35.987 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.987 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.988 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.988 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.988 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.988 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.988 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.988 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.988 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.988 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.988 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.988 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.988 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.988 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.988 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.988 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.988 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout: "raw_obj2": { 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout: "pool": ".data-pool", 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout: "loc": "" 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout: "new_obj2": { 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket": { 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "ebtest", 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout: "marker": "marker", 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_id": "bucket-id", 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout: "tenant": "", 2024-03-04T12:28:35.989 INFO:tasks.workunit.client.0.smithi110.stdout: "explicit_placement": { 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout: "data_pool": ".data-pool", 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout: "data_extra_pool": "", 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout: "index_pool": ".index-pool" 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout: "key": { 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout: "name": "_myobj_", 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout: "instance": "inst", 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout: "ns": "ns" 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:28:35.990 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:28:35.991 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-03-04T12:28:35.991 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 4 tests. 2024-03-04T12:28:35.991 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:28:35.991 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:28:36.032 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-03-04T12:28:36.033 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-03-04T12:28:36.033 DEBUG:teuthology.orchestra.run.smithi110:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-03-04T12:28:36.144 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:28:36.144 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:28:36.187 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.178+0000 7ff292630800 20 rados->read ofs=0 len=0 2024-03-04T12:28:36.187 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.179+0000 7ff292630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:36.188 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.179+0000 7ff292630800 20 realm 2024-03-04T12:28:36.188 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.179+0000 7ff292630800 20 rados->read ofs=0 len=0 2024-03-04T12:28:36.188 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.180+0000 7ff292630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:36.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.180+0000 7ff292630800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:28:36.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.180+0000 7ff292630800 20 rados->read ofs=0 len=0 2024-03-04T12:28:36.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.180+0000 7ff292630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:36.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.180+0000 7ff292630800 20 rados->read ofs=0 len=0 2024-03-04T12:28:36.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.181+0000 7ff292630800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:28:36.190 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.181+0000 7ff292630800 20 rados->read ofs=0 len=0 2024-03-04T12:28:36.190 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.181+0000 7ff292630800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:28:36.190 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.181+0000 7ff292630800 20 searching for the correct realm 2024-03-04T12:28:36.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.189+0000 7ff28d12f640 0 -- 172.21.15.110:0/1767286817 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7ff28004b040 msgr2=0x7ff28004a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:28:36.401 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.392+0000 7ff28d12f640 0 -- 172.21.15.110:0/1767286817 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7ff158077290 msgr2=0x7ff1580796c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:28:36.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.397+0000 7ff292630800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:28:36.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.397+0000 7ff292630800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:28:36.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.397+0000 7ff292630800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:28:36.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.397+0000 7ff292630800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:28:36.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.397+0000 7ff292630800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:28:36.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.397+0000 7ff292630800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:28:36.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.397+0000 7ff292630800 20 rados->read ofs=0 len=0 2024-03-04T12:28:36.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.397+0000 7ff292630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:36.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.397+0000 7ff292630800 20 rados->read ofs=0 len=0 2024-03-04T12:28:36.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.398+0000 7ff292630800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:28:36.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.398+0000 7ff292630800 20 rados->read ofs=0 len=0 2024-03-04T12:28:36.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.398+0000 7ff292630800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:28:36.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.398+0000 7ff292630800 20 zone default found 2024-03-04T12:28:36.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.398+0000 7ff292630800 4 Realm: () 2024-03-04T12:28:36.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.398+0000 7ff292630800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:28:36.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.398+0000 7ff292630800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:28:36.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.398+0000 7ff292630800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:28:36.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.398+0000 7ff292630800 20 zonegroup default 2024-03-04T12:28:36.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.398+0000 7ff292630800 20 rados->read ofs=0 len=0 2024-03-04T12:28:36.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.399+0000 7ff292630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:36.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.399+0000 7ff292630800 20 rados->read ofs=0 len=0 2024-03-04T12:28:36.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.399+0000 7ff292630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:36.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.399+0000 7ff292630800 20 rados->read ofs=0 len=0 2024-03-04T12:28:36.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.399+0000 7ff292630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:36.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.399+0000 7ff292630800 20 started sync module instance, tier type = 2024-03-04T12:28:36.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.399+0000 7ff292630800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:28:36.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.409+0000 7ff292630800 20 add_watcher() i=0 2024-03-04T12:28:36.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.409+0000 7ff292630800 20 add_watcher() i=1 2024-03-04T12:28:36.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.409+0000 7ff292630800 20 add_watcher() i=2 2024-03-04T12:28:36.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.409+0000 7ff292630800 20 add_watcher() i=3 2024-03-04T12:28:36.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.409+0000 7ff292630800 20 add_watcher() i=4 2024-03-04T12:28:36.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.409+0000 7ff292630800 20 add_watcher() i=5 2024-03-04T12:28:36.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.409+0000 7ff292630800 20 add_watcher() i=6 2024-03-04T12:28:36.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.410+0000 7ff292630800 20 add_watcher() i=7 2024-03-04T12:28:36.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.410+0000 7ff292630800 2 all 8 watchers are set, enabling cache 2024-03-04T12:28:36.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.413+0000 7ff13f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:28:36.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.413+0000 7ff292630800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:28:36.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.413+0000 7ff292630800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:28:36.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.413+0000 7ff292630800 5 note: GC not initialized 2024-03-04T12:28:36.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.414+0000 7ff13e7fc640 20 reqs_thread_entry: start 2024-03-04T12:28:36.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.414+0000 7ff292630800 20 init_complete bucket index max shards: 11 2024-03-04T12:28:36.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.414+0000 7ff292630800 20 Filter name: none 2024-03-04T12:28:36.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.414+0000 7ff0affff640 20 reqs_thread_entry: start 2024-03-04T12:28:36.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.414+0000 7ff292630800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-03-04T12:28:36.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.414+0000 7ff292630800 20 rados->read ofs=0 len=0 2024-03-04T12:28:36.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.414+0000 7ff292630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:36.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.414+0000 7ff292630800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-03-04T12:28:36.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.414+0000 7ff292630800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-03-04T12:28:36.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.414+0000 7ff292630800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-03-04T12:28:36.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.414+0000 7ff292630800 20 rados->read ofs=0 len=0 2024-03-04T12:28:36.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.415+0000 7ff292630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:36.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.415+0000 7ff292630800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-03-04T12:28:36.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.415+0000 7ff292630800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-03-04T12:28:36.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.415+0000 7ff292630800 10 cache get: name=default.rgw.meta+users.keys+MKridRh/cxcxpZFH1i0QmoQ1/1g= : miss 2024-03-04T12:28:36.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.415+0000 7ff292630800 20 rados->read ofs=0 len=0 2024-03-04T12:28:36.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.415+0000 7ff292630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:36.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.415+0000 7ff292630800 10 cache put: name=default.rgw.meta+users.keys+MKridRh/cxcxpZFH1i0QmoQ1/1g= info.flags=0x0 2024-03-04T12:28:36.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.415+0000 7ff292630800 10 adding default.rgw.meta+users.keys+MKridRh/cxcxpZFH1i0QmoQ1/1g= to cache LRU end 2024-03-04T12:28:36.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.415+0000 7ff292630800 10 cache get: name=default.rgw.meta+users.keys+MKridRh/cxcxpZFH1i0QmoQ1/1g= : hit (negative entry) 2024-03-04T12:28:36.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.415+0000 7ff292630800 10 cache get: name=default.rgw.meta+users.keys+MKridRh/cxcxpZFH1i0QmoQ1/1g= : hit (negative entry) 2024-03-04T12:28:36.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.416+0000 7ff292630800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-03-04T12:28:36.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.416+0000 7ff292630800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-03-04T12:28:36.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.416+0000 7ff292630800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-03-04T12:28:36.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.417+0000 7ff1717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1035087118338 cookie 94525100543552 notifier 5258 bl.length()=664 2024-03-04T12:28:36.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.417+0000 7ff1717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-03-04T12:28:36.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.417+0000 7ff1717fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-03-04T12:28:36.428 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.420+0000 7ff292630800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-03-04T12:28:36.428 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.420+0000 7ff292630800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-03-04T12:28:36.428 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.420+0000 7ff292630800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-03-04T12:28:36.429 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.420+0000 7ff170ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1035087118336 cookie 94525100542016 notifier 5258 bl.length()=194 2024-03-04T12:28:36.429 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.420+0000 7ff170ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-03-04T12:28:36.429 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.420+0000 7ff170ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-03-04T12:28:36.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.425+0000 7ff292630800 10 cache put: name=default.rgw.meta+users.keys+MKridRh/cxcxpZFH1i0QmoQ1/1g= info.flags=0x7 2024-03-04T12:28:36.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.425+0000 7ff292630800 10 moving default.rgw.meta+users.keys+MKridRh/cxcxpZFH1i0QmoQ1/1g= to cache LRU end 2024-03-04T12:28:36.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.425+0000 7ff292630800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MKridRh/cxcxpZFH1i0QmoQ1/1g=, ofs0, ns] 2024-03-04T12:28:36.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.425+0000 7ff170ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1035087118339 cookie 94525100543552 notifier 5258 bl.length()=203 2024-03-04T12:28:36.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.425+0000 7ff170ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MKridRh/cxcxpZFH1i0QmoQ1/1g= info.flags=0x7 2024-03-04T12:28:36.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.425+0000 7ff170ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MKridRh/cxcxpZFH1i0QmoQ1/1g= to cache LRU end 2024-03-04T12:28:36.435 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:36.435 INFO:tasks.workunit.client.0.smithi110.stdout: "user_id": "ceph-test-librgw-file", 2024-03-04T12:28:36.435 INFO:tasks.workunit.client.0.smithi110.stdout: "display_name": "librgw test user", 2024-03-04T12:28:36.436 INFO:tasks.workunit.client.0.smithi110.stdout: "email": "librgw@example.com", 2024-03-04T12:28:36.436 INFO:tasks.workunit.client.0.smithi110.stdout: "suspended": 0, 2024-03-04T12:28:36.436 INFO:tasks.workunit.client.0.smithi110.stdout: "max_buckets": 1000, 2024-03-04T12:28:36.436 INFO:tasks.workunit.client.0.smithi110.stdout: "subusers": [], 2024-03-04T12:28:36.436 INFO:tasks.workunit.client.0.smithi110.stdout: "keys": [ 2024-03-04T12:28:36.436 INFO:tasks.workunit.client.0.smithi110.stdout: { 2024-03-04T12:28:36.436 INFO:tasks.workunit.client.0.smithi110.stdout: "user": "ceph-test-librgw-file", 2024-03-04T12:28:36.436 INFO:tasks.workunit.client.0.smithi110.stdout: "access_key": "MKridRh/cxcxpZFH1i0QmoQ1/1g=", 2024-03-04T12:28:36.436 INFO:tasks.workunit.client.0.smithi110.stdout: "secret_key": "mXdXRzgVvixKr9Otx8IiMRaIbWKA4BYwHPfjhjnH0zib/4kmRdd3bA==", 2024-03-04T12:28:36.436 INFO:tasks.workunit.client.0.smithi110.stdout: "active": true 2024-03-04T12:28:36.436 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:36.436 INFO:tasks.workunit.client.0.smithi110.stdout: ], 2024-03-04T12:28:36.436 INFO:tasks.workunit.client.0.smithi110.stdout: "swift_keys": [], 2024-03-04T12:28:36.437 INFO:tasks.workunit.client.0.smithi110.stdout: "caps": [], 2024-03-04T12:28:36.437 INFO:tasks.workunit.client.0.smithi110.stdout: "op_mask": "read, write, delete", 2024-03-04T12:28:36.437 INFO:tasks.workunit.client.0.smithi110.stdout: "default_placement": "", 2024-03-04T12:28:36.437 INFO:tasks.workunit.client.0.smithi110.stdout: "default_storage_class": "", 2024-03-04T12:28:36.437 INFO:tasks.workunit.client.0.smithi110.stdout: "placement_tags": [], 2024-03-04T12:28:36.437 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_quota": { 2024-03-04T12:28:36.437 INFO:tasks.workunit.client.0.smithi110.stdout: "enabled": false, 2024-03-04T12:28:36.437 INFO:tasks.workunit.client.0.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:28:36.437 INFO:tasks.workunit.client.0.smithi110.stdout: "max_size": -1, 2024-03-04T12:28:36.437 INFO:tasks.workunit.client.0.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:28:36.437 INFO:tasks.workunit.client.0.smithi110.stdout: "max_objects": -1 2024-03-04T12:28:36.437 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:36.437 INFO:tasks.workunit.client.0.smithi110.stdout: "user_quota": { 2024-03-04T12:28:36.437 INFO:tasks.workunit.client.0.smithi110.stdout: "enabled": false, 2024-03-04T12:28:36.438 INFO:tasks.workunit.client.0.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:28:36.438 INFO:tasks.workunit.client.0.smithi110.stdout: "max_size": -1, 2024-03-04T12:28:36.438 INFO:tasks.workunit.client.0.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:28:36.438 INFO:tasks.workunit.client.0.smithi110.stdout: "max_objects": -1 2024-03-04T12:28:36.438 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:36.438 INFO:tasks.workunit.client.0.smithi110.stdout: "temp_url_keys": [], 2024-03-04T12:28:36.438 INFO:tasks.workunit.client.0.smithi110.stdout: "type": "rgw", 2024-03-04T12:28:36.438 INFO:tasks.workunit.client.0.smithi110.stdout: "mfa_ids": [] 2024-03-04T12:28:36.438 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:36.438 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:28:36.438 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.428+0000 7ff13f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:28:36.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.431+0000 7ff292630800 20 remove_watcher() i=0 2024-03-04T12:28:36.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.431+0000 7ff292630800 2 removed watcher, disabling cache 2024-03-04T12:28:36.440 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.432+0000 7ff292630800 20 remove_watcher() i=1 2024-03-04T12:28:36.441 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.433+0000 7ff292630800 20 remove_watcher() i=2 2024-03-04T12:28:36.443 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.435+0000 7ff292630800 20 remove_watcher() i=3 2024-03-04T12:28:36.444 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.436+0000 7ff292630800 20 remove_watcher() i=4 2024-03-04T12:28:36.445 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.437+0000 7ff292630800 20 remove_watcher() i=5 2024-03-04T12:28:36.446 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.438+0000 7ff292630800 20 remove_watcher() i=6 2024-03-04T12:28:36.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:36.439+0000 7ff292630800 20 remove_watcher() i=7 2024-03-04T12:28:36.456 INFO:tasks.workunit.client.0.smithi110.stdout:phase 1.1 2024-03-04T12:28:36.476 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-04T12:28:36.476 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:28:36.476 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 24 tests from LibRGW 2024-03-04T12:28:36.476 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:28:36.487 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:28:36.487 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:28:36.867 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.INIT (391 ms) 2024-03-04T12:28:36.868 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-03-04T12:28:36.868 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-03-04T12:28:36.869 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:28:36.869 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-04T12:28:36.869 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-03-04T12:28:36.879 INFO:tasks.workunit.client.0.smithi110.stdout:creating: nfsroot:foo/bar/baz/quux 2024-03-04T12:28:36.883 INFO:tasks.workunit.client.0.smithi110.stdout:creating: nfsroot:foo/f1 2024-03-04T12:28:36.886 INFO:tasks.workunit.client.0.smithi110.stdout:creating: nfsroot:foo/f2 2024-03-04T12:28:36.889 INFO:tasks.workunit.client.0.smithi110.stdout:creating: nfsroot:foo/bar/f1 2024-03-04T12:28:36.891 INFO:tasks.workunit.client.0.smithi110.stdout:creating: nfsroot:foo/bar/d1/ 2024-03-04T12:28:36.893 INFO:tasks.workunit.client.0.smithi110.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-03-04T12:28:36.896 INFO:tasks.workunit.client.0.smithi110.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-03-04T12:28:36.899 INFO:tasks.workunit.client.0.smithi110.stdout:creating: nfsroot:foo/bar/baz/momma 2024-03-04T12:28:36.901 INFO:tasks.workunit.client.0.smithi110.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-03-04T12:28:36.903 INFO:tasks.workunit.client.0.smithi110.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-03-04T12:28:36.907 INFO:tasks.workunit.client.0.smithi110.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-03-04T12:28:36.909 INFO:tasks.workunit.client.0.smithi110.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-03-04T12:28:36.911 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SETUP_HIER1 (43 ms) 2024-03-04T12:28:36.912 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-03-04T12:28:37.008 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SETUP_DIRS1 (97 ms) 2024-03-04T12:28:37.008 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SETATTR 2024-03-04T12:28:37.008 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-03-04T12:28:37.009 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-03-04T12:28:37.026 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (17 ms) 2024-03-04T12:28:37.026 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-03-04T12:28:37.067 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (42 ms) 2024-03-04T12:28:37.067 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-03-04T12:28:37.067 INFO:tasks.workunit.client.0.smithi110.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-03-04T12:28:37.073 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (5 ms) 2024-03-04T12:28:37.073 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-03-04T12:28:37.073 INFO:tasks.workunit.client.0.smithi110.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-03-04T12:28:37.080 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (7 ms) 2024-03-04T12:28:37.080 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-03-04T12:28:37.080 INFO:tasks.workunit.client.0.smithi110.stdout:scanning objects in /bdirs1/dir_0 2024-03-04T12:28:37.080 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-04T12:28:37.080 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-04T12:28:37.080 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-04T12:28:37.081 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-04T12:28:37.081 INFO:tasks.workunit.client.0.smithi110.stdout:scanning objects in /bdirs1/dir_1 2024-03-04T12:28:37.081 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-04T12:28:37.081 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-04T12:28:37.081 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-04T12:28:37.081 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-04T12:28:37.081 INFO:tasks.workunit.client.0.smithi110.stdout:scanning objects in /bdirs1/dir_2 2024-03-04T12:28:37.081 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-04T12:28:37.081 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-04T12:28:37.081 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-04T12:28:37.081 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-04T12:28:37.081 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (1 ms) 2024-03-04T12:28:37.081 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-03-04T12:28:37.081 INFO:tasks.workunit.client.0.smithi110.stdout:read back objects in /bdirs1/dir_0 2024-03-04T12:28:37.082 INFO:tasks.workunit.client.0.smithi110.stdout:reading 0,256 dir_0/sfile_0 2024-03-04T12:28:37.082 INFO:tasks.workunit.client.0.smithi110.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-04T12:28:37.082 INFO:tasks.workunit.client.0.smithi110.stdout:reading 0,256 dir_0/sfile_1 2024-03-04T12:28:37.082 INFO:tasks.workunit.client.0.smithi110.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-04T12:28:37.082 INFO:tasks.workunit.client.0.smithi110.stdout:read back objects in /bdirs1/dir_1 2024-03-04T12:28:37.082 INFO:tasks.workunit.client.0.smithi110.stdout:reading 0,256 dir_1/sfile_0 2024-03-04T12:28:37.083 INFO:tasks.workunit.client.0.smithi110.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-04T12:28:37.083 INFO:tasks.workunit.client.0.smithi110.stdout:reading 0,256 dir_1/sfile_1 2024-03-04T12:28:37.084 INFO:tasks.workunit.client.0.smithi110.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-04T12:28:37.084 INFO:tasks.workunit.client.0.smithi110.stdout:read back objects in /bdirs1/dir_2 2024-03-04T12:28:37.084 INFO:tasks.workunit.client.0.smithi110.stdout:reading 0,256 dir_2/sfile_0 2024-03-04T12:28:37.084 INFO:tasks.workunit.client.0.smithi110.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-04T12:28:37.084 INFO:tasks.workunit.client.0.smithi110.stdout:reading 0,256 dir_2/sfile_1 2024-03-04T12:28:37.085 INFO:tasks.workunit.client.0.smithi110.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-04T12:28:37.086 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.READ_DIRS1 (5 ms) 2024-03-04T12:28:37.086 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-03-04T12:28:37.258 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.READF_SETUP1 (172 ms) 2024-03-04T12:28:37.258 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-03-04T12:28:37.258 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-03-04T12:28:37.258 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-03-04T12:28:37.258 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-03-04T12:28:37.258 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-03-04T12:28:37.258 INFO:tasks.workunit.client.0.smithi110.stdout:release sdir_0 type: DIR refs: 2 2024-03-04T12:28:37.259 INFO:tasks.workunit.client.0.smithi110.stdout:release sfile_0 type: FILE refs: 2 2024-03-04T12:28:37.259 INFO:tasks.workunit.client.0.smithi110.stdout:release sdir_1 type: DIR refs: 2 2024-03-04T12:28:37.259 INFO:tasks.workunit.client.0.smithi110.stdout:release sfile_1 type: FILE refs: 2 2024-03-04T12:28:37.259 INFO:tasks.workunit.client.0.smithi110.stdout:release sdir_0 type: DIR refs: 2 2024-03-04T12:28:37.259 INFO:tasks.workunit.client.0.smithi110.stdout:release sfile_0 type: FILE refs: 2 2024-03-04T12:28:37.259 INFO:tasks.workunit.client.0.smithi110.stdout:release sdir_1 type: DIR refs: 2 2024-03-04T12:28:37.259 INFO:tasks.workunit.client.0.smithi110.stdout:release sfile_1 type: FILE refs: 2 2024-03-04T12:28:37.259 INFO:tasks.workunit.client.0.smithi110.stdout:release sdir_0 type: DIR refs: 2 2024-03-04T12:28:37.259 INFO:tasks.workunit.client.0.smithi110.stdout:release sfile_0 type: FILE refs: 2 2024-03-04T12:28:37.259 INFO:tasks.workunit.client.0.smithi110.stdout:release sdir_1 type: DIR refs: 2 2024-03-04T12:28:37.259 INFO:tasks.workunit.client.0.smithi110.stdout:release sfile_1 type: FILE refs: 2 2024-03-04T12:28:37.259 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-03-04T12:28:37.259 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.HIER1 2024-03-04T12:28:37.266 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/f2 (f2): FILE 2024-03-04T12:28:37.267 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/f1 (f1): FILE 2024-03-04T12:28:37.270 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-03-04T12:28:37.271 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-03-04T12:28:37.274 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-04T12:28:37.275 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-04T12:28:37.275 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-03-04T12:28:37.275 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-03-04T12:28:37.276 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-04T12:28:37.276 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-04T12:28:37.277 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-03-04T12:28:37.279 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-03-04T12:28:37.279 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-03-04T12:28:37.279 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar (bar): DIR 2024-03-04T12:28:37.279 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo (foo): DIR 2024-03-04T12:28:37.279 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot (nfsroot): DIR 2024-03-04T12:28:37.279 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2024-03-04T12:28:37.279 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-04T12:28:37.279 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-03-04T12:28:37.279 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-04T12:28:37.280 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-04T12:28:37.280 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-04T12:28:37.280 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-04T12:28:37.280 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-04T12:28:37.280 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-04T12:28:37.280 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:28:37.280 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:28:37.280 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:28:37.280 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:28:37.280 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:28:37.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:37.270+0000 7ff40263a8c0 -1 shutting down 2024-03-04T12:28:37.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:37.272+0000 7ff2dbeb1640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65435, si_uid : 1000, si_addr0x3e80000ff9b, si_status0 2024-03-04T12:28:37.333 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SHUTDOWN (54 ms) 2024-03-04T12:28:37.333 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 24 tests from LibRGW (856 ms total) 2024-03-04T12:28:37.333 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:28:37.333 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:28:37.333 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 24 tests from 1 test suite ran. (856 ms total) 2024-03-04T12:28:37.333 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 24 tests. 2024-03-04T12:28:37.338 INFO:tasks.workunit.client.0.smithi110.stdout:phase 1.2 2024-03-04T12:28:37.358 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-04T12:28:37.358 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:28:37.358 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 24 tests from LibRGW 2024-03-04T12:28:37.358 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:28:37.366 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:28:37.366 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:28:37.745 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.INIT (385 ms) 2024-03-04T12:28:37.745 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-03-04T12:28:37.745 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-03-04T12:28:37.745 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:28:37.745 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-04T12:28:37.745 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-03-04T12:28:37.745 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-03-04T12:28:37.745 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-03-04T12:28:37.745 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-03-04T12:28:37.745 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SETATTR 2024-03-04T12:28:37.745 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-03-04T12:28:37.746 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-03-04T12:28:37.746 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-03-04T12:28:37.746 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-03-04T12:28:37.746 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-03-04T12:28:37.746 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-03-04T12:28:37.746 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-03-04T12:28:37.746 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-03-04T12:28:37.746 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-03-04T12:28:37.746 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-03-04T12:28:37.746 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-03-04T12:28:37.746 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-03-04T12:28:37.746 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-03-04T12:28:37.746 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-03-04T12:28:37.746 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-03-04T12:28:37.746 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-03-04T12:28:37.746 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-03-04T12:28:37.747 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-03-04T12:28:37.747 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-03-04T12:28:37.747 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-03-04T12:28:37.747 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-03-04T12:28:37.747 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.HIER1 2024-03-04T12:28:37.747 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-03-04T12:28:37.747 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-04T12:28:37.747 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-03-04T12:28:37.747 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-04T12:28:37.747 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-04T12:28:37.747 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-04T12:28:37.747 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-04T12:28:37.747 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-04T12:28:37.747 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-04T12:28:37.748 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:28:37.748 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:28:37.748 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:28:37.748 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:28:37.748 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:28:37.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:37.735+0000 7fc58b5228c0 -1 shutting down 2024-03-04T12:28:37.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:37.736+0000 7fc46533a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66052, si_uid : 1000, si_addr0x3e800010204, si_status0 2024-03-04T12:28:37.815 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SHUTDOWN (71 ms) 2024-03-04T12:28:37.815 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 24 tests from LibRGW (457 ms total) 2024-03-04T12:28:37.815 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:28:37.815 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:28:37.815 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 24 tests from 1 test suite ran. (457 ms total) 2024-03-04T12:28:37.815 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 24 tests. 2024-03-04T12:28:37.820 INFO:tasks.workunit.client.0.smithi110.stdout:phase 1.3 2024-03-04T12:28:37.840 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-04T12:28:37.840 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:28:37.840 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 24 tests from LibRGW 2024-03-04T12:28:37.840 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:28:37.850 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:28:37.850 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:28:38.431 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.INIT (591 ms) 2024-03-04T12:28:38.431 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-03-04T12:28:38.432 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-03-04T12:28:38.432 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:28:38.432 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-04T12:28:38.432 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-03-04T12:28:38.437 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-03-04T12:28:38.438 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-03-04T12:28:38.496 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SETUP_DIRS1 (59 ms) 2024-03-04T12:28:38.497 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SETATTR 2024-03-04T12:28:38.497 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-03-04T12:28:38.497 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-03-04T12:28:38.497 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-03-04T12:28:38.497 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-03-04T12:28:38.497 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-03-04T12:28:38.497 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-03-04T12:28:38.497 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-03-04T12:28:38.497 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-03-04T12:28:38.497 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-03-04T12:28:38.497 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-03-04T12:28:38.497 INFO:tasks.workunit.client.0.smithi110.stdout:scanning objects in /bdirs1/dir_0 2024-03-04T12:28:38.497 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-04T12:28:38.498 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-04T12:28:38.498 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-04T12:28:38.498 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-04T12:28:38.498 INFO:tasks.workunit.client.0.smithi110.stdout:scanning objects in /bdirs1/dir_1 2024-03-04T12:28:38.498 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-04T12:28:38.498 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-04T12:28:38.498 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-04T12:28:38.498 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-04T12:28:38.498 INFO:tasks.workunit.client.0.smithi110.stdout:scanning objects in /bdirs1/dir_2 2024-03-04T12:28:38.498 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-04T12:28:38.498 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-04T12:28:38.498 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-04T12:28:38.498 INFO:tasks.workunit.client.0.smithi110.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-04T12:28:38.498 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-03-04T12:28:38.498 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-03-04T12:28:38.499 INFO:tasks.workunit.client.0.smithi110.stdout:read back objects in /bdirs1/dir_0 2024-03-04T12:28:38.499 INFO:tasks.workunit.client.0.smithi110.stdout:reading 0,256 dir_0/sfile_0 2024-03-04T12:28:38.499 INFO:tasks.workunit.client.0.smithi110.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-04T12:28:38.499 INFO:tasks.workunit.client.0.smithi110.stdout:reading 0,256 dir_0/sfile_1 2024-03-04T12:28:38.499 INFO:tasks.workunit.client.0.smithi110.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-04T12:28:38.499 INFO:tasks.workunit.client.0.smithi110.stdout:read back objects in /bdirs1/dir_1 2024-03-04T12:28:38.499 INFO:tasks.workunit.client.0.smithi110.stdout:reading 0,256 dir_1/sfile_0 2024-03-04T12:28:38.500 INFO:tasks.workunit.client.0.smithi110.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-04T12:28:38.500 INFO:tasks.workunit.client.0.smithi110.stdout:reading 0,256 dir_1/sfile_1 2024-03-04T12:28:38.501 INFO:tasks.workunit.client.0.smithi110.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-04T12:28:38.501 INFO:tasks.workunit.client.0.smithi110.stdout:read back objects in /bdirs1/dir_2 2024-03-04T12:28:38.501 INFO:tasks.workunit.client.0.smithi110.stdout:reading 0,256 dir_2/sfile_0 2024-03-04T12:28:38.502 INFO:tasks.workunit.client.0.smithi110.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-04T12:28:38.502 INFO:tasks.workunit.client.0.smithi110.stdout:reading 0,256 dir_2/sfile_1 2024-03-04T12:28:38.503 INFO:tasks.workunit.client.0.smithi110.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-04T12:28:38.503 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.READ_DIRS1 (6 ms) 2024-03-04T12:28:38.504 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-03-04T12:28:38.504 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-03-04T12:28:38.504 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-03-04T12:28:38.504 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-03-04T12:28:38.504 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-03-04T12:28:38.504 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-03-04T12:28:38.504 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-03-04T12:28:38.504 INFO:tasks.workunit.client.0.smithi110.stdout:release sdir_0 type: DIR refs: 2 2024-03-04T12:28:38.504 INFO:tasks.workunit.client.0.smithi110.stdout:release sfile_0 type: FILE refs: 2 2024-03-04T12:28:38.504 INFO:tasks.workunit.client.0.smithi110.stdout:release sdir_1 type: DIR refs: 2 2024-03-04T12:28:38.504 INFO:tasks.workunit.client.0.smithi110.stdout:release sfile_1 type: FILE refs: 2 2024-03-04T12:28:38.504 INFO:tasks.workunit.client.0.smithi110.stdout:release sdir_0 type: DIR refs: 2 2024-03-04T12:28:38.504 INFO:tasks.workunit.client.0.smithi110.stdout:release sfile_0 type: FILE refs: 2 2024-03-04T12:28:38.504 INFO:tasks.workunit.client.0.smithi110.stdout:release sdir_1 type: DIR refs: 2 2024-03-04T12:28:38.505 INFO:tasks.workunit.client.0.smithi110.stdout:release sfile_1 type: FILE refs: 2 2024-03-04T12:28:38.505 INFO:tasks.workunit.client.0.smithi110.stdout:release sdir_0 type: DIR refs: 2 2024-03-04T12:28:38.505 INFO:tasks.workunit.client.0.smithi110.stdout:release sfile_0 type: FILE refs: 2 2024-03-04T12:28:38.505 INFO:tasks.workunit.client.0.smithi110.stdout:release sdir_1 type: DIR refs: 2 2024-03-04T12:28:38.505 INFO:tasks.workunit.client.0.smithi110.stdout:release sfile_1 type: FILE refs: 2 2024-03-04T12:28:38.505 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-03-04T12:28:38.505 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.HIER1 2024-03-04T12:28:38.511 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/f2 (f2): FILE 2024-03-04T12:28:38.511 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/f1 (f1): FILE 2024-03-04T12:28:38.514 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-03-04T12:28:38.516 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-03-04T12:28:38.518 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-04T12:28:38.519 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-04T12:28:38.519 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-03-04T12:28:38.520 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-03-04T12:28:38.520 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-04T12:28:38.521 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-04T12:28:38.521 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-03-04T12:28:38.523 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-03-04T12:28:38.523 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-03-04T12:28:38.523 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo/bar (bar): DIR 2024-03-04T12:28:38.523 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot/foo (foo): DIR 2024-03-04T12:28:38.523 INFO:tasks.workunit.client.0.smithi110.stdout:/nfsroot (nfsroot): DIR 2024-03-04T12:28:38.524 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.HIER1 (19 ms) 2024-03-04T12:28:38.524 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-04T12:28:38.524 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-03-04T12:28:38.524 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-04T12:28:38.524 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-04T12:28:38.524 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-04T12:28:38.524 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-04T12:28:38.524 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-04T12:28:38.524 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-04T12:28:38.524 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:28:38.524 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:28:38.524 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:28:38.525 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:28:38.525 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:28:38.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:38.515+0000 7f6c8d5358c0 -1 shutting down 2024-03-04T12:28:38.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:38.516+0000 7f6b67360640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66669, si_uid : 1000, si_addr0x3e80001046d, si_status0 2024-03-04T12:28:38.597 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SHUTDOWN (75 ms) 2024-03-04T12:28:38.597 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 24 tests from LibRGW (758 ms total) 2024-03-04T12:28:38.597 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:28:38.597 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:28:38.597 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 24 tests from 1 test suite ran. (758 ms total) 2024-03-04T12:28:38.597 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 24 tests. 2024-03-04T12:28:38.603 INFO:tasks.workunit.client.0.smithi110.stdout:phase 2.1 2024-03-04T12:28:38.624 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 9 tests from 1 test suite. 2024-03-04T12:28:38.624 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:28:38.624 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 9 tests from LibRGW 2024-03-04T12:28:38.624 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:28:38.635 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:28:38.635 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:28:39.000 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.INIT (376 ms) 2024-03-04T12:28:39.000 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:28:39.000 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-04T12:28:39.000 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-04T12:28:39.011 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-03-04T12:28:39.011 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-04T12:28:39.011 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-03-04T12:28:39.012 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-03-04T12:28:39.022 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave0 2024-03-04T12:28:39.033 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave1 2024-03-04T12:28:39.047 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave2 2024-03-04T12:28:39.059 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave3 2024-03-04T12:28:39.070 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave4 2024-03-04T12:28:39.083 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave5 2024-03-04T12:28:39.093 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave6 2024-03-04T12:28:39.105 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave7 2024-03-04T12:28:39.117 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave8 2024-03-04T12:28:39.128 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave9 2024-03-04T12:28:39.129 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (117 ms) 2024-03-04T12:28:39.129 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-03-04T12:28:39.415 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (287 ms) 2024-03-04T12:28:39.416 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:28:39.416 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:28:39.416 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:28:39.416 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:28:39.416 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:28:39.416 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:39.407+0000 7fe6781208c0 -1 shutting down 2024-03-04T12:28:39.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:39.408+0000 7fe5520bf640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67286, si_uid : 1000, si_addr0x3e8000106d6, si_status0 2024-03-04T12:28:39.465 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SHUTDOWN (49 ms) 2024-03-04T12:28:39.465 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 9 tests from LibRGW (841 ms total) 2024-03-04T12:28:39.465 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:28:39.465 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:28:39.465 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 9 tests from 1 test suite ran. (841 ms total) 2024-03-04T12:28:39.465 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 9 tests. 2024-03-04T12:28:39.470 INFO:tasks.workunit.client.0.smithi110.stdout:phase 2.2 2024-03-04T12:28:39.490 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 9 tests from 1 test suite. 2024-03-04T12:28:39.490 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:28:39.490 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 9 tests from LibRGW 2024-03-04T12:28:39.490 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:28:39.499 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:28:39.499 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:28:39.877 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.INIT (386 ms) 2024-03-04T12:28:39.877 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:28:39.878 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-04T12:28:39.878 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-04T12:28:39.878 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-03-04T12:28:39.878 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-04T12:28:39.910 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.DELETE_BUCKET (33 ms) 2024-03-04T12:28:39.910 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-03-04T12:28:39.921 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave0 2024-03-04T12:28:39.931 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave1 2024-03-04T12:28:39.940 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave2 2024-03-04T12:28:39.951 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave3 2024-03-04T12:28:39.961 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave4 2024-03-04T12:28:39.971 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave5 2024-03-04T12:28:39.981 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave6 2024-03-04T12:28:39.991 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave7 2024-03-04T12:28:40.002 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave8 2024-03-04T12:28:40.012 INFO:tasks.workunit.client.0.smithi110.stdout:created: sorrydave9 2024-03-04T12:28:40.012 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (102 ms) 2024-03-04T12:28:40.012 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-03-04T12:28:40.299 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (287 ms) 2024-03-04T12:28:40.300 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:28:40.300 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:28:40.300 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:28:40.300 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:28:40.300 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:28:40.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:40.291+0000 7f591643c8c0 -1 shutting down 2024-03-04T12:28:40.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:40.292+0000 7f57ef9b5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67903, si_uid : 1000, si_addr0x3e80001093f, si_status0 2024-03-04T12:28:40.343 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SHUTDOWN (43 ms) 2024-03-04T12:28:40.343 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 9 tests from LibRGW (852 ms total) 2024-03-04T12:28:40.343 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:28:40.343 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:28:40.343 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 9 tests from 1 test suite ran. (852 ms total) 2024-03-04T12:28:40.343 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 9 tests. 2024-03-04T12:28:40.348 INFO:tasks.workunit.client.0.smithi110.stdout:phase 3.1 2024-03-04T12:28:40.663 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 13 tests from 1 test suite. 2024-03-04T12:28:40.663 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:28:40.663 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 13 tests from LibRGW 2024-03-04T12:28:40.663 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:28:40.672 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:28:40.672 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:28:41.051 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.INIT (388 ms) 2024-03-04T12:28:41.051 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:28:41.051 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-04T12:28:41.051 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-04T12:28:41.063 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-03-04T12:28:41.063 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-04T12:28:41.068 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-03-04T12:28:41.068 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-04T12:28:41.069 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-03-04T12:28:41.069 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.LARGE1 2024-03-04T12:28:41.127 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.LARGE1 (57 ms) 2024-03-04T12:28:41.127 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.LARGE2 2024-03-04T12:28:41.153 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.LARGE2 (27 ms) 2024-03-04T12:28:41.154 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-04T12:28:41.154 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-04T12:28:41.154 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-04T12:28:41.154 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-03-04T12:28:41.154 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-04T12:28:41.154 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-03-04T12:28:41.154 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:28:41.154 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:28:41.154 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:28:41.154 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:28:41.155 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:28:41.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:41.145+0000 7f4d7cf308c0 -1 shutting down 2024-03-04T12:28:41.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:41.147+0000 7f4c56e46640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68520, si_uid : 1000, si_addr0x3e800010ba8, si_status0 2024-03-04T12:28:41.217 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SHUTDOWN (63 ms) 2024-03-04T12:28:41.217 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 13 tests from LibRGW (554 ms total) 2024-03-04T12:28:41.217 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:28:41.217 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:28:41.217 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 13 tests from 1 test suite ran. (554 ms total) 2024-03-04T12:28:41.217 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 13 tests. 2024-03-04T12:28:41.223 INFO:tasks.workunit.client.0.smithi110.stdout:phase 3.2 2024-03-04T12:28:41.535 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 13 tests from 1 test suite. 2024-03-04T12:28:41.535 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:28:41.535 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 13 tests from LibRGW 2024-03-04T12:28:41.535 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:28:41.543 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:28:41.543 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:28:41.718 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.INIT (182 ms) 2024-03-04T12:28:41.718 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:28:41.718 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-04T12:28:41.719 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-04T12:28:41.719 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-03-04T12:28:41.719 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-04T12:28:41.724 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-03-04T12:28:41.725 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-04T12:28:41.727 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-03-04T12:28:41.728 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.LARGE1 2024-03-04T12:28:41.792 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.LARGE1 (65 ms) 2024-03-04T12:28:41.793 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.LARGE2 2024-03-04T12:28:41.793 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-03-04T12:28:41.793 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-04T12:28:41.793 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-04T12:28:41.793 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-04T12:28:41.798 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-03-04T12:28:41.798 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-04T12:28:41.827 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.DELETE_BUCKET (29 ms) 2024-03-04T12:28:41.827 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:28:41.827 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:28:41.827 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:28:41.827 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:28:41.827 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:28:41.827 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:41.819+0000 7fbf31a2c8c0 -1 shutting down 2024-03-04T12:28:41.828 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:41.820+0000 7fbe0d706640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69137, si_uid : 1000, si_addr0x3e800010e11, si_status0 2024-03-04T12:28:41.882 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SHUTDOWN (56 ms) 2024-03-04T12:28:41.882 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 13 tests from LibRGW (347 ms total) 2024-03-04T12:28:41.883 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:28:41.883 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:28:41.883 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 13 tests from 1 test suite ran. (347 ms total) 2024-03-04T12:28:41.883 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 13 tests. 2024-03-04T12:28:41.889 INFO:tasks.workunit.client.0.smithi110.stdout:phase 4.1 2024-03-04T12:28:41.911 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 11 tests from 1 test suite. 2024-03-04T12:28:41.911 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:28:41.911 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 11 tests from LibRGW 2024-03-04T12:28:41.911 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.TVAR 2024-03-04T12:28:41.911 INFO:tasks.workunit.client.0.smithi110.stdout:read i1: 64001 2024-03-04T12:28:41.911 INFO:tasks.workunit.client.0.smithi110.stdout:read s1: blunderbuss 2024-03-04T12:28:41.911 INFO:tasks.workunit.client.0.smithi110.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-03-04T12:28:41.911 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:28:41.921 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:28:41.921 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:28:42.081 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.INIT (170 ms) 2024-03-04T12:28:42.081 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:28:42.081 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-04T12:28:42.081 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-04T12:28:42.098 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (17 ms) 2024-03-04T12:28:42.098 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-04T12:28:42.500 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_0 2024-03-04T12:28:42.501 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_1 2024-03-04T12:28:42.501 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_2 2024-03-04T12:28:42.501 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_3 2024-03-04T12:28:42.501 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_4 2024-03-04T12:28:42.501 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_5 2024-03-04T12:28:42.501 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_6 2024-03-04T12:28:42.501 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_7 2024-03-04T12:28:42.501 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_8 2024-03-04T12:28:42.501 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_9 2024-03-04T12:28:42.501 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_10 2024-03-04T12:28:42.501 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_11 2024-03-04T12:28:42.501 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_12 2024-03-04T12:28:42.501 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_13 2024-03-04T12:28:42.502 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_14 2024-03-04T12:28:42.502 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_15 2024-03-04T12:28:42.502 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_16 2024-03-04T12:28:42.502 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_17 2024-03-04T12:28:42.502 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_18 2024-03-04T12:28:42.502 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_19 2024-03-04T12:28:42.502 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_20 2024-03-04T12:28:42.502 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_21 2024-03-04T12:28:42.502 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_22 2024-03-04T12:28:42.502 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_23 2024-03-04T12:28:42.502 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_24 2024-03-04T12:28:42.502 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_25 2024-03-04T12:28:42.502 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_26 2024-03-04T12:28:42.502 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_27 2024-03-04T12:28:42.502 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_28 2024-03-04T12:28:42.503 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_29 2024-03-04T12:28:42.503 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_30 2024-03-04T12:28:42.503 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_31 2024-03-04T12:28:42.503 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_32 2024-03-04T12:28:42.503 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_33 2024-03-04T12:28:42.503 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_34 2024-03-04T12:28:42.503 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_35 2024-03-04T12:28:42.503 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_36 2024-03-04T12:28:42.503 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_37 2024-03-04T12:28:42.503 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_38 2024-03-04T12:28:42.503 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_39 2024-03-04T12:28:42.504 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_40 2024-03-04T12:28:42.504 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_41 2024-03-04T12:28:42.504 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_42 2024-03-04T12:28:42.504 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_43 2024-03-04T12:28:42.504 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_44 2024-03-04T12:28:42.504 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_45 2024-03-04T12:28:42.504 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_46 2024-03-04T12:28:42.504 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_47 2024-03-04T12:28:42.504 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_48 2024-03-04T12:28:42.504 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_49 2024-03-04T12:28:42.504 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_50 2024-03-04T12:28:42.504 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_51 2024-03-04T12:28:42.505 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_52 2024-03-04T12:28:42.505 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_53 2024-03-04T12:28:42.505 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_54 2024-03-04T12:28:42.505 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_55 2024-03-04T12:28:42.505 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_56 2024-03-04T12:28:42.505 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_57 2024-03-04T12:28:42.505 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_58 2024-03-04T12:28:42.505 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_59 2024-03-04T12:28:42.505 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_60 2024-03-04T12:28:42.505 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_61 2024-03-04T12:28:42.505 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_62 2024-03-04T12:28:42.505 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_63 2024-03-04T12:28:42.505 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_64 2024-03-04T12:28:42.505 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_65 2024-03-04T12:28:42.506 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_66 2024-03-04T12:28:42.506 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_67 2024-03-04T12:28:42.506 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_68 2024-03-04T12:28:42.506 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_69 2024-03-04T12:28:42.506 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_70 2024-03-04T12:28:42.506 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_71 2024-03-04T12:28:42.506 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_72 2024-03-04T12:28:42.506 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_73 2024-03-04T12:28:42.506 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_74 2024-03-04T12:28:42.506 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_75 2024-03-04T12:28:42.506 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_76 2024-03-04T12:28:42.506 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_77 2024-03-04T12:28:42.506 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_78 2024-03-04T12:28:42.506 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_79 2024-03-04T12:28:42.507 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_80 2024-03-04T12:28:42.507 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_81 2024-03-04T12:28:42.507 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_82 2024-03-04T12:28:42.507 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_83 2024-03-04T12:28:42.507 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_84 2024-03-04T12:28:42.507 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_85 2024-03-04T12:28:42.507 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_86 2024-03-04T12:28:42.507 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_87 2024-03-04T12:28:42.507 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_88 2024-03-04T12:28:42.507 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_89 2024-03-04T12:28:42.507 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_90 2024-03-04T12:28:42.507 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_91 2024-03-04T12:28:42.507 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_92 2024-03-04T12:28:42.507 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_93 2024-03-04T12:28:42.508 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_94 2024-03-04T12:28:42.508 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_95 2024-03-04T12:28:42.508 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_96 2024-03-04T12:28:42.508 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_97 2024-03-04T12:28:42.508 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_98 2024-03-04T12:28:42.508 INFO:tasks.workunit.client.0.smithi110.stdout:created: dmarker:f_99 2024-03-04T12:28:42.508 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (402 ms) 2024-03-04T12:28:42.508 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-04T12:28:42.509 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-03-04T12:28:42.509 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-03-04T12:28:42.509 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-03-04T12:28:42.509 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-03-04T12:28:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-03-04T12:28:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-03-04T12:28:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-03-04T12:28:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-03-04T12:28:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-03-04T12:28:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-03-04T12:28:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-03-04T12:28:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-03-04T12:28:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-03-04T12:28:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-03-04T12:28:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-03-04T12:28:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-03-04T12:28:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-03-04T12:28:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-03-04T12:28:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-03-04T12:28:42.510 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-03-04T12:28:42.511 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-03-04T12:28:42.511 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-03-04T12:28:42.511 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-03-04T12:28:42.511 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-03-04T12:28:42.511 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-03-04T12:28:42.511 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-03-04T12:28:42.511 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-03-04T12:28:42.511 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-03-04T12:28:42.511 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-03-04T12:28:42.512 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-03-04T12:28:42.512 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-03-04T12:28:42.512 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-03-04T12:28:42.512 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-03-04T12:28:42.512 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-03-04T12:28:42.512 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-03-04T12:28:42.512 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-03-04T12:28:42.512 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-03-04T12:28:42.512 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-03-04T12:28:42.512 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-03-04T12:28:42.512 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-03-04T12:28:42.513 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-03-04T12:28:42.513 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-03-04T12:28:42.513 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-03-04T12:28:42.513 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-03-04T12:28:42.513 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-03-04T12:28:42.513 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-03-04T12:28:42.513 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-03-04T12:28:42.513 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-03-04T12:28:42.513 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-03-04T12:28:42.513 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-03-04T12:28:42.515 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-03-04T12:28:42.515 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-03-04T12:28:42.515 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-03-04T12:28:42.515 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-03-04T12:28:42.515 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-03-04T12:28:42.515 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-03-04T12:28:42.515 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-03-04T12:28:42.515 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-03-04T12:28:42.515 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-03-04T12:28:42.515 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-03-04T12:28:42.515 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-03-04T12:28:42.515 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-03-04T12:28:42.516 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-03-04T12:28:42.516 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-03-04T12:28:42.516 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-03-04T12:28:42.516 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-03-04T12:28:42.516 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-03-04T12:28:42.516 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-03-04T12:28:42.516 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-03-04T12:28:42.516 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-03-04T12:28:42.516 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-03-04T12:28:42.516 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-03-04T12:28:42.516 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-03-04T12:28:42.516 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-03-04T12:28:42.516 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-03-04T12:28:42.517 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-03-04T12:28:42.517 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-03-04T12:28:42.517 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-03-04T12:28:42.517 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-03-04T12:28:42.517 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-03-04T12:28:42.517 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-03-04T12:28:42.517 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-03-04T12:28:42.517 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-03-04T12:28:42.517 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-03-04T12:28:42.517 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-03-04T12:28:42.517 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-03-04T12:28:42.517 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-03-04T12:28:42.517 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-03-04T12:28:42.517 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-03-04T12:28:42.518 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-03-04T12:28:42.518 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-03-04T12:28:42.518 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-03-04T12:28:42.518 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-03-04T12:28:42.518 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-03-04T12:28:42.518 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-03-04T12:28:42.518 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-03-04T12:28:42.518 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-03-04T12:28:42.518 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-03-04T12:28:42.518 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-03-04T12:28:42.518 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-03-04T12:28:42.518 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-03-04T12:28:42.518 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-03-04T12:28:42.519 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_READDIR (3 ms) 2024-03-04T12:28:42.519 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-03-04T12:28:42.519 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-03-04T12:28:42.519 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-03-04T12:28:42.519 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-03-04T12:28:42.519 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-03-04T12:28:42.519 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-03-04T12:28:42.519 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-03-04T12:28:42.519 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-03-04T12:28:42.519 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-03-04T12:28:42.519 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-03-04T12:28:42.519 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-03-04T12:28:42.519 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-03-04T12:28:42.520 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-03-04T12:28:42.520 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-03-04T12:28:42.520 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-03-04T12:28:42.520 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-03-04T12:28:42.520 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-03-04T12:28:42.520 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-03-04T12:28:42.520 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-03-04T12:28:42.520 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-03-04T12:28:42.520 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-03-04T12:28:42.520 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-03-04T12:28:42.520 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-03-04T12:28:42.520 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-03-04T12:28:42.520 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-03-04T12:28:42.520 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-03-04T12:28:42.521 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-03-04T12:28:42.521 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-03-04T12:28:42.521 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-03-04T12:28:42.521 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-03-04T12:28:42.521 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-03-04T12:28:42.521 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-03-04T12:28:42.521 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-03-04T12:28:42.521 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-03-04T12:28:42.521 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-03-04T12:28:42.521 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-03-04T12:28:42.521 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-03-04T12:28:42.521 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-03-04T12:28:42.521 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-03-04T12:28:42.521 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-03-04T12:28:42.522 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-03-04T12:28:42.522 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-03-04T12:28:42.522 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-03-04T12:28:42.522 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-03-04T12:28:42.522 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-03-04T12:28:42.522 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-03-04T12:28:42.522 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-03-04T12:28:42.522 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-03-04T12:28:42.522 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-03-04T12:28:42.522 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-03-04T12:28:42.522 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-03-04T12:28:42.522 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-03-04T12:28:42.522 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-03-04T12:28:42.522 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-03-04T12:28:42.523 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-03-04T12:28:42.523 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-03-04T12:28:42.523 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-03-04T12:28:42.523 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-03-04T12:28:42.523 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-03-04T12:28:42.523 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-03-04T12:28:42.523 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-03-04T12:28:42.523 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-03-04T12:28:42.523 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-03-04T12:28:42.523 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-03-04T12:28:42.523 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-03-04T12:28:42.523 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-03-04T12:28:42.523 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-03-04T12:28:42.523 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-03-04T12:28:42.523 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-03-04T12:28:42.524 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-03-04T12:28:42.524 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-03-04T12:28:42.524 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-03-04T12:28:42.524 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-03-04T12:28:42.524 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-03-04T12:28:42.524 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-03-04T12:28:42.524 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-03-04T12:28:42.524 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-03-04T12:28:42.524 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-03-04T12:28:42.524 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-03-04T12:28:42.524 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-03-04T12:28:42.524 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-03-04T12:28:42.524 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-03-04T12:28:42.524 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-03-04T12:28:42.525 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-03-04T12:28:42.525 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-03-04T12:28:42.525 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-03-04T12:28:42.525 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-03-04T12:28:42.525 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-03-04T12:28:42.525 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-03-04T12:28:42.525 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-03-04T12:28:42.525 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-03-04T12:28:42.525 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-03-04T12:28:42.525 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-03-04T12:28:42.525 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-03-04T12:28:42.525 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-03-04T12:28:42.525 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-03-04T12:28:42.525 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-03-04T12:28:42.526 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-03-04T12:28:42.526 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-03-04T12:28:42.526 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-03-04T12:28:42.526 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-03-04T12:28:42.526 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER2_READDIR (1 ms) 2024-03-04T12:28:42.526 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-04T12:28:42.526 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (1 ms) 2024-03-04T12:28:42.526 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:28:42.526 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:28:42.526 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:28:42.526 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:28:42.526 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:28:42.527 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:42.497+0000 7f6e661398c0 -1 shutting down 2024-03-04T12:28:42.527 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:42.498+0000 7f6d40070640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69754, si_uid : 1000, si_addr0x3e80001107a, si_status0 2024-03-04T12:28:42.546 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SHUTDOWN (40 ms) 2024-03-04T12:28:42.546 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 11 tests from LibRGW (635 ms total) 2024-03-04T12:28:42.546 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:28:42.546 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:28:42.546 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 11 tests from 1 test suite ran. (635 ms total) 2024-03-04T12:28:42.546 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 11 tests. 2024-03-04T12:28:42.552 INFO:tasks.workunit.client.0.smithi110.stdout:phase 4.2 2024-03-04T12:28:42.572 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 11 tests from 1 test suite. 2024-03-04T12:28:42.572 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:28:42.573 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 11 tests from LibRGW 2024-03-04T12:28:42.573 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.TVAR 2024-03-04T12:28:42.573 INFO:tasks.workunit.client.0.smithi110.stdout:read i1: 64001 2024-03-04T12:28:42.573 INFO:tasks.workunit.client.0.smithi110.stdout:read s1: blunderbuss 2024-03-04T12:28:42.573 INFO:tasks.workunit.client.0.smithi110.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-03-04T12:28:42.573 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:28:42.580 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:28:42.580 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:28:42.956 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.INIT (384 ms) 2024-03-04T12:28:42.956 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:28:42.957 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-04T12:28:42.957 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-04T12:28:42.967 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (11 ms) 2024-03-04T12:28:42.967 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-04T12:28:42.967 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-04T12:28:42.967 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-04T12:28:42.967 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-04T12:28:42.967 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-03-04T12:28:42.969 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-03-04T12:28:42.970 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-03-04T12:28:42.970 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-03-04T12:28:42.970 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-03-04T12:28:42.970 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-03-04T12:28:42.970 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-03-04T12:28:42.970 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-03-04T12:28:42.970 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-03-04T12:28:42.970 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-03-04T12:28:42.970 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-03-04T12:28:42.970 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-03-04T12:28:42.970 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-03-04T12:28:42.970 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-03-04T12:28:42.970 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-03-04T12:28:42.970 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-03-04T12:28:42.971 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-03-04T12:28:42.971 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-03-04T12:28:42.971 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-03-04T12:28:42.971 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-03-04T12:28:42.971 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-03-04T12:28:42.971 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-03-04T12:28:42.971 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-03-04T12:28:42.971 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-03-04T12:28:42.971 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-03-04T12:28:42.971 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-03-04T12:28:42.971 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-03-04T12:28:42.971 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-03-04T12:28:42.971 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-03-04T12:28:42.971 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-03-04T12:28:42.971 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-03-04T12:28:42.972 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-03-04T12:28:42.972 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-03-04T12:28:42.972 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-03-04T12:28:42.972 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-03-04T12:28:42.972 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-03-04T12:28:42.972 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-03-04T12:28:42.972 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-03-04T12:28:42.972 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-03-04T12:28:42.972 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-03-04T12:28:42.972 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-03-04T12:28:42.972 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-03-04T12:28:42.972 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-03-04T12:28:42.972 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-03-04T12:28:42.972 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-03-04T12:28:42.973 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-03-04T12:28:42.973 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-03-04T12:28:42.973 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-03-04T12:28:42.973 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-03-04T12:28:42.973 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-03-04T12:28:42.973 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-03-04T12:28:42.973 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-03-04T12:28:42.973 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-03-04T12:28:42.973 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-03-04T12:28:42.973 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-03-04T12:28:42.973 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-03-04T12:28:42.973 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-03-04T12:28:42.973 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-03-04T12:28:42.973 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-03-04T12:28:42.973 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-03-04T12:28:42.974 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-03-04T12:28:42.974 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-03-04T12:28:42.974 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-03-04T12:28:42.974 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-03-04T12:28:42.974 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-03-04T12:28:42.974 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-03-04T12:28:42.974 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-03-04T12:28:42.974 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-03-04T12:28:42.974 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-03-04T12:28:42.974 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-03-04T12:28:42.974 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-03-04T12:28:42.974 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-03-04T12:28:42.974 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-03-04T12:28:42.974 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-03-04T12:28:42.974 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-03-04T12:28:42.975 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-03-04T12:28:42.975 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-03-04T12:28:42.975 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-03-04T12:28:42.975 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-03-04T12:28:42.975 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-03-04T12:28:42.975 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-03-04T12:28:42.975 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-03-04T12:28:42.975 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-03-04T12:28:42.975 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-03-04T12:28:42.975 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-03-04T12:28:42.975 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-03-04T12:28:42.975 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-03-04T12:28:42.975 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-03-04T12:28:42.975 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-03-04T12:28:42.976 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-03-04T12:28:42.976 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-03-04T12:28:42.976 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-03-04T12:28:42.976 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-03-04T12:28:42.976 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-03-04T12:28:42.976 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-03-04T12:28:42.976 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-03-04T12:28:42.976 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-03-04T12:28:42.976 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-03-04T12:28:42.976 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-03-04T12:28:42.976 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-03-04T12:28:42.976 INFO:tasks.workunit.client.0.smithi110.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-03-04T12:28:42.976 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-03-04T12:28:42.976 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-04T12:28:42.977 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-04T12:28:42.977 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:28:42.977 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:28:42.977 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:28:42.977 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:28:42.977 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:28:42.977 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:42.962+0000 7f17191278c0 -1 shutting down 2024-03-04T12:28:42.977 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:42.963+0000 7f15f2f78640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70371, si_uid : 1000, si_addr0x3e8000112e3, si_status0 2024-03-04T12:28:43.031 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SHUTDOWN (62 ms) 2024-03-04T12:28:43.031 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 11 tests from LibRGW (459 ms total) 2024-03-04T12:28:43.031 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:28:43.031 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:28:43.032 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 11 tests from 1 test suite ran. (459 ms total) 2024-03-04T12:28:43.032 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 11 tests. 2024-03-04T12:28:43.037 INFO:tasks.workunit.client.0.smithi110.stdout:phase 5.1 2024-03-04T12:28:43.065 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 19 tests from 1 test suite. 2024-03-04T12:28:43.065 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:28:43.065 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 19 tests from LibRGW 2024-03-04T12:28:43.065 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:28:43.075 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:28:43.075 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:28:43.245 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.INIT (179 ms) 2024-03-04T12:28:43.245 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:28:43.245 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-04T12:28:43.245 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-04T12:28:43.255 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-03-04T12:28:43.255 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-04T12:28:43.259 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-03-04T12:28:43.260 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-03-04T12:28:43.260 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-03-04T12:28:43.260 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-04T12:28:43.261 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-03-04T12:28:43.262 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-03-04T12:28:43.262 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-03-04T12:28:43.262 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-03-04T12:28:43.265 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-03-04T12:28:43.265 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-03-04T12:28:43.268 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-03-04T12:28:43.268 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-04T12:28:43.268 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-04T12:28:43.268 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-03-04T12:28:43.268 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-03-04T12:28:43.269 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.WRITEV 2024-03-04T12:28:43.269 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-03-04T12:28:43.269 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.READV 2024-03-04T12:28:43.269 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.READV (0 ms) 2024-03-04T12:28:43.269 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-03-04T12:28:43.269 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-03-04T12:28:43.269 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-04T12:28:43.269 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-03-04T12:28:43.269 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-04T12:28:43.269 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-03-04T12:28:43.269 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:28:43.269 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:28:43.269 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:28:43.269 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:28:43.270 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:28:43.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:43.261+0000 7fba3f8398c0 -1 shutting down 2024-03-04T12:28:43.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:43.262+0000 7fb918f13640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70988, si_uid : 1000, si_addr0x3e80001154c, si_status0 2024-03-04T12:28:43.320 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SHUTDOWN (52 ms) 2024-03-04T12:28:43.320 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 19 tests from LibRGW (254 ms total) 2024-03-04T12:28:43.320 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:28:43.320 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:28:43.320 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 19 tests from 1 test suite ran. (254 ms total) 2024-03-04T12:28:43.320 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 19 tests. 2024-03-04T12:28:43.325 INFO:tasks.workunit.client.0.smithi110.stdout:phase 5.2 2024-03-04T12:28:43.354 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] Running 19 tests from 1 test suite. 2024-03-04T12:28:43.354 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment set-up. 2024-03-04T12:28:43.354 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 19 tests from LibRGW 2024-03-04T12:28:43.354 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.INIT 2024-03-04T12:28:43.361 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:28:43.361 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:28:43.724 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.INIT (370 ms) 2024-03-04T12:28:43.725 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.MOUNT 2024-03-04T12:28:43.725 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-04T12:28:43.725 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-04T12:28:43.725 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-03-04T12:28:43.725 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-04T12:28:43.732 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-03-04T12:28:43.732 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-03-04T12:28:43.732 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-03-04T12:28:43.732 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-04T12:28:43.733 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-03-04T12:28:43.733 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-03-04T12:28:43.733 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-03-04T12:28:43.733 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-03-04T12:28:43.733 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-03-04T12:28:43.733 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-03-04T12:28:43.733 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-03-04T12:28:43.733 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-04T12:28:43.733 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-04T12:28:43.733 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-03-04T12:28:43.733 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-03-04T12:28:43.734 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.WRITEV 2024-03-04T12:28:43.734 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-03-04T12:28:43.734 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.READV 2024-03-04T12:28:43.734 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.READV (0 ms) 2024-03-04T12:28:43.734 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-03-04T12:28:43.734 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-03-04T12:28:43.734 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-04T12:28:43.735 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-03-04T12:28:43.735 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-04T12:28:43.763 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.DELETE_BUCKET (28 ms) 2024-03-04T12:28:43.764 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-04T12:28:43.764 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-04T12:28:43.764 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-04T12:28:43.764 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-04T12:28:43.764 INFO:tasks.workunit.client.0.smithi110.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-04T12:28:43.764 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:43.756+0000 7f9cf81238c0 -1 shutting down 2024-03-04T12:28:43.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:43.757+0000 7f9bd1fae640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71605, si_uid : 1000, si_addr0x3e8000117b5, si_status0 2024-03-04T12:28:43.889 INFO:tasks.workunit.client.0.smithi110.stdout:[ OK ] LibRGW.SHUTDOWN (125 ms) 2024-03-04T12:28:43.889 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] 19 tests from LibRGW (534 ms total) 2024-03-04T12:28:43.889 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:28:43.889 INFO:tasks.workunit.client.0.smithi110.stdout:[----------] Global test environment tear-down 2024-03-04T12:28:43.889 INFO:tasks.workunit.client.0.smithi110.stdout:[==========] 19 tests from 1 test suite ran. (534 ms total) 2024-03-04T12:28:43.889 INFO:tasks.workunit.client.0.smithi110.stdout:[ PASSED ] 19 tests. 2024-03-04T12:28:43.895 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:28:43.895 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:28:43.935 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-03-04T12:28:43.936 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-03-04T12:28:43.936 DEBUG:teuthology.orchestra.run.smithi110:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-03-04T12:28:44.006 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' -z ']' 2024-03-04T12:28:44.006 INFO:tasks.workunit.client.0.smithi110.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-03-04T12:28:44.007 INFO:tasks.workunit.client.0.smithi110.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-03-04T12:28:44.007 INFO:tasks.workunit.client.0.smithi110.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-03-04T12:28:44.007 INFO:tasks.workunit.client.0.smithi110.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-03-04T12:28:44.007 INFO:tasks.workunit.client.0.smithi110.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-03-04T12:28:44.041 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:28:44.041 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:28:44.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.067+0000 7f9202d3c800 20 rados->read ofs=0 len=0 2024-03-04T12:28:44.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.068+0000 7f9202d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:44.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.068+0000 7f9202d3c800 20 realm 2024-03-04T12:28:44.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.068+0000 7f9202d3c800 20 rados->read ofs=0 len=0 2024-03-04T12:28:44.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.068+0000 7f9202d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:44.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.068+0000 7f9202d3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:28:44.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.068+0000 7f9202d3c800 20 rados->read ofs=0 len=0 2024-03-04T12:28:44.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.068+0000 7f9202d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:44.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.068+0000 7f9202d3c800 20 rados->read ofs=0 len=0 2024-03-04T12:28:44.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.069+0000 7f9202d3c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:28:44.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.069+0000 7f9202d3c800 20 rados->read ofs=0 len=0 2024-03-04T12:28:44.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.069+0000 7f9202d3c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:28:44.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.069+0000 7f9202d3c800 20 searching for the correct realm 2024-03-04T12:28:44.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.072+0000 7f91f62f9640 0 -- 172.21.15.110:0/1714002614 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f91f0039030 msgr2=0x7f91f0052940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:28:44.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.075+0000 7f91feafa640 0 -- 172.21.15.110:0/1714002614 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f91e80c9be0 msgr2=0x7f91e809f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:28:44.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.281+0000 7f9202d3c800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:28:44.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.281+0000 7f9202d3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:28:44.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.281+0000 7f9202d3c800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:28:44.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.281+0000 7f9202d3c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:28:44.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.281+0000 7f9202d3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:28:44.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.281+0000 7f9202d3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:28:44.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.281+0000 7f9202d3c800 20 rados->read ofs=0 len=0 2024-03-04T12:28:44.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.281+0000 7f9202d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:44.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.281+0000 7f9202d3c800 20 rados->read ofs=0 len=0 2024-03-04T12:28:44.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.282+0000 7f9202d3c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:28:44.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.282+0000 7f9202d3c800 20 rados->read ofs=0 len=0 2024-03-04T12:28:44.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.282+0000 7f9202d3c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:28:44.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.282+0000 7f9202d3c800 20 zone default found 2024-03-04T12:28:44.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.282+0000 7f9202d3c800 4 Realm: () 2024-03-04T12:28:44.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.282+0000 7f9202d3c800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:28:44.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.282+0000 7f9202d3c800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:28:44.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.282+0000 7f9202d3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:28:44.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.282+0000 7f9202d3c800 20 zonegroup default 2024-03-04T12:28:44.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.282+0000 7f9202d3c800 20 rados->read ofs=0 len=0 2024-03-04T12:28:44.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.282+0000 7f9202d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:44.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.282+0000 7f9202d3c800 20 rados->read ofs=0 len=0 2024-03-04T12:28:44.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.282+0000 7f9202d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:44.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.282+0000 7f9202d3c800 20 rados->read ofs=0 len=0 2024-03-04T12:28:44.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.283+0000 7f9202d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:44.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.283+0000 7f9202d3c800 20 started sync module instance, tier type = 2024-03-04T12:28:44.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.283+0000 7f9202d3c800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:28:44.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.291+0000 7f9202d3c800 20 add_watcher() i=0 2024-03-04T12:28:44.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.291+0000 7f9202d3c800 20 add_watcher() i=1 2024-03-04T12:28:44.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.291+0000 7f9202d3c800 20 add_watcher() i=2 2024-03-04T12:28:44.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.291+0000 7f9202d3c800 20 add_watcher() i=3 2024-03-04T12:28:44.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.291+0000 7f9202d3c800 20 add_watcher() i=4 2024-03-04T12:28:44.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.291+0000 7f9202d3c800 20 add_watcher() i=5 2024-03-04T12:28:44.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.291+0000 7f9202d3c800 20 add_watcher() i=6 2024-03-04T12:28:44.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.292+0000 7f9202d3c800 20 add_watcher() i=7 2024-03-04T12:28:44.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.292+0000 7f9202d3c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:28:44.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.294+0000 7f90b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:28:44.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.294+0000 7f9202d3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:28:44.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.294+0000 7f9202d3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:28:44.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.294+0000 7f9202d3c800 5 note: GC not initialized 2024-03-04T12:28:44.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.294+0000 7f902ffff640 20 reqs_thread_entry: start 2024-03-04T12:28:44.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.294+0000 7f9202d3c800 20 init_complete bucket index max shards: 11 2024-03-04T12:28:44.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.294+0000 7f9202d3c800 20 Filter name: none 2024-03-04T12:28:44.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.294+0000 7f902dffb640 20 reqs_thread_entry: start 2024-03-04T12:28:44.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.294+0000 7f9202d3c800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-03-04T12:28:44.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.294+0000 7f9202d3c800 20 rados->read ofs=0 len=0 2024-03-04T12:28:44.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.295+0000 7f9202d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:44.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.295+0000 7f9202d3c800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-03-04T12:28:44.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.295+0000 7f9202d3c800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-03-04T12:28:44.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.295+0000 7f9202d3c800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-03-04T12:28:44.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.295+0000 7f9202d3c800 20 rados->read ofs=0 len=0 2024-03-04T12:28:44.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.295+0000 7f9202d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:44.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.295+0000 7f9202d3c800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-03-04T12:28:44.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.295+0000 7f9202d3c800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-03-04T12:28:44.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.295+0000 7f9202d3c800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-03-04T12:28:44.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.295+0000 7f9202d3c800 20 rados->read ofs=0 len=0 2024-03-04T12:28:44.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.295+0000 7f9202d3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:28:44.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.295+0000 7f9202d3c800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-03-04T12:28:44.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.295+0000 7f9202d3c800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-03-04T12:28:44.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.295+0000 7f9202d3c800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-03-04T12:28:44.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.295+0000 7f9202d3c800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-03-04T12:28:44.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.296+0000 7f9202d3c800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-03-04T12:28:44.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.296+0000 7f9202d3c800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-03-04T12:28:44.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.296+0000 7f9202d3c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-03-04T12:28:44.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.297+0000 7f90e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1035087118338 cookie 93924108036176 notifier 5802 bl.length()=644 2024-03-04T12:28:44.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.297+0000 7f90e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-03-04T12:28:44.306 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.297+0000 7f90e27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-03-04T12:28:44.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.299+0000 7f9202d3c800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-03-04T12:28:44.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.299+0000 7f9202d3c800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-03-04T12:28:44.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.299+0000 7f9202d3c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-03-04T12:28:44.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.300+0000 7f90e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1035087118340 cookie 93924108019744 notifier 5802 bl.length()=187 2024-03-04T12:28:44.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.300+0000 7f90e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-03-04T12:28:44.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.300+0000 7f90e27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-03-04T12:28:44.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.302+0000 7f9202d3c800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-03-04T12:28:44.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.302+0000 7f9202d3c800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-03-04T12:28:44.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.302+0000 7f9202d3c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-03-04T12:28:44.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.303+0000 7f90e1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1035087118341 cookie 93924108019744 notifier 5802 bl.length()=197 2024-03-04T12:28:44.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.303+0000 7f90e1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-03-04T12:28:44.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.303+0000 7f90e1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-03-04T12:28:44.311 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:28:44.312 INFO:tasks.workunit.client.0.smithi110.stdout: "user_id": "ceph-test-maven", 2024-03-04T12:28:44.312 INFO:tasks.workunit.client.0.smithi110.stdout: "display_name": "maven test user", 2024-03-04T12:28:44.312 INFO:tasks.workunit.client.0.smithi110.stdout: "email": "sigv4@example.com", 2024-03-04T12:28:44.312 INFO:tasks.workunit.client.0.smithi110.stdout: "suspended": 0, 2024-03-04T12:28:44.312 INFO:tasks.workunit.client.0.smithi110.stdout: "max_buckets": 1000, 2024-03-04T12:28:44.312 INFO:tasks.workunit.client.0.smithi110.stdout: "subusers": [], 2024-03-04T12:28:44.312 INFO:tasks.workunit.client.0.smithi110.stdout: "keys": [ 2024-03-04T12:28:44.312 INFO:tasks.workunit.client.0.smithi110.stdout: { 2024-03-04T12:28:44.312 INFO:tasks.workunit.client.0.smithi110.stdout: "user": "ceph-test-maven", 2024-03-04T12:28:44.312 INFO:tasks.workunit.client.0.smithi110.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-03-04T12:28:44.312 INFO:tasks.workunit.client.0.smithi110.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-03-04T12:28:44.312 INFO:tasks.workunit.client.0.smithi110.stdout: "active": true 2024-03-04T12:28:44.312 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:28:44.312 INFO:tasks.workunit.client.0.smithi110.stdout: ], 2024-03-04T12:28:44.313 INFO:tasks.workunit.client.0.smithi110.stdout: "swift_keys": [], 2024-03-04T12:28:44.313 INFO:tasks.workunit.client.0.smithi110.stdout: "caps": [], 2024-03-04T12:28:44.313 INFO:tasks.workunit.client.0.smithi110.stdout: "op_mask": "read, write, delete", 2024-03-04T12:28:44.313 INFO:tasks.workunit.client.0.smithi110.stdout: "default_placement": "", 2024-03-04T12:28:44.313 INFO:tasks.workunit.client.0.smithi110.stdout: "default_storage_class": "", 2024-03-04T12:28:44.313 INFO:tasks.workunit.client.0.smithi110.stdout: "placement_tags": [], 2024-03-04T12:28:44.313 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_quota": { 2024-03-04T12:28:44.313 INFO:tasks.workunit.client.0.smithi110.stdout: "enabled": false, 2024-03-04T12:28:44.313 INFO:tasks.workunit.client.0.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:28:44.313 INFO:tasks.workunit.client.0.smithi110.stdout: "max_size": -1, 2024-03-04T12:28:44.313 INFO:tasks.workunit.client.0.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:28:44.313 INFO:tasks.workunit.client.0.smithi110.stdout: "max_objects": -1 2024-03-04T12:28:44.313 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:44.313 INFO:tasks.workunit.client.0.smithi110.stdout: "user_quota": { 2024-03-04T12:28:44.313 INFO:tasks.workunit.client.0.smithi110.stdout: "enabled": false, 2024-03-04T12:28:44.314 INFO:tasks.workunit.client.0.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:28:44.314 INFO:tasks.workunit.client.0.smithi110.stdout: "max_size": -1, 2024-03-04T12:28:44.314 INFO:tasks.workunit.client.0.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:28:44.314 INFO:tasks.workunit.client.0.smithi110.stdout: "max_objects": -1 2024-03-04T12:28:44.314 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:28:44.314 INFO:tasks.workunit.client.0.smithi110.stdout: "temp_url_keys": [], 2024-03-04T12:28:44.314 INFO:tasks.workunit.client.0.smithi110.stdout: "type": "rgw", 2024-03-04T12:28:44.314 INFO:tasks.workunit.client.0.smithi110.stdout: "mfa_ids": [] 2024-03-04T12:28:44.314 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:28:44.314 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:28:44.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.305+0000 7f90b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:28:44.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.307+0000 7f9202d3c800 20 remove_watcher() i=0 2024-03-04T12:28:44.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.307+0000 7f9202d3c800 2 removed watcher, disabling cache 2024-03-04T12:28:44.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.308+0000 7f9202d3c800 20 remove_watcher() i=1 2024-03-04T12:28:44.317 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.309+0000 7f9202d3c800 20 remove_watcher() i=2 2024-03-04T12:28:44.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.310+0000 7f9202d3c800 20 remove_watcher() i=3 2024-03-04T12:28:44.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.311+0000 7f9202d3c800 20 remove_watcher() i=4 2024-03-04T12:28:44.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.312+0000 7f9202d3c800 20 remove_watcher() i=5 2024-03-04T12:28:44.320 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.313+0000 7f9202d3c800 20 remove_watcher() i=6 2024-03-04T12:28:44.321 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:28:44.314+0000 7f9202d3c800 20 remove_watcher() i=7 2024-03-04T12:28:44.331 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' -z ']' 2024-03-04T12:28:44.331 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-03-04T12:28:44.331 INFO:tasks.workunit.client.0.smithi110.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-03-04T12:28:44.332 INFO:tasks.workunit.client.0.smithi110.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi110.front.sepia.ceph.com:443 2024-03-04T12:28:44.332 INFO:tasks.workunit.client.0.smithi110.stderr:+ RGW_HTTP_ENDPOINT_URL=https://smithi110.front.sepia.ceph.com:443 2024-03-04T12:28:44.332 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-03-04T12:28:44.332 INFO:tasks.workunit.client.0.smithi110.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-03-04T12:28:44.332 INFO:tasks.workunit.client.0.smithi110.stderr:+ ./mvnw clean package 2024-03-04T12:28:44.340 INFO:tasks.workunit.client.0.smithi110.stdout:Warning: JAVA_HOME environment variable is not set. 2024-03-04T12:28:46.940 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Scanning for projects... 2024-03-04T12:28:47.073 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-03-04T12:28:47.179 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 51 kB/s) 2024-03-04T12:28:47.193 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-03-04T12:28:47.244 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 32/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.6 MB/s) 2024-03-04T12:28:47.255 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-03-04T12:28:47.281 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.1 MB/s) 2024-03-04T12:28:47.310 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:28:47.310 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-03-04T12:28:47.310 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Building jcksum 1.0 2024-03-04T12:28:47.310 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] from pom.xml 2024-03-04T12:28:47.310 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-03-04T12:28:47.312 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-03-04T12:28:47.332 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 265 kB/s) 2024-03-04T12:28:47.338 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-03-04T12:28:47.358 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 521 kB/s) 2024-03-04T12:28:47.361 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-03-04T12:28:47.381 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.3 MB/s) 2024-03-04T12:28:47.388 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-03-04T12:28:47.407 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.0 MB/s) 2024-03-04T12:28:47.420 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-03-04T12:28:47.439 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 1.8 MB/s) 2024-03-04T12:28:47.446 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-03-04T12:28:47.464 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 480 kB/s) 2024-03-04T12:28:47.467 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-03-04T12:28:47.484 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 450 kB/s) 2024-03-04T12:28:47.486 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-03-04T12:28:47.505 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.5 MB/s) 2024-03-04T12:28:47.511 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-03-04T12:28:47.529 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.1 MB/s) 2024-03-04T12:28:47.536 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-03-04T12:28:47.555 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.6 MB/s) 2024-03-04T12:28:47.560 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-03-04T12:28:47.578 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 545 kB/s) 2024-03-04T12:28:47.584 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-03-04T12:28:47.604 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.3 MB/s) 2024-03-04T12:28:47.612 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-03-04T12:28:47.631 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 296 kB/s) 2024-03-04T12:28:47.633 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-03-04T12:28:47.651 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.2 MB/s) 2024-03-04T12:28:47.656 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-03-04T12:28:47.675 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.5 MB/s) 2024-03-04T12:28:47.681 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-03-04T12:28:47.700 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.3 MB/s) 2024-03-04T12:28:47.708 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-03-04T12:28:47.726 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 313 kB/s) 2024-03-04T12:28:47.730 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-03-04T12:28:47.749 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.2 MB/s) 2024-03-04T12:28:47.759 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-03-04T12:28:47.777 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 376 kB/s) 2024-03-04T12:28:47.781 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-03-04T12:28:47.799 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 550 kB/s) 2024-03-04T12:28:47.801 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-03-04T12:28:47.820 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.4 MB/s) 2024-03-04T12:28:47.824 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-03-04T12:28:47.842 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.1 MB/s) 2024-03-04T12:28:47.849 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-03-04T12:28:47.867 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.4 MB/s) 2024-03-04T12:28:47.885 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-03-04T12:28:47.903 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 338 kB/s) 2024-03-04T12:28:47.906 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-03-04T12:28:47.924 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.1 MB/s) 2024-03-04T12:28:47.930 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-03-04T12:28:47.949 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-03-04T12:28:47.959 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-03-04T12:28:47.977 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 211 kB/s) 2024-03-04T12:28:47.980 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-03-04T12:28:47.998 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 86 kB/s) 2024-03-04T12:28:48.001 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-03-04T12:28:48.018 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 124 kB/s) 2024-03-04T12:28:48.022 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-03-04T12:28:48.040 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 214 kB/s) 2024-03-04T12:28:48.044 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-03-04T12:28:48.062 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 179 kB/s) 2024-03-04T12:28:48.066 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-03-04T12:28:48.083 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 609 kB/s) 2024-03-04T12:28:48.087 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-03-04T12:28:48.105 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 94 kB/s) 2024-03-04T12:28:48.108 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-03-04T12:28:48.126 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 212 kB/s) 2024-03-04T12:28:48.130 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-03-04T12:28:48.148 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 273 kB/s) 2024-03-04T12:28:48.151 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-03-04T12:28:48.168 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 72 kB/s) 2024-03-04T12:28:48.170 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-03-04T12:28:48.187 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 226 kB/s) 2024-03-04T12:28:48.189 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-03-04T12:28:48.206 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 812 kB/s) 2024-03-04T12:28:48.209 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-03-04T12:28:48.226 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 204 kB/s) 2024-03-04T12:28:48.229 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-03-04T12:28:48.247 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 136 kB/s) 2024-03-04T12:28:48.251 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-03-04T12:28:48.268 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 162 kB/s) 2024-03-04T12:28:48.272 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-03-04T12:28:48.289 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 412 kB/s) 2024-03-04T12:28:48.292 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-03-04T12:28:48.310 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 303 kB/s) 2024-03-04T12:28:48.314 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-03-04T12:28:48.331 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 194 kB/s) 2024-03-04T12:28:48.335 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-03-04T12:28:48.352 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 244 kB/s) 2024-03-04T12:28:48.354 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-03-04T12:28:48.372 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 134 kB/s) 2024-03-04T12:28:48.376 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-03-04T12:28:48.393 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 358 kB/s) 2024-03-04T12:28:48.396 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-03-04T12:28:48.413 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 357 kB/s) 2024-03-04T12:28:48.416 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-03-04T12:28:48.434 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 175 kB/s) 2024-03-04T12:28:48.437 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-03-04T12:28:48.455 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 193 kB/s) 2024-03-04T12:28:48.459 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-03-04T12:28:48.476 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 227 kB/s) 2024-03-04T12:28:48.478 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-03-04T12:28:48.495 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 99 kB/s) 2024-03-04T12:28:48.498 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-03-04T12:28:48.515 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 389 kB/s) 2024-03-04T12:28:48.517 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-03-04T12:28:48.534 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 964 kB/s) 2024-03-04T12:28:48.536 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-03-04T12:28:48.554 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.9 MB/s) 2024-03-04T12:28:48.557 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-03-04T12:28:48.574 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.0 MB/s) 2024-03-04T12:28:48.577 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-03-04T12:28:48.594 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 292 kB/s) 2024-03-04T12:28:48.595 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-03-04T12:28:48.612 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 775 kB/s) 2024-03-04T12:28:48.616 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-03-04T12:28:48.634 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 822 kB/s) 2024-03-04T12:28:48.635 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-03-04T12:28:48.655 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 65/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.6 MB/s) 2024-03-04T12:28:48.660 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-03-04T12:28:48.677 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 922 kB/s) 2024-03-04T12:28:48.681 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-03-04T12:28:48.698 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 908 kB/s) 2024-03-04T12:28:48.700 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-03-04T12:28:48.721 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 62/79 kB Progress (1): 78/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.0 MB/s) 2024-03-04T12:28:48.724 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-03-04T12:28:48.742 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.1 MB/s) 2024-03-04T12:28:48.745 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-03-04T12:28:48.762 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.2 MB/s) 2024-03-04T12:28:48.765 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-03-04T12:28:48.784 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 53/78 kB Progress (1): 69/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.9 MB/s) 2024-03-04T12:28:48.790 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-03-04T12:28:48.806 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 226 kB/s) 2024-03-04T12:28:48.808 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-03-04T12:28:48.825 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 812 kB/s) 2024-03-04T12:28:48.828 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-03-04T12:28:48.845 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 189 kB/s) 2024-03-04T12:28:48.848 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-03-04T12:28:48.864 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 187 kB/s) 2024-03-04T12:28:48.866 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-03-04T12:28:48.883 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 120 kB/s) 2024-03-04T12:28:48.885 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-03-04T12:28:48.901 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 167 kB/s) 2024-03-04T12:28:48.903 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-03-04T12:28:48.920 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 90 kB/s) 2024-03-04T12:28:48.923 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-03-04T12:28:48.940 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 177 kB/s) 2024-03-04T12:28:48.942 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-03-04T12:28:48.958 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 188 kB/s) 2024-03-04T12:28:48.960 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-03-04T12:28:48.977 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 200 kB/s) 2024-03-04T12:28:48.979 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-03-04T12:28:48.996 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 64 kB/s) 2024-03-04T12:28:48.999 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-03-04T12:28:49.016 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 57 kB/s) 2024-03-04T12:28:49.018 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-03-04T12:28:49.035 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 180 kB/s) 2024-03-04T12:28:49.037 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-03-04T12:28:49.054 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 190 kB/s) 2024-03-04T12:28:49.056 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-03-04T12:28:49.076 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 172 kB/s) 2024-03-04T12:28:49.078 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-03-04T12:28:49.094 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.7/3.4 kB Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 202 kB/s) 2024-03-04T12:28:49.096 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-03-04T12:28:49.112 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 189 kB/s) 2024-03-04T12:28:49.129 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-03-04T12:28:49.253 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 26 MB/s) 2024-03-04T12:28:49.255 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-03-04T12:28:49.255 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-03-04T12:28:49.255 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-03-04T12:28:49.255 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-03-04T12:28:49.256 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-03-04T12:28:49.275 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 1.7 MB/s) 2024-03-04T12:28:49.275 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-03-04T12:28:49.294 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 411 kB/s) 2024-03-04T12:28:49.294 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-03-04T12:28:49.311 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (1): 4.1/16 kB Progress (1): 5.5/16 kB Progress (1): 6.9/16 kB Progress (1): 8.3/16 kB Progress (1): 9.7/16 kB Progress (1): 11/16 kB Progress (1): 12/16 kB Progress (1): 14/16 kB Progress (1): 15/16 kB Progress (1): 16 kB Progress (2): 16 kB | 1.4/49 kB Progress (2): 16 kB | 2.8/49 kB Progress (2): 16 kB | 4.1/49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 282 kB/s) 2024-03-04T12:28:49.311 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 5.5/49 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-03-04T12:28:49.325 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 5.5/49 kB | 16/71 kB Progress (2): 6.9/49 kB | 16/71 kB Progress (2): 8.3/49 kB | 16/71 kB Progress (2): 9.7/49 kB | 16/71 kB Progress (2): 11/49 kB | 16/71 kB Progress (2): 12/49 kB | 16/71 kB Progress (2): 14/49 kB | 16/71 kB Progress (2): 15/49 kB | 16/71 kB Progress (3): 15/49 kB | 16/71 kB | 16/782 kB Progress (3): 17/49 kB | 16/71 kB | 16/782 kB Progress (3): 18/49 kB | 16/71 kB | 16/782 kB Progress (3): 19/49 kB | 16/71 kB | 16/782 kB Progress (3): 19/49 kB | 16/71 kB | 33/782 kB Progress (3): 19/49 kB | 16/71 kB | 49/782 kB Progress (3): 21/49 kB | 16/71 kB | 49/782 kB Progress (3): 22/49 kB | 16/71 kB | 49/782 kB Progress (3): 23/49 kB | 16/71 kB | 49/782 kB Progress (3): 25/49 kB | 16/71 kB | 49/782 kB Progress (3): 25/49 kB | 16/71 kB | 66/782 kB Progress (3): 26/49 kB | 16/71 kB | 66/782 kB Progress (3): 26/49 kB | 16/71 kB | 82/782 kB Progress (3): 28/49 kB | 16/71 kB | 82/782 kB Progress (3): 29/49 kB | 16/71 kB | 82/782 kB Progress (3): 30/49 kB | 16/71 kB | 82/782 kB Progress (4): 30/49 kB | 16/71 kB | 82/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 98/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 115/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 131/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 147/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 164/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 180/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 197/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 213/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 229/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 246/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 256/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 272/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 289/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 305/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 321/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 338/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 354/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 370/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 387/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 403/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 420/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 436/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 452/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 469/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 485/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 502/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 518/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 534/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 551/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 567/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 583/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 600/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 616/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 633/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 649/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 665/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 682/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 698/782 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 715/782 kB | 16/98 kB Progress (4): 30/49 kB | 33/71 kB | 715/782 kB | 16/98 kB Progress (4): 30/49 kB | 33/71 kB | 731/782 kB | 16/98 kB Progress (4): 30/49 kB | 33/71 kB | 747/782 kB | 16/98 kB Progress (4): 32/49 kB | 33/71 kB | 747/782 kB | 16/98 kB Progress (4): 33/49 kB | 33/71 kB | 747/782 kB | 16/98 kB Progress (4): 34/49 kB | 33/71 kB | 747/782 kB | 16/98 kB Progress (4): 34/49 kB | 33/71 kB | 764/782 kB | 16/98 kB Progress (4): 36/49 kB | 33/71 kB | 764/782 kB | 16/98 kB Progress (4): 36/49 kB | 33/71 kB | 780/782 kB | 16/98 kB Progress (4): 37/49 kB | 33/71 kB | 780/782 kB | 16/98 kB Progress (4): 37/49 kB | 33/71 kB | 782 kB | 16/98 kB Progress (4): 39/49 kB | 33/71 kB | 782 kB | 16/98 kB Progress (4): 40/49 kB | 33/71 kB | 782 kB | 16/98 kB Progress (4): 41/49 kB | 33/71 kB | 782 kB | 16/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 11 MB/s) 2024-03-04T12:28:49.325 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-03-04T12:28:49.328 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (4): 41/49 kB | 33/71 kB | 16/98 kB | 1.4/11 kB Progress (4): 41/49 kB | 33/71 kB | 16/98 kB | 2.8/11 kB Progress (4): 41/49 kB | 33/71 kB | 16/98 kB | 4.1/11 kB Progress (4): 43/49 kB | 33/71 kB | 16/98 kB | 4.1/11 kB Progress (4): 43/49 kB | 33/71 kB | 16/98 kB | 5.5/11 kB Progress (4): 44/49 kB | 33/71 kB | 16/98 kB | 5.5/11 kB Progress (4): 44/49 kB | 33/71 kB | 16/98 kB | 6.9/11 kB Progress (4): 46/49 kB | 33/71 kB | 16/98 kB | 6.9/11 kB Progress (4): 46/49 kB | 33/71 kB | 16/98 kB | 8.3/11 kB Progress (4): 46/49 kB | 49/71 kB | 16/98 kB | 8.3/11 kB Progress (4): 46/49 kB | 49/71 kB | 16/98 kB | 9.7/11 kB Progress (4): 47/49 kB | 49/71 kB | 16/98 kB | 9.7/11 kB Progress (4): 47/49 kB | 49/71 kB | 16/98 kB | 11/11 kB Progress (4): 48/49 kB | 49/71 kB | 16/98 kB | 11/11 kB Progress (4): 48/49 kB | 49/71 kB | 16/98 kB | 11 kB Progress (4): 49 kB | 49/71 kB | 16/98 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 156 kB/s) 2024-03-04T12:28:49.329 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-03-04T12:28:49.329 INFO:tasks.workunit.client.0.smithi110.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 674 kB/s) 2024-03-04T12:28:49.329 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-03-04T12:28:49.340 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 49/71 kB | 33/98 kB Progress (2): 49/71 kB | 49/98 kB Progress (2): 66/71 kB | 49/98 kB Progress (2): 71 kB | 49/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 820 kB/s) 2024-03-04T12:28:49.340 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-03-04T12:28:49.346 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 49/98 kB | 16/205 kB Progress (2): 49/98 kB | 33/205 kB Progress (2): 49/98 kB | 49/205 kB Progress (2): 49/98 kB | 66/205 kB Progress (2): 49/98 kB | 82/205 kB Progress (2): 66/98 kB | 82/205 kB Progress (2): 66/98 kB | 98/205 kB Progress (2): 66/98 kB | 115/205 kB Progress (2): 66/98 kB | 131/205 kB Progress (2): 66/98 kB | 147/205 kB Progress (2): 66/98 kB | 164/205 kB Progress (2): 66/98 kB | 180/205 kB Progress (2): 66/98 kB | 197/205 kB Progress (2): 82/98 kB | 197/205 kB Progress (3): 82/98 kB | 197/205 kB | 16/30 kB Progress (3): 82/98 kB | 205 kB | 16/30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.3 MB/s) 2024-03-04T12:28:49.346 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-03-04T12:28:49.348 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 98 kB | 16/30 kB Progress (2): 98 kB | 30 kB Progress (3): 98 kB | 30 kB | 16/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.0 MB/s) 2024-03-04T12:28:49.348 INFO:tasks.workunit.client.0.smithi110.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 328 kB/s) 2024-03-04T12:28:49.348 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-03-04T12:28:49.348 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-03-04T12:28:49.363 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 16/81 kB | 16/798 kB Progress (2): 33/81 kB | 16/798 kB Progress (2): 33/81 kB | 33/798 kB Progress (2): 33/81 kB | 49/798 kB Progress (2): 49/81 kB | 49/798 kB Progress (3): 49/81 kB | 49/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 124 kB/s) 2024-03-04T12:28:49.363 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-03-04T12:28:49.366 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 49/81 kB | 66/798 kB Progress (2): 66/81 kB | 66/798 kB Progress (2): 81 kB | 66/798 kB Progress (3): 81 kB | 66/798 kB | 16/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 739 kB/s) 2024-03-04T12:28:49.366 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-03-04T12:28:49.381 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (3): 66/798 kB | 16/151 kB | 16/182 kB Progress (3): 66/798 kB | 33/151 kB | 16/182 kB Progress (3): 66/798 kB | 49/151 kB | 16/182 kB Progress (3): 66/798 kB | 49/151 kB | 33/182 kB Progress (3): 66/798 kB | 66/151 kB | 33/182 kB Progress (3): 66/798 kB | 66/151 kB | 49/182 kB Progress (3): 66/798 kB | 82/151 kB | 49/182 kB Progress (3): 66/798 kB | 98/151 kB | 49/182 kB Progress (3): 82/798 kB | 98/151 kB | 49/182 kB Progress (3): 98/798 kB | 98/151 kB | 49/182 kB Progress (3): 115/798 kB | 98/151 kB | 49/182 kB Progress (3): 131/798 kB | 98/151 kB | 49/182 kB Progress (3): 147/798 kB | 98/151 kB | 49/182 kB Progress (3): 164/798 kB | 98/151 kB | 49/182 kB Progress (4): 164/798 kB | 98/151 kB | 49/182 kB | 16/27 kB Progress (4): 180/798 kB | 98/151 kB | 49/182 kB | 16/27 kB Progress (4): 180/798 kB | 98/151 kB | 49/182 kB | 27 kB Progress (4): 180/798 kB | 98/151 kB | 66/182 kB | 27 kB Progress (4): 180/798 kB | 115/151 kB | 66/182 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 220 kB/s) 2024-03-04T12:28:49.381 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-03-04T12:28:49.383 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (3): 197/798 kB | 115/151 kB | 66/182 kB Progress (3): 197/798 kB | 131/151 kB | 66/182 kB Progress (3): 197/798 kB | 131/151 kB | 82/182 kB Progress (3): 213/798 kB | 131/151 kB | 82/182 kB Progress (3): 213/798 kB | 147/151 kB | 82/182 kB Progress (3): 213/798 kB | 147/151 kB | 98/182 kB Progress (3): 213/798 kB | 151 kB | 98/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-03-04T12:28:49.383 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-03-04T12:28:49.384 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (3): 213/798 kB | 98/182 kB | 16/30 kB Progress (3): 213/798 kB | 98/182 kB | 30 kB Progress (3): 213/798 kB | 115/182 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 237 kB/s) 2024-03-04T12:28:49.384 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-03-04T12:28:49.390 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 213/798 kB | 131/182 kB Progress (2): 213/798 kB | 147/182 kB Progress (2): 213/798 kB | 164/182 kB Progress (2): 229/798 kB | 164/182 kB Progress (2): 246/798 kB | 164/182 kB Progress (2): 246/798 kB | 180/182 kB Progress (2): 246/798 kB | 182 kB Progress (2): 262/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.4 MB/s) 2024-03-04T12:28:49.390 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 279/798 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-03-04T12:28:49.401 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 295/798 kB Progress (1): 311/798 kB Progress (1): 328/798 kB Progress (1): 344/798 kB Progress (1): 360/798 kB Progress (1): 377/798 kB Progress (1): 393/798 kB Progress (1): 410/798 kB Progress (1): 426/798 kB Progress (1): 442/798 kB Progress (1): 459/798 kB Progress (1): 475/798 kB Progress (1): 492/798 kB Progress (2): 492/798 kB | 16/385 kB Progress (2): 492/798 kB | 33/385 kB Progress (2): 492/798 kB | 49/385 kB Progress (2): 492/798 kB | 66/385 kB Progress (2): 492/798 kB | 82/385 kB Progress (2): 492/798 kB | 98/385 kB Progress (2): 492/798 kB | 115/385 kB Progress (2): 492/798 kB | 131/385 kB Progress (2): 492/798 kB | 147/385 kB Progress (2): 492/798 kB | 164/385 kB Progress (3): 492/798 kB | 164/385 kB | 13 kB Progress (3): 492/798 kB | 180/385 kB | 13 kB Progress (3): 492/798 kB | 197/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 91 kB/s) 2024-03-04T12:28:49.401 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 492/798 kB | 213/385 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-03-04T12:28:49.405 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 492/798 kB | 229/385 kB Progress (2): 492/798 kB | 246/385 kB Progress (2): 492/798 kB | 256/385 kB Progress (2): 492/798 kB | 272/385 kB Progress (2): 492/798 kB | 289/385 kB Progress (2): 492/798 kB | 305/385 kB Progress (2): 508/798 kB | 305/385 kB Progress (2): 508/798 kB | 321/385 kB Progress (3): 508/798 kB | 321/385 kB | 16/75 kB Progress (3): 508/798 kB | 338/385 kB | 16/75 kB Progress (3): 508/798 kB | 354/385 kB | 16/75 kB Progress (3): 524/798 kB | 354/385 kB | 16/75 kB Progress (3): 524/798 kB | 354/385 kB | 32/75 kB Progress (3): 524/798 kB | 370/385 kB | 32/75 kB Progress (3): 541/798 kB | 370/385 kB | 32/75 kB Progress (3): 541/798 kB | 385 kB | 32/75 kB Progress (3): 557/798 kB | 385 kB | 32/75 kB Progress (3): 573/798 kB | 385 kB | 32/75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.6 MB/s) 2024-03-04T12:28:49.405 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 585/798 kB | 32/75 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-03-04T12:28:49.407 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 585/798 kB | 49/75 kB Progress (2): 601/798 kB | 49/75 kB Progress (2): 617/798 kB | 49/75 kB Progress (2): 634/798 kB | 49/75 kB Progress (2): 650/798 kB | 49/75 kB Progress (2): 650/798 kB | 65/75 kB Progress (2): 650/798 kB | 75 kB Progress (2): 667/798 kB | 75 kB Progress (2): 683/798 kB | 75 kB Progress (2): 699/798 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 497 kB/s) 2024-03-04T12:28:49.407 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-03-04T12:28:49.410 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 716/798 kB Progress (1): 732/798 kB Progress (1): 749/798 kB Progress (1): 765/798 kB Progress (1): 781/798 kB Progress (2): 781/798 kB | 16/780 kB Progress (2): 798/798 kB | 16/780 kB Progress (2): 798 kB | 16/780 kB Progress (2): 798 kB | 33/780 kB Progress (2): 798 kB | 49/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 5.2 MB/s) 2024-03-04T12:28:49.410 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 66/780 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-03-04T12:28:49.430 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 82/780 kB Progress (1): 98/780 kB Progress (1): 115/780 kB Progress (1): 131/780 kB Progress (1): 147/780 kB Progress (1): 164/780 kB Progress (1): 180/780 kB Progress (1): 197/780 kB Progress (1): 213/780 kB Progress (1): 229/780 kB Progress (1): 246/780 kB Progress (2): 246/780 kB | 16/501 kB Progress (2): 246/780 kB | 33/501 kB Progress (2): 246/780 kB | 49/501 kB Progress (2): 246/780 kB | 63/501 kB Progress (2): 246/780 kB | 80/501 kB Progress (2): 246/780 kB | 96/501 kB Progress (2): 246/780 kB | 112/501 kB Progress (2): 246/780 kB | 129/501 kB Progress (2): 246/780 kB | 145/501 kB Progress (2): 246/780 kB | 162/501 kB Progress (2): 256/780 kB | 162/501 kB Progress (2): 256/780 kB | 178/501 kB Progress (2): 272/780 kB | 178/501 kB Progress (2): 272/780 kB | 194/501 kB Progress (2): 289/780 kB | 194/501 kB Progress (2): 289/780 kB | 211/501 kB Progress (2): 289/780 kB | 227/501 kB Progress (2): 289/780 kB | 243/501 kB Progress (2): 289/780 kB | 260/501 kB Progress (2): 289/780 kB | 276/501 kB Progress (2): 289/780 kB | 293/501 kB Progress (2): 305/780 kB | 293/501 kB Progress (2): 305/780 kB | 309/501 kB Progress (2): 321/780 kB | 309/501 kB Progress (2): 321/780 kB | 325/501 kB Progress (2): 321/780 kB | 342/501 kB Progress (2): 321/780 kB | 358/501 kB Progress (2): 338/780 kB | 358/501 kB Progress (2): 338/780 kB | 375/501 kB Progress (2): 354/780 kB | 375/501 kB Progress (2): 354/780 kB | 391/501 kB Progress (2): 354/780 kB | 407/501 kB Progress (2): 370/780 kB | 407/501 kB Progress (2): 387/780 kB | 407/501 kB Progress (2): 387/780 kB | 424/501 kB Progress (2): 387/780 kB | 440/501 kB Progress (2): 403/780 kB | 440/501 kB Progress (3): 403/780 kB | 440/501 kB | 16/41 kB Progress (3): 403/780 kB | 456/501 kB | 16/41 kB Progress (3): 420/780 kB | 456/501 kB | 16/41 kB Progress (3): 420/780 kB | 456/501 kB | 33/41 kB Progress (3): 436/780 kB | 456/501 kB | 33/41 kB Progress (3): 436/780 kB | 473/501 kB | 33/41 kB Progress (3): 436/780 kB | 473/501 kB | 41 kB Progress (3): 452/780 kB | 473/501 kB | 41 kB Progress (3): 469/780 kB | 473/501 kB | 41 kB Progress (3): 469/780 kB | 489/501 kB | 41 kB Progress (3): 485/780 kB | 489/501 kB | 41 kB Progress (3): 485/780 kB | 501 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 239 kB/s) 2024-03-04T12:28:49.430 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 502/780 kB | 501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-03-04T12:28:49.431 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 518/780 kB | 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.9 MB/s) 2024-03-04T12:28:49.431 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-03-04T12:28:49.440 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 534/780 kB Progress (1): 551/780 kB Progress (1): 567/780 kB Progress (1): 583/780 kB Progress (2): 583/780 kB | 16/354 kB Progress (2): 600/780 kB | 16/354 kB Progress (2): 616/780 kB | 16/354 kB Progress (2): 616/780 kB | 33/354 kB Progress (2): 633/780 kB | 33/354 kB Progress (2): 649/780 kB | 33/354 kB Progress (2): 665/780 kB | 33/354 kB Progress (2): 665/780 kB | 49/354 kB Progress (2): 682/780 kB | 49/354 kB Progress (2): 698/780 kB | 49/354 kB Progress (2): 698/780 kB | 66/354 kB Progress (2): 715/780 kB | 66/354 kB Progress (2): 731/780 kB | 66/354 kB Progress (2): 731/780 kB | 82/354 kB Progress (2): 747/780 kB | 82/354 kB Progress (3): 747/780 kB | 82/354 kB | 16/329 kB Progress (3): 747/780 kB | 98/354 kB | 16/329 kB Progress (3): 747/780 kB | 115/354 kB | 16/329 kB Progress (3): 747/780 kB | 115/354 kB | 33/329 kB Progress (3): 747/780 kB | 115/354 kB | 49/329 kB Progress (3): 747/780 kB | 131/354 kB | 49/329 kB Progress (3): 747/780 kB | 131/354 kB | 66/329 kB Progress (3): 747/780 kB | 131/354 kB | 82/329 kB Progress (3): 747/780 kB | 131/354 kB | 98/329 kB Progress (3): 747/780 kB | 147/354 kB | 98/329 kB Progress (3): 747/780 kB | 147/354 kB | 115/329 kB Progress (3): 747/780 kB | 147/354 kB | 131/329 kB Progress (3): 764/780 kB | 147/354 kB | 131/329 kB Progress (3): 780/780 kB | 147/354 kB | 131/329 kB Progress (3): 780 kB | 147/354 kB | 131/329 kB Progress (3): 780 kB | 147/354 kB | 147/329 kB Progress (3): 780 kB | 147/354 kB | 164/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.3 MB/s) 2024-03-04T12:28:49.440 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-03-04T12:28:49.456 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 147/354 kB | 180/329 kB Progress (2): 147/354 kB | 197/329 kB Progress (2): 147/354 kB | 213/329 kB Progress (2): 147/354 kB | 229/329 kB Progress (2): 147/354 kB | 246/329 kB Progress (3): 147/354 kB | 246/329 kB | 16/586 kB Progress (3): 164/354 kB | 246/329 kB | 16/586 kB Progress (3): 164/354 kB | 246/329 kB | 33/586 kB Progress (3): 180/354 kB | 246/329 kB | 33/586 kB Progress (3): 180/354 kB | 246/329 kB | 49/586 kB Progress (3): 180/354 kB | 246/329 kB | 63/586 kB Progress (3): 180/354 kB | 246/329 kB | 80/586 kB Progress (3): 180/354 kB | 246/329 kB | 96/586 kB Progress (3): 180/354 kB | 246/329 kB | 113/586 kB Progress (3): 180/354 kB | 246/329 kB | 129/586 kB Progress (3): 197/354 kB | 246/329 kB | 129/586 kB Progress (3): 197/354 kB | 246/329 kB | 145/586 kB Progress (3): 197/354 kB | 246/329 kB | 162/586 kB Progress (3): 197/354 kB | 246/329 kB | 178/586 kB Progress (3): 213/354 kB | 246/329 kB | 178/586 kB Progress (3): 213/354 kB | 246/329 kB | 194/586 kB Progress (3): 213/354 kB | 246/329 kB | 211/586 kB Progress (3): 213/354 kB | 246/329 kB | 227/586 kB Progress (3): 213/354 kB | 246/329 kB | 244/586 kB Progress (3): 213/354 kB | 246/329 kB | 260/586 kB Progress (3): 229/354 kB | 246/329 kB | 260/586 kB Progress (3): 229/354 kB | 246/329 kB | 276/586 kB Progress (3): 246/354 kB | 246/329 kB | 276/586 kB Progress (3): 246/354 kB | 246/329 kB | 293/586 kB Progress (3): 246/354 kB | 246/329 kB | 309/586 kB Progress (3): 246/354 kB | 246/329 kB | 326/586 kB Progress (3): 246/354 kB | 246/329 kB | 342/586 kB Progress (3): 262/354 kB | 246/329 kB | 342/586 kB Progress (3): 262/354 kB | 246/329 kB | 358/586 kB Progress (3): 279/354 kB | 246/329 kB | 358/586 kB Progress (3): 279/354 kB | 246/329 kB | 375/586 kB Progress (3): 279/354 kB | 246/329 kB | 391/586 kB Progress (3): 279/354 kB | 246/329 kB | 407/586 kB Progress (3): 279/354 kB | 246/329 kB | 424/586 kB Progress (3): 279/354 kB | 262/329 kB | 424/586 kB Progress (3): 279/354 kB | 262/329 kB | 440/586 kB Progress (3): 279/354 kB | 279/329 kB | 440/586 kB Progress (3): 279/354 kB | 279/329 kB | 457/586 kB Progress (3): 279/354 kB | 295/329 kB | 457/586 kB Progress (3): 279/354 kB | 295/329 kB | 473/586 kB Progress (3): 279/354 kB | 295/329 kB | 489/586 kB Progress (3): 279/354 kB | 295/329 kB | 506/586 kB Progress (3): 295/354 kB | 295/329 kB | 506/586 kB Progress (3): 295/354 kB | 295/329 kB | 522/586 kB Progress (3): 311/354 kB | 295/329 kB | 522/586 kB Progress (3): 311/354 kB | 295/329 kB | 539/586 kB Progress (3): 311/354 kB | 311/329 kB | 539/586 kB Progress (3): 311/354 kB | 311/329 kB | 555/586 kB Progress (3): 311/354 kB | 311/329 kB | 571/586 kB Progress (3): 311/354 kB | 328/329 kB | 571/586 kB Progress (3): 328/354 kB | 328/329 kB | 571/586 kB Progress (3): 328/354 kB | 329 kB | 571/586 kB Progress (3): 328/354 kB | 329 kB | 586 kB Progress (3): 344/354 kB | 329 kB | 586 kB Progress (3): 354 kB | 329 kB | 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.0 MB/s) 2024-03-04T12:28:49.456 INFO:tasks.workunit.client.0.smithi110.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.7 MB/s) 2024-03-04T12:28:49.456 INFO:tasks.workunit.client.0.smithi110.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.8 MB/s) 2024-03-04T12:28:49.457 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-03-04T12:28:49.457 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-03-04T12:28:49.457 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-03-04T12:28:49.460 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/211 kB Progress (1): 33/211 kB Progress (1): 49/211 kB Progress (1): 66/211 kB Progress (1): 82/211 kB Progress (1): 98/211 kB Progress (1): 115/211 kB Progress (1): 131/211 kB Progress (1): 147/211 kB Progress (1): 164/211 kB Progress (1): 180/211 kB Progress (1): 197/211 kB Progress (1): 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.0 MB/s) 2024-03-04T12:28:49.460 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-03-04T12:28:49.462 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 31 kB/s) 2024-03-04T12:28:49.462 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-03-04T12:28:49.474 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.8 kB Progress (2): 6.8 kB | 14 kB Progress (3): 6.8 kB | 14 kB | 16/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 32 kB/s) 2024-03-04T12:28:49.474 INFO:tasks.workunit.client.0.smithi110.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 66 kB/s) 2024-03-04T12:28:49.474 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-03-04T12:28:49.474 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 33/106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-03-04T12:28:49.475 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 49/106 kB Progress (1): 66/106 kB Progress (1): 82/106 kB Progress (1): 98/106 kB Progress (1): 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 490 kB/s) 2024-03-04T12:28:49.475 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-03-04T12:28:49.481 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 82/245 kB Progress (1): 98/245 kB Progress (1): 115/245 kB Progress (1): 131/245 kB Progress (1): 147/245 kB Progress (1): 164/245 kB Progress (1): 180/245 kB Progress (2): 180/245 kB | 16/205 kB Progress (2): 197/245 kB | 16/205 kB Progress (2): 197/245 kB | 33/205 kB Progress (2): 213/245 kB | 33/205 kB Progress (2): 213/245 kB | 49/205 kB Progress (2): 229/245 kB | 49/205 kB Progress (2): 229/245 kB | 63/205 kB Progress (2): 245 kB | 63/205 kB Progress (2): 245 kB | 79/205 kB Progress (2): 245 kB | 95/205 kB Progress (2): 245 kB | 112/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.1 MB/s) 2024-03-04T12:28:49.481 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-03-04T12:28:49.483 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 128/205 kB Progress (1): 145/205 kB Progress (1): 161/205 kB Progress (1): 177/205 kB Progress (1): 194/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 910 kB/s) 2024-03-04T12:28:49.483 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-03-04T12:28:49.491 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 15 kB Progress (2): 15 kB | 16/16 kB Progress (2): 15 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 65 kB/s) 2024-03-04T12:28:49.491 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-03-04T12:28:49.491 INFO:tasks.workunit.client.0.smithi110.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 71 kB/s) 2024-03-04T12:28:49.491 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-03-04T12:28:49.492 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 27 kB/s) 2024-03-04T12:28:49.498 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 94 kB/s) 2024-03-04T12:28:49.499 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 100 kB/s) 2024-03-04T12:28:49.508 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 69 kB/s) 2024-03-04T12:28:49.511 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/184 kB Progress (1): 32/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 724 kB/s) 2024-03-04T12:28:49.539 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:28:49.540 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-03-04T12:28:49.545 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-03-04T12:28:49.562 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 343 kB/s) 2024-03-04T12:28:49.564 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-03-04T12:28:49.581 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 300 kB/s) 2024-03-04T12:28:49.583 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-03-04T12:28:49.600 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.4 MB/s) 2024-03-04T12:28:49.604 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-03-04T12:28:49.620 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 839 kB/s) 2024-03-04T12:28:49.625 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-03-04T12:28:49.646 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 66/153 kB Progress (1): 82/153 kB Progress (1): 98/153 kB Progress (1): 115/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 7.3 MB/s) 2024-03-04T12:28:49.647 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-03-04T12:28:49.668 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 115/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 164/215 kB Progress (1): 180/215 kB Progress (1): 197/215 kB Progress (1): 213/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 9.8 MB/s) 2024-03-04T12:28:49.705 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:28:49.705 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-03-04T12:28:49.708 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-03-04T12:28:49.725 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 156 kB/s) 2024-03-04T12:28:49.726 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-03-04T12:28:49.743 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.3 MB/s) 2024-03-04T12:28:49.746 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-03-04T12:28:49.763 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 516 kB/s) 2024-03-04T12:28:49.765 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-03-04T12:28:49.783 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.4 MB/s) 2024-03-04T12:28:49.785 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-03-04T12:28:49.802 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 355 kB/s) 2024-03-04T12:28:49.804 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-03-04T12:28:49.821 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 189 kB/s) 2024-03-04T12:28:49.824 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-03-04T12:28:49.841 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 38 kB/s) 2024-03-04T12:28:49.843 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-03-04T12:28:49.859 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 171 kB/s) 2024-03-04T12:28:49.860 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-03-04T12:28:49.876 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 881 kB/s) 2024-03-04T12:28:49.878 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-03-04T12:28:49.896 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 188 kB/s) 2024-03-04T12:28:49.897 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-03-04T12:28:49.914 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 492 kB/s) 2024-03-04T12:28:49.916 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-03-04T12:28:49.932 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 492 kB/s) 2024-03-04T12:28:49.934 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-03-04T12:28:49.951 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 501 kB/s) 2024-03-04T12:28:49.953 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-03-04T12:28:49.970 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.2 MB/s) 2024-03-04T12:28:49.974 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-03-04T12:28:49.990 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 300 kB/s) 2024-03-04T12:28:49.993 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-03-04T12:28:50.010 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.7 MB/s) 2024-03-04T12:28:50.014 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-03-04T12:28:50.031 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 300 kB/s) 2024-03-04T12:28:50.035 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-03-04T12:28:50.053 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.7 MB/s) 2024-03-04T12:28:50.054 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-03-04T12:28:50.054 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-03-04T12:28:50.054 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-03-04T12:28:50.054 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-03-04T12:28:50.054 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-03-04T12:28:50.071 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/41 kB Progress (2): 16/41 kB | 8.5 kB Progress (2): 33/41 kB | 8.5 kB Progress (3): 33/41 kB | 8.5 kB | 2.5 kB Progress (3): 41 kB | 8.5 kB | 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 499 kB/s) 2024-03-04T12:28:50.071 INFO:tasks.workunit.client.0.smithi110.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 147 kB/s) 2024-03-04T12:28:50.071 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-03-04T12:28:50.071 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-03-04T12:28:50.071 INFO:tasks.workunit.client.0.smithi110.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.4 MB/s) 2024-03-04T12:28:50.077 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/269 kB Progress (1): 33/269 kB Progress (1): 49/269 kB Progress (1): 66/269 kB Progress (1): 82/269 kB Progress (1): 98/269 kB Progress (1): 115/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 256/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 12 MB/s) 2024-03-04T12:28:50.094 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (1): 62/327 kB Progress (1): 79/327 kB Progress (1): 95/327 kB Progress (2): 95/327 kB | 16/587 kB Progress (2): 111/327 kB | 16/587 kB Progress (2): 111/327 kB | 33/587 kB Progress (2): 128/327 kB | 33/587 kB Progress (2): 128/327 kB | 49/587 kB Progress (2): 144/327 kB | 49/587 kB Progress (2): 144/327 kB | 66/587 kB Progress (2): 161/327 kB | 66/587 kB Progress (2): 161/327 kB | 82/587 kB Progress (2): 177/327 kB | 82/587 kB Progress (2): 177/327 kB | 98/587 kB Progress (2): 177/327 kB | 115/587 kB Progress (2): 177/327 kB | 131/587 kB Progress (2): 193/327 kB | 131/587 kB Progress (2): 193/327 kB | 147/587 kB Progress (2): 210/327 kB | 147/587 kB Progress (2): 210/327 kB | 164/587 kB Progress (2): 210/327 kB | 180/587 kB Progress (2): 226/327 kB | 180/587 kB Progress (2): 226/327 kB | 197/587 kB Progress (2): 242/327 kB | 197/587 kB Progress (2): 242/327 kB | 213/587 kB Progress (2): 242/327 kB | 229/587 kB Progress (2): 259/327 kB | 229/587 kB Progress (2): 259/327 kB | 246/587 kB Progress (2): 275/327 kB | 246/587 kB Progress (2): 292/327 kB | 246/587 kB Progress (2): 292/327 kB | 262/587 kB Progress (2): 308/327 kB | 262/587 kB Progress (2): 308/327 kB | 279/587 kB Progress (2): 308/327 kB | 295/587 kB Progress (2): 324/327 kB | 295/587 kB Progress (2): 327 kB | 295/587 kB Progress (2): 327 kB | 311/587 kB Progress (2): 327 kB | 328/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 8.2 MB/s) 2024-03-04T12:28:50.095 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 344/587 kB Progress (2): 344/587 kB | 16/55 kB Progress (2): 360/587 kB | 16/55 kB Progress (2): 360/587 kB | 33/55 kB Progress (2): 377/587 kB | 33/55 kB Progress (2): 377/587 kB | 49/55 kB Progress (2): 377/587 kB | 55 kB Progress (2): 393/587 kB | 55 kB Progress (2): 410/587 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 1.3 MB/s) 2024-03-04T12:28:50.097 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 426/587 kB Progress (1): 442/587 kB Progress (1): 459/587 kB Progress (1): 475/587 kB Progress (1): 492/587 kB Progress (1): 508/587 kB Progress (1): 524/587 kB Progress (1): 541/587 kB Progress (1): 557/587 kB Progress (1): 573/587 kB Progress (1): 585/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 13 MB/s) 2024-03-04T12:28:50.127 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-03-04T12:28:50.127 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:28:50.128 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-03-04T12:28:50.131 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-03-04T12:28:50.148 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 296 kB/s) 2024-03-04T12:28:50.149 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-03-04T12:28:50.166 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 397 kB/s) 2024-03-04T12:28:50.167 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-03-04T12:28:50.184 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.0 MB/s) 2024-03-04T12:28:50.185 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-03-04T12:28:50.202 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 873 kB/s) 2024-03-04T12:28:50.204 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-03-04T12:28:50.221 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 51 kB/s) 2024-03-04T12:28:50.222 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-03-04T12:28:50.239 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 265 kB/s) 2024-03-04T12:28:50.240 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-03-04T12:28:50.257 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.0 MB/s) 2024-03-04T12:28:50.260 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-03-04T12:28:50.276 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 292 kB/s) 2024-03-04T12:28:50.278 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-03-04T12:28:50.295 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 244 kB/s) 2024-03-04T12:28:50.297 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-03-04T12:28:50.314 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 139 kB/s) 2024-03-04T12:28:50.316 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-03-04T12:28:50.333 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 627 kB/s) 2024-03-04T12:28:50.335 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-03-04T12:28:50.352 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.0 MB/s) 2024-03-04T12:28:50.354 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-03-04T12:28:50.371 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 386 kB/s) 2024-03-04T12:28:50.373 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-03-04T12:28:50.390 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 66 kB/s) 2024-03-04T12:28:50.391 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-03-04T12:28:50.408 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 493 kB/s) 2024-03-04T12:28:50.410 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-03-04T12:28:50.426 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 158 kB/s) 2024-03-04T12:28:50.429 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-03-04T12:28:50.446 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 331 kB/s) 2024-03-04T12:28:50.448 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-03-04T12:28:50.464 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 71 kB/s) 2024-03-04T12:28:50.468 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-03-04T12:28:50.484 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 48 kB/s) 2024-03-04T12:28:50.485 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-03-04T12:28:50.501 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 377 kB/s) 2024-03-04T12:28:50.503 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-03-04T12:28:50.519 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.6 MB/s) 2024-03-04T12:28:50.521 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-03-04T12:28:50.537 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 75 kB/s) 2024-03-04T12:28:50.538 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-03-04T12:28:50.555 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 83 kB/s) 2024-03-04T12:28:50.560 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-03-04T12:28:50.577 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 796 kB/s) 2024-03-04T12:28:50.578 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-03-04T12:28:50.578 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-03-04T12:28:50.578 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-03-04T12:28:50.578 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-03-04T12:28:50.578 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-03-04T12:28:50.593 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 263 kB/s) 2024-03-04T12:28:50.593 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-03-04T12:28:50.595 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/122 kB Progress (1): 33/122 kB Progress (1): 49/122 kB Progress (2): 49/122 kB | 16/55 kB Progress (2): 63/122 kB | 16/55 kB Progress (2): 63/122 kB | 33/55 kB Progress (2): 63/122 kB | 49/55 kB Progress (2): 79/122 kB | 49/55 kB Progress (2): 79/122 kB | 55 kB Progress (2): 96/122 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.0 MB/s) 2024-03-04T12:28:50.595 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-03-04T12:28:50.596 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 112/122 kB Progress (2): 112/122 kB | 16/334 kB Progress (2): 122 kB | 16/334 kB Progress (2): 122 kB | 33/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.4 MB/s) 2024-03-04T12:28:50.596 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-03-04T12:28:50.600 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 49/334 kB Progress (1): 66/334 kB Progress (1): 82/334 kB Progress (1): 98/334 kB Progress (1): 115/334 kB Progress (1): 131/334 kB Progress (1): 147/334 kB Progress (1): 164/334 kB Progress (1): 180/334 kB Progress (1): 197/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 246/334 kB Progress (1): 262/334 kB Progress (1): 279/334 kB Progress (1): 295/334 kB Progress (1): 311/334 kB Progress (1): 328/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 15 MB/s) 2024-03-04T12:28:50.614 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 256/267 kB Progress (2): 256/267 kB | 4.7 kB Progress (2): 267 kB | 4.7 kB Progress (3): 267 kB | 4.7 kB | 16/23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 126 kB/s) 2024-03-04T12:28:50.614 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.2 MB/s) 2024-03-04T12:28:50.614 INFO:tasks.workunit.client.0.smithi110.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 633 kB/s) 2024-03-04T12:28:50.615 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 711 kB/s) 2024-03-04T12:28:50.668 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Changes detected - recompiling the module! :source 2024-03-04T12:28:50.669 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-03-04T12:28:51.341 INFO:tasks.workunit.client.0.smithi110.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-03-04T12:28:51.341 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:28:51.341 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-03-04T12:28:51.344 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-03-04T12:28:51.344 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:28:51.344 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-03-04T12:28:51.351 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-03-04T12:28:51.351 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-03-04T12:28:51.556 INFO:tasks.workunit.client.0.smithi110.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-03-04T12:28:51.557 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:28:51.557 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-03-04T12:28:51.562 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-03-04T12:28:51.583 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 312 kB/s) 2024-03-04T12:28:51.588 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-03-04T12:28:51.620 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 110 kB/s) 2024-03-04T12:28:51.625 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-03-04T12:28:51.645 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 163 kB/s) 2024-03-04T12:28:51.648 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-03-04T12:28:51.667 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 214 kB/s) 2024-03-04T12:28:51.671 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-03-04T12:28:51.688 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 194 kB/s) 2024-03-04T12:28:51.691 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-03-04T12:28:51.710 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 234 kB/s) 2024-03-04T12:28:51.713 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-03-04T12:28:51.730 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 104 kB/s) 2024-03-04T12:28:51.732 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-03-04T12:28:51.751 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 115 kB/s) 2024-03-04T12:28:51.753 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-03-04T12:28:51.770 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.7 MB/s) 2024-03-04T12:28:51.772 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-03-04T12:28:51.789 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 112 kB/s) 2024-03-04T12:28:51.792 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-03-04T12:28:51.826 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 171 kB/s) 2024-03-04T12:28:51.829 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-03-04T12:28:51.846 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 138 kB/s) 2024-03-04T12:28:51.847 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-03-04T12:28:51.865 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.3 MB/s) 2024-03-04T12:28:51.867 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-03-04T12:28:51.883 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.2 MB/s) 2024-03-04T12:28:51.885 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-03-04T12:28:51.903 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 896 kB/s) 2024-03-04T12:28:51.905 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-03-04T12:28:51.923 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 481 kB/s) 2024-03-04T12:28:51.925 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-03-04T12:28:51.942 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.6 MB/s) 2024-03-04T12:28:51.944 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-03-04T12:28:51.961 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 504 kB/s) 2024-03-04T12:28:51.964 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-03-04T12:28:51.984 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 103 kB/s) 2024-03-04T12:28:51.987 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-03-04T12:28:52.004 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 162 kB/s) 2024-03-04T12:28:52.006 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-03-04T12:28:52.023 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 91 kB/s) 2024-03-04T12:28:52.024 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-03-04T12:28:52.055 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 99 kB/s) 2024-03-04T12:28:52.056 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-03-04T12:28:52.072 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.3 MB/s) 2024-03-04T12:28:52.074 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-03-04T12:28:52.104 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 225 kB/s) 2024-03-04T12:28:52.106 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-03-04T12:28:52.122 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 798 kB/s) 2024-03-04T12:28:52.125 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-03-04T12:28:52.142 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 174 kB/s) 2024-03-04T12:28:52.143 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-03-04T12:28:52.159 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 425 kB/s) 2024-03-04T12:28:52.161 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-03-04T12:28:52.177 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 525 kB/s) 2024-03-04T12:28:52.179 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-03-04T12:28:52.206 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 76 kB/s) 2024-03-04T12:28:52.208 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-03-04T12:28:52.225 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 131 kB/s) 2024-03-04T12:28:52.228 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-03-04T12:28:52.245 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 178 kB/s) 2024-03-04T12:28:52.250 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-03-04T12:28:52.270 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 713 kB/s) 2024-03-04T12:28:52.272 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-03-04T12:28:52.289 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 853 kB/s) 2024-03-04T12:28:52.292 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-03-04T12:28:52.317 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 560 kB/s) 2024-03-04T12:28:52.318 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-03-04T12:28:52.335 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 282 kB/s) 2024-03-04T12:28:52.336 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-03-04T12:28:52.354 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 349 kB/s) 2024-03-04T12:28:52.356 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-03-04T12:28:52.374 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.8 MB/s) 2024-03-04T12:28:52.377 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-03-04T12:28:52.408 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 542 kB/s) 2024-03-04T12:28:52.409 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-03-04T12:28:52.427 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 822 kB/s) 2024-03-04T12:28:52.430 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-03-04T12:28:52.446 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 44 kB/s) 2024-03-04T12:28:52.447 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-03-04T12:28:52.464 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 300 kB/s) 2024-03-04T12:28:52.466 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-03-04T12:28:52.482 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 465 kB/s) 2024-03-04T12:28:52.485 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-03-04T12:28:52.501 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 176 kB/s) 2024-03-04T12:28:52.504 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-03-04T12:28:52.521 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 250 kB/s) 2024-03-04T12:28:52.524 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-03-04T12:28:52.541 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 128 kB/s) 2024-03-04T12:28:52.543 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-03-04T12:28:52.561 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 204 kB/s) 2024-03-04T12:28:52.563 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-03-04T12:28:52.580 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 643 kB/s) 2024-03-04T12:28:52.582 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-03-04T12:28:52.599 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 748 kB/s) 2024-03-04T12:28:52.601 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-03-04T12:28:52.619 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 986 kB/s) 2024-03-04T12:28:52.621 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-03-04T12:28:52.654 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 11 kB/s) 2024-03-04T12:28:52.655 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-03-04T12:28:52.687 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 191 kB/s) 2024-03-04T12:28:52.689 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-03-04T12:28:52.706 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 432 kB/s) 2024-03-04T12:28:52.707 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-03-04T12:28:52.724 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 302 kB/s) 2024-03-04T12:28:52.726 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-03-04T12:28:52.743 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 457 kB/s) 2024-03-04T12:28:52.745 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-03-04T12:28:52.764 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.2 MB/s) 2024-03-04T12:28:52.765 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-03-04T12:28:52.784 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.3 MB/s) 2024-03-04T12:28:52.786 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-03-04T12:28:52.803 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-03-04T12:28:52.805 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-03-04T12:28:52.822 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 353 kB/s) 2024-03-04T12:28:52.824 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-03-04T12:28:52.840 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 251 kB/s) 2024-03-04T12:28:52.842 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-03-04T12:28:52.859 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 200 kB/s) 2024-03-04T12:28:52.860 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-03-04T12:28:52.884 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.2 MB/s) 2024-03-04T12:28:52.886 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-03-04T12:28:52.922 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 66 kB/s) 2024-03-04T12:28:52.926 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-03-04T12:28:52.972 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 115/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 164/308 kB Progress (1): 180/308 kB Progress (1): 197/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 246/308 kB Progress (1): 262/308 kB Progress (1): 279/308 kB Progress (1): 295/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 6.7 MB/s) 2024-03-04T12:28:52.973 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-03-04T12:28:52.973 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-03-04T12:28:52.973 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-03-04T12:28:52.973 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-03-04T12:28:52.973 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-03-04T12:28:53.012 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 14 kB Progress (2): 14 kB | 16/26 kB Progress (3): 14 kB | 16/26 kB | 16/171 kB Progress (3): 14 kB | 26 kB | 16/171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 348 kB/s) 2024-03-04T12:28:53.013 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 26 kB | 33/171 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-03-04T12:28:53.013 INFO:tasks.workunit.client.0.smithi110.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 663 kB/s) 2024-03-04T12:28:53.013 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-03-04T12:28:53.013 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 49/171 kB Progress (2): 49/171 kB | 8.2 kB Progress (2): 62/171 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 204 kB/s) 2024-03-04T12:28:53.013 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-03-04T12:28:53.015 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 79/171 kB Progress (2): 79/171 kB | 16/118 kB Progress (2): 95/171 kB | 16/118 kB Progress (2): 95/171 kB | 33/118 kB Progress (2): 112/171 kB | 33/118 kB Progress (2): 112/171 kB | 49/118 kB Progress (2): 128/171 kB | 49/118 kB Progress (2): 144/171 kB | 49/118 kB Progress (2): 144/171 kB | 66/118 kB Progress (2): 161/171 kB | 66/118 kB Progress (2): 171 kB | 66/118 kB Progress (2): 171 kB | 82/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 4.1 MB/s) 2024-03-04T12:28:53.015 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-03-04T12:28:53.015 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 98/118 kB Progress (1): 115/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 2.7 MB/s) 2024-03-04T12:28:53.015 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-03-04T12:28:53.044 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/136 kB Progress (1): 33/136 kB Progress (2): 33/136 kB | 16/61 kB Progress (2): 33/136 kB | 33/61 kB Progress (2): 33/136 kB | 49/61 kB Progress (2): 33/136 kB | 61 kB Progress (3): 33/136 kB | 61 kB | 16/146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 869 kB/s) 2024-03-04T12:28:53.045 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 33/136 kB | 33/146 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-03-04T12:28:53.047 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 33/136 kB | 49/146 kB Progress (2): 49/136 kB | 49/146 kB Progress (2): 49/136 kB | 66/146 kB Progress (2): 66/136 kB | 66/146 kB Progress (2): 66/136 kB | 82/146 kB Progress (2): 66/136 kB | 98/146 kB Progress (2): 66/136 kB | 115/146 kB Progress (2): 82/136 kB | 115/146 kB Progress (2): 82/136 kB | 131/146 kB Progress (2): 98/136 kB | 131/146 kB Progress (2): 98/136 kB | 146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 2.0 MB/s) 2024-03-04T12:28:53.047 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-03-04T12:28:53.048 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 115/136 kB Progress (1): 131/136 kB Progress (1): 136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 1.8 MB/s) 2024-03-04T12:28:53.055 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/501 kB Progress (1): 33/501 kB Progress (1): 49/501 kB Progress (1): 66/501 kB Progress (1): 82/501 kB Progress (1): 98/501 kB Progress (1): 115/501 kB Progress (2): 115/501 kB | 16/58 kB Progress (2): 131/501 kB | 16/58 kB Progress (2): 147/501 kB | 16/58 kB Progress (2): 147/501 kB | 33/58 kB Progress (2): 164/501 kB | 33/58 kB Progress (2): 180/501 kB | 33/58 kB Progress (2): 197/501 kB | 33/58 kB Progress (2): 197/501 kB | 49/58 kB Progress (2): 213/501 kB | 49/58 kB Progress (2): 229/501 kB | 49/58 kB Progress (2): 246/501 kB | 49/58 kB Progress (2): 246/501 kB | 58 kB Progress (2): 262/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 702 kB/s) 2024-03-04T12:28:53.060 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 279/501 kB Progress (1): 295/501 kB Progress (1): 311/501 kB Progress (1): 328/501 kB Progress (1): 344/501 kB Progress (1): 360/501 kB Progress (1): 377/501 kB Progress (1): 393/501 kB Progress (1): 410/501 kB Progress (1): 426/501 kB Progress (1): 442/501 kB Progress (1): 459/501 kB Progress (1): 475/501 kB Progress (1): 492/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 5.8 MB/s) 2024-03-04T12:28:53.078 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 1.2 MB/s) 2024-03-04T12:28:53.125 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 16 MB/s) 2024-03-04T12:28:53.211 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:28:53.211 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-03-04T12:28:53.215 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-03-04T12:28:53.234 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 236 kB/s) 2024-03-04T12:28:53.236 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-03-04T12:28:53.267 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 163 kB/s) 2024-03-04T12:28:53.268 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-03-04T12:28:53.292 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.0 MB/s) 2024-03-04T12:28:53.294 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-03-04T12:28:53.311 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.1 MB/s) 2024-03-04T12:28:53.314 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-03-04T12:28:53.330 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 324 kB/s) 2024-03-04T12:28:53.332 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-03-04T12:28:53.349 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 231 kB/s) 2024-03-04T12:28:53.352 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-03-04T12:28:53.370 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 334 kB/s) 2024-03-04T12:28:53.372 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-03-04T12:28:53.407 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 179 kB/s) 2024-03-04T12:28:53.409 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-03-04T12:28:53.438 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 703 kB/s) 2024-03-04T12:28:53.441 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-03-04T12:28:53.476 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 428 kB/s) 2024-03-04T12:28:53.478 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-03-04T12:28:53.507 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 68 kB/s) 2024-03-04T12:28:53.509 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-03-04T12:28:53.534 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 342 kB/s) 2024-03-04T12:28:53.535 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-03-04T12:28:53.556 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.2 MB/s) 2024-03-04T12:28:53.561 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-03-04T12:28:53.579 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 1.9 MB/s) 2024-03-04T12:28:53.580 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-03-04T12:28:53.580 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-03-04T12:28:53.581 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-03-04T12:28:53.581 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-03-04T12:28:53.581 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-03-04T12:28:53.604 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/26 kB Progress (2): 16/26 kB | 16/79 kB Progress (2): 26 kB | 16/79 kB Progress (2): 26 kB | 33/79 kB Progress (2): 26 kB | 49/79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.2 MB/s) 2024-03-04T12:28:53.604 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-03-04T12:28:53.604 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 49/79 kB | 16/211 kB Progress (2): 49/79 kB | 33/211 kB Progress (2): 66/79 kB | 33/211 kB Progress (3): 66/79 kB | 33/211 kB | 16/58 kB Progress (3): 79 kB | 33/211 kB | 16/58 kB Progress (3): 79 kB | 33/211 kB | 33/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 3.3 MB/s) 2024-03-04T12:28:53.604 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-03-04T12:28:53.606 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 49/211 kB | 33/58 kB Progress (2): 62/211 kB | 33/58 kB Progress (2): 78/211 kB | 33/58 kB Progress (2): 94/211 kB | 33/58 kB Progress (2): 94/211 kB | 49/58 kB Progress (2): 94/211 kB | 58 kB Progress (2): 111/211 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 2.3 MB/s) 2024-03-04T12:28:53.609 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 127/211 kB Progress (1): 144/211 kB Progress (2): 144/211 kB | 0/1.0 MB Progress (2): 144/211 kB | 0/1.0 MB Progress (2): 160/211 kB | 0/1.0 MB Progress (2): 176/211 kB | 0/1.0 MB Progress (2): 193/211 kB | 0/1.0 MB Progress (2): 193/211 kB | 0/1.0 MB Progress (2): 209/211 kB | 0/1.0 MB Progress (2): 211 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 7.0 MB/s) 2024-03-04T12:28:53.637 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (2): 0.4/1.0 MB | 16/116 kB Progress (2): 0.4/1.0 MB | 32/116 kB Progress (2): 0.4/1.0 MB | 32/116 kB Progress (2): 0.4/1.0 MB | 49/116 kB Progress (2): 0.4/1.0 MB | 65/116 kB Progress (3): 0.4/1.0 MB | 65/116 kB | 16/267 kB Progress (3): 0.4/1.0 MB | 65/116 kB | 33/267 kB Progress (3): 0.4/1.0 MB | 65/116 kB | 33/267 kB Progress (3): 0.4/1.0 MB | 65/116 kB | 33/267 kB Progress (3): 0.4/1.0 MB | 65/116 kB | 49/267 kB Progress (3): 0.4/1.0 MB | 81/116 kB | 49/267 kB Progress (3): 0.4/1.0 MB | 81/116 kB | 66/267 kB Progress (3): 0.4/1.0 MB | 98/116 kB | 66/267 kB Progress (3): 0.4/1.0 MB | 98/116 kB | 82/267 kB Progress (3): 0.4/1.0 MB | 98/116 kB | 98/267 kB Progress (3): 0.4/1.0 MB | 98/116 kB | 115/267 kB Progress (3): 0.4/1.0 MB | 98/116 kB | 115/267 kB Progress (3): 0.4/1.0 MB | 98/116 kB | 131/267 kB Progress (3): 0.4/1.0 MB | 98/116 kB | 147/267 kB Progress (3): 0.4/1.0 MB | 114/116 kB | 147/267 kB Progress (3): 0.4/1.0 MB | 116 kB | 147/267 kB Progress (3): 0.4/1.0 MB | 116 kB | 164/267 kB Progress (3): 0.4/1.0 MB | 116 kB | 180/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 2.1 MB/s) 2024-03-04T12:28:53.637 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 0.4/1.0 MB | 180/267 kB Progress (2): 0.4/1.0 MB | 197/267 kB Progress (2): 0.4/1.0 MB | 213/267 kB Progress (2): 0.4/1.0 MB | 229/267 kB Progress (2): 0.4/1.0 MB | 246/267 kB Progress (2): 0.5/1.0 MB | 246/267 kB Progress (2): 0.5/1.0 MB | 256/267 kB Progress (2): 0.5/1.0 MB | 267 kB Progress (2): 0.5/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 4.8 MB/s) 2024-03-04T12:28:53.665 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 12 MB/s) 2024-03-04T12:28:53.820 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-03-04T12:28:53.843 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-04T12:28:53.843 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] BUILD SUCCESS 2024-03-04T12:28:53.843 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-04T12:28:53.844 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Total time: 6.934 s 2024-03-04T12:28:53.844 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Finished at: 2024-03-04T12:28:53Z 2024-03-04T12:28:53.844 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-04T12:28:53.858 INFO:tasks.workunit.client.0.smithi110.stderr:+ ./mvnw test -Dtest=PutObjects 2024-03-04T12:28:53.866 INFO:tasks.workunit.client.0.smithi110.stdout:Warning: JAVA_HOME environment variable is not set. 2024-03-04T12:28:54.853 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Scanning for projects... 2024-03-04T12:28:54.953 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:28:54.953 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-03-04T12:28:54.953 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Building jcksum 1.0 2024-03-04T12:28:54.953 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] from pom.xml 2024-03-04T12:28:54.953 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-03-04T12:28:55.207 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:28:55.207 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-03-04T12:28:55.289 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-03-04T12:28:55.290 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:28:55.290 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-03-04T12:28:55.420 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Nothing to compile - all classes are up to date 2024-03-04T12:28:55.420 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:28:55.420 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-03-04T12:28:55.422 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-03-04T12:28:55.422 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:28:55.422 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-03-04T12:28:55.429 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Nothing to compile - all classes are up to date 2024-03-04T12:28:55.429 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:28:55.429 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-03-04T12:28:55.619 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-03-04T12:28:55.811 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-03-04T12:28:56.007 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-03-04T12:28:56.014 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-03-04T12:28:56.034 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 137 kB/s) 2024-03-04T12:28:56.039 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-03-04T12:28:56.058 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 141 kB/s) 2024-03-04T12:28:56.062 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-03-04T12:28:56.082 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 159 kB/s) 2024-03-04T12:28:56.085 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-03-04T12:28:56.106 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 160 kB/s) 2024-03-04T12:28:56.109 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-03-04T12:28:56.128 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 84 kB/s) 2024-03-04T12:28:56.132 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-03-04T12:28:56.152 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 135 kB/s) 2024-03-04T12:28:56.159 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-03-04T12:28:56.186 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.0 MB/s) 2024-03-04T12:28:56.188 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-03-04T12:28:56.188 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-03-04T12:28:56.189 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-03-04T12:28:56.190 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-03-04T12:28:56.190 INFO:tasks.workunit.client.0.smithi110.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-03-04T12:28:56.212 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 675 kB/s) 2024-03-04T12:28:56.254 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (1): 4.1/7.7 kB Progress (1): 5.5/7.7 kB Progress (1): 6.9/7.7 kB Progress (1): 7.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 118 kB/s) 2024-03-04T12:28:56.285 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (1): 16/103 kB Progress (2): 16/103 kB | 16/169 kB Progress (3): 16/103 kB | 16/169 kB | 16/189 kB Progress (3): 33/103 kB | 16/169 kB | 16/189 kB Progress (3): 33/103 kB | 33/169 kB | 16/189 kB Progress (3): 33/103 kB | 33/169 kB | 33/189 kB Progress (3): 33/103 kB | 49/169 kB | 33/189 kB Progress (3): 49/103 kB | 49/169 kB | 33/189 kB Progress (3): 49/103 kB | 49/169 kB | 49/189 kB Progress (3): 66/103 kB | 49/169 kB | 49/189 kB Progress (3): 66/103 kB | 49/169 kB | 66/189 kB Progress (3): 66/103 kB | 66/169 kB | 66/189 kB Progress (3): 82/103 kB | 66/169 kB | 66/189 kB Progress (3): 82/103 kB | 66/169 kB | 82/189 kB Progress (3): 98/103 kB | 66/169 kB | 82/189 kB Progress (3): 98/103 kB | 82/169 kB | 82/189 kB Progress (3): 103 kB | 82/169 kB | 82/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.1 MB/s) 2024-03-04T12:28:56.300 INFO:tasks.workunit.client.0.smithi110.stdout:Progress (2): 82/169 kB | 98/189 kB Progress (2): 98/169 kB | 98/189 kB Progress (2): 98/169 kB | 115/189 kB Progress (2): 115/169 kB | 115/189 kB Progress (2): 115/169 kB | 131/189 kB Progress (2): 131/169 kB | 131/189 kB Progress (2): 131/169 kB | 147/189 kB Progress (2): 147/169 kB | 147/189 kB Progress (2): 147/169 kB | 164/189 kB Progress (2): 164/169 kB | 164/189 kB Progress (2): 169 kB | 164/189 kB Progress (2): 169 kB | 180/189 kB Progress (2): 169 kB | 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.5 MB/s) 2024-03-04T12:28:56.300 INFO:tasks.workunit.client.0.smithi110.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 1.7 MB/s) 2024-03-04T12:28:56.314 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:28:56.314 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] ------------------------------------------------------- 2024-03-04T12:28:56.314 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] T E S T S 2024-03-04T12:28:56.314 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] ------------------------------------------------------- 2024-03-04T12:28:56.786 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-03-04T12:28:56.897 INFO:tasks.workunit.client.0.smithi110.stdout:PutObjects.java: starting test run: 2024-03-04T12:28:56.897 INFO:tasks.workunit.client.0.smithi110.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-03-04T12:28:56.897 INFO:tasks.workunit.client.0.smithi110.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-03-04T12:28:56.897 INFO:tasks.workunit.client.0.smithi110.stdout: EndpointUrl=https://smithi110.front.sepia.ceph.com:443 2024-03-04T12:28:56.897 INFO:tasks.workunit.client.0.smithi110.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-03-04T12:28:56.994 INFO:tasks.workunit.client.0.smithi110.stdout:DEBUG: Environment Variables Read 2024-03-04T12:28:57.297 INFO:tasks.workunit.client.0.smithi110.stdout:DEBUG: S3 Client Initialized 2024-03-04T12:28:57.297 INFO:tasks.workunit.client.0.smithi110.stdout:DEBUG: Generating File 2024-03-04T12:28:57.297 INFO:tasks.workunit.client.0.smithi110.stdout:DEBUG: File Generated 2024-03-04T12:28:57.297 INFO:tasks.workunit.client.0.smithi110.stdout:DEBUG: Generating File 2024-03-04T12:28:57.298 INFO:tasks.workunit.client.0.smithi110.stdout:DEBUG: File Generated 2024-03-04T12:28:57.298 INFO:tasks.workunit.client.0.smithi110.stdout:DEBUG: Generating File 2024-03-04T12:28:57.298 INFO:tasks.workunit.client.0.smithi110.stdout:DEBUG: File Generated 2024-03-04T12:28:57.298 INFO:tasks.workunit.client.0.smithi110.stdout:DEBUG: Generating File 2024-03-04T12:28:57.298 INFO:tasks.workunit.client.0.smithi110.stdout:DEBUG: File Generated 2024-03-04T12:28:57.298 INFO:tasks.workunit.client.0.smithi110.stdout:DEBUG: Generating File 2024-03-04T12:28:57.298 INFO:tasks.workunit.client.0.smithi110.stdout:DEBUG: File Generated 2024-03-04T12:28:57.298 INFO:tasks.workunit.client.0.smithi110.stdout:DEBUG: Generating File 2024-03-04T12:28:57.298 INFO:tasks.workunit.client.0.smithi110.stdout:DEBUG: File Generated 2024-03-04T12:28:57.298 INFO:tasks.workunit.client.0.smithi110.stdout:DEBUG: Generated Big Files 2024-03-04T12:28:57.727 INFO:tasks.workunit.client.0.smithi110.stdout:HeadBucketResponse() 2024-03-04T12:28:57.727 INFO:tasks.workunit.client.0.smithi110.stdout:sheik is ready 2024-03-04T12:28:57.727 INFO:tasks.workunit.client.0.smithi110.stdout:DEBUG: Test Bucket Created 2024-03-04T12:28:57.795 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileNoCksum called with file-0b 2024-03-04T12:28:57.896 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileNoCksum called with file-8b 2024-03-04T12:28:58.096 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileNoCksum called with file-200b 2024-03-04T12:28:58.187 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileNoCksum called with file-21983b 2024-03-04T12:28:58.196 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileNoCksum called with file-5519b 2024-03-04T12:28:58.296 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileNoCksum called with file-204329b 2024-03-04T12:28:58.697 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileNoCksum called with file-256k 2024-03-04T12:28:58.797 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileNoCksum called with file-1m 2024-03-04T12:28:59.197 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-03-04T12:28:59.899 INFO:tasks.workunit.client.0.smithi110.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-03-04T12:29:04.206 INFO:tasks.workunit.client.0.smithi110.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-03-04T12:29:08.411 INFO:tasks.workunit.client.0.smithi110.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-03-04T12:29:40.011 INFO:tasks.workunit.client.0.smithi110.stdout:arg: file-0b 2024-03-04T12:29:40.012 INFO:tasks.workunit.client.0.smithi110.stdout:arg: file-8b 2024-03-04T12:29:40.013 INFO:tasks.workunit.client.0.smithi110.stdout:arg: file-200b 2024-03-04T12:29:40.014 INFO:tasks.workunit.client.0.smithi110.stdout:arg: file-21983b 2024-03-04T12:29:40.016 INFO:tasks.workunit.client.0.smithi110.stdout:arg: file-5519b 2024-03-04T12:29:40.017 INFO:tasks.workunit.client.0.smithi110.stdout:arg: file-204329b 2024-03-04T12:29:40.018 INFO:tasks.workunit.client.0.smithi110.stdout:arg: file-256k 2024-03-04T12:29:40.019 INFO:tasks.workunit.client.0.smithi110.stdout:arg: file-1m 2024-03-04T12:29:40.020 INFO:tasks.workunit.client.0.smithi110.stdout:arg: file-1038757b 2024-03-04T12:29:40.049 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileCksum called with file-0b 2024-03-04T12:29:40.149 INFO:tasks.workunit.client.0.smithi110.stdout:PutObjectResponse 2024-03-04T12:29:40.250 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileCksum called with file-8b 2024-03-04T12:29:40.250 INFO:tasks.workunit.client.0.smithi110.stdout:PutObjectResponse 2024-03-04T12:29:40.350 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileCksum called with file-200b 2024-03-04T12:29:40.350 INFO:tasks.workunit.client.0.smithi110.stdout:PutObjectResponse 2024-03-04T12:29:40.450 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileCksum called with file-21983b 2024-03-04T12:29:40.450 INFO:tasks.workunit.client.0.smithi110.stdout:PutObjectResponse 2024-03-04T12:29:40.550 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileCksum called with file-5519b 2024-03-04T12:29:40.642 INFO:tasks.workunit.client.0.smithi110.stdout:PutObjectResponse 2024-03-04T12:29:40.650 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileCksum called with file-204329b 2024-03-04T12:29:40.750 INFO:tasks.workunit.client.0.smithi110.stdout:PutObjectResponse 2024-03-04T12:29:40.850 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileCksum called with file-256k 2024-03-04T12:29:40.950 INFO:tasks.workunit.client.0.smithi110.stdout:PutObjectResponse 2024-03-04T12:29:41.050 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileCksum called with file-1m 2024-03-04T12:29:41.351 INFO:tasks.workunit.client.0.smithi110.stdout:PutObjectResponse 2024-03-04T12:29:41.451 INFO:tasks.workunit.client.0.smithi110.stdout:putObjectFromFileCksum called with file-1038757b 2024-03-04T12:29:41.851 INFO:tasks.workunit.client.0.smithi110.stdout:PutObjectResponse 2024-03-04T12:29:42.052 INFO:tasks.workunit.client.0.smithi110.stdout:mpuObjectFromFileCksum called with file-5m 2024-03-04T12:29:45.255 INFO:tasks.workunit.client.0.smithi110.stdout:mpuObjectFromFileCksum called with file-10m 2024-03-04T12:29:49.259 INFO:tasks.workunit.client.0.smithi110.stdout:mpuObjectFromFileCksum called with file-100m 2024-03-04T12:30:31.086 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 94.29 s -- in io.ceph.jcksum.PutObjects 2024-03-04T12:30:31.098 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:30:31.098 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Results: 2024-03-04T12:30:31.098 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:30:31.098 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-03-04T12:30:31.098 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] 2024-03-04T12:30:31.100 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-04T12:30:31.100 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] BUILD SUCCESS 2024-03-04T12:30:31.100 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-04T12:30:31.101 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Total time: 01:36 min 2024-03-04T12:30:31.101 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] Finished at: 2024-03-04T12:30:31Z 2024-03-04T12:30:31.101 INFO:tasks.workunit.client.0.smithi110.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-04T12:30:31.113 INFO:tasks.workunit.client.0.smithi110.stderr:+ exit 2024-03-04T12:30:31.114 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:30:31.114 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:30:31.194 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-03-04T12:30:31.195 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-04T12:30:31.550 DEBUG:teuthology.parallel:result is None 2024-03-04T12:30:31.550 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:30:31.590 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:30:31.590 DEBUG:teuthology.orchestra.run.smithi110:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:30:31.657 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:30:31.657 INFO:teuthology.run_tasks:Running task workunit... 2024-03-04T12:30:31.672 INFO:tasks.workunit:Pulling workunits from ref 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:30:31.672 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-04T12:30:31.673 DEBUG:teuthology.orchestra.run.smithi110:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:30:31.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:30:31.725 INFO:teuthology.orchestra.run.smithi110.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-04T12:30:31.725 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:30:31.793 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-04T12:30:31.793 DEBUG:teuthology.orchestra.run.smithi110:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-04T12:30:31.861 INFO:tasks.workunit:timeout=3h 2024-03-04T12:30:31.861 INFO:tasks.workunit:cleanup=True 2024-03-04T12:30:31.861 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/pritha-srivastava/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:30:31.930 INFO:tasks.workunit.client.0.smithi110.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-04T12:31:20.545 INFO:tasks.workunit.client.0.smithi110.stderr:Note: switching to '3aec390336fdfdc8f927818b718cfb0361bd47c8'. 2024-03-04T12:31:20.545 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:31:20.545 INFO:tasks.workunit.client.0.smithi110.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-04T12:31:20.545 INFO:tasks.workunit.client.0.smithi110.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-04T12:31:20.545 INFO:tasks.workunit.client.0.smithi110.stderr:state without impacting any branches by switching back to a branch. 2024-03-04T12:31:20.545 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:31:20.545 INFO:tasks.workunit.client.0.smithi110.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-04T12:31:20.546 INFO:tasks.workunit.client.0.smithi110.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-04T12:31:20.546 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:31:20.546 INFO:tasks.workunit.client.0.smithi110.stderr: git switch -c 2024-03-04T12:31:20.546 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:31:20.546 INFO:tasks.workunit.client.0.smithi110.stderr:Or undo this operation with: 2024-03-04T12:31:20.546 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:31:20.546 INFO:tasks.workunit.client.0.smithi110.stderr: git switch - 2024-03-04T12:31:20.546 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:31:20.546 INFO:tasks.workunit.client.0.smithi110.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-04T12:31:20.546 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:31:20.546 INFO:tasks.workunit.client.0.smithi110.stderr:HEAD is now at 3aec390336f qa/d4n: Start redis up before rgw 2024-03-04T12:31:20.549 DEBUG:teuthology.orchestra.run.smithi110:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-04T12:31:20.616 INFO:tasks.workunit.client.0.smithi110.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-04T12:31:20.618 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:31:20.618 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-04T12:31:20.666 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-04T12:31:20.715 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-04T12:31:20.753 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:31:20.755 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:31:20.755 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-04T12:31:20.793 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:31:20.797 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:31:20.797 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-04T12:31:20.865 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-03-04T12:31:20.866 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-03-04T12:31:20.866 DEBUG:teuthology.orchestra.run.smithi110:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-03-04T12:31:20.941 INFO:tasks.workunit.client.0.smithi110.stdout:INFO: fully qualified domain name: smithi110.front.sepia.ceph.com 2024-03-04T12:31:20.941 INFO:tasks.workunit.client.0.smithi110.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-03-04T12:31:20.941 INFO:tasks.workunit.client.0.smithi110.stdout:== TESTING VERSIONED BUCKET == 2024-03-04T12:31:23.473 INFO:tasks.workunit.client.0.smithi110.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2024-03-04T12:31:23.700 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting pip 2024-03-04T12:31:23.706 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-04T12:31:23.753 INFO:tasks.workunit.client.0.smithi110.stdout:Installing collected packages: pip 2024-03-04T12:31:23.753 INFO:tasks.workunit.client.0.smithi110.stdout: Attempting uninstall: pip 2024-03-04T12:31:23.753 INFO:tasks.workunit.client.0.smithi110.stdout: Found existing installation: pip 21.2.3 2024-03-04T12:31:23.899 INFO:tasks.workunit.client.0.smithi110.stdout: Uninstalling pip-21.2.3: 2024-03-04T12:31:23.904 INFO:tasks.workunit.client.0.smithi110.stdout: Successfully uninstalled pip-21.2.3 2024-03-04T12:31:25.015 INFO:tasks.workunit.client.0.smithi110.stdout:Successfully installed pip-24.0 2024-03-04T12:31:25.934 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting boto3 2024-03-04T12:31:25.935 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached boto3-1.34.54-py3-none-any.whl.metadata (6.6 kB) 2024-03-04T12:31:26.550 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting botocore<1.35.0,>=1.34.54 (from boto3) 2024-03-04T12:31:26.552 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached botocore-1.34.54-py3-none-any.whl.metadata (5.7 kB) 2024-03-04T12:31:26.650 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-03-04T12:31:26.651 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-03-04T12:31:26.755 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-03-04T12:31:26.756 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-03-04T12:31:26.856 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:31:26.858 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-03-04T12:31:26.973 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:31:26.974 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-03-04T12:31:27.245 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:31:27.246 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-04T12:31:27.268 INFO:tasks.workunit.client.0.smithi110.stdout:Using cached boto3-1.34.54-py3-none-any.whl (139 kB) 2024-03-04T12:31:27.270 INFO:tasks.workunit.client.0.smithi110.stdout:Using cached botocore-1.34.54-py3-none-any.whl (12.0 MB) 2024-03-04T12:31:27.290 INFO:tasks.workunit.client.0.smithi110.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-03-04T12:31:27.291 INFO:tasks.workunit.client.0.smithi110.stdout:Using cached s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-03-04T12:31:27.292 INFO:tasks.workunit.client.0.smithi110.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-03-04T12:31:27.294 INFO:tasks.workunit.client.0.smithi110.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-03-04T12:31:27.296 INFO:tasks.workunit.client.0.smithi110.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-04T12:31:27.397 INFO:tasks.workunit.client.0.smithi110.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-03-04T12:31:28.404 INFO:tasks.workunit.client.0.smithi110.stdout:Successfully installed boto3-1.34.54 botocore-1.34.54 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.0 six-1.16.0 urllib3-1.26.18 2024-03-04T12:31:28.854 INFO:tasks.workunit.client.0.smithi110.stdout:INFO: creating user 2024-03-04T12:31:28.960 INFO:tasks.workunit.client.0.smithi110.stdout:{ 2024-03-04T12:31:28.961 INFO:tasks.workunit.client.0.smithi110.stdout: "user_id": "testid", 2024-03-04T12:31:28.961 INFO:tasks.workunit.client.0.smithi110.stdout: "display_name": "M. Tester", 2024-03-04T12:31:28.961 INFO:tasks.workunit.client.0.smithi110.stdout: "email": "tester@ceph.com", 2024-03-04T12:31:28.961 INFO:tasks.workunit.client.0.smithi110.stdout: "suspended": 0, 2024-03-04T12:31:28.961 INFO:tasks.workunit.client.0.smithi110.stdout: "max_buckets": 1000, 2024-03-04T12:31:28.961 INFO:tasks.workunit.client.0.smithi110.stdout: "subusers": [], 2024-03-04T12:31:28.961 INFO:tasks.workunit.client.0.smithi110.stdout: "keys": [ 2024-03-04T12:31:28.961 INFO:tasks.workunit.client.0.smithi110.stdout: { 2024-03-04T12:31:28.961 INFO:tasks.workunit.client.0.smithi110.stdout: "user": "testid", 2024-03-04T12:31:28.961 INFO:tasks.workunit.client.0.smithi110.stdout: "access_key": "0555b35654ad1656d804", 2024-03-04T12:31:28.961 INFO:tasks.workunit.client.0.smithi110.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-03-04T12:31:28.962 INFO:tasks.workunit.client.0.smithi110.stdout: "active": true 2024-03-04T12:31:28.962 INFO:tasks.workunit.client.0.smithi110.stdout: } 2024-03-04T12:31:28.962 INFO:tasks.workunit.client.0.smithi110.stdout: ], 2024-03-04T12:31:28.962 INFO:tasks.workunit.client.0.smithi110.stdout: "swift_keys": [], 2024-03-04T12:31:28.962 INFO:tasks.workunit.client.0.smithi110.stdout: "caps": [], 2024-03-04T12:31:28.962 INFO:tasks.workunit.client.0.smithi110.stdout: "op_mask": "read, write, delete", 2024-03-04T12:31:28.962 INFO:tasks.workunit.client.0.smithi110.stdout: "default_placement": "", 2024-03-04T12:31:28.962 INFO:tasks.workunit.client.0.smithi110.stdout: "default_storage_class": "", 2024-03-04T12:31:28.962 INFO:tasks.workunit.client.0.smithi110.stdout: "placement_tags": [], 2024-03-04T12:31:28.962 INFO:tasks.workunit.client.0.smithi110.stdout: "bucket_quota": { 2024-03-04T12:31:28.962 INFO:tasks.workunit.client.0.smithi110.stdout: "enabled": false, 2024-03-04T12:31:28.962 INFO:tasks.workunit.client.0.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:31:28.962 INFO:tasks.workunit.client.0.smithi110.stdout: "max_size": -1, 2024-03-04T12:31:28.963 INFO:tasks.workunit.client.0.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:31:28.963 INFO:tasks.workunit.client.0.smithi110.stdout: "max_objects": -1 2024-03-04T12:31:28.963 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:31:28.963 INFO:tasks.workunit.client.0.smithi110.stdout: "user_quota": { 2024-03-04T12:31:28.963 INFO:tasks.workunit.client.0.smithi110.stdout: "enabled": false, 2024-03-04T12:31:28.963 INFO:tasks.workunit.client.0.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:31:28.963 INFO:tasks.workunit.client.0.smithi110.stdout: "max_size": -1, 2024-03-04T12:31:28.963 INFO:tasks.workunit.client.0.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:31:28.963 INFO:tasks.workunit.client.0.smithi110.stdout: "max_objects": -1 2024-03-04T12:31:28.963 INFO:tasks.workunit.client.0.smithi110.stdout: }, 2024-03-04T12:31:28.963 INFO:tasks.workunit.client.0.smithi110.stdout: "temp_url_keys": [], 2024-03-04T12:31:28.963 INFO:tasks.workunit.client.0.smithi110.stdout: "type": "rgw", 2024-03-04T12:31:28.963 INFO:tasks.workunit.client.0.smithi110.stdout: "mfa_ids": [] 2024-03-04T12:31:28.964 INFO:tasks.workunit.client.0.smithi110.stdout:} 2024-03-04T12:31:28.964 INFO:tasks.workunit.client.0.smithi110.stdout: 2024-03-04T12:31:40.469 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:40.470 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:40.524 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:40.524 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:40.562 INFO:tasks.workunit.client.0.smithi110.stderr:5+0 records in 2024-03-04T12:31:40.562 INFO:tasks.workunit.client.0.smithi110.stderr:5+0 records out 2024-03-04T12:31:40.562 INFO:tasks.workunit.client.0.smithi110.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0151747 s, 346 MB/s 2024-03-04T12:31:40.565 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:40.565 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:40.638 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:40.639 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:41.688 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:41.688 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:42.764 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:42.764 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:43.819 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:43.819 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:44.869 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:44.869 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:45.919 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:45.919 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:46.973 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:46.973 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:48.029 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:48.030 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:49.077 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:49.077 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:50.121 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:50.121 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:51.172 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:51.172 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:52.212 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:52.212 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:53.277 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:53.278 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:54.314 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:31:54.315 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:31:54.437 INFO:tasks.workunit.client.0.smithi110.stdout:bucket nams is reupload-bkt-108436 2024-03-04T12:31:54.437 INFO:tasks.workunit.client.0.smithi110.stdout:endpoint is https://smithi110.front.sepia.ceph.com:443 2024-03-04T12:31:54.437 INFO:tasks.workunit.client.0.smithi110.stdout:start UploadId=2~P3vhsCXiTgYRGF0MNAPuvI7W2op2u0T 2024-03-04T12:31:54.437 INFO:tasks.workunit.client.0.smithi110.stdout:phase 1 uploaded part {'ETag': '"ead66d5eea2baa69b39bdafc614c90d9"', 'PartNumber': 1} 2024-03-04T12:31:54.438 INFO:tasks.workunit.client.0.smithi110.stdout:phase 1 uploaded part {'ETag': '"ead66d5eea2baa69b39bdafc614c90d9"', 'PartNumber': 2} 2024-03-04T12:31:54.438 INFO:tasks.workunit.client.0.smithi110.stdout:phase 2 uploaded part {'ETag': '"ead66d5eea2baa69b39bdafc614c90d9"', 'PartNumber': 1} 2024-03-04T12:31:54.438 INFO:tasks.workunit.client.0.smithi110.stdout:phase 2 uploaded part {'ETag': '"ead66d5eea2baa69b39bdafc614c90d9"', 'PartNumber': 1} 2024-03-04T12:31:54.438 INFO:tasks.workunit.client.0.smithi110.stdout:phase 2 uploaded part {'ETag': '"ead66d5eea2baa69b39bdafc614c90d9"', 'PartNumber': 1} 2024-03-04T12:31:54.438 INFO:tasks.workunit.client.0.smithi110.stdout:phase 2 uploaded part {'ETag': '"ead66d5eea2baa69b39bdafc614c90d9"', 'PartNumber': 1} 2024-03-04T12:31:54.438 INFO:tasks.workunit.client.0.smithi110.stdout:phase 2 uploaded part {'ETag': '"ead66d5eea2baa69b39bdafc614c90d9"', 'PartNumber': 1} 2024-03-04T12:31:54.438 INFO:tasks.workunit.client.0.smithi110.stdout:phase 2 uploaded part {'ETag': '"ead66d5eea2baa69b39bdafc614c90d9"', 'PartNumber': 1} 2024-03-04T12:31:54.438 INFO:tasks.workunit.client.0.smithi110.stdout:phase 2 uploaded part {'ETag': '"ead66d5eea2baa69b39bdafc614c90d9"', 'PartNumber': 1} 2024-03-04T12:31:54.438 INFO:tasks.workunit.client.0.smithi110.stdout:phase 2 uploaded part {'ETag': '"ead66d5eea2baa69b39bdafc614c90d9"', 'PartNumber': 1} 2024-03-04T12:31:54.438 INFO:tasks.workunit.client.0.smithi110.stdout:phase 2 uploaded part {'ETag': '"ead66d5eea2baa69b39bdafc614c90d9"', 'PartNumber': 1} 2024-03-04T12:31:54.438 INFO:tasks.workunit.client.0.smithi110.stdout:phase 2 uploaded part {'ETag': '"ead66d5eea2baa69b39bdafc614c90d9"', 'PartNumber': 1} 2024-03-04T12:31:54.438 INFO:tasks.workunit.client.0.smithi110.stdout:phase 2 uploaded part {'ETag': '"ead66d5eea2baa69b39bdafc614c90d9"', 'PartNumber': 1} 2024-03-04T12:31:54.438 INFO:tasks.workunit.client.0.smithi110.stdout:completing multipart upload, parts=[{'ETag': '"ead66d5eea2baa69b39bdafc614c90d9"', 'PartNumber': 1}, {'ETag': '"ead66d5eea2baa69b39bdafc614c90d9"', 'PartNumber': 2}] 2024-03-04T12:31:55.386 INFO:tasks.workunit.client.0.smithi110.stdout:radosgw-admin bucket radoslist: 2024-03-04T12:31:55.387 INFO:tasks.workunit.client.0.smithi110.stdout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.4__:9ddgPCOp7nEl8r6XfUYhOLXUfM0ZjxG_mpu_test4 2024-03-04T12:31:55.387 INFO:tasks.workunit.client.0.smithi110.stdout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.4_mpu_test4 2024-03-04T12:31:55.387 INFO:tasks.workunit.client.0.smithi110.stdout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.4__multipart_mpu_test4.2~P3vhsCXiTgYRGF0MNAPuvI7W2op2u0T.2 2024-03-04T12:31:55.387 INFO:tasks.workunit.client.0.smithi110.stdout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.4__multipart_mpu_test4.n0q6ShK-jB915jrtaBw5RRbvhSDA3IsO.1 2024-03-04T12:31:55.443 INFO:tasks.workunit.client.0.smithi110.stdout:rados ls: 2024-03-04T12:31:55.444 INFO:tasks.workunit.client.0.smithi110.stdout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.4__:9ddgPCOp7nEl8r6XfUYhOLXUfM0ZjxG_mpu_test4 2024-03-04T12:31:55.444 INFO:tasks.workunit.client.0.smithi110.stdout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.4_mpu_test4 2024-03-04T12:31:55.444 INFO:tasks.workunit.client.0.smithi110.stdout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.4__multipart_mpu_test4.2~P3vhsCXiTgYRGF0MNAPuvI7W2op2u0T.2 2024-03-04T12:31:55.444 INFO:tasks.workunit.client.0.smithi110.stdout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.4__multipart_mpu_test4.n0q6ShK-jB915jrtaBw5RRbvhSDA3IsO.1 2024-03-04T12:31:55.448 INFO:tasks.workunit.client.0.smithi110.stdout:== PASSED == 2024-03-04T12:31:55.448 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:31:55.448 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:31:55.528 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-03-04T12:31:55.529 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-04T12:31:55.916 DEBUG:teuthology.parallel:result is None 2024-03-04T12:31:55.916 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:31:55.956 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:31:55.956 DEBUG:teuthology.orchestra.run.smithi110:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:31:56.024 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:31:56.024 INFO:teuthology.run_tasks:Running task ragweed... 2024-03-04T12:31:56.038 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-03-04T12:31:56.038 INFO:tasks.ragweed:Downloading ragweed... 2024-03-04T12:31:56.039 INFO:tasks.ragweed:Using branch 'wip-rgw-d4n' for ragweed 2024-03-04T12:31:56.039 DEBUG:teuthology.orchestra.run.smithi110:> git clone -b wip-rgw-d4n https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-03-04T12:31:56.091 INFO:teuthology.orchestra.run.smithi110.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-03-04T12:31:56.137 INFO:teuthology.orchestra.run.smithi110.stderr:fatal: Remote branch wip-rgw-d4n not found in upstream origin 2024-03-04T12:31:56.137 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-03-04T12:31:56.138 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-03-04T12:31:56.139 DEBUG:teuthology.orchestra.run.smithi110:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-03-04T12:31:56.207 INFO:teuthology.orchestra.run.smithi110.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-03-04T12:31:56.374 INFO:tasks.ragweed:Creating rgw users... 2024-03-04T12:31:56.374 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-03-04T12:31:56.374 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key VOBMCIKWFJPLUYNSIAHG --secret p9b/yyZyZQL9rlBdrHRpAzG5kx0NH9FmI2CJSfbZ6GhilYegJAm50A== --email ragweed.client.0+test@test.test --system false 2024-03-04T12:31:56.479 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:31:56.479 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:31:56.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.501+0000 7f82e3a13800 20 rados->read ofs=0 len=0 2024-03-04T12:31:56.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.503+0000 7f82e3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:56.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.503+0000 7f82e3a13800 20 realm 2024-03-04T12:31:56.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.503+0000 7f82e3a13800 20 rados->read ofs=0 len=0 2024-03-04T12:31:56.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.503+0000 7f82e3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:56.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.503+0000 7f82e3a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:31:56.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.503+0000 7f82e3a13800 20 rados->read ofs=0 len=0 2024-03-04T12:31:56.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.503+0000 7f82e3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:56.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.503+0000 7f82e3a13800 20 rados->read ofs=0 len=0 2024-03-04T12:31:56.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.504+0000 7f82e3a13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:31:56.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.504+0000 7f82e3a13800 20 rados->read ofs=0 len=0 2024-03-04T12:31:56.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.504+0000 7f82e3a13800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:31:56.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.504+0000 7f82e3a13800 20 searching for the correct realm 2024-03-04T12:31:56.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.507+0000 7f82de9cb640 0 -- 172.21.15.110:0/2838311633 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f82d0075070 msgr2=0x7f82d005e2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:31:56.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.713+0000 7f82df1cc640 0 -- 172.21.15.110:0/2838311633 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f82d402b070 msgr2=0x7f82d401f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:31:56.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.919+0000 7f82e3a13800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:31:56.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.919+0000 7f82e3a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:31:56.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.919+0000 7f82e3a13800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:31:56.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.919+0000 7f82e3a13800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:31:56.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.919+0000 7f82e3a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:31:56.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.919+0000 7f82e3a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:31:56.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.919+0000 7f82e3a13800 20 rados->read ofs=0 len=0 2024-03-04T12:31:56.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.919+0000 7f82e3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:56.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.919+0000 7f82e3a13800 20 rados->read ofs=0 len=0 2024-03-04T12:31:56.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.919+0000 7f82e3a13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:31:56.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.919+0000 7f82e3a13800 20 rados->read ofs=0 len=0 2024-03-04T12:31:56.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.920+0000 7f82e3a13800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:31:56.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.920+0000 7f82e3a13800 20 zone default found 2024-03-04T12:31:56.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.920+0000 7f82e3a13800 4 Realm: () 2024-03-04T12:31:56.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.920+0000 7f82e3a13800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:31:56.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.920+0000 7f82e3a13800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:31:56.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.920+0000 7f82e3a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:31:56.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.920+0000 7f82e3a13800 20 zonegroup default 2024-03-04T12:31:56.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.920+0000 7f82e3a13800 20 rados->read ofs=0 len=0 2024-03-04T12:31:56.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.920+0000 7f82e3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:56.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.920+0000 7f82e3a13800 20 rados->read ofs=0 len=0 2024-03-04T12:31:56.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.920+0000 7f82e3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:56.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.920+0000 7f82e3a13800 20 rados->read ofs=0 len=0 2024-03-04T12:31:56.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.921+0000 7f82e3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:56.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.921+0000 7f82e3a13800 20 started sync module instance, tier type = 2024-03-04T12:31:56.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.921+0000 7f82e3a13800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:31:56.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.930+0000 7f82e3a13800 20 add_watcher() i=0 2024-03-04T12:31:56.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.930+0000 7f82e3a13800 20 add_watcher() i=1 2024-03-04T12:31:56.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.930+0000 7f82e3a13800 20 add_watcher() i=2 2024-03-04T12:31:56.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.930+0000 7f82e3a13800 20 add_watcher() i=3 2024-03-04T12:31:56.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.930+0000 7f82e3a13800 20 add_watcher() i=4 2024-03-04T12:31:56.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.930+0000 7f82e3a13800 20 add_watcher() i=5 2024-03-04T12:31:56.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.930+0000 7f82e3a13800 20 add_watcher() i=6 2024-03-04T12:31:56.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.931+0000 7f82e3a13800 20 add_watcher() i=7 2024-03-04T12:31:56.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.931+0000 7f82e3a13800 2 all 8 watchers are set, enabling cache 2024-03-04T12:31:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.933+0000 7f8195fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:31:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.933+0000 7f82e3a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:31:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.933+0000 7f82e3a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:31:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.933+0000 7f82e3a13800 5 note: GC not initialized 2024-03-04T12:31:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.933+0000 7f8194fe1640 20 reqs_thread_entry: start 2024-03-04T12:31:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.933+0000 7f82e3a13800 20 init_complete bucket index max shards: 11 2024-03-04T12:31:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.933+0000 7f82e3a13800 20 Filter name: none 2024-03-04T12:31:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.933+0000 7f810e7fc640 20 reqs_thread_entry: start 2024-03-04T12:31:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.933+0000 7f82e3a13800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-03-04T12:31:56.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.933+0000 7f82e3a13800 20 rados->read ofs=0 len=0 2024-03-04T12:31:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.934+0000 7f82e3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.934+0000 7f82e3a13800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-03-04T12:31:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.934+0000 7f82e3a13800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-04T12:31:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.934+0000 7f82e3a13800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-03-04T12:31:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.934+0000 7f82e3a13800 20 rados->read ofs=0 len=0 2024-03-04T12:31:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.934+0000 7f82e3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.934+0000 7f82e3a13800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-03-04T12:31:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.934+0000 7f82e3a13800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-03-04T12:31:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.934+0000 7f82e3a13800 10 cache get: name=default.rgw.meta+users.keys+VOBMCIKWFJPLUYNSIAHG : miss 2024-03-04T12:31:56.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.934+0000 7f82e3a13800 20 rados->read ofs=0 len=0 2024-03-04T12:31:56.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.934+0000 7f82e3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:56.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.934+0000 7f82e3a13800 10 cache put: name=default.rgw.meta+users.keys+VOBMCIKWFJPLUYNSIAHG info.flags=0x0 2024-03-04T12:31:56.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.934+0000 7f82e3a13800 10 adding default.rgw.meta+users.keys+VOBMCIKWFJPLUYNSIAHG to cache LRU end 2024-03-04T12:31:56.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.934+0000 7f82e3a13800 10 cache get: name=default.rgw.meta+users.keys+VOBMCIKWFJPLUYNSIAHG : hit (negative entry) 2024-03-04T12:31:56.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.934+0000 7f82e3a13800 10 cache get: name=default.rgw.meta+users.keys+VOBMCIKWFJPLUYNSIAHG : hit (negative entry) 2024-03-04T12:31:56.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.936+0000 7f82e3a13800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-03-04T12:31:56.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.936+0000 7f82e3a13800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-04T12:31:56.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.936+0000 7f82e3a13800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-03-04T12:31:56.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.936+0000 7f81c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1047972020289 cookie 94679613261232 notifier 5567 bl.length()=642 2024-03-04T12:31:56.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.936+0000 7f81c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-03-04T12:31:56.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.936+0000 7f81c27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-04T12:31:56.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.939+0000 7f82e3a13800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-03-04T12:31:56.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.939+0000 7f82e3a13800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-03-04T12:31:56.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.939+0000 7f82e3a13800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-03-04T12:31:56.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.939+0000 7f81c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1047972020230 cookie 94679613257104 notifier 5567 bl.length()=202 2024-03-04T12:31:56.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.939+0000 7f81c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-03-04T12:31:56.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.939+0000 7f81c27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-03-04T12:31:56.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.942+0000 7f82e3a13800 10 cache put: name=default.rgw.meta+users.keys+VOBMCIKWFJPLUYNSIAHG info.flags=0x7 2024-03-04T12:31:56.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.942+0000 7f82e3a13800 10 moving default.rgw.meta+users.keys+VOBMCIKWFJPLUYNSIAHG to cache LRU end 2024-03-04T12:31:56.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.942+0000 7f82e3a13800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:VOBMCIKWFJPLUYNSIAHG, ofs0, ns] 2024-03-04T12:31:56.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.942+0000 7f81c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1047972020271 cookie 94679613252224 notifier 5567 bl.length()=190 2024-03-04T12:31:56.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.942+0000 7f81c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VOBMCIKWFJPLUYNSIAHG info.flags=0x7 2024-03-04T12:31:56.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.942+0000 7f81c27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VOBMCIKWFJPLUYNSIAHG to cache LRU end 2024-03-04T12:31:56.951 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T12:31:56.951 INFO:teuthology.orchestra.run.smithi110.stdout: "user_id": "ragweed.client.0", 2024-03-04T12:31:56.951 INFO:teuthology.orchestra.run.smithi110.stdout: "display_name": "Mr. ragweed.client.0", 2024-03-04T12:31:56.951 INFO:teuthology.orchestra.run.smithi110.stdout: "email": "ragweed.client.0+test@test.test", 2024-03-04T12:31:56.951 INFO:teuthology.orchestra.run.smithi110.stdout: "suspended": 0, 2024-03-04T12:31:56.951 INFO:teuthology.orchestra.run.smithi110.stdout: "max_buckets": 1000, 2024-03-04T12:31:56.951 INFO:teuthology.orchestra.run.smithi110.stdout: "subusers": [], 2024-03-04T12:31:56.951 INFO:teuthology.orchestra.run.smithi110.stdout: "keys": [ 2024-03-04T12:31:56.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:31:56.951 INFO:teuthology.orchestra.run.smithi110.stdout: "user": "ragweed.client.0", 2024-03-04T12:31:56.951 INFO:teuthology.orchestra.run.smithi110.stdout: "access_key": "VOBMCIKWFJPLUYNSIAHG", 2024-03-04T12:31:56.952 INFO:teuthology.orchestra.run.smithi110.stdout: "secret_key": "p9b/yyZyZQL9rlBdrHRpAzG5kx0NH9FmI2CJSfbZ6GhilYegJAm50A==", 2024-03-04T12:31:56.952 INFO:teuthology.orchestra.run.smithi110.stdout: "active": true 2024-03-04T12:31:56.952 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-03-04T12:31:56.952 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-03-04T12:31:56.952 INFO:teuthology.orchestra.run.smithi110.stdout: "swift_keys": [], 2024-03-04T12:31:56.952 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": [], 2024-03-04T12:31:56.952 INFO:teuthology.orchestra.run.smithi110.stdout: "op_mask": "read, write, delete", 2024-03-04T12:31:56.952 INFO:teuthology.orchestra.run.smithi110.stdout: "default_placement": "", 2024-03-04T12:31:56.952 INFO:teuthology.orchestra.run.smithi110.stdout: "default_storage_class": "", 2024-03-04T12:31:56.952 INFO:teuthology.orchestra.run.smithi110.stdout: "placement_tags": [], 2024-03-04T12:31:56.952 INFO:teuthology.orchestra.run.smithi110.stdout: "bucket_quota": { 2024-03-04T12:31:56.952 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:31:56.952 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:31:56.952 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:31:56.953 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:31:56.953 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:31:56.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:31:56.953 INFO:teuthology.orchestra.run.smithi110.stdout: "user_quota": { 2024-03-04T12:31:56.953 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:31:56.953 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:31:56.953 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:31:56.953 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:31:56.953 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:31:56.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:31:56.953 INFO:teuthology.orchestra.run.smithi110.stdout: "temp_url_keys": [], 2024-03-04T12:31:56.953 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "rgw", 2024-03-04T12:31:56.953 INFO:teuthology.orchestra.run.smithi110.stdout: "mfa_ids": [] 2024-03-04T12:31:56.953 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T12:31:56.954 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:31:56.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.945+0000 7f8195fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:31:56.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.947+0000 7f82e3a13800 20 remove_watcher() i=0 2024-03-04T12:31:56.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.947+0000 7f82e3a13800 2 removed watcher, disabling cache 2024-03-04T12:31:56.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.948+0000 7f82e3a13800 20 remove_watcher() i=1 2024-03-04T12:31:56.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.950+0000 7f82e3a13800 20 remove_watcher() i=2 2024-03-04T12:31:56.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.951+0000 7f82e3a13800 20 remove_watcher() i=3 2024-03-04T12:31:56.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.952+0000 7f82e3a13800 20 remove_watcher() i=4 2024-03-04T12:31:56.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.953+0000 7f82e3a13800 20 remove_watcher() i=5 2024-03-04T12:31:56.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.954+0000 7f82e3a13800 20 remove_watcher() i=6 2024-03-04T12:31:56.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:56.955+0000 7f82e3a13800 20 remove_watcher() i=7 2024-03-04T12:31:56.973 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-03-04T12:31:56.973 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key FCRJBHIVEZRHTRBTIIWG --secret er/q5Nze1+GjeqFlgLHYLieKtC62ayd+q8mSuakftQOJncGkGA49Hg== --email sysuser.client.0+test@test.test --system true 2024-03-04T12:31:57.036 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:31:57.036 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:31:57.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.059+0000 7fd08428c800 20 rados->read ofs=0 len=0 2024-03-04T12:31:57.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.060+0000 7fd08428c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:57.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.061+0000 7fd08428c800 20 realm 2024-03-04T12:31:57.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.061+0000 7fd08428c800 20 rados->read ofs=0 len=0 2024-03-04T12:31:57.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.061+0000 7fd08428c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:57.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.061+0000 7fd08428c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:31:57.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.061+0000 7fd08428c800 20 rados->read ofs=0 len=0 2024-03-04T12:31:57.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.061+0000 7fd08428c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:57.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.061+0000 7fd08428c800 20 rados->read ofs=0 len=0 2024-03-04T12:31:57.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.062+0000 7fd08428c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:31:57.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.062+0000 7fd08428c800 20 rados->read ofs=0 len=0 2024-03-04T12:31:57.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.062+0000 7fd08428c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:31:57.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.062+0000 7fd08428c800 20 searching for the correct realm 2024-03-04T12:31:57.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.064+0000 7fd081d88640 0 -- 172.21.15.110:0/599387820 >> [v2:172.21.15.110:6800/2482344533,v1:172.21.15.110:6801/2482344533] conn(0x7fd07c042040 msgr2=0x7fd07c042420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:31:57.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.469+0000 7fd082589640 0 -- 172.21.15.110:0/599387820 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7fd07405b040 msgr2=0x7fd0740030b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:31:57.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:31:57.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:31:57.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:31:57.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:31:57.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:31:57.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:31:57.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 20 rados->read ofs=0 len=0 2024-03-04T12:31:57.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:57.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 20 rados->read ofs=0 len=0 2024-03-04T12:31:57.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:31:57.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 20 rados->read ofs=0 len=0 2024-03-04T12:31:57.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:31:57.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 20 zone default found 2024-03-04T12:31:57.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 4 Realm: () 2024-03-04T12:31:57.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:31:57.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:31:57.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:31:57.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 20 zonegroup default 2024-03-04T12:31:57.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.478+0000 7fd08428c800 20 rados->read ofs=0 len=0 2024-03-04T12:31:57.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.479+0000 7fd08428c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:57.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.479+0000 7fd08428c800 20 rados->read ofs=0 len=0 2024-03-04T12:31:57.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.479+0000 7fd08428c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:57.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.479+0000 7fd08428c800 20 rados->read ofs=0 len=0 2024-03-04T12:31:57.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.479+0000 7fd08428c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:57.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.479+0000 7fd08428c800 20 started sync module instance, tier type = 2024-03-04T12:31:57.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.479+0000 7fd08428c800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:31:57.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.489+0000 7fd08428c800 20 add_watcher() i=0 2024-03-04T12:31:57.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.489+0000 7fd08428c800 20 add_watcher() i=1 2024-03-04T12:31:57.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.489+0000 7fd08428c800 20 add_watcher() i=2 2024-03-04T12:31:57.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.489+0000 7fd08428c800 20 add_watcher() i=3 2024-03-04T12:31:57.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.489+0000 7fd08428c800 20 add_watcher() i=4 2024-03-04T12:31:57.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.489+0000 7fd08428c800 20 add_watcher() i=5 2024-03-04T12:31:57.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.489+0000 7fd08428c800 20 add_watcher() i=6 2024-03-04T12:31:57.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.489+0000 7fd08428c800 20 add_watcher() i=7 2024-03-04T12:31:57.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.489+0000 7fd08428c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:31:57.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.491+0000 7fcf2f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:31:57.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.491+0000 7fd08428c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:31:57.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.491+0000 7fd08428c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:31:57.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.491+0000 7fd08428c800 5 note: GC not initialized 2024-03-04T12:31:57.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.492+0000 7fcf2e7fc640 20 reqs_thread_entry: start 2024-03-04T12:31:57.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.492+0000 7fd08428c800 20 init_complete bucket index max shards: 11 2024-03-04T12:31:57.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.492+0000 7fd08428c800 20 Filter name: none 2024-03-04T12:31:57.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.492+0000 7fce9ffff640 20 reqs_thread_entry: start 2024-03-04T12:31:57.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.492+0000 7fd08428c800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-03-04T12:31:57.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.492+0000 7fd08428c800 20 rados->read ofs=0 len=0 2024-03-04T12:31:57.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.492+0000 7fd08428c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:57.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.492+0000 7fd08428c800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-03-04T12:31:57.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.492+0000 7fd08428c800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-04T12:31:57.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.492+0000 7fd08428c800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-03-04T12:31:57.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.492+0000 7fd08428c800 20 rados->read ofs=0 len=0 2024-03-04T12:31:57.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.493+0000 7fd08428c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:57.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.493+0000 7fd08428c800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-03-04T12:31:57.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.493+0000 7fd08428c800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-03-04T12:31:57.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.493+0000 7fd08428c800 10 cache get: name=default.rgw.meta+users.keys+FCRJBHIVEZRHTRBTIIWG : miss 2024-03-04T12:31:57.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.493+0000 7fd08428c800 20 rados->read ofs=0 len=0 2024-03-04T12:31:57.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.493+0000 7fd08428c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:31:57.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.493+0000 7fd08428c800 10 cache put: name=default.rgw.meta+users.keys+FCRJBHIVEZRHTRBTIIWG info.flags=0x0 2024-03-04T12:31:57.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.493+0000 7fd08428c800 10 adding default.rgw.meta+users.keys+FCRJBHIVEZRHTRBTIIWG to cache LRU end 2024-03-04T12:31:57.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.493+0000 7fd08428c800 10 cache get: name=default.rgw.meta+users.keys+FCRJBHIVEZRHTRBTIIWG : hit (negative entry) 2024-03-04T12:31:57.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.493+0000 7fd08428c800 10 cache get: name=default.rgw.meta+users.keys+FCRJBHIVEZRHTRBTIIWG : hit (negative entry) 2024-03-04T12:31:57.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.494+0000 7fd08428c800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-03-04T12:31:57.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.494+0000 7fd08428c800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-04T12:31:57.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.494+0000 7fd08428c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-03-04T12:31:57.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.495+0000 7fcf64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1047972020231 cookie 94646690571216 notifier 5937 bl.length()=642 2024-03-04T12:31:57.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.495+0000 7fcf64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-03-04T12:31:57.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.495+0000 7fcf64ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-04T12:31:57.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.498+0000 7fd08428c800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-03-04T12:31:57.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.498+0000 7fd08428c800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-03-04T12:31:57.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.498+0000 7fd08428c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-03-04T12:31:57.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.498+0000 7fcf64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1047972020290 cookie 94646690576592 notifier 5937 bl.length()=202 2024-03-04T12:31:57.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.498+0000 7fcf64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-03-04T12:31:57.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.498+0000 7fcf64ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-03-04T12:31:57.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.501+0000 7fd08428c800 10 cache put: name=default.rgw.meta+users.keys+FCRJBHIVEZRHTRBTIIWG info.flags=0x7 2024-03-04T12:31:57.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.501+0000 7fd08428c800 10 moving default.rgw.meta+users.keys+FCRJBHIVEZRHTRBTIIWG to cache LRU end 2024-03-04T12:31:57.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.501+0000 7fd08428c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:FCRJBHIVEZRHTRBTIIWG, ofs0, ns] 2024-03-04T12:31:57.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.501+0000 7fcf64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1047972020255 cookie 94646690562128 notifier 5937 bl.length()=190 2024-03-04T12:31:57.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.501+0000 7fcf64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FCRJBHIVEZRHTRBTIIWG info.flags=0x7 2024-03-04T12:31:57.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.501+0000 7fcf64ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FCRJBHIVEZRHTRBTIIWG to cache LRU end 2024-03-04T12:31:57.509 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T12:31:57.509 INFO:teuthology.orchestra.run.smithi110.stdout: "user_id": "sysuser.client.0", 2024-03-04T12:31:57.509 INFO:teuthology.orchestra.run.smithi110.stdout: "display_name": "Mr. sysuser.client.0", 2024-03-04T12:31:57.509 INFO:teuthology.orchestra.run.smithi110.stdout: "email": "sysuser.client.0+test@test.test", 2024-03-04T12:31:57.510 INFO:teuthology.orchestra.run.smithi110.stdout: "suspended": 0, 2024-03-04T12:31:57.510 INFO:teuthology.orchestra.run.smithi110.stdout: "max_buckets": 1000, 2024-03-04T12:31:57.510 INFO:teuthology.orchestra.run.smithi110.stdout: "subusers": [], 2024-03-04T12:31:57.510 INFO:teuthology.orchestra.run.smithi110.stdout: "keys": [ 2024-03-04T12:31:57.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:31:57.510 INFO:teuthology.orchestra.run.smithi110.stdout: "user": "sysuser.client.0", 2024-03-04T12:31:57.510 INFO:teuthology.orchestra.run.smithi110.stdout: "access_key": "FCRJBHIVEZRHTRBTIIWG", 2024-03-04T12:31:57.510 INFO:teuthology.orchestra.run.smithi110.stdout: "secret_key": "er/q5Nze1+GjeqFlgLHYLieKtC62ayd+q8mSuakftQOJncGkGA49Hg==", 2024-03-04T12:31:57.510 INFO:teuthology.orchestra.run.smithi110.stdout: "active": true 2024-03-04T12:31:57.510 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-03-04T12:31:57.510 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-03-04T12:31:57.510 INFO:teuthology.orchestra.run.smithi110.stdout: "swift_keys": [], 2024-03-04T12:31:57.510 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": [], 2024-03-04T12:31:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: "op_mask": "read, write, delete", 2024-03-04T12:31:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: "system": true, 2024-03-04T12:31:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: "default_placement": "", 2024-03-04T12:31:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: "default_storage_class": "", 2024-03-04T12:31:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: "placement_tags": [], 2024-03-04T12:31:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: "bucket_quota": { 2024-03-04T12:31:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:31:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:31:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:31:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:31:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:31:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:31:57.511 INFO:teuthology.orchestra.run.smithi110.stdout: "user_quota": { 2024-03-04T12:31:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:31:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:31:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:31:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:31:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:31:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:31:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "temp_url_keys": [], 2024-03-04T12:31:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "rgw", 2024-03-04T12:31:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: "mfa_ids": [] 2024-03-04T12:31:57.512 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T12:31:57.512 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:31:57.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.503+0000 7fcf2f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:31:57.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.506+0000 7fd08428c800 20 remove_watcher() i=0 2024-03-04T12:31:57.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.506+0000 7fd08428c800 2 removed watcher, disabling cache 2024-03-04T12:31:57.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.506+0000 7fd08428c800 20 remove_watcher() i=1 2024-03-04T12:31:57.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.507+0000 7fd08428c800 20 remove_watcher() i=2 2024-03-04T12:31:57.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.508+0000 7fd08428c800 20 remove_watcher() i=3 2024-03-04T12:31:57.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.509+0000 7fd08428c800 20 remove_watcher() i=4 2024-03-04T12:31:57.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.510+0000 7fd08428c800 20 remove_watcher() i=5 2024-03-04T12:31:57.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.511+0000 7fd08428c800 20 remove_watcher() i=6 2024-03-04T12:31:57.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:31:57.512+0000 7fd08428c800 20 remove_watcher() i=7 2024-03-04T12:31:57.529 INFO:tasks.ragweed:Configuring ragweed... 2024-03-04T12:31:57.530 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:31:57.530 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-03-04T12:31:57.556 INFO:tasks.ragweed:Configuring boto... 2024-03-04T12:31:57.557 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:31:57.557 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-03-04T12:31:57.624 DEBUG:teuthology.orchestra.run.smithi110:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-03-04T12:31:57.809 INFO:teuthology.orchestra.run.smithi110.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-03-04T12:31:57.977 INFO:teuthology.orchestra.run.smithi110.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-03-04T12:31:58.465 INFO:teuthology.orchestra.run.smithi110.stdout:py installdeps: -rrequirements.txt 2024-03-04T12:32:07.834 INFO:teuthology.orchestra.run.smithi110.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-03-04T12:32:10.131 INFO:teuthology.orchestra.run.smithi110.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2021.10.8,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-299/tmp/wheel/cockpit-299-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.0,execnet==2.0.2,file-magic==0.4.0,gevent==24.2.1,google-auth==2.28.0,gpg==1.15.1,greenlet==3.0.3,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.4.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.1.0,python-dateutil==2.8.1,python-linux-procfs==0.7.0,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=647e4fe1a943deb0bfbafb7e8de006190bf19cd1a3b26bebd80b87bb665ac693,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.5,sepolicy==3.5,setools==4.4.3,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,sos==4.3,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.4.0,urllib3==1.26.5,WebOb==1.8.7,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==6.2 2024-03-04T12:32:10.131 INFO:teuthology.orchestra.run.smithi110.stdout:py run-test-pre: PYTHONHASHSEED='1983182968' 2024-03-04T12:32:10.131 INFO:teuthology.orchestra.run.smithi110.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-03-04T12:32:10.337 INFO:teuthology.orchestra.run.smithi110.stdout:============================= test session starts ============================== 2024-03-04T12:32:10.337 INFO:teuthology.orchestra.run.smithi110.stdout:platform linux -- Python 3.9.17, pytest-8.1.0, pluggy-1.4.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-03-04T12:32:10.337 INFO:teuthology.orchestra.run.smithi110.stdout:cachedir: .tox/py/.pytest_cache 2024-03-04T12:32:10.338 INFO:teuthology.orchestra.run.smithi110.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-03-04T12:32:10.338 INFO:teuthology.orchestra.run.smithi110.stdout:configfile: pytest.ini 2024-03-04T12:32:10.434 INFO:teuthology.orchestra.run.smithi110.stdout:collecting ... collected 9 items 2024-03-04T12:32:10.435 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:32:16.355 INFO:teuthology.orchestra.run.smithi110.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-03-04T12:32:22.889 INFO:teuthology.orchestra.run.smithi110.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-03-04T12:32:27.325 INFO:teuthology.orchestra.run.smithi110.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-03-04T12:32:33.931 INFO:teuthology.orchestra.run.smithi110.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-03-04T12:32:40.425 INFO:teuthology.orchestra.run.smithi110.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-03-04T12:32:55.041 INFO:teuthology.orchestra.run.smithi110.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-03-04T12:33:07.028 INFO:teuthology.orchestra.run.smithi110.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-03-04T12:33:20.682 INFO:teuthology.orchestra.run.smithi110.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-03-04T12:33:47.345 INFO:teuthology.orchestra.run.smithi110.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-03-04T12:33:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:33:47.346 INFO:teuthology.orchestra.run.smithi110.stdout:=============================== warnings summary =============================== 2024-03-04T12:33:47.346 INFO:teuthology.orchestra.run.smithi110.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-03-04T12:33:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-03-04T12:33:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: import imp 2024-03-04T12:33:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:33:47.346 INFO:teuthology.orchestra.run.smithi110.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-03-04T12:33:47.346 INFO:teuthology.orchestra.run.smithi110.stdout:=================== 9 passed, 1 warning in 97.01s (0:01:37) ==================== 2024-03-04T12:33:47.378 INFO:teuthology.orchestra.run.smithi110.stdout:___________________________________ summary ____________________________________ 2024-03-04T12:33:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: py: commands succeeded 2024-03-04T12:33:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: congratulations :) 2024-03-04T12:33:47.391 INFO:tasks.ragweed:Cleaning up boto... 2024-03-04T12:33:47.392 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-03-04T12:33:47.418 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-03-04T12:33:47.512 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:33:47.512 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:33:47.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.535+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.536+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.536+0000 7f8e1e015800 20 realm 2024-03-04T12:33:47.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.536+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.536+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.536+0000 7f8e1e015800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:33:47.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.536+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.536+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.536+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.537+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:33:47.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.537+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.538+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:33:47.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.538+0000 7f8e1e015800 20 searching for the correct realm 2024-03-04T12:33:47.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.542+0000 7f8e18e15640 0 -- 172.21.15.110:0/1246811473 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f8e0c052920 msgr2=0x7f8e0c0463f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:33:47.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.546+0000 7f8e19e17640 0 -- 172.21.15.110:0/1246811473 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7f8e1007ebe0 msgr2=0x7f8e10007390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:33:47.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.549+0000 7f8e1e015800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:33:47.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.549+0000 7f8e1e015800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:33:47.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.549+0000 7f8e1e015800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:33:47.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.549+0000 7f8e1e015800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:33:47.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.549+0000 7f8e1e015800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:33:47.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.549+0000 7f8e1e015800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:33:47.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.549+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.550+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.550+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.550+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:33:47.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.550+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.550+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:33:47.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.550+0000 7f8e1e015800 20 zone default found 2024-03-04T12:33:47.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.550+0000 7f8e1e015800 4 Realm: () 2024-03-04T12:33:47.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.550+0000 7f8e1e015800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:33:47.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.550+0000 7f8e1e015800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:33:47.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.550+0000 7f8e1e015800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:33:47.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.550+0000 7f8e1e015800 20 zonegroup default 2024-03-04T12:33:47.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.550+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.551+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.551+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.551+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.551+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.551+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.551+0000 7f8e1e015800 20 started sync module instance, tier type = 2024-03-04T12:33:47.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.551+0000 7f8e1e015800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:33:47.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.561+0000 7f8e1e015800 20 add_watcher() i=0 2024-03-04T12:33:47.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.561+0000 7f8e1e015800 20 add_watcher() i=1 2024-03-04T12:33:47.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.561+0000 7f8e1e015800 20 add_watcher() i=2 2024-03-04T12:33:47.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.561+0000 7f8e1e015800 20 add_watcher() i=3 2024-03-04T12:33:47.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.561+0000 7f8e1e015800 20 add_watcher() i=4 2024-03-04T12:33:47.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.561+0000 7f8e1e015800 20 add_watcher() i=5 2024-03-04T12:33:47.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.561+0000 7f8e1e015800 20 add_watcher() i=6 2024-03-04T12:33:47.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.561+0000 7f8e1e015800 20 add_watcher() i=7 2024-03-04T12:33:47.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.561+0000 7f8e1e015800 2 all 8 watchers are set, enabling cache 2024-03-04T12:33:47.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.563+0000 7f8ccffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:33:47.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.563+0000 7f8e1e015800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:33:47.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.563+0000 7f8e1e015800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:33:47.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.600+0000 7f8ccefe5640 20 reqs_thread_entry: start 2024-03-04T12:33:47.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.600+0000 7f8e1e015800 20 init_complete bucket index max shards: 11 2024-03-04T12:33:47.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.600+0000 7f8e1e015800 20 Filter name: none 2024-03-04T12:33:47.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.600+0000 7f8cccfe1640 20 reqs_thread_entry: start 2024-03-04T12:33:47.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.600+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-03-04T12:33:47.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.600+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.601+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=453 2024-03-04T12:33:47.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.601+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-03-04T12:33:47.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.601+0000 7f8e1e015800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-04T12:33:47.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.601+0000 7f8e1e015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:33:47.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.601+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5 : miss 2024-03-04T12:33:47.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.601+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.602+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=378 2024-03-04T12:33:47.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.602+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5 info.flags=0x17 2024-03-04T12:33:47.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.602+0000 7f8e1e015800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5 to cache LRU end 2024-03-04T12:33:47.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.602+0000 7f8e1e015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:33:47.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.602+0000 7f8e1e015800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:33:47.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.602+0000 7f8e1e015800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5 2024-03-04T12:33:47.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.602+0000 7f8e1e015800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-03-04T12:33:47.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.603+0000 7f8e1e015800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-03-04T12:33:47.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.603+0000 7f8e1e015800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-03-04T12:33:47.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.603+0000 7f8e1e015800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-03-04T12:33:47.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.604+0000 7f8e1e015800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-03-04T12:33:47.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.604+0000 7f8e1e015800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-03-04T12:33:47.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.604+0000 7f8e1e015800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-03-04T12:33:47.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.605+0000 7f8e1e015800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-03-04T12:33:47.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.605+0000 7f8e1e015800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-03-04T12:33:47.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.606+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100d1f60 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x562ed5a05098 s->prefetch_data=0 2024-03-04T12:33:47.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.606+0000 7f8e1e015800 10 manifest: total_size = 5001 2024-03-04T12:33:47.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.606+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.6507048638779362199 2024-03-04T12:33:47.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.606+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100d1f60 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x562ed5a05098 s->prefetch_data=0 2024-03-04T12:33:47.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.606+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5a05098 2024-03-04T12:33:47.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.606+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5.1 2024-03-04T12:33:47.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.609+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100d1f60 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x562ed5a05098 s->prefetch_data=0 2024-03-04T12:33:47.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.609+0000 7f8e1e015800 10 manifest: total_size = 4806 2024-03-04T12:33:47.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.609+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15167666468185791855 2024-03-04T12:33:47.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.609+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100d1f60 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x562ed5a05098 s->prefetch_data=0 2024-03-04T12:33:47.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.609+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5a05098 2024-03-04T12:33:47.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.609+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5.2 2024-03-04T12:33:47.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.610+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-03-04T12:33:47.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.611+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100d1f60 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x562ed5a04ee8 s->prefetch_data=0 2024-03-04T12:33:47.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.612+0000 7f8e1e015800 10 manifest: total_size = 7634 2024-03-04T12:33:47.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.612+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7887154678572483857 2024-03-04T12:33:47.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.612+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100d1f60 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x562ed5a04ee8 s->prefetch_data=0 2024-03-04T12:33:47.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.612+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5a04ee8 2024-03-04T12:33:47.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.612+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5.2 2024-03-04T12:33:47.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.612+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-03-04T12:33:47.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.614+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100d1f60 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x562ed5a04ea8 s->prefetch_data=0 2024-03-04T12:33:47.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.614+0000 7f8e1e015800 10 manifest: total_size = 7447 2024-03-04T12:33:47.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.614+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17405168326003003211 2024-03-04T12:33:47.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.614+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100d1f60 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x562ed5a04ea8 s->prefetch_data=0 2024-03-04T12:33:47.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.614+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5a04ea8 2024-03-04T12:33:47.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.614+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5.3 2024-03-04T12:33:47.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.615+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-03-04T12:33:47.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.616+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100d1f60 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x562ed5a04ea8 s->prefetch_data=0 2024-03-04T12:33:47.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.616+0000 7f8e1e015800 10 manifest: total_size = 7449 2024-03-04T12:33:47.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.616+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9122407771206029401 2024-03-04T12:33:47.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.616+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100d1f60 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x562ed5a04ea8 s->prefetch_data=0 2024-03-04T12:33:47.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.616+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5a04ea8 2024-03-04T12:33:47.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.616+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5.4 2024-03-04T12:33:47.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.617+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-03-04T12:33:47.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.620+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598b1c0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x562ed5a04e68 s->prefetch_data=0 2024-03-04T12:33:47.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.620+0000 7f8e1e015800 10 manifest: total_size = 5114 2024-03-04T12:33:47.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.620+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17314925106323806452 2024-03-04T12:33:47.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.620+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598b1c0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x562ed5a04e68 s->prefetch_data=0 2024-03-04T12:33:47.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.620+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5a04e68 2024-03-04T12:33:47.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.620+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5.4 2024-03-04T12:33:47.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.621+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-03-04T12:33:47.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.623+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598b1c0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x562ed5a04e68 s->prefetch_data=0 2024-03-04T12:33:47.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.623+0000 7f8e1e015800 10 manifest: total_size = 7412 2024-03-04T12:33:47.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.623+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10504361120953945644 2024-03-04T12:33:47.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.623+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598b1c0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x562ed5a04e68 s->prefetch_data=0 2024-03-04T12:33:47.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.623+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5a04e68 2024-03-04T12:33:47.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.623+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5.5 2024-03-04T12:33:47.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.624+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-03-04T12:33:47.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.625+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598b1c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x562ed5a04e68 s->prefetch_data=0 2024-03-04T12:33:47.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.625+0000 7f8e1e015800 10 manifest: total_size = 14027 2024-03-04T12:33:47.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.625+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.6003903623618665129 2024-03-04T12:33:47.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.625+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598b1c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x562ed5a04e68 s->prefetch_data=0 2024-03-04T12:33:47.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.625+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5a04e68 2024-03-04T12:33:47.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.625+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5.7 2024-03-04T12:33:47.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.626+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-03-04T12:33:47.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.628+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e14088130 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x562ed5a04968 s->prefetch_data=0 2024-03-04T12:33:47.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.628+0000 7f8e1e015800 10 manifest: total_size = 5337 2024-03-04T12:33:47.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.628+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5936710971570733943 2024-03-04T12:33:47.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.628+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e14088130 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x562ed5a04968 s->prefetch_data=0 2024-03-04T12:33:47.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.628+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5a04968 2024-03-04T12:33:47.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.628+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5.8 2024-03-04T12:33:47.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.629+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-03-04T12:33:47.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.630+0000 7f8e1e015800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:33:47.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.630+0000 7f8e1e015800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:33:47.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.631+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-03-04T12:33:47.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.632+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:33:47.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.632+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:33:47.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.632+0000 7f8e1e015800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:33:47.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.632+0000 7f8e1e015800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:33:47.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.632+0000 7f8e1e015800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5])"; uploads.size()=0; is_truncated=0 2024-03-04T12:33:47.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.634+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-03-04T12:33:47.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.634+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.634+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=204 2024-03-04T12:33:47.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.634+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-03-04T12:33:47.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.634+0000 7f8e1e015800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-03-04T12:33:47.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.635+0000 7f8e1e015800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-03-04T12:33:47.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.635+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-03-04T12:33:47.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.636+0000 7f8cebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824072 cookie 94759151761056 notifier 5973 bl.length()=162 2024-03-04T12:33:47.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.638+0000 7f8e1e015800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5 from cache 2024-03-04T12:33:47.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.638+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5, ofs0, ns] 2024-03-04T12:33:47.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.638+0000 7f8cebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824011 cookie 94759151770960 notifier 5973 bl.length()=219 2024-03-04T12:33:47.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.642+0000 7f8e1e015800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5 : miss 2024-03-04T12:33:47.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.642+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.642+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.642+0000 7f8e1e015800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5 info.flags=0x0 2024-03-04T12:33:47.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.642+0000 7f8e1e015800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5 to cache LRU end 2024-03-04T12:33:47.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.644+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12 : miss 2024-03-04T12:33:47.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.644+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.645+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=409 2024-03-04T12:33:47.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.645+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12 info.flags=0x17 2024-03-04T12:33:47.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.645+0000 7f8e1e015800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12 to cache LRU end 2024-03-04T12:33:47.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.645+0000 7f8e1e015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:33:47.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.645+0000 7f8e1e015800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:33:47.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.645+0000 7f8e1e015800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12 2024-03-04T12:33:47.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.649+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo 2024-03-04T12:33:47.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.649+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100d2650 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x562ed5a04968 s->prefetch_data=0 2024-03-04T12:33:47.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.649+0000 7f8e1e015800 10 manifest: total_size = 886297 2024-03-04T12:33:47.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.649+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14660057757368240927 2024-03-04T12:33:47.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.649+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100d2650 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x562ed5a04968 s->prefetch_data=0 2024-03-04T12:33:47.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.649+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5a04968 2024-03-04T12:33:47.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.649+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12.10 2024-03-04T12:33:47.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-04T12:33:47.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-03-04T12:33:47.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-03-04T12:33:47.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-04T12:33:47.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-03-04T12:33:47.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-03-04T12:33:47.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-04T12:33:47.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-03-04T12:33:47.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-03-04T12:33:47.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-03-04T12:33:47.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-03-04T12:33:47.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-03-04T12:33:47.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14660057757368240927 2024-03-04T12:33:47.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12__multipart_foo.2~i7fjol3Jrp0_BI3b7pE4TPxC_Kp5pFj.1 2024-03-04T12:33:47.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-03-04T12:33:47.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12__multipart_foo.2~i7fjol3Jrp0_BI3b7pE4TPxC_Kp5pFj.2 2024-03-04T12:33:47.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-03-04T12:33:47.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12__multipart_foo.2~i7fjol3Jrp0_BI3b7pE4TPxC_Kp5pFj.3 2024-03-04T12:33:47.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-03-04T12:33:47.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12__multipart_foo.2~i7fjol3Jrp0_BI3b7pE4TPxC_Kp5pFj.4 2024-03-04T12:33:47.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-03-04T12:33:47.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.651+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14660057757368240927 2024-03-04T12:33:47.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.652+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo 2024-03-04T12:33:47.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.653+0000 7f8e1e015800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:33:47.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.653+0000 7f8e1e015800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:33:47.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.653+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:33:47.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.653+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:33:47.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.653+0000 7f8e1e015800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:33:47.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.653+0000 7f8e1e015800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:33:47.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.653+0000 7f8e1e015800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12])"; uploads.size()=0; is_truncated=0 2024-03-04T12:33:47.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.656+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-03-04T12:33:47.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.656+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.657+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=235 2024-03-04T12:33:47.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.657+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-03-04T12:33:47.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.657+0000 7f8e1e015800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-03-04T12:33:47.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.658+0000 7f8e1e015800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-03-04T12:33:47.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.658+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-03-04T12:33:47.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.658+0000 7f8cfcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824054 cookie 94759151764256 notifier 5973 bl.length()=191 2024-03-04T12:33:47.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.660+0000 7f8e1e015800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12 from cache 2024-03-04T12:33:47.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.660+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12, ofs0, ns] 2024-03-04T12:33:47.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.661+0000 7f8cebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824012 cookie 94759151770960 notifier 5973 bl.length()=249 2024-03-04T12:33:47.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.664+0000 7f8e1e015800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12 : miss 2024-03-04T12:33:47.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.664+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.664+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.664+0000 7f8e1e015800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12 info.flags=0x0 2024-03-04T12:33:47.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.664+0000 7f8e1e015800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12 to cache LRU end 2024-03-04T12:33:47.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.666+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13 : miss 2024-03-04T12:33:47.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.666+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.667+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=416 2024-03-04T12:33:47.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.667+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13 info.flags=0x17 2024-03-04T12:33:47.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.667+0000 7f8e1e015800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13 to cache LRU end 2024-03-04T12:33:47.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.667+0000 7f8e1e015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:33:47.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.667+0000 7f8e1e015800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:33:47.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.667+0000 7f8e1e015800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13 2024-03-04T12:33:47.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.670+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo 2024-03-04T12:33:47.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.670+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e10008020 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x562ed5a04968 s->prefetch_data=0 2024-03-04T12:33:47.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.671+0000 7f8e1e015800 10 manifest: total_size = 886297 2024-03-04T12:33:47.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.671+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9948899938861830815 2024-03-04T12:33:47.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.671+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e10008020 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x562ed5a04968 s->prefetch_data=0 2024-03-04T12:33:47.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.671+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5a04968 2024-03-04T12:33:47.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.671+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13.10 2024-03-04T12:33:47.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-04T12:33:47.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-03-04T12:33:47.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-03-04T12:33:47.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-04T12:33:47.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-03-04T12:33:47.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-03-04T12:33:47.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-04T12:33:47.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-03-04T12:33:47.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-03-04T12:33:47.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-03-04T12:33:47.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-03-04T12:33:47.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-03-04T12:33:47.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9948899938861830815 2024-03-04T12:33:47.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13__multipart_foo.2~iRuDy7EzBXzWC9ELDof04xzKwovxAxS.1 2024-03-04T12:33:47.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-03-04T12:33:47.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13__multipart_foo.2~iRuDy7EzBXzWC9ELDof04xzKwovxAxS.2 2024-03-04T12:33:47.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-03-04T12:33:47.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13__multipart_foo.2~iRuDy7EzBXzWC9ELDof04xzKwovxAxS.3 2024-03-04T12:33:47.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-03-04T12:33:47.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13__multipart_foo.2~iRuDy7EzBXzWC9ELDof04xzKwovxAxS.4 2024-03-04T12:33:47.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-03-04T12:33:47.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.673+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9948899938861830815 2024-03-04T12:33:47.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.674+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo 2024-03-04T12:33:47.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.674+0000 7f8e1e015800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:33:47.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.674+0000 7f8e1e015800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:33:47.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.675+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:33:47.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.675+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:33:47.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.675+0000 7f8e1e015800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:33:47.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.675+0000 7f8e1e015800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:33:47.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.675+0000 7f8e1e015800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13])"; uploads.size()=0; is_truncated=0 2024-03-04T12:33:47.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.676+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-03-04T12:33:47.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.676+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.677+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=242 2024-03-04T12:33:47.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.677+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-03-04T12:33:47.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.677+0000 7f8e1e015800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-03-04T12:33:47.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.678+0000 7f8e1e015800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-03-04T12:33:47.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.678+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-03-04T12:33:47.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.678+0000 7f8cfcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824012 cookie 94759151768320 notifier 5973 bl.length()=198 2024-03-04T12:33:47.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.682+0000 7f8e1e015800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13 from cache 2024-03-04T12:33:47.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.682+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13, ofs0, ns] 2024-03-04T12:33:47.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.682+0000 7f8cfcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824073 cookie 94759151761056 notifier 5973 bl.length()=256 2024-03-04T12:33:47.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.685+0000 7f8e1e015800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13 : miss 2024-03-04T12:33:47.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.685+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.685+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.685+0000 7f8e1e015800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13 info.flags=0x0 2024-03-04T12:33:47.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.685+0000 7f8e1e015800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13 to cache LRU end 2024-03-04T12:33:47.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.688+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11 : miss 2024-03-04T12:33:47.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.688+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.688+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=411 2024-03-04T12:33:47.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.688+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11 info.flags=0x17 2024-03-04T12:33:47.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.688+0000 7f8e1e015800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11 to cache LRU end 2024-03-04T12:33:47.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.688+0000 7f8e1e015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:33:47.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.688+0000 7f8e1e015800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:33:47.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.688+0000 7f8e1e015800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11 2024-03-04T12:33:47.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.692+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo[y3YI03pnw61klbo6EQTPmGXVNjOIjhL] 2024-03-04T12:33:47.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.692+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11.10 2024-03-04T12:33:47.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.692+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1405c4e0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.692+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to lbctyp90ftpplptazbds9cnsbp5q3962 2024-03-04T12:33:47.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.692+0000 7f8e1e015800 20 get_obj_state_impl: setting s->olh_tag to fwip9of59nmkz8i37dp892j8axb0dv5r 2024-03-04T12:33:47.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.692+0000 7f8e1e015800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fwip9of59nmkz8i37dp892j8axb0dv5r 2024-03-04T12:33:47.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.693+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11.10 2024-03-04T12:33:47.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.695+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11.10 2024-03-04T12:33:47.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.695+0000 7f8e1e015800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-03-04T12:33:47.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.695+0000 7f8e1e015800 20 olh_log_entry: epoch=3 op=3 key=foo[y3YI03pnw61klbo6EQTPmGXVNjOIjhL] 2024-03-04T12:33:47.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.695+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1405c4e0 obj=test-client.0-r-test-multipart-index-versioning.1:_:y3YI03pnw61klbo6EQTPmGXVNjOIjhL_foo state=0x562ed59a4288 s->prefetch_data=0 2024-03-04T12:33:47.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.696+0000 7f8e1e015800 10 manifest: total_size = 1667 2024-03-04T12:33:47.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.696+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15560268107241374403 2024-03-04T12:33:47.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.696+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1405c4e0 obj=test-client.0-r-test-multipart-index-versioning.1:_:y3YI03pnw61klbo6EQTPmGXVNjOIjhL_foo state=0x562ed59a4288 s->prefetch_data=0 2024-03-04T12:33:47.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.696+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed59a4288 2024-03-04T12:33:47.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.696+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11.10 2024-03-04T12:33:47.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-04T12:33:47.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-03-04T12:33:47.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-03-04T12:33:47.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-04T12:33:47.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-03-04T12:33:47.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-03-04T12:33:47.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-04T12:33:47.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-03-04T12:33:47.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-03-04T12:33:47.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-03-04T12:33:47.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-03-04T12:33:47.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-03-04T12:33:47.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15560268107241374403 2024-03-04T12:33:47.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11__multipart_foo.2~n3W9cnNfKEnql6nAWDtkRf4QOGXLUc8.1 2024-03-04T12:33:47.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-03-04T12:33:47.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11__multipart_foo.2~n3W9cnNfKEnql6nAWDtkRf4QOGXLUc8.2 2024-03-04T12:33:47.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-03-04T12:33:47.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11__multipart_foo.2~n3W9cnNfKEnql6nAWDtkRf4QOGXLUc8.3 2024-03-04T12:33:47.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-03-04T12:33:47.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11__multipart_foo.2~n3W9cnNfKEnql6nAWDtkRf4QOGXLUc8.4 2024-03-04T12:33:47.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-03-04T12:33:47.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.697+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15560268107241374403 2024-03-04T12:33:47.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.698+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=foo[y3YI03pnw61klbo6EQTPmGXVNjOIjhL] 2024-03-04T12:33:47.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.700+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1405c4e0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.700+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11.10 2024-03-04T12:33:47.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.701+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11.10 2024-03-04T12:33:47.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.701+0000 7f8e1e015800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:33:47.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.701+0000 7f8e1e015800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:33:47.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.702+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:33:47.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.702+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:33:47.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.702+0000 7f8e1e015800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:33:47.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.702+0000 7f8e1e015800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:33:47.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.702+0000 7f8e1e015800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11])"; uploads.size()=0; is_truncated=0 2024-03-04T12:33:47.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.704+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-03-04T12:33:47.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.704+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.704+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=237 2024-03-04T12:33:47.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.704+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-03-04T12:33:47.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.704+0000 7f8e1e015800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-03-04T12:33:47.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.705+0000 7f8e1e015800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-03-04T12:33:47.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.705+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-03-04T12:33:47.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.705+0000 7f8cebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824013 cookie 94759151768320 notifier 5973 bl.length()=193 2024-03-04T12:33:47.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.708+0000 7f8e1e015800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11 from cache 2024-03-04T12:33:47.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.708+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11, ofs0, ns] 2024-03-04T12:33:47.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.708+0000 7f8cebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824039 cookie 94759151765824 notifier 5973 bl.length()=251 2024-03-04T12:33:47.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.712+0000 7f8e1e015800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11 : miss 2024-03-04T12:33:47.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.712+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.712+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.712+0000 7f8e1e015800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11 info.flags=0x0 2024-03-04T12:33:47.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.712+0000 7f8e1e015800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11 to cache LRU end 2024-03-04T12:33:47.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.714+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10 : miss 2024-03-04T12:33:47.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.714+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.714+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=401 2024-03-04T12:33:47.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.714+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10 info.flags=0x17 2024-03-04T12:33:47.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.714+0000 7f8e1e015800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10 to cache LRU end 2024-03-04T12:33:47.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.714+0000 7f8e1e015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:33:47.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.714+0000 7f8e1e015800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:33:47.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.714+0000 7f8e1e015800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10 2024-03-04T12:33:47.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.718+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo 2024-03-04T12:33:47.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.718+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed5a061e0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x562ed5989b78 s->prefetch_data=0 2024-03-04T12:33:47.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.718+0000 7f8e1e015800 10 manifest: total_size = 18874368 2024-03-04T12:33:47.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.718+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14582732577554803002 2024-03-04T12:33:47.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.718+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed5a061e0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x562ed5989b78 s->prefetch_data=0 2024-03-04T12:33:47.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.718+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5989b78 2024-03-04T12:33:47.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.718+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10.10 2024-03-04T12:33:47.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-04T12:33:47.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:33:47.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:33:47.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-03-04T12:33:47.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-03-04T12:33:47.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-03-04T12:33:47.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-03-04T12:33:47.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-03-04T12:33:47.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-03-04T12:33:47.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14582732577554803002 2024-03-04T12:33:47.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10__multipart_foo.2~Bss21gkejmmCddDFb5xkbdXV4zGzJX1.1 2024-03-04T12:33:47.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-03-04T12:33:47.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10__multipart_foo.2~Bss21gkejmmCddDFb5xkbdXV4zGzJX1.2 2024-03-04T12:33:47.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-03-04T12:33:47.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10__multipart_foo.2~Bss21gkejmmCddDFb5xkbdXV4zGzJX1.3 2024-03-04T12:33:47.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-03-04T12:33:47.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10__multipart_foo.2~Bss21gkejmmCddDFb5xkbdXV4zGzJX1.4 2024-03-04T12:33:47.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-03-04T12:33:47.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.720+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14582732577554803002 2024-03-04T12:33:47.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.721+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo 2024-03-04T12:33:47.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.722+0000 7f8e1e015800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:33:47.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.722+0000 7f8e1e015800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:33:47.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.722+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:33:47.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.722+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:33:47.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.722+0000 7f8e1e015800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:33:47.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.722+0000 7f8e1e015800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:33:47.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.722+0000 7f8e1e015800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10])"; uploads.size()=0; is_truncated=0 2024-03-04T12:33:47.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.724+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-03-04T12:33:47.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.724+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.724+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=227 2024-03-04T12:33:47.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.724+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-03-04T12:33:47.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.724+0000 7f8e1e015800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-03-04T12:33:47.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.725+0000 7f8e1e015800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-03-04T12:33:47.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.725+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-03-04T12:33:47.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.726+0000 7f8cebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824074 cookie 94759151773632 notifier 5973 bl.length()=183 2024-03-04T12:33:47.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.728+0000 7f8e1e015800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10 from cache 2024-03-04T12:33:47.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.728+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10, ofs0, ns] 2024-03-04T12:33:47.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.728+0000 7f8cebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824075 cookie 94759151773632 notifier 5973 bl.length()=241 2024-03-04T12:33:47.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.732+0000 7f8e1e015800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10 : miss 2024-03-04T12:33:47.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.732+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.732+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.732+0000 7f8e1e015800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10 info.flags=0x0 2024-03-04T12:33:47.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.732+0000 7f8e1e015800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10 to cache LRU end 2024-03-04T12:33:47.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.734+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16 : miss 2024-03-04T12:33:47.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.734+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.735+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=407 2024-03-04T12:33:47.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.735+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16 info.flags=0x17 2024-03-04T12:33:47.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.735+0000 7f8e1e015800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16 to cache LRU end 2024-03-04T12:33:47.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.735+0000 7f8e1e015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:33:47.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.735+0000 7f8e1e015800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:33:47.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.735+0000 7f8e1e015800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16 2024-03-04T12:33:47.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.735+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-03-04T12:33:47.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.736+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-03-04T12:33:47.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.736+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-04T12:33:47.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.737+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-03-04T12:33:47.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.737+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-03-04T12:33:47.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.737+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-04T12:33:47.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.738+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-03-04T12:33:47.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.738+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-04T12:33:47.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.738+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-03-04T12:33:47.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.738+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-03-04T12:33:47.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.738+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-03-04T12:33:47.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.739+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-03-04T12:33:47.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.739+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598c730 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.739+0000 7f8e1e015800 10 manifest: total_size = 27197 2024-03-04T12:33:47.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.739+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to _FnjWSPU_m5ApAjm-v-ZtcC742ymvMCm 2024-03-04T12:33:47.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.739+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598c730 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.739+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5988e48 2024-03-04T12:33:47.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.739+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16.0 2024-03-04T12:33:47.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.742+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.742+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=27197 stripe_ofs=27197 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.742+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: _FnjWSPU_m5ApAjm-v-ZtcC742ymvMCm 2024-03-04T12:33:47.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.742+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.742+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.aBMKX0Jidmc5Nrv4IHYtUE1XETPDZFu_0 2024-03-04T12:33:47.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.742+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-04T12:33:47.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.742+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.742+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _FnjWSPU_m5ApAjm-v-ZtcC742ymvMCm 2024-03-04T12:33:47.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.743+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-03-04T12:33:47.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.743+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598c730 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.743+0000 7f8e1e015800 10 manifest: total_size = 5242880 2024-03-04T12:33:47.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.743+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to _PVZdviq26EgcO8AowFwMc-yH7MMZ9fa 2024-03-04T12:33:47.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.743+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598c730 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.743+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5988e48 2024-03-04T12:33:47.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.743+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16.2 2024-03-04T12:33:47.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.746+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.746+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.746+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: _PVZdviq26EgcO8AowFwMc-yH7MMZ9fa 2024-03-04T12:33:47.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.746+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.746+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.Rkvq6bD8mszaIwSLo4-cFwmwB129nNo_1 2024-03-04T12:33:47.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.746+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-04T12:33:47.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.746+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.746+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _PVZdviq26EgcO8AowFwMc-yH7MMZ9fa 2024-03-04T12:33:47.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.748+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-03-04T12:33:47.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.748+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed56a6be0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.748+0000 7f8e1e015800 10 manifest: total_size = 5242880 2024-03-04T12:33:47.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.748+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12440524166839900593 2024-03-04T12:33:47.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.748+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed56a6be0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.748+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5988e48 2024-03-04T12:33:47.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.748+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16.3 2024-03-04T12:33:47.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.750+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.750+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.750+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12440524166839900593 2024-03-04T12:33:47.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.750+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.750+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.ulIvZXFBeaM7Vl39uLGUtCbEkEuyDWC_0 2024-03-04T12:33:47.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.750+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-03-04T12:33:47.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.750+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.750+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12440524166839900593 2024-03-04T12:33:47.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.751+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e10008020 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.751+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-04T12:33:47.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.752+0000 7f8e1e015800 10 manifest: total_size = 5242880 2024-03-04T12:33:47.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.752+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to _47ppJ2Fup8id6If-lmR87G75A16H1Qr 2024-03-04T12:33:47.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.752+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e10008020 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.752+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5988e48 2024-03-04T12:33:47.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.752+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16.5 2024-03-04T12:33:47.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.754+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.754+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.754+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: _47ppJ2Fup8id6If-lmR87G75A16H1Qr 2024-03-04T12:33:47.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.754+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.754+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.98J3wI2r5bwU0M0dfd9peR4MRYhR2sq_0 2024-03-04T12:33:47.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.754+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-04T12:33:47.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.754+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.754+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _47ppJ2Fup8id6If-lmR87G75A16H1Qr 2024-03-04T12:33:47.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.755+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-03-04T12:33:47.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.755+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e10008020 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.755+0000 7f8e1e015800 10 manifest: total_size = 5242880 2024-03-04T12:33:47.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.755+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to _vfvDl0xHu7nKvCrOWur-8oG9W_NJWw4 2024-03-04T12:33:47.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.755+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e10008020 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.755+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5988e48 2024-03-04T12:33:47.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.755+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16.5 2024-03-04T12:33:47.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.757+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.757+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.757+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: _vfvDl0xHu7nKvCrOWur-8oG9W_NJWw4 2024-03-04T12:33:47.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.757+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.757+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.NnzEjxY_Mw66YxzqRe5SColZzUlQA0W_0 2024-03-04T12:33:47.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.757+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-04T12:33:47.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.757+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.757+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _vfvDl0xHu7nKvCrOWur-8oG9W_NJWw4 2024-03-04T12:33:47.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.758+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-03-04T12:33:47.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.758+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e10008020 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.759+0000 7f8e1e015800 10 manifest: total_size = 27197 2024-03-04T12:33:47.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.759+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17030824780897445372 2024-03-04T12:33:47.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.759+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e10008020 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.759+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5988e48 2024-03-04T12:33:47.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.759+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16.5 2024-03-04T12:33:47.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.761+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e10008020 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.761+0000 7f8e1e015800 10 manifest: total_size = 5242880 2024-03-04T12:33:47.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.761+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to _HJXNTRVUZNUFC3ULb2cXvHV8ZvChm-M 2024-03-04T12:33:47.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.761+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e10008020 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.761+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5988e48 2024-03-04T12:33:47.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.761+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16.7 2024-03-04T12:33:47.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.762+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-04T12:33:47.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.764+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.764+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.764+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: _HJXNTRVUZNUFC3ULb2cXvHV8ZvChm-M 2024-03-04T12:33:47.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.764+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.764+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.C54OxcfB2-nLq0mogrE9ns-mcnBc45z_1 2024-03-04T12:33:47.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.764+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-04T12:33:47.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.764+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.764+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _HJXNTRVUZNUFC3ULb2cXvHV8ZvChm-M 2024-03-04T12:33:47.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.765+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-03-04T12:33:47.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.765+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598aa00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.766+0000 7f8e1e015800 10 manifest: total_size = 5242880 2024-03-04T12:33:47.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.766+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3063653365328619314 2024-03-04T12:33:47.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.766+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598aa00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.766+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5988e48 2024-03-04T12:33:47.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.766+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16.7 2024-03-04T12:33:47.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.768+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.768+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.768+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3063653365328619314 2024-03-04T12:33:47.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.768+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.768+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.3ZBfxUtboI38Q4ZEeaPUaHQ_Mjx7gA8_0 2024-03-04T12:33:47.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.768+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-03-04T12:33:47.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.768+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.768+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3063653365328619314 2024-03-04T12:33:47.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.769+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-04T12:33:47.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.769+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598aa00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.770+0000 7f8e1e015800 10 manifest: total_size = 27197 2024-03-04T12:33:47.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.770+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to _7cL04mBwJn_xwTt6nlso7fmo55UxjcX 2024-03-04T12:33:47.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.770+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598aa00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.770+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5988e48 2024-03-04T12:33:47.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.770+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16.7 2024-03-04T12:33:47.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.772+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e14088130 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.772+0000 7f8e1e015800 10 manifest: total_size = 5242880 2024-03-04T12:33:47.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.772+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.772+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.772+0000 7f8e1e015800 10 generate_fake_tag new tag=82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.3ZBfxUtboI38Q4ZEeaPUaHQ_Mjx7gA8_1_8cac4533320dfecc12563d67714d7787 2024-03-04T12:33:47.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.772+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.3ZBfxUtboI38Q4ZEeaPUaHQ_Mjx7gA8_1_8cac4533320dfecc12563d67714d7787 2024-03-04T12:33:47.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.772+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e14088130 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.772+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5988e48 2024-03-04T12:33:47.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.772+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16.8 2024-03-04T12:33:47.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.773+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-03-04T12:33:47.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.774+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.774+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.774+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.3ZBfxUtboI38Q4ZEeaPUaHQ_Mjx7gA8_1_8cac4533320dfecc12563d67714d7787 2024-03-04T12:33:47.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.774+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.774+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.3ZBfxUtboI38Q4ZEeaPUaHQ_Mjx7gA8_0 2024-03-04T12:33:47.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.774+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 398 2024-03-04T12:33:47.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.774+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.774+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.3ZBfxUtboI38Q4ZEeaPUaHQ_Mjx7gA8_1_8cac4533320dfecc12563d67714d7787 2024-03-04T12:33:47.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.775+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-03-04T12:33:47.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.775+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e0c093490 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.776+0000 7f8e1e015800 10 manifest: total_size = 27197 2024-03-04T12:33:47.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.776+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to _AqXYMh9FRI-I4t4ym-qaT5g52N8Jv20 2024-03-04T12:33:47.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.776+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e0c093490 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.776+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5988e48 2024-03-04T12:33:47.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.776+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16.8 2024-03-04T12:33:47.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.778+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.778+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=27197 stripe_ofs=27197 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.778+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: _AqXYMh9FRI-I4t4ym-qaT5g52N8Jv20 2024-03-04T12:33:47.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.778+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.778+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.RhXIZms4CTNq80ui8xoEJ6XVD1BIfMJ_0 2024-03-04T12:33:47.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.778+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-04T12:33:47.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.778+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.778+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _AqXYMh9FRI-I4t4ym-qaT5g52N8Jv20 2024-03-04T12:33:47.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.779+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-03-04T12:33:47.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.779+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e10008020 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.779+0000 7f8e1e015800 10 manifest: total_size = 5242880 2024-03-04T12:33:47.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.779+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.779+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.779+0000 7f8e1e015800 10 generate_fake_tag new tag=82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.ulIvZXFBeaM7Vl39uLGUtCbEkEuyDWC_1_b7ceb4558202b7b2a852812a4f3a6214 2024-03-04T12:33:47.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.779+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.ulIvZXFBeaM7Vl39uLGUtCbEkEuyDWC_1_b7ceb4558202b7b2a852812a4f3a6214 2024-03-04T12:33:47.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.779+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e10008020 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x562ed5988e48 s->prefetch_data=0 2024-03-04T12:33:47.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.779+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5988e48 2024-03-04T12:33:47.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.779+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16.9 2024-03-04T12:33:47.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.781+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.781+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.781+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.ulIvZXFBeaM7Vl39uLGUtCbEkEuyDWC_1_b7ceb4558202b7b2a852812a4f3a6214 2024-03-04T12:33:47.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.781+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.781+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.ulIvZXFBeaM7Vl39uLGUtCbEkEuyDWC_0 2024-03-04T12:33:47.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.781+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 396 2024-03-04T12:33:47.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.781+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.781+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.ulIvZXFBeaM7Vl39uLGUtCbEkEuyDWC_1_b7ceb4558202b7b2a852812a4f3a6214 2024-03-04T12:33:47.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.783+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-03-04T12:33:47.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.783+0000 7f8e1e015800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:33:47.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.783+0000 7f8e1e015800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:33:47.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.783+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:33:47.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.783+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:33:47.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.783+0000 7f8e1e015800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:33:47.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.783+0000 7f8e1e015800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:33:47.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.783+0000 7f8e1e015800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16])"; uploads.size()=0; is_truncated=0 2024-03-04T12:33:47.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.785+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-03-04T12:33:47.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.785+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.786+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=233 2024-03-04T12:33:47.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.786+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-03-04T12:33:47.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.786+0000 7f8e1e015800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-03-04T12:33:47.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.787+0000 7f8e1e015800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-03-04T12:33:47.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.787+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-03-04T12:33:47.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.787+0000 7f8cebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824014 cookie 94759151768320 notifier 5973 bl.length()=189 2024-03-04T12:33:47.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.790+0000 7f8e1e015800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16 from cache 2024-03-04T12:33:47.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.790+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16, ofs0, ns] 2024-03-04T12:33:47.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.790+0000 7f8cebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824040 cookie 94759151765824 notifier 5973 bl.length()=247 2024-03-04T12:33:47.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.793+0000 7f8e1e015800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16 : miss 2024-03-04T12:33:47.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.793+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.794+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.794+0000 7f8e1e015800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16 info.flags=0x0 2024-03-04T12:33:47.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.794+0000 7f8e1e015800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16 to cache LRU end 2024-03-04T12:33:47.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.796+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17 : miss 2024-03-04T12:33:47.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.796+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.796+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=417 2024-03-04T12:33:47.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.796+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17 info.flags=0x17 2024-03-04T12:33:47.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.796+0000 7f8e1e015800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17 to cache LRU end 2024-03-04T12:33:47.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.796+0000 7f8e1e015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:33:47.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.796+0000 7f8e1e015800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:33:47.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.796+0000 7f8e1e015800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17 2024-03-04T12:33:47.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.797+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-03-04T12:33:47.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.798+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-03-04T12:33:47.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.798+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-04T12:33:47.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.799+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-03-04T12:33:47.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.799+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-03-04T12:33:47.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.799+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-04T12:33:47.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.799+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-03-04T12:33:47.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.799+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-04T12:33:47.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.799+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-03-04T12:33:47.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.800+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-03-04T12:33:47.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.800+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-03-04T12:33:47.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.800+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-03-04T12:33:47.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.801+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e0c020b20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.801+0000 7f8e1e015800 10 manifest: total_size = 16377 2024-03-04T12:33:47.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.801+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to _vzZtoR7nU6qPxnvlUFEy_AX8tCxComE 2024-03-04T12:33:47.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.801+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e0c020b20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.801+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5989f98 2024-03-04T12:33:47.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.801+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17.0 2024-03-04T12:33:47.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.803+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.804+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.804+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: _vzZtoR7nU6qPxnvlUFEy_AX8tCxComE 2024-03-04T12:33:47.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.804+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.804+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.QrvUmsHCHjOS2vfO9x-pl3g6IWHNsMk_0 2024-03-04T12:33:47.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.804+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-04T12:33:47.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.804+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.804+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _vzZtoR7nU6qPxnvlUFEy_AX8tCxComE 2024-03-04T12:33:47.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.805+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-03-04T12:33:47.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.805+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1007e5b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.805+0000 7f8e1e015800 10 manifest: total_size = 11534336 2024-03-04T12:33:47.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.805+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to _msq9eltZrEFxmajxJYO_6fJgsHk7hGe 2024-03-04T12:33:47.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.805+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1007e5b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.805+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5989f98 2024-03-04T12:33:47.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.805+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17.2 2024-03-04T12:33:47.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.808+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.808+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.808+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.808+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.808+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: _msq9eltZrEFxmajxJYO_6fJgsHk7hGe 2024-03-04T12:33:47.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.808+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.808+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.le1ZgQ4GF0W2O5jR7atTykVF7C9U7to_1 2024-03-04T12:33:47.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.808+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-04T12:33:47.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.808+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.le1ZgQ4GF0W2O5jR7atTykVF7C9U7to_2 2024-03-04T12:33:47.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.808+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-03-04T12:33:47.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.808+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.808+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _msq9eltZrEFxmajxJYO_6fJgsHk7hGe 2024-03-04T12:33:47.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.809+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-03-04T12:33:47.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.809+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1007e5b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.810+0000 7f8e1e015800 10 manifest: total_size = 11534336 2024-03-04T12:33:47.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.810+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.783262820324221637 2024-03-04T12:33:47.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.810+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1007e5b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.810+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5989f98 2024-03-04T12:33:47.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.810+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17.3 2024-03-04T12:33:47.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-04T12:33:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:33:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:33:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:33:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-04T12:33:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:33:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-04T12:33:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.783262820324221637 2024-03-04T12:33:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.1 2024-03-04T12:33:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 366 2024-03-04T12:33:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.2 2024-03-04T12:33:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-03-04T12:33:47.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.3 2024-03-04T12:33:47.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-03-04T12:33:47.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.812+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.783262820324221637 2024-03-04T12:33:47.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.813+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-04T12:33:47.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.813+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1405c1d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.813+0000 7f8e1e015800 10 manifest: total_size = 11534336 2024-03-04T12:33:47.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.813+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to _iG3jebUx1IwuhX1nj02b7IGDtzGuyND 2024-03-04T12:33:47.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.813+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1405c1d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.813+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5989f98 2024-03-04T12:33:47.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.813+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17.5 2024-03-04T12:33:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.815+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.815+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.815+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.815+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.815+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: _iG3jebUx1IwuhX1nj02b7IGDtzGuyND 2024-03-04T12:33:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.815+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.815+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.LR467a5h1_rRIC-ekIw5XSd9sfo8AfP_0 2024-03-04T12:33:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.815+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-04T12:33:47.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.815+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.LR467a5h1_rRIC-ekIw5XSd9sfo8AfP_1 2024-03-04T12:33:47.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.815+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-03-04T12:33:47.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.815+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.815+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _iG3jebUx1IwuhX1nj02b7IGDtzGuyND 2024-03-04T12:33:47.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.817+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-03-04T12:33:47.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.817+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1405c4e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.817+0000 7f8e1e015800 10 manifest: total_size = 11534336 2024-03-04T12:33:47.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.817+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to _bkNxiytPW7Nn1nXTD-f6m7j4BGY4twI 2024-03-04T12:33:47.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.817+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1405c4e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.817+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5989f98 2024-03-04T12:33:47.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.817+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17.5 2024-03-04T12:33:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.819+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.819+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.819+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.819+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.819+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: _bkNxiytPW7Nn1nXTD-f6m7j4BGY4twI 2024-03-04T12:33:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.819+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.819+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.zlV-H0VSpoVAF-QQDxZ84jcJjeLSwp7_0 2024-03-04T12:33:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.819+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-04T12:33:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.819+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.zlV-H0VSpoVAF-QQDxZ84jcJjeLSwp7_1 2024-03-04T12:33:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.819+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-03-04T12:33:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.819+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.819+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _bkNxiytPW7Nn1nXTD-f6m7j4BGY4twI 2024-03-04T12:33:47.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.820+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-03-04T12:33:47.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.820+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1007e5b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.821+0000 7f8e1e015800 10 manifest: total_size = 16377 2024-03-04T12:33:47.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.821+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15881263055245146626 2024-03-04T12:33:47.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.821+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1007e5b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.821+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5989f98 2024-03-04T12:33:47.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.821+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17.5 2024-03-04T12:33:47.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-03-04T12:33:47.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7670 2024-03-04T12:33:47.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7672 2024-03-04T12:33:47.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-03-04T12:33:47.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6299126 part_ofs=7670 rule->part_size=7672 2024-03-04T12:33:47.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=1035 2024-03-04T12:33:47.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-03-04T12:33:47.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6306798 part_ofs=15342 rule->part_size=1035 2024-03-04T12:33:47.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=16377 rule->part_size=1035 2024-03-04T12:33:47.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15881263055245146626 2024-03-04T12:33:47.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.1 2024-03-04T12:33:47.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-03-04T12:33:47.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.2 2024-03-04T12:33:47.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-03-04T12:33:47.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.3 2024-03-04T12:33:47.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-03-04T12:33:47.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.823+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15881263055245146626 2024-03-04T12:33:47.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.824+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-04T12:33:47.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.824+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e0c093490 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.824+0000 7f8e1e015800 10 manifest: total_size = 11534336 2024-03-04T12:33:47.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.824+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to _rq3qpKTUecC0ZtGAiTrsjNkZnZOHWO8 2024-03-04T12:33:47.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.824+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e0c093490 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.824+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5989f98 2024-03-04T12:33:47.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.824+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17.7 2024-03-04T12:33:47.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.828+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.828+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.828+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.828+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.828+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: _rq3qpKTUecC0ZtGAiTrsjNkZnZOHWO8 2024-03-04T12:33:47.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.828+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.828+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.QecE8GjAsS214Q-fTR5JDMYvml9faIy_1 2024-03-04T12:33:47.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.828+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-04T12:33:47.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.828+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.QecE8GjAsS214Q-fTR5JDMYvml9faIy_2 2024-03-04T12:33:47.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.828+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-03-04T12:33:47.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.828+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.828+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _rq3qpKTUecC0ZtGAiTrsjNkZnZOHWO8 2024-03-04T12:33:47.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.829+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-03-04T12:33:47.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.829+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e0c093490 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.830+0000 7f8e1e015800 10 manifest: total_size = 11534336 2024-03-04T12:33:47.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.830+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3894301390893804782 2024-03-04T12:33:47.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.830+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e0c093490 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.830+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5989f98 2024-03-04T12:33:47.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.830+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17.7 2024-03-04T12:33:47.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-04T12:33:47.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:33:47.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:33:47.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:33:47.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-04T12:33:47.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:33:47.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-04T12:33:47.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3894301390893804782 2024-03-04T12:33:47.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.1 2024-03-04T12:33:47.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-03-04T12:33:47.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.2 2024-03-04T12:33:47.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-03-04T12:33:47.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.3 2024-03-04T12:33:47.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-03-04T12:33:47.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.832+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3894301390893804782 2024-03-04T12:33:47.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.834+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-04T12:33:47.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.834+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed59ada10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.834+0000 7f8e1e015800 10 manifest: total_size = 16377 2024-03-04T12:33:47.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.834+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-03-04T12:33:47.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.834+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7670 2024-03-04T12:33:47.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.834+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7672 2024-03-04T12:33:47.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.834+0000 7f8e1e015800 10 generate_fake_tag new tag=82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.2_59d48bbcb0855328f3bb3748052c9591 2024-03-04T12:33:47.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.834+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.2_59d48bbcb0855328f3bb3748052c9591 2024-03-04T12:33:47.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.834+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed59ada10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.834+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5989f98 2024-03-04T12:33:47.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.834+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17.7 2024-03-04T12:33:47.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-03-04T12:33:47.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7670 2024-03-04T12:33:47.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7672 2024-03-04T12:33:47.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-03-04T12:33:47.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6299126 part_ofs=7670 rule->part_size=7672 2024-03-04T12:33:47.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=1035 2024-03-04T12:33:47.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-03-04T12:33:47.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6306798 part_ofs=15342 rule->part_size=1035 2024-03-04T12:33:47.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=16377 rule->part_size=1035 2024-03-04T12:33:47.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.2_59d48bbcb0855328f3bb3748052c9591 2024-03-04T12:33:47.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.1 2024-03-04T12:33:47.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2024-03-04T12:33:47.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.2 2024-03-04T12:33:47.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 704 2024-03-04T12:33:47.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.3 2024-03-04T12:33:47.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 968 2024-03-04T12:33:47.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.836+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.2_59d48bbcb0855328f3bb3748052c9591 2024-03-04T12:33:47.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.837+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-03-04T12:33:47.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.837+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598c810 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.838+0000 7f8e1e015800 10 manifest: total_size = 11534336 2024-03-04T12:33:47.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.838+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.838+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-04T12:33:47.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.838+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:33:47.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.838+0000 7f8e1e015800 10 generate_fake_tag new tag=82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.2_f95312edadcc9975fda50a6c742a412e 2024-03-04T12:33:47.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.838+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.2_f95312edadcc9975fda50a6c742a412e 2024-03-04T12:33:47.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.838+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598c810 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.838+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5989f98 2024-03-04T12:33:47.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.838+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17.8 2024-03-04T12:33:47.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-04T12:33:47.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:33:47.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:33:47.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:33:47.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-04T12:33:47.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:33:47.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-04T12:33:47.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.2_f95312edadcc9975fda50a6c742a412e 2024-03-04T12:33:47.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.1 2024-03-04T12:33:47.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 449 2024-03-04T12:33:47.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.2 2024-03-04T12:33:47.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 722 2024-03-04T12:33:47.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.3 2024-03-04T12:33:47.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 995 2024-03-04T12:33:47.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.839+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.2_f95312edadcc9975fda50a6c742a412e 2024-03-04T12:33:47.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.841+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-03-04T12:33:47.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.841+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1007e5b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.841+0000 7f8e1e015800 10 manifest: total_size = 16377 2024-03-04T12:33:47.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.841+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to _InCt6E3Dh1fWoxqwVZt1ffOYrqfM2xJ 2024-03-04T12:33:47.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.841+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1007e5b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.841+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5989f98 2024-03-04T12:33:47.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.841+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17.8 2024-03-04T12:33:47.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.843+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.843+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.843+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: _InCt6E3Dh1fWoxqwVZt1ffOYrqfM2xJ 2024-03-04T12:33:47.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.843+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.843+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.sn4-JhWnhekO6lMbilTZUeyX6_FwHWT_0 2024-03-04T12:33:47.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.843+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-04T12:33:47.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.843+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.843+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _InCt6E3Dh1fWoxqwVZt1ffOYrqfM2xJ 2024-03-04T12:33:47.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.844+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-03-04T12:33:47.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.845+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100d1f60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.845+0000 7f8e1e015800 10 manifest: total_size = 11534336 2024-03-04T12:33:47.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.845+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.845+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-04T12:33:47.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.845+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:33:47.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.845+0000 7f8e1e015800 10 generate_fake_tag new tag=82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.2_5b67ab283eeafbd784a5a86e39528262 2024-03-04T12:33:47.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.845+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.2_5b67ab283eeafbd784a5a86e39528262 2024-03-04T12:33:47.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.845+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100d1f60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x562ed5989f98 s->prefetch_data=0 2024-03-04T12:33:47.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.845+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5989f98 2024-03-04T12:33:47.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.845+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17.9 2024-03-04T12:33:47.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-04T12:33:47.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:33:47.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:33:47.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:33:47.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-04T12:33:47.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:33:47.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-04T12:33:47.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.2_5b67ab283eeafbd784a5a86e39528262 2024-03-04T12:33:47.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.1 2024-03-04T12:33:47.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 441 2024-03-04T12:33:47.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.2 2024-03-04T12:33:47.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 708 2024-03-04T12:33:47.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.3 2024-03-04T12:33:47.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 975 2024-03-04T12:33:47.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.847+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.2_5b67ab283eeafbd784a5a86e39528262 2024-03-04T12:33:47.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.848+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-03-04T12:33:47.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.848+0000 7f8e1e015800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:33:47.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.848+0000 7f8e1e015800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:33:47.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.849+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:33:47.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.849+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:33:47.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.849+0000 7f8e1e015800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:33:47.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.849+0000 7f8e1e015800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:33:47.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.849+0000 7f8e1e015800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17])"; uploads.size()=0; is_truncated=0 2024-03-04T12:33:47.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.850+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-03-04T12:33:47.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.850+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.851+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=243 2024-03-04T12:33:47.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.851+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-03-04T12:33:47.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.851+0000 7f8e1e015800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-03-04T12:33:47.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.852+0000 7f8e1e015800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-03-04T12:33:47.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.852+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-03-04T12:33:47.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.852+0000 7f8cfcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824013 cookie 94759151770960 notifier 5973 bl.length()=199 2024-03-04T12:33:47.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.855+0000 7f8e1e015800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17 from cache 2024-03-04T12:33:47.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.855+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17, ofs0, ns] 2024-03-04T12:33:47.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.855+0000 7f8cebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824055 cookie 94759151764256 notifier 5973 bl.length()=257 2024-03-04T12:33:47.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.858+0000 7f8e1e015800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17 : miss 2024-03-04T12:33:47.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.858+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.858+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.858+0000 7f8e1e015800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17 info.flags=0x0 2024-03-04T12:33:47.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.858+0000 7f8e1e015800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17 to cache LRU end 2024-03-04T12:33:47.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.860+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15 : miss 2024-03-04T12:33:47.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.860+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.861+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=412 2024-03-04T12:33:47.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.861+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15 info.flags=0x17 2024-03-04T12:33:47.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.861+0000 7f8e1e015800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15 to cache LRU end 2024-03-04T12:33:47.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.861+0000 7f8e1e015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:33:47.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.861+0000 7f8e1e015800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:33:47.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.861+0000 7f8e1e015800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15 2024-03-04T12:33:47.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.862+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-04T12:33:47.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.863+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-04T12:33:47.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.864+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-04T12:33:47.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.865+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed5989990 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x562ed5998c88 s->prefetch_data=0 2024-03-04T12:33:47.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.866+0000 7f8e1e015800 10 manifest: total_size = 11534336 2024-03-04T12:33:47.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.866+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5631237834717135712 2024-03-04T12:33:47.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.866+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed5989990 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x562ed5998c88 s->prefetch_data=0 2024-03-04T12:33:47.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.866+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5998c88 2024-03-04T12:33:47.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.866+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15.3 2024-03-04T12:33:47.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-04T12:33:47.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:33:47.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:33:47.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:33:47.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-04T12:33:47.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:33:47.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-04T12:33:47.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5631237834717135712 2024-03-04T12:33:47.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-FROZEN.2~jylk3oBQ-sOIU20tB4yH92bygMfbQDw.1 2024-03-04T12:33:47.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-03-04T12:33:47.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-FROZEN.2~jylk3oBQ-sOIU20tB4yH92bygMfbQDw.2 2024-03-04T12:33:47.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-03-04T12:33:47.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-FROZEN.2~jylk3oBQ-sOIU20tB4yH92bygMfbQDw.3 2024-03-04T12:33:47.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-03-04T12:33:47.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.868+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5631237834717135712 2024-03-04T12:33:47.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.870+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-04T12:33:47.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.870+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed5993100 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x562ed5998c88 s->prefetch_data=0 2024-03-04T12:33:47.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.870+0000 7f8e1e015800 10 manifest: total_size = 1087 2024-03-04T12:33:47.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.870+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8542849956831905045 2024-03-04T12:33:47.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.870+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed5993100 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x562ed5998c88 s->prefetch_data=0 2024-03-04T12:33:47.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.870+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5998c88 2024-03-04T12:33:47.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.870+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15.5 2024-03-04T12:33:47.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-04T12:33:47.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-03-04T12:33:47.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-03-04T12:33:47.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-04T12:33:47.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-03-04T12:33:47.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-03-04T12:33:47.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-03-04T12:33:47.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-03-04T12:33:47.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-03-04T12:33:47.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8542849956831905045 2024-03-04T12:33:47.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-STANDARD.2~VObEvtXm46ksiQ0x2_oQgDFZOc_NDQn.1 2024-03-04T12:33:47.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-03-04T12:33:47.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-STANDARD.2~VObEvtXm46ksiQ0x2_oQgDFZOc_NDQn.2 2024-03-04T12:33:47.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-03-04T12:33:47.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-STANDARD.2~VObEvtXm46ksiQ0x2_oQgDFZOc_NDQn.3 2024-03-04T12:33:47.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-03-04T12:33:47.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.872+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8542849956831905045 2024-03-04T12:33:47.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.873+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-04T12:33:47.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.874+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1405c4e0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x562ed5998c88 s->prefetch_data=0 2024-03-04T12:33:47.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.874+0000 7f8e1e015800 10 manifest: total_size = 11534336 2024-03-04T12:33:47.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.874+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7599931387119670362 2024-03-04T12:33:47.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.874+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1405c4e0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x562ed5998c88 s->prefetch_data=0 2024-03-04T12:33:47.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.874+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5998c88 2024-03-04T12:33:47.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.874+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15.7 2024-03-04T12:33:47.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-04T12:33:47.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:33:47.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-04T12:33:47.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-04T12:33:47.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:33:47.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-04T12:33:47.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-04T12:33:47.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-04T12:33:47.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7599931387119670362 2024-03-04T12:33:47.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-LUKEWARM.2~-N4cqKCaueLqoE4uP5PcQVBPU7Ulmsj.1 2024-03-04T12:33:47.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-03-04T12:33:47.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-LUKEWARM.2~-N4cqKCaueLqoE4uP5PcQVBPU7Ulmsj.2 2024-03-04T12:33:47.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-03-04T12:33:47.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-LUKEWARM.2~-N4cqKCaueLqoE4uP5PcQVBPU7Ulmsj.3 2024-03-04T12:33:47.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-03-04T12:33:47.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.876+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7599931387119670362 2024-03-04T12:33:47.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.877+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-04T12:33:47.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.877+0000 7f8e1e015800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:33:47.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.877+0000 7f8e1e015800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:33:47.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.878+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:33:47.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.878+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:33:47.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.878+0000 7f8e1e015800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:33:47.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.878+0000 7f8e1e015800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:33:47.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.878+0000 7f8e1e015800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15])"; uploads.size()=0; is_truncated=0 2024-03-04T12:33:47.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.880+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-03-04T12:33:47.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.880+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.880+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=238 2024-03-04T12:33:47.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.880+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-03-04T12:33:47.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.880+0000 7f8e1e015800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-03-04T12:33:47.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.881+0000 7f8e1e015800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-03-04T12:33:47.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.881+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-03-04T12:33:47.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.881+0000 7f8cfcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824041 cookie 94759151775936 notifier 5973 bl.length()=194 2024-03-04T12:33:47.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.884+0000 7f8e1e015800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15 from cache 2024-03-04T12:33:47.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.884+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15, ofs0, ns] 2024-03-04T12:33:47.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.884+0000 7f8cfcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824056 cookie 94759151764256 notifier 5973 bl.length()=252 2024-03-04T12:33:47.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.890+0000 7f8e1e015800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15 : miss 2024-03-04T12:33:47.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.890+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.890+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.890+0000 7f8e1e015800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15 info.flags=0x0 2024-03-04T12:33:47.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.890+0000 7f8e1e015800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15 to cache LRU end 2024-03-04T12:33:47.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.892+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14 : miss 2024-03-04T12:33:47.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.892+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.892+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=402 2024-03-04T12:33:47.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.892+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14 info.flags=0x17 2024-03-04T12:33:47.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.892+0000 7f8e1e015800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14 to cache LRU end 2024-03-04T12:33:47.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.892+0000 7f8e1e015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:33:47.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.892+0000 7f8e1e015800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:33:47.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.892+0000 7f8e1e015800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14 2024-03-04T12:33:47.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.893+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-04T12:33:47.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.894+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-04T12:33:47.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.895+0000 7f8e1e015800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-04T12:33:47.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.896+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598afe0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x562ed5998c88 s->prefetch_data=0 2024-03-04T12:33:47.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.896+0000 7f8e1e015800 10 manifest: total_size = 10485760 2024-03-04T12:33:47.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.896+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.6109182556982963453 2024-03-04T12:33:47.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.896+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598afe0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x562ed5998c88 s->prefetch_data=0 2024-03-04T12:33:47.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.896+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5998c88 2024-03-04T12:33:47.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.896+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14.3 2024-03-04T12:33:47.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.898+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.898+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.898+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.898+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.898+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.6109182556982963453 2024-03-04T12:33:47.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.898+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.898+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14__shadow_.16PvOQdJmzZ2jI4Vic_6N45igmZ_CWu_0 2024-03-04T12:33:47.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.898+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-03-04T12:33:47.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.898+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14__shadow_.16PvOQdJmzZ2jI4Vic_6N45igmZ_CWu_1 2024-03-04T12:33:47.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.898+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-03-04T12:33:47.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.898+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.899+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.6109182556982963453 2024-03-04T12:33:47.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.900+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-04T12:33:47.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.900+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e14088210 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x562ed5998c88 s->prefetch_data=0 2024-03-04T12:33:47.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.900+0000 7f8e1e015800 10 manifest: total_size = 3300 2024-03-04T12:33:47.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.900+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.4425786153484301730 2024-03-04T12:33:47.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.900+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e14088210 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x562ed5998c88 s->prefetch_data=0 2024-03-04T12:33:47.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.900+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5998c88 2024-03-04T12:33:47.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.900+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14.5 2024-03-04T12:33:47.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.902+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1405c4e0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x562ed5998c88 s->prefetch_data=0 2024-03-04T12:33:47.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.902+0000 7f8e1e015800 10 manifest: total_size = 10485760 2024-03-04T12:33:47.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.902+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2122818390751021899 2024-03-04T12:33:47.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.902+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1405c4e0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x562ed5998c88 s->prefetch_data=0 2024-03-04T12:33:47.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.902+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5998c88 2024-03-04T12:33:47.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.902+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14.7 2024-03-04T12:33:47.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.903+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-04T12:33:47.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.905+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.905+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.905+0000 7f8e1e015800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-04T12:33:47.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.905+0000 7f8e1e015800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-03-04T12:33:47.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.905+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2122818390751021899 2024-03-04T12:33:47.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.905+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-04T12:33:47.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.905+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14__shadow_.TAjDLqqNmPTi9Nn7QWcXT1MgXyFDbRK_0 2024-03-04T12:33:47.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.905+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-03-04T12:33:47.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.905+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14__shadow_.TAjDLqqNmPTi9Nn7QWcXT1MgXyFDbRK_1 2024-03-04T12:33:47.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.905+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-03-04T12:33:47.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.905+0000 7f8e1e015800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-04T12:33:47.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.905+0000 7f8e1e015800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2122818390751021899 2024-03-04T12:33:47.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.906+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-04T12:33:47.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.906+0000 7f8e1e015800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:33:47.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.906+0000 7f8e1e015800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:33:47.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.907+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:33:47.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.907+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:33:47.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.907+0000 7f8e1e015800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:33:47.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.907+0000 7f8e1e015800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:33:47.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.907+0000 7f8e1e015800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14])"; uploads.size()=0; is_truncated=0 2024-03-04T12:33:47.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.908+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-03-04T12:33:47.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.908+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.909+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=228 2024-03-04T12:33:47.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.909+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-03-04T12:33:47.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.909+0000 7f8e1e015800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-03-04T12:33:47.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.909+0000 7f8e1e015800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-03-04T12:33:47.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.909+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-03-04T12:33:47.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.910+0000 7f8cebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824015 cookie 94759151768320 notifier 5973 bl.length()=184 2024-03-04T12:33:47.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.912+0000 7f8e1e015800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14 from cache 2024-03-04T12:33:47.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.912+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14, ofs0, ns] 2024-03-04T12:33:47.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.913+0000 7f8cfcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824076 cookie 94759151761056 notifier 5973 bl.length()=242 2024-03-04T12:33:47.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.917+0000 7f8e1e015800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14 : miss 2024-03-04T12:33:47.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.917+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.917+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.917+0000 7f8e1e015800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14 info.flags=0x0 2024-03-04T12:33:47.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.917+0000 7f8e1e015800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14 to cache LRU end 2024-03-04T12:33:47.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.919+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7 : miss 2024-03-04T12:33:47.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.919+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.920+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=397 2024-03-04T12:33:47.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.920+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7 info.flags=0x17 2024-03-04T12:33:47.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.920+0000 7f8e1e015800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7 to cache LRU end 2024-03-04T12:33:47.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.920+0000 7f8e1e015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:33:47.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.920+0000 7f8e1e015800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:33:47.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.920+0000 7f8e1e015800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7 2024-03-04T12:33:47.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.921+0000 7f8e1e015800 10 cls_bucket_list_unordered: got ___ 2024-03-04T12:33:47.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.922+0000 7f8e1e015800 10 cls_bucket_list_unordered: got __ _ 2024-03-04T12:33:47.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.923+0000 7f8e1e015800 10 cls_bucket_list_unordered: got __ 2024-03-04T12:33:47.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.923+0000 7f8e1e015800 10 cls_bucket_list_unordered: got obj 2024-03-04T12:33:47.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.924+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100a0f10 obj=test-client.0-r-test-small-obj-data.1:___ state=0x562ed5998aa8 s->prefetch_data=0 2024-03-04T12:33:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.924+0000 7f8e1e015800 10 manifest: total_size = 0 2024-03-04T12:33:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.924+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16002253696782176373 2024-03-04T12:33:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.924+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100a0f10 obj=test-client.0-r-test-small-obj-data.1:___ state=0x562ed5998aa8 s->prefetch_data=0 2024-03-04T12:33:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.924+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5998aa8 2024-03-04T12:33:47.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.924+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7.2 2024-03-04T12:33:47.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.926+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100a0f10 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x562ed5998aa8 s->prefetch_data=0 2024-03-04T12:33:47.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.927+0000 7f8e1e015800 10 manifest: total_size = 0 2024-03-04T12:33:47.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.927+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15681610631760148177 2024-03-04T12:33:47.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.927+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100a0f10 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x562ed5998aa8 s->prefetch_data=0 2024-03-04T12:33:47.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.927+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5998aa8 2024-03-04T12:33:47.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.927+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7.3 2024-03-04T12:33:47.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.927+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=___ 2024-03-04T12:33:47.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.929+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100a0f10 obj=test-client.0-r-test-small-obj-data.1:__ state=0x562ed5998aa8 s->prefetch_data=0 2024-03-04T12:33:47.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.929+0000 7f8e1e015800 10 manifest: total_size = 0 2024-03-04T12:33:47.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.929+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8512141159917219715 2024-03-04T12:33:47.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.929+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100a0f10 obj=test-client.0-r-test-small-obj-data.1:__ state=0x562ed5998aa8 s->prefetch_data=0 2024-03-04T12:33:47.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.929+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5998aa8 2024-03-04T12:33:47.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.929+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7.6 2024-03-04T12:33:47.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.930+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=__ _ 2024-03-04T12:33:47.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.931+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100a0f10 obj=test-client.0-r-test-small-obj-data.1:obj state=0x562ed5998aa8 s->prefetch_data=0 2024-03-04T12:33:47.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.932+0000 7f8e1e015800 10 manifest: total_size = 0 2024-03-04T12:33:47.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.932+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17106386145573718159 2024-03-04T12:33:47.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.932+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100a0f10 obj=test-client.0-r-test-small-obj-data.1:obj state=0x562ed5998aa8 s->prefetch_data=0 2024-03-04T12:33:47.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.932+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5998aa8 2024-03-04T12:33:47.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.932+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7.8 2024-03-04T12:33:47.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.933+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=__ 2024-03-04T12:33:47.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.934+0000 7f8e1e015800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:33:47.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.934+0000 7f8e1e015800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:33:47.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.935+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=obj 2024-03-04T12:33:47.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.935+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:33:47.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.935+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:33:47.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.935+0000 7f8e1e015800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:33:47.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.935+0000 7f8e1e015800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:33:47.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.935+0000 7f8e1e015800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7])"; uploads.size()=0; is_truncated=0 2024-03-04T12:33:47.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.937+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-03-04T12:33:47.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.937+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.937+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=223 2024-03-04T12:33:47.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.937+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-03-04T12:33:47.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.937+0000 7f8e1e015800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-03-04T12:33:47.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.938+0000 7f8e1e015800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-03-04T12:33:47.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.938+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-03-04T12:33:47.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.939+0000 7f8cebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824057 cookie 94759151764256 notifier 5973 bl.length()=181 2024-03-04T12:33:47.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.941+0000 7f8e1e015800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7 from cache 2024-03-04T12:33:47.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.941+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7, ofs0, ns] 2024-03-04T12:33:47.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.941+0000 7f8cfcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824042 cookie 94759151765824 notifier 5973 bl.length()=238 2024-03-04T12:33:47.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.945+0000 7f8e1e015800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7 : miss 2024-03-04T12:33:47.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.945+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.945+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.945+0000 7f8e1e015800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7 info.flags=0x0 2024-03-04T12:33:47.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.945+0000 7f8e1e015800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7 to cache LRU end 2024-03-04T12:33:47.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.947+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8 : miss 2024-03-04T12:33:47.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.947+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.947+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=397 2024-03-04T12:33:47.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.947+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8 info.flags=0x17 2024-03-04T12:33:47.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.947+0000 7f8e1e015800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8 to cache LRU end 2024-03-04T12:33:47.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.947+0000 7f8e1e015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:33:47.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.947+0000 7f8e1e015800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:33:47.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.947+0000 7f8e1e015800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8 2024-03-04T12:33:47.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.949+0000 7f8e1e015800 10 cls_bucket_list_unordered: got ___ 2024-03-04T12:33:47.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.949+0000 7f8e1e015800 10 cls_bucket_list_unordered: got __ _ 2024-03-04T12:33:47.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.950+0000 7f8e1e015800 10 cls_bucket_list_unordered: got __ 2024-03-04T12:33:47.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.951+0000 7f8e1e015800 10 cls_bucket_list_unordered: got obj 2024-03-04T12:33:47.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.951+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e0c052ea0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x562ed5998928 s->prefetch_data=0 2024-03-04T12:33:47.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.952+0000 7f8e1e015800 10 manifest: total_size = 24595 2024-03-04T12:33:47.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.952+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14862698636041317683 2024-03-04T12:33:47.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.952+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e0c052ea0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x562ed5998928 s->prefetch_data=0 2024-03-04T12:33:47.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.952+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5998928 2024-03-04T12:33:47.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.952+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8.2 2024-03-04T12:33:47.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.954+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e0c052ea0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x562ed5998928 s->prefetch_data=0 2024-03-04T12:33:47.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.954+0000 7f8e1e015800 10 manifest: total_size = 24595 2024-03-04T12:33:47.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.954+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17054010692597277623 2024-03-04T12:33:47.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.954+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e0c052ea0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x562ed5998928 s->prefetch_data=0 2024-03-04T12:33:47.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.954+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5998928 2024-03-04T12:33:47.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.954+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8.3 2024-03-04T12:33:47.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.955+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=___ 2024-03-04T12:33:47.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.956+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e0c052ea0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x562ed5998928 s->prefetch_data=0 2024-03-04T12:33:47.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.956+0000 7f8e1e015800 10 manifest: total_size = 2078 2024-03-04T12:33:47.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.956+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8935994432462028733 2024-03-04T12:33:47.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.956+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e0c052ea0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x562ed5998928 s->prefetch_data=0 2024-03-04T12:33:47.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.956+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5998928 2024-03-04T12:33:47.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.956+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8.6 2024-03-04T12:33:47.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.957+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=__ _ 2024-03-04T12:33:47.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.959+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1007e5b0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x562ed5998928 s->prefetch_data=0 2024-03-04T12:33:47.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.959+0000 7f8e1e015800 10 manifest: total_size = 2078 2024-03-04T12:33:47.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.959+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11495023103277739076 2024-03-04T12:33:47.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.959+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e1007e5b0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x562ed5998928 s->prefetch_data=0 2024-03-04T12:33:47.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.959+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed5998928 2024-03-04T12:33:47.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.959+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8.8 2024-03-04T12:33:47.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.960+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=__ 2024-03-04T12:33:47.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.961+0000 7f8e1e015800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:33:47.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.961+0000 7f8e1e015800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:33:47.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.962+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=obj 2024-03-04T12:33:47.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.962+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:33:47.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.962+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:33:47.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.962+0000 7f8e1e015800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:33:47.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.962+0000 7f8e1e015800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:33:47.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.962+0000 7f8e1e015800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8])"; uploads.size()=0; is_truncated=0 2024-03-04T12:33:47.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.964+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-03-04T12:33:47.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.964+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.964+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=223 2024-03-04T12:33:47.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.964+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-03-04T12:33:47.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.964+0000 7f8e1e015800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-03-04T12:33:47.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.965+0000 7f8e1e015800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-03-04T12:33:47.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.965+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-03-04T12:33:47.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.966+0000 7f8cfcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824058 cookie 94759151764256 notifier 5973 bl.length()=181 2024-03-04T12:33:47.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.968+0000 7f8e1e015800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8 from cache 2024-03-04T12:33:47.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.968+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8, ofs0, ns] 2024-03-04T12:33:47.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.968+0000 7f8cfcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824043 cookie 94759151765824 notifier 5973 bl.length()=238 2024-03-04T12:33:47.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.972+0000 7f8e1e015800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8 : miss 2024-03-04T12:33:47.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.972+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.973+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:47.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.973+0000 7f8e1e015800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8 info.flags=0x0 2024-03-04T12:33:47.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.973+0000 7f8e1e015800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8 to cache LRU end 2024-03-04T12:33:47.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.975+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9 : miss 2024-03-04T12:33:47.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.975+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.975+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=397 2024-03-04T12:33:47.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.975+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9 info.flags=0x17 2024-03-04T12:33:47.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.975+0000 7f8e1e015800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9 to cache LRU end 2024-03-04T12:33:47.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.975+0000 7f8e1e015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:33:47.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.975+0000 7f8e1e015800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-04T12:33:47.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.975+0000 7f8e1e015800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9 2024-03-04T12:33:47.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.976+0000 7f8e1e015800 10 cls_bucket_list_unordered: got ___ 2024-03-04T12:33:47.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.976+0000 7f8e1e015800 10 cls_bucket_list_unordered: got __ _ 2024-03-04T12:33:47.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.977+0000 7f8e1e015800 10 cls_bucket_list_unordered: got __ 2024-03-04T12:33:47.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.978+0000 7f8e1e015800 10 cls_bucket_list_unordered: got obj 2024-03-04T12:33:47.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.979+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598dcd0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x562ed59b7b28 s->prefetch_data=0 2024-03-04T12:33:47.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.979+0000 7f8e1e015800 10 manifest: total_size = 1048576 2024-03-04T12:33:47.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.979+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7721532831473078246 2024-03-04T12:33:47.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.979+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598dcd0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x562ed59b7b28 s->prefetch_data=0 2024-03-04T12:33:47.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.979+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed59b7b28 2024-03-04T12:33:47.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.979+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9.2 2024-03-04T12:33:47.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.981+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598dcd0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x562ed59b7b28 s->prefetch_data=0 2024-03-04T12:33:47.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.982+0000 7f8e1e015800 10 manifest: total_size = 55 2024-03-04T12:33:47.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.982+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16986304070675894523 2024-03-04T12:33:47.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.982+0000 7f8e1e015800 20 get_obj_state: octx=0x562ed598dcd0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x562ed59b7b28 s->prefetch_data=0 2024-03-04T12:33:47.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.982+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed59b7b28 2024-03-04T12:33:47.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.982+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9.3 2024-03-04T12:33:47.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.982+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=___ 2024-03-04T12:33:47.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.984+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100081c0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x562ed59b7b28 s->prefetch_data=0 2024-03-04T12:33:47.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.984+0000 7f8e1e015800 10 manifest: total_size = 49187 2024-03-04T12:33:47.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.984+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.1884951422190099981 2024-03-04T12:33:47.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.984+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100081c0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x562ed59b7b28 s->prefetch_data=0 2024-03-04T12:33:47.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.984+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed59b7b28 2024-03-04T12:33:47.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.984+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9.6 2024-03-04T12:33:47.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.985+0000 7f8cfcff9640 20 handle_completion(): completion ok for obj=__ _ 2024-03-04T12:33:47.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.986+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100081c0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x562ed59b7b28 s->prefetch_data=0 2024-03-04T12:33:47.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.986+0000 7f8e1e015800 10 manifest: total_size = 1048576 2024-03-04T12:33:47.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.986+0000 7f8e1e015800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14085917182539697784 2024-03-04T12:33:47.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.986+0000 7f8e1e015800 20 get_obj_state: octx=0x7f8e100081c0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x562ed59b7b28 s->prefetch_data=0 2024-03-04T12:33:47.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.986+0000 7f8e1e015800 20 prepare_atomic_modification: state is not atomic. state=0x562ed59b7b28 2024-03-04T12:33:47.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.986+0000 7f8e1e015800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9.8 2024-03-04T12:33:47.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.987+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=__ 2024-03-04T12:33:47.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.989+0000 7f8e1e015800 20 list_objects_ordered: starting attempt 1 2024-03-04T12:33:47.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.989+0000 7f8e1e015800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-04T12:33:47.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.990+0000 7f8cebfff640 20 handle_completion(): completion ok for obj=obj 2024-03-04T12:33:47.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.990+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-04T12:33:47.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.990+0000 7f8e1e015800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-04T12:33:47.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.990+0000 7f8e1e015800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-04T12:33:47.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.990+0000 7f8e1e015800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-04T12:33:47.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.990+0000 7f8e1e015800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9])"; uploads.size()=0; is_truncated=0 2024-03-04T12:33:47.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.992+0000 7f8e1e015800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-03-04T12:33:47.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.992+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:47.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.993+0000 7f8e1e015800 20 rados_obj.operate() r=0 bl.length=223 2024-03-04T12:33:47.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.993+0000 7f8e1e015800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-03-04T12:33:48.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.993+0000 7f8e1e015800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-03-04T12:33:48.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.994+0000 7f8e1e015800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-03-04T12:33:48.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.994+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-03-04T12:33:48.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.994+0000 7f8cebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824059 cookie 94759151764256 notifier 5973 bl.length()=181 2024-03-04T12:33:48.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.997+0000 7f8e1e015800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9 from cache 2024-03-04T12:33:48.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.997+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9, ofs0, ns] 2024-03-04T12:33:48.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:47.997+0000 7f8cfcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824044 cookie 94759151765824 notifier 5973 bl.length()=238 2024-03-04T12:33:48.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.000+0000 7f8e1e015800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9 : miss 2024-03-04T12:33:48.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.000+0000 7f8e1e015800 20 rados->read ofs=0 len=0 2024-03-04T12:33:48.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.001+0000 7f8e1e015800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:48.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.001+0000 7f8e1e015800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9 info.flags=0x0 2024-03-04T12:33:48.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.001+0000 7f8e1e015800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9 to cache LRU end 2024-03-04T12:33:48.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.002+0000 7f8e1e015800 10 removing key index: VOBMCIKWFJPLUYNSIAHG 2024-03-04T12:33:48.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.004+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:VOBMCIKWFJPLUYNSIAHG, ofs0, ns] 2024-03-04T12:33:48.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.004+0000 7f8cebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824060 cookie 94759151764256 notifier 5973 bl.length()=170 2024-03-04T12:33:48.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.005+0000 7f8e1e015800 10 removing email index: ragweed.client.0+test@test.test 2024-03-04T12:33:48.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.006+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-03-04T12:33:48.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.007+0000 7f8cebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824016 cookie 94759151768320 notifier 5973 bl.length()=182 2024-03-04T12:33:48.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.008+0000 7f8e1e015800 10 removing user buckets index 2024-03-04T12:33:48.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.009+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-03-04T12:33:48.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.009+0000 7f8cebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824045 cookie 94759151775936 notifier 5973 bl.length()=173 2024-03-04T12:33:48.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.010+0000 7f8e1e015800 10 removing user index: ragweed.client.0 2024-03-04T12:33:48.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.011+0000 7f8e1e015800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-03-04T12:33:48.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.011+0000 7f8e1e015800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-03-04T12:33:48.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.012+0000 7f8cfcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824077 cookie 94759151773632 notifier 5973 bl.length()=165 2024-03-04T12:33:48.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.015+0000 7f8ccffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:33:48.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.018+0000 7f8e1e015800 20 remove_watcher() i=0 2024-03-04T12:33:48.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.018+0000 7f8e1e015800 2 removed watcher, disabling cache 2024-03-04T12:33:48.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.019+0000 7f8e1e015800 20 remove_watcher() i=1 2024-03-04T12:33:48.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.020+0000 7f8e1e015800 20 remove_watcher() i=2 2024-03-04T12:33:48.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.021+0000 7f8e1e015800 20 remove_watcher() i=3 2024-03-04T12:33:48.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.022+0000 7f8e1e015800 20 remove_watcher() i=4 2024-03-04T12:33:48.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.022+0000 7f8e1e015800 20 remove_watcher() i=5 2024-03-04T12:33:48.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.023+0000 7f8e1e015800 20 remove_watcher() i=6 2024-03-04T12:33:48.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.024+0000 7f8e1e015800 20 remove_watcher() i=7 2024-03-04T12:33:48.041 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-03-04T12:33:48.094 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:33:48.095 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:33:48.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.118+0000 7f11e5610800 20 rados->read ofs=0 len=0 2024-03-04T12:33:48.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.119+0000 7f11e5610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:48.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.119+0000 7f11e5610800 20 realm 2024-03-04T12:33:48.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.119+0000 7f11e5610800 20 rados->read ofs=0 len=0 2024-03-04T12:33:48.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.119+0000 7f11e5610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:48.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.119+0000 7f11e5610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:33:48.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.119+0000 7f11e5610800 20 rados->read ofs=0 len=0 2024-03-04T12:33:48.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.119+0000 7f11e5610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:48.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.119+0000 7f11e5610800 20 rados->read ofs=0 len=0 2024-03-04T12:33:48.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.120+0000 7f11e5610800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:33:48.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.120+0000 7f11e5610800 20 rados->read ofs=0 len=0 2024-03-04T12:33:48.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.120+0000 7f11e5610800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:33:48.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.120+0000 7f11e5610800 20 searching for the correct realm 2024-03-04T12:33:48.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.123+0000 7f11dbfff640 0 -- 172.21.15.110:0/1407770873 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f11d407e070 msgr2=0x7f11d40d8800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:33:48.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.127+0000 7f11e0bf0640 0 -- 172.21.15.110:0/1407770873 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f11cc089970 msgr2=0x7f11cc05d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:33:48.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.333+0000 7f11e5610800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:33:48.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.333+0000 7f11e5610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:33:48.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.333+0000 7f11e5610800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:33:48.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.333+0000 7f11e5610800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:33:48.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.333+0000 7f11e5610800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:33:48.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.333+0000 7f11e5610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:33:48.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.333+0000 7f11e5610800 20 rados->read ofs=0 len=0 2024-03-04T12:33:48.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.333+0000 7f11e5610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:48.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.333+0000 7f11e5610800 20 rados->read ofs=0 len=0 2024-03-04T12:33:48.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.333+0000 7f11e5610800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:33:48.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.333+0000 7f11e5610800 20 rados->read ofs=0 len=0 2024-03-04T12:33:48.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.334+0000 7f11e5610800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:33:48.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.334+0000 7f11e5610800 20 zone default found 2024-03-04T12:33:48.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.334+0000 7f11e5610800 4 Realm: () 2024-03-04T12:33:48.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.334+0000 7f11e5610800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:33:48.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.334+0000 7f11e5610800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:33:48.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.334+0000 7f11e5610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:33:48.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.334+0000 7f11e5610800 20 zonegroup default 2024-03-04T12:33:48.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.334+0000 7f11e5610800 20 rados->read ofs=0 len=0 2024-03-04T12:33:48.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.334+0000 7f11e5610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:48.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.334+0000 7f11e5610800 20 rados->read ofs=0 len=0 2024-03-04T12:33:48.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.334+0000 7f11e5610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:48.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.334+0000 7f11e5610800 20 rados->read ofs=0 len=0 2024-03-04T12:33:48.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.334+0000 7f11e5610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:33:48.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.334+0000 7f11e5610800 20 started sync module instance, tier type = 2024-03-04T12:33:48.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.334+0000 7f11e5610800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:33:48.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.343+0000 7f11e5610800 20 add_watcher() i=0 2024-03-04T12:33:48.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.343+0000 7f11e5610800 20 add_watcher() i=1 2024-03-04T12:33:48.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.343+0000 7f11e5610800 20 add_watcher() i=2 2024-03-04T12:33:48.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.343+0000 7f11e5610800 20 add_watcher() i=3 2024-03-04T12:33:48.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.343+0000 7f11e5610800 20 add_watcher() i=4 2024-03-04T12:33:48.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.343+0000 7f11e5610800 20 add_watcher() i=5 2024-03-04T12:33:48.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.343+0000 7f11e5610800 20 add_watcher() i=6 2024-03-04T12:33:48.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.344+0000 7f11e5610800 20 add_watcher() i=7 2024-03-04T12:33:48.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.344+0000 7f11e5610800 2 all 8 watchers are set, enabling cache 2024-03-04T12:33:48.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.346+0000 7f1096fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:33:48.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.346+0000 7f11e5610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:33:48.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.346+0000 7f11e5610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:33:48.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.381+0000 7f1095fe3640 20 reqs_thread_entry: start 2024-03-04T12:33:48.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.381+0000 7f11e5610800 20 init_complete bucket index max shards: 11 2024-03-04T12:33:48.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.381+0000 7f11e5610800 20 Filter name: none 2024-03-04T12:33:48.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.381+0000 7f10077fe640 20 reqs_thread_entry: start 2024-03-04T12:33:48.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.381+0000 7f11e5610800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-03-04T12:33:48.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.381+0000 7f11e5610800 20 rados->read ofs=0 len=0 2024-03-04T12:33:48.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.382+0000 7f11e5610800 20 rados_obj.operate() r=0 bl.length=453 2024-03-04T12:33:48.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.382+0000 7f11e5610800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-03-04T12:33:48.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.382+0000 7f11e5610800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-04T12:33:48.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.382+0000 7f11e5610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:33:48.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.382+0000 7f11e5610800 10 removing key index: FCRJBHIVEZRHTRBTIIWG 2024-03-04T12:33:48.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.383+0000 7f11e5610800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:FCRJBHIVEZRHTRBTIIWG, ofs0, ns] 2024-03-04T12:33:48.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.384+0000 7f10b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824046 cookie 94923026135184 notifier 5991 bl.length()=170 2024-03-04T12:33:48.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.385+0000 7f11e5610800 10 removing email index: sysuser.client.0+test@test.test 2024-03-04T12:33:48.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.386+0000 7f11e5610800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-03-04T12:33:48.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.386+0000 7f10b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824078 cookie 94923026132512 notifier 5991 bl.length()=182 2024-03-04T12:33:48.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.387+0000 7f11e5610800 10 removing user buckets index 2024-03-04T12:33:48.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.388+0000 7f11e5610800 10 removing user index: sysuser.client.0 2024-03-04T12:33:48.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.389+0000 7f11e5610800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-03-04T12:33:48.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.389+0000 7f11e5610800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-03-04T12:33:48.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.390+0000 7f10b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824017 cookie 94923026127664 notifier 5991 bl.length()=165 2024-03-04T12:33:48.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.392+0000 7f1096fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:33:48.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.394+0000 7f11e5610800 20 remove_watcher() i=0 2024-03-04T12:33:48.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.394+0000 7f11e5610800 2 removed watcher, disabling cache 2024-03-04T12:33:48.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.395+0000 7f11e5610800 20 remove_watcher() i=1 2024-03-04T12:33:48.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.396+0000 7f11e5610800 20 remove_watcher() i=2 2024-03-04T12:33:48.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.396+0000 7f11e5610800 20 remove_watcher() i=3 2024-03-04T12:33:48.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.397+0000 7f11e5610800 20 remove_watcher() i=4 2024-03-04T12:33:48.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.398+0000 7f11e5610800 20 remove_watcher() i=5 2024-03-04T12:33:48.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.399+0000 7f11e5610800 20 remove_watcher() i=6 2024-03-04T12:33:48.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:33:48.400+0000 7f11e5610800 20 remove_watcher() i=7 2024-03-04T12:33:48.416 INFO:tasks.ragweed:Removing ragweed... 2024-03-04T12:33:48.417 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-03-04T12:33:48.495 INFO:teuthology.run_tasks:Running task workunit... 2024-03-04T12:33:48.508 INFO:tasks.workunit:Pulling workunits from ref 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:33:48.508 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-04T12:33:48.508 DEBUG:teuthology.orchestra.run.smithi110:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:33:48.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T12:33:48.535 INFO:teuthology.orchestra.run.smithi110.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-04T12:33:48.536 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:33:48.602 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-04T12:33:48.602 DEBUG:teuthology.orchestra.run.smithi110:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-04T12:33:48.671 INFO:tasks.workunit:timeout=3h 2024-03-04T12:33:48.671 INFO:tasks.workunit:cleanup=True 2024-03-04T12:33:48.671 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/pritha-srivastava/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3aec390336fdfdc8f927818b718cfb0361bd47c8 2024-03-04T12:33:48.739 INFO:tasks.workunit.client.0.smithi110.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-04T12:34:30.599 INFO:tasks.workunit.client.0.smithi110.stderr:Note: switching to '3aec390336fdfdc8f927818b718cfb0361bd47c8'. 2024-03-04T12:34:30.599 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:30.599 INFO:tasks.workunit.client.0.smithi110.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-04T12:34:30.600 INFO:tasks.workunit.client.0.smithi110.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-04T12:34:30.600 INFO:tasks.workunit.client.0.smithi110.stderr:state without impacting any branches by switching back to a branch. 2024-03-04T12:34:30.600 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:30.600 INFO:tasks.workunit.client.0.smithi110.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-04T12:34:30.600 INFO:tasks.workunit.client.0.smithi110.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-04T12:34:30.600 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:30.600 INFO:tasks.workunit.client.0.smithi110.stderr: git switch -c 2024-03-04T12:34:30.600 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:30.600 INFO:tasks.workunit.client.0.smithi110.stderr:Or undo this operation with: 2024-03-04T12:34:30.600 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:30.600 INFO:tasks.workunit.client.0.smithi110.stderr: git switch - 2024-03-04T12:34:30.600 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:30.600 INFO:tasks.workunit.client.0.smithi110.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-04T12:34:30.600 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:30.601 INFO:tasks.workunit.client.0.smithi110.stderr:HEAD is now at 3aec390336f qa/d4n: Start redis up before rgw 2024-03-04T12:34:30.605 DEBUG:teuthology.orchestra.run.smithi110:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-04T12:34:30.672 INFO:tasks.workunit.client.0.smithi110.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-04T12:34:30.674 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:34:30.674 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-04T12:34:30.725 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-04T12:34:30.773 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-04T12:34:30.812 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-04T12:34:30.813 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:34:30.813 INFO:tasks.workunit.client.0.smithi110.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-04T12:34:30.852 INFO:tasks.workunit.client.0.smithi110.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-04T12:34:30.855 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:34:30.855 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-04T12:34:30.924 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-03-04T12:34:30.925 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-03-04T12:34:30.925 DEBUG:teuthology.orchestra.run.smithi110:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3aec390336fdfdc8f927818b718cfb0361bd47c8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-03-04T12:34:30.995 INFO:tasks.workunit.client.0.smithi110.stderr:+ ulimit -c 0 2024-03-04T12:34:30.995 INFO:tasks.workunit.client.0.smithi110.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-03-04T12:34:30.995 INFO:tasks.workunit.client.0.smithi110.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-04T12:34:30.996 INFO:tasks.workunit.client.0.smithi110.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-04T12:34:33.227 INFO:tasks.workunit.client.0.smithi110.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-03-04T12:34:33.227 INFO:tasks.workunit.client.0.smithi110.stderr:++ deactivate nondestructive 2024-03-04T12:34:33.227 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n '' ']' 2024-03-04T12:34:33.227 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n '' ']' 2024-03-04T12:34:33.227 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-04T12:34:33.227 INFO:tasks.workunit.client.0.smithi110.stderr:++ hash -r 2024-03-04T12:34:33.227 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n '' ']' 2024-03-04T12:34:33.227 INFO:tasks.workunit.client.0.smithi110.stderr:++ unset VIRTUAL_ENV 2024-03-04T12:34:33.227 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-03-04T12:34:33.227 INFO:tasks.workunit.client.0.smithi110.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-04T12:34:33.228 INFO:tasks.workunit.client.0.smithi110.stderr:++ export VIRTUAL_ENV 2024-03-04T12:34:33.228 INFO:tasks.workunit.client.0.smithi110.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-04T12:34:33.228 INFO:tasks.workunit.client.0.smithi110.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-04T12:34:33.228 INFO:tasks.workunit.client.0.smithi110.stderr:++ export PATH 2024-03-04T12:34:33.228 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n '' ']' 2024-03-04T12:34:33.228 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -z '' ']' 2024-03-04T12:34:33.228 INFO:tasks.workunit.client.0.smithi110.stderr:++ _OLD_VIRTUAL_PS1= 2024-03-04T12:34:33.228 INFO:tasks.workunit.client.0.smithi110.stderr:++ PS1='(rgw) ' 2024-03-04T12:34:33.228 INFO:tasks.workunit.client.0.smithi110.stderr:++ export PS1 2024-03-04T12:34:33.228 INFO:tasks.workunit.client.0.smithi110.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-04T12:34:33.228 INFO:tasks.workunit.client.0.smithi110.stderr:++ hash -r 2024-03-04T12:34:33.228 INFO:tasks.workunit.client.0.smithi110.stderr:+ pip install pip --upgrade 2024-03-04T12:34:33.454 INFO:tasks.workunit.client.0.smithi110.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2024-03-04T12:34:33.707 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting pip 2024-03-04T12:34:33.713 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-04T12:34:33.760 INFO:tasks.workunit.client.0.smithi110.stdout:Installing collected packages: pip 2024-03-04T12:34:33.760 INFO:tasks.workunit.client.0.smithi110.stdout: Attempting uninstall: pip 2024-03-04T12:34:33.760 INFO:tasks.workunit.client.0.smithi110.stdout: Found existing installation: pip 21.2.3 2024-03-04T12:34:33.904 INFO:tasks.workunit.client.0.smithi110.stdout: Uninstalling pip-21.2.3: 2024-03-04T12:34:33.909 INFO:tasks.workunit.client.0.smithi110.stdout: Successfully uninstalled pip-21.2.3 2024-03-04T12:34:35.022 INFO:tasks.workunit.client.0.smithi110.stdout:Successfully installed pip-24.0 2024-03-04T12:34:35.067 INFO:tasks.workunit.client.0.smithi110.stderr:+ pip install boto3 2024-03-04T12:34:35.950 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting boto3 2024-03-04T12:34:35.951 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached boto3-1.34.54-py3-none-any.whl.metadata (6.6 kB) 2024-03-04T12:34:36.572 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting botocore<1.35.0,>=1.34.54 (from boto3) 2024-03-04T12:34:36.573 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached botocore-1.34.54-py3-none-any.whl.metadata (5.7 kB) 2024-03-04T12:34:36.672 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-03-04T12:34:36.673 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-03-04T12:34:36.769 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-03-04T12:34:36.770 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-03-04T12:34:36.878 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:34:36.879 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-03-04T12:34:36.988 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:34:36.989 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-03-04T12:34:37.169 INFO:tasks.workunit.client.0.smithi110.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.54->boto3) 2024-03-04T12:34:37.170 INFO:tasks.workunit.client.0.smithi110.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-04T12:34:37.192 INFO:tasks.workunit.client.0.smithi110.stdout:Using cached boto3-1.34.54-py3-none-any.whl (139 kB) 2024-03-04T12:34:37.194 INFO:tasks.workunit.client.0.smithi110.stdout:Using cached botocore-1.34.54-py3-none-any.whl (12.0 MB) 2024-03-04T12:34:37.213 INFO:tasks.workunit.client.0.smithi110.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-03-04T12:34:37.215 INFO:tasks.workunit.client.0.smithi110.stdout:Using cached s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-03-04T12:34:37.216 INFO:tasks.workunit.client.0.smithi110.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-03-04T12:34:37.218 INFO:tasks.workunit.client.0.smithi110.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-03-04T12:34:37.219 INFO:tasks.workunit.client.0.smithi110.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-04T12:34:37.320 INFO:tasks.workunit.client.0.smithi110.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-03-04T12:34:38.360 INFO:tasks.workunit.client.0.smithi110.stdout:Successfully installed boto3-1.34.54 botocore-1.34.54 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.0 six-1.16.0 urllib3-1.26.18 2024-03-04T12:34:38.496 INFO:tasks.workunit.client.0.smithi110.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-03-04T12:34:38.622 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-03-04T12:34:38.654 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:34:38.654 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:34:38.688 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.681+0000 7f65d5c8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:38.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.682+0000 7f65d5c8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:38.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.682+0000 7f65d5c8c800 20 realm 2024-03-04T12:34:38.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.682+0000 7f65d5c8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:38.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.683+0000 7f65d5c8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:38.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.683+0000 7f65d5c8c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:34:38.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.683+0000 7f65d5c8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:38.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.683+0000 7f65d5c8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:38.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.683+0000 7f65d5c8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:38.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.684+0000 7f65d5c8c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:38.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.684+0000 7f65d5c8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:38.691 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.684+0000 7f65d5c8c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:34:38.691 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.684+0000 7f65d5c8c800 20 searching for the correct realm 2024-03-04T12:34:38.694 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.688+0000 7f65d3f89640 0 -- 172.21.15.110:0/3316097307 >> [v2:172.21.15.110:6824/3005097257,v1:172.21.15.110:6825/3005097257] conn(0x564551305c80 msgr2=0x5645513080a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:38.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.692+0000 7f65caf87640 0 -- 172.21.15.110:0/3316097307 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f65c40a3040 msgr2=0x7f65c40c9230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:38.702 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:34:38.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:34:38.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:34:38.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:34:38.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:34:38.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:34:38.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:38.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:38.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:38.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:38.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:38.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:34:38.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 20 zone default found 2024-03-04T12:34:38.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 4 Realm: () 2024-03-04T12:34:38.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:34:38.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:34:38.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:34:38.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 20 zonegroup default 2024-03-04T12:34:38.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.696+0000 7f65d5c8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:38.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.697+0000 7f65d5c8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:38.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.697+0000 7f65d5c8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:38.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.697+0000 7f65d5c8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:38.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.697+0000 7f65d5c8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:38.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.697+0000 7f65d5c8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:38.706 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.697+0000 7f65d5c8c800 20 started sync module instance, tier type = 2024-03-04T12:34:38.706 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.697+0000 7f65d5c8c800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:34:38.712 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.706+0000 7f65d5c8c800 20 add_watcher() i=0 2024-03-04T12:34:38.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.706+0000 7f65d5c8c800 20 add_watcher() i=1 2024-03-04T12:34:38.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.706+0000 7f65d5c8c800 20 add_watcher() i=2 2024-03-04T12:34:38.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.706+0000 7f65d5c8c800 20 add_watcher() i=3 2024-03-04T12:34:38.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.706+0000 7f65d5c8c800 20 add_watcher() i=4 2024-03-04T12:34:38.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.706+0000 7f65d5c8c800 20 add_watcher() i=5 2024-03-04T12:34:38.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.706+0000 7f65d5c8c800 20 add_watcher() i=6 2024-03-04T12:34:38.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.707+0000 7f65d5c8c800 20 add_watcher() i=7 2024-03-04T12:34:38.714 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.707+0000 7f65d5c8c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:34:38.715 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.709+0000 7f6489fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:38.716 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.709+0000 7f65d5c8c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:34:38.716 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.709+0000 7f65d5c8c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:34:38.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.709+0000 7f65d5c8c800 5 note: GC not initialized 2024-03-04T12:34:38.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.709+0000 7f6488fe1640 20 reqs_thread_entry: start 2024-03-04T12:34:38.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.709+0000 7f65d5c8c800 20 init_complete bucket index max shards: 11 2024-03-04T12:34:38.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.709+0000 7f65d5c8c800 20 Filter name: none 2024-03-04T12:34:38.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.709+0000 7f64027fc640 20 reqs_thread_entry: start 2024-03-04T12:34:38.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.709+0000 7f65d5c8c800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-03-04T12:34:38.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.709+0000 7f65d5c8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:38.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.710+0000 7f65d5c8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:38.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.710+0000 7f65d5c8c800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-03-04T12:34:38.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.710+0000 7f65d5c8c800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-03-04T12:34:38.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.710+0000 7f65d5c8c800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-03-04T12:34:38.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.710+0000 7f65d5c8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:38.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.710+0000 7f65d5c8c800 20 rados_obj.operate() r=0 bl.length=22 2024-03-04T12:34:38.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.710+0000 7f65d5c8c800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-03-04T12:34:38.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.710+0000 7f65d5c8c800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-04T12:34:38.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.710+0000 7f65d5c8c800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-03-04T12:34:38.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.710+0000 7f65d5c8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:38.719 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.711+0000 7f65d5c8c800 20 rados_obj.operate() r=0 bl.length=387 2024-03-04T12:34:38.719 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.711+0000 7f65d5c8c800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x11 2024-03-04T12:34:38.719 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.711+0000 7f65d5c8c800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-03-04T12:34:38.719 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.711+0000 7f65d5c8c800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-03-04T12:34:38.719 INFO:tasks.workunit.client.0.smithi110.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-03-04T12:34:38.719 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.712+0000 7f6489fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:38.720 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.714+0000 7f65d5c8c800 20 remove_watcher() i=0 2024-03-04T12:34:38.720 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.714+0000 7f65d5c8c800 2 removed watcher, disabling cache 2024-03-04T12:34:38.721 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.715+0000 7f65d5c8c800 20 remove_watcher() i=1 2024-03-04T12:34:38.722 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.716+0000 7f65d5c8c800 20 remove_watcher() i=2 2024-03-04T12:34:38.723 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.717+0000 7f65d5c8c800 20 remove_watcher() i=3 2024-03-04T12:34:38.725 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.718+0000 7f65d5c8c800 20 remove_watcher() i=4 2024-03-04T12:34:38.725 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.719+0000 7f65d5c8c800 20 remove_watcher() i=5 2024-03-04T12:34:38.726 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.720+0000 7f65d5c8c800 20 remove_watcher() i=6 2024-03-04T12:34:38.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:38.721+0000 7f65d5c8c800 20 remove_watcher() i=7 2024-03-04T12:34:51.779 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:34:51.780 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:34:51.829 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:34:51.829 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:34:51.875 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:34:51.875 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:34:51.919 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:34:51.919 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:34:51.943 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:34:51.943 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:34:52.001 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:34:52.001 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:34:52.053 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: reshard add 2024-03-04T12:34:52.053 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:52.054 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-04T12:34:52.081 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:34:52.082 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:34:52.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.293+0000 7fecda8bb640 0 --2- 172.21.15.110:0/1647788361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556b8658a6e0 0x556b866db870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-03-04T12:34:52.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.309+0000 7fecdeb26800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.311+0000 7fecdeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:52.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.311+0000 7fecdeb26800 20 realm 2024-03-04T12:34:52.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.311+0000 7fecdeb26800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.311+0000 7fecdeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:52.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.311+0000 7fecdeb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:34:52.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.311+0000 7fecdeb26800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.311+0000 7fecdeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:52.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.311+0000 7fecdeb26800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.312+0000 7fecdeb26800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:52.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.312+0000 7fecdeb26800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.312+0000 7fecdeb26800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:34:52.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.312+0000 7fecdeb26800 20 searching for the correct realm 2024-03-04T12:34:52.321 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.315+0000 7fecda0ba640 0 -- 172.21.15.110:0/289033742 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7feccc05b040 msgr2=0x7feccc09b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:52.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.521+0000 7fecda8bb640 0 -- 172.21.15.110:0/289033742 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fecd005e070 msgr2=0x7fecd00645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:34:52.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.728+0000 7fecdeb26800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:34:52.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.728+0000 7fecdeb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:34:52.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.728+0000 7fecdeb26800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:34:52.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.728+0000 7fecdeb26800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:34:52.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.728+0000 7fecdeb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:34:52.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.728+0000 7fecdeb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:34:52.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.728+0000 7fecdeb26800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.728+0000 7fecdeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:52.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.728+0000 7fecdeb26800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.728+0000 7fecdeb26800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:52.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.728+0000 7fecdeb26800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.729+0000 7fecdeb26800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:34:52.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.729+0000 7fecdeb26800 20 zone default found 2024-03-04T12:34:52.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.729+0000 7fecdeb26800 4 Realm: () 2024-03-04T12:34:52.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.729+0000 7fecdeb26800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:34:52.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.729+0000 7fecdeb26800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:34:52.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.729+0000 7fecdeb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:34:52.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.729+0000 7fecdeb26800 20 zonegroup default 2024-03-04T12:34:52.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.729+0000 7fecdeb26800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.729+0000 7fecdeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:52.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.729+0000 7fecdeb26800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.729+0000 7fecdeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:52.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.729+0000 7fecdeb26800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.729+0000 7fecdeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:52.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.729+0000 7fecdeb26800 20 started sync module instance, tier type = 2024-03-04T12:34:52.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.730+0000 7fecdeb26800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:34:52.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.739+0000 7fecdeb26800 20 add_watcher() i=0 2024-03-04T12:34:52.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.739+0000 7fecdeb26800 20 add_watcher() i=1 2024-03-04T12:34:52.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.739+0000 7fecdeb26800 20 add_watcher() i=2 2024-03-04T12:34:52.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.739+0000 7fecdeb26800 20 add_watcher() i=3 2024-03-04T12:34:52.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.739+0000 7fecdeb26800 20 add_watcher() i=4 2024-03-04T12:34:52.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.739+0000 7fecdeb26800 20 add_watcher() i=5 2024-03-04T12:34:52.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.739+0000 7fecdeb26800 20 add_watcher() i=6 2024-03-04T12:34:52.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.740+0000 7fecdeb26800 20 add_watcher() i=7 2024-03-04T12:34:52.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.740+0000 7fecdeb26800 2 all 8 watchers are set, enabling cache 2024-03-04T12:34:52.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.742+0000 7feb917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:52.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.742+0000 7fecdeb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:34:52.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.742+0000 7fecdeb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:34:52.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.742+0000 7fecdeb26800 5 note: GC not initialized 2024-03-04T12:34:52.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.743+0000 7feb0bfff640 20 reqs_thread_entry: start 2024-03-04T12:34:52.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.743+0000 7fecdeb26800 20 init_complete bucket index max shards: 11 2024-03-04T12:34:52.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.743+0000 7fecdeb26800 20 Filter name: none 2024-03-04T12:34:52.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.743+0000 7feb09ffb640 20 reqs_thread_entry: start 2024-03-04T12:34:52.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.743+0000 7fecdeb26800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.744+0000 7fecdeb26800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:34:52.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.744+0000 7fecdeb26800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.744+0000 7fecdeb26800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:34:52.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.744+0000 7fecdeb26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:34:52.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.744+0000 7fecdeb26800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.744+0000 7fecdeb26800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:34:52.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.744+0000 7fecdeb26800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.745+0000 7fecdeb26800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:34:52.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.745+0000 7fecdeb26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:34:52.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.746+0000 7fecdeb26800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.746+0000 7fecdeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:52.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.747+0000 7feb917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:52.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.749+0000 7fecdeb26800 20 remove_watcher() i=0 2024-03-04T12:34:52.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.749+0000 7fecdeb26800 2 removed watcher, disabling cache 2024-03-04T12:34:52.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.750+0000 7fecdeb26800 20 remove_watcher() i=1 2024-03-04T12:34:52.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.751+0000 7fecdeb26800 20 remove_watcher() i=2 2024-03-04T12:34:52.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.752+0000 7fecdeb26800 20 remove_watcher() i=3 2024-03-04T12:34:52.759 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.753+0000 7fecdeb26800 20 remove_watcher() i=4 2024-03-04T12:34:52.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.754+0000 7fecdeb26800 20 remove_watcher() i=5 2024-03-04T12:34:52.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.755+0000 7fecdeb26800 20 remove_watcher() i=6 2024-03-04T12:34:52.762 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.756+0000 7fecdeb26800 20 remove_watcher() i=7 2024-03-04T12:34:52.772 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:52.772 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:34:52.772 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: a-bucket id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-03-04T12:34:52.772 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:52.773 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-03-04T12:34:52.803 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:34:52.803 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:34:52.836 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.830+0000 7fb55e11f800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.839 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.831+0000 7fb55e11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:52.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.831+0000 7fb55e11f800 20 realm 2024-03-04T12:34:52.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.831+0000 7fb55e11f800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.831+0000 7fb55e11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:52.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.831+0000 7fb55e11f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:34:52.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.831+0000 7fb55e11f800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.831+0000 7fb55e11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:52.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.831+0000 7fb55e11f800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.841 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.832+0000 7fb55e11f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:52.841 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.832+0000 7fb55e11f800 20 rados->read ofs=0 len=0 2024-03-04T12:34:52.841 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.833+0000 7fb55e11f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:34:52.841 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.833+0000 7fb55e11f800 20 searching for the correct realm 2024-03-04T12:34:52.842 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.836+0000 7fb55a5f1640 0 -- 172.21.15.110:0/1225267264 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7fb550029070 msgr2=0x7fb550017aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:52.846 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:52.839+0000 7fb559df0640 0 -- 172.21.15.110:0/1225267264 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fb5500663a0 msgr2=0x7fb550090040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:53.052 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.045+0000 7fb55e11f800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:34:53.052 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.045+0000 7fb55e11f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:34:53.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.045+0000 7fb55e11f800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:34:53.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.045+0000 7fb55e11f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:34:53.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.045+0000 7fb55e11f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:34:53.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.045+0000 7fb55e11f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:34:53.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.045+0000 7fb55e11f800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.045+0000 7fb55e11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.045+0000 7fb55e11f800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.045+0000 7fb55e11f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:53.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.045+0000 7fb55e11f800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.046+0000 7fb55e11f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:34:53.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.046+0000 7fb55e11f800 20 zone default found 2024-03-04T12:34:53.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.046+0000 7fb55e11f800 4 Realm: () 2024-03-04T12:34:53.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.046+0000 7fb55e11f800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:34:53.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.046+0000 7fb55e11f800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:34:53.053 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.046+0000 7fb55e11f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:34:53.054 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.046+0000 7fb55e11f800 20 zonegroup default 2024-03-04T12:34:53.054 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.046+0000 7fb55e11f800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.054 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.046+0000 7fb55e11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.054 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.046+0000 7fb55e11f800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.054 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.046+0000 7fb55e11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.054 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.046+0000 7fb55e11f800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.055 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.047+0000 7fb55e11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.055 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.047+0000 7fb55e11f800 20 started sync module instance, tier type = 2024-03-04T12:34:53.055 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.047+0000 7fb55e11f800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:34:53.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.055+0000 7fb55e11f800 20 add_watcher() i=0 2024-03-04T12:34:53.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.055+0000 7fb55e11f800 20 add_watcher() i=1 2024-03-04T12:34:53.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.055+0000 7fb55e11f800 20 add_watcher() i=2 2024-03-04T12:34:53.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.055+0000 7fb55e11f800 20 add_watcher() i=3 2024-03-04T12:34:53.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.055+0000 7fb55e11f800 20 add_watcher() i=4 2024-03-04T12:34:53.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.055+0000 7fb55e11f800 20 add_watcher() i=5 2024-03-04T12:34:53.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.055+0000 7fb55e11f800 20 add_watcher() i=6 2024-03-04T12:34:53.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.056+0000 7fb55e11f800 20 add_watcher() i=7 2024-03-04T12:34:53.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.056+0000 7fb55e11f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:34:53.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.058+0000 7fb40b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:53.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.058+0000 7fb55e11f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:34:53.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.058+0000 7fb55e11f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:34:53.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.058+0000 7fb55e11f800 5 note: GC not initialized 2024-03-04T12:34:53.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.058+0000 7fb40a7fc640 20 reqs_thread_entry: start 2024-03-04T12:34:53.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.058+0000 7fb55e11f800 20 init_complete bucket index max shards: 11 2024-03-04T12:34:53.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.058+0000 7fb55e11f800 20 Filter name: none 2024-03-04T12:34:53.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.059+0000 7fb37bfff640 20 reqs_thread_entry: start 2024-03-04T12:34:53.066 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.059+0000 7fb55e11f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-04T12:34:53.066 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.059+0000 7fb55e11f800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.066 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.059+0000 7fb55e11f800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:34:53.066 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.059+0000 7fb55e11f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-03-04T12:34:53.066 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.059+0000 7fb55e11f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-04T12:34:53.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.059+0000 7fb55e11f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 : miss 2024-03-04T12:34:53.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.059+0000 7fb55e11f800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.060+0000 7fb55e11f800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:34:53.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.060+0000 7fb55e11f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:34:53.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.060+0000 7fb55e11f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:34:53.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.060+0000 7fb55e11f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:34:53.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.060+0000 7fb55e11f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:34:53.067 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.060+0000 7fb55e11f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 2024-03-04T12:34:53.068 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.062+0000 7fb40b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:53.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.064+0000 7fb55e11f800 20 remove_watcher() i=0 2024-03-04T12:34:53.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.064+0000 7fb55e11f800 2 removed watcher, disabling cache 2024-03-04T12:34:53.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.065+0000 7fb55e11f800 20 remove_watcher() i=1 2024-03-04T12:34:53.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.067+0000 7fb55e11f800 20 remove_watcher() i=2 2024-03-04T12:34:53.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.068+0000 7fb55e11f800 20 remove_watcher() i=3 2024-03-04T12:34:53.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.069+0000 7fb55e11f800 20 remove_watcher() i=4 2024-03-04T12:34:53.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.070+0000 7fb55e11f800 20 remove_watcher() i=5 2024-03-04T12:34:53.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.071+0000 7fb55e11f800 20 remove_watcher() i=6 2024-03-04T12:34:53.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.071+0000 7fb55e11f800 20 remove_watcher() i=7 2024-03-04T12:34:53.088 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin reshard list 2024-03-04T12:34:53.114 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:34:53.114 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:34:53.147 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.140+0000 7ff93ac16800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.149 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.142+0000 7ff93ac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.149 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.142+0000 7ff93ac16800 20 realm 2024-03-04T12:34:53.149 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.142+0000 7ff93ac16800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.142+0000 7ff93ac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.142+0000 7ff93ac16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:34:53.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.142+0000 7ff93ac16800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.142+0000 7ff93ac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.142+0000 7ff93ac16800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.143+0000 7ff93ac16800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:53.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.143+0000 7ff93ac16800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.144+0000 7ff93ac16800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:34:53.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.144+0000 7ff93ac16800 20 searching for the correct realm 2024-03-04T12:34:53.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.147+0000 7ff936b5f640 0 -- 172.21.15.110:0/1610025011 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7ff920084930 msgr2=0x7ff9200823f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:53.157 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.150+0000 7ff93635e640 0 -- 172.21.15.110:0/1610025011 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7ff9200938f0 msgr2=0x7ff9200783d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:53.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.356+0000 7ff93ac16800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:34:53.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.356+0000 7ff93ac16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:34:53.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.356+0000 7ff93ac16800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:34:53.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.356+0000 7ff93ac16800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:34:53.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.356+0000 7ff93ac16800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:34:53.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.356+0000 7ff93ac16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:34:53.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.356+0000 7ff93ac16800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.356+0000 7ff93ac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.356+0000 7ff93ac16800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.357+0000 7ff93ac16800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:53.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.357+0000 7ff93ac16800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.357+0000 7ff93ac16800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:34:53.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.357+0000 7ff93ac16800 20 zone default found 2024-03-04T12:34:53.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.357+0000 7ff93ac16800 4 Realm: () 2024-03-04T12:34:53.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.357+0000 7ff93ac16800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:34:53.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.357+0000 7ff93ac16800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:34:53.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.357+0000 7ff93ac16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:34:53.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.357+0000 7ff93ac16800 20 zonegroup default 2024-03-04T12:34:53.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.357+0000 7ff93ac16800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.357+0000 7ff93ac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.358+0000 7ff93ac16800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.358+0000 7ff93ac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.358+0000 7ff93ac16800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.358+0000 7ff93ac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.358+0000 7ff93ac16800 20 started sync module instance, tier type = 2024-03-04T12:34:53.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.358+0000 7ff93ac16800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:34:53.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.367+0000 7ff93ac16800 20 add_watcher() i=0 2024-03-04T12:34:53.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.367+0000 7ff93ac16800 20 add_watcher() i=1 2024-03-04T12:34:53.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.367+0000 7ff93ac16800 20 add_watcher() i=2 2024-03-04T12:34:53.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.367+0000 7ff93ac16800 20 add_watcher() i=3 2024-03-04T12:34:53.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.367+0000 7ff93ac16800 20 add_watcher() i=4 2024-03-04T12:34:53.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.367+0000 7ff93ac16800 20 add_watcher() i=5 2024-03-04T12:34:53.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.367+0000 7ff93ac16800 20 add_watcher() i=6 2024-03-04T12:34:53.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.368+0000 7ff93ac16800 20 add_watcher() i=7 2024-03-04T12:34:53.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.368+0000 7ff93ac16800 2 all 8 watchers are set, enabling cache 2024-03-04T12:34:53.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.370+0000 7ff7ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:53.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.370+0000 7ff93ac16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:34:53.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.370+0000 7ff93ac16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:34:53.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.370+0000 7ff93ac16800 5 note: GC not initialized 2024-03-04T12:34:53.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.370+0000 7ff7677fe640 20 reqs_thread_entry: start 2024-03-04T12:34:53.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.371+0000 7ff93ac16800 20 init_complete bucket index max shards: 11 2024-03-04T12:34:53.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.371+0000 7ff93ac16800 20 Filter name: none 2024-03-04T12:34:53.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.371+0000 7ff7657fa640 20 reqs_thread_entry: start 2024-03-04T12:34:53.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.377+0000 7ff7ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:53.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.380+0000 7ff93ac16800 20 remove_watcher() i=0 2024-03-04T12:34:53.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.380+0000 7ff93ac16800 2 removed watcher, disabling cache 2024-03-04T12:34:53.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.381+0000 7ff93ac16800 20 remove_watcher() i=1 2024-03-04T12:34:53.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.382+0000 7ff93ac16800 20 remove_watcher() i=2 2024-03-04T12:34:53.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.383+0000 7ff93ac16800 20 remove_watcher() i=3 2024-03-04T12:34:53.390 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.384+0000 7ff93ac16800 20 remove_watcher() i=4 2024-03-04T12:34:53.391 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.385+0000 7ff93ac16800 20 remove_watcher() i=5 2024-03-04T12:34:53.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.386+0000 7ff93ac16800 20 remove_watcher() i=6 2024-03-04T12:34:53.393 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.387+0000 7ff93ac16800 20 remove_watcher() i=7 2024-03-04T12:34:53.402 INFO:tasks.workunit.client.0.smithi110.stderr:bucket name a-bucket 2024-03-04T12:34:53.403 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: reshard process 2024-03-04T12:34:53.403 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:53.403 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin reshard process 2024-03-04T12:34:53.429 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:34:53.429 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:34:53.462 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.456+0000 7f117969d800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.457+0000 7f117969d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.457+0000 7f117969d800 20 realm 2024-03-04T12:34:53.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.457+0000 7f117969d800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.457+0000 7f117969d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.457+0000 7f117969d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:34:53.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.457+0000 7f117969d800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.457+0000 7f117969d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.457+0000 7f117969d800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.458+0000 7f117969d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:53.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.458+0000 7f117969d800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.459+0000 7f117969d800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:34:53.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.459+0000 7f117969d800 20 searching for the correct realm 2024-03-04T12:34:53.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.463+0000 7f1176998640 0 -- 172.21.15.110:0/4122928 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x55d3d7d37db0 msgr2=0x55d3d7d3a270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:53.472 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.466+0000 7f1177199640 0 -- 172.21.15.110:0/4122928 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f116c0a4900 msgr2=0x7f116c085440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:53.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.470+0000 7f117969d800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:34:53.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.470+0000 7f117969d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:34:53.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.470+0000 7f117969d800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:34:53.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.470+0000 7f117969d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:34:53.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.470+0000 7f117969d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:34:53.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.470+0000 7f117969d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:34:53.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.470+0000 7f117969d800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.471+0000 7f117969d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.471+0000 7f117969d800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.471+0000 7f117969d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:53.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.471+0000 7f117969d800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.471+0000 7f117969d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:34:53.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.471+0000 7f117969d800 20 zone default found 2024-03-04T12:34:53.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.471+0000 7f117969d800 4 Realm: () 2024-03-04T12:34:53.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.471+0000 7f117969d800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:34:53.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.471+0000 7f117969d800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:34:53.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.471+0000 7f117969d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:34:53.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.471+0000 7f117969d800 20 zonegroup default 2024-03-04T12:34:53.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.471+0000 7f117969d800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.472+0000 7f117969d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.472+0000 7f117969d800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.472+0000 7f117969d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.472+0000 7f117969d800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.472+0000 7f117969d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:53.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.472+0000 7f117969d800 20 started sync module instance, tier type = 2024-03-04T12:34:53.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.472+0000 7f117969d800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:34:53.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.481+0000 7f117969d800 20 add_watcher() i=0 2024-03-04T12:34:53.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.481+0000 7f117969d800 20 add_watcher() i=1 2024-03-04T12:34:53.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.481+0000 7f117969d800 20 add_watcher() i=2 2024-03-04T12:34:53.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.481+0000 7f117969d800 20 add_watcher() i=3 2024-03-04T12:34:53.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.481+0000 7f117969d800 20 add_watcher() i=4 2024-03-04T12:34:53.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.481+0000 7f117969d800 20 add_watcher() i=5 2024-03-04T12:34:53.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.481+0000 7f117969d800 20 add_watcher() i=6 2024-03-04T12:34:53.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.482+0000 7f117969d800 20 add_watcher() i=7 2024-03-04T12:34:53.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.482+0000 7f117969d800 2 all 8 watchers are set, enabling cache 2024-03-04T12:34:53.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.483+0000 7f102dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:53.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.484+0000 7f117969d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:34:53.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.484+0000 7f117969d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:34:53.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.484+0000 7f117969d800 5 note: GC not initialized 2024-03-04T12:34:53.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.484+0000 7f102cfe1640 20 reqs_thread_entry: start 2024-03-04T12:34:53.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.484+0000 7f117969d800 20 init_complete bucket index max shards: 11 2024-03-04T12:34:53.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.484+0000 7f117969d800 20 Filter name: none 2024-03-04T12:34:53.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.484+0000 7f0fa67fc640 20 reqs_thread_entry: start 2024-03-04T12:34:53.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.484+0000 7f117969d800 20 processing logshard = reshard.0000000000 2024-03-04T12:34:53.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.487+0000 7f117969d800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-03-04T12:34:53.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.487+0000 7f117969d800 20 processing logshard = reshard.0000000001 2024-03-04T12:34:53.496 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.489+0000 7f117969d800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-03-04T12:34:53.496 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.489+0000 7f117969d800 20 processing logshard = reshard.0000000002 2024-03-04T12:34:53.498 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.492+0000 7f117969d800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-03-04T12:34:53.498 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.492+0000 7f117969d800 20 processing logshard = reshard.0000000003 2024-03-04T12:34:53.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.494+0000 7f117969d800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-03-04T12:34:53.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.494+0000 7f117969d800 20 processing logshard = reshard.0000000004 2024-03-04T12:34:53.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.497+0000 7f117969d800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-03-04T12:34:53.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.497+0000 7f117969d800 20 processing logshard = reshard.0000000005 2024-03-04T12:34:53.506 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.500+0000 7f117969d800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-03-04T12:34:53.506 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.500+0000 7f117969d800 20 processing logshard = reshard.0000000006 2024-03-04T12:34:53.507 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.501+0000 7f117969d800 20 process_entry resharding a-bucket 2024-03-04T12:34:53.507 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.501+0000 7f117969d800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-04T12:34:53.507 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.501+0000 7f117969d800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.501+0000 7f117969d800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:34:53.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.501+0000 7f117969d800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-03-04T12:34:53.508 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.501+0000 7f117969d800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-04T12:34:53.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.501+0000 7f117969d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 : miss 2024-03-04T12:34:53.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.501+0000 7f117969d800 20 rados->read ofs=0 len=0 2024-03-04T12:34:53.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.502+0000 7f117969d800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:34:53.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.502+0000 7f117969d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:34:53.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.502+0000 7f117969d800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:34:53.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.502+0000 7f117969d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:34:53.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.502+0000 7f117969d800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:34:53.509 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.502+0000 7f117969d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 2024-03-04T12:34:53.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.508+0000 7f117969d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:34:53.515 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.508+0000 7f117969d800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:34:53.515 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.508+0000 7f117969d800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:34:53.515 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.508+0000 7f117969d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18, ofs0, ns] 2024-03-04T12:34:53.515 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.508+0000 7f105affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824016 cookie 94368347439760 notifier 5702 bl.length()=861 2024-03-04T12:34:53.515 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.508+0000 7f105affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:34:53.515 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.508+0000 7f105affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:34:53.515 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.508+0000 7f105affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:34:53.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.510+0000 7f117969d800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): orig_sources= new_sources= 2024-03-04T12:34:53.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.510+0000 7f117969d800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): potential sources added=[] removed=[] 2024-03-04T12:34:53.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.510+0000 7f117969d800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): orig_dests= new_dests= 2024-03-04T12:34:53.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.510+0000 7f117969d800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): potential dests added=[] removed=[] 2024-03-04T12:34:53.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.0 2024-03-04T12:34:53.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.0 2024-03-04T12:34:53.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.1 2024-03-04T12:34:53.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.1 2024-03-04T12:34:53.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.2 2024-03-04T12:34:53.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.2 2024-03-04T12:34:53.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.3 2024-03-04T12:34:53.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.3 2024-03-04T12:34:53.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.4 2024-03-04T12:34:53.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.4 2024-03-04T12:34:53.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.5 2024-03-04T12:34:53.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.5 2024-03-04T12:34:53.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.6 2024-03-04T12:34:53.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.6 2024-03-04T12:34:53.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.7 2024-03-04T12:34:53.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.7 2024-03-04T12:34:53.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.8 2024-03-04T12:34:53.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.8 2024-03-04T12:34:53.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.9 2024-03-04T12:34:53.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.9 2024-03-04T12:34:53.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.10 2024-03-04T12:34:53.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.10 2024-03-04T12:34:53.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.11 2024-03-04T12:34:53.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.11 2024-03-04T12:34:53.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.512+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.0 2024-03-04T12:34:53.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.513+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1 2024-03-04T12:34:53.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.513+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2 2024-03-04T12:34:53.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.514+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.3 2024-03-04T12:34:53.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.514+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.4 2024-03-04T12:34:53.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.515+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.5 2024-03-04T12:34:53.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.515+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.6 2024-03-04T12:34:53.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.515+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.7 2024-03-04T12:34:53.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.516+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.8 2024-03-04T12:34:53.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.516+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.9 2024-03-04T12:34:53.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.517+0000 7f117969d800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.10 2024-03-04T12:34:53.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.517+0000 7f117969d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 : hit (requested=0x17, cached=0x17) 2024-03-04T12:34:53.524 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.517+0000 7f117969d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 2024-03-04T12:34:53.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.518+0000 7f117969d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:34:53.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.518+0000 7f117969d800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:34:53.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.518+0000 7f117969d800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:34:53.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.518+0000 7f117969d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18, ofs0, ns] 2024-03-04T12:34:53.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.519+0000 7f105a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824017 cookie 94368347439760 notifier 5702 bl.length()=829 2024-03-04T12:34:53.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.519+0000 7f105a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:34:53.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.519+0000 7f105a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:34:53.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.519+0000 7f105a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:34:53.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.520+0000 7f117969d800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): orig_sources= new_sources= 2024-03-04T12:34:53.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.520+0000 7f117969d800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): potential sources added=[] removed=[] 2024-03-04T12:34:53.527 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.520+0000 7f117969d800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): orig_dests= new_dests= 2024-03-04T12:34:53.527 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.520+0000 7f117969d800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): potential dests added=[] removed=[] 2024-03-04T12:34:53.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.522+0000 7f117969d800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-03-04T12:34:53.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.523+0000 7f117969d800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-03-04T12:34:53.532 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.525+0000 7f117969d800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-03-04T12:34:53.532 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.525+0000 7f117969d800 20 processing logshard = reshard.0000000007 2024-03-04T12:34:53.534 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.528+0000 7f117969d800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-03-04T12:34:53.534 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.528+0000 7f117969d800 20 processing logshard = reshard.0000000008 2024-03-04T12:34:53.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.530+0000 7f117969d800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-03-04T12:34:53.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.530+0000 7f117969d800 20 processing logshard = reshard.0000000009 2024-03-04T12:34:53.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.533+0000 7f117969d800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-03-04T12:34:53.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.533+0000 7f117969d800 20 processing logshard = reshard.0000000010 2024-03-04T12:34:53.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.535+0000 7f117969d800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-03-04T12:34:53.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.535+0000 7f117969d800 20 processing logshard = reshard.0000000011 2024-03-04T12:34:53.543 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.537+0000 7f117969d800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-03-04T12:34:53.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.537+0000 7f117969d800 20 processing logshard = reshard.0000000012 2024-03-04T12:34:53.546 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.540+0000 7f117969d800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-03-04T12:34:53.546 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.540+0000 7f117969d800 20 processing logshard = reshard.0000000013 2024-03-04T12:34:53.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.542+0000 7f117969d800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-03-04T12:34:53.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.542+0000 7f117969d800 20 processing logshard = reshard.0000000014 2024-03-04T12:34:53.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.544+0000 7f117969d800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-03-04T12:34:53.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.544+0000 7f117969d800 20 processing logshard = reshard.0000000015 2024-03-04T12:34:53.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.547+0000 7f117969d800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-03-04T12:34:53.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.548+0000 7f102dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:53.556 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.550+0000 7f117969d800 20 remove_watcher() i=0 2024-03-04T12:34:53.556 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.550+0000 7f117969d800 2 removed watcher, disabling cache 2024-03-04T12:34:53.557 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.551+0000 7f117969d800 20 remove_watcher() i=1 2024-03-04T12:34:53.558 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.552+0000 7f117969d800 20 remove_watcher() i=2 2024-03-04T12:34:53.559 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.553+0000 7f117969d800 20 remove_watcher() i=3 2024-03-04T12:34:53.560 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.554+0000 7f117969d800 20 remove_watcher() i=4 2024-03-04T12:34:53.561 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.555+0000 7f117969d800 20 remove_watcher() i=5 2024-03-04T12:34:53.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.556+0000 7f117969d800 20 remove_watcher() i=6 2024-03-04T12:34:53.563 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:53.557+0000 7f117969d800 20 remove_watcher() i=7 2024-03-04T12:34:58.580 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-04T12:34:58.611 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:34:58.611 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:34:58.649 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:58.642+0000 7f28f2d28800 20 rados->read ofs=0 len=0 2024-03-04T12:34:58.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:58.644+0000 7f28f2d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:58.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:58.644+0000 7f28f2d28800 20 realm 2024-03-04T12:34:58.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:58.644+0000 7f28f2d28800 20 rados->read ofs=0 len=0 2024-03-04T12:34:58.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:58.644+0000 7f28f2d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:58.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:58.644+0000 7f28f2d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:34:58.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:58.644+0000 7f28f2d28800 20 rados->read ofs=0 len=0 2024-03-04T12:34:58.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:58.644+0000 7f28f2d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:58.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:58.644+0000 7f28f2d28800 20 rados->read ofs=0 len=0 2024-03-04T12:34:58.653 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:58.646+0000 7f28f2d28800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:58.653 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:58.646+0000 7f28f2d28800 20 rados->read ofs=0 len=0 2024-03-04T12:34:58.653 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:58.646+0000 7f28f2d28800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:34:58.653 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:58.646+0000 7f28f2d28800 20 searching for the correct realm 2024-03-04T12:34:58.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:58.649+0000 7f28ee229640 0 -- 172.21.15.110:0/865115118 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f28e0051b70 msgr2=0x7f28e003a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:58.862 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:58.856+0000 7f28eea2a640 0 -- 172.21.15.110:0/865115118 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f28d8015070 msgr2=0x7f28d8019880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:34:59.070 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.063+0000 7f28f2d28800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:34:59.070 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.063+0000 7f28f2d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:34:59.070 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.063+0000 7f28f2d28800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:34:59.070 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.063+0000 7f28f2d28800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:34:59.070 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.063+0000 7f28f2d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:34:59.070 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.063+0000 7f28f2d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:34:59.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.063+0000 7f28f2d28800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.063+0000 7f28f2d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.063+0000 7f28f2d28800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.064+0000 7f28f2d28800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:59.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.064+0000 7f28f2d28800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.064+0000 7f28f2d28800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:34:59.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.064+0000 7f28f2d28800 20 zone default found 2024-03-04T12:34:59.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.064+0000 7f28f2d28800 4 Realm: () 2024-03-04T12:34:59.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.064+0000 7f28f2d28800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:34:59.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.064+0000 7f28f2d28800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:34:59.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.064+0000 7f28f2d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:34:59.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.064+0000 7f28f2d28800 20 zonegroup default 2024-03-04T12:34:59.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.064+0000 7f28f2d28800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.065+0000 7f28f2d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.065+0000 7f28f2d28800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.065+0000 7f28f2d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.065+0000 7f28f2d28800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.065+0000 7f28f2d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.065+0000 7f28f2d28800 20 started sync module instance, tier type = 2024-03-04T12:34:59.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.065+0000 7f28f2d28800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:34:59.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.076+0000 7f28f2d28800 20 add_watcher() i=0 2024-03-04T12:34:59.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.076+0000 7f28f2d28800 20 add_watcher() i=1 2024-03-04T12:34:59.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.076+0000 7f28f2d28800 20 add_watcher() i=2 2024-03-04T12:34:59.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.076+0000 7f28f2d28800 20 add_watcher() i=3 2024-03-04T12:34:59.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.076+0000 7f28f2d28800 20 add_watcher() i=4 2024-03-04T12:34:59.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.076+0000 7f28f2d28800 20 add_watcher() i=5 2024-03-04T12:34:59.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.076+0000 7f28f2d28800 20 add_watcher() i=6 2024-03-04T12:34:59.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.078+0000 7f28f2d28800 20 add_watcher() i=7 2024-03-04T12:34:59.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.078+0000 7f28f2d28800 2 all 8 watchers are set, enabling cache 2024-03-04T12:34:59.086 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.080+0000 7f27a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:59.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.081+0000 7f28f2d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:34:59.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.081+0000 7f28f2d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:34:59.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.081+0000 7f28f2d28800 5 note: GC not initialized 2024-03-04T12:34:59.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.081+0000 7f271ffff640 20 reqs_thread_entry: start 2024-03-04T12:34:59.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.081+0000 7f28f2d28800 20 init_complete bucket index max shards: 11 2024-03-04T12:34:59.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.081+0000 7f28f2d28800 20 Filter name: none 2024-03-04T12:34:59.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.081+0000 7f271dffb640 20 reqs_thread_entry: start 2024-03-04T12:34:59.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.081+0000 7f28f2d28800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.082+0000 7f28f2d28800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:34:59.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.082+0000 7f28f2d28800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.089 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.082+0000 7f28f2d28800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:34:59.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.082+0000 7f28f2d28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:34:59.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.082+0000 7f28f2d28800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.083+0000 7f28f2d28800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:34:59.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.083+0000 7f28f2d28800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.083+0000 7f28f2d28800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:34:59.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.083+0000 7f28f2d28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:34:59.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.085+0000 7f28f2d28800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.085+0000 7f28f2d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.086+0000 7f27a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:59.094 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.088+0000 7f28f2d28800 20 remove_watcher() i=0 2024-03-04T12:34:59.095 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.088+0000 7f28f2d28800 2 removed watcher, disabling cache 2024-03-04T12:34:59.096 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.090+0000 7f28f2d28800 20 remove_watcher() i=1 2024-03-04T12:34:59.097 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.091+0000 7f28f2d28800 20 remove_watcher() i=2 2024-03-04T12:34:59.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.092+0000 7f28f2d28800 20 remove_watcher() i=3 2024-03-04T12:34:59.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.093+0000 7f28f2d28800 20 remove_watcher() i=4 2024-03-04T12:34:59.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.094+0000 7f28f2d28800 20 remove_watcher() i=5 2024-03-04T12:34:59.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.095+0000 7f28f2d28800 20 remove_watcher() i=6 2024-03-04T12:34:59.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.097+0000 7f28f2d28800 20 remove_watcher() i=7 2024-03-04T12:34:59.114 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:59.115 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:34:59.115 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: a-bucket id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-03-04T12:34:59.115 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:59.115 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: reshard add non empty bucket 2024-03-04T12:34:59.115 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:59.119 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:34:59.119 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:34:59.151 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:34:59.151 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:34:59.180 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:34:59.180 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:34:59.208 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:34:59.209 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:34:59.237 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:34:59.237 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:34:59.265 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:34:59.265 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:34:59.292 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:34:59.292 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:34:59.320 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:34:59.320 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:34:59.347 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-04T12:34:59.374 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:34:59.375 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:34:59.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.401+0000 7fe51652b800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.402+0000 7fe51652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.402+0000 7fe51652b800 20 realm 2024-03-04T12:34:59.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.402+0000 7fe51652b800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.403+0000 7fe51652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.403+0000 7fe51652b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:34:59.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.403+0000 7fe51652b800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.403+0000 7fe51652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.403+0000 7fe51652b800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.404+0000 7fe51652b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:59.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.404+0000 7fe51652b800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.404+0000 7fe51652b800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:34:59.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.404+0000 7fe51652b800 20 searching for the correct realm 2024-03-04T12:34:59.414 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.408+0000 7fe51195a640 0 -- 172.21.15.110:0/2575799828 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x55adce212200 msgr2=0x55adce214670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:59.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.411+0000 7fe51215b640 0 -- 172.21.15.110:0/2575799828 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fe508064b90 msgr2=0x7fe50806a0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:59.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.416+0000 7fe51652b800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:34:59.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.416+0000 7fe51652b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:34:59.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.416+0000 7fe51652b800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:34:59.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.416+0000 7fe51652b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:34:59.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.416+0000 7fe51652b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:34:59.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.416+0000 7fe51652b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:34:59.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.416+0000 7fe51652b800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.416+0000 7fe51652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.416+0000 7fe51652b800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.416+0000 7fe51652b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:59.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.416+0000 7fe51652b800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.416+0000 7fe51652b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:34:59.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.417+0000 7fe51652b800 20 zone default found 2024-03-04T12:34:59.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.417+0000 7fe51652b800 4 Realm: () 2024-03-04T12:34:59.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.417+0000 7fe51652b800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:34:59.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.417+0000 7fe51652b800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:34:59.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.417+0000 7fe51652b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:34:59.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.417+0000 7fe51652b800 20 zonegroup default 2024-03-04T12:34:59.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.417+0000 7fe51652b800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.417+0000 7fe51652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.417+0000 7fe51652b800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.417+0000 7fe51652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.417+0000 7fe51652b800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.417+0000 7fe51652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.417+0000 7fe51652b800 20 started sync module instance, tier type = 2024-03-04T12:34:59.426 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.417+0000 7fe51652b800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:34:59.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.426+0000 7fe51652b800 20 add_watcher() i=0 2024-03-04T12:34:59.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.426+0000 7fe51652b800 20 add_watcher() i=1 2024-03-04T12:34:59.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.426+0000 7fe51652b800 20 add_watcher() i=2 2024-03-04T12:34:59.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.426+0000 7fe51652b800 20 add_watcher() i=3 2024-03-04T12:34:59.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.426+0000 7fe51652b800 20 add_watcher() i=4 2024-03-04T12:34:59.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.426+0000 7fe51652b800 20 add_watcher() i=5 2024-03-04T12:34:59.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.426+0000 7fe51652b800 20 add_watcher() i=6 2024-03-04T12:34:59.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.427+0000 7fe51652b800 20 add_watcher() i=7 2024-03-04T12:34:59.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.427+0000 7fe51652b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:34:59.435 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.429+0000 7fe3c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:59.436 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.430+0000 7fe51652b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:34:59.436 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.430+0000 7fe51652b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:34:59.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.430+0000 7fe51652b800 5 note: GC not initialized 2024-03-04T12:34:59.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.430+0000 7fe3437fe640 20 reqs_thread_entry: start 2024-03-04T12:34:59.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.430+0000 7fe51652b800 20 init_complete bucket index max shards: 11 2024-03-04T12:34:59.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.430+0000 7fe51652b800 20 Filter name: none 2024-03-04T12:34:59.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.430+0000 7fe3417fa640 20 reqs_thread_entry: start 2024-03-04T12:34:59.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.430+0000 7fe51652b800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.438 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.430+0000 7fe51652b800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:34:59.438 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.430+0000 7fe51652b800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.438 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.431+0000 7fe51652b800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:34:59.438 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.431+0000 7fe51652b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:34:59.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.431+0000 7fe51652b800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.431+0000 7fe51652b800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:34:59.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.431+0000 7fe51652b800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.432+0000 7fe51652b800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:34:59.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.432+0000 7fe51652b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:34:59.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.433+0000 7fe51652b800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.433+0000 7fe51652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.440 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.434+0000 7fe3c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:59.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.436+0000 7fe51652b800 20 remove_watcher() i=0 2024-03-04T12:34:59.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.436+0000 7fe51652b800 2 removed watcher, disabling cache 2024-03-04T12:34:59.443 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.437+0000 7fe51652b800 20 remove_watcher() i=1 2024-03-04T12:34:59.445 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.438+0000 7fe51652b800 20 remove_watcher() i=2 2024-03-04T12:34:59.446 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.439+0000 7fe51652b800 20 remove_watcher() i=3 2024-03-04T12:34:59.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.441+0000 7fe51652b800 20 remove_watcher() i=4 2024-03-04T12:34:59.448 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.441+0000 7fe51652b800 20 remove_watcher() i=5 2024-03-04T12:34:59.449 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.442+0000 7fe51652b800 20 remove_watcher() i=6 2024-03-04T12:34:59.449 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.443+0000 7fe51652b800 20 remove_watcher() i=7 2024-03-04T12:34:59.459 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:59.459 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:34:59.459 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: a-bucket id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-03-04T12:34:59.459 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:59.461 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-03-04T12:34:59.490 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:34:59.490 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:34:59.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.517+0000 7f1fcae8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.518+0000 7f1fcae8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.518+0000 7f1fcae8c800 20 realm 2024-03-04T12:34:59.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.518+0000 7f1fcae8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.518+0000 7f1fcae8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.518+0000 7f1fcae8c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:34:59.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.518+0000 7f1fcae8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.518+0000 7f1fcae8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.518+0000 7f1fcae8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.519+0000 7f1fcae8c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:59.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.519+0000 7f1fcae8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.520+0000 7f1fcae8c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:34:59.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.520+0000 7f1fcae8c800 20 searching for the correct realm 2024-03-04T12:34:59.530 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.524+0000 7f1fc9189640 0 -- 172.21.15.110:0/3561811870 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7f1fb4025040 msgr2=0x7f1fb40931a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:59.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.730+0000 7f1fc8988640 0 -- 172.21.15.110:0/3561811870 >> [v2:172.21.15.172:6800/824320839,v1:172.21.15.172:6801/824320839] conn(0x5581beaef710 msgr2=0x5581beaf1b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:59.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.733+0000 7f1fcae8c800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:34:59.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.733+0000 7f1fcae8c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:34:59.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.733+0000 7f1fcae8c800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:34:59.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.733+0000 7f1fcae8c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:34:59.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.733+0000 7f1fcae8c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:34:59.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.733+0000 7f1fcae8c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:34:59.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.733+0000 7f1fcae8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.733+0000 7f1fcae8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.733+0000 7f1fcae8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.733+0000 7f1fcae8c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:59.741 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.733+0000 7f1fcae8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.734+0000 7f1fcae8c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:34:59.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.734+0000 7f1fcae8c800 20 zone default found 2024-03-04T12:34:59.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.734+0000 7f1fcae8c800 4 Realm: () 2024-03-04T12:34:59.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.734+0000 7f1fcae8c800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:34:59.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.734+0000 7f1fcae8c800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:34:59.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.734+0000 7f1fcae8c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:34:59.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.734+0000 7f1fcae8c800 20 zonegroup default 2024-03-04T12:34:59.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.734+0000 7f1fcae8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.734+0000 7f1fcae8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.734+0000 7f1fcae8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.735+0000 7f1fcae8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.735+0000 7f1fcae8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.735+0000 7f1fcae8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.735+0000 7f1fcae8c800 20 started sync module instance, tier type = 2024-03-04T12:34:59.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.735+0000 7f1fcae8c800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:34:59.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.745+0000 7f1fcae8c800 20 add_watcher() i=0 2024-03-04T12:34:59.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.745+0000 7f1fcae8c800 20 add_watcher() i=1 2024-03-04T12:34:59.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.745+0000 7f1fcae8c800 20 add_watcher() i=2 2024-03-04T12:34:59.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.745+0000 7f1fcae8c800 20 add_watcher() i=3 2024-03-04T12:34:59.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.745+0000 7f1fcae8c800 20 add_watcher() i=4 2024-03-04T12:34:59.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.745+0000 7f1fcae8c800 20 add_watcher() i=5 2024-03-04T12:34:59.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.745+0000 7f1fcae8c800 20 add_watcher() i=6 2024-03-04T12:34:59.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.745+0000 7f1fcae8c800 20 add_watcher() i=7 2024-03-04T12:34:59.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.745+0000 7f1fcae8c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:34:59.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.747+0000 7f1e7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:59.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.748+0000 7f1fcae8c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:34:59.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.748+0000 7f1fcae8c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:34:59.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.748+0000 7f1fcae8c800 5 note: GC not initialized 2024-03-04T12:34:59.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.748+0000 7f1e7dfe3640 20 reqs_thread_entry: start 2024-03-04T12:34:59.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.748+0000 7f1fcae8c800 20 init_complete bucket index max shards: 11 2024-03-04T12:34:59.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.748+0000 7f1fcae8c800 20 Filter name: none 2024-03-04T12:34:59.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.748+0000 7f1def7fe640 20 reqs_thread_entry: start 2024-03-04T12:34:59.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.748+0000 7f1fcae8c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-04T12:34:59.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.748+0000 7f1fcae8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.749+0000 7f1fcae8c800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:34:59.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.749+0000 7f1fcae8c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-03-04T12:34:59.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.749+0000 7f1fcae8c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-04T12:34:59.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.749+0000 7f1fcae8c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 : miss 2024-03-04T12:34:59.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.749+0000 7f1fcae8c800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.749+0000 7f1fcae8c800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:34:59.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.749+0000 7f1fcae8c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:34:59.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.749+0000 7f1fcae8c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:34:59.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.749+0000 7f1fcae8c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:34:59.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.749+0000 7f1fcae8c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:34:59.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.749+0000 7f1fcae8c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 2024-03-04T12:34:59.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.751+0000 7f1e7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:59.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.753+0000 7f1fcae8c800 20 remove_watcher() i=0 2024-03-04T12:34:59.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.753+0000 7f1fcae8c800 2 removed watcher, disabling cache 2024-03-04T12:34:59.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.754+0000 7f1fcae8c800 20 remove_watcher() i=1 2024-03-04T12:34:59.762 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.755+0000 7f1fcae8c800 20 remove_watcher() i=2 2024-03-04T12:34:59.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.757+0000 7f1fcae8c800 20 remove_watcher() i=3 2024-03-04T12:34:59.764 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.758+0000 7f1fcae8c800 20 remove_watcher() i=4 2024-03-04T12:34:59.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.758+0000 7f1fcae8c800 20 remove_watcher() i=5 2024-03-04T12:34:59.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.759+0000 7f1fcae8c800 20 remove_watcher() i=6 2024-03-04T12:34:59.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.760+0000 7f1fcae8c800 20 remove_watcher() i=7 2024-03-04T12:34:59.777 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin reshard list 2024-03-04T12:34:59.802 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:34:59.802 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:34:59.835 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.828+0000 7f7269610800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.836 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.830+0000 7f7269610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.837 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.830+0000 7f7269610800 20 realm 2024-03-04T12:34:59.837 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.830+0000 7f7269610800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.837 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.830+0000 7f7269610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.837 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.830+0000 7f7269610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:34:59.837 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.830+0000 7f7269610800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.837 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.830+0000 7f7269610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.837 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.830+0000 7f7269610800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.831+0000 7f7269610800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:59.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.831+0000 7f7269610800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.831+0000 7f7269610800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:34:59.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.831+0000 7f7269610800 20 searching for the correct realm 2024-03-04T12:34:59.841 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.835+0000 7f72643ef640 0 -- 172.21.15.110:0/117029275 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x562857343250 msgr2=0x5628573456a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:59.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.838+0000 7f7264bf0640 0 -- 172.21.15.110:0/117029275 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f724c020430 msgr2=0x7f724c020890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:59.849 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.842+0000 7f7269610800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:34:59.849 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.842+0000 7f7269610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:34:59.849 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.842+0000 7f7269610800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:34:59.849 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.842+0000 7f7269610800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:34:59.850 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.842+0000 7f7269610800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:34:59.850 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.842+0000 7f7269610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:34:59.850 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.842+0000 7f7269610800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.850 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.843+0000 7f7269610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.850 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.843+0000 7f7269610800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.850 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.843+0000 7f7269610800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:59.850 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.843+0000 7f7269610800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.851 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.843+0000 7f7269610800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:34:59.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.843+0000 7f7269610800 20 zone default found 2024-03-04T12:34:59.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.843+0000 7f7269610800 4 Realm: () 2024-03-04T12:34:59.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.843+0000 7f7269610800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:34:59.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.843+0000 7f7269610800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:34:59.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.843+0000 7f7269610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:34:59.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.843+0000 7f7269610800 20 zonegroup default 2024-03-04T12:34:59.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.843+0000 7f7269610800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.844+0000 7f7269610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.844+0000 7f7269610800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.844+0000 7f7269610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.844+0000 7f7269610800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.844+0000 7f7269610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.853 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.844+0000 7f7269610800 20 started sync module instance, tier type = 2024-03-04T12:34:59.853 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.844+0000 7f7269610800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:34:59.860 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.853+0000 7f7269610800 20 add_watcher() i=0 2024-03-04T12:34:59.860 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.853+0000 7f7269610800 20 add_watcher() i=1 2024-03-04T12:34:59.860 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.853+0000 7f7269610800 20 add_watcher() i=2 2024-03-04T12:34:59.860 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.853+0000 7f7269610800 20 add_watcher() i=3 2024-03-04T12:34:59.860 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.853+0000 7f7269610800 20 add_watcher() i=4 2024-03-04T12:34:59.860 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.853+0000 7f7269610800 20 add_watcher() i=5 2024-03-04T12:34:59.860 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.853+0000 7f7269610800 20 add_watcher() i=6 2024-03-04T12:34:59.861 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.854+0000 7f7269610800 20 add_watcher() i=7 2024-03-04T12:34:59.861 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.854+0000 7f7269610800 2 all 8 watchers are set, enabling cache 2024-03-04T12:34:59.862 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.856+0000 7f711afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:59.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.856+0000 7f7269610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:34:59.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.856+0000 7f7269610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:34:59.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.856+0000 7f7269610800 5 note: GC not initialized 2024-03-04T12:34:59.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.856+0000 7f7119fe3640 20 reqs_thread_entry: start 2024-03-04T12:34:59.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.856+0000 7f7269610800 20 init_complete bucket index max shards: 11 2024-03-04T12:34:59.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.856+0000 7f7269610800 20 Filter name: none 2024-03-04T12:34:59.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.857+0000 7f708b7fe640 20 reqs_thread_entry: start 2024-03-04T12:34:59.869 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.863+0000 7f711afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:59.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.865+0000 7f7269610800 20 remove_watcher() i=0 2024-03-04T12:34:59.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.865+0000 7f7269610800 2 removed watcher, disabling cache 2024-03-04T12:34:59.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.866+0000 7f7269610800 20 remove_watcher() i=1 2024-03-04T12:34:59.874 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.867+0000 7f7269610800 20 remove_watcher() i=2 2024-03-04T12:34:59.875 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.868+0000 7f7269610800 20 remove_watcher() i=3 2024-03-04T12:34:59.875 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.869+0000 7f7269610800 20 remove_watcher() i=4 2024-03-04T12:34:59.876 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.870+0000 7f7269610800 20 remove_watcher() i=5 2024-03-04T12:34:59.877 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.871+0000 7f7269610800 20 remove_watcher() i=6 2024-03-04T12:34:59.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.872+0000 7f7269610800 20 remove_watcher() i=7 2024-03-04T12:34:59.888 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: reshard process non empty bucket 2024-03-04T12:34:59.888 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:34:59.889 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin reshard process 2024-03-04T12:34:59.914 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:34:59.915 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:34:59.948 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.941+0000 7f7ec1230800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.949 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.942+0000 7f7ec1230800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.949 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.942+0000 7f7ec1230800 20 realm 2024-03-04T12:34:59.949 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.942+0000 7f7ec1230800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.942+0000 7f7ec1230800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.942+0000 7f7ec1230800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:34:59.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.942+0000 7f7ec1230800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.943+0000 7f7ec1230800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.943+0000 7f7ec1230800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.951 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.943+0000 7f7ec1230800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:59.951 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.943+0000 7f7ec1230800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.951 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.944+0000 7f7ec1230800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:34:59.951 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.944+0000 7f7ec1230800 20 searching for the correct realm 2024-03-04T12:34:59.953 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.947+0000 7f7ebbd2f640 0 -- 172.21.15.110:0/5871287 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x55774c7f5f90 msgr2=0x55774c7f8430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:34:59.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.950+0000 7f7ebc530640 0 -- 172.21.15.110:0/5871287 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f7eb00832e0 msgr2=0x7f7eb003b9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:34:59.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.955+0000 7f7ec1230800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:34:59.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.955+0000 7f7ec1230800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:34:59.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.955+0000 7f7ec1230800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:34:59.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.955+0000 7f7ec1230800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:34:59.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.955+0000 7f7ec1230800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:34:59.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.955+0000 7f7ec1230800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:34:59.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.955+0000 7f7ec1230800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.963 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.955+0000 7f7ec1230800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.955+0000 7f7ec1230800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.955+0000 7f7ec1230800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:34:59.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.955+0000 7f7ec1230800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.956+0000 7f7ec1230800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:34:59.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.956+0000 7f7ec1230800 20 zone default found 2024-03-04T12:34:59.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.956+0000 7f7ec1230800 4 Realm: () 2024-03-04T12:34:59.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.956+0000 7f7ec1230800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:34:59.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.956+0000 7f7ec1230800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:34:59.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.956+0000 7f7ec1230800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:34:59.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.956+0000 7f7ec1230800 20 zonegroup default 2024-03-04T12:34:59.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.956+0000 7f7ec1230800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.956+0000 7f7ec1230800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.956+0000 7f7ec1230800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.964 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.956+0000 7f7ec1230800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.965 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.956+0000 7f7ec1230800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.965 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.956+0000 7f7ec1230800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:34:59.965 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.956+0000 7f7ec1230800 20 started sync module instance, tier type = 2024-03-04T12:34:59.965 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.956+0000 7f7ec1230800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:34:59.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.965+0000 7f7ec1230800 20 add_watcher() i=0 2024-03-04T12:34:59.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.965+0000 7f7ec1230800 20 add_watcher() i=1 2024-03-04T12:34:59.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.965+0000 7f7ec1230800 20 add_watcher() i=2 2024-03-04T12:34:59.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.965+0000 7f7ec1230800 20 add_watcher() i=3 2024-03-04T12:34:59.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.965+0000 7f7ec1230800 20 add_watcher() i=4 2024-03-04T12:34:59.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.965+0000 7f7ec1230800 20 add_watcher() i=5 2024-03-04T12:34:59.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.965+0000 7f7ec1230800 20 add_watcher() i=6 2024-03-04T12:34:59.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.966+0000 7f7ec1230800 20 add_watcher() i=7 2024-03-04T12:34:59.973 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.966+0000 7f7ec1230800 2 all 8 watchers are set, enabling cache 2024-03-04T12:34:59.976 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.969+0000 7f7d72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:34:59.976 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.969+0000 7f7ec1230800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:34:59.976 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.969+0000 7f7ec1230800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:34:59.976 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.969+0000 7f7ec1230800 5 note: GC not initialized 2024-03-04T12:34:59.976 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.970+0000 7f7d71fdb640 20 reqs_thread_entry: start 2024-03-04T12:34:59.977 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.970+0000 7f7ec1230800 20 init_complete bucket index max shards: 11 2024-03-04T12:34:59.977 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.970+0000 7f7ec1230800 20 Filter name: none 2024-03-04T12:34:59.977 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.970+0000 7f7ce37fe640 20 reqs_thread_entry: start 2024-03-04T12:34:59.977 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.970+0000 7f7ec1230800 20 processing logshard = reshard.0000000000 2024-03-04T12:34:59.979 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.972+0000 7f7ec1230800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-03-04T12:34:59.979 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.972+0000 7f7ec1230800 20 processing logshard = reshard.0000000001 2024-03-04T12:34:59.981 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.975+0000 7f7ec1230800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-03-04T12:34:59.981 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.975+0000 7f7ec1230800 20 processing logshard = reshard.0000000002 2024-03-04T12:34:59.983 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.977+0000 7f7ec1230800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-03-04T12:34:59.983 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.977+0000 7f7ec1230800 20 processing logshard = reshard.0000000003 2024-03-04T12:34:59.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.979+0000 7f7ec1230800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-03-04T12:34:59.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.979+0000 7f7ec1230800 20 processing logshard = reshard.0000000004 2024-03-04T12:34:59.988 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.982+0000 7f7ec1230800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-03-04T12:34:59.988 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.982+0000 7f7ec1230800 20 processing logshard = reshard.0000000005 2024-03-04T12:34:59.990 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.984+0000 7f7ec1230800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-03-04T12:34:59.990 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.984+0000 7f7ec1230800 20 processing logshard = reshard.0000000006 2024-03-04T12:34:59.992 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.986+0000 7f7ec1230800 20 process_entry resharding a-bucket 2024-03-04T12:34:59.992 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.986+0000 7f7ec1230800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-04T12:34:59.992 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.986+0000 7f7ec1230800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.992 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.986+0000 7f7ec1230800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:34:59.993 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.986+0000 7f7ec1230800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-03-04T12:34:59.993 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.986+0000 7f7ec1230800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-04T12:34:59.993 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.986+0000 7f7ec1230800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 : miss 2024-03-04T12:34:59.993 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.986+0000 7f7ec1230800 20 rados->read ofs=0 len=0 2024-03-04T12:34:59.993 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.986+0000 7f7ec1230800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:34:59.993 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.986+0000 7f7ec1230800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:34:59.993 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.986+0000 7f7ec1230800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:34:59.994 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.986+0000 7f7ec1230800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:34:59.994 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.986+0000 7f7ec1230800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:34:59.994 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.986+0000 7f7ec1230800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 2024-03-04T12:34:59.999 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.993+0000 7f7ec1230800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:34:59.999 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.993+0000 7f7ec1230800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:34:59.999 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.993+0000 7f7ec1230800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:34:59.999 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.993+0000 7f7ec1230800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18, ofs0, ns] 2024-03-04T12:35:00.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.993+0000 7f7d937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824018 cookie 93970872902384 notifier 6183 bl.length()=861 2024-03-04T12:35:00.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.993+0000 7f7d937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:35:00.000 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.993+0000 7f7d937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:35:00.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.993+0000 7f7d937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:35:00.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.995+0000 7f7ec1230800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): orig_sources= new_sources= 2024-03-04T12:35:00.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.995+0000 7f7ec1230800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): potential sources added=[] removed=[] 2024-03-04T12:35:00.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.995+0000 7f7ec1230800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): orig_dests= new_dests= 2024-03-04T12:35:00.001 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.995+0000 7f7ec1230800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): potential dests added=[] removed=[] 2024-03-04T12:35:00.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.0 2024-03-04T12:35:00.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.0 2024-03-04T12:35:00.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.1 2024-03-04T12:35:00.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.1 2024-03-04T12:35:00.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.2 2024-03-04T12:35:00.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.2 2024-03-04T12:35:00.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.3 2024-03-04T12:35:00.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.3 2024-03-04T12:35:00.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.4 2024-03-04T12:35:00.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.4 2024-03-04T12:35:00.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.5 2024-03-04T12:35:00.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.5 2024-03-04T12:35:00.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.6 2024-03-04T12:35:00.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.6 2024-03-04T12:35:00.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.7 2024-03-04T12:35:00.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.7 2024-03-04T12:35:00.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.8 2024-03-04T12:35:00.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.8 2024-03-04T12:35:00.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.9 2024-03-04T12:35:00.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.9 2024-03-04T12:35:00.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.10 2024-03-04T12:35:00.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.10 2024-03-04T12:35:00.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.11 2024-03-04T12:35:00.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.11 2024-03-04T12:35:00.006 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.12 2024-03-04T12:35:00.006 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.12 2024-03-04T12:35:00.006 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.0 2024-03-04T12:35:00.006 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.0 2024-03-04T12:35:00.006 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.1 2024-03-04T12:35:00.006 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.997+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.1 2024-03-04T12:35:00.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.998+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.2 2024-03-04T12:35:00.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.998+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.2 2024-03-04T12:35:00.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.998+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.3 2024-03-04T12:35:00.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.998+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.3 2024-03-04T12:35:00.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.999+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.4 2024-03-04T12:35:00.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.999+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.4 2024-03-04T12:35:00.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.999+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.5 2024-03-04T12:35:00.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:34:59.999+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.5 2024-03-04T12:35:00.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.000+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.6 2024-03-04T12:35:00.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.000+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.6 2024-03-04T12:35:00.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.000+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.7 2024-03-04T12:35:00.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.000+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.7 2024-03-04T12:35:00.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.000+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.8 2024-03-04T12:35:00.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.000+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.8 2024-03-04T12:35:00.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.001+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.9 2024-03-04T12:35:00.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.001+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.9 2024-03-04T12:35:00.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.001+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.10 2024-03-04T12:35:00.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.001+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.10 2024-03-04T12:35:00.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.001+0000 7f7ec1230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.11 2024-03-04T12:35:00.009 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.001+0000 7f7ec1230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.1.11 2024-03-04T12:35:00.010 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.004+0000 7f7ec1230800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 : hit (requested=0x17, cached=0x17) 2024-03-04T12:35:00.010 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.004+0000 7f7ec1230800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 2024-03-04T12:35:00.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.005+0000 7f7ec1230800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:35:00.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.005+0000 7f7ec1230800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:35:00.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.005+0000 7f7ec1230800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:35:00.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.005+0000 7f7ec1230800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18, ofs0, ns] 2024-03-04T12:35:00.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.005+0000 7f7d92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824019 cookie 93970872902384 notifier 6183 bl.length()=829 2024-03-04T12:35:00.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.005+0000 7f7d92ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:35:00.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.005+0000 7f7d92ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:35:00.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.005+0000 7f7d92ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:35:00.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.007+0000 7f7ec1230800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): orig_sources= new_sources= 2024-03-04T12:35:00.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.007+0000 7f7ec1230800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): potential sources added=[] removed=[] 2024-03-04T12:35:00.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.007+0000 7f7ec1230800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): orig_dests= new_dests= 2024-03-04T12:35:00.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.007+0000 7f7ec1230800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): potential dests added=[] removed=[] 2024-03-04T12:35:00.016 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.009+0000 7f7ec1230800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-03-04T12:35:00.017 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.010+0000 7f7ec1230800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-03-04T12:35:00.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.013+0000 7f7ec1230800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-03-04T12:35:00.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.013+0000 7f7ec1230800 20 processing logshard = reshard.0000000007 2024-03-04T12:35:00.021 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.015+0000 7f7ec1230800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-03-04T12:35:00.021 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.015+0000 7f7ec1230800 20 processing logshard = reshard.0000000008 2024-03-04T12:35:00.023 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.017+0000 7f7ec1230800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-03-04T12:35:00.023 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.017+0000 7f7ec1230800 20 processing logshard = reshard.0000000009 2024-03-04T12:35:00.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.019+0000 7f7ec1230800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-03-04T12:35:00.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.019+0000 7f7ec1230800 20 processing logshard = reshard.0000000010 2024-03-04T12:35:00.027 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.021+0000 7f7ec1230800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-03-04T12:35:00.027 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.021+0000 7f7ec1230800 20 processing logshard = reshard.0000000011 2024-03-04T12:35:00.030 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.024+0000 7f7ec1230800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-03-04T12:35:00.030 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.024+0000 7f7ec1230800 20 processing logshard = reshard.0000000012 2024-03-04T12:35:00.032 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.026+0000 7f7ec1230800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-03-04T12:35:00.032 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.026+0000 7f7ec1230800 20 processing logshard = reshard.0000000013 2024-03-04T12:35:00.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.028+0000 7f7ec1230800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-03-04T12:35:00.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.028+0000 7f7ec1230800 20 processing logshard = reshard.0000000014 2024-03-04T12:35:00.037 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.030+0000 7f7ec1230800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-03-04T12:35:00.037 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.030+0000 7f7ec1230800 20 processing logshard = reshard.0000000015 2024-03-04T12:35:00.039 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.033+0000 7f7ec1230800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-03-04T12:35:00.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.034+0000 7f7d72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:00.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.036+0000 7f7ec1230800 20 remove_watcher() i=0 2024-03-04T12:35:00.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.036+0000 7f7ec1230800 2 removed watcher, disabling cache 2024-03-04T12:35:00.043 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.036+0000 7f7ec1230800 20 remove_watcher() i=1 2024-03-04T12:35:00.044 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.037+0000 7f7ec1230800 20 remove_watcher() i=2 2024-03-04T12:35:00.045 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.038+0000 7f7ec1230800 20 remove_watcher() i=3 2024-03-04T12:35:00.046 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.039+0000 7f7ec1230800 20 remove_watcher() i=4 2024-03-04T12:35:00.046 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.040+0000 7f7ec1230800 20 remove_watcher() i=5 2024-03-04T12:35:00.047 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.041+0000 7f7ec1230800 20 remove_watcher() i=6 2024-03-04T12:35:00.048 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.042+0000 7f7ec1230800 20 remove_watcher() i=7 2024-03-04T12:35:00.059 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-04T12:35:00.087 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:00.087 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:00.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.113+0000 7f6e10daf800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.114+0000 7f6e10daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:00.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.114+0000 7f6e10daf800 20 realm 2024-03-04T12:35:00.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.114+0000 7f6e10daf800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.115+0000 7f6e10daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:00.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.115+0000 7f6e10daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:00.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.115+0000 7f6e10daf800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.115+0000 7f6e10daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:00.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.115+0000 7f6e10daf800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.116+0000 7f6e10daf800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:00.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.116+0000 7f6e10daf800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.116+0000 7f6e10daf800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:00.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.116+0000 7f6e10daf800 20 searching for the correct realm 2024-03-04T12:35:00.125 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.119+0000 7f6e07fff640 0 -- 172.21.15.110:0/922738676 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x555ff3891010 msgr2=0x555ff3893400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:00.129 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.123+0000 7f6e0e8ab640 0 -- 172.21.15.110:0/922738676 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f6df805c860 msgr2=0x7f6df80364a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:00.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.126+0000 7f6e10daf800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:00.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.126+0000 7f6e10daf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:00.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.126+0000 7f6e10daf800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:00.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.126+0000 7f6e10daf800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:00.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.126+0000 7f6e10daf800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:00.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.126+0000 7f6e10daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:00.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.126+0000 7f6e10daf800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.127+0000 7f6e10daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:00.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.127+0000 7f6e10daf800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.127+0000 7f6e10daf800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:00.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.127+0000 7f6e10daf800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.135 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.127+0000 7f6e10daf800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:00.135 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.127+0000 7f6e10daf800 20 zone default found 2024-03-04T12:35:00.135 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.127+0000 7f6e10daf800 4 Realm: () 2024-03-04T12:35:00.135 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.127+0000 7f6e10daf800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:00.135 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.127+0000 7f6e10daf800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:00.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.127+0000 7f6e10daf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:00.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.127+0000 7f6e10daf800 20 zonegroup default 2024-03-04T12:35:00.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.127+0000 7f6e10daf800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.127+0000 7f6e10daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:00.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.128+0000 7f6e10daf800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.128+0000 7f6e10daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:00.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.128+0000 7f6e10daf800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.128+0000 7f6e10daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:00.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.128+0000 7f6e10daf800 20 started sync module instance, tier type = 2024-03-04T12:35:00.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.128+0000 7f6e10daf800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:00.143 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.137+0000 7f6e10daf800 20 add_watcher() i=0 2024-03-04T12:35:00.143 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.137+0000 7f6e10daf800 20 add_watcher() i=1 2024-03-04T12:35:00.143 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.137+0000 7f6e10daf800 20 add_watcher() i=2 2024-03-04T12:35:00.143 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.137+0000 7f6e10daf800 20 add_watcher() i=3 2024-03-04T12:35:00.143 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.137+0000 7f6e10daf800 20 add_watcher() i=4 2024-03-04T12:35:00.144 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.137+0000 7f6e10daf800 20 add_watcher() i=5 2024-03-04T12:35:00.144 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.137+0000 7f6e10daf800 20 add_watcher() i=6 2024-03-04T12:35:00.144 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.138+0000 7f6e10daf800 20 add_watcher() i=7 2024-03-04T12:35:00.144 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.138+0000 7f6e10daf800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:00.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.139+0000 7f6cc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:00.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.139+0000 7f6e10daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:00.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.139+0000 7f6e10daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:00.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.140+0000 7f6e10daf800 5 note: GC not initialized 2024-03-04T12:35:00.147 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.140+0000 7f6c3ffff640 20 reqs_thread_entry: start 2024-03-04T12:35:00.147 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.140+0000 7f6e10daf800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:00.147 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.140+0000 7f6e10daf800 20 Filter name: none 2024-03-04T12:35:00.147 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.140+0000 7f6c3dffb640 20 reqs_thread_entry: start 2024-03-04T12:35:00.147 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.140+0000 7f6e10daf800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.140+0000 7f6e10daf800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:35:00.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.140+0000 7f6e10daf800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.141+0000 7f6e10daf800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:35:00.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.141+0000 7f6e10daf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:00.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.141+0000 7f6e10daf800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.141+0000 7f6e10daf800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:35:00.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.141+0000 7f6e10daf800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.142+0000 7f6e10daf800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:35:00.149 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.142+0000 7f6e10daf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:00.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.143+0000 7f6e10daf800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.143+0000 7f6e10daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:00.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.144+0000 7f6cc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:00.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.146+0000 7f6e10daf800 20 remove_watcher() i=0 2024-03-04T12:35:00.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.146+0000 7f6e10daf800 2 removed watcher, disabling cache 2024-03-04T12:35:00.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.147+0000 7f6e10daf800 20 remove_watcher() i=1 2024-03-04T12:35:00.154 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.148+0000 7f6e10daf800 20 remove_watcher() i=2 2024-03-04T12:35:00.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.149+0000 7f6e10daf800 20 remove_watcher() i=3 2024-03-04T12:35:00.156 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.150+0000 7f6e10daf800 20 remove_watcher() i=4 2024-03-04T12:35:00.157 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.151+0000 7f6e10daf800 20 remove_watcher() i=5 2024-03-04T12:35:00.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.152+0000 7f6e10daf800 20 remove_watcher() i=6 2024-03-04T12:35:00.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.153+0000 7f6e10daf800 20 remove_watcher() i=7 2024-03-04T12:35:00.169 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:00.169 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:35:00.169 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: a-bucket id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-03-04T12:35:00.169 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:00.169 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-03-04T12:35:00.169 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:00.171 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.171 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.218 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.218 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.275 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.275 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.304 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.304 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.333 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.333 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.362 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.362 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.389 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.389 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.417 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.418 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.446 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.446 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.474 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.474 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.502 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.502 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.530 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.530 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.558 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.558 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.585 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.586 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.613 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.613 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.641 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.641 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.670 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.670 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.698 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.698 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.726 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.727 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.755 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.755 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.782 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.783 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.810 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:00.810 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:00.838 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-04T12:35:00.866 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:00.866 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:00.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.892+0000 7fb79880f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.893+0000 7fb79880f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:00.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.893+0000 7fb79880f800 20 realm 2024-03-04T12:35:00.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.893+0000 7fb79880f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.893+0000 7fb79880f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:00.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.893+0000 7fb79880f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:00.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.893+0000 7fb79880f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.894+0000 7fb79880f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:00.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.894+0000 7fb79880f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.894+0000 7fb79880f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:00.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.894+0000 7fb79880f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.895+0000 7fb79880f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:00.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.895+0000 7fb79880f800 20 searching for the correct realm 2024-03-04T12:35:00.904 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.898+0000 7fb78bfff640 0 -- 172.21.15.110:0/2948328818 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7fb784066070 msgr2=0x7fb78407f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:00.908 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.901+0000 7fb794682640 0 -- 172.21.15.110:0/2948328818 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7fb77c040b70 msgr2=0x7fb77c05c9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:00.911 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:00.911 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:00.911 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:00.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:00.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:00.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:00.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:00.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:00.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.913 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:00.913 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 20 zone default found 2024-03-04T12:35:00.913 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 4 Realm: () 2024-03-04T12:35:00.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:00.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:00.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:00.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 20 zonegroup default 2024-03-04T12:35:00.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.905+0000 7fb79880f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.906+0000 7fb79880f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:00.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.906+0000 7fb79880f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.906+0000 7fb79880f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:00.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.906+0000 7fb79880f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.906+0000 7fb79880f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:00.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.906+0000 7fb79880f800 20 started sync module instance, tier type = 2024-03-04T12:35:00.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.906+0000 7fb79880f800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:00.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.914+0000 7fb79880f800 20 add_watcher() i=0 2024-03-04T12:35:00.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.914+0000 7fb79880f800 20 add_watcher() i=1 2024-03-04T12:35:00.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.914+0000 7fb79880f800 20 add_watcher() i=2 2024-03-04T12:35:00.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.914+0000 7fb79880f800 20 add_watcher() i=3 2024-03-04T12:35:00.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.914+0000 7fb79880f800 20 add_watcher() i=4 2024-03-04T12:35:00.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.914+0000 7fb79880f800 20 add_watcher() i=5 2024-03-04T12:35:00.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.914+0000 7fb79880f800 20 add_watcher() i=6 2024-03-04T12:35:00.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.915+0000 7fb79880f800 20 add_watcher() i=7 2024-03-04T12:35:00.922 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.915+0000 7fb79880f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:00.923 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.917+0000 7fb649fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:00.924 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.917+0000 7fb79880f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:00.924 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.917+0000 7fb79880f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:00.924 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.917+0000 7fb79880f800 5 note: GC not initialized 2024-03-04T12:35:00.924 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.917+0000 7fb648fe1640 20 reqs_thread_entry: start 2024-03-04T12:35:00.924 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.917+0000 7fb79880f800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:00.924 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.917+0000 7fb79880f800 20 Filter name: none 2024-03-04T12:35:00.924 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.918+0000 7fb5c27fc640 20 reqs_thread_entry: start 2024-03-04T12:35:00.924 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.918+0000 7fb79880f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.926 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.918+0000 7fb79880f800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:00.926 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.918+0000 7fb79880f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.926 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.919+0000 7fb79880f800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:00.926 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.919+0000 7fb79880f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:00.926 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.919+0000 7fb79880f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.926 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.919+0000 7fb79880f800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:00.926 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.919+0000 7fb79880f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.926 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.919+0000 7fb79880f800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:00.926 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.919+0000 7fb79880f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:00.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.920+0000 7fb79880f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:00.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.920+0000 7fb79880f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:00.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.921+0000 7fb649fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:00.929 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.923+0000 7fb79880f800 20 remove_watcher() i=0 2024-03-04T12:35:00.929 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.923+0000 7fb79880f800 2 removed watcher, disabling cache 2024-03-04T12:35:00.930 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.924+0000 7fb79880f800 20 remove_watcher() i=1 2024-03-04T12:35:00.931 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.925+0000 7fb79880f800 20 remove_watcher() i=2 2024-03-04T12:35:00.932 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.926+0000 7fb79880f800 20 remove_watcher() i=3 2024-03-04T12:35:00.933 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.927+0000 7fb79880f800 20 remove_watcher() i=4 2024-03-04T12:35:00.934 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.928+0000 7fb79880f800 20 remove_watcher() i=5 2024-03-04T12:35:00.935 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.929+0000 7fb79880f800 20 remove_watcher() i=6 2024-03-04T12:35:00.936 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:00.930+0000 7fb79880f800 20 remove_watcher() i=7 2024-03-04T12:35:00.946 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:00.946 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:35:00.946 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: error-at-set-target-layout id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:35:00.946 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:00.947 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-03-04T12:35:00.980 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:00.980 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:01.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.007+0000 7f67ac812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.008+0000 7f67ac812800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.008+0000 7f67ac812800 20 realm 2024-03-04T12:35:01.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.008+0000 7f67ac812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.008+0000 7f67ac812800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.008+0000 7f67ac812800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:01.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.008+0000 7f67ac812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.008+0000 7f67ac812800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.008+0000 7f67ac812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.016 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.009+0000 7f67ac812800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:01.016 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.009+0000 7f67ac812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.016 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.009+0000 7f67ac812800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:01.016 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.009+0000 7f67ac812800 20 searching for the correct realm 2024-03-04T12:35:01.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.012+0000 7f67a85f1640 0 -- 172.21.15.110:0/3651074931 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f679005ecf0 msgr2=0x7f679005d950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:01.022 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.015+0000 7f67a7df0640 0 -- 172.21.15.110:0/3651074931 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f6790066c60 msgr2=0x7f67900729a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:01.228 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.221+0000 7f67ac812800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:01.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.221+0000 7f67ac812800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:01.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.221+0000 7f67ac812800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:01.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.221+0000 7f67ac812800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:01.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.221+0000 7f67ac812800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:01.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.221+0000 7f67ac812800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:01.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.221+0000 7f67ac812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.221+0000 7f67ac812800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.221+0000 7f67ac812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.221+0000 7f67ac812800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:01.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.221+0000 7f67ac812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.222+0000 7f67ac812800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:01.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.222+0000 7f67ac812800 20 zone default found 2024-03-04T12:35:01.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.222+0000 7f67ac812800 4 Realm: () 2024-03-04T12:35:01.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.222+0000 7f67ac812800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:01.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.222+0000 7f67ac812800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:01.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.222+0000 7f67ac812800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:01.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.222+0000 7f67ac812800 20 zonegroup default 2024-03-04T12:35:01.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.222+0000 7f67ac812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.222+0000 7f67ac812800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.222+0000 7f67ac812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.222+0000 7f67ac812800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.222+0000 7f67ac812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.231 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.222+0000 7f67ac812800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.231 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.222+0000 7f67ac812800 20 started sync module instance, tier type = 2024-03-04T12:35:01.231 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.222+0000 7f67ac812800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:01.238 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.232+0000 7f67ac812800 20 add_watcher() i=0 2024-03-04T12:35:01.239 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.232+0000 7f67ac812800 20 add_watcher() i=1 2024-03-04T12:35:01.239 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.232+0000 7f67ac812800 20 add_watcher() i=2 2024-03-04T12:35:01.239 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.232+0000 7f67ac812800 20 add_watcher() i=3 2024-03-04T12:35:01.239 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.232+0000 7f67ac812800 20 add_watcher() i=4 2024-03-04T12:35:01.239 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.232+0000 7f67ac812800 20 add_watcher() i=5 2024-03-04T12:35:01.239 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.232+0000 7f67ac812800 20 add_watcher() i=6 2024-03-04T12:35:01.239 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.233+0000 7f67ac812800 20 add_watcher() i=7 2024-03-04T12:35:01.240 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.233+0000 7f67ac812800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:01.241 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.234+0000 7f665dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:01.242 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.235+0000 7f67ac812800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:01.242 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.235+0000 7f67ac812800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:01.242 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.235+0000 7f67ac812800 5 note: GC not initialized 2024-03-04T12:35:01.242 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.235+0000 7f665cfe1640 20 reqs_thread_entry: start 2024-03-04T12:35:01.242 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.235+0000 7f67ac812800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:01.242 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.235+0000 7f67ac812800 20 Filter name: none 2024-03-04T12:35:01.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.235+0000 7f65d67fc640 20 reqs_thread_entry: start 2024-03-04T12:35:01.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.235+0000 7f67ac812800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-03-04T12:35:01.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.235+0000 7f67ac812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.236+0000 7f67ac812800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:01.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.236+0000 7f67ac812800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-03-04T12:35:01.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.236+0000 7f67ac812800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-03-04T12:35:01.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.236+0000 7f67ac812800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 : miss 2024-03-04T12:35:01.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.236+0000 7f67ac812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.236+0000 7f67ac812800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:01.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.236+0000 7f67ac812800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 info.flags=0x17 2024-03-04T12:35:01.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.236+0000 7f67ac812800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 to cache LRU end 2024-03-04T12:35:01.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.236+0000 7f67ac812800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:35:01.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.236+0000 7f67ac812800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:01.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.236+0000 7f67ac812800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 2024-03-04T12:35:01.246 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.240+0000 7f67ac812800 -1 Injecting error=-5 at location=set_target_layout 2024-03-04T12:35:01.246 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.240+0000 7f67ac812800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-03-04T12:35:01.252 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.245+0000 7f665dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:01.253 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.247+0000 7f67ac812800 20 remove_watcher() i=0 2024-03-04T12:35:01.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.247+0000 7f67ac812800 2 removed watcher, disabling cache 2024-03-04T12:35:01.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.248+0000 7f67ac812800 20 remove_watcher() i=1 2024-03-04T12:35:01.255 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.249+0000 7f67ac812800 20 remove_watcher() i=2 2024-03-04T12:35:01.256 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.250+0000 7f67ac812800 20 remove_watcher() i=3 2024-03-04T12:35:01.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.251+0000 7f67ac812800 20 remove_watcher() i=4 2024-03-04T12:35:01.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.252+0000 7f67ac812800 20 remove_watcher() i=5 2024-03-04T12:35:01.259 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.253+0000 7f67ac812800 20 remove_watcher() i=6 2024-03-04T12:35:01.260 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.254+0000 7f67ac812800 20 remove_watcher() i=7 2024-03-04T12:35:01.271 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-04T12:35:01.298 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:01.299 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:01.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.326+0000 7fef36d30800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.327+0000 7fef36d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.327+0000 7fef36d30800 20 realm 2024-03-04T12:35:01.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.327+0000 7fef36d30800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.328+0000 7fef36d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.328+0000 7fef36d30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:01.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.328+0000 7fef36d30800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.328+0000 7fef36d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.328+0000 7fef36d30800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.329+0000 7fef36d30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:01.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.329+0000 7fef36d30800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.329+0000 7fef36d30800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:01.336 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.329+0000 7fef36d30800 20 searching for the correct realm 2024-03-04T12:35:01.336 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.330+0000 7fef2a2c1640 0 -- 172.21.15.110:0/943576641 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x564bea4eb540 msgr2=0x564bea4ed9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:01.339 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.332+0000 7fef332c3640 0 -- 172.21.15.110:0/943576641 >> [v2:172.21.15.110:6824/3005097257,v1:172.21.15.110:6825/3005097257] conn(0x564bea4e2210 msgr2=0x564bea4e4690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:01.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.339+0000 7fef36d30800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:01.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.339+0000 7fef36d30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:01.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.339+0000 7fef36d30800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:01.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.339+0000 7fef36d30800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:01.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.339+0000 7fef36d30800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:01.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.339+0000 7fef36d30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:01.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.339+0000 7fef36d30800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.339+0000 7fef36d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.339+0000 7fef36d30800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.340+0000 7fef36d30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:01.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.340+0000 7fef36d30800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.340+0000 7fef36d30800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:01.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.340+0000 7fef36d30800 20 zone default found 2024-03-04T12:35:01.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.340+0000 7fef36d30800 4 Realm: () 2024-03-04T12:35:01.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.340+0000 7fef36d30800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:01.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.340+0000 7fef36d30800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:01.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.340+0000 7fef36d30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:01.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.340+0000 7fef36d30800 20 zonegroup default 2024-03-04T12:35:01.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.340+0000 7fef36d30800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.340+0000 7fef36d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.340+0000 7fef36d30800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.341+0000 7fef36d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.341+0000 7fef36d30800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.341+0000 7fef36d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.341+0000 7fef36d30800 20 started sync module instance, tier type = 2024-03-04T12:35:01.349 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.341+0000 7fef36d30800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:01.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.349+0000 7fef36d30800 20 add_watcher() i=0 2024-03-04T12:35:01.355 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.349+0000 7fef36d30800 20 add_watcher() i=1 2024-03-04T12:35:01.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.349+0000 7fef36d30800 20 add_watcher() i=2 2024-03-04T12:35:01.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.349+0000 7fef36d30800 20 add_watcher() i=3 2024-03-04T12:35:01.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.349+0000 7fef36d30800 20 add_watcher() i=4 2024-03-04T12:35:01.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.349+0000 7fef36d30800 20 add_watcher() i=5 2024-03-04T12:35:01.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.349+0000 7fef36d30800 20 add_watcher() i=6 2024-03-04T12:35:01.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.350+0000 7fef36d30800 20 add_watcher() i=7 2024-03-04T12:35:01.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.350+0000 7fef36d30800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:01.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.351+0000 7fede97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:01.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.352+0000 7fef36d30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:01.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.352+0000 7fef36d30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:01.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.352+0000 7fef36d30800 5 note: GC not initialized 2024-03-04T12:35:01.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.352+0000 7fed63fff640 20 reqs_thread_entry: start 2024-03-04T12:35:01.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.352+0000 7fef36d30800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:01.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.352+0000 7fef36d30800 20 Filter name: none 2024-03-04T12:35:01.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.352+0000 7fed61ffb640 20 reqs_thread_entry: start 2024-03-04T12:35:01.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.352+0000 7fef36d30800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.353+0000 7fef36d30800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:01.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.353+0000 7fef36d30800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.360 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.353+0000 7fef36d30800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:01.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.353+0000 7fef36d30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:01.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.353+0000 7fef36d30800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.354+0000 7fef36d30800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:01.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.354+0000 7fef36d30800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.354+0000 7fef36d30800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:01.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.354+0000 7fef36d30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:01.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.355+0000 7fef36d30800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.355+0000 7fef36d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.356+0000 7fede97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:01.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.358+0000 7fef36d30800 20 remove_watcher() i=0 2024-03-04T12:35:01.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.358+0000 7fef36d30800 2 removed watcher, disabling cache 2024-03-04T12:35:01.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.359+0000 7fef36d30800 20 remove_watcher() i=1 2024-03-04T12:35:01.366 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.360+0000 7fef36d30800 20 remove_watcher() i=2 2024-03-04T12:35:01.367 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.361+0000 7fef36d30800 20 remove_watcher() i=3 2024-03-04T12:35:01.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.362+0000 7fef36d30800 20 remove_watcher() i=4 2024-03-04T12:35:01.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.363+0000 7fef36d30800 20 remove_watcher() i=5 2024-03-04T12:35:01.370 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.364+0000 7fef36d30800 20 remove_watcher() i=6 2024-03-04T12:35:01.371 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.365+0000 7fef36d30800 20 remove_watcher() i=7 2024-03-04T12:35:01.380 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:01.381 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:35:01.381 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: error-at-set-target-layout id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:35:01.381 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:01.383 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:01.383 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:01.408 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:01.409 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:01.464 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:35:01.494 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:01.494 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:01.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.520+0000 7f3f2a230800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.521+0000 7f3f2a230800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.521+0000 7f3f2a230800 20 realm 2024-03-04T12:35:01.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.521+0000 7f3f2a230800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.521+0000 7f3f2a230800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.521+0000 7f3f2a230800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:01.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.521+0000 7f3f2a230800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.521+0000 7f3f2a230800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.528 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.521+0000 7f3f2a230800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.522+0000 7f3f2a230800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:01.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.522+0000 7f3f2a230800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.522+0000 7f3f2a230800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:01.529 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.522+0000 7f3f2a230800 20 searching for the correct realm 2024-03-04T12:35:01.532 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.525+0000 7f3f25d31640 0 -- 172.21.15.110:0/3378092797 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f3f10020040 msgr2=0x7f3f1002e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:01.535 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.528+0000 7f3f25530640 0 -- 172.21.15.110:0/3378092797 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f3f1001a910 msgr2=0x7f3f1003f3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:01.741 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.734+0000 7f3f2a230800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:01.741 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.734+0000 7f3f2a230800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:01.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.734+0000 7f3f2a230800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:01.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.734+0000 7f3f2a230800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:01.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.734+0000 7f3f2a230800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:01.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.734+0000 7f3f2a230800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:01.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.734+0000 7f3f2a230800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.734+0000 7f3f2a230800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.734+0000 7f3f2a230800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.734+0000 7f3f2a230800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:01.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.734+0000 7f3f2a230800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.734+0000 7f3f2a230800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:01.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.735+0000 7f3f2a230800 20 zone default found 2024-03-04T12:35:01.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.735+0000 7f3f2a230800 4 Realm: () 2024-03-04T12:35:01.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.735+0000 7f3f2a230800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:01.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.735+0000 7f3f2a230800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:01.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.735+0000 7f3f2a230800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:01.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.735+0000 7f3f2a230800 20 zonegroup default 2024-03-04T12:35:01.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.735+0000 7f3f2a230800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.735+0000 7f3f2a230800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.735+0000 7f3f2a230800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.735+0000 7f3f2a230800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.735+0000 7f3f2a230800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.735+0000 7f3f2a230800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:01.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.735+0000 7f3f2a230800 20 started sync module instance, tier type = 2024-03-04T12:35:01.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.735+0000 7f3f2a230800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:01.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.744+0000 7f3f2a230800 20 add_watcher() i=0 2024-03-04T12:35:01.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.744+0000 7f3f2a230800 20 add_watcher() i=1 2024-03-04T12:35:01.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.744+0000 7f3f2a230800 20 add_watcher() i=2 2024-03-04T12:35:01.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.744+0000 7f3f2a230800 20 add_watcher() i=3 2024-03-04T12:35:01.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.744+0000 7f3f2a230800 20 add_watcher() i=4 2024-03-04T12:35:01.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.744+0000 7f3f2a230800 20 add_watcher() i=5 2024-03-04T12:35:01.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.744+0000 7f3f2a230800 20 add_watcher() i=6 2024-03-04T12:35:01.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.745+0000 7f3f2a230800 20 add_watcher() i=7 2024-03-04T12:35:01.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.745+0000 7f3f2a230800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:01.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.747+0000 7f3ddb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:01.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.747+0000 7f3f2a230800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:01.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.747+0000 7f3f2a230800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:01.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.747+0000 7f3f2a230800 5 note: GC not initialized 2024-03-04T12:35:01.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.747+0000 7f3dda7e4640 20 reqs_thread_entry: start 2024-03-04T12:35:01.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.747+0000 7f3f2a230800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:01.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.747+0000 7f3f2a230800 20 Filter name: none 2024-03-04T12:35:01.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.748+0000 7f3d4bfff640 20 reqs_thread_entry: start 2024-03-04T12:35:01.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.748+0000 7f3f2a230800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-03-04T12:35:01.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.748+0000 7f3f2a230800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.748+0000 7f3f2a230800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:01.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.748+0000 7f3f2a230800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-03-04T12:35:01.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.748+0000 7f3f2a230800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-03-04T12:35:01.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.748+0000 7f3f2a230800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 : miss 2024-03-04T12:35:01.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.748+0000 7f3f2a230800 20 rados->read ofs=0 len=0 2024-03-04T12:35:01.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.748+0000 7f3f2a230800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:01.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.748+0000 7f3f2a230800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 info.flags=0x17 2024-03-04T12:35:01.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.748+0000 7f3f2a230800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 to cache LRU end 2024-03-04T12:35:01.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.748+0000 7f3f2a230800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:35:01.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.748+0000 7f3f2a230800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:01.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.748+0000 7f3f2a230800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 2024-03-04T12:35:01.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.753+0000 7f3f2a230800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 info.flags=0x17 2024-03-04T12:35:01.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.753+0000 7f3f2a230800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 to cache LRU end 2024-03-04T12:35:01.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.753+0000 7f3f2a230800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:01.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.753+0000 7f3f2a230800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20, ofs0, ns] 2024-03-04T12:35:01.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.753+0000 7f3df7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824022 cookie 94456484202432 notifier 6270 bl.length()=959 2024-03-04T12:35:01.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.753+0000 7f3df7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 info.flags=0x17 2024-03-04T12:35:01.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.753+0000 7f3df7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 to cache LRU end 2024-03-04T12:35:01.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.753+0000 7f3df7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:01.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.755+0000 7f3f2a230800 20 handle_bi_update(): bucket=:error-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20]): orig_sources= new_sources= 2024-03-04T12:35:01.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.755+0000 7f3f2a230800 20 handle_bi_update(): bucket=:error-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20]): potential sources added=[] removed=[] 2024-03-04T12:35:01.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.755+0000 7f3f2a230800 20 handle_bi_update(): bucket=:error-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20]): orig_dests= new_dests= 2024-03-04T12:35:01.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.755+0000 7f3f2a230800 20 handle_bi_update(): bucket=:error-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20]): potential dests added=[] removed=[] 2024-03-04T12:35:01.764 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.0 2024-03-04T12:35:01.764 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.0 2024-03-04T12:35:01.764 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.1 2024-03-04T12:35:01.764 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.1 2024-03-04T12:35:01.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.2 2024-03-04T12:35:01.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.2 2024-03-04T12:35:01.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.3 2024-03-04T12:35:01.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.3 2024-03-04T12:35:01.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.4 2024-03-04T12:35:01.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.4 2024-03-04T12:35:01.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.5 2024-03-04T12:35:01.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.5 2024-03-04T12:35:01.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.6 2024-03-04T12:35:01.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.6 2024-03-04T12:35:01.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.7 2024-03-04T12:35:01.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.7 2024-03-04T12:35:01.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.8 2024-03-04T12:35:01.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.8 2024-03-04T12:35:01.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.9 2024-03-04T12:35:01.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.9 2024-03-04T12:35:01.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.10 2024-03-04T12:35:01.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.10 2024-03-04T12:35:01.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.11 2024-03-04T12:35:01.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1.11 2024-03-04T12:35:01.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.757+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.0 2024-03-04T12:35:01.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.758+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.1 2024-03-04T12:35:01.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.758+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.2 2024-03-04T12:35:01.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.759+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.3 2024-03-04T12:35:01.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.759+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.4 2024-03-04T12:35:01.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.760+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.5 2024-03-04T12:35:01.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.760+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.6 2024-03-04T12:35:01.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.761+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.7 2024-03-04T12:35:01.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.761+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.8 2024-03-04T12:35:01.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.762+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.9 2024-03-04T12:35:01.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.762+0000 7f3f2a230800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20.10 2024-03-04T12:35:01.771 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.765+0000 7f3f2a230800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 : hit (requested=0x17, cached=0x17) 2024-03-04T12:35:01.771 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.765+0000 7f3f2a230800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 2024-03-04T12:35:01.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.766+0000 7f3f2a230800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 info.flags=0x17 2024-03-04T12:35:01.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.766+0000 7f3f2a230800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 to cache LRU end 2024-03-04T12:35:01.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.766+0000 7f3f2a230800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:01.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.766+0000 7f3f2a230800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20, ofs0, ns] 2024-03-04T12:35:01.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.766+0000 7f3df7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824023 cookie 94456484202432 notifier 6270 bl.length()=927 2024-03-04T12:35:01.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.766+0000 7f3df7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 info.flags=0x17 2024-03-04T12:35:01.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.766+0000 7f3df7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 to cache LRU end 2024-03-04T12:35:01.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.766+0000 7f3df7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:01.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.768+0000 7f3f2a230800 20 handle_bi_update(): bucket=:error-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20]): orig_sources= new_sources= 2024-03-04T12:35:01.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.768+0000 7f3f2a230800 20 handle_bi_update(): bucket=:error-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20]): potential sources added=[] removed=[] 2024-03-04T12:35:01.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.768+0000 7f3f2a230800 20 handle_bi_update(): bucket=:error-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20]): orig_dests= new_dests= 2024-03-04T12:35:01.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.768+0000 7f3f2a230800 20 handle_bi_update(): bucket=:error-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20]): potential dests added=[] removed=[] 2024-03-04T12:35:01.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.770+0000 7f3f2a230800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-03-04T12:35:01.778 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.772+0000 7f3ddb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:01.780 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.774+0000 7f3f2a230800 20 remove_watcher() i=0 2024-03-04T12:35:01.780 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.774+0000 7f3f2a230800 2 removed watcher, disabling cache 2024-03-04T12:35:01.781 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.775+0000 7f3f2a230800 20 remove_watcher() i=1 2024-03-04T12:35:01.782 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.776+0000 7f3f2a230800 20 remove_watcher() i=2 2024-03-04T12:35:01.783 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.777+0000 7f3f2a230800 20 remove_watcher() i=3 2024-03-04T12:35:01.785 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.778+0000 7f3f2a230800 20 remove_watcher() i=4 2024-03-04T12:35:01.785 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.779+0000 7f3f2a230800 20 remove_watcher() i=5 2024-03-04T12:35:01.786 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.780+0000 7f3f2a230800 20 remove_watcher() i=6 2024-03-04T12:35:01.787 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.781+0000 7f3f2a230800 20 remove_watcher() i=7 2024-03-04T12:35:01.798 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-04T12:35:01.826 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:01.826 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:01.860 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.853+0000 7f6731324800 20 rados->read ofs=0 len=0 2024-03-04T12:35:02.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.854+0000 7f6731324800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:02.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.854+0000 7f6731324800 20 realm 2024-03-04T12:35:02.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.854+0000 7f6731324800 20 rados->read ofs=0 len=0 2024-03-04T12:35:02.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.854+0000 7f6731324800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:02.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.854+0000 7f6731324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:02.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.854+0000 7f6731324800 20 rados->read ofs=0 len=0 2024-03-04T12:35:02.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.854+0000 7f6731324800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:02.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.854+0000 7f6731324800 20 rados->read ofs=0 len=0 2024-03-04T12:35:02.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.855+0000 7f6731324800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:02.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.855+0000 7f6731324800 20 rados->read ofs=0 len=0 2024-03-04T12:35:02.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.855+0000 7f6731324800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:02.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.855+0000 7f6731324800 20 searching for the correct realm 2024-03-04T12:35:02.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.859+0000 7f672d8b5640 0 -- 172.21.15.110:0/2471737514 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f67180a97b0 msgr2=0x7f67180d30b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:02.274 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:01.862+0000 7f672d0b4640 0 -- 172.21.15.110:0/2471737514 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f67180d3530 msgr2=0x7f671807e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:02.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.068+0000 7f6731324800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:02.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.068+0000 7f6731324800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:02.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.068+0000 7f6731324800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:02.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.068+0000 7f6731324800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:02.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.068+0000 7f6731324800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:02.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.068+0000 7f6731324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:02.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.068+0000 7f6731324800 20 rados->read ofs=0 len=0 2024-03-04T12:35:02.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.068+0000 7f6731324800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:02.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.068+0000 7f6731324800 20 rados->read ofs=0 len=0 2024-03-04T12:35:02.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.068+0000 7f6731324800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:02.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.068+0000 7f6731324800 20 rados->read ofs=0 len=0 2024-03-04T12:35:02.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.069+0000 7f6731324800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:02.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.069+0000 7f6731324800 20 zone default found 2024-03-04T12:35:02.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.069+0000 7f6731324800 4 Realm: () 2024-03-04T12:35:02.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.069+0000 7f6731324800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:02.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.069+0000 7f6731324800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:02.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.069+0000 7f6731324800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:02.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.069+0000 7f6731324800 20 zonegroup default 2024-03-04T12:35:02.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.069+0000 7f6731324800 20 rados->read ofs=0 len=0 2024-03-04T12:35:02.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.069+0000 7f6731324800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:02.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.069+0000 7f6731324800 20 rados->read ofs=0 len=0 2024-03-04T12:35:02.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.069+0000 7f6731324800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:02.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.069+0000 7f6731324800 20 rados->read ofs=0 len=0 2024-03-04T12:35:02.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.070+0000 7f6731324800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:02.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.070+0000 7f6731324800 20 started sync module instance, tier type = 2024-03-04T12:35:02.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.070+0000 7f6731324800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:02.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.078+0000 7f6731324800 20 add_watcher() i=0 2024-03-04T12:35:02.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.078+0000 7f6731324800 20 add_watcher() i=1 2024-03-04T12:35:02.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.078+0000 7f6731324800 20 add_watcher() i=2 2024-03-04T12:35:02.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.078+0000 7f6731324800 20 add_watcher() i=3 2024-03-04T12:35:02.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.078+0000 7f6731324800 20 add_watcher() i=4 2024-03-04T12:35:02.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.078+0000 7f6731324800 20 add_watcher() i=5 2024-03-04T12:35:02.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.078+0000 7f6731324800 20 add_watcher() i=6 2024-03-04T12:35:02.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.079+0000 7f6731324800 20 add_watcher() i=7 2024-03-04T12:35:02.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.079+0000 7f6731324800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:02.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.081+0000 7f65e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:02.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.081+0000 7f6731324800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:02.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.081+0000 7f6731324800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:02.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.081+0000 7f6731324800 5 note: GC not initialized 2024-03-04T12:35:02.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.081+0000 7f65e27e4640 20 reqs_thread_entry: start 2024-03-04T12:35:02.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.081+0000 7f6731324800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:02.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.082+0000 7f6731324800 20 Filter name: none 2024-03-04T12:35:02.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.082+0000 7f6553fff640 20 reqs_thread_entry: start 2024-03-04T12:35:02.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.082+0000 7f6731324800 20 rados->read ofs=0 len=0 2024-03-04T12:35:02.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.082+0000 7f6731324800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:02.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.082+0000 7f6731324800 20 rados->read ofs=0 len=0 2024-03-04T12:35:02.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.083+0000 7f6731324800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:02.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.083+0000 7f6731324800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:02.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.083+0000 7f6731324800 20 rados->read ofs=0 len=0 2024-03-04T12:35:02.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.083+0000 7f6731324800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:02.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.083+0000 7f6731324800 20 rados->read ofs=0 len=0 2024-03-04T12:35:02.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.084+0000 7f6731324800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:02.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.084+0000 7f6731324800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:02.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.085+0000 7f6731324800 20 rados->read ofs=0 len=0 2024-03-04T12:35:02.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.085+0000 7f6731324800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:02.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.086+0000 7f65e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:02.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.088+0000 7f6731324800 20 remove_watcher() i=0 2024-03-04T12:35:02.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.088+0000 7f6731324800 2 removed watcher, disabling cache 2024-03-04T12:35:02.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.089+0000 7f6731324800 20 remove_watcher() i=1 2024-03-04T12:35:02.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.090+0000 7f6731324800 20 remove_watcher() i=2 2024-03-04T12:35:02.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.091+0000 7f6731324800 20 remove_watcher() i=3 2024-03-04T12:35:02.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.092+0000 7f6731324800 20 remove_watcher() i=4 2024-03-04T12:35:02.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.092+0000 7f6731324800 20 remove_watcher() i=5 2024-03-04T12:35:02.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.093+0000 7f6731324800 20 remove_watcher() i=6 2024-03-04T12:35:02.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:02.094+0000 7f6731324800 20 remove_watcher() i=7 2024-03-04T12:35:02.281 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:02.281 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:35:02.281 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: error-at-set-target-layout id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-04T12:35:02.281 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:02.282 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.282 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.282 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.282 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.283 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.283 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.408 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-03-04T12:35:02.408 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:02.408 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.408 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.457 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.457 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.510 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.510 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.538 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.538 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.566 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.566 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.594 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.594 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.622 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.622 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.650 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.650 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.678 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.679 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.707 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.707 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.733 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.733 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.762 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.762 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.789 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.790 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.818 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.818 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.846 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.846 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.875 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.875 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.902 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.902 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.929 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.929 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.958 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.958 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:02.985 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:02.985 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:03.013 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:03.013 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:03.041 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:03.041 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:03.070 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-04T12:35:03.097 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:03.097 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:03.131 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.124+0000 7f82dc131800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.126+0000 7f82dc131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.126+0000 7f82dc131800 20 realm 2024-03-04T12:35:03.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.126+0000 7f82dc131800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.126+0000 7f82dc131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.126+0000 7f82dc131800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:03.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.126+0000 7f82dc131800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.126+0000 7f82dc131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.133 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.126+0000 7f82dc131800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.127+0000 7f82dc131800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:03.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.127+0000 7f82dc131800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.128+0000 7f82dc131800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:03.134 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.128+0000 7f82dc131800 20 searching for the correct realm 2024-03-04T12:35:03.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.131+0000 7f82d8632640 0 -- 172.21.15.110:0/2093720243 >> [v2:172.21.15.110:6824/3005097257,v1:172.21.15.110:6825/3005097257] conn(0x55e2b161ebb0 msgr2=0x55e2b1621070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:03.140 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.134+0000 7f82d7630640 0 -- 172.21.15.110:0/2093720243 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f82d0065070 msgr2=0x7f82d0077ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:03.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:03.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:03.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:03.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:03.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:03.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:03.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:03.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:03.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 20 zone default found 2024-03-04T12:35:03.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 4 Realm: () 2024-03-04T12:35:03.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:03.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:03.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:03.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 20 zonegroup default 2024-03-04T12:35:03.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.138+0000 7f82dc131800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.139+0000 7f82dc131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.146 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.139+0000 7f82dc131800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.147 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.139+0000 7f82dc131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.147 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.139+0000 7f82dc131800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.147 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.139+0000 7f82dc131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.147 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.139+0000 7f82dc131800 20 started sync module instance, tier type = 2024-03-04T12:35:03.147 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.139+0000 7f82dc131800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:03.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.148+0000 7f82dc131800 20 add_watcher() i=0 2024-03-04T12:35:03.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.148+0000 7f82dc131800 20 add_watcher() i=1 2024-03-04T12:35:03.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.148+0000 7f82dc131800 20 add_watcher() i=2 2024-03-04T12:35:03.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.148+0000 7f82dc131800 20 add_watcher() i=3 2024-03-04T12:35:03.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.148+0000 7f82dc131800 20 add_watcher() i=4 2024-03-04T12:35:03.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.148+0000 7f82dc131800 20 add_watcher() i=5 2024-03-04T12:35:03.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.148+0000 7f82dc131800 20 add_watcher() i=6 2024-03-04T12:35:03.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.149+0000 7f82dc131800 20 add_watcher() i=7 2024-03-04T12:35:03.155 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.149+0000 7f82dc131800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:03.157 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.151+0000 7f818dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:03.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.151+0000 7f82dc131800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:03.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.151+0000 7f82dc131800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:03.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.151+0000 7f82dc131800 5 note: GC not initialized 2024-03-04T12:35:03.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.151+0000 7f818cfe1640 20 reqs_thread_entry: start 2024-03-04T12:35:03.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.151+0000 7f82dc131800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:03.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.151+0000 7f82dc131800 20 Filter name: none 2024-03-04T12:35:03.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.151+0000 7f81067fc640 20 reqs_thread_entry: start 2024-03-04T12:35:03.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.151+0000 7f82dc131800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.152+0000 7f82dc131800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:03.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.152+0000 7f82dc131800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.160 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.152+0000 7f82dc131800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:03.160 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.152+0000 7f82dc131800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:03.160 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.152+0000 7f82dc131800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.160 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.153+0000 7f82dc131800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:03.160 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.153+0000 7f82dc131800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.160 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.153+0000 7f82dc131800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:03.160 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.153+0000 7f82dc131800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:03.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.154+0000 7f82dc131800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.154+0000 7f82dc131800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.155+0000 7f818dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:03.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.157+0000 7f82dc131800 20 remove_watcher() i=0 2024-03-04T12:35:03.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.157+0000 7f82dc131800 2 removed watcher, disabling cache 2024-03-04T12:35:03.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.158+0000 7f82dc131800 20 remove_watcher() i=1 2024-03-04T12:35:03.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.159+0000 7f82dc131800 20 remove_watcher() i=2 2024-03-04T12:35:03.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.160+0000 7f82dc131800 20 remove_watcher() i=3 2024-03-04T12:35:03.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.161+0000 7f82dc131800 20 remove_watcher() i=4 2024-03-04T12:35:03.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.162+0000 7f82dc131800 20 remove_watcher() i=5 2024-03-04T12:35:03.169 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.163+0000 7f82dc131800 20 remove_watcher() i=6 2024-03-04T12:35:03.170 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.164+0000 7f82dc131800 20 remove_watcher() i=7 2024-03-04T12:35:03.180 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:03.180 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:35:03.180 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: error-at-set-target-layout id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:35:03.180 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:03.181 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-03-04T12:35:03.216 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:03.216 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:03.250 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.243+0000 7f151e34b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.251 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.244+0000 7f151e34b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.251 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.244+0000 7f151e34b800 20 realm 2024-03-04T12:35:03.251 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.244+0000 7f151e34b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.251 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.245+0000 7f151e34b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.251 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.245+0000 7f151e34b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:03.251 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.245+0000 7f151e34b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.252 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.245+0000 7f151e34b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.252 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.245+0000 7f151e34b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.252 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.246+0000 7f151e34b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:03.252 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.246+0000 7f151e34b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.253 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.246+0000 7f151e34b800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:03.253 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.246+0000 7f151e34b800 20 searching for the correct realm 2024-03-04T12:35:03.256 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.250+0000 7f1513fff640 0 -- 172.21.15.110:0/540710028 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f150c007390 msgr2=0x7f150c0d69e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:03.259 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.253+0000 7f1513fff640 0 -- 172.21.15.110:0/540710028 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f13e4079c50 msgr2=0x7f13e407c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:03.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.256+0000 7f151e34b800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:03.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.256+0000 7f151e34b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:03.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.256+0000 7f151e34b800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:03.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.256+0000 7f151e34b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:03.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.256+0000 7f151e34b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:03.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.256+0000 7f151e34b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:03.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.256+0000 7f151e34b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.256+0000 7f151e34b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.256+0000 7f151e34b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.264 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.257+0000 7f151e34b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:03.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.257+0000 7f151e34b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.257+0000 7f151e34b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:03.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.257+0000 7f151e34b800 20 zone default found 2024-03-04T12:35:03.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.257+0000 7f151e34b800 4 Realm: () 2024-03-04T12:35:03.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.257+0000 7f151e34b800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:03.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.257+0000 7f151e34b800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:03.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.257+0000 7f151e34b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:03.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.257+0000 7f151e34b800 20 zonegroup default 2024-03-04T12:35:03.266 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.257+0000 7f151e34b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.266 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.257+0000 7f151e34b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.266 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.257+0000 7f151e34b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.266 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.258+0000 7f151e34b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.266 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.258+0000 7f151e34b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.266 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.258+0000 7f151e34b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.266 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.258+0000 7f151e34b800 20 started sync module instance, tier type = 2024-03-04T12:35:03.266 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.258+0000 7f151e34b800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:03.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.269+0000 7f151e34b800 20 add_watcher() i=0 2024-03-04T12:35:03.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.269+0000 7f151e34b800 20 add_watcher() i=1 2024-03-04T12:35:03.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.269+0000 7f151e34b800 20 add_watcher() i=2 2024-03-04T12:35:03.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.269+0000 7f151e34b800 20 add_watcher() i=3 2024-03-04T12:35:03.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.269+0000 7f151e34b800 20 add_watcher() i=4 2024-03-04T12:35:03.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.269+0000 7f151e34b800 20 add_watcher() i=5 2024-03-04T12:35:03.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.269+0000 7f151e34b800 20 add_watcher() i=6 2024-03-04T12:35:03.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.270+0000 7f151e34b800 20 add_watcher() i=7 2024-03-04T12:35:03.277 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.270+0000 7f151e34b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:03.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.272+0000 7f13d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:03.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.272+0000 7f151e34b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:03.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.272+0000 7f151e34b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:03.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.272+0000 7f151e34b800 5 note: GC not initialized 2024-03-04T12:35:03.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.272+0000 7f134bfff640 20 reqs_thread_entry: start 2024-03-04T12:35:03.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.273+0000 7f151e34b800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:03.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.273+0000 7f151e34b800 20 Filter name: none 2024-03-04T12:35:03.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.273+0000 7f1349ffb640 20 reqs_thread_entry: start 2024-03-04T12:35:03.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.273+0000 7f151e34b800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-03-04T12:35:03.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.273+0000 7f151e34b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.273+0000 7f151e34b800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:03.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.273+0000 7f151e34b800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-03-04T12:35:03.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.273+0000 7f151e34b800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-03-04T12:35:03.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.273+0000 7f151e34b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21 : miss 2024-03-04T12:35:03.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.273+0000 7f151e34b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.273+0000 7f151e34b800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:03.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.273+0000 7f151e34b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21 info.flags=0x17 2024-03-04T12:35:03.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.273+0000 7f151e34b800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21 to cache LRU end 2024-03-04T12:35:03.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.273+0000 7f151e34b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:35:03.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.273+0000 7f151e34b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:03.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.273+0000 7f151e34b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21 2024-03-04T12:35:03.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.277+0000 7f151e34b800 -1 Injecting error=-125 at location=set_target_layout 2024-03-04T12:35:03.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.278+0000 7f151e34b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21 info.flags=0x17 2024-03-04T12:35:03.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.278+0000 7f151e34b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21 to cache LRU end 2024-03-04T12:35:03.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.278+0000 7f151e34b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:03.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.278+0000 7f151e34b800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21, ofs0, ns] 2024-03-04T12:35:03.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.278+0000 7f13fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824028 cookie 94038292178336 notifier 5921 bl.length()=959 2024-03-04T12:35:03.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.278+0000 7f13fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21 info.flags=0x17 2024-03-04T12:35:03.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.278+0000 7f13fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21 to cache LRU end 2024-03-04T12:35:03.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.278+0000 7f13fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:03.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.280+0000 7f151e34b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21]): orig_sources= new_sources= 2024-03-04T12:35:03.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.280+0000 7f151e34b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21]): potential sources added=[] removed=[] 2024-03-04T12:35:03.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.280+0000 7f151e34b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21]): orig_dests= new_dests= 2024-03-04T12:35:03.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.280+0000 7f151e34b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21]): potential dests added=[] removed=[] 2024-03-04T12:35:03.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.0 2024-03-04T12:35:03.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.0 2024-03-04T12:35:03.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.1 2024-03-04T12:35:03.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.1 2024-03-04T12:35:03.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.2 2024-03-04T12:35:03.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.2 2024-03-04T12:35:03.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.3 2024-03-04T12:35:03.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.3 2024-03-04T12:35:03.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.4 2024-03-04T12:35:03.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.4 2024-03-04T12:35:03.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.5 2024-03-04T12:35:03.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.5 2024-03-04T12:35:03.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.6 2024-03-04T12:35:03.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.6 2024-03-04T12:35:03.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.7 2024-03-04T12:35:03.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.7 2024-03-04T12:35:03.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.8 2024-03-04T12:35:03.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.8 2024-03-04T12:35:03.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.9 2024-03-04T12:35:03.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.9 2024-03-04T12:35:03.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.10 2024-03-04T12:35:03.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.10 2024-03-04T12:35:03.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.11 2024-03-04T12:35:03.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1.11 2024-03-04T12:35:03.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.0 2024-03-04T12:35:03.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.283+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.1 2024-03-04T12:35:03.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.284+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.2 2024-03-04T12:35:03.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.284+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.3 2024-03-04T12:35:03.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.285+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.4 2024-03-04T12:35:03.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.285+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.5 2024-03-04T12:35:03.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.286+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.6 2024-03-04T12:35:03.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.286+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.7 2024-03-04T12:35:03.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.286+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.8 2024-03-04T12:35:03.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.287+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.9 2024-03-04T12:35:03.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.287+0000 7f151e34b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21.10 2024-03-04T12:35:03.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.290+0000 7f151e34b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21 : hit (requested=0x17, cached=0x17) 2024-03-04T12:35:03.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.290+0000 7f151e34b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21 2024-03-04T12:35:03.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.291+0000 7f151e34b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21 info.flags=0x17 2024-03-04T12:35:03.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.291+0000 7f151e34b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21 to cache LRU end 2024-03-04T12:35:03.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.291+0000 7f151e34b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:03.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.291+0000 7f151e34b800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21, ofs0, ns] 2024-03-04T12:35:03.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.292+0000 7f13fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824029 cookie 94038292178336 notifier 5921 bl.length()=927 2024-03-04T12:35:03.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.292+0000 7f13fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21 info.flags=0x17 2024-03-04T12:35:03.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.292+0000 7f13fdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21 to cache LRU end 2024-03-04T12:35:03.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.292+0000 7f13fdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:03.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.293+0000 7f151e34b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21]): orig_sources= new_sources= 2024-03-04T12:35:03.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.293+0000 7f151e34b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21]): potential sources added=[] removed=[] 2024-03-04T12:35:03.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.293+0000 7f151e34b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21]): orig_dests= new_dests= 2024-03-04T12:35:03.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.293+0000 7f151e34b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21]): potential dests added=[] removed=[] 2024-03-04T12:35:03.302 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.296+0000 7f151e34b800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-03-04T12:35:03.304 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.298+0000 7f13d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:03.306 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.300+0000 7f151e34b800 20 remove_watcher() i=0 2024-03-04T12:35:03.306 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.300+0000 7f151e34b800 2 removed watcher, disabling cache 2024-03-04T12:35:03.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.301+0000 7f151e34b800 20 remove_watcher() i=1 2024-03-04T12:35:03.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.302+0000 7f151e34b800 20 remove_watcher() i=2 2024-03-04T12:35:03.309 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.303+0000 7f151e34b800 20 remove_watcher() i=3 2024-03-04T12:35:03.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.304+0000 7f151e34b800 20 remove_watcher() i=4 2024-03-04T12:35:03.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.305+0000 7f151e34b800 20 remove_watcher() i=5 2024-03-04T12:35:03.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.306+0000 7f151e34b800 20 remove_watcher() i=6 2024-03-04T12:35:03.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.307+0000 7f151e34b800 20 remove_watcher() i=7 2024-03-04T12:35:03.324 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-04T12:35:03.352 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:03.352 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:03.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.379+0000 7f8a06812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.381+0000 7f8a06812800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.381+0000 7f8a06812800 20 realm 2024-03-04T12:35:03.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.381+0000 7f8a06812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.381+0000 7f8a06812800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.381+0000 7f8a06812800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:03.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.381+0000 7f8a06812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.381+0000 7f8a06812800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.381+0000 7f8a06812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.382+0000 7f8a06812800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:03.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.382+0000 7f8a06812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.383+0000 7f8a06812800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:03.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.383+0000 7f8a06812800 20 searching for the correct realm 2024-03-04T12:35:03.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.386+0000 7f8a017a8640 0 -- 172.21.15.110:0/703688241 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x56393177af00 msgr2=0x56393177d350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:03.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.389+0000 7f8a01fa9640 0 -- 172.21.15.110:0/703688241 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f89ec063610 msgr2=0x7f89ec064630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:03.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:03.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:03.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:03.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:03.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:03.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:03.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:03.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.401 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:03.401 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 20 zone default found 2024-03-04T12:35:03.401 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 4 Realm: () 2024-03-04T12:35:03.401 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:03.401 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:03.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:03.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 20 zonegroup default 2024-03-04T12:35:03.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.393+0000 7f8a06812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.394+0000 7f8a06812800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.394+0000 7f8a06812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.394+0000 7f8a06812800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.394+0000 7f8a06812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.394+0000 7f8a06812800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.394+0000 7f8a06812800 20 started sync module instance, tier type = 2024-03-04T12:35:03.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.394+0000 7f8a06812800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:03.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.404+0000 7f8a06812800 20 add_watcher() i=0 2024-03-04T12:35:03.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.404+0000 7f8a06812800 20 add_watcher() i=1 2024-03-04T12:35:03.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.404+0000 7f8a06812800 20 add_watcher() i=2 2024-03-04T12:35:03.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.404+0000 7f8a06812800 20 add_watcher() i=3 2024-03-04T12:35:03.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.404+0000 7f8a06812800 20 add_watcher() i=4 2024-03-04T12:35:03.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.404+0000 7f8a06812800 20 add_watcher() i=5 2024-03-04T12:35:03.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.404+0000 7f8a06812800 20 add_watcher() i=6 2024-03-04T12:35:03.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.405+0000 7f8a06812800 20 add_watcher() i=7 2024-03-04T12:35:03.412 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.405+0000 7f8a06812800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:03.413 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.407+0000 7f88b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:03.414 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.407+0000 7f8a06812800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:03.414 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.407+0000 7f8a06812800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:03.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.407+0000 7f8a06812800 5 note: GC not initialized 2024-03-04T12:35:03.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.407+0000 7f88b27fc640 20 reqs_thread_entry: start 2024-03-04T12:35:03.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.407+0000 7f8a06812800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:03.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.408+0000 7f8a06812800 20 Filter name: none 2024-03-04T12:35:03.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.408+0000 7f8823fff640 20 reqs_thread_entry: start 2024-03-04T12:35:03.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.408+0000 7f8a06812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.408+0000 7f8a06812800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:03.415 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.408+0000 7f8a06812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.416 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.408+0000 7f8a06812800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:03.416 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.408+0000 7f8a06812800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:03.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.408+0000 7f8a06812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.409+0000 7f8a06812800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:03.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.409+0000 7f8a06812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.409+0000 7f8a06812800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:03.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.409+0000 7f8a06812800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:03.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.410+0000 7f8a06812800 20 rados->read ofs=0 len=0 2024-03-04T12:35:03.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.410+0000 7f8a06812800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:03.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.411+0000 7f88b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:03.419 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.413+0000 7f8a06812800 20 remove_watcher() i=0 2024-03-04T12:35:03.419 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.413+0000 7f8a06812800 2 removed watcher, disabling cache 2024-03-04T12:35:03.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.414+0000 7f8a06812800 20 remove_watcher() i=1 2024-03-04T12:35:03.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.415+0000 7f8a06812800 20 remove_watcher() i=2 2024-03-04T12:35:03.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.416+0000 7f8a06812800 20 remove_watcher() i=3 2024-03-04T12:35:03.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.416+0000 7f8a06812800 20 remove_watcher() i=4 2024-03-04T12:35:03.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.417+0000 7f8a06812800 20 remove_watcher() i=5 2024-03-04T12:35:03.424 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.418+0000 7f8a06812800 20 remove_watcher() i=6 2024-03-04T12:35:03.425 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:03.419+0000 7f8a06812800 20 remove_watcher() i=7 2024-03-04T12:35:03.435 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:03.435 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:35:03.436 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: error-at-set-target-layout id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-03-04T12:35:03.436 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:03.437 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:03.437 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:03.455 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:03.455 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:03.620 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:03.620 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:03.743 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: reshard bucket with abort at set_target_layout 2024-03-04T12:35:03.743 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:03.745 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:03.745 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:03.794 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:03.795 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:03.849 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:03.849 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:03.878 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:03.878 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:03.904 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:03.905 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:03.932 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:03.933 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:03.960 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:03.960 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:03.989 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:03.989 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:04.016 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:04.017 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:04.045 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:04.045 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:04.072 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:04.072 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:04.100 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:04.100 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:04.128 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:04.128 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:04.156 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:04.157 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:04.184 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:04.184 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:04.213 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:04.213 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:04.240 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:04.240 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:04.268 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:04.268 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:04.298 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:04.298 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:04.325 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:04.325 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:04.355 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:04.356 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:04.383 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:04.383 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:04.411 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-03-04T12:35:04.439 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:04.439 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:04.472 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.466+0000 7f5cbbe9d800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.467+0000 7f5cbbe9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:04.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.467+0000 7f5cbbe9d800 20 realm 2024-03-04T12:35:04.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.467+0000 7f5cbbe9d800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.467+0000 7f5cbbe9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:04.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.467+0000 7f5cbbe9d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:04.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.467+0000 7f5cbbe9d800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.467+0000 7f5cbbe9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:04.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.467+0000 7f5cbbe9d800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.468+0000 7f5cbbe9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:04.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.468+0000 7f5cbbe9d800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.468+0000 7f5cbbe9d800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:04.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.468+0000 7f5cbbe9d800 20 searching for the correct realm 2024-03-04T12:35:04.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.472+0000 7f5cba19a640 0 -- 172.21.15.110:0/729244332 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7f5cb005e040 msgr2=0x7f5cb009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:35:04.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.678+0000 7f5cb9999640 0 -- 172.21.15.110:0/729244332 >> [v2:172.21.15.172:6800/824320839,v1:172.21.15.172:6801/824320839] conn(0x55bcc8fd1bd0 msgr2=0x55bcc8fd3fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:04.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.680+0000 7f5cbbe9d800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:04.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.680+0000 7f5cbbe9d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:04.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.680+0000 7f5cbbe9d800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:04.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.680+0000 7f5cbbe9d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:04.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.680+0000 7f5cbbe9d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:04.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.680+0000 7f5cbbe9d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:04.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.680+0000 7f5cbbe9d800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.681+0000 7f5cbbe9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:04.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.681+0000 7f5cbbe9d800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.688 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.681+0000 7f5cbbe9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:04.688 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.681+0000 7f5cbbe9d800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.688 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.681+0000 7f5cbbe9d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:04.688 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.681+0000 7f5cbbe9d800 20 zone default found 2024-03-04T12:35:04.688 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.681+0000 7f5cbbe9d800 4 Realm: () 2024-03-04T12:35:04.688 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.681+0000 7f5cbbe9d800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:04.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.681+0000 7f5cbbe9d800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:04.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.681+0000 7f5cbbe9d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:04.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.681+0000 7f5cbbe9d800 20 zonegroup default 2024-03-04T12:35:04.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.681+0000 7f5cbbe9d800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.682+0000 7f5cbbe9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:04.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.682+0000 7f5cbbe9d800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.682+0000 7f5cbbe9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:04.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.682+0000 7f5cbbe9d800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.683+0000 7f5cbbe9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:04.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.683+0000 7f5cbbe9d800 20 started sync module instance, tier type = 2024-03-04T12:35:04.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.683+0000 7f5cbbe9d800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:04.697 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.691+0000 7f5cbbe9d800 20 add_watcher() i=0 2024-03-04T12:35:04.697 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.691+0000 7f5cbbe9d800 20 add_watcher() i=1 2024-03-04T12:35:04.697 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.691+0000 7f5cbbe9d800 20 add_watcher() i=2 2024-03-04T12:35:04.697 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.691+0000 7f5cbbe9d800 20 add_watcher() i=3 2024-03-04T12:35:04.697 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.691+0000 7f5cbbe9d800 20 add_watcher() i=4 2024-03-04T12:35:04.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.691+0000 7f5cbbe9d800 20 add_watcher() i=5 2024-03-04T12:35:04.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.691+0000 7f5cbbe9d800 20 add_watcher() i=6 2024-03-04T12:35:04.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.692+0000 7f5cbbe9d800 20 add_watcher() i=7 2024-03-04T12:35:04.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.692+0000 7f5cbbe9d800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:04.699 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.693+0000 7f5b6b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:04.700 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.693+0000 7f5cbbe9d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:04.700 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.693+0000 7f5cbbe9d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:04.701 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.694+0000 7f5cbbe9d800 5 note: GC not initialized 2024-03-04T12:35:04.701 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.694+0000 7f5b6a7fc640 20 reqs_thread_entry: start 2024-03-04T12:35:04.701 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.694+0000 7f5cbbe9d800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:04.701 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.694+0000 7f5cbbe9d800 20 Filter name: none 2024-03-04T12:35:04.701 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.694+0000 7f5adbfff640 20 reqs_thread_entry: start 2024-03-04T12:35:04.701 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.694+0000 7f5cbbe9d800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.702 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.695+0000 7f5cbbe9d800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:04.702 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.695+0000 7f5cbbe9d800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.702 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.695+0000 7f5cbbe9d800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:04.702 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.695+0000 7f5cbbe9d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:04.702 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.695+0000 7f5cbbe9d800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.702 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.696+0000 7f5cbbe9d800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:04.702 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.696+0000 7f5cbbe9d800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.696+0000 7f5cbbe9d800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:04.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.696+0000 7f5cbbe9d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:04.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.697+0000 7f5cbbe9d800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.697+0000 7f5cbbe9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:04.704 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.698+0000 7f5b6b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:04.706 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.699+0000 7f5cbbe9d800 20 remove_watcher() i=0 2024-03-04T12:35:04.706 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.699+0000 7f5cbbe9d800 2 removed watcher, disabling cache 2024-03-04T12:35:04.706 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.700+0000 7f5cbbe9d800 20 remove_watcher() i=1 2024-03-04T12:35:04.707 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.701+0000 7f5cbbe9d800 20 remove_watcher() i=2 2024-03-04T12:35:04.708 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.702+0000 7f5cbbe9d800 20 remove_watcher() i=3 2024-03-04T12:35:04.709 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.703+0000 7f5cbbe9d800 20 remove_watcher() i=4 2024-03-04T12:35:04.710 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.704+0000 7f5cbbe9d800 20 remove_watcher() i=5 2024-03-04T12:35:04.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.705+0000 7f5cbbe9d800 20 remove_watcher() i=6 2024-03-04T12:35:04.712 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.706+0000 7f5cbbe9d800 20 remove_watcher() i=7 2024-03-04T12:35:04.721 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:04.722 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:35:04.722 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: abort-at-set-target-layout id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:35:04.722 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:04.723 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-03-04T12:35:04.756 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:04.756 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:04.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.783+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.784+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:04.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.784+0000 7fc9c380f800 20 realm 2024-03-04T12:35:04.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.784+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.784+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:04.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.784+0000 7fc9c380f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:04.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.784+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.785+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:04.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.785+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.785+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:04.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.785+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:04.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.786+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:04.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.786+0000 7fc9c380f800 20 searching for the correct realm 2024-03-04T12:35:04.795 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.789+0000 7fc9b6680640 0 -- 172.21.15.110:0/1659756204 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7fc9b0089070 msgr2=0x7fc9b005b450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:04.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.792+0000 7fc9bee81640 0 -- 172.21.15.110:0/1659756204 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fc9a8060a30 msgr2=0x7fc9a8065790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:05.004 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:05.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:05.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:05.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:05.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:05.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:05.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.998+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.998+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.998+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.998+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:05.005 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.998+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.999+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:05.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.999+0000 7fc9c380f800 20 zone default found 2024-03-04T12:35:05.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.999+0000 7fc9c380f800 4 Realm: () 2024-03-04T12:35:05.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.999+0000 7fc9c380f800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:05.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.999+0000 7fc9c380f800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:05.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.999+0000 7fc9c380f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:05.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.999+0000 7fc9c380f800 20 zonegroup default 2024-03-04T12:35:05.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.999+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.999+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:04.999+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.000+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.007 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.000+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.000+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.000+0000 7fc9c380f800 20 started sync module instance, tier type = 2024-03-04T12:35:05.008 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.000+0000 7fc9c380f800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:05.014 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=0 2024-03-04T12:35:05.014 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=1 2024-03-04T12:35:05.014 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=2 2024-03-04T12:35:05.014 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=3 2024-03-04T12:35:05.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=4 2024-03-04T12:35:05.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=5 2024-03-04T12:35:05.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=6 2024-03-04T12:35:05.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.009+0000 7fc9c380f800 20 add_watcher() i=7 2024-03-04T12:35:05.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.009+0000 7fc9c380f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:05.017 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.010+0000 7fc8757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:05.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.011+0000 7fc9c380f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:05.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.011+0000 7fc9c380f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:05.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.011+0000 7fc9c380f800 5 note: GC not initialized 2024-03-04T12:35:05.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.011+0000 7fc7effff640 20 reqs_thread_entry: start 2024-03-04T12:35:05.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.011+0000 7fc9c380f800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:05.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.011+0000 7fc9c380f800 20 Filter name: none 2024-03-04T12:35:05.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.011+0000 7fc7edffb640 20 reqs_thread_entry: start 2024-03-04T12:35:05.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.011+0000 7fc9c380f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-04T12:35:05.018 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.011+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.012+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:05.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.012+0000 7fc9c380f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-04T12:35:05.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.012+0000 7fc9c380f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-04T12:35:05.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.012+0000 7fc9c380f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 : miss 2024-03-04T12:35:05.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.012+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.019 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.012+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:05.020 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.012+0000 7fc9c380f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 info.flags=0x17 2024-03-04T12:35:05.020 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.012+0000 7fc9c380f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 to cache LRU end 2024-03-04T12:35:05.020 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.012+0000 7fc9c380f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:35:05.020 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.012+0000 7fc9c380f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:05.020 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.012+0000 7fc9c380f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 2024-03-04T12:35:05.022 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc9c380f800 time 2024-03-04T12:35:05.016700+0000 2024-03-04T12:35:05.022 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:35:05.022 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:35:05.023 INFO:tasks.workunit.client.0.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc9c4780e86] 2024-03-04T12:35:05.023 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fc9c4781044] 2024-03-04T12:35:05.023 INFO:tasks.workunit.client.0.smithi110.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5562d9386eb1] 2024-03-04T12:35:05.023 INFO:tasks.workunit.client.0.smithi110.stderr: 4: radosgw-admin(+0x7e4532) [0x5562d9391532] 2024-03-04T12:35:05.023 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x5562d939ad1b] 2024-03-04T12:35:05.023 INFO:tasks.workunit.client.0.smithi110.stderr: 6: main() 2024-03-04T12:35:05.023 INFO:tasks.workunit.client.0.smithi110.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7fc9c363feb0] 2024-03-04T12:35:05.023 INFO:tasks.workunit.client.0.smithi110.stderr: 8: __libc_start_main() 2024-03-04T12:35:05.023 INFO:tasks.workunit.client.0.smithi110.stderr: 9: _start() 2024-03-04T12:35:05.023 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.016+0000 7fc9c380f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc9c380f800 time 2024-03-04T12:35:05.016700+0000 2024-03-04T12:35:05.023 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:35:05.023 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.023 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:35:05.024 INFO:tasks.workunit.client.0.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc9c4780e86] 2024-03-04T12:35:05.024 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fc9c4781044] 2024-03-04T12:35:05.024 INFO:tasks.workunit.client.0.smithi110.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5562d9386eb1] 2024-03-04T12:35:05.024 INFO:tasks.workunit.client.0.smithi110.stderr: 4: radosgw-admin(+0x7e4532) [0x5562d9391532] 2024-03-04T12:35:05.024 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x5562d939ad1b] 2024-03-04T12:35:05.024 INFO:tasks.workunit.client.0.smithi110.stderr: 6: main() 2024-03-04T12:35:05.024 INFO:tasks.workunit.client.0.smithi110.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7fc9c363feb0] 2024-03-04T12:35:05.024 INFO:tasks.workunit.client.0.smithi110.stderr: 8: __libc_start_main() 2024-03-04T12:35:05.024 INFO:tasks.workunit.client.0.smithi110.stderr: 9: _start() 2024-03-04T12:35:05.024 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.024 INFO:tasks.workunit.client.0.smithi110.stderr:*** Caught signal (Aborted) ** 2024-03-04T12:35:05.024 INFO:tasks.workunit.client.0.smithi110.stderr: in thread 7fc9c380f800 thread_name:radosgw-admin 2024-03-04T12:35:05.042 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:35:05.043 INFO:tasks.workunit.client.0.smithi110.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc9c3654db0] 2024-03-04T12:35:05.043 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc9c36a154c] 2024-03-04T12:35:05.043 INFO:tasks.workunit.client.0.smithi110.stderr: 3: raise() 2024-03-04T12:35:05.043 INFO:tasks.workunit.client.0.smithi110.stderr: 4: abort() 2024-03-04T12:35:05.043 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc9c4780ee0] 2024-03-04T12:35:05.043 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fc9c4781044] 2024-03-04T12:35:05.043 INFO:tasks.workunit.client.0.smithi110.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5562d9386eb1] 2024-03-04T12:35:05.043 INFO:tasks.workunit.client.0.smithi110.stderr: 8: radosgw-admin(+0x7e4532) [0x5562d9391532] 2024-03-04T12:35:05.043 INFO:tasks.workunit.client.0.smithi110.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x5562d939ad1b] 2024-03-04T12:35:05.043 INFO:tasks.workunit.client.0.smithi110.stderr: 10: main() 2024-03-04T12:35:05.043 INFO:tasks.workunit.client.0.smithi110.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7fc9c363feb0] 2024-03-04T12:35:05.043 INFO:tasks.workunit.client.0.smithi110.stderr: 12: __libc_start_main() 2024-03-04T12:35:05.044 INFO:tasks.workunit.client.0.smithi110.stderr: 13: _start() 2024-03-04T12:35:05.044 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.017+0000 7fc9c380f800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:35:05.044 INFO:tasks.workunit.client.0.smithi110.stderr: in thread 7fc9c380f800 thread_name:radosgw-admin 2024-03-04T12:35:05.044 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.044 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:35:05.044 INFO:tasks.workunit.client.0.smithi110.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc9c3654db0] 2024-03-04T12:35:05.044 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc9c36a154c] 2024-03-04T12:35:05.044 INFO:tasks.workunit.client.0.smithi110.stderr: 3: raise() 2024-03-04T12:35:05.044 INFO:tasks.workunit.client.0.smithi110.stderr: 4: abort() 2024-03-04T12:35:05.044 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc9c4780ee0] 2024-03-04T12:35:05.044 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fc9c4781044] 2024-03-04T12:35:05.044 INFO:tasks.workunit.client.0.smithi110.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5562d9386eb1] 2024-03-04T12:35:05.045 INFO:tasks.workunit.client.0.smithi110.stderr: 8: radosgw-admin(+0x7e4532) [0x5562d9391532] 2024-03-04T12:35:05.045 INFO:tasks.workunit.client.0.smithi110.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x5562d939ad1b] 2024-03-04T12:35:05.045 INFO:tasks.workunit.client.0.smithi110.stderr: 10: main() 2024-03-04T12:35:05.045 INFO:tasks.workunit.client.0.smithi110.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7fc9c363feb0] 2024-03-04T12:35:05.045 INFO:tasks.workunit.client.0.smithi110.stderr: 12: __libc_start_main() 2024-03-04T12:35:05.045 INFO:tasks.workunit.client.0.smithi110.stderr: 13: _start() 2024-03-04T12:35:05.045 INFO:tasks.workunit.client.0.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:35:05.045 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.045 INFO:tasks.workunit.client.0.smithi110.stderr:--- begin dump of recent events --- 2024-03-04T12:35:05.045 INFO:tasks.workunit.client.0.smithi110.stderr: -499> 2024-03-04T12:35:04.767+0000 7fc8ace09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:35:05.045 INFO:tasks.workunit.client.0.smithi110.stderr: -498> 2024-03-04T12:35:04.767+0000 7fc8ace09640 10 monclient: dump: 2024-03-04T12:35:05.045 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.046 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.046 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.046 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.046 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.046 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.046 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.046 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.046 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.046 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.046 INFO:tasks.workunit.client.0.smithi110.stderr: -497> 2024-03-04T12:35:04.767+0000 7fc8ace09640 10 monclient: _finish_auth 0 2024-03-04T12:35:05.046 INFO:tasks.workunit.client.0.smithi110.stderr: -496> 2024-03-04T12:35:04.767+0000 7fc8ace09640 10 monclient: _check_auth_tickets 2024-03-04T12:35:05.046 INFO:tasks.workunit.client.0.smithi110.stderr: -495> 2024-03-04T12:35:04.767+0000 7fc8ace09640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:05.046 INFO:tasks.workunit.client.0.smithi110.stderr: -494> 2024-03-04T12:35:04.767+0000 7fc8ace09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.046 INFO:tasks.workunit.client.0.smithi110.stderr: -493> 2024-03-04T12:35:04.767+0000 7fc8ace09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:35:05.047 INFO:tasks.workunit.client.0.smithi110.stderr: -492> 2024-03-04T12:35:04.767+0000 7fc8ace09640 10 monclient: dump: 2024-03-04T12:35:05.047 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.047 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.047 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.047 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.047 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.047 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.047 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.047 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.047 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.047 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.047 INFO:tasks.workunit.client.0.smithi110.stderr: -491> 2024-03-04T12:35:04.767+0000 7fc9c380f800 5 monclient: authenticate success, global_id 5960 2024-03-04T12:35:05.047 INFO:tasks.workunit.client.0.smithi110.stderr: -490> 2024-03-04T12:35:04.767+0000 7fc9c380f800 10 monclient: get_monmap_and_config success 2024-03-04T12:35:05.047 INFO:tasks.workunit.client.0.smithi110.stderr: -489> 2024-03-04T12:35:04.767+0000 7fc9c380f800 4 set_mon_vals no callback set 2024-03-04T12:35:05.048 INFO:tasks.workunit.client.0.smithi110.stderr: -488> 2024-03-04T12:35:04.767+0000 7fc9c380f800 10 monclient: shutdown 2024-03-04T12:35:05.048 INFO:tasks.workunit.client.0.smithi110.stderr: -487> 2024-03-04T12:35:04.767+0000 7fc9c380f800 5 asok(0x5562da0410c0) unregister_commands rotate-key 2024-03-04T12:35:05.048 INFO:tasks.workunit.client.0.smithi110.stderr: -486> 2024-03-04T12:35:04.767+0000 7fc9c380f800 10 monclient: build_initial_monmap 2024-03-04T12:35:05.048 INFO:tasks.workunit.client.0.smithi110.stderr: -485> 2024-03-04T12:35:04.767+0000 7fc9c380f800 1 build_initial for_mkfs: 0 2024-03-04T12:35:05.048 INFO:tasks.workunit.client.0.smithi110.stderr: -484> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient: monmap: 2024-03-04T12:35:05.048 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:35:05.048 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:35:05.048 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:35:05.048 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:35:05.048 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:35:05.048 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.048 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:35:05.048 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:35:05.048 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:35:05.049 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.049 INFO:tasks.workunit.client.0.smithi110.stderr: -483> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding auth protocol: cephx 2024-03-04T12:35:05.049 INFO:tasks.workunit.client.0.smithi110.stderr: -482> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding auth protocol: cephx 2024-03-04T12:35:05.049 INFO:tasks.workunit.client.0.smithi110.stderr: -481> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding auth protocol: cephx 2024-03-04T12:35:05.049 INFO:tasks.workunit.client.0.smithi110.stderr: -480> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: secure 2024-03-04T12:35:05.049 INFO:tasks.workunit.client.0.smithi110.stderr: -479> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: crc 2024-03-04T12:35:05.049 INFO:tasks.workunit.client.0.smithi110.stderr: -478> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: secure 2024-03-04T12:35:05.049 INFO:tasks.workunit.client.0.smithi110.stderr: -477> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: crc 2024-03-04T12:35:05.049 INFO:tasks.workunit.client.0.smithi110.stderr: -476> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: secure 2024-03-04T12:35:05.049 INFO:tasks.workunit.client.0.smithi110.stderr: -475> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: crc 2024-03-04T12:35:05.049 INFO:tasks.workunit.client.0.smithi110.stderr: -474> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: crc 2024-03-04T12:35:05.049 INFO:tasks.workunit.client.0.smithi110.stderr: -473> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: secure 2024-03-04T12:35:05.049 INFO:tasks.workunit.client.0.smithi110.stderr: -472> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: crc 2024-03-04T12:35:05.049 INFO:tasks.workunit.client.0.smithi110.stderr: -471> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: secure 2024-03-04T12:35:05.049 INFO:tasks.workunit.client.0.smithi110.stderr: -470> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: crc 2024-03-04T12:35:05.050 INFO:tasks.workunit.client.0.smithi110.stderr: -469> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: secure 2024-03-04T12:35:05.050 INFO:tasks.workunit.client.0.smithi110.stderr: -468> 2024-03-04T12:35:04.768+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.050 INFO:tasks.workunit.client.0.smithi110.stderr: -467> 2024-03-04T12:35:04.768+0000 7fc9c380f800 1 librados: starting msgr at 2024-03-04T12:35:05.050 INFO:tasks.workunit.client.0.smithi110.stderr: -466> 2024-03-04T12:35:04.768+0000 7fc9c380f800 1 librados: starting objecter 2024-03-04T12:35:05.050 INFO:tasks.workunit.client.0.smithi110.stderr: -465> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command objecter_requests hook 0x5562da28a7a0 2024-03-04T12:35:05.050 INFO:tasks.workunit.client.0.smithi110.stderr: -464> 2024-03-04T12:35:04.768+0000 7fc9c380f800 1 librados: setting wanted keys 2024-03-04T12:35:05.050 INFO:tasks.workunit.client.0.smithi110.stderr: -463> 2024-03-04T12:35:04.768+0000 7fc9c380f800 1 librados: calling monclient init 2024-03-04T12:35:05.050 INFO:tasks.workunit.client.0.smithi110.stderr: -462> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient: init 2024-03-04T12:35:05.050 INFO:tasks.workunit.client.0.smithi110.stderr: -461> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding auth protocol: cephx 2024-03-04T12:35:05.050 INFO:tasks.workunit.client.0.smithi110.stderr: -460> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding auth protocol: cephx 2024-03-04T12:35:05.050 INFO:tasks.workunit.client.0.smithi110.stderr: -459> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding auth protocol: cephx 2024-03-04T12:35:05.050 INFO:tasks.workunit.client.0.smithi110.stderr: -458> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: secure 2024-03-04T12:35:05.050 INFO:tasks.workunit.client.0.smithi110.stderr: -457> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: crc 2024-03-04T12:35:05.050 INFO:tasks.workunit.client.0.smithi110.stderr: -456> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: secure 2024-03-04T12:35:05.051 INFO:tasks.workunit.client.0.smithi110.stderr: -455> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: crc 2024-03-04T12:35:05.051 INFO:tasks.workunit.client.0.smithi110.stderr: -454> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: secure 2024-03-04T12:35:05.051 INFO:tasks.workunit.client.0.smithi110.stderr: -453> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: crc 2024-03-04T12:35:05.051 INFO:tasks.workunit.client.0.smithi110.stderr: -452> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: crc 2024-03-04T12:35:05.051 INFO:tasks.workunit.client.0.smithi110.stderr: -451> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: secure 2024-03-04T12:35:05.051 INFO:tasks.workunit.client.0.smithi110.stderr: -450> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: crc 2024-03-04T12:35:05.051 INFO:tasks.workunit.client.0.smithi110.stderr: -449> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: secure 2024-03-04T12:35:05.051 INFO:tasks.workunit.client.0.smithi110.stderr: -448> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: crc 2024-03-04T12:35:05.051 INFO:tasks.workunit.client.0.smithi110.stderr: -447> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: secure 2024-03-04T12:35:05.051 INFO:tasks.workunit.client.0.smithi110.stderr: -446> 2024-03-04T12:35:04.768+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.051 INFO:tasks.workunit.client.0.smithi110.stderr: -445> 2024-03-04T12:35:04.768+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.051 INFO:tasks.workunit.client.0.smithi110.stderr: -444> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command rotate-key hook 0x5562da25f2a8 2024-03-04T12:35:05.051 INFO:tasks.workunit.client.0.smithi110.stderr: -443> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient: _reopen_session rank -1 2024-03-04T12:35:05.051 INFO:tasks.workunit.client.0.smithi110.stderr: -442> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:35:05.051 INFO:tasks.workunit.client.0.smithi110.stderr: -441> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-b con 0x5562da0d6940 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:35:05.052 INFO:tasks.workunit.client.0.smithi110.stderr: -440> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-c con 0x5562da10c4a0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:35:05.052 INFO:tasks.workunit.client.0.smithi110.stderr: -439> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-a con 0x5562da264bc0 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:35:05.052 INFO:tasks.workunit.client.0.smithi110.stderr: -438> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.052 INFO:tasks.workunit.client.0.smithi110.stderr: -437> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.052 INFO:tasks.workunit.client.0.smithi110.stderr: -436> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.052 INFO:tasks.workunit.client.0.smithi110.stderr: -435> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient(hunting): _renew_subs 2024-03-04T12:35:05.052 INFO:tasks.workunit.client.0.smithi110.stderr: -434> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient(hunting): authenticate will time out at 1686.127945s 2024-03-04T12:35:05.052 INFO:tasks.workunit.client.0.smithi110.stderr: -433> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient(hunting): get_auth_request con 0x5562da10c4a0 auth_method 0 2024-03-04T12:35:05.052 INFO:tasks.workunit.client.0.smithi110.stderr: -432> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.052 INFO:tasks.workunit.client.0.smithi110.stderr: -431> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.052 INFO:tasks.workunit.client.0.smithi110.stderr: -430> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.052 INFO:tasks.workunit.client.0.smithi110.stderr: -429> 2024-03-04T12:35:04.769+0000 7fc9bf682640 10 monclient(hunting): get_auth_request con 0x5562da264bc0 auth_method 0 2024-03-04T12:35:05.052 INFO:tasks.workunit.client.0.smithi110.stderr: -428> 2024-03-04T12:35:04.769+0000 7fc9bf682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.052 INFO:tasks.workunit.client.0.smithi110.stderr: -427> 2024-03-04T12:35:04.769+0000 7fc9bf682640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.053 INFO:tasks.workunit.client.0.smithi110.stderr: -426> 2024-03-04T12:35:04.769+0000 7fc9bf682640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.053 INFO:tasks.workunit.client.0.smithi110.stderr: -425> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.053 INFO:tasks.workunit.client.0.smithi110.stderr: -424> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.053 INFO:tasks.workunit.client.0.smithi110.stderr: -423> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.053 INFO:tasks.workunit.client.0.smithi110.stderr: -422> 2024-03-04T12:35:04.769+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.053 INFO:tasks.workunit.client.0.smithi110.stderr: -421> 2024-03-04T12:35:04.769+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.053 INFO:tasks.workunit.client.0.smithi110.stderr: -420> 2024-03-04T12:35:04.769+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.053 INFO:tasks.workunit.client.0.smithi110.stderr: -419> 2024-03-04T12:35:04.769+0000 7fc9bee81640 10 monclient(hunting): get_auth_request con 0x5562da0d6940 auth_method 0 2024-03-04T12:35:05.053 INFO:tasks.workunit.client.0.smithi110.stderr: -418> 2024-03-04T12:35:04.769+0000 7fc9bee81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.053 INFO:tasks.workunit.client.0.smithi110.stderr: -417> 2024-03-04T12:35:04.769+0000 7fc9bee81640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.053 INFO:tasks.workunit.client.0.smithi110.stderr: -416> 2024-03-04T12:35:04.769+0000 7fc9bee81640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.053 INFO:tasks.workunit.client.0.smithi110.stderr: -415> 2024-03-04T12:35:04.769+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.053 INFO:tasks.workunit.client.0.smithi110.stderr: -414> 2024-03-04T12:35:04.769+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.053 INFO:tasks.workunit.client.0.smithi110.stderr: -413> 2024-03-04T12:35:04.769+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.054 INFO:tasks.workunit.client.0.smithi110.stderr: -412> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient(hunting): handle_auth_done global_id 5963 payload 824 2024-03-04T12:35:05.054 INFO:tasks.workunit.client.0.smithi110.stderr: -411> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient: _finish_hunting 0 2024-03-04T12:35:05.054 INFO:tasks.workunit.client.0.smithi110.stderr: -410> 2024-03-04T12:35:04.769+0000 7fc9b6680640 1 monclient: found mon.noname-c 2024-03-04T12:35:05.054 INFO:tasks.workunit.client.0.smithi110.stderr: -409> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.110:3301/0 2024-03-04T12:35:05.054 INFO:tasks.workunit.client.0.smithi110.stderr: -408> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.054 INFO:tasks.workunit.client.0.smithi110.stderr: -407> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:35:05.054 INFO:tasks.workunit.client.0.smithi110.stderr: -406> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: dump: 2024-03-04T12:35:05.054 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.054 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.054 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.054 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.054 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.054 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.054 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.054 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.055 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.055 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.055 INFO:tasks.workunit.client.0.smithi110.stderr: -405> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: _finish_auth 0 2024-03-04T12:35:05.055 INFO:tasks.workunit.client.0.smithi110.stderr: -404> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: _check_auth_tickets 2024-03-04T12:35:05.055 INFO:tasks.workunit.client.0.smithi110.stderr: -403> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:05.055 INFO:tasks.workunit.client.0.smithi110.stderr: -402> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.055 INFO:tasks.workunit.client.0.smithi110.stderr: -401> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:35:05.055 INFO:tasks.workunit.client.0.smithi110.stderr: -400> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: dump: 2024-03-04T12:35:05.055 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.055 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.055 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.055 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.055 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.055 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.055 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.056 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.056 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.056 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.056 INFO:tasks.workunit.client.0.smithi110.stderr: -399> 2024-03-04T12:35:04.769+0000 7fc8ace09640 4 set_mon_vals no callback set 2024-03-04T12:35:05.056 INFO:tasks.workunit.client.0.smithi110.stderr: -398> 2024-03-04T12:35:04.769+0000 7fc9c380f800 5 monclient: authenticate success, global_id 5963 2024-03-04T12:35:05.056 INFO:tasks.workunit.client.0.smithi110.stderr: -397> 2024-03-04T12:35:04.769+0000 7fc9c380f800 10 monclient: _renew_subs 2024-03-04T12:35:05.056 INFO:tasks.workunit.client.0.smithi110.stderr: -396> 2024-03-04T12:35:04.769+0000 7fc9c380f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:35:05.056 INFO:tasks.workunit.client.0.smithi110.stderr: -395> 2024-03-04T12:35:04.769+0000 7fc9c380f800 10 monclient: _renew_subs 2024-03-04T12:35:05.056 INFO:tasks.workunit.client.0.smithi110.stderr: -394> 2024-03-04T12:35:04.769+0000 7fc9c380f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:35:05.056 INFO:tasks.workunit.client.0.smithi110.stderr: -393> 2024-03-04T12:35:04.769+0000 7fc9c380f800 1 librados: init done 2024-03-04T12:35:05.056 INFO:tasks.workunit.client.0.smithi110.stderr: -392> 2024-03-04T12:35:04.771+0000 7fc8ab606640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:35:05.056 INFO:tasks.workunit.client.0.smithi110.stderr: -391> 2024-03-04T12:35:04.771+0000 7fc8ab606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:05.056 INFO:tasks.workunit.client.0.smithi110.stderr: -390> 2024-03-04T12:35:04.771+0000 7fc8ab606640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:05.057 INFO:tasks.workunit.client.0.smithi110.stderr: -389> 2024-03-04T12:35:04.772+0000 7fc9bee81640 10 monclient: get_auth_request con 0x7fc8a4069ee0 auth_method 0 2024-03-04T12:35:05.057 INFO:tasks.workunit.client.0.smithi110.stderr: -388> 2024-03-04T12:35:04.772+0000 7fc9bf682640 10 monclient: get_auth_request con 0x5562da284c20 auth_method 0 2024-03-04T12:35:05.057 INFO:tasks.workunit.client.0.smithi110.stderr: -387> 2024-03-04T12:35:04.772+0000 7fc9bee81640 10 monclient: get_auth_request con 0x5562da2aae00 auth_method 0 2024-03-04T12:35:05.057 INFO:tasks.workunit.client.0.smithi110.stderr: -386> 2024-03-04T12:35:04.774+0000 7fc9b6680640 10 monclient: get_auth_request con 0x5562da2aff90 auth_method 0 2024-03-04T12:35:05.057 INFO:tasks.workunit.client.0.smithi110.stderr: -385> 2024-03-04T12:35:04.774+0000 7fc9c380f800 10 monclient: build_initial_monmap 2024-03-04T12:35:05.057 INFO:tasks.workunit.client.0.smithi110.stderr: -384> 2024-03-04T12:35:04.774+0000 7fc9c380f800 1 build_initial for_mkfs: 0 2024-03-04T12:35:05.057 INFO:tasks.workunit.client.0.smithi110.stderr: -383> 2024-03-04T12:35:04.774+0000 7fc9c380f800 10 monclient: monmap: 2024-03-04T12:35:05.057 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:35:05.057 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:35:05.057 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:35:05.057 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:35:05.057 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:35:05.057 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.057 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:35:05.058 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:35:05.058 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:35:05.058 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.058 INFO:tasks.workunit.client.0.smithi110.stderr: -382> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding auth protocol: cephx 2024-03-04T12:35:05.058 INFO:tasks.workunit.client.0.smithi110.stderr: -381> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding auth protocol: cephx 2024-03-04T12:35:05.058 INFO:tasks.workunit.client.0.smithi110.stderr: -380> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding auth protocol: cephx 2024-03-04T12:35:05.058 INFO:tasks.workunit.client.0.smithi110.stderr: -379> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: secure 2024-03-04T12:35:05.058 INFO:tasks.workunit.client.0.smithi110.stderr: -378> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: crc 2024-03-04T12:35:05.058 INFO:tasks.workunit.client.0.smithi110.stderr: -377> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: secure 2024-03-04T12:35:05.058 INFO:tasks.workunit.client.0.smithi110.stderr: -376> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: crc 2024-03-04T12:35:05.058 INFO:tasks.workunit.client.0.smithi110.stderr: -375> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: secure 2024-03-04T12:35:05.058 INFO:tasks.workunit.client.0.smithi110.stderr: -374> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: crc 2024-03-04T12:35:05.058 INFO:tasks.workunit.client.0.smithi110.stderr: -373> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: crc 2024-03-04T12:35:05.058 INFO:tasks.workunit.client.0.smithi110.stderr: -372> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: secure 2024-03-04T12:35:05.059 INFO:tasks.workunit.client.0.smithi110.stderr: -371> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: crc 2024-03-04T12:35:05.059 INFO:tasks.workunit.client.0.smithi110.stderr: -370> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: secure 2024-03-04T12:35:05.059 INFO:tasks.workunit.client.0.smithi110.stderr: -369> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: crc 2024-03-04T12:35:05.059 INFO:tasks.workunit.client.0.smithi110.stderr: -368> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: secure 2024-03-04T12:35:05.059 INFO:tasks.workunit.client.0.smithi110.stderr: -367> 2024-03-04T12:35:04.775+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.059 INFO:tasks.workunit.client.0.smithi110.stderr: -366> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command objecter_requests cmddesc objecter_requests hook 0x5562da2b9780 EEXIST 2024-03-04T12:35:05.059 INFO:tasks.workunit.client.0.smithi110.stderr: -365> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient: init 2024-03-04T12:35:05.059 INFO:tasks.workunit.client.0.smithi110.stderr: -364> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding auth protocol: cephx 2024-03-04T12:35:05.059 INFO:tasks.workunit.client.0.smithi110.stderr: -363> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding auth protocol: cephx 2024-03-04T12:35:05.059 INFO:tasks.workunit.client.0.smithi110.stderr: -362> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding auth protocol: cephx 2024-03-04T12:35:05.059 INFO:tasks.workunit.client.0.smithi110.stderr: -361> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: secure 2024-03-04T12:35:05.059 INFO:tasks.workunit.client.0.smithi110.stderr: -360> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: crc 2024-03-04T12:35:05.059 INFO:tasks.workunit.client.0.smithi110.stderr: -359> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: secure 2024-03-04T12:35:05.059 INFO:tasks.workunit.client.0.smithi110.stderr: -358> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: crc 2024-03-04T12:35:05.059 INFO:tasks.workunit.client.0.smithi110.stderr: -357> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: secure 2024-03-04T12:35:05.060 INFO:tasks.workunit.client.0.smithi110.stderr: -356> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: crc 2024-03-04T12:35:05.060 INFO:tasks.workunit.client.0.smithi110.stderr: -355> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: crc 2024-03-04T12:35:05.060 INFO:tasks.workunit.client.0.smithi110.stderr: -354> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: secure 2024-03-04T12:35:05.060 INFO:tasks.workunit.client.0.smithi110.stderr: -353> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: crc 2024-03-04T12:35:05.060 INFO:tasks.workunit.client.0.smithi110.stderr: -352> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: secure 2024-03-04T12:35:05.060 INFO:tasks.workunit.client.0.smithi110.stderr: -351> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: crc 2024-03-04T12:35:05.060 INFO:tasks.workunit.client.0.smithi110.stderr: -350> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: secure 2024-03-04T12:35:05.060 INFO:tasks.workunit.client.0.smithi110.stderr: -349> 2024-03-04T12:35:04.775+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.060 INFO:tasks.workunit.client.0.smithi110.stderr: -348> 2024-03-04T12:35:04.775+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.060 INFO:tasks.workunit.client.0.smithi110.stderr: -347> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command rotate-key cmddesc rotate-key hook 0x5562da2b3070 EEXIST 2024-03-04T12:35:05.060 INFO:tasks.workunit.client.0.smithi110.stderr: -346> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient: _reopen_session rank -1 2024-03-04T12:35:05.060 INFO:tasks.workunit.client.0.smithi110.stderr: -345> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:35:05.060 INFO:tasks.workunit.client.0.smithi110.stderr: -344> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-b con 0x5562da2de4e0 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:35:05.060 INFO:tasks.workunit.client.0.smithi110.stderr: -343> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-c con 0x5562da2de8c0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:35:05.061 INFO:tasks.workunit.client.0.smithi110.stderr: -342> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-a con 0x5562da2f1210 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:35:05.061 INFO:tasks.workunit.client.0.smithi110.stderr: -341> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.061 INFO:tasks.workunit.client.0.smithi110.stderr: -340> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.061 INFO:tasks.workunit.client.0.smithi110.stderr: -339> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.061 INFO:tasks.workunit.client.0.smithi110.stderr: -338> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient(hunting): _renew_subs 2024-03-04T12:35:05.061 INFO:tasks.workunit.client.0.smithi110.stderr: -337> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient(hunting): authenticate will time out at 1686.134884s 2024-03-04T12:35:05.061 INFO:tasks.workunit.client.0.smithi110.stderr: -336> 2024-03-04T12:35:04.776+0000 7fc9bf682640 10 monclient(hunting): get_auth_request con 0x5562da2f1210 auth_method 0 2024-03-04T12:35:05.061 INFO:tasks.workunit.client.0.smithi110.stderr: -335> 2024-03-04T12:35:04.776+0000 7fc9bf682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.061 INFO:tasks.workunit.client.0.smithi110.stderr: -334> 2024-03-04T12:35:04.776+0000 7fc9bf682640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.061 INFO:tasks.workunit.client.0.smithi110.stderr: -333> 2024-03-04T12:35:04.776+0000 7fc9bf682640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.061 INFO:tasks.workunit.client.0.smithi110.stderr: -332> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient(hunting): get_auth_request con 0x5562da2de8c0 auth_method 0 2024-03-04T12:35:05.061 INFO:tasks.workunit.client.0.smithi110.stderr: -331> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.061 INFO:tasks.workunit.client.0.smithi110.stderr: -330> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.061 INFO:tasks.workunit.client.0.smithi110.stderr: -329> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.062 INFO:tasks.workunit.client.0.smithi110.stderr: -328> 2024-03-04T12:35:04.776+0000 7fc9bee81640 10 monclient(hunting): get_auth_request con 0x5562da2de4e0 auth_method 0 2024-03-04T12:35:05.062 INFO:tasks.workunit.client.0.smithi110.stderr: -327> 2024-03-04T12:35:04.776+0000 7fc9bee81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.062 INFO:tasks.workunit.client.0.smithi110.stderr: -326> 2024-03-04T12:35:04.776+0000 7fc9bee81640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.062 INFO:tasks.workunit.client.0.smithi110.stderr: -325> 2024-03-04T12:35:04.776+0000 7fc9bee81640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.062 INFO:tasks.workunit.client.0.smithi110.stderr: -324> 2024-03-04T12:35:04.776+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.062 INFO:tasks.workunit.client.0.smithi110.stderr: -323> 2024-03-04T12:35:04.776+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.062 INFO:tasks.workunit.client.0.smithi110.stderr: -322> 2024-03-04T12:35:04.776+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.062 INFO:tasks.workunit.client.0.smithi110.stderr: -321> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.062 INFO:tasks.workunit.client.0.smithi110.stderr: -320> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.062 INFO:tasks.workunit.client.0.smithi110.stderr: -319> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.062 INFO:tasks.workunit.client.0.smithi110.stderr: -318> 2024-03-04T12:35:04.776+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.062 INFO:tasks.workunit.client.0.smithi110.stderr: -317> 2024-03-04T12:35:04.776+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.062 INFO:tasks.workunit.client.0.smithi110.stderr: -316> 2024-03-04T12:35:04.776+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.062 INFO:tasks.workunit.client.0.smithi110.stderr: -315> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient(hunting): handle_auth_done global_id 5966 payload 824 2024-03-04T12:35:05.063 INFO:tasks.workunit.client.0.smithi110.stderr: -314> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient: _finish_hunting 0 2024-03-04T12:35:05.063 INFO:tasks.workunit.client.0.smithi110.stderr: -313> 2024-03-04T12:35:04.776+0000 7fc9b6680640 1 monclient: found mon.noname-c 2024-03-04T12:35:05.063 INFO:tasks.workunit.client.0.smithi110.stderr: -312> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.110:3301/0 2024-03-04T12:35:05.063 INFO:tasks.workunit.client.0.smithi110.stderr: -311> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.063 INFO:tasks.workunit.client.0.smithi110.stderr: -310> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:35:05.063 INFO:tasks.workunit.client.0.smithi110.stderr: -309> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: dump: 2024-03-04T12:35:05.063 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.063 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.063 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.063 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.063 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.063 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.063 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.063 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.063 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.064 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.064 INFO:tasks.workunit.client.0.smithi110.stderr: -308> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: _finish_auth 0 2024-03-04T12:35:05.064 INFO:tasks.workunit.client.0.smithi110.stderr: -307> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: _check_auth_tickets 2024-03-04T12:35:05.064 INFO:tasks.workunit.client.0.smithi110.stderr: -306> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:05.064 INFO:tasks.workunit.client.0.smithi110.stderr: -305> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.064 INFO:tasks.workunit.client.0.smithi110.stderr: -304> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:35:05.064 INFO:tasks.workunit.client.0.smithi110.stderr: -303> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: dump: 2024-03-04T12:35:05.064 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.064 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.064 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.064 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.064 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.064 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.064 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.065 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.065 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.065 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.065 INFO:tasks.workunit.client.0.smithi110.stderr: -302> 2024-03-04T12:35:04.776+0000 7fc9c380f800 5 monclient: authenticate success, global_id 5966 2024-03-04T12:35:05.065 INFO:tasks.workunit.client.0.smithi110.stderr: -301> 2024-03-04T12:35:04.776+0000 7fc9bfe83640 4 set_mon_vals no callback set 2024-03-04T12:35:05.065 INFO:tasks.workunit.client.0.smithi110.stderr: -300> 2024-03-04T12:35:04.776+0000 7fc9c380f800 10 monclient: _renew_subs 2024-03-04T12:35:05.065 INFO:tasks.workunit.client.0.smithi110.stderr: -299> 2024-03-04T12:35:04.776+0000 7fc9c380f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:35:05.065 INFO:tasks.workunit.client.0.smithi110.stderr: -298> 2024-03-04T12:35:04.776+0000 7fc9c380f800 10 monclient: _renew_subs 2024-03-04T12:35:05.065 INFO:tasks.workunit.client.0.smithi110.stderr: -297> 2024-03-04T12:35:04.776+0000 7fc9c380f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:35:05.065 INFO:tasks.workunit.client.0.smithi110.stderr: -296> 2024-03-04T12:35:04.778+0000 7fc8a8e01640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:35:05.065 INFO:tasks.workunit.client.0.smithi110.stderr: -295> 2024-03-04T12:35:04.778+0000 7fc8a8e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:05.065 INFO:tasks.workunit.client.0.smithi110.stderr: -294> 2024-03-04T12:35:04.778+0000 7fc8a8e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:05.065 INFO:tasks.workunit.client.0.smithi110.stderr: -293> 2024-03-04T12:35:04.778+0000 7fc9bee81640 10 monclient: get_auth_request con 0x7fc898069dc0 auth_method 0 2024-03-04T12:35:05.065 INFO:tasks.workunit.client.0.smithi110.stderr: -292> 2024-03-04T12:35:04.778+0000 7fc9c380f800 10 monclient: get_monmap_and_config 2024-03-04T12:35:05.066 INFO:tasks.workunit.client.0.smithi110.stderr: -291> 2024-03-04T12:35:04.778+0000 7fc9c380f800 10 monclient: build_initial_monmap 2024-03-04T12:35:05.066 INFO:tasks.workunit.client.0.smithi110.stderr: -290> 2024-03-04T12:35:04.778+0000 7fc9c380f800 1 build_initial for_mkfs: 0 2024-03-04T12:35:05.066 INFO:tasks.workunit.client.0.smithi110.stderr: -289> 2024-03-04T12:35:04.778+0000 7fc9c380f800 10 monclient: monmap: 2024-03-04T12:35:05.066 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:35:05.066 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:35:05.066 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:35:05.066 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:35:05.066 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:35:05.066 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.066 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:35:05.066 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:35:05.066 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:35:05.066 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.066 INFO:tasks.workunit.client.0.smithi110.stderr: -288> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding auth protocol: cephx 2024-03-04T12:35:05.066 INFO:tasks.workunit.client.0.smithi110.stderr: -287> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding auth protocol: cephx 2024-03-04T12:35:05.067 INFO:tasks.workunit.client.0.smithi110.stderr: -286> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding auth protocol: cephx 2024-03-04T12:35:05.067 INFO:tasks.workunit.client.0.smithi110.stderr: -285> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.067 INFO:tasks.workunit.client.0.smithi110.stderr: -284> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.067 INFO:tasks.workunit.client.0.smithi110.stderr: -283> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.067 INFO:tasks.workunit.client.0.smithi110.stderr: -282> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.067 INFO:tasks.workunit.client.0.smithi110.stderr: -281> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.067 INFO:tasks.workunit.client.0.smithi110.stderr: -280> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.067 INFO:tasks.workunit.client.0.smithi110.stderr: -279> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.067 INFO:tasks.workunit.client.0.smithi110.stderr: -278> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.067 INFO:tasks.workunit.client.0.smithi110.stderr: -277> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.067 INFO:tasks.workunit.client.0.smithi110.stderr: -276> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.067 INFO:tasks.workunit.client.0.smithi110.stderr: -275> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.067 INFO:tasks.workunit.client.0.smithi110.stderr: -274> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.067 INFO:tasks.workunit.client.0.smithi110.stderr: -273> 2024-03-04T12:35:04.778+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.067 INFO:tasks.workunit.client.0.smithi110.stderr: -272> 2024-03-04T12:35:04.778+0000 7fc9c380f800 10 monclient: init 2024-03-04T12:35:05.068 INFO:tasks.workunit.client.0.smithi110.stderr: -271> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding auth protocol: cephx 2024-03-04T12:35:05.068 INFO:tasks.workunit.client.0.smithi110.stderr: -270> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding auth protocol: cephx 2024-03-04T12:35:05.068 INFO:tasks.workunit.client.0.smithi110.stderr: -269> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding auth protocol: cephx 2024-03-04T12:35:05.068 INFO:tasks.workunit.client.0.smithi110.stderr: -268> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: secure 2024-03-04T12:35:05.068 INFO:tasks.workunit.client.0.smithi110.stderr: -267> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: crc 2024-03-04T12:35:05.068 INFO:tasks.workunit.client.0.smithi110.stderr: -266> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: secure 2024-03-04T12:35:05.068 INFO:tasks.workunit.client.0.smithi110.stderr: -265> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: crc 2024-03-04T12:35:05.068 INFO:tasks.workunit.client.0.smithi110.stderr: -264> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: secure 2024-03-04T12:35:05.068 INFO:tasks.workunit.client.0.smithi110.stderr: -263> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: crc 2024-03-04T12:35:05.068 INFO:tasks.workunit.client.0.smithi110.stderr: -262> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: crc 2024-03-04T12:35:05.068 INFO:tasks.workunit.client.0.smithi110.stderr: -261> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: secure 2024-03-04T12:35:05.068 INFO:tasks.workunit.client.0.smithi110.stderr: -260> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: crc 2024-03-04T12:35:05.068 INFO:tasks.workunit.client.0.smithi110.stderr: -259> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: secure 2024-03-04T12:35:05.069 INFO:tasks.workunit.client.0.smithi110.stderr: -258> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: crc 2024-03-04T12:35:05.069 INFO:tasks.workunit.client.0.smithi110.stderr: -257> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: secure 2024-03-04T12:35:05.069 INFO:tasks.workunit.client.0.smithi110.stderr: -256> 2024-03-04T12:35:04.779+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.069 INFO:tasks.workunit.client.0.smithi110.stderr: -255> 2024-03-04T12:35:04.779+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.069 INFO:tasks.workunit.client.0.smithi110.stderr: -254> 2024-03-04T12:35:04.779+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command rotate-key cmddesc rotate-key hook 0x7fff8c35d8f8 EEXIST 2024-03-04T12:35:05.069 INFO:tasks.workunit.client.0.smithi110.stderr: -253> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient: _reopen_session rank -1 2024-03-04T12:35:05.069 INFO:tasks.workunit.client.0.smithi110.stderr: -252> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-04T12:35:05.069 INFO:tasks.workunit.client.0.smithi110.stderr: -251> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-a con 0x5562da3308e0 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:35:05.069 INFO:tasks.workunit.client.0.smithi110.stderr: -250> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-b con 0x5562da3226a0 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:35:05.069 INFO:tasks.workunit.client.0.smithi110.stderr: -249> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-c con 0x5562da3233b0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:35:05.069 INFO:tasks.workunit.client.0.smithi110.stderr: -248> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.069 INFO:tasks.workunit.client.0.smithi110.stderr: -247> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.069 INFO:tasks.workunit.client.0.smithi110.stderr: -246> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.070 INFO:tasks.workunit.client.0.smithi110.stderr: -245> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient(hunting): _renew_subs 2024-03-04T12:35:05.070 INFO:tasks.workunit.client.0.smithi110.stderr: -244> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient(hunting): authenticate will time out at 1686.138335s 2024-03-04T12:35:05.070 INFO:tasks.workunit.client.0.smithi110.stderr: -243> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient(hunting): get_auth_request con 0x5562da3308e0 auth_method 0 2024-03-04T12:35:05.070 INFO:tasks.workunit.client.0.smithi110.stderr: -242> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.070 INFO:tasks.workunit.client.0.smithi110.stderr: -241> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.070 INFO:tasks.workunit.client.0.smithi110.stderr: -240> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.070 INFO:tasks.workunit.client.0.smithi110.stderr: -239> 2024-03-04T12:35:04.779+0000 7fc9bf682640 10 monclient(hunting): get_auth_request con 0x5562da3233b0 auth_method 0 2024-03-04T12:35:05.070 INFO:tasks.workunit.client.0.smithi110.stderr: -238> 2024-03-04T12:35:04.779+0000 7fc9bf682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.070 INFO:tasks.workunit.client.0.smithi110.stderr: -237> 2024-03-04T12:35:04.779+0000 7fc9bf682640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.070 INFO:tasks.workunit.client.0.smithi110.stderr: -236> 2024-03-04T12:35:04.779+0000 7fc9bf682640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.070 INFO:tasks.workunit.client.0.smithi110.stderr: -235> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.070 INFO:tasks.workunit.client.0.smithi110.stderr: -234> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.070 INFO:tasks.workunit.client.0.smithi110.stderr: -233> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.070 INFO:tasks.workunit.client.0.smithi110.stderr: -232> 2024-03-04T12:35:04.779+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.071 INFO:tasks.workunit.client.0.smithi110.stderr: -231> 2024-03-04T12:35:04.779+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.071 INFO:tasks.workunit.client.0.smithi110.stderr: -230> 2024-03-04T12:35:04.779+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.071 INFO:tasks.workunit.client.0.smithi110.stderr: -229> 2024-03-04T12:35:04.779+0000 7fc9b6680640 10 monclient(hunting): get_auth_request con 0x5562da3226a0 auth_method 0 2024-03-04T12:35:05.071 INFO:tasks.workunit.client.0.smithi110.stderr: -228> 2024-03-04T12:35:04.779+0000 7fc9b6680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.071 INFO:tasks.workunit.client.0.smithi110.stderr: -227> 2024-03-04T12:35:04.779+0000 7fc9b6680640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.071 INFO:tasks.workunit.client.0.smithi110.stderr: -226> 2024-03-04T12:35:04.779+0000 7fc9b6680640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.071 INFO:tasks.workunit.client.0.smithi110.stderr: -225> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient(hunting): handle_auth_done global_id 6375 payload 274 2024-03-04T12:35:05.071 INFO:tasks.workunit.client.0.smithi110.stderr: -224> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient: _finish_hunting 0 2024-03-04T12:35:05.071 INFO:tasks.workunit.client.0.smithi110.stderr: -223> 2024-03-04T12:35:04.779+0000 7fc9bee81640 1 monclient: found mon.noname-a 2024-03-04T12:35:05.071 INFO:tasks.workunit.client.0.smithi110.stderr: -222> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:35:05.071 INFO:tasks.workunit.client.0.smithi110.stderr: -221> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.071 INFO:tasks.workunit.client.0.smithi110.stderr: -220> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:35:05.071 INFO:tasks.workunit.client.0.smithi110.stderr: -219> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: dump: 2024-03-04T12:35:05.071 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.071 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.072 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.072 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.072 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.072 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.072 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.072 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.072 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.072 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.072 INFO:tasks.workunit.client.0.smithi110.stderr: -218> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: _finish_auth 0 2024-03-04T12:35:05.072 INFO:tasks.workunit.client.0.smithi110.stderr: -217> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: _check_auth_tickets 2024-03-04T12:35:05.072 INFO:tasks.workunit.client.0.smithi110.stderr: -216> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:05.072 INFO:tasks.workunit.client.0.smithi110.stderr: -215> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.072 INFO:tasks.workunit.client.0.smithi110.stderr: -214> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:35:05.072 INFO:tasks.workunit.client.0.smithi110.stderr: -213> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: dump: 2024-03-04T12:35:05.073 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.073 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.073 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.073 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.073 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.073 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.073 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.073 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.073 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.073 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.073 INFO:tasks.workunit.client.0.smithi110.stderr: -212> 2024-03-04T12:35:04.779+0000 7fc9c380f800 5 monclient: authenticate success, global_id 6375 2024-03-04T12:35:05.073 INFO:tasks.workunit.client.0.smithi110.stderr: -211> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient: get_monmap_and_config success 2024-03-04T12:35:05.073 INFO:tasks.workunit.client.0.smithi110.stderr: -210> 2024-03-04T12:35:04.779+0000 7fc9c380f800 4 set_mon_vals no callback set 2024-03-04T12:35:05.073 INFO:tasks.workunit.client.0.smithi110.stderr: -209> 2024-03-04T12:35:04.780+0000 7fc9c380f800 10 monclient: shutdown 2024-03-04T12:35:05.074 INFO:tasks.workunit.client.0.smithi110.stderr: -208> 2024-03-04T12:35:04.780+0000 7fc9c380f800 10 monclient: build_initial_monmap 2024-03-04T12:35:05.074 INFO:tasks.workunit.client.0.smithi110.stderr: -207> 2024-03-04T12:35:04.780+0000 7fc9c380f800 1 build_initial for_mkfs: 0 2024-03-04T12:35:05.074 INFO:tasks.workunit.client.0.smithi110.stderr: -206> 2024-03-04T12:35:04.780+0000 7fc9c380f800 10 monclient: monmap: 2024-03-04T12:35:05.074 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:35:05.074 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:35:05.074 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:35:05.074 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:35:05.074 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:35:05.074 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.074 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:35:05.074 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:35:05.074 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:35:05.074 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.074 INFO:tasks.workunit.client.0.smithi110.stderr: -205> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding auth protocol: cephx 2024-03-04T12:35:05.075 INFO:tasks.workunit.client.0.smithi110.stderr: -204> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding auth protocol: cephx 2024-03-04T12:35:05.075 INFO:tasks.workunit.client.0.smithi110.stderr: -203> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding auth protocol: cephx 2024-03-04T12:35:05.075 INFO:tasks.workunit.client.0.smithi110.stderr: -202> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.075 INFO:tasks.workunit.client.0.smithi110.stderr: -201> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.075 INFO:tasks.workunit.client.0.smithi110.stderr: -200> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.075 INFO:tasks.workunit.client.0.smithi110.stderr: -199> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.075 INFO:tasks.workunit.client.0.smithi110.stderr: -198> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.075 INFO:tasks.workunit.client.0.smithi110.stderr: -197> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.075 INFO:tasks.workunit.client.0.smithi110.stderr: -196> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.075 INFO:tasks.workunit.client.0.smithi110.stderr: -195> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.075 INFO:tasks.workunit.client.0.smithi110.stderr: -194> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.075 INFO:tasks.workunit.client.0.smithi110.stderr: -193> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.075 INFO:tasks.workunit.client.0.smithi110.stderr: -192> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.075 INFO:tasks.workunit.client.0.smithi110.stderr: -191> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.076 INFO:tasks.workunit.client.0.smithi110.stderr: -190> 2024-03-04T12:35:04.780+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.076 INFO:tasks.workunit.client.0.smithi110.stderr: -189> 2024-03-04T12:35:04.780+0000 7fc9c380f800 1 librados: starting msgr at 2024-03-04T12:35:05.076 INFO:tasks.workunit.client.0.smithi110.stderr: -188> 2024-03-04T12:35:04.780+0000 7fc9c380f800 1 librados: starting objecter 2024-03-04T12:35:05.076 INFO:tasks.workunit.client.0.smithi110.stderr: -187> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command objecter_requests cmddesc objecter_requests hook 0x5562da2f18d0 EEXIST 2024-03-04T12:35:05.076 INFO:tasks.workunit.client.0.smithi110.stderr: -186> 2024-03-04T12:35:04.780+0000 7fc9c380f800 1 librados: setting wanted keys 2024-03-04T12:35:05.076 INFO:tasks.workunit.client.0.smithi110.stderr: -185> 2024-03-04T12:35:04.780+0000 7fc9c380f800 1 librados: calling monclient init 2024-03-04T12:35:05.076 INFO:tasks.workunit.client.0.smithi110.stderr: -184> 2024-03-04T12:35:04.780+0000 7fc9c380f800 10 monclient: init 2024-03-04T12:35:05.076 INFO:tasks.workunit.client.0.smithi110.stderr: -183> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding auth protocol: cephx 2024-03-04T12:35:05.076 INFO:tasks.workunit.client.0.smithi110.stderr: -182> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding auth protocol: cephx 2024-03-04T12:35:05.076 INFO:tasks.workunit.client.0.smithi110.stderr: -181> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding auth protocol: cephx 2024-03-04T12:35:05.076 INFO:tasks.workunit.client.0.smithi110.stderr: -180> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: secure 2024-03-04T12:35:05.076 INFO:tasks.workunit.client.0.smithi110.stderr: -179> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: crc 2024-03-04T12:35:05.076 INFO:tasks.workunit.client.0.smithi110.stderr: -178> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: secure 2024-03-04T12:35:05.076 INFO:tasks.workunit.client.0.smithi110.stderr: -177> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: crc 2024-03-04T12:35:05.077 INFO:tasks.workunit.client.0.smithi110.stderr: -176> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: secure 2024-03-04T12:35:05.077 INFO:tasks.workunit.client.0.smithi110.stderr: -175> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: crc 2024-03-04T12:35:05.077 INFO:tasks.workunit.client.0.smithi110.stderr: -174> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: crc 2024-03-04T12:35:05.077 INFO:tasks.workunit.client.0.smithi110.stderr: -173> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: secure 2024-03-04T12:35:05.077 INFO:tasks.workunit.client.0.smithi110.stderr: -172> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: crc 2024-03-04T12:35:05.077 INFO:tasks.workunit.client.0.smithi110.stderr: -171> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: secure 2024-03-04T12:35:05.077 INFO:tasks.workunit.client.0.smithi110.stderr: -170> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: crc 2024-03-04T12:35:05.077 INFO:tasks.workunit.client.0.smithi110.stderr: -169> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: secure 2024-03-04T12:35:05.077 INFO:tasks.workunit.client.0.smithi110.stderr: -168> 2024-03-04T12:35:04.781+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.077 INFO:tasks.workunit.client.0.smithi110.stderr: -167> 2024-03-04T12:35:04.781+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.077 INFO:tasks.workunit.client.0.smithi110.stderr: -166> 2024-03-04T12:35:04.781+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command rotate-key cmddesc rotate-key hook 0x5562da2fb348 EEXIST 2024-03-04T12:35:05.077 INFO:tasks.workunit.client.0.smithi110.stderr: -165> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient: _reopen_session rank -1 2024-03-04T12:35:05.077 INFO:tasks.workunit.client.0.smithi110.stderr: -164> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-04T12:35:05.077 INFO:tasks.workunit.client.0.smithi110.stderr: -163> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-c con 0x5562da3226a0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:35:05.077 INFO:tasks.workunit.client.0.smithi110.stderr: -162> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-b con 0x5562da3233b0 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:35:05.078 INFO:tasks.workunit.client.0.smithi110.stderr: -161> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-a con 0x5562da3308e0 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:35:05.078 INFO:tasks.workunit.client.0.smithi110.stderr: -160> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.078 INFO:tasks.workunit.client.0.smithi110.stderr: -159> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.078 INFO:tasks.workunit.client.0.smithi110.stderr: -158> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.078 INFO:tasks.workunit.client.0.smithi110.stderr: -157> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient(hunting): _renew_subs 2024-03-04T12:35:05.078 INFO:tasks.workunit.client.0.smithi110.stderr: -156> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient(hunting): authenticate will time out at 1686.140484s 2024-03-04T12:35:05.078 INFO:tasks.workunit.client.0.smithi110.stderr: -155> 2024-03-04T12:35:04.781+0000 7fc9bee81640 10 monclient(hunting): get_auth_request con 0x5562da3226a0 auth_method 0 2024-03-04T12:35:05.078 INFO:tasks.workunit.client.0.smithi110.stderr: -154> 2024-03-04T12:35:04.781+0000 7fc9bee81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.078 INFO:tasks.workunit.client.0.smithi110.stderr: -153> 2024-03-04T12:35:04.781+0000 7fc9bee81640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.078 INFO:tasks.workunit.client.0.smithi110.stderr: -152> 2024-03-04T12:35:04.781+0000 7fc9bee81640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.078 INFO:tasks.workunit.client.0.smithi110.stderr: -151> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient(hunting): get_auth_request con 0x5562da3308e0 auth_method 0 2024-03-04T12:35:05.078 INFO:tasks.workunit.client.0.smithi110.stderr: -150> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.078 INFO:tasks.workunit.client.0.smithi110.stderr: -149> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.078 INFO:tasks.workunit.client.0.smithi110.stderr: -148> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.079 INFO:tasks.workunit.client.0.smithi110.stderr: -147> 2024-03-04T12:35:04.781+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.079 INFO:tasks.workunit.client.0.smithi110.stderr: -146> 2024-03-04T12:35:04.781+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.079 INFO:tasks.workunit.client.0.smithi110.stderr: -145> 2024-03-04T12:35:04.781+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.079 INFO:tasks.workunit.client.0.smithi110.stderr: -144> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.079 INFO:tasks.workunit.client.0.smithi110.stderr: -143> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.079 INFO:tasks.workunit.client.0.smithi110.stderr: -142> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.079 INFO:tasks.workunit.client.0.smithi110.stderr: -141> 2024-03-04T12:35:04.781+0000 7fc9b6680640 10 monclient(hunting): get_auth_request con 0x5562da3233b0 auth_method 0 2024-03-04T12:35:05.079 INFO:tasks.workunit.client.0.smithi110.stderr: -140> 2024-03-04T12:35:04.781+0000 7fc9b6680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.079 INFO:tasks.workunit.client.0.smithi110.stderr: -139> 2024-03-04T12:35:04.781+0000 7fc9b6680640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.079 INFO:tasks.workunit.client.0.smithi110.stderr: -138> 2024-03-04T12:35:04.781+0000 7fc9b6680640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.079 INFO:tasks.workunit.client.0.smithi110.stderr: -137> 2024-03-04T12:35:04.781+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.079 INFO:tasks.workunit.client.0.smithi110.stderr: -136> 2024-03-04T12:35:04.781+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.079 INFO:tasks.workunit.client.0.smithi110.stderr: -135> 2024-03-04T12:35:04.781+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.079 INFO:tasks.workunit.client.0.smithi110.stderr: -134> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient(hunting): handle_auth_done global_id 6378 payload 824 2024-03-04T12:35:05.079 INFO:tasks.workunit.client.0.smithi110.stderr: -133> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient: _finish_hunting 0 2024-03-04T12:35:05.080 INFO:tasks.workunit.client.0.smithi110.stderr: -132> 2024-03-04T12:35:04.781+0000 7fc9bf682640 1 monclient: found mon.noname-a 2024-03-04T12:35:05.080 INFO:tasks.workunit.client.0.smithi110.stderr: -131> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:35:05.080 INFO:tasks.workunit.client.0.smithi110.stderr: -130> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.080 INFO:tasks.workunit.client.0.smithi110.stderr: -129> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:35:05.080 INFO:tasks.workunit.client.0.smithi110.stderr: -128> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: dump: 2024-03-04T12:35:05.080 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.080 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.080 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.080 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.080 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.080 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.080 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.080 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.081 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.081 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.081 INFO:tasks.workunit.client.0.smithi110.stderr: -127> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: _finish_auth 0 2024-03-04T12:35:05.081 INFO:tasks.workunit.client.0.smithi110.stderr: -126> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: _check_auth_tickets 2024-03-04T12:35:05.081 INFO:tasks.workunit.client.0.smithi110.stderr: -125> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:05.081 INFO:tasks.workunit.client.0.smithi110.stderr: -124> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.081 INFO:tasks.workunit.client.0.smithi110.stderr: -123> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:35:05.081 INFO:tasks.workunit.client.0.smithi110.stderr: -122> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: dump: 2024-03-04T12:35:05.081 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.081 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.081 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.081 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.081 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.081 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.082 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.082 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.082 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.082 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.082 INFO:tasks.workunit.client.0.smithi110.stderr: -121> 2024-03-04T12:35:04.782+0000 7fc8a27fc640 4 set_mon_vals no callback set 2024-03-04T12:35:05.082 INFO:tasks.workunit.client.0.smithi110.stderr: -120> 2024-03-04T12:35:04.782+0000 7fc9c380f800 5 monclient: authenticate success, global_id 6378 2024-03-04T12:35:05.082 INFO:tasks.workunit.client.0.smithi110.stderr: -119> 2024-03-04T12:35:04.782+0000 7fc9c380f800 10 monclient: _renew_subs 2024-03-04T12:35:05.082 INFO:tasks.workunit.client.0.smithi110.stderr: -118> 2024-03-04T12:35:04.782+0000 7fc9c380f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:05.082 INFO:tasks.workunit.client.0.smithi110.stderr: -117> 2024-03-04T12:35:04.782+0000 7fc9c380f800 10 monclient: _renew_subs 2024-03-04T12:35:05.082 INFO:tasks.workunit.client.0.smithi110.stderr: -116> 2024-03-04T12:35:04.782+0000 7fc9c380f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:05.082 INFO:tasks.workunit.client.0.smithi110.stderr: -115> 2024-03-04T12:35:04.782+0000 7fc9c380f800 1 librados: init done 2024-03-04T12:35:05.082 INFO:tasks.workunit.client.0.smithi110.stderr: -114> 2024-03-04T12:35:04.782+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command cr dump hook 0x5562da326968 2024-03-04T12:35:05.082 INFO:tasks.workunit.client.0.smithi110.stderr: -113> 2024-03-04T12:35:04.783+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.082 INFO:tasks.workunit.client.0.smithi110.stderr: -112> 2024-03-04T12:35:04.783+0000 7fc8a0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:35:05.083 INFO:tasks.workunit.client.0.smithi110.stderr: -111> 2024-03-04T12:35:04.783+0000 7fc8a0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:05.083 INFO:tasks.workunit.client.0.smithi110.stderr: -110> 2024-03-04T12:35:04.783+0000 7fc8a0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:05.083 INFO:tasks.workunit.client.0.smithi110.stderr: -109> 2024-03-04T12:35:04.784+0000 7fc9bee81640 10 monclient: get_auth_request con 0x7fc888069eb0 auth_method 0 2024-03-04T12:35:05.083 INFO:tasks.workunit.client.0.smithi110.stderr: -108> 2024-03-04T12:35:04.784+0000 7fc9b6680640 10 monclient: get_auth_request con 0x5562da34b740 auth_method 0 2024-03-04T12:35:05.083 INFO:tasks.workunit.client.0.smithi110.stderr: -107> 2024-03-04T12:35:04.784+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.083 INFO:tasks.workunit.client.0.smithi110.stderr: -106> 2024-03-04T12:35:04.784+0000 7fc9c380f800 20 realm 2024-03-04T12:35:05.083 INFO:tasks.workunit.client.0.smithi110.stderr: -105> 2024-03-04T12:35:04.784+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.083 INFO:tasks.workunit.client.0.smithi110.stderr: -104> 2024-03-04T12:35:04.784+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.083 INFO:tasks.workunit.client.0.smithi110.stderr: -103> 2024-03-04T12:35:04.784+0000 7fc9c380f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:05.083 INFO:tasks.workunit.client.0.smithi110.stderr: -102> 2024-03-04T12:35:04.784+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.083 INFO:tasks.workunit.client.0.smithi110.stderr: -101> 2024-03-04T12:35:04.785+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.083 INFO:tasks.workunit.client.0.smithi110.stderr: -100> 2024-03-04T12:35:04.785+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.084 INFO:tasks.workunit.client.0.smithi110.stderr: -99> 2024-03-04T12:35:04.785+0000 7fc9bee81640 10 monclient: get_auth_request con 0x5562da34f930 auth_method 0 2024-03-04T12:35:05.084 INFO:tasks.workunit.client.0.smithi110.stderr: -98> 2024-03-04T12:35:04.785+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:05.084 INFO:tasks.workunit.client.0.smithi110.stderr: -97> 2024-03-04T12:35:04.785+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.084 INFO:tasks.workunit.client.0.smithi110.stderr: -96> 2024-03-04T12:35:04.786+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:05.084 INFO:tasks.workunit.client.0.smithi110.stderr: -95> 2024-03-04T12:35:04.786+0000 7fc9c380f800 20 searching for the correct realm 2024-03-04T12:35:05.084 INFO:tasks.workunit.client.0.smithi110.stderr: -94> 2024-03-04T12:35:04.786+0000 7fc9b6680640 10 monclient: get_auth_request con 0x5562da3547d0 auth_method 0 2024-03-04T12:35:05.084 INFO:tasks.workunit.client.0.smithi110.stderr: -93> 2024-03-04T12:35:04.787+0000 7fc9bf682640 10 monclient: get_auth_request con 0x7fc9a8017070 auth_method 0 2024-03-04T12:35:05.084 INFO:tasks.workunit.client.0.smithi110.stderr: -92> 2024-03-04T12:35:04.787+0000 7fc9bee81640 10 monclient: get_auth_request con 0x7fc9b8031060 auth_method 0 2024-03-04T12:35:05.084 INFO:tasks.workunit.client.0.smithi110.stderr: -91> 2024-03-04T12:35:04.788+0000 7fc9b6680640 10 monclient: get_auth_request con 0x7fc9b0089070 auth_method 0 2024-03-04T12:35:05.084 INFO:tasks.workunit.client.0.smithi110.stderr: -90> 2024-03-04T12:35:04.789+0000 7fc9b6680640 0 -- 172.21.15.110:0/1659756204 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7fc9b0089070 msgr2=0x7fc9b005b450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:05.084 INFO:tasks.workunit.client.0.smithi110.stderr: -89> 2024-03-04T12:35:04.789+0000 7fc8a0ff9640 1 client.6378.objecter ms_handle_reset 0x7fc9b0089070 session 0x7fc9b006c040 osd.4 2024-03-04T12:35:05.084 INFO:tasks.workunit.client.0.smithi110.stderr: -88> 2024-03-04T12:35:04.789+0000 7fc8a0ff9640 10 monclient: _renew_subs 2024-03-04T12:35:05.084 INFO:tasks.workunit.client.0.smithi110.stderr: -87> 2024-03-04T12:35:04.789+0000 7fc8a0ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:05.084 INFO:tasks.workunit.client.0.smithi110.stderr: -86> 2024-03-04T12:35:04.789+0000 7fc9b6680640 10 monclient: get_auth_request con 0x7fc888079c50 auth_method 0 2024-03-04T12:35:05.085 INFO:tasks.workunit.client.0.smithi110.stderr: -85> 2024-03-04T12:35:04.790+0000 7fc9bf682640 10 monclient: get_auth_request con 0x7fc9a800e070 auth_method 0 2024-03-04T12:35:05.085 INFO:tasks.workunit.client.0.smithi110.stderr: -84> 2024-03-04T12:35:04.792+0000 7fc9bee81640 10 monclient: get_auth_request con 0x7fc9a8060a30 auth_method 0 2024-03-04T12:35:05.085 INFO:tasks.workunit.client.0.smithi110.stderr: -83> 2024-03-04T12:35:04.792+0000 7fc9bee81640 0 -- 172.21.15.110:0/1659756204 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fc9a8060a30 msgr2=0x7fc9a8065790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:05.085 INFO:tasks.workunit.client.0.smithi110.stderr: -82> 2024-03-04T12:35:04.993+0000 7fc9bee81640 10 monclient: get_auth_request con 0x7fc9a8060a30 auth_method 0 2024-03-04T12:35:05.085 INFO:tasks.workunit.client.0.smithi110.stderr: -81> 2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:05.085 INFO:tasks.workunit.client.0.smithi110.stderr: -80> 2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:05.085 INFO:tasks.workunit.client.0.smithi110.stderr: -79> 2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:05.085 INFO:tasks.workunit.client.0.smithi110.stderr: -78> 2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:05.085 INFO:tasks.workunit.client.0.smithi110.stderr: -77> 2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:05.085 INFO:tasks.workunit.client.0.smithi110.stderr: -76> 2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:05.085 INFO:tasks.workunit.client.0.smithi110.stderr: -75> 2024-03-04T12:35:04.998+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.085 INFO:tasks.workunit.client.0.smithi110.stderr: -74> 2024-03-04T12:35:04.998+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.085 INFO:tasks.workunit.client.0.smithi110.stderr: -73> 2024-03-04T12:35:04.998+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.085 INFO:tasks.workunit.client.0.smithi110.stderr: -72> 2024-03-04T12:35:04.998+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:05.085 INFO:tasks.workunit.client.0.smithi110.stderr: -71> 2024-03-04T12:35:04.998+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.086 INFO:tasks.workunit.client.0.smithi110.stderr: -70> 2024-03-04T12:35:04.999+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:05.086 INFO:tasks.workunit.client.0.smithi110.stderr: -69> 2024-03-04T12:35:04.999+0000 7fc9c380f800 20 zone default found 2024-03-04T12:35:05.086 INFO:tasks.workunit.client.0.smithi110.stderr: -68> 2024-03-04T12:35:04.999+0000 7fc9c380f800 4 Realm: () 2024-03-04T12:35:05.086 INFO:tasks.workunit.client.0.smithi110.stderr: -67> 2024-03-04T12:35:04.999+0000 7fc9c380f800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:05.086 INFO:tasks.workunit.client.0.smithi110.stderr: -66> 2024-03-04T12:35:04.999+0000 7fc9c380f800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:05.086 INFO:tasks.workunit.client.0.smithi110.stderr: -65> 2024-03-04T12:35:04.999+0000 7fc9c380f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:05.086 INFO:tasks.workunit.client.0.smithi110.stderr: -64> 2024-03-04T12:35:04.999+0000 7fc9c380f800 20 zonegroup default 2024-03-04T12:35:05.086 INFO:tasks.workunit.client.0.smithi110.stderr: -63> 2024-03-04T12:35:04.999+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.086 INFO:tasks.workunit.client.0.smithi110.stderr: -62> 2024-03-04T12:35:04.999+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.086 INFO:tasks.workunit.client.0.smithi110.stderr: -61> 2024-03-04T12:35:04.999+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.086 INFO:tasks.workunit.client.0.smithi110.stderr: -60> 2024-03-04T12:35:05.000+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.086 INFO:tasks.workunit.client.0.smithi110.stderr: -59> 2024-03-04T12:35:05.000+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.086 INFO:tasks.workunit.client.0.smithi110.stderr: -58> 2024-03-04T12:35:05.000+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.086 INFO:tasks.workunit.client.0.smithi110.stderr: -57> 2024-03-04T12:35:05.000+0000 7fc9c380f800 20 started sync module instance, tier type = 2024-03-04T12:35:05.086 INFO:tasks.workunit.client.0.smithi110.stderr: -56> 2024-03-04T12:35:05.000+0000 7fc9c380f800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:05.087 INFO:tasks.workunit.client.0.smithi110.stderr: -55> 2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=0 2024-03-04T12:35:05.087 INFO:tasks.workunit.client.0.smithi110.stderr: -54> 2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=1 2024-03-04T12:35:05.087 INFO:tasks.workunit.client.0.smithi110.stderr: -53> 2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=2 2024-03-04T12:35:05.087 INFO:tasks.workunit.client.0.smithi110.stderr: -52> 2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=3 2024-03-04T12:35:05.087 INFO:tasks.workunit.client.0.smithi110.stderr: -51> 2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=4 2024-03-04T12:35:05.087 INFO:tasks.workunit.client.0.smithi110.stderr: -50> 2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=5 2024-03-04T12:35:05.087 INFO:tasks.workunit.client.0.smithi110.stderr: -49> 2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=6 2024-03-04T12:35:05.087 INFO:tasks.workunit.client.0.smithi110.stderr: -48> 2024-03-04T12:35:05.009+0000 7fc9c380f800 20 add_watcher() i=7 2024-03-04T12:35:05.087 INFO:tasks.workunit.client.0.smithi110.stderr: -47> 2024-03-04T12:35:05.009+0000 7fc9c380f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:05.087 INFO:tasks.workunit.client.0.smithi110.stderr: -46> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding auth protocol: cephx 2024-03-04T12:35:05.087 INFO:tasks.workunit.client.0.smithi110.stderr: -45> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding auth protocol: cephx 2024-03-04T12:35:05.087 INFO:tasks.workunit.client.0.smithi110.stderr: -44> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding auth protocol: cephx 2024-03-04T12:35:05.087 INFO:tasks.workunit.client.0.smithi110.stderr: -43> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: secure 2024-03-04T12:35:05.087 INFO:tasks.workunit.client.0.smithi110.stderr: -42> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: crc 2024-03-04T12:35:05.088 INFO:tasks.workunit.client.0.smithi110.stderr: -41> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: secure 2024-03-04T12:35:05.088 INFO:tasks.workunit.client.0.smithi110.stderr: -40> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: crc 2024-03-04T12:35:05.088 INFO:tasks.workunit.client.0.smithi110.stderr: -39> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: secure 2024-03-04T12:35:05.088 INFO:tasks.workunit.client.0.smithi110.stderr: -38> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: crc 2024-03-04T12:35:05.088 INFO:tasks.workunit.client.0.smithi110.stderr: -37> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: crc 2024-03-04T12:35:05.088 INFO:tasks.workunit.client.0.smithi110.stderr: -36> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: secure 2024-03-04T12:35:05.088 INFO:tasks.workunit.client.0.smithi110.stderr: -35> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: crc 2024-03-04T12:35:05.088 INFO:tasks.workunit.client.0.smithi110.stderr: -34> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: secure 2024-03-04T12:35:05.088 INFO:tasks.workunit.client.0.smithi110.stderr: -33> 2024-03-04T12:35:05.010+0000 7fc8757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:05.088 INFO:tasks.workunit.client.0.smithi110.stderr: -32> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: crc 2024-03-04T12:35:05.088 INFO:tasks.workunit.client.0.smithi110.stderr: -31> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: secure 2024-03-04T12:35:05.088 INFO:tasks.workunit.client.0.smithi110.stderr: -30> 2024-03-04T12:35:05.011+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.088 INFO:tasks.workunit.client.0.smithi110.stderr: -29> 2024-03-04T12:35:05.011+0000 7fc9c380f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:05.088 INFO:tasks.workunit.client.0.smithi110.stderr: -28> 2024-03-04T12:35:05.011+0000 7fc9c380f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:05.089 INFO:tasks.workunit.client.0.smithi110.stderr: -27> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command cache list hook 0x5562da3293b0 2024-03-04T12:35:05.089 INFO:tasks.workunit.client.0.smithi110.stderr: -26> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command cache inspect hook 0x5562da3293b0 2024-03-04T12:35:05.089 INFO:tasks.workunit.client.0.smithi110.stderr: -25> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command cache erase hook 0x5562da3293b0 2024-03-04T12:35:05.089 INFO:tasks.workunit.client.0.smithi110.stderr: -24> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command cache zap hook 0x5562da3293b0 2024-03-04T12:35:05.089 INFO:tasks.workunit.client.0.smithi110.stderr: -23> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 note: GC not initialized 2024-03-04T12:35:05.089 INFO:tasks.workunit.client.0.smithi110.stderr: -22> 2024-03-04T12:35:05.011+0000 7fc7effff640 20 reqs_thread_entry: start 2024-03-04T12:35:05.089 INFO:tasks.workunit.client.0.smithi110.stderr: -21> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command sync trace show hook 0x7fc9b007f050 2024-03-04T12:35:05.089 INFO:tasks.workunit.client.0.smithi110.stderr: -20> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command sync trace history hook 0x7fc9b007f050 2024-03-04T12:35:05.089 INFO:tasks.workunit.client.0.smithi110.stderr: -19> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command sync trace active hook 0x7fc9b007f050 2024-03-04T12:35:05.089 INFO:tasks.workunit.client.0.smithi110.stderr: -18> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command sync trace active_short hook 0x7fc9b007f050 2024-03-04T12:35:05.089 INFO:tasks.workunit.client.0.smithi110.stderr: -17> 2024-03-04T12:35:05.011+0000 7fc9c380f800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:05.089 INFO:tasks.workunit.client.0.smithi110.stderr: -16> 2024-03-04T12:35:05.011+0000 7fc9c380f800 20 Filter name: none 2024-03-04T12:35:05.089 INFO:tasks.workunit.client.0.smithi110.stderr: -15> 2024-03-04T12:35:05.011+0000 7fc7edffb640 20 reqs_thread_entry: start 2024-03-04T12:35:05.089 INFO:tasks.workunit.client.0.smithi110.stderr: -14> 2024-03-04T12:35:05.011+0000 7fc9c380f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-04T12:35:05.090 INFO:tasks.workunit.client.0.smithi110.stderr: -13> 2024-03-04T12:35:05.011+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.090 INFO:tasks.workunit.client.0.smithi110.stderr: -12> 2024-03-04T12:35:05.012+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:05.090 INFO:tasks.workunit.client.0.smithi110.stderr: -11> 2024-03-04T12:35:05.012+0000 7fc9c380f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-04T12:35:05.090 INFO:tasks.workunit.client.0.smithi110.stderr: -10> 2024-03-04T12:35:05.012+0000 7fc9c380f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-04T12:35:05.090 INFO:tasks.workunit.client.0.smithi110.stderr: -9> 2024-03-04T12:35:05.012+0000 7fc9c380f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 : miss 2024-03-04T12:35:05.090 INFO:tasks.workunit.client.0.smithi110.stderr: -8> 2024-03-04T12:35:05.012+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.090 INFO:tasks.workunit.client.0.smithi110.stderr: -7> 2024-03-04T12:35:05.012+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:05.090 INFO:tasks.workunit.client.0.smithi110.stderr: -6> 2024-03-04T12:35:05.012+0000 7fc9c380f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 info.flags=0x17 2024-03-04T12:35:05.090 INFO:tasks.workunit.client.0.smithi110.stderr: -5> 2024-03-04T12:35:05.012+0000 7fc9c380f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 to cache LRU end 2024-03-04T12:35:05.090 INFO:tasks.workunit.client.0.smithi110.stderr: -4> 2024-03-04T12:35:05.012+0000 7fc9c380f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:35:05.090 INFO:tasks.workunit.client.0.smithi110.stderr: -3> 2024-03-04T12:35:05.012+0000 7fc9c380f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:05.090 INFO:tasks.workunit.client.0.smithi110.stderr: -2> 2024-03-04T12:35:05.012+0000 7fc9c380f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 2024-03-04T12:35:05.090 INFO:tasks.workunit.client.0.smithi110.stderr: -1> 2024-03-04T12:35:05.016+0000 7fc9c380f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc9c380f800 time 2024-03-04T12:35:05.016700+0000 2024-03-04T12:35:05.090 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:35:05.090 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.091 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:35:05.091 INFO:tasks.workunit.client.0.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc9c4780e86] 2024-03-04T12:35:05.091 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fc9c4781044] 2024-03-04T12:35:05.091 INFO:tasks.workunit.client.0.smithi110.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5562d9386eb1] 2024-03-04T12:35:05.091 INFO:tasks.workunit.client.0.smithi110.stderr: 4: radosgw-admin(+0x7e4532) [0x5562d9391532] 2024-03-04T12:35:05.091 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x5562d939ad1b] 2024-03-04T12:35:05.091 INFO:tasks.workunit.client.0.smithi110.stderr: 6: main() 2024-03-04T12:35:05.091 INFO:tasks.workunit.client.0.smithi110.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7fc9c363feb0] 2024-03-04T12:35:05.091 INFO:tasks.workunit.client.0.smithi110.stderr: 8: __libc_start_main() 2024-03-04T12:35:05.091 INFO:tasks.workunit.client.0.smithi110.stderr: 9: _start() 2024-03-04T12:35:05.091 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.091 INFO:tasks.workunit.client.0.smithi110.stderr: 0> 2024-03-04T12:35:05.017+0000 7fc9c380f800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:35:05.091 INFO:tasks.workunit.client.0.smithi110.stderr: in thread 7fc9c380f800 thread_name:radosgw-admin 2024-03-04T12:35:05.091 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.092 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:35:05.092 INFO:tasks.workunit.client.0.smithi110.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc9c3654db0] 2024-03-04T12:35:05.092 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc9c36a154c] 2024-03-04T12:35:05.092 INFO:tasks.workunit.client.0.smithi110.stderr: 3: raise() 2024-03-04T12:35:05.092 INFO:tasks.workunit.client.0.smithi110.stderr: 4: abort() 2024-03-04T12:35:05.092 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc9c4780ee0] 2024-03-04T12:35:05.092 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fc9c4781044] 2024-03-04T12:35:05.092 INFO:tasks.workunit.client.0.smithi110.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5562d9386eb1] 2024-03-04T12:35:05.092 INFO:tasks.workunit.client.0.smithi110.stderr: 8: radosgw-admin(+0x7e4532) [0x5562d9391532] 2024-03-04T12:35:05.092 INFO:tasks.workunit.client.0.smithi110.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x5562d939ad1b] 2024-03-04T12:35:05.092 INFO:tasks.workunit.client.0.smithi110.stderr: 10: main() 2024-03-04T12:35:05.092 INFO:tasks.workunit.client.0.smithi110.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7fc9c363feb0] 2024-03-04T12:35:05.092 INFO:tasks.workunit.client.0.smithi110.stderr: 12: __libc_start_main() 2024-03-04T12:35:05.092 INFO:tasks.workunit.client.0.smithi110.stderr: 13: _start() 2024-03-04T12:35:05.093 INFO:tasks.workunit.client.0.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:35:05.093 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.093 INFO:tasks.workunit.client.0.smithi110.stderr:--- logging levels --- 2024-03-04T12:35:05.093 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 none 2024-03-04T12:35:05.093 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 lockdep 2024-03-04T12:35:05.093 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 context 2024-03-04T12:35:05.093 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 crush 2024-03-04T12:35:05.093 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds 2024-03-04T12:35:05.093 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_balancer 2024-03-04T12:35:05.093 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_locker 2024-03-04T12:35:05.093 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_log 2024-03-04T12:35:05.093 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_log_expire 2024-03-04T12:35:05.093 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_migrator 2024-03-04T12:35:05.093 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 buffer 2024-03-04T12:35:05.094 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 timer 2024-03-04T12:35:05.094 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 filer 2024-03-04T12:35:05.094 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 striper 2024-03-04T12:35:05.094 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 objecter 2024-03-04T12:35:05.094 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rados 2024-03-04T12:35:05.094 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd 2024-03-04T12:35:05.094 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_mirror 2024-03-04T12:35:05.094 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_replay 2024-03-04T12:35:05.094 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_pwl 2024-03-04T12:35:05.094 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 journaler 2024-03-04T12:35:05.094 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 objectcacher 2024-03-04T12:35:05.094 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 immutable_obj_cache 2024-03-04T12:35:05.094 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 client 2024-03-04T12:35:05.094 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 osd 2024-03-04T12:35:05.094 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 optracker 2024-03-04T12:35:05.095 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 objclass 2024-03-04T12:35:05.095 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 filestore 2024-03-04T12:35:05.095 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 journal 2024-03-04T12:35:05.095 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 0 ms 2024-03-04T12:35:05.095 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mon 2024-03-04T12:35:05.095 INFO:tasks.workunit.client.0.smithi110.stderr: 0/10 monc 2024-03-04T12:35:05.095 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 paxos 2024-03-04T12:35:05.095 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 tp 2024-03-04T12:35:05.095 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 auth 2024-03-04T12:35:05.095 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 crypto 2024-03-04T12:35:05.095 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 finisher 2024-03-04T12:35:05.095 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 reserver 2024-03-04T12:35:05.095 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 heartbeatmap 2024-03-04T12:35:05.095 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 perfcounter 2024-03-04T12:35:05.095 INFO:tasks.workunit.client.0.smithi110.stderr: 20/20 rgw 2024-03-04T12:35:05.096 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_sync 2024-03-04T12:35:05.096 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_datacache 2024-03-04T12:35:05.096 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_access 2024-03-04T12:35:05.096 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_dbstore 2024-03-04T12:35:05.096 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_flight 2024-03-04T12:35:05.096 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_lifecycle 2024-03-04T12:35:05.096 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 javaclient 2024-03-04T12:35:05.096 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 asok 2024-03-04T12:35:05.096 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 throttle 2024-03-04T12:35:05.096 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 0 refs 2024-03-04T12:35:05.096 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 compressor 2024-03-04T12:35:05.096 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 bluestore 2024-03-04T12:35:05.096 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 bluefs 2024-03-04T12:35:05.096 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 bdev 2024-03-04T12:35:05.096 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 kstore 2024-03-04T12:35:05.097 INFO:tasks.workunit.client.0.smithi110.stderr: 4/ 5 rocksdb 2024-03-04T12:35:05.097 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 fuse 2024-03-04T12:35:05.097 INFO:tasks.workunit.client.0.smithi110.stderr: 2/ 5 mgr 2024-03-04T12:35:05.097 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mgrc 2024-03-04T12:35:05.097 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 dpdk 2024-03-04T12:35:05.097 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 eventtrace 2024-03-04T12:35:05.097 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 prioritycache 2024-03-04T12:35:05.097 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 test 2024-03-04T12:35:05.097 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cephfs_mirror 2024-03-04T12:35:05.097 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cephsqlite 2024-03-04T12:35:05.097 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 crimson_interrupt 2024-03-04T12:35:05.097 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore 2024-03-04T12:35:05.097 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_onode 2024-03-04T12:35:05.097 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_odata 2024-03-04T12:35:05.098 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_omap 2024-03-04T12:35:05.098 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_tm 2024-03-04T12:35:05.098 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_t 2024-03-04T12:35:05.098 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_cleaner 2024-03-04T12:35:05.098 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_epm 2024-03-04T12:35:05.098 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_lba 2024-03-04T12:35:05.098 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-04T12:35:05.098 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_cache 2024-03-04T12:35:05.098 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_journal 2024-03-04T12:35:05.098 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_device 2024-03-04T12:35:05.098 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_backref 2024-03-04T12:35:05.098 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 alienstore 2024-03-04T12:35:05.098 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mclock 2024-03-04T12:35:05.098 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cyanstore 2024-03-04T12:35:05.098 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 ceph_exporter 2024-03-04T12:35:05.099 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 memstore 2024-03-04T12:35:05.099 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 trace 2024-03-04T12:35:05.099 INFO:tasks.workunit.client.0.smithi110.stderr: -2/-2 (syslog threshold) 2024-03-04T12:35:05.099 INFO:tasks.workunit.client.0.smithi110.stderr: 99/99 (stderr threshold) 2024-03-04T12:35:05.099 INFO:tasks.workunit.client.0.smithi110.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-04T12:35:05.099 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc7edffb640 / http_manager 2024-03-04T12:35:05.099 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc7effff640 / http_manager 2024-03-04T12:35:05.099 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc8757e2640 / rgw_dt_lg_renew 2024-03-04T12:35:05.099 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc8a0ff9640 / ms_dispatch 2024-03-04T12:35:05.099 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc8a27fc640 / io_context_pool 2024-03-04T12:35:05.099 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc8a8e01640 / ms_dispatch 2024-03-04T12:35:05.099 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc8ab606640 / ms_dispatch 2024-03-04T12:35:05.099 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc8ace09640 / io_context_pool 2024-03-04T12:35:05.099 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc9b6680640 / msgr-worker-2 2024-03-04T12:35:05.100 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc9bee81640 / msgr-worker-1 2024-03-04T12:35:05.100 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc9bf682640 / msgr-worker-0 2024-03-04T12:35:05.100 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc9bfe83640 / io_context_pool 2024-03-04T12:35:05.100 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc9c380f800 / radosgw-admin 2024-03-04T12:35:05.100 INFO:tasks.workunit.client.0.smithi110.stderr: max_recent 500 2024-03-04T12:35:05.100 INFO:tasks.workunit.client.0.smithi110.stderr: max_new 1000 2024-03-04T12:35:05.100 INFO:tasks.workunit.client.0.smithi110.stderr: log_file /var/log/ceph/ceph-client.admin.91082.log 2024-03-04T12:35:05.100 INFO:tasks.workunit.client.0.smithi110.stderr:--- end dump of recent events --- 2024-03-04T12:35:05.100 INFO:tasks.workunit.client.0.smithi110.stderr:--- begin dump of recent events --- 2024-03-04T12:35:05.100 INFO:tasks.workunit.client.0.smithi110.stderr: -499> 2024-03-04T12:35:04.767+0000 7fc8ace09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:35:05.100 INFO:tasks.workunit.client.0.smithi110.stderr: -498> 2024-03-04T12:35:04.767+0000 7fc8ace09640 10 monclient: dump: 2024-03-04T12:35:05.100 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.100 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.100 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.101 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.101 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.101 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.101 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.101 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.101 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.101 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.101 INFO:tasks.workunit.client.0.smithi110.stderr: -497> 2024-03-04T12:35:04.767+0000 7fc8ace09640 10 monclient: _finish_auth 0 2024-03-04T12:35:05.101 INFO:tasks.workunit.client.0.smithi110.stderr: -496> 2024-03-04T12:35:04.767+0000 7fc8ace09640 10 monclient: _check_auth_tickets 2024-03-04T12:35:05.101 INFO:tasks.workunit.client.0.smithi110.stderr: -495> 2024-03-04T12:35:04.767+0000 7fc8ace09640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:05.101 INFO:tasks.workunit.client.0.smithi110.stderr: -494> 2024-03-04T12:35:04.767+0000 7fc8ace09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.101 INFO:tasks.workunit.client.0.smithi110.stderr: -493> 2024-03-04T12:35:04.767+0000 7fc8ace09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:35:05.101 INFO:tasks.workunit.client.0.smithi110.stderr: -492> 2024-03-04T12:35:04.767+0000 7fc8ace09640 10 monclient: dump: 2024-03-04T12:35:05.101 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.102 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.102 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.102 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.102 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.102 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.102 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.102 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.102 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.102 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.102 INFO:tasks.workunit.client.0.smithi110.stderr: -491> 2024-03-04T12:35:04.767+0000 7fc9c380f800 5 monclient: authenticate success, global_id 5960 2024-03-04T12:35:05.102 INFO:tasks.workunit.client.0.smithi110.stderr: -490> 2024-03-04T12:35:04.767+0000 7fc9c380f800 10 monclient: get_monmap_and_config success 2024-03-04T12:35:05.102 INFO:tasks.workunit.client.0.smithi110.stderr: -489> 2024-03-04T12:35:04.767+0000 7fc9c380f800 4 set_mon_vals no callback set 2024-03-04T12:35:05.102 INFO:tasks.workunit.client.0.smithi110.stderr: -488> 2024-03-04T12:35:04.767+0000 7fc9c380f800 10 monclient: shutdown 2024-03-04T12:35:05.102 INFO:tasks.workunit.client.0.smithi110.stderr: -487> 2024-03-04T12:35:04.767+0000 7fc9c380f800 5 asok(0x5562da0410c0) unregister_commands rotate-key 2024-03-04T12:35:05.102 INFO:tasks.workunit.client.0.smithi110.stderr: -486> 2024-03-04T12:35:04.767+0000 7fc9c380f800 10 monclient: build_initial_monmap 2024-03-04T12:35:05.103 INFO:tasks.workunit.client.0.smithi110.stderr: -485> 2024-03-04T12:35:04.767+0000 7fc9c380f800 1 build_initial for_mkfs: 0 2024-03-04T12:35:05.103 INFO:tasks.workunit.client.0.smithi110.stderr: -484> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient: monmap: 2024-03-04T12:35:05.103 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:35:05.103 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:35:05.103 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:35:05.103 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:35:05.103 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:35:05.103 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.103 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:35:05.103 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:35:05.103 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:35:05.103 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.103 INFO:tasks.workunit.client.0.smithi110.stderr: -483> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding auth protocol: cephx 2024-03-04T12:35:05.103 INFO:tasks.workunit.client.0.smithi110.stderr: -482> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding auth protocol: cephx 2024-03-04T12:35:05.103 INFO:tasks.workunit.client.0.smithi110.stderr: -481> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding auth protocol: cephx 2024-03-04T12:35:05.104 INFO:tasks.workunit.client.0.smithi110.stderr: -480> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: secure 2024-03-04T12:35:05.104 INFO:tasks.workunit.client.0.smithi110.stderr: -479> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: crc 2024-03-04T12:35:05.104 INFO:tasks.workunit.client.0.smithi110.stderr: -478> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: secure 2024-03-04T12:35:05.104 INFO:tasks.workunit.client.0.smithi110.stderr: -477> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: crc 2024-03-04T12:35:05.104 INFO:tasks.workunit.client.0.smithi110.stderr: -476> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: secure 2024-03-04T12:35:05.104 INFO:tasks.workunit.client.0.smithi110.stderr: -475> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: crc 2024-03-04T12:35:05.104 INFO:tasks.workunit.client.0.smithi110.stderr: -474> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: crc 2024-03-04T12:35:05.104 INFO:tasks.workunit.client.0.smithi110.stderr: -473> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: secure 2024-03-04T12:35:05.104 INFO:tasks.workunit.client.0.smithi110.stderr: -472> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: crc 2024-03-04T12:35:05.104 INFO:tasks.workunit.client.0.smithi110.stderr: -471> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: secure 2024-03-04T12:35:05.104 INFO:tasks.workunit.client.0.smithi110.stderr: -470> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: crc 2024-03-04T12:35:05.104 INFO:tasks.workunit.client.0.smithi110.stderr: -469> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da261fc0) adding con mode: secure 2024-03-04T12:35:05.104 INFO:tasks.workunit.client.0.smithi110.stderr: -468> 2024-03-04T12:35:04.768+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.104 INFO:tasks.workunit.client.0.smithi110.stderr: -467> 2024-03-04T12:35:04.768+0000 7fc9c380f800 1 librados: starting msgr at 2024-03-04T12:35:05.105 INFO:tasks.workunit.client.0.smithi110.stderr: -466> 2024-03-04T12:35:04.768+0000 7fc9c380f800 1 librados: starting objecter 2024-03-04T12:35:05.105 INFO:tasks.workunit.client.0.smithi110.stderr: -465> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command objecter_requests hook 0x5562da28a7a0 2024-03-04T12:35:05.105 INFO:tasks.workunit.client.0.smithi110.stderr: -464> 2024-03-04T12:35:04.768+0000 7fc9c380f800 1 librados: setting wanted keys 2024-03-04T12:35:05.105 INFO:tasks.workunit.client.0.smithi110.stderr: -463> 2024-03-04T12:35:04.768+0000 7fc9c380f800 1 librados: calling monclient init 2024-03-04T12:35:05.105 INFO:tasks.workunit.client.0.smithi110.stderr: -462> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient: init 2024-03-04T12:35:05.105 INFO:tasks.workunit.client.0.smithi110.stderr: -461> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding auth protocol: cephx 2024-03-04T12:35:05.105 INFO:tasks.workunit.client.0.smithi110.stderr: -460> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding auth protocol: cephx 2024-03-04T12:35:05.105 INFO:tasks.workunit.client.0.smithi110.stderr: -459> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding auth protocol: cephx 2024-03-04T12:35:05.105 INFO:tasks.workunit.client.0.smithi110.stderr: -458> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: secure 2024-03-04T12:35:05.105 INFO:tasks.workunit.client.0.smithi110.stderr: -457> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: crc 2024-03-04T12:35:05.105 INFO:tasks.workunit.client.0.smithi110.stderr: -456> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: secure 2024-03-04T12:35:05.105 INFO:tasks.workunit.client.0.smithi110.stderr: -455> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: crc 2024-03-04T12:35:05.105 INFO:tasks.workunit.client.0.smithi110.stderr: -454> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: secure 2024-03-04T12:35:05.105 INFO:tasks.workunit.client.0.smithi110.stderr: -453> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: crc 2024-03-04T12:35:05.105 INFO:tasks.workunit.client.0.smithi110.stderr: -452> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: crc 2024-03-04T12:35:05.106 INFO:tasks.workunit.client.0.smithi110.stderr: -451> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: secure 2024-03-04T12:35:05.106 INFO:tasks.workunit.client.0.smithi110.stderr: -450> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: crc 2024-03-04T12:35:05.106 INFO:tasks.workunit.client.0.smithi110.stderr: -449> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: secure 2024-03-04T12:35:05.106 INFO:tasks.workunit.client.0.smithi110.stderr: -448> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: crc 2024-03-04T12:35:05.106 INFO:tasks.workunit.client.0.smithi110.stderr: -447> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 AuthRegistry(0x5562da25f160) adding con mode: secure 2024-03-04T12:35:05.106 INFO:tasks.workunit.client.0.smithi110.stderr: -446> 2024-03-04T12:35:04.768+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.106 INFO:tasks.workunit.client.0.smithi110.stderr: -445> 2024-03-04T12:35:04.768+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.106 INFO:tasks.workunit.client.0.smithi110.stderr: -444> 2024-03-04T12:35:04.768+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command rotate-key hook 0x5562da25f2a8 2024-03-04T12:35:05.106 INFO:tasks.workunit.client.0.smithi110.stderr: -443> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient: _reopen_session rank -1 2024-03-04T12:35:05.106 INFO:tasks.workunit.client.0.smithi110.stderr: -442> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:35:05.106 INFO:tasks.workunit.client.0.smithi110.stderr: -441> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-b con 0x5562da0d6940 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:35:05.106 INFO:tasks.workunit.client.0.smithi110.stderr: -440> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-c con 0x5562da10c4a0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:35:05.106 INFO:tasks.workunit.client.0.smithi110.stderr: -439> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-a con 0x5562da264bc0 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:35:05.106 INFO:tasks.workunit.client.0.smithi110.stderr: -438> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.107 INFO:tasks.workunit.client.0.smithi110.stderr: -437> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.107 INFO:tasks.workunit.client.0.smithi110.stderr: -436> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.107 INFO:tasks.workunit.client.0.smithi110.stderr: -435> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient(hunting): _renew_subs 2024-03-04T12:35:05.107 INFO:tasks.workunit.client.0.smithi110.stderr: -434> 2024-03-04T12:35:04.768+0000 7fc9c380f800 10 monclient(hunting): authenticate will time out at 1686.127945s 2024-03-04T12:35:05.107 INFO:tasks.workunit.client.0.smithi110.stderr: -433> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient(hunting): get_auth_request con 0x5562da10c4a0 auth_method 0 2024-03-04T12:35:05.107 INFO:tasks.workunit.client.0.smithi110.stderr: -432> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.107 INFO:tasks.workunit.client.0.smithi110.stderr: -431> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.107 INFO:tasks.workunit.client.0.smithi110.stderr: -430> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.107 INFO:tasks.workunit.client.0.smithi110.stderr: -429> 2024-03-04T12:35:04.769+0000 7fc9bf682640 10 monclient(hunting): get_auth_request con 0x5562da264bc0 auth_method 0 2024-03-04T12:35:05.107 INFO:tasks.workunit.client.0.smithi110.stderr: -428> 2024-03-04T12:35:04.769+0000 7fc9bf682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.107 INFO:tasks.workunit.client.0.smithi110.stderr: -427> 2024-03-04T12:35:04.769+0000 7fc9bf682640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.107 INFO:tasks.workunit.client.0.smithi110.stderr: -426> 2024-03-04T12:35:04.769+0000 7fc9bf682640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.107 INFO:tasks.workunit.client.0.smithi110.stderr: -425> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.107 INFO:tasks.workunit.client.0.smithi110.stderr: -424> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.108 INFO:tasks.workunit.client.0.smithi110.stderr: -423> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.108 INFO:tasks.workunit.client.0.smithi110.stderr: -422> 2024-03-04T12:35:04.769+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.108 INFO:tasks.workunit.client.0.smithi110.stderr: -421> 2024-03-04T12:35:04.769+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.108 INFO:tasks.workunit.client.0.smithi110.stderr: -420> 2024-03-04T12:35:04.769+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.108 INFO:tasks.workunit.client.0.smithi110.stderr: -419> 2024-03-04T12:35:04.769+0000 7fc9bee81640 10 monclient(hunting): get_auth_request con 0x5562da0d6940 auth_method 0 2024-03-04T12:35:05.108 INFO:tasks.workunit.client.0.smithi110.stderr: -418> 2024-03-04T12:35:04.769+0000 7fc9bee81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.108 INFO:tasks.workunit.client.0.smithi110.stderr: -417> 2024-03-04T12:35:04.769+0000 7fc9bee81640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.108 INFO:tasks.workunit.client.0.smithi110.stderr: -416> 2024-03-04T12:35:04.769+0000 7fc9bee81640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.108 INFO:tasks.workunit.client.0.smithi110.stderr: -415> 2024-03-04T12:35:04.769+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.108 INFO:tasks.workunit.client.0.smithi110.stderr: -414> 2024-03-04T12:35:04.769+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.108 INFO:tasks.workunit.client.0.smithi110.stderr: -413> 2024-03-04T12:35:04.769+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.108 INFO:tasks.workunit.client.0.smithi110.stderr: -412> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient(hunting): handle_auth_done global_id 5963 payload 824 2024-03-04T12:35:05.108 INFO:tasks.workunit.client.0.smithi110.stderr: -411> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient: _finish_hunting 0 2024-03-04T12:35:05.108 INFO:tasks.workunit.client.0.smithi110.stderr: -410> 2024-03-04T12:35:04.769+0000 7fc9b6680640 1 monclient: found mon.noname-c 2024-03-04T12:35:05.109 INFO:tasks.workunit.client.0.smithi110.stderr: -409> 2024-03-04T12:35:04.769+0000 7fc9b6680640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.110:3301/0 2024-03-04T12:35:05.109 INFO:tasks.workunit.client.0.smithi110.stderr: -408> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.109 INFO:tasks.workunit.client.0.smithi110.stderr: -407> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:35:05.109 INFO:tasks.workunit.client.0.smithi110.stderr: -406> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: dump: 2024-03-04T12:35:05.109 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.109 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.109 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.109 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.109 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.109 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.109 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.109 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.109 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.109 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.109 INFO:tasks.workunit.client.0.smithi110.stderr: -405> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: _finish_auth 0 2024-03-04T12:35:05.110 INFO:tasks.workunit.client.0.smithi110.stderr: -404> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: _check_auth_tickets 2024-03-04T12:35:05.110 INFO:tasks.workunit.client.0.smithi110.stderr: -403> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:05.110 INFO:tasks.workunit.client.0.smithi110.stderr: -402> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.110 INFO:tasks.workunit.client.0.smithi110.stderr: -401> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:35:05.110 INFO:tasks.workunit.client.0.smithi110.stderr: -400> 2024-03-04T12:35:04.769+0000 7fc8ab606640 10 monclient: dump: 2024-03-04T12:35:05.110 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.110 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.110 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.110 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.110 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.110 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.110 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.110 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.110 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.111 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.111 INFO:tasks.workunit.client.0.smithi110.stderr: -399> 2024-03-04T12:35:04.769+0000 7fc8ace09640 4 set_mon_vals no callback set 2024-03-04T12:35:05.111 INFO:tasks.workunit.client.0.smithi110.stderr: -398> 2024-03-04T12:35:04.769+0000 7fc9c380f800 5 monclient: authenticate success, global_id 5963 2024-03-04T12:35:05.111 INFO:tasks.workunit.client.0.smithi110.stderr: -397> 2024-03-04T12:35:04.769+0000 7fc9c380f800 10 monclient: _renew_subs 2024-03-04T12:35:05.111 INFO:tasks.workunit.client.0.smithi110.stderr: -396> 2024-03-04T12:35:04.769+0000 7fc9c380f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:35:05.111 INFO:tasks.workunit.client.0.smithi110.stderr: -395> 2024-03-04T12:35:04.769+0000 7fc9c380f800 10 monclient: _renew_subs 2024-03-04T12:35:05.111 INFO:tasks.workunit.client.0.smithi110.stderr: -394> 2024-03-04T12:35:04.769+0000 7fc9c380f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:35:05.111 INFO:tasks.workunit.client.0.smithi110.stderr: -393> 2024-03-04T12:35:04.769+0000 7fc9c380f800 1 librados: init done 2024-03-04T12:35:05.111 INFO:tasks.workunit.client.0.smithi110.stderr: -392> 2024-03-04T12:35:04.771+0000 7fc8ab606640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:35:05.111 INFO:tasks.workunit.client.0.smithi110.stderr: -391> 2024-03-04T12:35:04.771+0000 7fc8ab606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:05.111 INFO:tasks.workunit.client.0.smithi110.stderr: -390> 2024-03-04T12:35:04.771+0000 7fc8ab606640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:05.111 INFO:tasks.workunit.client.0.smithi110.stderr: -389> 2024-03-04T12:35:04.772+0000 7fc9bee81640 10 monclient: get_auth_request con 0x7fc8a4069ee0 auth_method 0 2024-03-04T12:35:05.111 INFO:tasks.workunit.client.0.smithi110.stderr: -388> 2024-03-04T12:35:04.772+0000 7fc9bf682640 10 monclient: get_auth_request con 0x5562da284c20 auth_method 0 2024-03-04T12:35:05.111 INFO:tasks.workunit.client.0.smithi110.stderr: -387> 2024-03-04T12:35:04.772+0000 7fc9bee81640 10 monclient: get_auth_request con 0x5562da2aae00 auth_method 0 2024-03-04T12:35:05.111 INFO:tasks.workunit.client.0.smithi110.stderr: -386> 2024-03-04T12:35:04.774+0000 7fc9b6680640 10 monclient: get_auth_request con 0x5562da2aff90 auth_method 0 2024-03-04T12:35:05.112 INFO:tasks.workunit.client.0.smithi110.stderr: -385> 2024-03-04T12:35:04.774+0000 7fc9c380f800 10 monclient: build_initial_monmap 2024-03-04T12:35:05.112 INFO:tasks.workunit.client.0.smithi110.stderr: -384> 2024-03-04T12:35:04.774+0000 7fc9c380f800 1 build_initial for_mkfs: 0 2024-03-04T12:35:05.112 INFO:tasks.workunit.client.0.smithi110.stderr: -383> 2024-03-04T12:35:04.774+0000 7fc9c380f800 10 monclient: monmap: 2024-03-04T12:35:05.112 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:35:05.112 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:35:05.112 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:35:05.112 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:35:05.112 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:35:05.112 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.112 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:35:05.112 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:35:05.112 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:35:05.112 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.113 INFO:tasks.workunit.client.0.smithi110.stderr: -382> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding auth protocol: cephx 2024-03-04T12:35:05.113 INFO:tasks.workunit.client.0.smithi110.stderr: -381> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding auth protocol: cephx 2024-03-04T12:35:05.113 INFO:tasks.workunit.client.0.smithi110.stderr: -380> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding auth protocol: cephx 2024-03-04T12:35:05.113 INFO:tasks.workunit.client.0.smithi110.stderr: -379> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: secure 2024-03-04T12:35:05.113 INFO:tasks.workunit.client.0.smithi110.stderr: -378> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: crc 2024-03-04T12:35:05.113 INFO:tasks.workunit.client.0.smithi110.stderr: -377> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: secure 2024-03-04T12:35:05.113 INFO:tasks.workunit.client.0.smithi110.stderr: -376> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: crc 2024-03-04T12:35:05.113 INFO:tasks.workunit.client.0.smithi110.stderr: -375> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: secure 2024-03-04T12:35:05.113 INFO:tasks.workunit.client.0.smithi110.stderr: -374> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: crc 2024-03-04T12:35:05.113 INFO:tasks.workunit.client.0.smithi110.stderr: -373> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: crc 2024-03-04T12:35:05.113 INFO:tasks.workunit.client.0.smithi110.stderr: -372> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: secure 2024-03-04T12:35:05.113 INFO:tasks.workunit.client.0.smithi110.stderr: -371> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: crc 2024-03-04T12:35:05.113 INFO:tasks.workunit.client.0.smithi110.stderr: -370> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: secure 2024-03-04T12:35:05.113 INFO:tasks.workunit.client.0.smithi110.stderr: -369> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: crc 2024-03-04T12:35:05.114 INFO:tasks.workunit.client.0.smithi110.stderr: -368> 2024-03-04T12:35:04.774+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b3ea0) adding con mode: secure 2024-03-04T12:35:05.114 INFO:tasks.workunit.client.0.smithi110.stderr: -367> 2024-03-04T12:35:04.775+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.114 INFO:tasks.workunit.client.0.smithi110.stderr: -366> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command objecter_requests cmddesc objecter_requests hook 0x5562da2b9780 EEXIST 2024-03-04T12:35:05.114 INFO:tasks.workunit.client.0.smithi110.stderr: -365> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient: init 2024-03-04T12:35:05.114 INFO:tasks.workunit.client.0.smithi110.stderr: -364> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding auth protocol: cephx 2024-03-04T12:35:05.114 INFO:tasks.workunit.client.0.smithi110.stderr: -363> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding auth protocol: cephx 2024-03-04T12:35:05.114 INFO:tasks.workunit.client.0.smithi110.stderr: -362> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding auth protocol: cephx 2024-03-04T12:35:05.114 INFO:tasks.workunit.client.0.smithi110.stderr: -361> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: secure 2024-03-04T12:35:05.114 INFO:tasks.workunit.client.0.smithi110.stderr: -360> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: crc 2024-03-04T12:35:05.114 INFO:tasks.workunit.client.0.smithi110.stderr: -359> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: secure 2024-03-04T12:35:05.114 INFO:tasks.workunit.client.0.smithi110.stderr: -358> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: crc 2024-03-04T12:35:05.114 INFO:tasks.workunit.client.0.smithi110.stderr: -357> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: secure 2024-03-04T12:35:05.114 INFO:tasks.workunit.client.0.smithi110.stderr: -356> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: crc 2024-03-04T12:35:05.114 INFO:tasks.workunit.client.0.smithi110.stderr: -355> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: crc 2024-03-04T12:35:05.115 INFO:tasks.workunit.client.0.smithi110.stderr: -354> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: secure 2024-03-04T12:35:05.115 INFO:tasks.workunit.client.0.smithi110.stderr: -353> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: crc 2024-03-04T12:35:05.115 INFO:tasks.workunit.client.0.smithi110.stderr: -352> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: secure 2024-03-04T12:35:05.115 INFO:tasks.workunit.client.0.smithi110.stderr: -351> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: crc 2024-03-04T12:35:05.115 INFO:tasks.workunit.client.0.smithi110.stderr: -350> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 AuthRegistry(0x5562da2b2f28) adding con mode: secure 2024-03-04T12:35:05.115 INFO:tasks.workunit.client.0.smithi110.stderr: -349> 2024-03-04T12:35:04.775+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.115 INFO:tasks.workunit.client.0.smithi110.stderr: -348> 2024-03-04T12:35:04.775+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.115 INFO:tasks.workunit.client.0.smithi110.stderr: -347> 2024-03-04T12:35:04.775+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command rotate-key cmddesc rotate-key hook 0x5562da2b3070 EEXIST 2024-03-04T12:35:05.115 INFO:tasks.workunit.client.0.smithi110.stderr: -346> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient: _reopen_session rank -1 2024-03-04T12:35:05.115 INFO:tasks.workunit.client.0.smithi110.stderr: -345> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:35:05.115 INFO:tasks.workunit.client.0.smithi110.stderr: -344> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-b con 0x5562da2de4e0 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:35:05.115 INFO:tasks.workunit.client.0.smithi110.stderr: -343> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-c con 0x5562da2de8c0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:35:05.115 INFO:tasks.workunit.client.0.smithi110.stderr: -342> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-a con 0x5562da2f1210 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:35:05.115 INFO:tasks.workunit.client.0.smithi110.stderr: -341> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.116 INFO:tasks.workunit.client.0.smithi110.stderr: -340> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.116 INFO:tasks.workunit.client.0.smithi110.stderr: -339> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.116 INFO:tasks.workunit.client.0.smithi110.stderr: -338> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient(hunting): _renew_subs 2024-03-04T12:35:05.116 INFO:tasks.workunit.client.0.smithi110.stderr: -337> 2024-03-04T12:35:04.775+0000 7fc9c380f800 10 monclient(hunting): authenticate will time out at 1686.134884s 2024-03-04T12:35:05.116 INFO:tasks.workunit.client.0.smithi110.stderr: -336> 2024-03-04T12:35:04.776+0000 7fc9bf682640 10 monclient(hunting): get_auth_request con 0x5562da2f1210 auth_method 0 2024-03-04T12:35:05.116 INFO:tasks.workunit.client.0.smithi110.stderr: -335> 2024-03-04T12:35:04.776+0000 7fc9bf682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.116 INFO:tasks.workunit.client.0.smithi110.stderr: -334> 2024-03-04T12:35:04.776+0000 7fc9bf682640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.116 INFO:tasks.workunit.client.0.smithi110.stderr: -333> 2024-03-04T12:35:04.776+0000 7fc9bf682640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.116 INFO:tasks.workunit.client.0.smithi110.stderr: -332> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient(hunting): get_auth_request con 0x5562da2de8c0 auth_method 0 2024-03-04T12:35:05.116 INFO:tasks.workunit.client.0.smithi110.stderr: -331> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.116 INFO:tasks.workunit.client.0.smithi110.stderr: -330> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.116 INFO:tasks.workunit.client.0.smithi110.stderr: -329> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.116 INFO:tasks.workunit.client.0.smithi110.stderr: -328> 2024-03-04T12:35:04.776+0000 7fc9bee81640 10 monclient(hunting): get_auth_request con 0x5562da2de4e0 auth_method 0 2024-03-04T12:35:05.116 INFO:tasks.workunit.client.0.smithi110.stderr: -327> 2024-03-04T12:35:04.776+0000 7fc9bee81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.117 INFO:tasks.workunit.client.0.smithi110.stderr: -326> 2024-03-04T12:35:04.776+0000 7fc9bee81640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.117 INFO:tasks.workunit.client.0.smithi110.stderr: -325> 2024-03-04T12:35:04.776+0000 7fc9bee81640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.117 INFO:tasks.workunit.client.0.smithi110.stderr: -324> 2024-03-04T12:35:04.776+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.117 INFO:tasks.workunit.client.0.smithi110.stderr: -323> 2024-03-04T12:35:04.776+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.117 INFO:tasks.workunit.client.0.smithi110.stderr: -322> 2024-03-04T12:35:04.776+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.117 INFO:tasks.workunit.client.0.smithi110.stderr: -321> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.117 INFO:tasks.workunit.client.0.smithi110.stderr: -320> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.117 INFO:tasks.workunit.client.0.smithi110.stderr: -319> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.117 INFO:tasks.workunit.client.0.smithi110.stderr: -318> 2024-03-04T12:35:04.776+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.117 INFO:tasks.workunit.client.0.smithi110.stderr: -317> 2024-03-04T12:35:04.776+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.117 INFO:tasks.workunit.client.0.smithi110.stderr: -316> 2024-03-04T12:35:04.776+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.117 INFO:tasks.workunit.client.0.smithi110.stderr: -315> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient(hunting): handle_auth_done global_id 5966 payload 824 2024-03-04T12:35:05.117 INFO:tasks.workunit.client.0.smithi110.stderr: -314> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient: _finish_hunting 0 2024-03-04T12:35:05.117 INFO:tasks.workunit.client.0.smithi110.stderr: -313> 2024-03-04T12:35:04.776+0000 7fc9b6680640 1 monclient: found mon.noname-c 2024-03-04T12:35:05.118 INFO:tasks.workunit.client.0.smithi110.stderr: -312> 2024-03-04T12:35:04.776+0000 7fc9b6680640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.110:3301/0 2024-03-04T12:35:05.118 INFO:tasks.workunit.client.0.smithi110.stderr: -311> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.118 INFO:tasks.workunit.client.0.smithi110.stderr: -310> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:35:05.118 INFO:tasks.workunit.client.0.smithi110.stderr: -309> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: dump: 2024-03-04T12:35:05.118 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.118 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.118 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.118 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.118 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.118 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.118 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.118 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.118 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.118 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.119 INFO:tasks.workunit.client.0.smithi110.stderr: -308> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: _finish_auth 0 2024-03-04T12:35:05.119 INFO:tasks.workunit.client.0.smithi110.stderr: -307> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: _check_auth_tickets 2024-03-04T12:35:05.119 INFO:tasks.workunit.client.0.smithi110.stderr: -306> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:05.119 INFO:tasks.workunit.client.0.smithi110.stderr: -305> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.119 INFO:tasks.workunit.client.0.smithi110.stderr: -304> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:35:05.119 INFO:tasks.workunit.client.0.smithi110.stderr: -303> 2024-03-04T12:35:04.776+0000 7fc8a8e01640 10 monclient: dump: 2024-03-04T12:35:05.119 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.119 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.119 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.119 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.119 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.119 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.119 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.119 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.120 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.120 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.120 INFO:tasks.workunit.client.0.smithi110.stderr: -302> 2024-03-04T12:35:04.776+0000 7fc9c380f800 5 monclient: authenticate success, global_id 5966 2024-03-04T12:35:05.120 INFO:tasks.workunit.client.0.smithi110.stderr: -301> 2024-03-04T12:35:04.776+0000 7fc9bfe83640 4 set_mon_vals no callback set 2024-03-04T12:35:05.120 INFO:tasks.workunit.client.0.smithi110.stderr: -300> 2024-03-04T12:35:04.776+0000 7fc9c380f800 10 monclient: _renew_subs 2024-03-04T12:35:05.120 INFO:tasks.workunit.client.0.smithi110.stderr: -299> 2024-03-04T12:35:04.776+0000 7fc9c380f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:35:05.120 INFO:tasks.workunit.client.0.smithi110.stderr: -298> 2024-03-04T12:35:04.776+0000 7fc9c380f800 10 monclient: _renew_subs 2024-03-04T12:35:05.120 INFO:tasks.workunit.client.0.smithi110.stderr: -297> 2024-03-04T12:35:04.776+0000 7fc9c380f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:35:05.120 INFO:tasks.workunit.client.0.smithi110.stderr: -296> 2024-03-04T12:35:04.778+0000 7fc8a8e01640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:35:05.120 INFO:tasks.workunit.client.0.smithi110.stderr: -295> 2024-03-04T12:35:04.778+0000 7fc8a8e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:05.120 INFO:tasks.workunit.client.0.smithi110.stderr: -294> 2024-03-04T12:35:04.778+0000 7fc8a8e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:05.120 INFO:tasks.workunit.client.0.smithi110.stderr: -293> 2024-03-04T12:35:04.778+0000 7fc9bee81640 10 monclient: get_auth_request con 0x7fc898069dc0 auth_method 0 2024-03-04T12:35:05.120 INFO:tasks.workunit.client.0.smithi110.stderr: -292> 2024-03-04T12:35:04.778+0000 7fc9c380f800 10 monclient: get_monmap_and_config 2024-03-04T12:35:05.121 INFO:tasks.workunit.client.0.smithi110.stderr: -291> 2024-03-04T12:35:04.778+0000 7fc9c380f800 10 monclient: build_initial_monmap 2024-03-04T12:35:05.121 INFO:tasks.workunit.client.0.smithi110.stderr: -290> 2024-03-04T12:35:04.778+0000 7fc9c380f800 1 build_initial for_mkfs: 0 2024-03-04T12:35:05.121 INFO:tasks.workunit.client.0.smithi110.stderr: -289> 2024-03-04T12:35:04.778+0000 7fc9c380f800 10 monclient: monmap: 2024-03-04T12:35:05.121 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:35:05.121 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:35:05.121 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:35:05.121 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:35:05.121 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:35:05.121 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.121 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:35:05.121 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:35:05.121 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:35:05.121 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.121 INFO:tasks.workunit.client.0.smithi110.stderr: -288> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding auth protocol: cephx 2024-03-04T12:35:05.122 INFO:tasks.workunit.client.0.smithi110.stderr: -287> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding auth protocol: cephx 2024-03-04T12:35:05.122 INFO:tasks.workunit.client.0.smithi110.stderr: -286> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding auth protocol: cephx 2024-03-04T12:35:05.122 INFO:tasks.workunit.client.0.smithi110.stderr: -285> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.122 INFO:tasks.workunit.client.0.smithi110.stderr: -284> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.122 INFO:tasks.workunit.client.0.smithi110.stderr: -283> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.122 INFO:tasks.workunit.client.0.smithi110.stderr: -282> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.122 INFO:tasks.workunit.client.0.smithi110.stderr: -281> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.122 INFO:tasks.workunit.client.0.smithi110.stderr: -280> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.122 INFO:tasks.workunit.client.0.smithi110.stderr: -279> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.122 INFO:tasks.workunit.client.0.smithi110.stderr: -278> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.122 INFO:tasks.workunit.client.0.smithi110.stderr: -277> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.122 INFO:tasks.workunit.client.0.smithi110.stderr: -276> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.122 INFO:tasks.workunit.client.0.smithi110.stderr: -275> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.122 INFO:tasks.workunit.client.0.smithi110.stderr: -274> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.123 INFO:tasks.workunit.client.0.smithi110.stderr: -273> 2024-03-04T12:35:04.778+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.123 INFO:tasks.workunit.client.0.smithi110.stderr: -272> 2024-03-04T12:35:04.778+0000 7fc9c380f800 10 monclient: init 2024-03-04T12:35:05.123 INFO:tasks.workunit.client.0.smithi110.stderr: -271> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding auth protocol: cephx 2024-03-04T12:35:05.123 INFO:tasks.workunit.client.0.smithi110.stderr: -270> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding auth protocol: cephx 2024-03-04T12:35:05.123 INFO:tasks.workunit.client.0.smithi110.stderr: -269> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding auth protocol: cephx 2024-03-04T12:35:05.123 INFO:tasks.workunit.client.0.smithi110.stderr: -268> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: secure 2024-03-04T12:35:05.123 INFO:tasks.workunit.client.0.smithi110.stderr: -267> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: crc 2024-03-04T12:35:05.123 INFO:tasks.workunit.client.0.smithi110.stderr: -266> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: secure 2024-03-04T12:35:05.123 INFO:tasks.workunit.client.0.smithi110.stderr: -265> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: crc 2024-03-04T12:35:05.123 INFO:tasks.workunit.client.0.smithi110.stderr: -264> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: secure 2024-03-04T12:35:05.123 INFO:tasks.workunit.client.0.smithi110.stderr: -263> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: crc 2024-03-04T12:35:05.123 INFO:tasks.workunit.client.0.smithi110.stderr: -262> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: crc 2024-03-04T12:35:05.123 INFO:tasks.workunit.client.0.smithi110.stderr: -261> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: secure 2024-03-04T12:35:05.123 INFO:tasks.workunit.client.0.smithi110.stderr: -260> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: crc 2024-03-04T12:35:05.123 INFO:tasks.workunit.client.0.smithi110.stderr: -259> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: secure 2024-03-04T12:35:05.124 INFO:tasks.workunit.client.0.smithi110.stderr: -258> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: crc 2024-03-04T12:35:05.124 INFO:tasks.workunit.client.0.smithi110.stderr: -257> 2024-03-04T12:35:04.778+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35d7b0) adding con mode: secure 2024-03-04T12:35:05.124 INFO:tasks.workunit.client.0.smithi110.stderr: -256> 2024-03-04T12:35:04.779+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.124 INFO:tasks.workunit.client.0.smithi110.stderr: -255> 2024-03-04T12:35:04.779+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.124 INFO:tasks.workunit.client.0.smithi110.stderr: -254> 2024-03-04T12:35:04.779+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command rotate-key cmddesc rotate-key hook 0x7fff8c35d8f8 EEXIST 2024-03-04T12:35:05.124 INFO:tasks.workunit.client.0.smithi110.stderr: -253> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient: _reopen_session rank -1 2024-03-04T12:35:05.124 INFO:tasks.workunit.client.0.smithi110.stderr: -252> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-04T12:35:05.124 INFO:tasks.workunit.client.0.smithi110.stderr: -251> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-a con 0x5562da3308e0 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:35:05.124 INFO:tasks.workunit.client.0.smithi110.stderr: -250> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-b con 0x5562da3226a0 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:35:05.124 INFO:tasks.workunit.client.0.smithi110.stderr: -249> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-c con 0x5562da3233b0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:35:05.124 INFO:tasks.workunit.client.0.smithi110.stderr: -248> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.124 INFO:tasks.workunit.client.0.smithi110.stderr: -247> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.124 INFO:tasks.workunit.client.0.smithi110.stderr: -246> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.125 INFO:tasks.workunit.client.0.smithi110.stderr: -245> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient(hunting): _renew_subs 2024-03-04T12:35:05.125 INFO:tasks.workunit.client.0.smithi110.stderr: -244> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient(hunting): authenticate will time out at 1686.138335s 2024-03-04T12:35:05.125 INFO:tasks.workunit.client.0.smithi110.stderr: -243> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient(hunting): get_auth_request con 0x5562da3308e0 auth_method 0 2024-03-04T12:35:05.125 INFO:tasks.workunit.client.0.smithi110.stderr: -242> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.125 INFO:tasks.workunit.client.0.smithi110.stderr: -241> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.125 INFO:tasks.workunit.client.0.smithi110.stderr: -240> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.125 INFO:tasks.workunit.client.0.smithi110.stderr: -239> 2024-03-04T12:35:04.779+0000 7fc9bf682640 10 monclient(hunting): get_auth_request con 0x5562da3233b0 auth_method 0 2024-03-04T12:35:05.125 INFO:tasks.workunit.client.0.smithi110.stderr: -238> 2024-03-04T12:35:04.779+0000 7fc9bf682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.125 INFO:tasks.workunit.client.0.smithi110.stderr: -237> 2024-03-04T12:35:04.779+0000 7fc9bf682640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.125 INFO:tasks.workunit.client.0.smithi110.stderr: -236> 2024-03-04T12:35:04.779+0000 7fc9bf682640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.125 INFO:tasks.workunit.client.0.smithi110.stderr: -235> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.125 INFO:tasks.workunit.client.0.smithi110.stderr: -234> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.125 INFO:tasks.workunit.client.0.smithi110.stderr: -233> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.125 INFO:tasks.workunit.client.0.smithi110.stderr: -232> 2024-03-04T12:35:04.779+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.125 INFO:tasks.workunit.client.0.smithi110.stderr: -231> 2024-03-04T12:35:04.779+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.126 INFO:tasks.workunit.client.0.smithi110.stderr: -230> 2024-03-04T12:35:04.779+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.126 INFO:tasks.workunit.client.0.smithi110.stderr: -229> 2024-03-04T12:35:04.779+0000 7fc9b6680640 10 monclient(hunting): get_auth_request con 0x5562da3226a0 auth_method 0 2024-03-04T12:35:05.126 INFO:tasks.workunit.client.0.smithi110.stderr: -228> 2024-03-04T12:35:04.779+0000 7fc9b6680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.126 INFO:tasks.workunit.client.0.smithi110.stderr: -227> 2024-03-04T12:35:04.779+0000 7fc9b6680640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.126 INFO:tasks.workunit.client.0.smithi110.stderr: -226> 2024-03-04T12:35:04.779+0000 7fc9b6680640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.126 INFO:tasks.workunit.client.0.smithi110.stderr: -225> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient(hunting): handle_auth_done global_id 6375 payload 274 2024-03-04T12:35:05.126 INFO:tasks.workunit.client.0.smithi110.stderr: -224> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient: _finish_hunting 0 2024-03-04T12:35:05.126 INFO:tasks.workunit.client.0.smithi110.stderr: -223> 2024-03-04T12:35:04.779+0000 7fc9bee81640 1 monclient: found mon.noname-a 2024-03-04T12:35:05.126 INFO:tasks.workunit.client.0.smithi110.stderr: -222> 2024-03-04T12:35:04.779+0000 7fc9bee81640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:35:05.126 INFO:tasks.workunit.client.0.smithi110.stderr: -221> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.126 INFO:tasks.workunit.client.0.smithi110.stderr: -220> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:35:05.126 INFO:tasks.workunit.client.0.smithi110.stderr: -219> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: dump: 2024-03-04T12:35:05.126 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.126 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.127 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.127 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.127 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.127 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.127 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.127 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.127 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.127 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.127 INFO:tasks.workunit.client.0.smithi110.stderr: -218> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: _finish_auth 0 2024-03-04T12:35:05.127 INFO:tasks.workunit.client.0.smithi110.stderr: -217> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: _check_auth_tickets 2024-03-04T12:35:05.127 INFO:tasks.workunit.client.0.smithi110.stderr: -216> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:05.127 INFO:tasks.workunit.client.0.smithi110.stderr: -215> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.127 INFO:tasks.workunit.client.0.smithi110.stderr: -214> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:35:05.127 INFO:tasks.workunit.client.0.smithi110.stderr: -213> 2024-03-04T12:35:04.779+0000 7fc8a27fc640 10 monclient: dump: 2024-03-04T12:35:05.127 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.128 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.128 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.128 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.128 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.128 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.128 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.128 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.128 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.128 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.128 INFO:tasks.workunit.client.0.smithi110.stderr: -212> 2024-03-04T12:35:04.779+0000 7fc9c380f800 5 monclient: authenticate success, global_id 6375 2024-03-04T12:35:05.128 INFO:tasks.workunit.client.0.smithi110.stderr: -211> 2024-03-04T12:35:04.779+0000 7fc9c380f800 10 monclient: get_monmap_and_config success 2024-03-04T12:35:05.128 INFO:tasks.workunit.client.0.smithi110.stderr: -210> 2024-03-04T12:35:04.779+0000 7fc9c380f800 4 set_mon_vals no callback set 2024-03-04T12:35:05.128 INFO:tasks.workunit.client.0.smithi110.stderr: -209> 2024-03-04T12:35:04.780+0000 7fc9c380f800 10 monclient: shutdown 2024-03-04T12:35:05.128 INFO:tasks.workunit.client.0.smithi110.stderr: -208> 2024-03-04T12:35:04.780+0000 7fc9c380f800 10 monclient: build_initial_monmap 2024-03-04T12:35:05.129 INFO:tasks.workunit.client.0.smithi110.stderr: -207> 2024-03-04T12:35:04.780+0000 7fc9c380f800 1 build_initial for_mkfs: 0 2024-03-04T12:35:05.129 INFO:tasks.workunit.client.0.smithi110.stderr: -206> 2024-03-04T12:35:04.780+0000 7fc9c380f800 10 monclient: monmap: 2024-03-04T12:35:05.129 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:35:05.129 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:35:05.129 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:35:05.129 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:35:05.129 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:35:05.129 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.129 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:35:05.129 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:35:05.129 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:35:05.129 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.129 INFO:tasks.workunit.client.0.smithi110.stderr: -205> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding auth protocol: cephx 2024-03-04T12:35:05.129 INFO:tasks.workunit.client.0.smithi110.stderr: -204> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding auth protocol: cephx 2024-03-04T12:35:05.129 INFO:tasks.workunit.client.0.smithi110.stderr: -203> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding auth protocol: cephx 2024-03-04T12:35:05.130 INFO:tasks.workunit.client.0.smithi110.stderr: -202> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.130 INFO:tasks.workunit.client.0.smithi110.stderr: -201> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.130 INFO:tasks.workunit.client.0.smithi110.stderr: -200> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.130 INFO:tasks.workunit.client.0.smithi110.stderr: -199> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.130 INFO:tasks.workunit.client.0.smithi110.stderr: -198> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.130 INFO:tasks.workunit.client.0.smithi110.stderr: -197> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.130 INFO:tasks.workunit.client.0.smithi110.stderr: -196> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.130 INFO:tasks.workunit.client.0.smithi110.stderr: -195> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.130 INFO:tasks.workunit.client.0.smithi110.stderr: -194> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.130 INFO:tasks.workunit.client.0.smithi110.stderr: -193> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.130 INFO:tasks.workunit.client.0.smithi110.stderr: -192> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: crc 2024-03-04T12:35:05.130 INFO:tasks.workunit.client.0.smithi110.stderr: -191> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fc030) adding con mode: secure 2024-03-04T12:35:05.130 INFO:tasks.workunit.client.0.smithi110.stderr: -190> 2024-03-04T12:35:04.780+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.130 INFO:tasks.workunit.client.0.smithi110.stderr: -189> 2024-03-04T12:35:04.780+0000 7fc9c380f800 1 librados: starting msgr at 2024-03-04T12:35:05.131 INFO:tasks.workunit.client.0.smithi110.stderr: -188> 2024-03-04T12:35:04.780+0000 7fc9c380f800 1 librados: starting objecter 2024-03-04T12:35:05.131 INFO:tasks.workunit.client.0.smithi110.stderr: -187> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command objecter_requests cmddesc objecter_requests hook 0x5562da2f18d0 EEXIST 2024-03-04T12:35:05.131 INFO:tasks.workunit.client.0.smithi110.stderr: -186> 2024-03-04T12:35:04.780+0000 7fc9c380f800 1 librados: setting wanted keys 2024-03-04T12:35:05.131 INFO:tasks.workunit.client.0.smithi110.stderr: -185> 2024-03-04T12:35:04.780+0000 7fc9c380f800 1 librados: calling monclient init 2024-03-04T12:35:05.131 INFO:tasks.workunit.client.0.smithi110.stderr: -184> 2024-03-04T12:35:04.780+0000 7fc9c380f800 10 monclient: init 2024-03-04T12:35:05.131 INFO:tasks.workunit.client.0.smithi110.stderr: -183> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding auth protocol: cephx 2024-03-04T12:35:05.131 INFO:tasks.workunit.client.0.smithi110.stderr: -182> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding auth protocol: cephx 2024-03-04T12:35:05.131 INFO:tasks.workunit.client.0.smithi110.stderr: -181> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding auth protocol: cephx 2024-03-04T12:35:05.131 INFO:tasks.workunit.client.0.smithi110.stderr: -180> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: secure 2024-03-04T12:35:05.131 INFO:tasks.workunit.client.0.smithi110.stderr: -179> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: crc 2024-03-04T12:35:05.131 INFO:tasks.workunit.client.0.smithi110.stderr: -178> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: secure 2024-03-04T12:35:05.131 INFO:tasks.workunit.client.0.smithi110.stderr: -177> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: crc 2024-03-04T12:35:05.131 INFO:tasks.workunit.client.0.smithi110.stderr: -176> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: secure 2024-03-04T12:35:05.131 INFO:tasks.workunit.client.0.smithi110.stderr: -175> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: crc 2024-03-04T12:35:05.131 INFO:tasks.workunit.client.0.smithi110.stderr: -174> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: crc 2024-03-04T12:35:05.132 INFO:tasks.workunit.client.0.smithi110.stderr: -173> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: secure 2024-03-04T12:35:05.132 INFO:tasks.workunit.client.0.smithi110.stderr: -172> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: crc 2024-03-04T12:35:05.132 INFO:tasks.workunit.client.0.smithi110.stderr: -171> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: secure 2024-03-04T12:35:05.132 INFO:tasks.workunit.client.0.smithi110.stderr: -170> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: crc 2024-03-04T12:35:05.132 INFO:tasks.workunit.client.0.smithi110.stderr: -169> 2024-03-04T12:35:04.780+0000 7fc9c380f800 5 AuthRegistry(0x5562da2fb200) adding con mode: secure 2024-03-04T12:35:05.132 INFO:tasks.workunit.client.0.smithi110.stderr: -168> 2024-03-04T12:35:04.781+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.132 INFO:tasks.workunit.client.0.smithi110.stderr: -167> 2024-03-04T12:35:04.781+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.132 INFO:tasks.workunit.client.0.smithi110.stderr: -166> 2024-03-04T12:35:04.781+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command rotate-key cmddesc rotate-key hook 0x5562da2fb348 EEXIST 2024-03-04T12:35:05.132 INFO:tasks.workunit.client.0.smithi110.stderr: -165> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient: _reopen_session rank -1 2024-03-04T12:35:05.132 INFO:tasks.workunit.client.0.smithi110.stderr: -164> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-04T12:35:05.132 INFO:tasks.workunit.client.0.smithi110.stderr: -163> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-c con 0x5562da3226a0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:35:05.132 INFO:tasks.workunit.client.0.smithi110.stderr: -162> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-b con 0x5562da3233b0 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:35:05.132 INFO:tasks.workunit.client.0.smithi110.stderr: -161> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient(hunting): picked mon.noname-a con 0x5562da3308e0 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:35:05.133 INFO:tasks.workunit.client.0.smithi110.stderr: -160> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.133 INFO:tasks.workunit.client.0.smithi110.stderr: -159> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.133 INFO:tasks.workunit.client.0.smithi110.stderr: -158> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:05.133 INFO:tasks.workunit.client.0.smithi110.stderr: -157> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient(hunting): _renew_subs 2024-03-04T12:35:05.133 INFO:tasks.workunit.client.0.smithi110.stderr: -156> 2024-03-04T12:35:04.781+0000 7fc9c380f800 10 monclient(hunting): authenticate will time out at 1686.140484s 2024-03-04T12:35:05.133 INFO:tasks.workunit.client.0.smithi110.stderr: -155> 2024-03-04T12:35:04.781+0000 7fc9bee81640 10 monclient(hunting): get_auth_request con 0x5562da3226a0 auth_method 0 2024-03-04T12:35:05.133 INFO:tasks.workunit.client.0.smithi110.stderr: -154> 2024-03-04T12:35:04.781+0000 7fc9bee81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.133 INFO:tasks.workunit.client.0.smithi110.stderr: -153> 2024-03-04T12:35:04.781+0000 7fc9bee81640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.133 INFO:tasks.workunit.client.0.smithi110.stderr: -152> 2024-03-04T12:35:04.781+0000 7fc9bee81640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.133 INFO:tasks.workunit.client.0.smithi110.stderr: -151> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient(hunting): get_auth_request con 0x5562da3308e0 auth_method 0 2024-03-04T12:35:05.133 INFO:tasks.workunit.client.0.smithi110.stderr: -150> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.133 INFO:tasks.workunit.client.0.smithi110.stderr: -149> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.133 INFO:tasks.workunit.client.0.smithi110.stderr: -148> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.133 INFO:tasks.workunit.client.0.smithi110.stderr: -147> 2024-03-04T12:35:04.781+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.135 INFO:tasks.workunit.client.0.smithi110.stderr: -146> 2024-03-04T12:35:04.781+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.135 INFO:tasks.workunit.client.0.smithi110.stderr: -145> 2024-03-04T12:35:04.781+0000 7fc9bee81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.135 INFO:tasks.workunit.client.0.smithi110.stderr: -144> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.135 INFO:tasks.workunit.client.0.smithi110.stderr: -143> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.135 INFO:tasks.workunit.client.0.smithi110.stderr: -142> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.135 INFO:tasks.workunit.client.0.smithi110.stderr: -141> 2024-03-04T12:35:04.781+0000 7fc9b6680640 10 monclient(hunting): get_auth_request con 0x5562da3233b0 auth_method 0 2024-03-04T12:35:05.136 INFO:tasks.workunit.client.0.smithi110.stderr: -140> 2024-03-04T12:35:04.781+0000 7fc9b6680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:05.136 INFO:tasks.workunit.client.0.smithi110.stderr: -139> 2024-03-04T12:35:04.781+0000 7fc9b6680640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:05.136 INFO:tasks.workunit.client.0.smithi110.stderr: -138> 2024-03-04T12:35:04.781+0000 7fc9b6680640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:05.136 INFO:tasks.workunit.client.0.smithi110.stderr: -137> 2024-03-04T12:35:04.781+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:05.136 INFO:tasks.workunit.client.0.smithi110.stderr: -136> 2024-03-04T12:35:04.781+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:05.136 INFO:tasks.workunit.client.0.smithi110.stderr: -135> 2024-03-04T12:35:04.781+0000 7fc9b6680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:05.136 INFO:tasks.workunit.client.0.smithi110.stderr: -134> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient(hunting): handle_auth_done global_id 6378 payload 824 2024-03-04T12:35:05.136 INFO:tasks.workunit.client.0.smithi110.stderr: -133> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient: _finish_hunting 0 2024-03-04T12:35:05.136 INFO:tasks.workunit.client.0.smithi110.stderr: -132> 2024-03-04T12:35:04.781+0000 7fc9bf682640 1 monclient: found mon.noname-a 2024-03-04T12:35:05.136 INFO:tasks.workunit.client.0.smithi110.stderr: -131> 2024-03-04T12:35:04.781+0000 7fc9bf682640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:35:05.136 INFO:tasks.workunit.client.0.smithi110.stderr: -130> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.136 INFO:tasks.workunit.client.0.smithi110.stderr: -129> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:35:05.136 INFO:tasks.workunit.client.0.smithi110.stderr: -128> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: dump: 2024-03-04T12:35:05.136 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.137 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.137 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.137 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.137 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.137 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.137 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.137 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.137 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.137 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.137 INFO:tasks.workunit.client.0.smithi110.stderr: -127> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: _finish_auth 0 2024-03-04T12:35:05.137 INFO:tasks.workunit.client.0.smithi110.stderr: -126> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: _check_auth_tickets 2024-03-04T12:35:05.137 INFO:tasks.workunit.client.0.smithi110.stderr: -125> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:05.137 INFO:tasks.workunit.client.0.smithi110.stderr: -124> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:05.137 INFO:tasks.workunit.client.0.smithi110.stderr: -123> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:35:05.138 INFO:tasks.workunit.client.0.smithi110.stderr: -122> 2024-03-04T12:35:04.782+0000 7fc8a0ff9640 10 monclient: dump: 2024-03-04T12:35:05.138 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:05.138 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:05.138 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.138 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:05.138 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:05.138 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:05.138 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:05.138 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:05.138 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:05.138 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.138 INFO:tasks.workunit.client.0.smithi110.stderr: -121> 2024-03-04T12:35:04.782+0000 7fc8a27fc640 4 set_mon_vals no callback set 2024-03-04T12:35:05.138 INFO:tasks.workunit.client.0.smithi110.stderr: -120> 2024-03-04T12:35:04.782+0000 7fc9c380f800 5 monclient: authenticate success, global_id 6378 2024-03-04T12:35:05.138 INFO:tasks.workunit.client.0.smithi110.stderr: -119> 2024-03-04T12:35:04.782+0000 7fc9c380f800 10 monclient: _renew_subs 2024-03-04T12:35:05.138 INFO:tasks.workunit.client.0.smithi110.stderr: -118> 2024-03-04T12:35:04.782+0000 7fc9c380f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:05.139 INFO:tasks.workunit.client.0.smithi110.stderr: -117> 2024-03-04T12:35:04.782+0000 7fc9c380f800 10 monclient: _renew_subs 2024-03-04T12:35:05.139 INFO:tasks.workunit.client.0.smithi110.stderr: -116> 2024-03-04T12:35:04.782+0000 7fc9c380f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:05.139 INFO:tasks.workunit.client.0.smithi110.stderr: -115> 2024-03-04T12:35:04.782+0000 7fc9c380f800 1 librados: init done 2024-03-04T12:35:05.139 INFO:tasks.workunit.client.0.smithi110.stderr: -114> 2024-03-04T12:35:04.782+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command cr dump hook 0x5562da326968 2024-03-04T12:35:05.139 INFO:tasks.workunit.client.0.smithi110.stderr: -113> 2024-03-04T12:35:04.783+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.139 INFO:tasks.workunit.client.0.smithi110.stderr: -112> 2024-03-04T12:35:04.783+0000 7fc8a0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:35:05.139 INFO:tasks.workunit.client.0.smithi110.stderr: -111> 2024-03-04T12:35:04.783+0000 7fc8a0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:05.139 INFO:tasks.workunit.client.0.smithi110.stderr: -110> 2024-03-04T12:35:04.783+0000 7fc8a0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:05.139 INFO:tasks.workunit.client.0.smithi110.stderr: -109> 2024-03-04T12:35:04.784+0000 7fc9bee81640 10 monclient: get_auth_request con 0x7fc888069eb0 auth_method 0 2024-03-04T12:35:05.139 INFO:tasks.workunit.client.0.smithi110.stderr: -108> 2024-03-04T12:35:04.784+0000 7fc9b6680640 10 monclient: get_auth_request con 0x5562da34b740 auth_method 0 2024-03-04T12:35:05.139 INFO:tasks.workunit.client.0.smithi110.stderr: -107> 2024-03-04T12:35:04.784+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.139 INFO:tasks.workunit.client.0.smithi110.stderr: -106> 2024-03-04T12:35:04.784+0000 7fc9c380f800 20 realm 2024-03-04T12:35:05.139 INFO:tasks.workunit.client.0.smithi110.stderr: -105> 2024-03-04T12:35:04.784+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.139 INFO:tasks.workunit.client.0.smithi110.stderr: -104> 2024-03-04T12:35:04.784+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.140 INFO:tasks.workunit.client.0.smithi110.stderr: -103> 2024-03-04T12:35:04.784+0000 7fc9c380f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:05.140 INFO:tasks.workunit.client.0.smithi110.stderr: -102> 2024-03-04T12:35:04.784+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.140 INFO:tasks.workunit.client.0.smithi110.stderr: -101> 2024-03-04T12:35:04.785+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.140 INFO:tasks.workunit.client.0.smithi110.stderr: -100> 2024-03-04T12:35:04.785+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.140 INFO:tasks.workunit.client.0.smithi110.stderr: -99> 2024-03-04T12:35:04.785+0000 7fc9bee81640 10 monclient: get_auth_request con 0x5562da34f930 auth_method 0 2024-03-04T12:35:05.140 INFO:tasks.workunit.client.0.smithi110.stderr: -98> 2024-03-04T12:35:04.785+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:05.140 INFO:tasks.workunit.client.0.smithi110.stderr: -97> 2024-03-04T12:35:04.785+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.140 INFO:tasks.workunit.client.0.smithi110.stderr: -96> 2024-03-04T12:35:04.786+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:05.140 INFO:tasks.workunit.client.0.smithi110.stderr: -95> 2024-03-04T12:35:04.786+0000 7fc9c380f800 20 searching for the correct realm 2024-03-04T12:35:05.140 INFO:tasks.workunit.client.0.smithi110.stderr: -94> 2024-03-04T12:35:04.786+0000 7fc9b6680640 10 monclient: get_auth_request con 0x5562da3547d0 auth_method 0 2024-03-04T12:35:05.140 INFO:tasks.workunit.client.0.smithi110.stderr: -93> 2024-03-04T12:35:04.787+0000 7fc9bf682640 10 monclient: get_auth_request con 0x7fc9a8017070 auth_method 0 2024-03-04T12:35:05.140 INFO:tasks.workunit.client.0.smithi110.stderr: -92> 2024-03-04T12:35:04.787+0000 7fc9bee81640 10 monclient: get_auth_request con 0x7fc9b8031060 auth_method 0 2024-03-04T12:35:05.140 INFO:tasks.workunit.client.0.smithi110.stderr: -91> 2024-03-04T12:35:04.788+0000 7fc9b6680640 10 monclient: get_auth_request con 0x7fc9b0089070 auth_method 0 2024-03-04T12:35:05.141 INFO:tasks.workunit.client.0.smithi110.stderr: -90> 2024-03-04T12:35:04.789+0000 7fc9b6680640 0 -- 172.21.15.110:0/1659756204 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7fc9b0089070 msgr2=0x7fc9b005b450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:05.141 INFO:tasks.workunit.client.0.smithi110.stderr: -89> 2024-03-04T12:35:04.789+0000 7fc8a0ff9640 1 client.6378.objecter ms_handle_reset 0x7fc9b0089070 session 0x7fc9b006c040 osd.4 2024-03-04T12:35:05.141 INFO:tasks.workunit.client.0.smithi110.stderr: -88> 2024-03-04T12:35:04.789+0000 7fc8a0ff9640 10 monclient: _renew_subs 2024-03-04T12:35:05.141 INFO:tasks.workunit.client.0.smithi110.stderr: -87> 2024-03-04T12:35:04.789+0000 7fc8a0ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:05.141 INFO:tasks.workunit.client.0.smithi110.stderr: -86> 2024-03-04T12:35:04.789+0000 7fc9b6680640 10 monclient: get_auth_request con 0x7fc888079c50 auth_method 0 2024-03-04T12:35:05.141 INFO:tasks.workunit.client.0.smithi110.stderr: -85> 2024-03-04T12:35:04.790+0000 7fc9bf682640 10 monclient: get_auth_request con 0x7fc9a800e070 auth_method 0 2024-03-04T12:35:05.141 INFO:tasks.workunit.client.0.smithi110.stderr: -84> 2024-03-04T12:35:04.792+0000 7fc9bee81640 10 monclient: get_auth_request con 0x7fc9a8060a30 auth_method 0 2024-03-04T12:35:05.141 INFO:tasks.workunit.client.0.smithi110.stderr: -83> 2024-03-04T12:35:04.792+0000 7fc9bee81640 0 -- 172.21.15.110:0/1659756204 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fc9a8060a30 msgr2=0x7fc9a8065790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:05.141 INFO:tasks.workunit.client.0.smithi110.stderr: -82> 2024-03-04T12:35:04.993+0000 7fc9bee81640 10 monclient: get_auth_request con 0x7fc9a8060a30 auth_method 0 2024-03-04T12:35:05.141 INFO:tasks.workunit.client.0.smithi110.stderr: -81> 2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:05.141 INFO:tasks.workunit.client.0.smithi110.stderr: -80> 2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:05.141 INFO:tasks.workunit.client.0.smithi110.stderr: -79> 2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:05.141 INFO:tasks.workunit.client.0.smithi110.stderr: -78> 2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:05.141 INFO:tasks.workunit.client.0.smithi110.stderr: -77> 2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:05.142 INFO:tasks.workunit.client.0.smithi110.stderr: -76> 2024-03-04T12:35:04.997+0000 7fc9c380f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:05.142 INFO:tasks.workunit.client.0.smithi110.stderr: -75> 2024-03-04T12:35:04.998+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.142 INFO:tasks.workunit.client.0.smithi110.stderr: -74> 2024-03-04T12:35:04.998+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.142 INFO:tasks.workunit.client.0.smithi110.stderr: -73> 2024-03-04T12:35:04.998+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.142 INFO:tasks.workunit.client.0.smithi110.stderr: -72> 2024-03-04T12:35:04.998+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:05.142 INFO:tasks.workunit.client.0.smithi110.stderr: -71> 2024-03-04T12:35:04.998+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.142 INFO:tasks.workunit.client.0.smithi110.stderr: -70> 2024-03-04T12:35:04.999+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:05.142 INFO:tasks.workunit.client.0.smithi110.stderr: -69> 2024-03-04T12:35:04.999+0000 7fc9c380f800 20 zone default found 2024-03-04T12:35:05.142 INFO:tasks.workunit.client.0.smithi110.stderr: -68> 2024-03-04T12:35:04.999+0000 7fc9c380f800 4 Realm: () 2024-03-04T12:35:05.142 INFO:tasks.workunit.client.0.smithi110.stderr: -67> 2024-03-04T12:35:04.999+0000 7fc9c380f800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:05.142 INFO:tasks.workunit.client.0.smithi110.stderr: -66> 2024-03-04T12:35:04.999+0000 7fc9c380f800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:05.142 INFO:tasks.workunit.client.0.smithi110.stderr: -65> 2024-03-04T12:35:04.999+0000 7fc9c380f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:05.142 INFO:tasks.workunit.client.0.smithi110.stderr: -64> 2024-03-04T12:35:04.999+0000 7fc9c380f800 20 zonegroup default 2024-03-04T12:35:05.142 INFO:tasks.workunit.client.0.smithi110.stderr: -63> 2024-03-04T12:35:04.999+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.143 INFO:tasks.workunit.client.0.smithi110.stderr: -62> 2024-03-04T12:35:04.999+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.143 INFO:tasks.workunit.client.0.smithi110.stderr: -61> 2024-03-04T12:35:04.999+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.143 INFO:tasks.workunit.client.0.smithi110.stderr: -60> 2024-03-04T12:35:05.000+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.143 INFO:tasks.workunit.client.0.smithi110.stderr: -59> 2024-03-04T12:35:05.000+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.143 INFO:tasks.workunit.client.0.smithi110.stderr: -58> 2024-03-04T12:35:05.000+0000 7fc9c380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.143 INFO:tasks.workunit.client.0.smithi110.stderr: -57> 2024-03-04T12:35:05.000+0000 7fc9c380f800 20 started sync module instance, tier type = 2024-03-04T12:35:05.143 INFO:tasks.workunit.client.0.smithi110.stderr: -56> 2024-03-04T12:35:05.000+0000 7fc9c380f800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:05.143 INFO:tasks.workunit.client.0.smithi110.stderr: -55> 2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=0 2024-03-04T12:35:05.143 INFO:tasks.workunit.client.0.smithi110.stderr: -54> 2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=1 2024-03-04T12:35:05.143 INFO:tasks.workunit.client.0.smithi110.stderr: -53> 2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=2 2024-03-04T12:35:05.143 INFO:tasks.workunit.client.0.smithi110.stderr: -52> 2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=3 2024-03-04T12:35:05.143 INFO:tasks.workunit.client.0.smithi110.stderr: -51> 2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=4 2024-03-04T12:35:05.143 INFO:tasks.workunit.client.0.smithi110.stderr: -50> 2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=5 2024-03-04T12:35:05.143 INFO:tasks.workunit.client.0.smithi110.stderr: -49> 2024-03-04T12:35:05.008+0000 7fc9c380f800 20 add_watcher() i=6 2024-03-04T12:35:05.144 INFO:tasks.workunit.client.0.smithi110.stderr: -48> 2024-03-04T12:35:05.009+0000 7fc9c380f800 20 add_watcher() i=7 2024-03-04T12:35:05.144 INFO:tasks.workunit.client.0.smithi110.stderr: -47> 2024-03-04T12:35:05.009+0000 7fc9c380f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:05.144 INFO:tasks.workunit.client.0.smithi110.stderr: -46> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding auth protocol: cephx 2024-03-04T12:35:05.144 INFO:tasks.workunit.client.0.smithi110.stderr: -45> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding auth protocol: cephx 2024-03-04T12:35:05.144 INFO:tasks.workunit.client.0.smithi110.stderr: -44> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding auth protocol: cephx 2024-03-04T12:35:05.144 INFO:tasks.workunit.client.0.smithi110.stderr: -43> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: secure 2024-03-04T12:35:05.144 INFO:tasks.workunit.client.0.smithi110.stderr: -42> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: crc 2024-03-04T12:35:05.144 INFO:tasks.workunit.client.0.smithi110.stderr: -41> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: secure 2024-03-04T12:35:05.144 INFO:tasks.workunit.client.0.smithi110.stderr: -40> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: crc 2024-03-04T12:35:05.144 INFO:tasks.workunit.client.0.smithi110.stderr: -39> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: secure 2024-03-04T12:35:05.144 INFO:tasks.workunit.client.0.smithi110.stderr: -38> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: crc 2024-03-04T12:35:05.144 INFO:tasks.workunit.client.0.smithi110.stderr: -37> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: crc 2024-03-04T12:35:05.144 INFO:tasks.workunit.client.0.smithi110.stderr: -36> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: secure 2024-03-04T12:35:05.144 INFO:tasks.workunit.client.0.smithi110.stderr: -35> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: crc 2024-03-04T12:35:05.145 INFO:tasks.workunit.client.0.smithi110.stderr: -34> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: secure 2024-03-04T12:35:05.145 INFO:tasks.workunit.client.0.smithi110.stderr: -33> 2024-03-04T12:35:05.010+0000 7fc8757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:05.145 INFO:tasks.workunit.client.0.smithi110.stderr: -32> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: crc 2024-03-04T12:35:05.145 INFO:tasks.workunit.client.0.smithi110.stderr: -31> 2024-03-04T12:35:05.010+0000 7fc9c380f800 5 AuthRegistry(0x7fff8c35dc40) adding con mode: secure 2024-03-04T12:35:05.145 INFO:tasks.workunit.client.0.smithi110.stderr: -30> 2024-03-04T12:35:05.011+0000 7fc9c380f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:05.145 INFO:tasks.workunit.client.0.smithi110.stderr: -29> 2024-03-04T12:35:05.011+0000 7fc9c380f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:05.145 INFO:tasks.workunit.client.0.smithi110.stderr: -28> 2024-03-04T12:35:05.011+0000 7fc9c380f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:05.145 INFO:tasks.workunit.client.0.smithi110.stderr: -27> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command cache list hook 0x5562da3293b0 2024-03-04T12:35:05.145 INFO:tasks.workunit.client.0.smithi110.stderr: -26> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command cache inspect hook 0x5562da3293b0 2024-03-04T12:35:05.145 INFO:tasks.workunit.client.0.smithi110.stderr: -25> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command cache erase hook 0x5562da3293b0 2024-03-04T12:35:05.145 INFO:tasks.workunit.client.0.smithi110.stderr: -24> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command cache zap hook 0x5562da3293b0 2024-03-04T12:35:05.145 INFO:tasks.workunit.client.0.smithi110.stderr: -23> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 note: GC not initialized 2024-03-04T12:35:05.145 INFO:tasks.workunit.client.0.smithi110.stderr: -22> 2024-03-04T12:35:05.011+0000 7fc7effff640 20 reqs_thread_entry: start 2024-03-04T12:35:05.145 INFO:tasks.workunit.client.0.smithi110.stderr: -21> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command sync trace show hook 0x7fc9b007f050 2024-03-04T12:35:05.145 INFO:tasks.workunit.client.0.smithi110.stderr: -20> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command sync trace history hook 0x7fc9b007f050 2024-03-04T12:35:05.146 INFO:tasks.workunit.client.0.smithi110.stderr: -19> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command sync trace active hook 0x7fc9b007f050 2024-03-04T12:35:05.146 INFO:tasks.workunit.client.0.smithi110.stderr: -18> 2024-03-04T12:35:05.011+0000 7fc9c380f800 5 asok(0x5562da0410c0) register_command sync trace active_short hook 0x7fc9b007f050 2024-03-04T12:35:05.146 INFO:tasks.workunit.client.0.smithi110.stderr: -17> 2024-03-04T12:35:05.011+0000 7fc9c380f800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:05.146 INFO:tasks.workunit.client.0.smithi110.stderr: -16> 2024-03-04T12:35:05.011+0000 7fc9c380f800 20 Filter name: none 2024-03-04T12:35:05.146 INFO:tasks.workunit.client.0.smithi110.stderr: -15> 2024-03-04T12:35:05.011+0000 7fc7edffb640 20 reqs_thread_entry: start 2024-03-04T12:35:05.146 INFO:tasks.workunit.client.0.smithi110.stderr: -14> 2024-03-04T12:35:05.011+0000 7fc9c380f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-04T12:35:05.146 INFO:tasks.workunit.client.0.smithi110.stderr: -13> 2024-03-04T12:35:05.011+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.146 INFO:tasks.workunit.client.0.smithi110.stderr: -12> 2024-03-04T12:35:05.012+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:05.146 INFO:tasks.workunit.client.0.smithi110.stderr: -11> 2024-03-04T12:35:05.012+0000 7fc9c380f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-04T12:35:05.146 INFO:tasks.workunit.client.0.smithi110.stderr: -10> 2024-03-04T12:35:05.012+0000 7fc9c380f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-04T12:35:05.146 INFO:tasks.workunit.client.0.smithi110.stderr: -9> 2024-03-04T12:35:05.012+0000 7fc9c380f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 : miss 2024-03-04T12:35:05.146 INFO:tasks.workunit.client.0.smithi110.stderr: -8> 2024-03-04T12:35:05.012+0000 7fc9c380f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.146 INFO:tasks.workunit.client.0.smithi110.stderr: -7> 2024-03-04T12:35:05.012+0000 7fc9c380f800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:05.146 INFO:tasks.workunit.client.0.smithi110.stderr: -6> 2024-03-04T12:35:05.012+0000 7fc9c380f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 info.flags=0x17 2024-03-04T12:35:05.147 INFO:tasks.workunit.client.0.smithi110.stderr: -5> 2024-03-04T12:35:05.012+0000 7fc9c380f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 to cache LRU end 2024-03-04T12:35:05.147 INFO:tasks.workunit.client.0.smithi110.stderr: -4> 2024-03-04T12:35:05.012+0000 7fc9c380f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:35:05.147 INFO:tasks.workunit.client.0.smithi110.stderr: -3> 2024-03-04T12:35:05.012+0000 7fc9c380f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:05.147 INFO:tasks.workunit.client.0.smithi110.stderr: -2> 2024-03-04T12:35:05.012+0000 7fc9c380f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 2024-03-04T12:35:05.147 INFO:tasks.workunit.client.0.smithi110.stderr: -1> 2024-03-04T12:35:05.016+0000 7fc9c380f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc9c380f800 time 2024-03-04T12:35:05.016700+0000 2024-03-04T12:35:05.147 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:35:05.147 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.147 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:35:05.147 INFO:tasks.workunit.client.0.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc9c4780e86] 2024-03-04T12:35:05.147 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fc9c4781044] 2024-03-04T12:35:05.147 INFO:tasks.workunit.client.0.smithi110.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5562d9386eb1] 2024-03-04T12:35:05.147 INFO:tasks.workunit.client.0.smithi110.stderr: 4: radosgw-admin(+0x7e4532) [0x5562d9391532] 2024-03-04T12:35:05.147 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x5562d939ad1b] 2024-03-04T12:35:05.147 INFO:tasks.workunit.client.0.smithi110.stderr: 6: main() 2024-03-04T12:35:05.148 INFO:tasks.workunit.client.0.smithi110.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7fc9c363feb0] 2024-03-04T12:35:05.148 INFO:tasks.workunit.client.0.smithi110.stderr: 8: __libc_start_main() 2024-03-04T12:35:05.148 INFO:tasks.workunit.client.0.smithi110.stderr: 9: _start() 2024-03-04T12:35:05.148 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.148 INFO:tasks.workunit.client.0.smithi110.stderr: 0> 2024-03-04T12:35:05.017+0000 7fc9c380f800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:35:05.148 INFO:tasks.workunit.client.0.smithi110.stderr: in thread 7fc9c380f800 thread_name:radosgw-admin 2024-03-04T12:35:05.148 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.148 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:35:05.148 INFO:tasks.workunit.client.0.smithi110.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc9c3654db0] 2024-03-04T12:35:05.148 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc9c36a154c] 2024-03-04T12:35:05.148 INFO:tasks.workunit.client.0.smithi110.stderr: 3: raise() 2024-03-04T12:35:05.148 INFO:tasks.workunit.client.0.smithi110.stderr: 4: abort() 2024-03-04T12:35:05.148 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc9c4780ee0] 2024-03-04T12:35:05.148 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fc9c4781044] 2024-03-04T12:35:05.149 INFO:tasks.workunit.client.0.smithi110.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5562d9386eb1] 2024-03-04T12:35:05.149 INFO:tasks.workunit.client.0.smithi110.stderr: 8: radosgw-admin(+0x7e4532) [0x5562d9391532] 2024-03-04T12:35:05.149 INFO:tasks.workunit.client.0.smithi110.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x5562d939ad1b] 2024-03-04T12:35:05.149 INFO:tasks.workunit.client.0.smithi110.stderr: 10: main() 2024-03-04T12:35:05.149 INFO:tasks.workunit.client.0.smithi110.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7fc9c363feb0] 2024-03-04T12:35:05.149 INFO:tasks.workunit.client.0.smithi110.stderr: 12: __libc_start_main() 2024-03-04T12:35:05.149 INFO:tasks.workunit.client.0.smithi110.stderr: 13: _start() 2024-03-04T12:35:05.149 INFO:tasks.workunit.client.0.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:35:05.149 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.149 INFO:tasks.workunit.client.0.smithi110.stderr:--- logging levels --- 2024-03-04T12:35:05.149 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 none 2024-03-04T12:35:05.149 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 lockdep 2024-03-04T12:35:05.149 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 context 2024-03-04T12:35:05.149 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 crush 2024-03-04T12:35:05.150 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds 2024-03-04T12:35:05.150 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_balancer 2024-03-04T12:35:05.150 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_locker 2024-03-04T12:35:05.150 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_log 2024-03-04T12:35:05.150 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_log_expire 2024-03-04T12:35:05.150 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_migrator 2024-03-04T12:35:05.150 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 buffer 2024-03-04T12:35:05.150 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 timer 2024-03-04T12:35:05.150 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 filer 2024-03-04T12:35:05.150 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 striper 2024-03-04T12:35:05.150 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 objecter 2024-03-04T12:35:05.150 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rados 2024-03-04T12:35:05.150 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd 2024-03-04T12:35:05.150 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_mirror 2024-03-04T12:35:05.151 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_replay 2024-03-04T12:35:05.151 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_pwl 2024-03-04T12:35:05.151 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 journaler 2024-03-04T12:35:05.151 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 objectcacher 2024-03-04T12:35:05.151 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 immutable_obj_cache 2024-03-04T12:35:05.151 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 client 2024-03-04T12:35:05.151 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 osd 2024-03-04T12:35:05.151 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 optracker 2024-03-04T12:35:05.151 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 objclass 2024-03-04T12:35:05.151 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 filestore 2024-03-04T12:35:05.151 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 journal 2024-03-04T12:35:05.151 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 0 ms 2024-03-04T12:35:05.151 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mon 2024-03-04T12:35:05.151 INFO:tasks.workunit.client.0.smithi110.stderr: 0/10 monc 2024-03-04T12:35:05.151 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 paxos 2024-03-04T12:35:05.152 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 tp 2024-03-04T12:35:05.152 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 auth 2024-03-04T12:35:05.152 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 crypto 2024-03-04T12:35:05.152 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 finisher 2024-03-04T12:35:05.152 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 reserver 2024-03-04T12:35:05.152 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 heartbeatmap 2024-03-04T12:35:05.152 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 perfcounter 2024-03-04T12:35:05.152 INFO:tasks.workunit.client.0.smithi110.stderr: 20/20 rgw 2024-03-04T12:35:05.152 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_sync 2024-03-04T12:35:05.152 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_datacache 2024-03-04T12:35:05.152 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_access 2024-03-04T12:35:05.152 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_dbstore 2024-03-04T12:35:05.152 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_flight 2024-03-04T12:35:05.152 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_lifecycle 2024-03-04T12:35:05.153 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 javaclient 2024-03-04T12:35:05.153 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 asok 2024-03-04T12:35:05.153 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 throttle 2024-03-04T12:35:05.153 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 0 refs 2024-03-04T12:35:05.153 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 compressor 2024-03-04T12:35:05.153 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 bluestore 2024-03-04T12:35:05.153 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 bluefs 2024-03-04T12:35:05.153 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 bdev 2024-03-04T12:35:05.153 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 kstore 2024-03-04T12:35:05.153 INFO:tasks.workunit.client.0.smithi110.stderr: 4/ 5 rocksdb 2024-03-04T12:35:05.153 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 fuse 2024-03-04T12:35:05.153 INFO:tasks.workunit.client.0.smithi110.stderr: 2/ 5 mgr 2024-03-04T12:35:05.153 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mgrc 2024-03-04T12:35:05.153 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 dpdk 2024-03-04T12:35:05.153 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 eventtrace 2024-03-04T12:35:05.154 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 prioritycache 2024-03-04T12:35:05.154 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 test 2024-03-04T12:35:05.154 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cephfs_mirror 2024-03-04T12:35:05.154 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cephsqlite 2024-03-04T12:35:05.154 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 crimson_interrupt 2024-03-04T12:35:05.154 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore 2024-03-04T12:35:05.154 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_onode 2024-03-04T12:35:05.154 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_odata 2024-03-04T12:35:05.154 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_omap 2024-03-04T12:35:05.154 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_tm 2024-03-04T12:35:05.154 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_t 2024-03-04T12:35:05.154 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_cleaner 2024-03-04T12:35:05.154 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_epm 2024-03-04T12:35:05.154 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_lba 2024-03-04T12:35:05.155 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-04T12:35:05.155 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_cache 2024-03-04T12:35:05.155 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_journal 2024-03-04T12:35:05.155 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_device 2024-03-04T12:35:05.155 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_backref 2024-03-04T12:35:05.155 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 alienstore 2024-03-04T12:35:05.155 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mclock 2024-03-04T12:35:05.155 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cyanstore 2024-03-04T12:35:05.155 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 ceph_exporter 2024-03-04T12:35:05.155 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 memstore 2024-03-04T12:35:05.155 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 trace 2024-03-04T12:35:05.155 INFO:tasks.workunit.client.0.smithi110.stderr: -2/-2 (syslog threshold) 2024-03-04T12:35:05.155 INFO:tasks.workunit.client.0.smithi110.stderr: 99/99 (stderr threshold) 2024-03-04T12:35:05.155 INFO:tasks.workunit.client.0.smithi110.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-04T12:35:05.155 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc7edffb640 / http_manager 2024-03-04T12:35:05.156 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc7effff640 / http_manager 2024-03-04T12:35:05.156 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc8757e2640 / rgw_dt_lg_renew 2024-03-04T12:35:05.156 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc8a0ff9640 / ms_dispatch 2024-03-04T12:35:05.156 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc8a27fc640 / io_context_pool 2024-03-04T12:35:05.156 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc8a8e01640 / ms_dispatch 2024-03-04T12:35:05.156 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc8ab606640 / ms_dispatch 2024-03-04T12:35:05.156 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc8ace09640 / io_context_pool 2024-03-04T12:35:05.156 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc9b6680640 / msgr-worker-2 2024-03-04T12:35:05.156 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc9bee81640 / msgr-worker-1 2024-03-04T12:35:05.156 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc9bf682640 / msgr-worker-0 2024-03-04T12:35:05.156 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc9bfe83640 / io_context_pool 2024-03-04T12:35:05.156 INFO:tasks.workunit.client.0.smithi110.stderr: 7fc9c380f800 / radosgw-admin 2024-03-04T12:35:05.156 INFO:tasks.workunit.client.0.smithi110.stderr: max_recent 500 2024-03-04T12:35:05.156 INFO:tasks.workunit.client.0.smithi110.stderr: max_new 1000 2024-03-04T12:35:05.157 INFO:tasks.workunit.client.0.smithi110.stderr: log_file /var/lib/ceph/crash/2024-03-04T12:35:05.018313Z_c7cdf878-577d-4feb-8b4d-25e91c90126b/log 2024-03-04T12:35:05.157 INFO:tasks.workunit.client.0.smithi110.stderr:--- end dump of recent events --- 2024-03-04T12:35:05.157 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-03-04T12:35:05.162 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:05.162 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:05.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.086+0000 7f8c5fa14800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.088+0000 7f8c5fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.088+0000 7f8c5fa14800 20 realm 2024-03-04T12:35:05.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.088+0000 7f8c5fa14800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.088+0000 7f8c5fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.088+0000 7f8c5fa14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:05.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.088+0000 7f8c5fa14800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.088+0000 7f8c5fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.088+0000 7f8c5fa14800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.089+0000 7f8c5fa14800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:05.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.089+0000 7f8c5fa14800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.089+0000 7f8c5fa14800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:05.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.089+0000 7f8c5fa14800 20 searching for the correct realm 2024-03-04T12:35:05.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.092+0000 7f8c52892640 0 -- 172.21.15.110:0/4074002959 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x557953fa5d20 msgr2=0x557953fa81b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:05.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.096+0000 7f8c5b093640 0 -- 172.21.15.110:0/4074002959 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f8c440b75c0 msgr2=0x7f8c440c3040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:05.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:05.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:05.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:05.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:05.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:05.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:05.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:05.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:05.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 20 zone default found 2024-03-04T12:35:05.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 4 Realm: () 2024-03-04T12:35:05.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:05.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:05.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:05.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 20 zonegroup default 2024-03-04T12:35:05.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.100+0000 7f8c5fa14800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.101+0000 7f8c5fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.101+0000 7f8c5fa14800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.101+0000 7f8c5fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.101+0000 7f8c5fa14800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.101+0000 7f8c5fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.101+0000 7f8c5fa14800 20 started sync module instance, tier type = 2024-03-04T12:35:05.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.101+0000 7f8c5fa14800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:05.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.109+0000 7f8c5fa14800 20 add_watcher() i=0 2024-03-04T12:35:05.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.109+0000 7f8c5fa14800 20 add_watcher() i=1 2024-03-04T12:35:05.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.109+0000 7f8c5fa14800 20 add_watcher() i=2 2024-03-04T12:35:05.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.109+0000 7f8c5fa14800 20 add_watcher() i=3 2024-03-04T12:35:05.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.109+0000 7f8c5fa14800 20 add_watcher() i=4 2024-03-04T12:35:05.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.109+0000 7f8c5fa14800 20 add_watcher() i=5 2024-03-04T12:35:05.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.109+0000 7f8c5fa14800 20 add_watcher() i=6 2024-03-04T12:35:05.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.110+0000 7f8c5fa14800 20 add_watcher() i=7 2024-03-04T12:35:05.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.110+0000 7f8c5fa14800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:05.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.112+0000 7f8b11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:05.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.112+0000 7f8c5fa14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:05.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.112+0000 7f8c5fa14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:05.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.112+0000 7f8c5fa14800 5 note: GC not initialized 2024-03-04T12:35:05.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.112+0000 7f8b10fe1640 20 reqs_thread_entry: start 2024-03-04T12:35:05.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.113+0000 7f8c5fa14800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:05.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.113+0000 7f8c5fa14800 20 Filter name: none 2024-03-04T12:35:05.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.113+0000 7f8a8a7fc640 20 reqs_thread_entry: start 2024-03-04T12:35:05.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.113+0000 7f8c5fa14800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.113+0000 7f8c5fa14800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:05.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.113+0000 7f8c5fa14800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.113+0000 7f8c5fa14800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:05.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.113+0000 7f8c5fa14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:05.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.113+0000 7f8c5fa14800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.114+0000 7f8c5fa14800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:05.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.114+0000 7f8c5fa14800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.114+0000 7f8c5fa14800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:05.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.114+0000 7f8c5fa14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:05.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.115+0000 7f8c5fa14800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.115+0000 7f8c5fa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.116+0000 7f8b11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:05.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.118+0000 7f8c5fa14800 20 remove_watcher() i=0 2024-03-04T12:35:05.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.118+0000 7f8c5fa14800 2 removed watcher, disabling cache 2024-03-04T12:35:05.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.119+0000 7f8c5fa14800 20 remove_watcher() i=1 2024-03-04T12:35:05.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.119+0000 7f8c5fa14800 20 remove_watcher() i=2 2024-03-04T12:35:05.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.120+0000 7f8c5fa14800 20 remove_watcher() i=3 2024-03-04T12:35:05.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.121+0000 7f8c5fa14800 20 remove_watcher() i=4 2024-03-04T12:35:05.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.122+0000 7f8c5fa14800 20 remove_watcher() i=5 2024-03-04T12:35:05.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.123+0000 7f8c5fa14800 20 remove_watcher() i=6 2024-03-04T12:35:05.168 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.124+0000 7f8c5fa14800 20 remove_watcher() i=7 2024-03-04T12:35:05.168 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.168 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:35:05.168 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: abort-at-set-target-layout id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:35:05.168 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:05.168 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:05.169 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:05.169 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:05.169 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:05.222 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:35:05.252 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:05.252 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:05.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.279+0000 7f7873624800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.280+0000 7f7873624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.280+0000 7f7873624800 20 realm 2024-03-04T12:35:05.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.280+0000 7f7873624800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.280+0000 7f7873624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.280+0000 7f7873624800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:05.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.280+0000 7f7873624800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.280+0000 7f7873624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.280+0000 7f7873624800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.281+0000 7f7873624800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:05.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.281+0000 7f7873624800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.281+0000 7f7873624800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:05.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.281+0000 7f7873624800 20 searching for the correct realm 2024-03-04T12:35:05.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.284+0000 7f786891f640 0 -- 172.21.15.110:0/2687519358 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x5587aa57ec80 msgr2=0x5587aa581120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:05.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.288+0000 7f7871120640 0 -- 172.21.15.110:0/2687519358 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f785c022710 msgr2=0x7f785c076a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:05.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.291+0000 7f7873624800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:05.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.291+0000 7f7873624800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:05.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.291+0000 7f7873624800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:05.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.291+0000 7f7873624800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:05.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.291+0000 7f7873624800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:05.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.291+0000 7f7873624800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:05.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.291+0000 7f7873624800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.291+0000 7f7873624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.291+0000 7f7873624800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.292+0000 7f7873624800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:05.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.292+0000 7f7873624800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.292+0000 7f7873624800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:05.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.292+0000 7f7873624800 20 zone default found 2024-03-04T12:35:05.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.292+0000 7f7873624800 4 Realm: () 2024-03-04T12:35:05.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.292+0000 7f7873624800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:05.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.292+0000 7f7873624800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:05.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.292+0000 7f7873624800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:05.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.292+0000 7f7873624800 20 zonegroup default 2024-03-04T12:35:05.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.292+0000 7f7873624800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.292+0000 7f7873624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.292+0000 7f7873624800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.293+0000 7f7873624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.293+0000 7f7873624800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.293+0000 7f7873624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:05.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.293+0000 7f7873624800 20 started sync module instance, tier type = 2024-03-04T12:35:05.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.293+0000 7f7873624800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:05.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.301+0000 7f7873624800 20 add_watcher() i=0 2024-03-04T12:35:05.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.301+0000 7f7873624800 20 add_watcher() i=1 2024-03-04T12:35:05.307 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.301+0000 7f7873624800 20 add_watcher() i=2 2024-03-04T12:35:05.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.301+0000 7f7873624800 20 add_watcher() i=3 2024-03-04T12:35:05.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.301+0000 7f7873624800 20 add_watcher() i=4 2024-03-04T12:35:05.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.301+0000 7f7873624800 20 add_watcher() i=5 2024-03-04T12:35:05.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.301+0000 7f7873624800 20 add_watcher() i=6 2024-03-04T12:35:05.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.302+0000 7f7873624800 20 add_watcher() i=7 2024-03-04T12:35:05.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.302+0000 7f7873624800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:05.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.303+0000 7f77277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:05.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.304+0000 7f7873624800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:05.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.304+0000 7f7873624800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:05.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.304+0000 7f7873624800 5 note: GC not initialized 2024-03-04T12:35:05.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.304+0000 7f77267e4640 20 reqs_thread_entry: start 2024-03-04T12:35:05.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.304+0000 7f7873624800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:05.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.304+0000 7f7873624800 20 Filter name: none 2024-03-04T12:35:05.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.304+0000 7f7697fff640 20 reqs_thread_entry: start 2024-03-04T12:35:05.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.304+0000 7f7873624800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-04T12:35:05.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.304+0000 7f7873624800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.305+0000 7f7873624800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:05.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.305+0000 7f7873624800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-04T12:35:05.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.305+0000 7f7873624800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-04T12:35:05.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.305+0000 7f7873624800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 : miss 2024-03-04T12:35:05.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.305+0000 7f7873624800 20 rados->read ofs=0 len=0 2024-03-04T12:35:05.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.305+0000 7f7873624800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:05.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.305+0000 7f7873624800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 info.flags=0x17 2024-03-04T12:35:05.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.305+0000 7f7873624800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 to cache LRU end 2024-03-04T12:35:05.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.305+0000 7f7873624800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:35:05.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.305+0000 7f7873624800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:05.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.305+0000 7f7873624800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 2024-03-04T12:35:05.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.306+0000 7f7873624800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 to be held by another RGW process; skipping for now 2024-03-04T12:35:05.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.307+0000 7f77277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:05.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.309+0000 7f7873624800 20 remove_watcher() i=0 2024-03-04T12:35:05.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.309+0000 7f7873624800 2 removed watcher, disabling cache 2024-03-04T12:35:05.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.310+0000 7f7873624800 20 remove_watcher() i=1 2024-03-04T12:35:05.317 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.311+0000 7f7873624800 20 remove_watcher() i=2 2024-03-04T12:35:05.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.312+0000 7f7873624800 20 remove_watcher() i=3 2024-03-04T12:35:05.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.313+0000 7f7873624800 20 remove_watcher() i=4 2024-03-04T12:35:05.320 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.314+0000 7f7873624800 20 remove_watcher() i=5 2024-03-04T12:35:05.321 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.315+0000 7f7873624800 20 remove_watcher() i=6 2024-03-04T12:35:05.322 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:05.316+0000 7f7873624800 20 remove_watcher() i=7 2024-03-04T12:35:05.331 INFO:tasks.workunit.client.0.smithi110.stderr:waiting 30 seconds for reshard lock to expire... 2024-03-04T12:35:35.364 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:35:35.398 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:35.398 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:35.436 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.429+0000 7f356a91f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.440 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.430+0000 7f356a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:35.440 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.430+0000 7f356a91f800 20 realm 2024-03-04T12:35:35.441 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.430+0000 7f356a91f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.441 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.430+0000 7f356a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:35.441 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.430+0000 7f356a91f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:35.441 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.430+0000 7f356a91f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.441 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.431+0000 7f356a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:35.441 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.431+0000 7f356a91f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.441 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.432+0000 7f356a91f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:35.441 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.432+0000 7f356a91f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.432+0000 7f356a91f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:35.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.432+0000 7f356a91f800 20 searching for the correct realm 2024-03-04T12:35:35.443 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.436+0000 7f3565de8640 0 -- 172.21.15.110:0/4060281555 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f355802c070 msgr2=0x7f355803d990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:35.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.440+0000 7f3566dea640 0 -- 172.21.15.110:0/4060281555 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7f355c0034b0 msgr2=0x7f355c0b2360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:35:35.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.444+0000 7f356a91f800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:35.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.444+0000 7f356a91f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:35.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.444+0000 7f356a91f800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:35.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.444+0000 7f356a91f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:35.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.444+0000 7f356a91f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:35.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.444+0000 7f356a91f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:35.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.444+0000 7f356a91f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.445+0000 7f356a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:35.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.445+0000 7f356a91f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.445+0000 7f356a91f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:35.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.445+0000 7f356a91f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.445+0000 7f356a91f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:35.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.445+0000 7f356a91f800 20 zone default found 2024-03-04T12:35:35.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.445+0000 7f356a91f800 4 Realm: () 2024-03-04T12:35:35.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.445+0000 7f356a91f800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:35.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.445+0000 7f356a91f800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:35.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.445+0000 7f356a91f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:35.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.445+0000 7f356a91f800 20 zonegroup default 2024-03-04T12:35:35.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.445+0000 7f356a91f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.446+0000 7f356a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:35.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.446+0000 7f356a91f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.446+0000 7f356a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:35.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.446+0000 7f356a91f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.446+0000 7f356a91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:35.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.446+0000 7f356a91f800 20 started sync module instance, tier type = 2024-03-04T12:35:35.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.446+0000 7f356a91f800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:35.463 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.455+0000 7f356a91f800 20 add_watcher() i=0 2024-03-04T12:35:35.463 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.455+0000 7f356a91f800 20 add_watcher() i=1 2024-03-04T12:35:35.463 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.455+0000 7f356a91f800 20 add_watcher() i=2 2024-03-04T12:35:35.463 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.455+0000 7f356a91f800 20 add_watcher() i=3 2024-03-04T12:35:35.463 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.455+0000 7f356a91f800 20 add_watcher() i=4 2024-03-04T12:35:35.463 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.455+0000 7f356a91f800 20 add_watcher() i=5 2024-03-04T12:35:35.463 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.455+0000 7f356a91f800 20 add_watcher() i=6 2024-03-04T12:35:35.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.456+0000 7f356a91f800 20 add_watcher() i=7 2024-03-04T12:35:35.464 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.456+0000 7f356a91f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:35.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.458+0000 7f341cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:35.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.458+0000 7f356a91f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:35.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.458+0000 7f356a91f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:35.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.458+0000 7f356a91f800 5 note: GC not initialized 2024-03-04T12:35:35.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.459+0000 7f33977fe640 20 reqs_thread_entry: start 2024-03-04T12:35:35.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.459+0000 7f356a91f800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:35.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.459+0000 7f356a91f800 20 Filter name: none 2024-03-04T12:35:35.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.459+0000 7f33957fa640 20 reqs_thread_entry: start 2024-03-04T12:35:35.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.459+0000 7f356a91f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-04T12:35:35.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.459+0000 7f356a91f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.468 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.460+0000 7f356a91f800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:35.468 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.460+0000 7f356a91f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-04T12:35:35.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.460+0000 7f356a91f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-04T12:35:35.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.460+0000 7f356a91f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 : miss 2024-03-04T12:35:35.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.460+0000 7f356a91f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.460+0000 7f356a91f800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:35.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.460+0000 7f356a91f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 info.flags=0x17 2024-03-04T12:35:35.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.460+0000 7f356a91f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 to cache LRU end 2024-03-04T12:35:35.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.460+0000 7f356a91f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:35:35.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.460+0000 7f356a91f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:35.469 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.460+0000 7f356a91f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 2024-03-04T12:35:35.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.466+0000 7f356a91f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 info.flags=0x17 2024-03-04T12:35:35.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.466+0000 7f356a91f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 to cache LRU end 2024-03-04T12:35:35.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.466+0000 7f356a91f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:35.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.466+0000 7f356a91f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22, ofs0, ns] 2024-03-04T12:35:35.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.466+0000 7f34497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824083 cookie 94637294134512 notifier 6429 bl.length()=959 2024-03-04T12:35:35.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.466+0000 7f34497fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 info.flags=0x17 2024-03-04T12:35:35.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.466+0000 7f34497fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 to cache LRU end 2024-03-04T12:35:35.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.466+0000 7f34497fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:35.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.468+0000 7f356a91f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22]): orig_sources= new_sources= 2024-03-04T12:35:35.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.468+0000 7f356a91f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22]): potential sources added=[] removed=[] 2024-03-04T12:35:35.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.468+0000 7f356a91f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22]): orig_dests= new_dests= 2024-03-04T12:35:35.476 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.468+0000 7f356a91f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22]): potential dests added=[] removed=[] 2024-03-04T12:35:35.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.0 2024-03-04T12:35:35.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.0 2024-03-04T12:35:35.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.1 2024-03-04T12:35:35.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.1 2024-03-04T12:35:35.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.2 2024-03-04T12:35:35.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.2 2024-03-04T12:35:35.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.3 2024-03-04T12:35:35.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.3 2024-03-04T12:35:35.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.4 2024-03-04T12:35:35.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.4 2024-03-04T12:35:35.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.5 2024-03-04T12:35:35.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.5 2024-03-04T12:35:35.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.6 2024-03-04T12:35:35.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.6 2024-03-04T12:35:35.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.7 2024-03-04T12:35:35.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.7 2024-03-04T12:35:35.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.8 2024-03-04T12:35:35.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.8 2024-03-04T12:35:35.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.9 2024-03-04T12:35:35.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.9 2024-03-04T12:35:35.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.10 2024-03-04T12:35:35.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.10 2024-03-04T12:35:35.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.11 2024-03-04T12:35:35.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1.11 2024-03-04T12:35:35.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.470+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.0 2024-03-04T12:35:35.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.471+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.1 2024-03-04T12:35:35.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.472+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.2 2024-03-04T12:35:35.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.472+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.3 2024-03-04T12:35:35.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.473+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.4 2024-03-04T12:35:35.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.473+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.5 2024-03-04T12:35:35.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.474+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.6 2024-03-04T12:35:35.481 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.474+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.7 2024-03-04T12:35:35.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.474+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.8 2024-03-04T12:35:35.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.475+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.9 2024-03-04T12:35:35.482 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.475+0000 7f356a91f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22.10 2024-03-04T12:35:35.485 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.478+0000 7f356a91f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 : hit (requested=0x17, cached=0x17) 2024-03-04T12:35:35.485 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.478+0000 7f356a91f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 2024-03-04T12:35:35.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.479+0000 7f356a91f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 info.flags=0x17 2024-03-04T12:35:35.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.479+0000 7f356a91f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 to cache LRU end 2024-03-04T12:35:35.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.479+0000 7f356a91f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:35.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.479+0000 7f356a91f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22, ofs0, ns] 2024-03-04T12:35:35.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.480+0000 7f3449ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824084 cookie 94637294134512 notifier 6429 bl.length()=927 2024-03-04T12:35:35.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.480+0000 7f3449ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 info.flags=0x17 2024-03-04T12:35:35.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.480+0000 7f3449ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 to cache LRU end 2024-03-04T12:35:35.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.480+0000 7f3449ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:35.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.481+0000 7f356a91f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22]): orig_sources= new_sources= 2024-03-04T12:35:35.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.481+0000 7f356a91f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22]): potential sources added=[] removed=[] 2024-03-04T12:35:35.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.481+0000 7f356a91f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22]): orig_dests= new_dests= 2024-03-04T12:35:35.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.481+0000 7f356a91f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22]): potential dests added=[] removed=[] 2024-03-04T12:35:35.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.484+0000 7f356a91f800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" completed successfully 2024-03-04T12:35:35.494 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.486+0000 7f341cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:35.496 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.489+0000 7f356a91f800 20 remove_watcher() i=0 2024-03-04T12:35:35.496 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.489+0000 7f356a91f800 2 removed watcher, disabling cache 2024-03-04T12:35:35.497 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.490+0000 7f356a91f800 20 remove_watcher() i=1 2024-03-04T12:35:35.498 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.491+0000 7f356a91f800 20 remove_watcher() i=2 2024-03-04T12:35:35.499 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.492+0000 7f356a91f800 20 remove_watcher() i=3 2024-03-04T12:35:35.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.493+0000 7f356a91f800 20 remove_watcher() i=4 2024-03-04T12:35:35.501 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.494+0000 7f356a91f800 20 remove_watcher() i=5 2024-03-04T12:35:35.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.494+0000 7f356a91f800 20 remove_watcher() i=6 2024-03-04T12:35:35.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.495+0000 7f356a91f800 20 remove_watcher() i=7 2024-03-04T12:35:35.514 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-03-04T12:35:35.541 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:35.541 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:35.574 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.567+0000 7f8ea8439800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.568+0000 7f8ea8439800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:35.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.568+0000 7f8ea8439800 20 realm 2024-03-04T12:35:35.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.568+0000 7f8ea8439800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.568+0000 7f8ea8439800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:35.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.568+0000 7f8ea8439800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:35.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.569+0000 7f8ea8439800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.569+0000 7f8ea8439800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:35.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.569+0000 7f8ea8439800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.569+0000 7f8ea8439800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:35.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.569+0000 7f8ea8439800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.570+0000 7f8ea8439800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:35.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.570+0000 7f8ea8439800 20 searching for the correct realm 2024-03-04T12:35:35.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.573+0000 7f8e9bfff640 0 -- 172.21.15.110:0/504519293 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f8e94018420 msgr2=0x7f8e94030ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:35.584 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.576+0000 7f8ea306f640 0 -- 172.21.15.110:0/504519293 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f8e8c097f80 msgr2=0x7f8e8c09a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:35.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.782+0000 7f8ea8439800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:35.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.782+0000 7f8ea8439800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:35.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.782+0000 7f8ea8439800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:35.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.782+0000 7f8ea8439800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:35.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.782+0000 7f8ea8439800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:35.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.782+0000 7f8ea8439800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:35.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.782+0000 7f8ea8439800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.782+0000 7f8ea8439800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:35.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.782+0000 7f8ea8439800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.783+0000 7f8ea8439800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:35.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.783+0000 7f8ea8439800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.783+0000 7f8ea8439800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:35.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.783+0000 7f8ea8439800 20 zone default found 2024-03-04T12:35:35.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.783+0000 7f8ea8439800 4 Realm: () 2024-03-04T12:35:35.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.783+0000 7f8ea8439800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:35.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.783+0000 7f8ea8439800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:35.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.783+0000 7f8ea8439800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:35.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.783+0000 7f8ea8439800 20 zonegroup default 2024-03-04T12:35:35.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.783+0000 7f8ea8439800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.783+0000 7f8ea8439800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:35.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.783+0000 7f8ea8439800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.784+0000 7f8ea8439800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:35.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.784+0000 7f8ea8439800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.784+0000 7f8ea8439800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:35.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.784+0000 7f8ea8439800 20 started sync module instance, tier type = 2024-03-04T12:35:35.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.784+0000 7f8ea8439800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:35.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.793+0000 7f8ea8439800 20 add_watcher() i=0 2024-03-04T12:35:35.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.793+0000 7f8ea8439800 20 add_watcher() i=1 2024-03-04T12:35:35.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.793+0000 7f8ea8439800 20 add_watcher() i=2 2024-03-04T12:35:35.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.793+0000 7f8ea8439800 20 add_watcher() i=3 2024-03-04T12:35:35.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.793+0000 7f8ea8439800 20 add_watcher() i=4 2024-03-04T12:35:35.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.793+0000 7f8ea8439800 20 add_watcher() i=5 2024-03-04T12:35:35.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.793+0000 7f8ea8439800 20 add_watcher() i=6 2024-03-04T12:35:35.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.794+0000 7f8ea8439800 20 add_watcher() i=7 2024-03-04T12:35:35.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.794+0000 7f8ea8439800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:35.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.796+0000 7f8d59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:35.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.796+0000 7f8ea8439800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:35.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.796+0000 7f8ea8439800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:35.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.796+0000 7f8ea8439800 5 note: GC not initialized 2024-03-04T12:35:35.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.796+0000 7f8d58fe1640 20 reqs_thread_entry: start 2024-03-04T12:35:35.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.796+0000 7f8ea8439800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:35.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.796+0000 7f8ea8439800 20 Filter name: none 2024-03-04T12:35:35.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.796+0000 7f8cd27fc640 20 reqs_thread_entry: start 2024-03-04T12:35:35.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.797+0000 7f8ea8439800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.797+0000 7f8ea8439800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:35.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.797+0000 7f8ea8439800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.797+0000 7f8ea8439800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:35.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.797+0000 7f8ea8439800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:35.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.797+0000 7f8ea8439800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.798+0000 7f8ea8439800 20 rados_obj.operate() r=0 bl.length=218 2024-03-04T12:35:35.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.798+0000 7f8ea8439800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.798+0000 7f8ea8439800 20 rados_obj.operate() r=0 bl.length=390 2024-03-04T12:35:35.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.798+0000 7f8ea8439800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:35.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.799+0000 7f8ea8439800 20 rados->read ofs=0 len=0 2024-03-04T12:35:35.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.799+0000 7f8ea8439800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:35.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.800+0000 7f8d59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:35.809 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.802+0000 7f8ea8439800 20 remove_watcher() i=0 2024-03-04T12:35:35.810 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.802+0000 7f8ea8439800 2 removed watcher, disabling cache 2024-03-04T12:35:35.811 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.803+0000 7f8ea8439800 20 remove_watcher() i=1 2024-03-04T12:35:35.811 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.804+0000 7f8ea8439800 20 remove_watcher() i=2 2024-03-04T12:35:35.812 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.805+0000 7f8ea8439800 20 remove_watcher() i=3 2024-03-04T12:35:35.813 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.806+0000 7f8ea8439800 20 remove_watcher() i=4 2024-03-04T12:35:35.814 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.807+0000 7f8ea8439800 20 remove_watcher() i=5 2024-03-04T12:35:35.815 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.808+0000 7f8ea8439800 20 remove_watcher() i=6 2024-03-04T12:35:35.816 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:35.809+0000 7f8ea8439800 20 remove_watcher() i=7 2024-03-04T12:35:35.826 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:35.826 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:35:35.826 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: abort-at-set-target-layout id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-04T12:35:35.826 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:35.828 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:35.828 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:35.844 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:35.844 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.011 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.011 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.135 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-03-04T12:35:36.136 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:36.137 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.137 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.182 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.182 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.236 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.236 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.267 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.267 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.295 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.295 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.323 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.323 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.354 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.354 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.382 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.382 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.410 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.410 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.438 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.438 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.469 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.469 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.499 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.499 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.527 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.527 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.555 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.555 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.584 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.584 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.611 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.611 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.640 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.641 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.669 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.669 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.697 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.697 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.725 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.725 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.753 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.753 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.781 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:36.782 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:36.810 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-03-04T12:35:36.837 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:36.837 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:36.870 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.863+0000 7fa2ebd2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.865+0000 7fa2ebd2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:36.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.865+0000 7fa2ebd2f800 20 realm 2024-03-04T12:35:36.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.865+0000 7fa2ebd2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.865+0000 7fa2ebd2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:36.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.865+0000 7fa2ebd2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:36.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.865+0000 7fa2ebd2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.872 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.865+0000 7fa2ebd2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:36.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.865+0000 7fa2ebd2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.866+0000 7fa2ebd2f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:36.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.866+0000 7fa2ebd2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.867+0000 7fa2ebd2f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:36.874 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.867+0000 7fa2ebd2f800 20 searching for the correct realm 2024-03-04T12:35:36.876 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.870+0000 7fa2df1af640 0 -- 172.21.15.110:0/3816108831 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x558734def030 msgr2=0x558734df14a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:36.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.874+0000 7fa2e79b0640 0 -- 172.21.15.110:0/3816108831 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fa2d0078700 msgr2=0x7fa2d005a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:36.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:36.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:36.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:36.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:36.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:36.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:36.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:36.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:36.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:36.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 20 zone default found 2024-03-04T12:35:36.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 4 Realm: () 2024-03-04T12:35:36.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:36.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:36.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:36.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 20 zonegroup default 2024-03-04T12:35:36.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.879+0000 7fa2ebd2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:36.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.880+0000 7fa2ebd2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.880+0000 7fa2ebd2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:36.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.880+0000 7fa2ebd2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.880+0000 7fa2ebd2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:36.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.880+0000 7fa2ebd2f800 20 started sync module instance, tier type = 2024-03-04T12:35:36.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.880+0000 7fa2ebd2f800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:36.896 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.889+0000 7fa2ebd2f800 20 add_watcher() i=0 2024-03-04T12:35:36.896 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.889+0000 7fa2ebd2f800 20 add_watcher() i=1 2024-03-04T12:35:36.896 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.889+0000 7fa2ebd2f800 20 add_watcher() i=2 2024-03-04T12:35:36.896 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.889+0000 7fa2ebd2f800 20 add_watcher() i=3 2024-03-04T12:35:36.896 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.889+0000 7fa2ebd2f800 20 add_watcher() i=4 2024-03-04T12:35:36.896 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.889+0000 7fa2ebd2f800 20 add_watcher() i=5 2024-03-04T12:35:36.896 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.889+0000 7fa2ebd2f800 20 add_watcher() i=6 2024-03-04T12:35:36.897 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.890+0000 7fa2ebd2f800 20 add_watcher() i=7 2024-03-04T12:35:36.897 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.890+0000 7fa2ebd2f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:36.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.892+0000 7fa19dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:36.899 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.892+0000 7fa2ebd2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:36.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.892+0000 7fa2ebd2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:36.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.892+0000 7fa2ebd2f800 5 note: GC not initialized 2024-03-04T12:35:36.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.892+0000 7fa19cfe1640 20 reqs_thread_entry: start 2024-03-04T12:35:36.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.893+0000 7fa2ebd2f800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:36.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.893+0000 7fa2ebd2f800 20 Filter name: none 2024-03-04T12:35:36.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.893+0000 7fa1167fc640 20 reqs_thread_entry: start 2024-03-04T12:35:36.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.893+0000 7fa2ebd2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.893+0000 7fa2ebd2f800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:35:36.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.893+0000 7fa2ebd2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.894+0000 7fa2ebd2f800 20 rados_obj.operate() r=0 bl.length=385 2024-03-04T12:35:36.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.894+0000 7fa2ebd2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:36.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.894+0000 7fa2ebd2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.894+0000 7fa2ebd2f800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:35:36.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.894+0000 7fa2ebd2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.894+0000 7fa2ebd2f800 20 rados_obj.operate() r=0 bl.length=385 2024-03-04T12:35:36.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.894+0000 7fa2ebd2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:36.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.895+0000 7fa2ebd2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.896+0000 7fa2ebd2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:36.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.896+0000 7fa19dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:36.905 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.899+0000 7fa2ebd2f800 20 remove_watcher() i=0 2024-03-04T12:35:36.905 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.899+0000 7fa2ebd2f800 2 removed watcher, disabling cache 2024-03-04T12:35:36.906 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.900+0000 7fa2ebd2f800 20 remove_watcher() i=1 2024-03-04T12:35:36.907 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.901+0000 7fa2ebd2f800 20 remove_watcher() i=2 2024-03-04T12:35:36.908 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.902+0000 7fa2ebd2f800 20 remove_watcher() i=3 2024-03-04T12:35:36.909 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.903+0000 7fa2ebd2f800 20 remove_watcher() i=4 2024-03-04T12:35:36.910 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.903+0000 7fa2ebd2f800 20 remove_watcher() i=5 2024-03-04T12:35:36.911 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.904+0000 7fa2ebd2f800 20 remove_watcher() i=6 2024-03-04T12:35:36.911 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.905+0000 7fa2ebd2f800 20 remove_watcher() i=7 2024-03-04T12:35:36.921 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:36.922 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:35:36.922 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: error-at-block-writes id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:35:36.922 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:36.923 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-03-04T12:35:36.956 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:36.956 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:36.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.983+0000 7f3363444800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.990 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.984+0000 7f3363444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:36.991 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.984+0000 7f3363444800 20 realm 2024-03-04T12:35:36.991 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.984+0000 7f3363444800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.991 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.984+0000 7f3363444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:36.991 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.984+0000 7f3363444800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:36.991 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.984+0000 7f3363444800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.991 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.984+0000 7f3363444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:36.991 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.984+0000 7f3363444800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.992 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.985+0000 7f3363444800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:36.992 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.985+0000 7f3363444800 20 rados->read ofs=0 len=0 2024-03-04T12:35:36.992 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.985+0000 7f3363444800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:36.992 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:36.985+0000 7f3363444800 20 searching for the correct realm 2024-03-04T12:35:37.196 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.189+0000 7f3361741640 0 -- 172.21.15.110:0/2257852465 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f334c080b90 msgr2=0x7f334c05bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:35:37.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.194+0000 7f3360f40640 0 -- 172.21.15.110:0/2257852465 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f334c071ba0 msgr2=0x7f334c0822f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:37.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.400+0000 7f3363444800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:37.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.400+0000 7f3363444800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:37.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.400+0000 7f3363444800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:37.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.400+0000 7f3363444800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:37.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.400+0000 7f3363444800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:37.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.400+0000 7f3363444800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:37.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.400+0000 7f3363444800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.400+0000 7f3363444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:37.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.400+0000 7f3363444800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.401+0000 7f3363444800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:37.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.401+0000 7f3363444800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.401+0000 7f3363444800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:37.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.401+0000 7f3363444800 20 zone default found 2024-03-04T12:35:37.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.401+0000 7f3363444800 4 Realm: () 2024-03-04T12:35:37.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.401+0000 7f3363444800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:37.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.401+0000 7f3363444800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:37.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.401+0000 7f3363444800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:37.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.401+0000 7f3363444800 20 zonegroup default 2024-03-04T12:35:37.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.401+0000 7f3363444800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.401+0000 7f3363444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:37.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.401+0000 7f3363444800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.401+0000 7f3363444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:37.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.401+0000 7f3363444800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.402+0000 7f3363444800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:37.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.402+0000 7f3363444800 20 started sync module instance, tier type = 2024-03-04T12:35:37.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.402+0000 7f3363444800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:37.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.411+0000 7f3363444800 20 add_watcher() i=0 2024-03-04T12:35:37.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.411+0000 7f3363444800 20 add_watcher() i=1 2024-03-04T12:35:37.417 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.411+0000 7f3363444800 20 add_watcher() i=2 2024-03-04T12:35:37.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.411+0000 7f3363444800 20 add_watcher() i=3 2024-03-04T12:35:37.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.411+0000 7f3363444800 20 add_watcher() i=4 2024-03-04T12:35:37.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.411+0000 7f3363444800 20 add_watcher() i=5 2024-03-04T12:35:37.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.411+0000 7f3363444800 20 add_watcher() i=6 2024-03-04T12:35:37.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.412+0000 7f3363444800 20 add_watcher() i=7 2024-03-04T12:35:37.418 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.412+0000 7f3363444800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:37.420 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.414+0000 7f3216fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:37.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.414+0000 7f3363444800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:37.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.414+0000 7f3363444800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:37.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.414+0000 7f3363444800 5 note: GC not initialized 2024-03-04T12:35:37.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.414+0000 7f3215fe3640 20 reqs_thread_entry: start 2024-03-04T12:35:37.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.414+0000 7f3363444800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:37.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.414+0000 7f3363444800 20 Filter name: none 2024-03-04T12:35:37.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.414+0000 7f31877fe640 20 reqs_thread_entry: start 2024-03-04T12:35:37.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.414+0000 7f3363444800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-03-04T12:35:37.421 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.414+0000 7f3363444800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.415+0000 7f3363444800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:35:37.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.415+0000 7f3363444800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-03-04T12:35:37.422 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.415+0000 7f3363444800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-03-04T12:35:37.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.415+0000 7f3363444800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 : miss 2024-03-04T12:35:37.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.415+0000 7f3363444800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.415+0000 7f3363444800 20 rados_obj.operate() r=0 bl.length=385 2024-03-04T12:35:37.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.415+0000 7f3363444800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 info.flags=0x17 2024-03-04T12:35:37.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.415+0000 7f3363444800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 to cache LRU end 2024-03-04T12:35:37.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.415+0000 7f3363444800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:35:37.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.415+0000 7f3363444800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:37.423 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.415+0000 7f3363444800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 2024-03-04T12:35:37.427 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.421+0000 7f3363444800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 info.flags=0x17 2024-03-04T12:35:37.427 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.421+0000 7f3363444800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 to cache LRU end 2024-03-04T12:35:37.427 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.421+0000 7f3363444800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:37.427 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.421+0000 7f3363444800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23, ofs0, ns] 2024-03-04T12:35:37.428 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.421+0000 7f32377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824062 cookie 94337731640080 notifier 6483 bl.length()=949 2024-03-04T12:35:37.428 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.421+0000 7f32377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 info.flags=0x17 2024-03-04T12:35:37.428 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.421+0000 7f32377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 to cache LRU end 2024-03-04T12:35:37.428 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.421+0000 7f32377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:37.429 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.423+0000 7f3363444800 20 handle_bi_update(): bucket=:error-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23]): orig_sources= new_sources= 2024-03-04T12:35:37.429 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.423+0000 7f3363444800 20 handle_bi_update(): bucket=:error-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23]): potential sources added=[] removed=[] 2024-03-04T12:35:37.429 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.423+0000 7f3363444800 20 handle_bi_update(): bucket=:error-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23]): orig_dests= new_dests= 2024-03-04T12:35:37.429 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.423+0000 7f3363444800 20 handle_bi_update(): bucket=:error-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23]): potential dests added=[] removed=[] 2024-03-04T12:35:37.429 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.423+0000 7f3363444800 -1 Injecting error=-5 at location=block_writes 2024-03-04T12:35:37.430 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.423+0000 7f3363444800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-03-04T12:35:37.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.425+0000 7f3363444800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 : hit (requested=0x17, cached=0x17) 2024-03-04T12:35:37.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.425+0000 7f3363444800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 2024-03-04T12:35:37.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.427+0000 7f3363444800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 info.flags=0x17 2024-03-04T12:35:37.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.427+0000 7f3363444800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 to cache LRU end 2024-03-04T12:35:37.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.427+0000 7f3363444800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:37.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.427+0000 7f3363444800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23, ofs0, ns] 2024-03-04T12:35:37.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.427+0000 7f3237fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824063 cookie 94337731640080 notifier 6483 bl.length()=917 2024-03-04T12:35:37.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.427+0000 7f3237fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 info.flags=0x17 2024-03-04T12:35:37.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.427+0000 7f3237fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 to cache LRU end 2024-03-04T12:35:37.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.427+0000 7f3237fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:37.435 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.428+0000 7f3363444800 20 handle_bi_update(): bucket=:error-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23]): orig_sources= new_sources= 2024-03-04T12:35:37.435 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.428+0000 7f3363444800 20 handle_bi_update(): bucket=:error-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23]): potential sources added=[] removed=[] 2024-03-04T12:35:37.435 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.428+0000 7f3363444800 20 handle_bi_update(): bucket=:error-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23]): orig_dests= new_dests= 2024-03-04T12:35:37.435 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.428+0000 7f3363444800 20 handle_bi_update(): bucket=:error-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23]): potential dests added=[] removed=[] 2024-03-04T12:35:37.437 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.430+0000 7f3216fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:37.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.433+0000 7f3363444800 20 remove_watcher() i=0 2024-03-04T12:35:37.439 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.433+0000 7f3363444800 2 removed watcher, disabling cache 2024-03-04T12:35:37.440 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.434+0000 7f3363444800 20 remove_watcher() i=1 2024-03-04T12:35:37.441 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.435+0000 7f3363444800 20 remove_watcher() i=2 2024-03-04T12:35:37.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.436+0000 7f3363444800 20 remove_watcher() i=3 2024-03-04T12:35:37.444 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.437+0000 7f3363444800 20 remove_watcher() i=4 2024-03-04T12:35:37.445 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.438+0000 7f3363444800 20 remove_watcher() i=5 2024-03-04T12:35:37.445 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.439+0000 7f3363444800 20 remove_watcher() i=6 2024-03-04T12:35:37.446 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.440+0000 7f3363444800 20 remove_watcher() i=7 2024-03-04T12:35:37.458 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-03-04T12:35:37.486 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:37.486 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:37.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.512+0000 7f4c49811800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.514+0000 7f4c49811800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:37.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.514+0000 7f4c49811800 20 realm 2024-03-04T12:35:37.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.514+0000 7f4c49811800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.514+0000 7f4c49811800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:37.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.514+0000 7f4c49811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:37.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.514+0000 7f4c49811800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.514+0000 7f4c49811800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:37.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.514+0000 7f4c49811800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.515+0000 7f4c49811800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:37.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.515+0000 7f4c49811800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.515+0000 7f4c49811800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:37.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.515+0000 7f4c49811800 20 searching for the correct realm 2024-03-04T12:35:37.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.517+0000 7f4c44fcc640 0 -- 172.21.15.110:0/3249118884 >> [v2:172.21.15.110:6800/2482344533,v1:172.21.15.110:6801/2482344533] conn(0x7f4c4002a040 msgr2=0x7f4c40018400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:37.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.722+0000 7f4c457cd640 0 -- 172.21.15.110:0/3249118884 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f4c300adc00 msgr2=0x7f4c3009aa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:37.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.728+0000 7f4c49811800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:37.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.728+0000 7f4c49811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:37.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.728+0000 7f4c49811800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:37.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.728+0000 7f4c49811800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:37.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.728+0000 7f4c49811800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:37.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.728+0000 7f4c49811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:37.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.728+0000 7f4c49811800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.728+0000 7f4c49811800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:37.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.728+0000 7f4c49811800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.729+0000 7f4c49811800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:37.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.729+0000 7f4c49811800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.729+0000 7f4c49811800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:37.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.729+0000 7f4c49811800 20 zone default found 2024-03-04T12:35:37.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.729+0000 7f4c49811800 4 Realm: () 2024-03-04T12:35:37.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.729+0000 7f4c49811800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:37.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.729+0000 7f4c49811800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:37.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.729+0000 7f4c49811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:37.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.729+0000 7f4c49811800 20 zonegroup default 2024-03-04T12:35:37.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.729+0000 7f4c49811800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.729+0000 7f4c49811800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:37.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.729+0000 7f4c49811800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.730+0000 7f4c49811800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:37.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.730+0000 7f4c49811800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.730+0000 7f4c49811800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:37.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.730+0000 7f4c49811800 20 started sync module instance, tier type = 2024-03-04T12:35:37.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.730+0000 7f4c49811800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:37.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.739+0000 7f4c49811800 20 add_watcher() i=0 2024-03-04T12:35:37.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.739+0000 7f4c49811800 20 add_watcher() i=1 2024-03-04T12:35:37.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.739+0000 7f4c49811800 20 add_watcher() i=2 2024-03-04T12:35:37.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.739+0000 7f4c49811800 20 add_watcher() i=3 2024-03-04T12:35:37.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.739+0000 7f4c49811800 20 add_watcher() i=4 2024-03-04T12:35:37.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.739+0000 7f4c49811800 20 add_watcher() i=5 2024-03-04T12:35:37.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.739+0000 7f4c49811800 20 add_watcher() i=6 2024-03-04T12:35:37.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.740+0000 7f4c49811800 20 add_watcher() i=7 2024-03-04T12:35:37.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.740+0000 7f4c49811800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:37.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.742+0000 7f4afafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:37.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.742+0000 7f4c49811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:37.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.742+0000 7f4c49811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:37.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.742+0000 7f4c49811800 5 note: GC not initialized 2024-03-04T12:35:37.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.742+0000 7f4af9fe3640 20 reqs_thread_entry: start 2024-03-04T12:35:37.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.742+0000 7f4c49811800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:37.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.742+0000 7f4c49811800 20 Filter name: none 2024-03-04T12:35:37.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.742+0000 7f4a6b7fe640 20 reqs_thread_entry: start 2024-03-04T12:35:37.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.742+0000 7f4c49811800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.743+0000 7f4c49811800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:35:37.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.743+0000 7f4c49811800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.744+0000 7f4c49811800 20 rados_obj.operate() r=0 bl.length=385 2024-03-04T12:35:37.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.744+0000 7f4c49811800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:37.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.744+0000 7f4c49811800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.744+0000 7f4c49811800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:35:37.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.744+0000 7f4c49811800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.744+0000 7f4c49811800 20 rados_obj.operate() r=0 bl.length=385 2024-03-04T12:35:37.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.744+0000 7f4c49811800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:37.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.745+0000 7f4c49811800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.745+0000 7f4c49811800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:37.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.746+0000 7f4afafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:37.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.748+0000 7f4c49811800 20 remove_watcher() i=0 2024-03-04T12:35:37.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.748+0000 7f4c49811800 2 removed watcher, disabling cache 2024-03-04T12:35:37.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.749+0000 7f4c49811800 20 remove_watcher() i=1 2024-03-04T12:35:37.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.750+0000 7f4c49811800 20 remove_watcher() i=2 2024-03-04T12:35:37.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.751+0000 7f4c49811800 20 remove_watcher() i=3 2024-03-04T12:35:37.759 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.753+0000 7f4c49811800 20 remove_watcher() i=4 2024-03-04T12:35:37.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.754+0000 7f4c49811800 20 remove_watcher() i=5 2024-03-04T12:35:37.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.754+0000 7f4c49811800 20 remove_watcher() i=6 2024-03-04T12:35:37.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.755+0000 7f4c49811800 20 remove_watcher() i=7 2024-03-04T12:35:37.771 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:37.771 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:35:37.772 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: error-at-block-writes id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:35:37.772 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:37.773 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:37.773 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:37.798 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:37.798 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:37.855 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:35:37.885 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:37.885 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:37.918 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.912+0000 7fb9dde67800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.920 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.913+0000 7fb9dde67800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:37.920 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.913+0000 7fb9dde67800 20 realm 2024-03-04T12:35:37.920 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.913+0000 7fb9dde67800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.920 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.913+0000 7fb9dde67800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:37.920 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.913+0000 7fb9dde67800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:37.920 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.913+0000 7fb9dde67800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.920 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.913+0000 7fb9dde67800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:37.920 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.913+0000 7fb9dde67800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.914+0000 7fb9dde67800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:37.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.914+0000 7fb9dde67800 20 rados->read ofs=0 len=0 2024-03-04T12:35:37.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.915+0000 7fb9dde67800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:37.921 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.915+0000 7fb9dde67800 20 searching for the correct realm 2024-03-04T12:35:37.926 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:37.919+0000 7fb9dc16b640 0 -- 172.21.15.110:0/1369054684 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7fb9c406dbe0 msgr2=0x7fb9c4078400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:35:38.131 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.125+0000 7fb9dc16b640 0 -- 172.21.15.110:0/1369054684 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7fb8a4079bd0 msgr2=0x7fb8a407c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:38.135 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.128+0000 7fb9dde67800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:38.135 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.128+0000 7fb9dde67800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:38.135 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.128+0000 7fb9dde67800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:38.135 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.128+0000 7fb9dde67800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:38.135 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.128+0000 7fb9dde67800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:38.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.128+0000 7fb9dde67800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:38.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.128+0000 7fb9dde67800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.129+0000 7fb9dde67800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:38.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.129+0000 7fb9dde67800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.129+0000 7fb9dde67800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:38.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.129+0000 7fb9dde67800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.129+0000 7fb9dde67800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:38.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.129+0000 7fb9dde67800 20 zone default found 2024-03-04T12:35:38.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.129+0000 7fb9dde67800 4 Realm: () 2024-03-04T12:35:38.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.129+0000 7fb9dde67800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:38.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.129+0000 7fb9dde67800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:38.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.129+0000 7fb9dde67800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:38.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.129+0000 7fb9dde67800 20 zonegroup default 2024-03-04T12:35:38.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.129+0000 7fb9dde67800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.130+0000 7fb9dde67800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:38.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.130+0000 7fb9dde67800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.130+0000 7fb9dde67800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:38.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.130+0000 7fb9dde67800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.130+0000 7fb9dde67800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:38.139 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.130+0000 7fb9dde67800 20 started sync module instance, tier type = 2024-03-04T12:35:38.139 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.130+0000 7fb9dde67800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:38.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.139+0000 7fb9dde67800 20 add_watcher() i=0 2024-03-04T12:35:38.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.139+0000 7fb9dde67800 20 add_watcher() i=1 2024-03-04T12:35:38.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.139+0000 7fb9dde67800 20 add_watcher() i=2 2024-03-04T12:35:38.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.142+0000 7fb9dde67800 20 add_watcher() i=3 2024-03-04T12:35:38.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.142+0000 7fb9dde67800 20 add_watcher() i=4 2024-03-04T12:35:38.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.142+0000 7fb9dde67800 20 add_watcher() i=5 2024-03-04T12:35:38.148 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.142+0000 7fb9dde67800 20 add_watcher() i=6 2024-03-04T12:35:38.149 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.142+0000 7fb9dde67800 20 add_watcher() i=7 2024-03-04T12:35:38.149 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.142+0000 7fb9dde67800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:38.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.143+0000 7fb891fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:38.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.144+0000 7fb9dde67800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:38.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.144+0000 7fb9dde67800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:38.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.144+0000 7fb9dde67800 5 note: GC not initialized 2024-03-04T12:35:38.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.144+0000 7fb890fe1640 20 reqs_thread_entry: start 2024-03-04T12:35:38.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.144+0000 7fb9dde67800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:38.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.144+0000 7fb9dde67800 20 Filter name: none 2024-03-04T12:35:38.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.144+0000 7fb80a7fc640 20 reqs_thread_entry: start 2024-03-04T12:35:38.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.144+0000 7fb9dde67800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-03-04T12:35:38.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.144+0000 7fb9dde67800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.145+0000 7fb9dde67800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:35:38.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.145+0000 7fb9dde67800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-03-04T12:35:38.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.145+0000 7fb9dde67800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-03-04T12:35:38.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.145+0000 7fb9dde67800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 : miss 2024-03-04T12:35:38.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.145+0000 7fb9dde67800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.145+0000 7fb9dde67800 20 rados_obj.operate() r=0 bl.length=385 2024-03-04T12:35:38.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.145+0000 7fb9dde67800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 info.flags=0x17 2024-03-04T12:35:38.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.145+0000 7fb9dde67800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 to cache LRU end 2024-03-04T12:35:38.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.145+0000 7fb9dde67800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:35:38.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.145+0000 7fb9dde67800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:38.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.145+0000 7fb9dde67800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 2024-03-04T12:35:38.157 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.151+0000 7fb9dde67800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 info.flags=0x17 2024-03-04T12:35:38.157 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.151+0000 7fb9dde67800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 to cache LRU end 2024-03-04T12:35:38.157 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.151+0000 7fb9dde67800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:38.157 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.151+0000 7fb9dde67800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23, ofs0, ns] 2024-03-04T12:35:38.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.151+0000 7fb8ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824064 cookie 94844884616832 notifier 6107 bl.length()=949 2024-03-04T12:35:38.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.151+0000 7fb8ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 info.flags=0x17 2024-03-04T12:35:38.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.151+0000 7fb8ba7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 to cache LRU end 2024-03-04T12:35:38.158 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.151+0000 7fb8ba7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:38.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.153+0000 7fb9dde67800 20 handle_bi_update(): bucket=:error-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23]): orig_sources= new_sources= 2024-03-04T12:35:38.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.153+0000 7fb9dde67800 20 handle_bi_update(): bucket=:error-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23]): potential sources added=[] removed=[] 2024-03-04T12:35:38.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.153+0000 7fb9dde67800 20 handle_bi_update(): bucket=:error-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23]): orig_dests= new_dests= 2024-03-04T12:35:38.159 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.153+0000 7fb9dde67800 20 handle_bi_update(): bucket=:error-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23]): potential dests added=[] removed=[] 2024-03-04T12:35:38.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.0 2024-03-04T12:35:38.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.0 2024-03-04T12:35:38.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.1 2024-03-04T12:35:38.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.1 2024-03-04T12:35:38.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.2 2024-03-04T12:35:38.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.2 2024-03-04T12:35:38.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.3 2024-03-04T12:35:38.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.3 2024-03-04T12:35:38.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.4 2024-03-04T12:35:38.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.4 2024-03-04T12:35:38.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.5 2024-03-04T12:35:38.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.5 2024-03-04T12:35:38.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.6 2024-03-04T12:35:38.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.6 2024-03-04T12:35:38.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.7 2024-03-04T12:35:38.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.7 2024-03-04T12:35:38.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.8 2024-03-04T12:35:38.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.8 2024-03-04T12:35:38.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.9 2024-03-04T12:35:38.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.9 2024-03-04T12:35:38.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.10 2024-03-04T12:35:38.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.10 2024-03-04T12:35:38.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.11 2024-03-04T12:35:38.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1.11 2024-03-04T12:35:38.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.155+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.0 2024-03-04T12:35:38.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.156+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.1 2024-03-04T12:35:38.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.156+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.2 2024-03-04T12:35:38.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.157+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.3 2024-03-04T12:35:38.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.157+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.4 2024-03-04T12:35:38.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.158+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.5 2024-03-04T12:35:38.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.158+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.6 2024-03-04T12:35:38.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.159+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.7 2024-03-04T12:35:38.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.159+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.8 2024-03-04T12:35:38.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.160+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.9 2024-03-04T12:35:38.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.160+0000 7fb9dde67800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23.10 2024-03-04T12:35:38.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.165+0000 7fb9dde67800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 : hit (requested=0x17, cached=0x17) 2024-03-04T12:35:38.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.165+0000 7fb9dde67800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 2024-03-04T12:35:38.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.166+0000 7fb9dde67800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 info.flags=0x17 2024-03-04T12:35:38.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.166+0000 7fb9dde67800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 to cache LRU end 2024-03-04T12:35:38.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.166+0000 7fb9dde67800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:38.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.166+0000 7fb9dde67800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23, ofs0, ns] 2024-03-04T12:35:38.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.167+0000 7fb8baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824065 cookie 94844884616832 notifier 6107 bl.length()=917 2024-03-04T12:35:38.174 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.167+0000 7fb8baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 info.flags=0x17 2024-03-04T12:35:38.174 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.167+0000 7fb8baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 to cache LRU end 2024-03-04T12:35:38.174 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.167+0000 7fb8baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:38.175 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.168+0000 7fb9dde67800 20 handle_bi_update(): bucket=:error-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23]): orig_sources= new_sources= 2024-03-04T12:35:38.175 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.168+0000 7fb9dde67800 20 handle_bi_update(): bucket=:error-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23]): potential sources added=[] removed=[] 2024-03-04T12:35:38.175 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.168+0000 7fb9dde67800 20 handle_bi_update(): bucket=:error-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23]): orig_dests= new_dests= 2024-03-04T12:35:38.175 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.168+0000 7fb9dde67800 20 handle_bi_update(): bucket=:error-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23]): potential dests added=[] removed=[] 2024-03-04T12:35:38.177 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.171+0000 7fb9dde67800 1 execute INFO: reshard of bucket "error-at-block-writes" completed successfully 2024-03-04T12:35:38.179 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.173+0000 7fb891fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:38.181 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.175+0000 7fb9dde67800 20 remove_watcher() i=0 2024-03-04T12:35:38.181 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.175+0000 7fb9dde67800 2 removed watcher, disabling cache 2024-03-04T12:35:38.182 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.176+0000 7fb9dde67800 20 remove_watcher() i=1 2024-03-04T12:35:38.183 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.177+0000 7fb9dde67800 20 remove_watcher() i=2 2024-03-04T12:35:38.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.178+0000 7fb9dde67800 20 remove_watcher() i=3 2024-03-04T12:35:38.185 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.179+0000 7fb9dde67800 20 remove_watcher() i=4 2024-03-04T12:35:38.186 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.180+0000 7fb9dde67800 20 remove_watcher() i=5 2024-03-04T12:35:38.187 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.181+0000 7fb9dde67800 20 remove_watcher() i=6 2024-03-04T12:35:38.188 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.182+0000 7fb9dde67800 20 remove_watcher() i=7 2024-03-04T12:35:38.199 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-03-04T12:35:38.226 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:38.227 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:38.261 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.253+0000 7fc1bb024800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.262 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.254+0000 7fc1bb024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:38.262 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.254+0000 7fc1bb024800 20 realm 2024-03-04T12:35:38.262 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.254+0000 7fc1bb024800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.262 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.254+0000 7fc1bb024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:38.262 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.254+0000 7fc1bb024800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:38.262 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.254+0000 7fc1bb024800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.254+0000 7fc1bb024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:38.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.254+0000 7fc1bb024800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.255+0000 7fc1bb024800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:38.264 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.255+0000 7fc1bb024800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.264 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.255+0000 7fc1bb024800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:38.264 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.255+0000 7fc1bb024800 20 searching for the correct realm 2024-03-04T12:35:38.265 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.259+0000 7fc1b9328640 0 -- 172.21.15.110:0/2162468750 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7fc1a400e070 msgr2=0x7fc1a400ad40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:38.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.262+0000 7fc1b8b27640 0 -- 172.21.15.110:0/2162468750 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fc1a4069ed0 msgr2=0x7fc1a405e310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:38.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.468+0000 7fc1bb024800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:38.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.468+0000 7fc1bb024800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:38.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.468+0000 7fc1bb024800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:38.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.468+0000 7fc1bb024800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:38.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.468+0000 7fc1bb024800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:38.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.468+0000 7fc1bb024800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:38.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.468+0000 7fc1bb024800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.468+0000 7fc1bb024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:38.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.468+0000 7fc1bb024800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.469+0000 7fc1bb024800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:38.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.469+0000 7fc1bb024800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.469+0000 7fc1bb024800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:38.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.469+0000 7fc1bb024800 20 zone default found 2024-03-04T12:35:38.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.469+0000 7fc1bb024800 4 Realm: () 2024-03-04T12:35:38.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.469+0000 7fc1bb024800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:38.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.469+0000 7fc1bb024800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:38.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.469+0000 7fc1bb024800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:38.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.469+0000 7fc1bb024800 20 zonegroup default 2024-03-04T12:35:38.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.469+0000 7fc1bb024800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.469+0000 7fc1bb024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:38.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.469+0000 7fc1bb024800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.470+0000 7fc1bb024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:38.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.470+0000 7fc1bb024800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.470+0000 7fc1bb024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:38.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.470+0000 7fc1bb024800 20 started sync module instance, tier type = 2024-03-04T12:35:38.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.470+0000 7fc1bb024800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:38.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.479+0000 7fc1bb024800 20 add_watcher() i=0 2024-03-04T12:35:38.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.479+0000 7fc1bb024800 20 add_watcher() i=1 2024-03-04T12:35:38.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.479+0000 7fc1bb024800 20 add_watcher() i=2 2024-03-04T12:35:38.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.479+0000 7fc1bb024800 20 add_watcher() i=3 2024-03-04T12:35:38.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.479+0000 7fc1bb024800 20 add_watcher() i=4 2024-03-04T12:35:38.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.480+0000 7fc1bb024800 20 add_watcher() i=5 2024-03-04T12:35:38.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.480+0000 7fc1bb024800 20 add_watcher() i=6 2024-03-04T12:35:38.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.480+0000 7fc1bb024800 20 add_watcher() i=7 2024-03-04T12:35:38.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.480+0000 7fc1bb024800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:38.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.482+0000 7fc06efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:38.489 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.483+0000 7fc1bb024800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:38.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.483+0000 7fc1bb024800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:38.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.483+0000 7fc1bb024800 5 note: GC not initialized 2024-03-04T12:35:38.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.483+0000 7fc06dfe3640 20 reqs_thread_entry: start 2024-03-04T12:35:38.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.483+0000 7fc1bb024800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:38.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.483+0000 7fc1bb024800 20 Filter name: none 2024-03-04T12:35:38.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.483+0000 7fbfdf7fe640 20 reqs_thread_entry: start 2024-03-04T12:35:38.490 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.483+0000 7fc1bb024800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.484+0000 7fc1bb024800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:35:38.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.484+0000 7fc1bb024800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.484+0000 7fc1bb024800 20 rados_obj.operate() r=0 bl.length=385 2024-03-04T12:35:38.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.484+0000 7fc1bb024800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:38.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.484+0000 7fc1bb024800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.485+0000 7fc1bb024800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:35:38.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.485+0000 7fc1bb024800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.485+0000 7fc1bb024800 20 rados_obj.operate() r=0 bl.length=385 2024-03-04T12:35:38.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.485+0000 7fc1bb024800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:38.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.486+0000 7fc1bb024800 20 rados->read ofs=0 len=0 2024-03-04T12:35:38.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.486+0000 7fc1bb024800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:38.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.487+0000 7fc06efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:38.496 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.489+0000 7fc1bb024800 20 remove_watcher() i=0 2024-03-04T12:35:38.496 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.489+0000 7fc1bb024800 2 removed watcher, disabling cache 2024-03-04T12:35:38.496 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.490+0000 7fc1bb024800 20 remove_watcher() i=1 2024-03-04T12:35:38.498 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.491+0000 7fc1bb024800 20 remove_watcher() i=2 2024-03-04T12:35:38.499 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.493+0000 7fc1bb024800 20 remove_watcher() i=3 2024-03-04T12:35:38.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.494+0000 7fc1bb024800 20 remove_watcher() i=4 2024-03-04T12:35:38.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.494+0000 7fc1bb024800 20 remove_watcher() i=5 2024-03-04T12:35:38.501 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.495+0000 7fc1bb024800 20 remove_watcher() i=6 2024-03-04T12:35:38.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:38.496+0000 7fc1bb024800 20 remove_watcher() i=7 2024-03-04T12:35:38.512 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:38.512 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:35:38.512 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: error-at-block-writes id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-04T12:35:38.512 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:38.514 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:38.514 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:38.533 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:38.533 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:38.686 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:38.686 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:38.814 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: reshard bucket with abort at block_writes 2024-03-04T12:35:38.814 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:38.815 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:38.815 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:38.859 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:38.859 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:38.913 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:38.913 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:38.942 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:38.943 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:38.972 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:38.972 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:38.999 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:38.999 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.027 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:39.028 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.055 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:39.055 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.082 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:39.083 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.111 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:39.111 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.138 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:39.139 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.167 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:39.167 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.195 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:39.195 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.223 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:39.223 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.251 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:39.251 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.279 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:39.279 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.308 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:39.308 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.336 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:39.336 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.365 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:39.365 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.395 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:39.395 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.424 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:39.424 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.452 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:39.452 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:39.481 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-03-04T12:35:39.508 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:39.509 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:39.542 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.535+0000 7f6ee4b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.537+0000 7f6ee4b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:39.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.537+0000 7f6ee4b2f800 20 realm 2024-03-04T12:35:39.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.537+0000 7f6ee4b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.537+0000 7f6ee4b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:39.544 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.537+0000 7f6ee4b2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:39.545 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.537+0000 7f6ee4b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.545 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.537+0000 7f6ee4b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:39.545 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.537+0000 7f6ee4b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.546 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.538+0000 7f6ee4b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:39.546 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.538+0000 7f6ee4b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.546 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.538+0000 7f6ee4b2f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:39.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.538+0000 7f6ee4b2f800 20 searching for the correct realm 2024-03-04T12:35:39.547 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.540+0000 7f6ee07f7640 0 -- 172.21.15.110:0/938109830 >> [v2:172.21.15.110:6800/2482344533,v1:172.21.15.110:6801/2482344533] conn(0x7f6ed801f040 msgr2=0x7f6ed801f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:39.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.745+0000 7f6ee0ff8640 0 -- 172.21.15.110:0/938109830 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f6ec8066030 msgr2=0x7f6ec80ca820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:39.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.751+0000 7f6ee4b2f800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:39.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.751+0000 7f6ee4b2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:39.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.751+0000 7f6ee4b2f800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:39.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.751+0000 7f6ee4b2f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:39.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.751+0000 7f6ee4b2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:39.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.751+0000 7f6ee4b2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:39.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.752+0000 7f6ee4b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.759 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.752+0000 7f6ee4b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:39.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.752+0000 7f6ee4b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.752+0000 7f6ee4b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:39.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.752+0000 7f6ee4b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.752+0000 7f6ee4b2f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:39.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.752+0000 7f6ee4b2f800 20 zone default found 2024-03-04T12:35:39.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.752+0000 7f6ee4b2f800 4 Realm: () 2024-03-04T12:35:39.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.752+0000 7f6ee4b2f800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:39.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.752+0000 7f6ee4b2f800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:39.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.752+0000 7f6ee4b2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:39.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.752+0000 7f6ee4b2f800 20 zonegroup default 2024-03-04T12:35:39.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.752+0000 7f6ee4b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.753+0000 7f6ee4b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:39.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.753+0000 7f6ee4b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.753+0000 7f6ee4b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:39.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.753+0000 7f6ee4b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.753+0000 7f6ee4b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:39.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.753+0000 7f6ee4b2f800 20 started sync module instance, tier type = 2024-03-04T12:35:39.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.753+0000 7f6ee4b2f800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:39.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.762+0000 7f6ee4b2f800 20 add_watcher() i=0 2024-03-04T12:35:39.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.762+0000 7f6ee4b2f800 20 add_watcher() i=1 2024-03-04T12:35:39.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.762+0000 7f6ee4b2f800 20 add_watcher() i=2 2024-03-04T12:35:39.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.762+0000 7f6ee4b2f800 20 add_watcher() i=3 2024-03-04T12:35:39.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.762+0000 7f6ee4b2f800 20 add_watcher() i=4 2024-03-04T12:35:39.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.762+0000 7f6ee4b2f800 20 add_watcher() i=5 2024-03-04T12:35:39.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.762+0000 7f6ee4b2f800 20 add_watcher() i=6 2024-03-04T12:35:39.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.763+0000 7f6ee4b2f800 20 add_watcher() i=7 2024-03-04T12:35:39.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.763+0000 7f6ee4b2f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:39.771 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.765+0000 7f6d96fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:39.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.765+0000 7f6ee4b2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:39.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.765+0000 7f6ee4b2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:39.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.765+0000 7f6ee4b2f800 5 note: GC not initialized 2024-03-04T12:35:39.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.765+0000 7f6d95fdb640 20 reqs_thread_entry: start 2024-03-04T12:35:39.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.765+0000 7f6ee4b2f800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:39.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.765+0000 7f6ee4b2f800 20 Filter name: none 2024-03-04T12:35:39.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.765+0000 7f6d077fe640 20 reqs_thread_entry: start 2024-03-04T12:35:39.772 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.765+0000 7f6ee4b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.766+0000 7f6ee4b2f800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:35:39.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.766+0000 7f6ee4b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.766+0000 7f6ee4b2f800 20 rados_obj.operate() r=0 bl.length=385 2024-03-04T12:35:39.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.766+0000 7f6ee4b2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:39.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.766+0000 7f6ee4b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.773 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.767+0000 7f6ee4b2f800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:35:39.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.767+0000 7f6ee4b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.767+0000 7f6ee4b2f800 20 rados_obj.operate() r=0 bl.length=385 2024-03-04T12:35:39.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.767+0000 7f6ee4b2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:39.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.768+0000 7f6ee4b2f800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.769+0000 7f6ee4b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:39.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.769+0000 7f6d96fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:39.778 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.772+0000 7f6ee4b2f800 20 remove_watcher() i=0 2024-03-04T12:35:39.778 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.772+0000 7f6ee4b2f800 2 removed watcher, disabling cache 2024-03-04T12:35:39.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.773+0000 7f6ee4b2f800 20 remove_watcher() i=1 2024-03-04T12:35:39.780 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.774+0000 7f6ee4b2f800 20 remove_watcher() i=2 2024-03-04T12:35:39.781 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.775+0000 7f6ee4b2f800 20 remove_watcher() i=3 2024-03-04T12:35:39.782 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.776+0000 7f6ee4b2f800 20 remove_watcher() i=4 2024-03-04T12:35:39.782 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.776+0000 7f6ee4b2f800 20 remove_watcher() i=5 2024-03-04T12:35:39.783 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.777+0000 7f6ee4b2f800 20 remove_watcher() i=6 2024-03-04T12:35:39.784 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.778+0000 7f6ee4b2f800 20 remove_watcher() i=7 2024-03-04T12:35:39.794 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:39.794 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:35:39.794 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: abort-at-block-writes id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:35:39.794 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:39.795 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-03-04T12:35:39.828 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:39.828 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:39.861 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.855+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:39.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.856+0000 7ff63332b800 20 realm 2024-03-04T12:35:39.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:39.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.856+0000 7ff63332b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:39.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:39.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.864 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.857+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:39.864 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.857+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:39.864 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.858+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:39.864 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.858+0000 7ff63332b800 20 searching for the correct realm 2024-03-04T12:35:39.868 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:39.862+0000 7ff62f755640 0 -- 172.21.15.110:0/3563356137 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7ff62401e030 msgr2=0x7ff6240751c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:35:40.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.068+0000 7ff62ef54640 0 -- 172.21.15.110:0/3563356137 >> [v2:172.21.15.172:6800/824320839,v1:172.21.15.172:6801/824320839] conn(0x556afb928f90 msgr2=0x556afb92b380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:40.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:40.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:40.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:40.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:40.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:40.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:40.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:40.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:40.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 20 zone default found 2024-03-04T12:35:40.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 4 Realm: () 2024-03-04T12:35:40.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:40.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:40.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:40.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 20 zonegroup default 2024-03-04T12:35:40.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.079 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.072+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.072+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.072+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.072+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.072+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.072+0000 7ff63332b800 20 started sync module instance, tier type = 2024-03-04T12:35:40.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.072+0000 7ff63332b800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:40.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=0 2024-03-04T12:35:40.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=1 2024-03-04T12:35:40.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=2 2024-03-04T12:35:40.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=3 2024-03-04T12:35:40.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=4 2024-03-04T12:35:40.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=5 2024-03-04T12:35:40.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=6 2024-03-04T12:35:40.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.082+0000 7ff63332b800 20 add_watcher() i=7 2024-03-04T12:35:40.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.082+0000 7ff63332b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:40.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.084+0000 7ff4e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:40.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.084+0000 7ff63332b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:40.091 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.084+0000 7ff63332b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:40.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.084+0000 7ff63332b800 5 note: GC not initialized 2024-03-04T12:35:40.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.085+0000 7ff45ffff640 20 reqs_thread_entry: start 2024-03-04T12:35:40.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.085+0000 7ff63332b800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:40.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.085+0000 7ff63332b800 20 Filter name: none 2024-03-04T12:35:40.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.085+0000 7ff45dffb640 20 reqs_thread_entry: start 2024-03-04T12:35:40.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.085+0000 7ff63332b800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-04T12:35:40.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.085+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.085+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:35:40.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.085+0000 7ff63332b800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-04T12:35:40.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.085+0000 7ff63332b800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-04T12:35:40.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.085+0000 7ff63332b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 : miss 2024-03-04T12:35:40.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.085+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.086+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=385 2024-03-04T12:35:40.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.086+0000 7ff63332b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 info.flags=0x17 2024-03-04T12:35:40.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.086+0000 7ff63332b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 to cache LRU end 2024-03-04T12:35:40.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.086+0000 7ff63332b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:35:40.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.086+0000 7ff63332b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:40.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.086+0000 7ff63332b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 2024-03-04T12:35:40.097 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.091+0000 7ff63332b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 info.flags=0x17 2024-03-04T12:35:40.097 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.091+0000 7ff63332b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 to cache LRU end 2024-03-04T12:35:40.097 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.091+0000 7ff63332b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:40.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.091+0000 7ff63332b800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24, ofs0, ns] 2024-03-04T12:35:40.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.091+0000 7ff511ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824088 cookie 93917975585152 notifier 6573 bl.length()=949 2024-03-04T12:35:40.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.091+0000 7ff511ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 info.flags=0x17 2024-03-04T12:35:40.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.091+0000 7ff511ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 to cache LRU end 2024-03-04T12:35:40.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.091+0000 7ff511ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:40.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.093+0000 7ff63332b800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): orig_sources= new_sources= 2024-03-04T12:35:40.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.093+0000 7ff63332b800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): potential sources added=[] removed=[] 2024-03-04T12:35:40.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.093+0000 7ff63332b800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): orig_dests= new_dests= 2024-03-04T12:35:40.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.093+0000 7ff63332b800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): potential dests added=[] removed=[] 2024-03-04T12:35:40.099 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff63332b800 time 2024-03-04T12:35:40.094232+0000 2024-03-04T12:35:40.099 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:35:40.100 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:35:40.100 INFO:tasks.workunit.client.0.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff634780e86] 2024-03-04T12:35:40.100 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7ff634781044] 2024-03-04T12:35:40.100 INFO:tasks.workunit.client.0.smithi110.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556afa536eb1] 2024-03-04T12:35:40.100 INFO:tasks.workunit.client.0.smithi110.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x556afa54ad74] 2024-03-04T12:35:40.100 INFO:tasks.workunit.client.0.smithi110.stderr: 5: main() 2024-03-04T12:35:40.100 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7ff63363feb0] 2024-03-04T12:35:40.100 INFO:tasks.workunit.client.0.smithi110.stderr: 7: __libc_start_main() 2024-03-04T12:35:40.101 INFO:tasks.workunit.client.0.smithi110.stderr: 8: _start() 2024-03-04T12:35:40.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.094+0000 7ff63332b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff63332b800 time 2024-03-04T12:35:40.094232+0000 2024-03-04T12:35:40.101 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:35:40.101 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.101 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:35:40.101 INFO:tasks.workunit.client.0.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff634780e86] 2024-03-04T12:35:40.101 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7ff634781044] 2024-03-04T12:35:40.101 INFO:tasks.workunit.client.0.smithi110.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556afa536eb1] 2024-03-04T12:35:40.101 INFO:tasks.workunit.client.0.smithi110.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x556afa54ad74] 2024-03-04T12:35:40.101 INFO:tasks.workunit.client.0.smithi110.stderr: 5: main() 2024-03-04T12:35:40.101 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7ff63363feb0] 2024-03-04T12:35:40.101 INFO:tasks.workunit.client.0.smithi110.stderr: 7: __libc_start_main() 2024-03-04T12:35:40.101 INFO:tasks.workunit.client.0.smithi110.stderr: 8: _start() 2024-03-04T12:35:40.101 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.102 INFO:tasks.workunit.client.0.smithi110.stderr:*** Caught signal (Aborted) ** 2024-03-04T12:35:40.102 INFO:tasks.workunit.client.0.smithi110.stderr: in thread 7ff63332b800 thread_name:radosgw-admin 2024-03-04T12:35:40.116 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:35:40.117 INFO:tasks.workunit.client.0.smithi110.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7ff633654db0] 2024-03-04T12:35:40.117 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7ff6336a154c] 2024-03-04T12:35:40.117 INFO:tasks.workunit.client.0.smithi110.stderr: 3: raise() 2024-03-04T12:35:40.117 INFO:tasks.workunit.client.0.smithi110.stderr: 4: abort() 2024-03-04T12:35:40.117 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff634780ee0] 2024-03-04T12:35:40.117 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7ff634781044] 2024-03-04T12:35:40.117 INFO:tasks.workunit.client.0.smithi110.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556afa536eb1] 2024-03-04T12:35:40.117 INFO:tasks.workunit.client.0.smithi110.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x556afa54ad74] 2024-03-04T12:35:40.117 INFO:tasks.workunit.client.0.smithi110.stderr: 9: main() 2024-03-04T12:35:40.117 INFO:tasks.workunit.client.0.smithi110.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7ff63363feb0] 2024-03-04T12:35:40.117 INFO:tasks.workunit.client.0.smithi110.stderr: 11: __libc_start_main() 2024-03-04T12:35:40.117 INFO:tasks.workunit.client.0.smithi110.stderr: 12: _start() 2024-03-04T12:35:40.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.094+0000 7ff63332b800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:35:40.117 INFO:tasks.workunit.client.0.smithi110.stderr: in thread 7ff63332b800 thread_name:radosgw-admin 2024-03-04T12:35:40.118 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.118 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:35:40.118 INFO:tasks.workunit.client.0.smithi110.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7ff633654db0] 2024-03-04T12:35:40.118 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7ff6336a154c] 2024-03-04T12:35:40.118 INFO:tasks.workunit.client.0.smithi110.stderr: 3: raise() 2024-03-04T12:35:40.118 INFO:tasks.workunit.client.0.smithi110.stderr: 4: abort() 2024-03-04T12:35:40.118 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff634780ee0] 2024-03-04T12:35:40.118 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7ff634781044] 2024-03-04T12:35:40.118 INFO:tasks.workunit.client.0.smithi110.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556afa536eb1] 2024-03-04T12:35:40.118 INFO:tasks.workunit.client.0.smithi110.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x556afa54ad74] 2024-03-04T12:35:40.118 INFO:tasks.workunit.client.0.smithi110.stderr: 9: main() 2024-03-04T12:35:40.118 INFO:tasks.workunit.client.0.smithi110.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7ff63363feb0] 2024-03-04T12:35:40.118 INFO:tasks.workunit.client.0.smithi110.stderr: 11: __libc_start_main() 2024-03-04T12:35:40.118 INFO:tasks.workunit.client.0.smithi110.stderr: 12: _start() 2024-03-04T12:35:40.119 INFO:tasks.workunit.client.0.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:35:40.119 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.119 INFO:tasks.workunit.client.0.smithi110.stderr:--- begin dump of recent events --- 2024-03-04T12:35:40.119 INFO:tasks.workunit.client.0.smithi110.stderr: -499> 2024-03-04T12:35:39.839+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.119 INFO:tasks.workunit.client.0.smithi110.stderr: -498> 2024-03-04T12:35:39.839+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.119 INFO:tasks.workunit.client.0.smithi110.stderr: -497> 2024-03-04T12:35:39.839+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.119 INFO:tasks.workunit.client.0.smithi110.stderr: -496> 2024-03-04T12:35:39.839+0000 7ff62f755640 10 monclient(hunting): handle_auth_done global_id 6561 payload 274 2024-03-04T12:35:40.119 INFO:tasks.workunit.client.0.smithi110.stderr: -495> 2024-03-04T12:35:39.839+0000 7ff62f755640 10 monclient: _finish_hunting 0 2024-03-04T12:35:40.119 INFO:tasks.workunit.client.0.smithi110.stderr: -494> 2024-03-04T12:35:39.839+0000 7ff62f755640 1 monclient: found mon.noname-a 2024-03-04T12:35:40.119 INFO:tasks.workunit.client.0.smithi110.stderr: -493> 2024-03-04T12:35:39.839+0000 7ff62f755640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.119 INFO:tasks.workunit.client.0.smithi110.stderr: -492> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.119 INFO:tasks.workunit.client.0.smithi110.stderr: -491> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:35:40.119 INFO:tasks.workunit.client.0.smithi110.stderr: -490> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: dump: 2024-03-04T12:35:40.119 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.119 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.120 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.120 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.120 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.120 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.120 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.120 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.120 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.120 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.120 INFO:tasks.workunit.client.0.smithi110.stderr: -489> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: _finish_auth 0 2024-03-04T12:35:40.120 INFO:tasks.workunit.client.0.smithi110.stderr: -488> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: _check_auth_tickets 2024-03-04T12:35:40.120 INFO:tasks.workunit.client.0.smithi110.stderr: -487> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:40.120 INFO:tasks.workunit.client.0.smithi110.stderr: -486> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.120 INFO:tasks.workunit.client.0.smithi110.stderr: -485> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:35:40.120 INFO:tasks.workunit.client.0.smithi110.stderr: -484> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: dump: 2024-03-04T12:35:40.121 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.121 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.121 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.121 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.121 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.121 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.121 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.121 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.121 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.121 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.121 INFO:tasks.workunit.client.0.smithi110.stderr: -483> 2024-03-04T12:35:39.839+0000 7ff63332b800 5 monclient: authenticate success, global_id 6561 2024-03-04T12:35:40.121 INFO:tasks.workunit.client.0.smithi110.stderr: -482> 2024-03-04T12:35:39.839+0000 7ff63332b800 10 monclient: get_monmap_and_config success 2024-03-04T12:35:40.121 INFO:tasks.workunit.client.0.smithi110.stderr: -481> 2024-03-04T12:35:39.839+0000 7ff63332b800 4 set_mon_vals no callback set 2024-03-04T12:35:40.121 INFO:tasks.workunit.client.0.smithi110.stderr: -480> 2024-03-04T12:35:39.840+0000 7ff63332b800 10 monclient: shutdown 2024-03-04T12:35:40.121 INFO:tasks.workunit.client.0.smithi110.stderr: -479> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 asok(0x556afb61b0c0) unregister_commands rotate-key 2024-03-04T12:35:40.122 INFO:tasks.workunit.client.0.smithi110.stderr: -478> 2024-03-04T12:35:39.840+0000 7ff63332b800 10 monclient: build_initial_monmap 2024-03-04T12:35:40.122 INFO:tasks.workunit.client.0.smithi110.stderr: -477> 2024-03-04T12:35:39.840+0000 7ff63332b800 1 build_initial for_mkfs: 0 2024-03-04T12:35:40.122 INFO:tasks.workunit.client.0.smithi110.stderr: -476> 2024-03-04T12:35:39.840+0000 7ff63332b800 10 monclient: monmap: 2024-03-04T12:35:40.122 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:35:40.122 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:35:40.122 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:35:40.122 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:35:40.122 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:35:40.122 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.122 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:35:40.122 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:35:40.122 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:35:40.122 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.122 INFO:tasks.workunit.client.0.smithi110.stderr: -475> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding auth protocol: cephx 2024-03-04T12:35:40.123 INFO:tasks.workunit.client.0.smithi110.stderr: -474> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding auth protocol: cephx 2024-03-04T12:35:40.123 INFO:tasks.workunit.client.0.smithi110.stderr: -473> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding auth protocol: cephx 2024-03-04T12:35:40.123 INFO:tasks.workunit.client.0.smithi110.stderr: -472> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: secure 2024-03-04T12:35:40.123 INFO:tasks.workunit.client.0.smithi110.stderr: -471> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: crc 2024-03-04T12:35:40.123 INFO:tasks.workunit.client.0.smithi110.stderr: -470> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: secure 2024-03-04T12:35:40.123 INFO:tasks.workunit.client.0.smithi110.stderr: -469> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: crc 2024-03-04T12:35:40.123 INFO:tasks.workunit.client.0.smithi110.stderr: -468> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: secure 2024-03-04T12:35:40.123 INFO:tasks.workunit.client.0.smithi110.stderr: -467> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: crc 2024-03-04T12:35:40.123 INFO:tasks.workunit.client.0.smithi110.stderr: -466> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: crc 2024-03-04T12:35:40.123 INFO:tasks.workunit.client.0.smithi110.stderr: -465> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: secure 2024-03-04T12:35:40.123 INFO:tasks.workunit.client.0.smithi110.stderr: -464> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: crc 2024-03-04T12:35:40.123 INFO:tasks.workunit.client.0.smithi110.stderr: -463> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: secure 2024-03-04T12:35:40.123 INFO:tasks.workunit.client.0.smithi110.stderr: -462> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: crc 2024-03-04T12:35:40.123 INFO:tasks.workunit.client.0.smithi110.stderr: -461> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: secure 2024-03-04T12:35:40.124 INFO:tasks.workunit.client.0.smithi110.stderr: -460> 2024-03-04T12:35:39.840+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.124 INFO:tasks.workunit.client.0.smithi110.stderr: -459> 2024-03-04T12:35:39.840+0000 7ff63332b800 1 librados: starting msgr at 2024-03-04T12:35:40.124 INFO:tasks.workunit.client.0.smithi110.stderr: -458> 2024-03-04T12:35:39.840+0000 7ff63332b800 1 librados: starting objecter 2024-03-04T12:35:40.124 INFO:tasks.workunit.client.0.smithi110.stderr: -457> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command objecter_requests hook 0x556afb83daa0 2024-03-04T12:35:40.124 INFO:tasks.workunit.client.0.smithi110.stderr: -456> 2024-03-04T12:35:39.840+0000 7ff63332b800 1 librados: setting wanted keys 2024-03-04T12:35:40.124 INFO:tasks.workunit.client.0.smithi110.stderr: -455> 2024-03-04T12:35:39.840+0000 7ff63332b800 1 librados: calling monclient init 2024-03-04T12:35:40.124 INFO:tasks.workunit.client.0.smithi110.stderr: -454> 2024-03-04T12:35:39.840+0000 7ff63332b800 10 monclient: init 2024-03-04T12:35:40.124 INFO:tasks.workunit.client.0.smithi110.stderr: -453> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding auth protocol: cephx 2024-03-04T12:35:40.124 INFO:tasks.workunit.client.0.smithi110.stderr: -452> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding auth protocol: cephx 2024-03-04T12:35:40.124 INFO:tasks.workunit.client.0.smithi110.stderr: -451> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding auth protocol: cephx 2024-03-04T12:35:40.124 INFO:tasks.workunit.client.0.smithi110.stderr: -450> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: secure 2024-03-04T12:35:40.124 INFO:tasks.workunit.client.0.smithi110.stderr: -449> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: crc 2024-03-04T12:35:40.124 INFO:tasks.workunit.client.0.smithi110.stderr: -448> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: secure 2024-03-04T12:35:40.124 INFO:tasks.workunit.client.0.smithi110.stderr: -447> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: crc 2024-03-04T12:35:40.125 INFO:tasks.workunit.client.0.smithi110.stderr: -446> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: secure 2024-03-04T12:35:40.125 INFO:tasks.workunit.client.0.smithi110.stderr: -445> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: crc 2024-03-04T12:35:40.125 INFO:tasks.workunit.client.0.smithi110.stderr: -444> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: crc 2024-03-04T12:35:40.125 INFO:tasks.workunit.client.0.smithi110.stderr: -443> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: secure 2024-03-04T12:35:40.125 INFO:tasks.workunit.client.0.smithi110.stderr: -442> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: crc 2024-03-04T12:35:40.125 INFO:tasks.workunit.client.0.smithi110.stderr: -441> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: secure 2024-03-04T12:35:40.125 INFO:tasks.workunit.client.0.smithi110.stderr: -440> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: crc 2024-03-04T12:35:40.125 INFO:tasks.workunit.client.0.smithi110.stderr: -439> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: secure 2024-03-04T12:35:40.125 INFO:tasks.workunit.client.0.smithi110.stderr: -438> 2024-03-04T12:35:39.841+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.125 INFO:tasks.workunit.client.0.smithi110.stderr: -437> 2024-03-04T12:35:39.841+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.125 INFO:tasks.workunit.client.0.smithi110.stderr: -436> 2024-03-04T12:35:39.841+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command rotate-key hook 0x556afb839328 2024-03-04T12:35:40.125 INFO:tasks.workunit.client.0.smithi110.stderr: -435> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient: _reopen_session rank -1 2024-03-04T12:35:40.125 INFO:tasks.workunit.client.0.smithi110.stderr: -434> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:35:40.125 INFO:tasks.workunit.client.0.smithi110.stderr: -433> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-b con 0x556afb6e5ce0 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:35:40.126 INFO:tasks.workunit.client.0.smithi110.stderr: -432> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-c con 0x556afb6ef130 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:35:40.126 INFO:tasks.workunit.client.0.smithi110.stderr: -431> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-a con 0x556afb77b340 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:35:40.126 INFO:tasks.workunit.client.0.smithi110.stderr: -430> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.126 INFO:tasks.workunit.client.0.smithi110.stderr: -429> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.126 INFO:tasks.workunit.client.0.smithi110.stderr: -428> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.126 INFO:tasks.workunit.client.0.smithi110.stderr: -427> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient(hunting): _renew_subs 2024-03-04T12:35:40.126 INFO:tasks.workunit.client.0.smithi110.stderr: -426> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient(hunting): authenticate will time out at 1721.200458s 2024-03-04T12:35:40.126 INFO:tasks.workunit.client.0.smithi110.stderr: -425> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient(hunting): get_auth_request con 0x556afb77b340 auth_method 0 2024-03-04T12:35:40.126 INFO:tasks.workunit.client.0.smithi110.stderr: -424> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.126 INFO:tasks.workunit.client.0.smithi110.stderr: -423> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.126 INFO:tasks.workunit.client.0.smithi110.stderr: -422> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.126 INFO:tasks.workunit.client.0.smithi110.stderr: -421> 2024-03-04T12:35:39.841+0000 7ff62e753640 10 monclient(hunting): get_auth_request con 0x556afb6ef130 auth_method 0 2024-03-04T12:35:40.126 INFO:tasks.workunit.client.0.smithi110.stderr: -420> 2024-03-04T12:35:39.841+0000 7ff62e753640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.126 INFO:tasks.workunit.client.0.smithi110.stderr: -419> 2024-03-04T12:35:39.841+0000 7ff62e753640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.127 INFO:tasks.workunit.client.0.smithi110.stderr: -418> 2024-03-04T12:35:39.841+0000 7ff62e753640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.127 INFO:tasks.workunit.client.0.smithi110.stderr: -417> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.127 INFO:tasks.workunit.client.0.smithi110.stderr: -416> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.127 INFO:tasks.workunit.client.0.smithi110.stderr: -415> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.127 INFO:tasks.workunit.client.0.smithi110.stderr: -414> 2024-03-04T12:35:39.841+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.127 INFO:tasks.workunit.client.0.smithi110.stderr: -413> 2024-03-04T12:35:39.841+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.127 INFO:tasks.workunit.client.0.smithi110.stderr: -412> 2024-03-04T12:35:39.841+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.127 INFO:tasks.workunit.client.0.smithi110.stderr: -411> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient(hunting): handle_auth_done global_id 6564 payload 824 2024-03-04T12:35:40.127 INFO:tasks.workunit.client.0.smithi110.stderr: -410> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient: _finish_hunting 0 2024-03-04T12:35:40.127 INFO:tasks.workunit.client.0.smithi110.stderr: -409> 2024-03-04T12:35:39.841+0000 7ff62f755640 1 monclient: found mon.noname-a 2024-03-04T12:35:40.127 INFO:tasks.workunit.client.0.smithi110.stderr: -408> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.127 INFO:tasks.workunit.client.0.smithi110.stderr: -407> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.127 INFO:tasks.workunit.client.0.smithi110.stderr: -406> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:35:40.127 INFO:tasks.workunit.client.0.smithi110.stderr: -405> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: dump: 2024-03-04T12:35:40.127 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.128 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.128 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.128 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.128 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.128 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.128 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.128 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.128 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.128 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.128 INFO:tasks.workunit.client.0.smithi110.stderr: -404> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: _finish_auth 0 2024-03-04T12:35:40.128 INFO:tasks.workunit.client.0.smithi110.stderr: -403> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: _check_auth_tickets 2024-03-04T12:35:40.128 INFO:tasks.workunit.client.0.smithi110.stderr: -402> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:40.128 INFO:tasks.workunit.client.0.smithi110.stderr: -401> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.128 INFO:tasks.workunit.client.0.smithi110.stderr: -400> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:35:40.129 INFO:tasks.workunit.client.0.smithi110.stderr: -399> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: dump: 2024-03-04T12:35:40.129 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.129 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.129 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.129 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.129 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.129 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.129 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.129 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.129 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.129 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.129 INFO:tasks.workunit.client.0.smithi110.stderr: -398> 2024-03-04T12:35:39.842+0000 7ff63332b800 5 monclient: authenticate success, global_id 6564 2024-03-04T12:35:40.129 INFO:tasks.workunit.client.0.smithi110.stderr: -397> 2024-03-04T12:35:39.842+0000 7ff63332b800 10 monclient: _renew_subs 2024-03-04T12:35:40.129 INFO:tasks.workunit.client.0.smithi110.stderr: -396> 2024-03-04T12:35:39.842+0000 7ff51ce09640 4 set_mon_vals no callback set 2024-03-04T12:35:40.129 INFO:tasks.workunit.client.0.smithi110.stderr: -395> 2024-03-04T12:35:39.842+0000 7ff63332b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.130 INFO:tasks.workunit.client.0.smithi110.stderr: -394> 2024-03-04T12:35:39.842+0000 7ff63332b800 10 monclient: _renew_subs 2024-03-04T12:35:40.130 INFO:tasks.workunit.client.0.smithi110.stderr: -393> 2024-03-04T12:35:39.842+0000 7ff63332b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.130 INFO:tasks.workunit.client.0.smithi110.stderr: -392> 2024-03-04T12:35:39.842+0000 7ff63332b800 1 librados: init done 2024-03-04T12:35:40.130 INFO:tasks.workunit.client.0.smithi110.stderr: -391> 2024-03-04T12:35:39.843+0000 7ff51b606640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:35:40.130 INFO:tasks.workunit.client.0.smithi110.stderr: -390> 2024-03-04T12:35:39.843+0000 7ff51b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:40.130 INFO:tasks.workunit.client.0.smithi110.stderr: -389> 2024-03-04T12:35:39.843+0000 7ff51b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:40.130 INFO:tasks.workunit.client.0.smithi110.stderr: -388> 2024-03-04T12:35:39.844+0000 7ff62ef54640 10 monclient: get_auth_request con 0x7ff514069eb0 auth_method 0 2024-03-04T12:35:40.130 INFO:tasks.workunit.client.0.smithi110.stderr: -387> 2024-03-04T12:35:39.844+0000 7ff62e753640 10 monclient: get_auth_request con 0x556afb842b30 auth_method 0 2024-03-04T12:35:40.130 INFO:tasks.workunit.client.0.smithi110.stderr: -386> 2024-03-04T12:35:39.844+0000 7ff62ef54640 10 monclient: get_auth_request con 0x556afb884950 auth_method 0 2024-03-04T12:35:40.130 INFO:tasks.workunit.client.0.smithi110.stderr: -385> 2024-03-04T12:35:39.846+0000 7ff62e753640 10 monclient: get_auth_request con 0x556afb8899e0 auth_method 0 2024-03-04T12:35:40.130 INFO:tasks.workunit.client.0.smithi110.stderr: -384> 2024-03-04T12:35:39.846+0000 7ff63332b800 10 monclient: build_initial_monmap 2024-03-04T12:35:40.130 INFO:tasks.workunit.client.0.smithi110.stderr: -383> 2024-03-04T12:35:39.846+0000 7ff63332b800 1 build_initial for_mkfs: 0 2024-03-04T12:35:40.130 INFO:tasks.workunit.client.0.smithi110.stderr: -382> 2024-03-04T12:35:39.846+0000 7ff63332b800 10 monclient: monmap: 2024-03-04T12:35:40.130 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:35:40.131 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:35:40.131 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:35:40.131 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:35:40.131 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:35:40.131 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.131 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:35:40.131 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:35:40.131 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:35:40.131 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.131 INFO:tasks.workunit.client.0.smithi110.stderr: -381> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding auth protocol: cephx 2024-03-04T12:35:40.131 INFO:tasks.workunit.client.0.smithi110.stderr: -380> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding auth protocol: cephx 2024-03-04T12:35:40.131 INFO:tasks.workunit.client.0.smithi110.stderr: -379> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding auth protocol: cephx 2024-03-04T12:35:40.131 INFO:tasks.workunit.client.0.smithi110.stderr: -378> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: secure 2024-03-04T12:35:40.131 INFO:tasks.workunit.client.0.smithi110.stderr: -377> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: crc 2024-03-04T12:35:40.131 INFO:tasks.workunit.client.0.smithi110.stderr: -376> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: secure 2024-03-04T12:35:40.132 INFO:tasks.workunit.client.0.smithi110.stderr: -375> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: crc 2024-03-04T12:35:40.132 INFO:tasks.workunit.client.0.smithi110.stderr: -374> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: secure 2024-03-04T12:35:40.132 INFO:tasks.workunit.client.0.smithi110.stderr: -373> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: crc 2024-03-04T12:35:40.132 INFO:tasks.workunit.client.0.smithi110.stderr: -372> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: crc 2024-03-04T12:35:40.132 INFO:tasks.workunit.client.0.smithi110.stderr: -371> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: secure 2024-03-04T12:35:40.132 INFO:tasks.workunit.client.0.smithi110.stderr: -370> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: crc 2024-03-04T12:35:40.132 INFO:tasks.workunit.client.0.smithi110.stderr: -369> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: secure 2024-03-04T12:35:40.132 INFO:tasks.workunit.client.0.smithi110.stderr: -368> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: crc 2024-03-04T12:35:40.132 INFO:tasks.workunit.client.0.smithi110.stderr: -367> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: secure 2024-03-04T12:35:40.132 INFO:tasks.workunit.client.0.smithi110.stderr: -366> 2024-03-04T12:35:39.847+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.132 INFO:tasks.workunit.client.0.smithi110.stderr: -365> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command objecter_requests cmddesc objecter_requests hook 0x556afb891370 EEXIST 2024-03-04T12:35:40.132 INFO:tasks.workunit.client.0.smithi110.stderr: -364> 2024-03-04T12:35:39.847+0000 7ff63332b800 10 monclient: init 2024-03-04T12:35:40.132 INFO:tasks.workunit.client.0.smithi110.stderr: -363> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding auth protocol: cephx 2024-03-04T12:35:40.132 INFO:tasks.workunit.client.0.smithi110.stderr: -362> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding auth protocol: cephx 2024-03-04T12:35:40.133 INFO:tasks.workunit.client.0.smithi110.stderr: -361> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding auth protocol: cephx 2024-03-04T12:35:40.133 INFO:tasks.workunit.client.0.smithi110.stderr: -360> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: secure 2024-03-04T12:35:40.133 INFO:tasks.workunit.client.0.smithi110.stderr: -359> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: crc 2024-03-04T12:35:40.133 INFO:tasks.workunit.client.0.smithi110.stderr: -358> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: secure 2024-03-04T12:35:40.133 INFO:tasks.workunit.client.0.smithi110.stderr: -357> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: crc 2024-03-04T12:35:40.133 INFO:tasks.workunit.client.0.smithi110.stderr: -356> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: secure 2024-03-04T12:35:40.133 INFO:tasks.workunit.client.0.smithi110.stderr: -355> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: crc 2024-03-04T12:35:40.133 INFO:tasks.workunit.client.0.smithi110.stderr: -354> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: crc 2024-03-04T12:35:40.133 INFO:tasks.workunit.client.0.smithi110.stderr: -353> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: secure 2024-03-04T12:35:40.133 INFO:tasks.workunit.client.0.smithi110.stderr: -352> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: crc 2024-03-04T12:35:40.133 INFO:tasks.workunit.client.0.smithi110.stderr: -351> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: secure 2024-03-04T12:35:40.133 INFO:tasks.workunit.client.0.smithi110.stderr: -350> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: crc 2024-03-04T12:35:40.133 INFO:tasks.workunit.client.0.smithi110.stderr: -349> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: secure 2024-03-04T12:35:40.133 INFO:tasks.workunit.client.0.smithi110.stderr: -348> 2024-03-04T12:35:39.847+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.133 INFO:tasks.workunit.client.0.smithi110.stderr: -347> 2024-03-04T12:35:39.847+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.134 INFO:tasks.workunit.client.0.smithi110.stderr: -346> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command rotate-key cmddesc rotate-key hook 0x556afb88c8a0 EEXIST 2024-03-04T12:35:40.134 INFO:tasks.workunit.client.0.smithi110.stderr: -345> 2024-03-04T12:35:39.847+0000 7ff63332b800 10 monclient: _reopen_session rank -1 2024-03-04T12:35:40.134 INFO:tasks.workunit.client.0.smithi110.stderr: -344> 2024-03-04T12:35:39.847+0000 7ff63332b800 10 monclient: _add_conns ranks=[2,0,1] 2024-03-04T12:35:40.134 INFO:tasks.workunit.client.0.smithi110.stderr: -343> 2024-03-04T12:35:39.847+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-c con 0x556afb8b7ba0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:35:40.134 INFO:tasks.workunit.client.0.smithi110.stderr: -342> 2024-03-04T12:35:39.847+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-a con 0x556afb8b7f80 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:35:40.134 INFO:tasks.workunit.client.0.smithi110.stderr: -341> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-b con 0x556afb8ca930 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:35:40.134 INFO:tasks.workunit.client.0.smithi110.stderr: -340> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.134 INFO:tasks.workunit.client.0.smithi110.stderr: -339> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.134 INFO:tasks.workunit.client.0.smithi110.stderr: -338> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.134 INFO:tasks.workunit.client.0.smithi110.stderr: -337> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient(hunting): _renew_subs 2024-03-04T12:35:40.134 INFO:tasks.workunit.client.0.smithi110.stderr: -336> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient(hunting): authenticate will time out at 1721.207016s 2024-03-04T12:35:40.134 INFO:tasks.workunit.client.0.smithi110.stderr: -335> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient(hunting): get_auth_request con 0x556afb8b7f80 auth_method 0 2024-03-04T12:35:40.134 INFO:tasks.workunit.client.0.smithi110.stderr: -334> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.134 INFO:tasks.workunit.client.0.smithi110.stderr: -333> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.134 INFO:tasks.workunit.client.0.smithi110.stderr: -332> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.135 INFO:tasks.workunit.client.0.smithi110.stderr: -331> 2024-03-04T12:35:39.848+0000 7ff62ef54640 10 monclient(hunting): get_auth_request con 0x556afb8b7ba0 auth_method 0 2024-03-04T12:35:40.135 INFO:tasks.workunit.client.0.smithi110.stderr: -330> 2024-03-04T12:35:39.848+0000 7ff62ef54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.135 INFO:tasks.workunit.client.0.smithi110.stderr: -329> 2024-03-04T12:35:39.848+0000 7ff62ef54640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.135 INFO:tasks.workunit.client.0.smithi110.stderr: -328> 2024-03-04T12:35:39.848+0000 7ff62ef54640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.135 INFO:tasks.workunit.client.0.smithi110.stderr: -327> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.135 INFO:tasks.workunit.client.0.smithi110.stderr: -326> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.135 INFO:tasks.workunit.client.0.smithi110.stderr: -325> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.135 INFO:tasks.workunit.client.0.smithi110.stderr: -324> 2024-03-04T12:35:39.848+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.135 INFO:tasks.workunit.client.0.smithi110.stderr: -323> 2024-03-04T12:35:39.848+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.135 INFO:tasks.workunit.client.0.smithi110.stderr: -322> 2024-03-04T12:35:39.848+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.135 INFO:tasks.workunit.client.0.smithi110.stderr: -321> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient(hunting): handle_auth_done global_id 6567 payload 824 2024-03-04T12:35:40.135 INFO:tasks.workunit.client.0.smithi110.stderr: -320> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient: _finish_hunting 0 2024-03-04T12:35:40.135 INFO:tasks.workunit.client.0.smithi110.stderr: -319> 2024-03-04T12:35:39.848+0000 7ff62e753640 1 monclient: found mon.noname-a 2024-03-04T12:35:40.135 INFO:tasks.workunit.client.0.smithi110.stderr: -318> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.135 INFO:tasks.workunit.client.0.smithi110.stderr: -317> 2024-03-04T12:35:39.848+0000 7ff62f755640 10 monclient: get_auth_request con 0x556afb8ca930 auth_method 0 2024-03-04T12:35:40.136 INFO:tasks.workunit.client.0.smithi110.stderr: -316> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.136 INFO:tasks.workunit.client.0.smithi110.stderr: -315> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:35:40.136 INFO:tasks.workunit.client.0.smithi110.stderr: -314> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: dump: 2024-03-04T12:35:40.136 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.136 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.136 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.136 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.136 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.136 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.136 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.136 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.136 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.136 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.137 INFO:tasks.workunit.client.0.smithi110.stderr: -313> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: _finish_auth 0 2024-03-04T12:35:40.137 INFO:tasks.workunit.client.0.smithi110.stderr: -312> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: _check_auth_tickets 2024-03-04T12:35:40.137 INFO:tasks.workunit.client.0.smithi110.stderr: -311> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:40.137 INFO:tasks.workunit.client.0.smithi110.stderr: -310> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.137 INFO:tasks.workunit.client.0.smithi110.stderr: -309> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:35:40.137 INFO:tasks.workunit.client.0.smithi110.stderr: -308> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: dump: 2024-03-04T12:35:40.137 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.137 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.137 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.137 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.137 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.137 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.137 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.137 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.137 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.138 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.138 INFO:tasks.workunit.client.0.smithi110.stderr: -307> 2024-03-04T12:35:39.848+0000 7ff63332b800 5 monclient: authenticate success, global_id 6567 2024-03-04T12:35:40.138 INFO:tasks.workunit.client.0.smithi110.stderr: -306> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient: _renew_subs 2024-03-04T12:35:40.138 INFO:tasks.workunit.client.0.smithi110.stderr: -305> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.138 INFO:tasks.workunit.client.0.smithi110.stderr: -304> 2024-03-04T12:35:39.848+0000 7ff62ff56640 4 set_mon_vals no callback set 2024-03-04T12:35:40.138 INFO:tasks.workunit.client.0.smithi110.stderr: -303> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient: _renew_subs 2024-03-04T12:35:40.138 INFO:tasks.workunit.client.0.smithi110.stderr: -302> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.138 INFO:tasks.workunit.client.0.smithi110.stderr: -301> 2024-03-04T12:35:39.850+0000 7ff518e01640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:35:40.138 INFO:tasks.workunit.client.0.smithi110.stderr: -300> 2024-03-04T12:35:39.850+0000 7ff518e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:40.138 INFO:tasks.workunit.client.0.smithi110.stderr: -299> 2024-03-04T12:35:39.850+0000 7ff518e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:40.138 INFO:tasks.workunit.client.0.smithi110.stderr: -298> 2024-03-04T12:35:39.850+0000 7ff63332b800 10 monclient: get_monmap_and_config 2024-03-04T12:35:40.138 INFO:tasks.workunit.client.0.smithi110.stderr: -297> 2024-03-04T12:35:39.850+0000 7ff63332b800 10 monclient: build_initial_monmap 2024-03-04T12:35:40.138 INFO:tasks.workunit.client.0.smithi110.stderr: -296> 2024-03-04T12:35:39.850+0000 7ff63332b800 1 build_initial for_mkfs: 0 2024-03-04T12:35:40.138 INFO:tasks.workunit.client.0.smithi110.stderr: -295> 2024-03-04T12:35:39.850+0000 7ff63332b800 10 monclient: monmap: 2024-03-04T12:35:40.138 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:35:40.139 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:35:40.139 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:35:40.139 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:35:40.139 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:35:40.139 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.139 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:35:40.139 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:35:40.139 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:35:40.139 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.139 INFO:tasks.workunit.client.0.smithi110.stderr: -294> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding auth protocol: cephx 2024-03-04T12:35:40.139 INFO:tasks.workunit.client.0.smithi110.stderr: -293> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding auth protocol: cephx 2024-03-04T12:35:40.139 INFO:tasks.workunit.client.0.smithi110.stderr: -292> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding auth protocol: cephx 2024-03-04T12:35:40.139 INFO:tasks.workunit.client.0.smithi110.stderr: -291> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: secure 2024-03-04T12:35:40.139 INFO:tasks.workunit.client.0.smithi110.stderr: -290> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: crc 2024-03-04T12:35:40.140 INFO:tasks.workunit.client.0.smithi110.stderr: -289> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: secure 2024-03-04T12:35:40.140 INFO:tasks.workunit.client.0.smithi110.stderr: -288> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: crc 2024-03-04T12:35:40.140 INFO:tasks.workunit.client.0.smithi110.stderr: -287> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: secure 2024-03-04T12:35:40.140 INFO:tasks.workunit.client.0.smithi110.stderr: -286> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: crc 2024-03-04T12:35:40.140 INFO:tasks.workunit.client.0.smithi110.stderr: -285> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: crc 2024-03-04T12:35:40.140 INFO:tasks.workunit.client.0.smithi110.stderr: -284> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: secure 2024-03-04T12:35:40.140 INFO:tasks.workunit.client.0.smithi110.stderr: -283> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: crc 2024-03-04T12:35:40.140 INFO:tasks.workunit.client.0.smithi110.stderr: -282> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: secure 2024-03-04T12:35:40.140 INFO:tasks.workunit.client.0.smithi110.stderr: -281> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: crc 2024-03-04T12:35:40.140 INFO:tasks.workunit.client.0.smithi110.stderr: -280> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: secure 2024-03-04T12:35:40.140 INFO:tasks.workunit.client.0.smithi110.stderr: -279> 2024-03-04T12:35:39.850+0000 7ff62ef54640 10 monclient: get_auth_request con 0x7ff508069df0 auth_method 0 2024-03-04T12:35:40.140 INFO:tasks.workunit.client.0.smithi110.stderr: -278> 2024-03-04T12:35:39.850+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.140 INFO:tasks.workunit.client.0.smithi110.stderr: -277> 2024-03-04T12:35:39.850+0000 7ff63332b800 10 monclient: init 2024-03-04T12:35:40.140 INFO:tasks.workunit.client.0.smithi110.stderr: -276> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding auth protocol: cephx 2024-03-04T12:35:40.141 INFO:tasks.workunit.client.0.smithi110.stderr: -275> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding auth protocol: cephx 2024-03-04T12:35:40.141 INFO:tasks.workunit.client.0.smithi110.stderr: -274> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding auth protocol: cephx 2024-03-04T12:35:40.141 INFO:tasks.workunit.client.0.smithi110.stderr: -273> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: secure 2024-03-04T12:35:40.141 INFO:tasks.workunit.client.0.smithi110.stderr: -272> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: crc 2024-03-04T12:35:40.141 INFO:tasks.workunit.client.0.smithi110.stderr: -271> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: secure 2024-03-04T12:35:40.141 INFO:tasks.workunit.client.0.smithi110.stderr: -270> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: crc 2024-03-04T12:35:40.141 INFO:tasks.workunit.client.0.smithi110.stderr: -269> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: secure 2024-03-04T12:35:40.141 INFO:tasks.workunit.client.0.smithi110.stderr: -268> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: crc 2024-03-04T12:35:40.141 INFO:tasks.workunit.client.0.smithi110.stderr: -267> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: crc 2024-03-04T12:35:40.141 INFO:tasks.workunit.client.0.smithi110.stderr: -266> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: secure 2024-03-04T12:35:40.141 INFO:tasks.workunit.client.0.smithi110.stderr: -265> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: crc 2024-03-04T12:35:40.141 INFO:tasks.workunit.client.0.smithi110.stderr: -264> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: secure 2024-03-04T12:35:40.141 INFO:tasks.workunit.client.0.smithi110.stderr: -263> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: crc 2024-03-04T12:35:40.141 INFO:tasks.workunit.client.0.smithi110.stderr: -262> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: secure 2024-03-04T12:35:40.142 INFO:tasks.workunit.client.0.smithi110.stderr: -261> 2024-03-04T12:35:39.851+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.142 INFO:tasks.workunit.client.0.smithi110.stderr: -260> 2024-03-04T12:35:39.851+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.142 INFO:tasks.workunit.client.0.smithi110.stderr: -259> 2024-03-04T12:35:39.851+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command rotate-key cmddesc rotate-key hook 0x7ffd944f3e28 EEXIST 2024-03-04T12:35:40.142 INFO:tasks.workunit.client.0.smithi110.stderr: -258> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient: _reopen_session rank -1 2024-03-04T12:35:40.142 INFO:tasks.workunit.client.0.smithi110.stderr: -257> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-04T12:35:40.142 INFO:tasks.workunit.client.0.smithi110.stderr: -256> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-b con 0x556afb90a1a0 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:35:40.142 INFO:tasks.workunit.client.0.smithi110.stderr: -255> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-a con 0x556afb8fbf60 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:35:40.142 INFO:tasks.workunit.client.0.smithi110.stderr: -254> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-c con 0x556afb8fcc70 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:35:40.142 INFO:tasks.workunit.client.0.smithi110.stderr: -253> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.142 INFO:tasks.workunit.client.0.smithi110.stderr: -252> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.142 INFO:tasks.workunit.client.0.smithi110.stderr: -251> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.142 INFO:tasks.workunit.client.0.smithi110.stderr: -250> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient(hunting): _renew_subs 2024-03-04T12:35:40.142 INFO:tasks.workunit.client.0.smithi110.stderr: -249> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient(hunting): authenticate will time out at 1721.210311s 2024-03-04T12:35:40.142 INFO:tasks.workunit.client.0.smithi110.stderr: -248> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient(hunting): get_auth_request con 0x556afb8fbf60 auth_method 0 2024-03-04T12:35:40.143 INFO:tasks.workunit.client.0.smithi110.stderr: -247> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.143 INFO:tasks.workunit.client.0.smithi110.stderr: -246> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.143 INFO:tasks.workunit.client.0.smithi110.stderr: -245> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.143 INFO:tasks.workunit.client.0.smithi110.stderr: -244> 2024-03-04T12:35:39.851+0000 7ff62f755640 10 monclient(hunting): get_auth_request con 0x556afb8fcc70 auth_method 0 2024-03-04T12:35:40.143 INFO:tasks.workunit.client.0.smithi110.stderr: -243> 2024-03-04T12:35:39.851+0000 7ff62f755640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.143 INFO:tasks.workunit.client.0.smithi110.stderr: -242> 2024-03-04T12:35:39.851+0000 7ff62f755640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.143 INFO:tasks.workunit.client.0.smithi110.stderr: -241> 2024-03-04T12:35:39.851+0000 7ff62f755640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.143 INFO:tasks.workunit.client.0.smithi110.stderr: -240> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.143 INFO:tasks.workunit.client.0.smithi110.stderr: -239> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.143 INFO:tasks.workunit.client.0.smithi110.stderr: -238> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.143 INFO:tasks.workunit.client.0.smithi110.stderr: -237> 2024-03-04T12:35:39.851+0000 7ff62f755640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.143 INFO:tasks.workunit.client.0.smithi110.stderr: -236> 2024-03-04T12:35:39.851+0000 7ff62f755640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.143 INFO:tasks.workunit.client.0.smithi110.stderr: -235> 2024-03-04T12:35:39.851+0000 7ff62f755640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.143 INFO:tasks.workunit.client.0.smithi110.stderr: -234> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient(hunting): handle_auth_done global_id 6570 payload 274 2024-03-04T12:35:40.144 INFO:tasks.workunit.client.0.smithi110.stderr: -233> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient: _finish_hunting 0 2024-03-04T12:35:40.144 INFO:tasks.workunit.client.0.smithi110.stderr: -232> 2024-03-04T12:35:39.851+0000 7ff62e753640 1 monclient: found mon.noname-a 2024-03-04T12:35:40.144 INFO:tasks.workunit.client.0.smithi110.stderr: -231> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.144 INFO:tasks.workunit.client.0.smithi110.stderr: -230> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.144 INFO:tasks.workunit.client.0.smithi110.stderr: -229> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:35:40.144 INFO:tasks.workunit.client.0.smithi110.stderr: -228> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: dump: 2024-03-04T12:35:40.144 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.144 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.144 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.144 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.144 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.144 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.144 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.144 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.145 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.145 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.145 INFO:tasks.workunit.client.0.smithi110.stderr: -227> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: _finish_auth 0 2024-03-04T12:35:40.145 INFO:tasks.workunit.client.0.smithi110.stderr: -226> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: _check_auth_tickets 2024-03-04T12:35:40.145 INFO:tasks.workunit.client.0.smithi110.stderr: -225> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:40.145 INFO:tasks.workunit.client.0.smithi110.stderr: -224> 2024-03-04T12:35:39.851+0000 7ff63332b800 5 monclient: authenticate success, global_id 6570 2024-03-04T12:35:40.145 INFO:tasks.workunit.client.0.smithi110.stderr: -223> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient: get_monmap_and_config success 2024-03-04T12:35:40.145 INFO:tasks.workunit.client.0.smithi110.stderr: -222> 2024-03-04T12:35:39.851+0000 7ff63332b800 4 set_mon_vals no callback set 2024-03-04T12:35:40.145 INFO:tasks.workunit.client.0.smithi110.stderr: -221> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.145 INFO:tasks.workunit.client.0.smithi110.stderr: -220> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:35:40.145 INFO:tasks.workunit.client.0.smithi110.stderr: -219> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: dump: 2024-03-04T12:35:40.145 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.145 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.145 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.145 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.146 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.146 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.146 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.146 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.146 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.146 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.146 INFO:tasks.workunit.client.0.smithi110.stderr: -218> 2024-03-04T12:35:39.852+0000 7ff63332b800 10 monclient: shutdown 2024-03-04T12:35:40.146 INFO:tasks.workunit.client.0.smithi110.stderr: -217> 2024-03-04T12:35:39.852+0000 7ff63332b800 10 monclient: build_initial_monmap 2024-03-04T12:35:40.146 INFO:tasks.workunit.client.0.smithi110.stderr: -216> 2024-03-04T12:35:39.852+0000 7ff63332b800 1 build_initial for_mkfs: 0 2024-03-04T12:35:40.146 INFO:tasks.workunit.client.0.smithi110.stderr: -215> 2024-03-04T12:35:39.852+0000 7ff63332b800 10 monclient: monmap: 2024-03-04T12:35:40.146 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:35:40.146 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:35:40.146 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:35:40.146 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:35:40.147 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:35:40.147 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.147 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:35:40.147 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:35:40.147 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:35:40.147 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.147 INFO:tasks.workunit.client.0.smithi110.stderr: -214> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding auth protocol: cephx 2024-03-04T12:35:40.147 INFO:tasks.workunit.client.0.smithi110.stderr: -213> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding auth protocol: cephx 2024-03-04T12:35:40.147 INFO:tasks.workunit.client.0.smithi110.stderr: -212> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding auth protocol: cephx 2024-03-04T12:35:40.147 INFO:tasks.workunit.client.0.smithi110.stderr: -211> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: secure 2024-03-04T12:35:40.147 INFO:tasks.workunit.client.0.smithi110.stderr: -210> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: crc 2024-03-04T12:35:40.147 INFO:tasks.workunit.client.0.smithi110.stderr: -209> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: secure 2024-03-04T12:35:40.147 INFO:tasks.workunit.client.0.smithi110.stderr: -208> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: crc 2024-03-04T12:35:40.147 INFO:tasks.workunit.client.0.smithi110.stderr: -207> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: secure 2024-03-04T12:35:40.147 INFO:tasks.workunit.client.0.smithi110.stderr: -206> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: crc 2024-03-04T12:35:40.148 INFO:tasks.workunit.client.0.smithi110.stderr: -205> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: crc 2024-03-04T12:35:40.148 INFO:tasks.workunit.client.0.smithi110.stderr: -204> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: secure 2024-03-04T12:35:40.148 INFO:tasks.workunit.client.0.smithi110.stderr: -203> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: crc 2024-03-04T12:35:40.148 INFO:tasks.workunit.client.0.smithi110.stderr: -202> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: secure 2024-03-04T12:35:40.148 INFO:tasks.workunit.client.0.smithi110.stderr: -201> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: crc 2024-03-04T12:35:40.148 INFO:tasks.workunit.client.0.smithi110.stderr: -200> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: secure 2024-03-04T12:35:40.148 INFO:tasks.workunit.client.0.smithi110.stderr: -199> 2024-03-04T12:35:39.852+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.148 INFO:tasks.workunit.client.0.smithi110.stderr: -198> 2024-03-04T12:35:39.852+0000 7ff63332b800 1 librados: starting msgr at 2024-03-04T12:35:40.148 INFO:tasks.workunit.client.0.smithi110.stderr: -197> 2024-03-04T12:35:39.852+0000 7ff63332b800 1 librados: starting objecter 2024-03-04T12:35:40.148 INFO:tasks.workunit.client.0.smithi110.stderr: -196> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command objecter_requests cmddesc objecter_requests hook 0x556afb8cad10 EEXIST 2024-03-04T12:35:40.148 INFO:tasks.workunit.client.0.smithi110.stderr: -195> 2024-03-04T12:35:39.852+0000 7ff63332b800 1 librados: setting wanted keys 2024-03-04T12:35:40.148 INFO:tasks.workunit.client.0.smithi110.stderr: -194> 2024-03-04T12:35:39.852+0000 7ff63332b800 1 librados: calling monclient init 2024-03-04T12:35:40.148 INFO:tasks.workunit.client.0.smithi110.stderr: -193> 2024-03-04T12:35:39.852+0000 7ff63332b800 10 monclient: init 2024-03-04T12:35:40.148 INFO:tasks.workunit.client.0.smithi110.stderr: -192> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding auth protocol: cephx 2024-03-04T12:35:40.149 INFO:tasks.workunit.client.0.smithi110.stderr: -191> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding auth protocol: cephx 2024-03-04T12:35:40.149 INFO:tasks.workunit.client.0.smithi110.stderr: -190> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding auth protocol: cephx 2024-03-04T12:35:40.149 INFO:tasks.workunit.client.0.smithi110.stderr: -189> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: secure 2024-03-04T12:35:40.149 INFO:tasks.workunit.client.0.smithi110.stderr: -188> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: crc 2024-03-04T12:35:40.149 INFO:tasks.workunit.client.0.smithi110.stderr: -187> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: secure 2024-03-04T12:35:40.149 INFO:tasks.workunit.client.0.smithi110.stderr: -186> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: crc 2024-03-04T12:35:40.149 INFO:tasks.workunit.client.0.smithi110.stderr: -185> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: secure 2024-03-04T12:35:40.149 INFO:tasks.workunit.client.0.smithi110.stderr: -184> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: crc 2024-03-04T12:35:40.149 INFO:tasks.workunit.client.0.smithi110.stderr: -183> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: crc 2024-03-04T12:35:40.149 INFO:tasks.workunit.client.0.smithi110.stderr: -182> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: secure 2024-03-04T12:35:40.149 INFO:tasks.workunit.client.0.smithi110.stderr: -181> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: crc 2024-03-04T12:35:40.149 INFO:tasks.workunit.client.0.smithi110.stderr: -180> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: secure 2024-03-04T12:35:40.149 INFO:tasks.workunit.client.0.smithi110.stderr: -179> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: crc 2024-03-04T12:35:40.149 INFO:tasks.workunit.client.0.smithi110.stderr: -178> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: secure 2024-03-04T12:35:40.150 INFO:tasks.workunit.client.0.smithi110.stderr: -177> 2024-03-04T12:35:39.853+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.150 INFO:tasks.workunit.client.0.smithi110.stderr: -176> 2024-03-04T12:35:39.853+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.150 INFO:tasks.workunit.client.0.smithi110.stderr: -175> 2024-03-04T12:35:39.853+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command rotate-key cmddesc rotate-key hook 0x556afb8cd688 EEXIST 2024-03-04T12:35:40.150 INFO:tasks.workunit.client.0.smithi110.stderr: -174> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient: _reopen_session rank -1 2024-03-04T12:35:40.150 INFO:tasks.workunit.client.0.smithi110.stderr: -173> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient: _add_conns ranks=[0,2,1] 2024-03-04T12:35:40.150 INFO:tasks.workunit.client.0.smithi110.stderr: -172> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-a con 0x556afb8fbf60 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:35:40.150 INFO:tasks.workunit.client.0.smithi110.stderr: -171> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-c con 0x556afb8fcc70 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:35:40.150 INFO:tasks.workunit.client.0.smithi110.stderr: -170> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-b con 0x556afb90a1a0 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:35:40.150 INFO:tasks.workunit.client.0.smithi110.stderr: -169> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.150 INFO:tasks.workunit.client.0.smithi110.stderr: -168> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.150 INFO:tasks.workunit.client.0.smithi110.stderr: -167> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.150 INFO:tasks.workunit.client.0.smithi110.stderr: -166> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient(hunting): _renew_subs 2024-03-04T12:35:40.150 INFO:tasks.workunit.client.0.smithi110.stderr: -165> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient(hunting): authenticate will time out at 1721.212396s 2024-03-04T12:35:40.151 INFO:tasks.workunit.client.0.smithi110.stderr: -164> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient(hunting): get_auth_request con 0x556afb8fbf60 auth_method 0 2024-03-04T12:35:40.151 INFO:tasks.workunit.client.0.smithi110.stderr: -163> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.151 INFO:tasks.workunit.client.0.smithi110.stderr: -162> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.151 INFO:tasks.workunit.client.0.smithi110.stderr: -161> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.151 INFO:tasks.workunit.client.0.smithi110.stderr: -160> 2024-03-04T12:35:39.853+0000 7ff62e753640 10 monclient(hunting): get_auth_request con 0x556afb8fcc70 auth_method 0 2024-03-04T12:35:40.151 INFO:tasks.workunit.client.0.smithi110.stderr: -159> 2024-03-04T12:35:39.853+0000 7ff62e753640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.151 INFO:tasks.workunit.client.0.smithi110.stderr: -158> 2024-03-04T12:35:39.853+0000 7ff62e753640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.151 INFO:tasks.workunit.client.0.smithi110.stderr: -157> 2024-03-04T12:35:39.853+0000 7ff62e753640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.151 INFO:tasks.workunit.client.0.smithi110.stderr: -156> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.151 INFO:tasks.workunit.client.0.smithi110.stderr: -155> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.151 INFO:tasks.workunit.client.0.smithi110.stderr: -154> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.151 INFO:tasks.workunit.client.0.smithi110.stderr: -153> 2024-03-04T12:35:39.853+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.151 INFO:tasks.workunit.client.0.smithi110.stderr: -152> 2024-03-04T12:35:39.853+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.151 INFO:tasks.workunit.client.0.smithi110.stderr: -151> 2024-03-04T12:35:39.853+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.151 INFO:tasks.workunit.client.0.smithi110.stderr: -150> 2024-03-04T12:35:39.853+0000 7ff62f755640 10 monclient(hunting): get_auth_request con 0x556afb90a1a0 auth_method 0 2024-03-04T12:35:40.152 INFO:tasks.workunit.client.0.smithi110.stderr: -149> 2024-03-04T12:35:39.853+0000 7ff62f755640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.152 INFO:tasks.workunit.client.0.smithi110.stderr: -148> 2024-03-04T12:35:39.853+0000 7ff62f755640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.152 INFO:tasks.workunit.client.0.smithi110.stderr: -147> 2024-03-04T12:35:39.853+0000 7ff62f755640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.152 INFO:tasks.workunit.client.0.smithi110.stderr: -146> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient(hunting): handle_auth_done global_id 6573 payload 824 2024-03-04T12:35:40.152 INFO:tasks.workunit.client.0.smithi110.stderr: -145> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient: _finish_hunting 0 2024-03-04T12:35:40.152 INFO:tasks.workunit.client.0.smithi110.stderr: -144> 2024-03-04T12:35:39.853+0000 7ff62ef54640 1 monclient: found mon.noname-a 2024-03-04T12:35:40.152 INFO:tasks.workunit.client.0.smithi110.stderr: -143> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.152 INFO:tasks.workunit.client.0.smithi110.stderr: -142> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.152 INFO:tasks.workunit.client.0.smithi110.stderr: -141> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:35:40.152 INFO:tasks.workunit.client.0.smithi110.stderr: -140> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: dump: 2024-03-04T12:35:40.152 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.152 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.152 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.152 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.153 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.153 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.153 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.153 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.153 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.153 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.153 INFO:tasks.workunit.client.0.smithi110.stderr: -139> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: _finish_auth 0 2024-03-04T12:35:40.153 INFO:tasks.workunit.client.0.smithi110.stderr: -138> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: _check_auth_tickets 2024-03-04T12:35:40.153 INFO:tasks.workunit.client.0.smithi110.stderr: -137> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:40.153 INFO:tasks.workunit.client.0.smithi110.stderr: -136> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.153 INFO:tasks.workunit.client.0.smithi110.stderr: -135> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:35:40.153 INFO:tasks.workunit.client.0.smithi110.stderr: -134> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: dump: 2024-03-04T12:35:40.153 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.153 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.154 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.154 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.154 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.154 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.154 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.154 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.154 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.154 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.154 INFO:tasks.workunit.client.0.smithi110.stderr: -133> 2024-03-04T12:35:39.853+0000 7ff63332b800 5 monclient: authenticate success, global_id 6573 2024-03-04T12:35:40.154 INFO:tasks.workunit.client.0.smithi110.stderr: -132> 2024-03-04T12:35:39.854+0000 7ff63332b800 10 monclient: _renew_subs 2024-03-04T12:35:40.154 INFO:tasks.workunit.client.0.smithi110.stderr: -131> 2024-03-04T12:35:39.853+0000 7ff5127fc640 4 set_mon_vals no callback set 2024-03-04T12:35:40.154 INFO:tasks.workunit.client.0.smithi110.stderr: -130> 2024-03-04T12:35:39.854+0000 7ff63332b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.154 INFO:tasks.workunit.client.0.smithi110.stderr: -129> 2024-03-04T12:35:39.854+0000 7ff63332b800 10 monclient: _renew_subs 2024-03-04T12:35:40.154 INFO:tasks.workunit.client.0.smithi110.stderr: -128> 2024-03-04T12:35:39.854+0000 7ff63332b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.155 INFO:tasks.workunit.client.0.smithi110.stderr: -127> 2024-03-04T12:35:39.854+0000 7ff63332b800 1 librados: init done 2024-03-04T12:35:40.155 INFO:tasks.workunit.client.0.smithi110.stderr: -126> 2024-03-04T12:35:39.854+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command cr dump hook 0x556afb918118 2024-03-04T12:35:40.155 INFO:tasks.workunit.client.0.smithi110.stderr: -125> 2024-03-04T12:35:39.855+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.155 INFO:tasks.workunit.client.0.smithi110.stderr: -124> 2024-03-04T12:35:39.855+0000 7ff510ff9640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:35:40.155 INFO:tasks.workunit.client.0.smithi110.stderr: -123> 2024-03-04T12:35:39.855+0000 7ff510ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:40.155 INFO:tasks.workunit.client.0.smithi110.stderr: -122> 2024-03-04T12:35:39.855+0000 7ff510ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:40.155 INFO:tasks.workunit.client.0.smithi110.stderr: -121> 2024-03-04T12:35:39.855+0000 7ff62e753640 10 monclient: get_auth_request con 0x7ff4f8069eb0 auth_method 0 2024-03-04T12:35:40.155 INFO:tasks.workunit.client.0.smithi110.stderr: -120> 2024-03-04T12:35:39.856+0000 7ff62f755640 10 monclient: get_auth_request con 0x556afb924c30 auth_method 0 2024-03-04T12:35:40.155 INFO:tasks.workunit.client.0.smithi110.stderr: -119> 2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.155 INFO:tasks.workunit.client.0.smithi110.stderr: -118> 2024-03-04T12:35:39.856+0000 7ff63332b800 20 realm 2024-03-04T12:35:40.155 INFO:tasks.workunit.client.0.smithi110.stderr: -117> 2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.155 INFO:tasks.workunit.client.0.smithi110.stderr: -116> 2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.155 INFO:tasks.workunit.client.0.smithi110.stderr: -115> 2024-03-04T12:35:39.856+0000 7ff63332b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:40.155 INFO:tasks.workunit.client.0.smithi110.stderr: -114> 2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.155 INFO:tasks.workunit.client.0.smithi110.stderr: -113> 2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.156 INFO:tasks.workunit.client.0.smithi110.stderr: -112> 2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.156 INFO:tasks.workunit.client.0.smithi110.stderr: -111> 2024-03-04T12:35:39.857+0000 7ff62ef54640 10 monclient: get_auth_request con 0x556afb928f90 auth_method 0 2024-03-04T12:35:40.156 INFO:tasks.workunit.client.0.smithi110.stderr: -110> 2024-03-04T12:35:39.857+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:40.156 INFO:tasks.workunit.client.0.smithi110.stderr: -109> 2024-03-04T12:35:39.857+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.156 INFO:tasks.workunit.client.0.smithi110.stderr: -108> 2024-03-04T12:35:39.858+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:40.156 INFO:tasks.workunit.client.0.smithi110.stderr: -107> 2024-03-04T12:35:39.858+0000 7ff63332b800 20 searching for the correct realm 2024-03-04T12:35:40.156 INFO:tasks.workunit.client.0.smithi110.stderr: -106> 2024-03-04T12:35:39.858+0000 7ff62e753640 10 monclient: get_auth_request con 0x556afb92e0a0 auth_method 0 2024-03-04T12:35:40.156 INFO:tasks.workunit.client.0.smithi110.stderr: -105> 2024-03-04T12:35:39.859+0000 7ff62f755640 10 monclient: get_auth_request con 0x7ff624033060 auth_method 0 2024-03-04T12:35:40.156 INFO:tasks.workunit.client.0.smithi110.stderr: -104> 2024-03-04T12:35:39.859+0000 7ff62ef54640 10 monclient: get_auth_request con 0x7ff628050070 auth_method 0 2024-03-04T12:35:40.156 INFO:tasks.workunit.client.0.smithi110.stderr: -103> 2024-03-04T12:35:39.860+0000 7ff62e753640 10 monclient: get_auth_request con 0x7ff620063790 auth_method 0 2024-03-04T12:35:40.156 INFO:tasks.workunit.client.0.smithi110.stderr: -102> 2024-03-04T12:35:39.862+0000 7ff62f755640 10 monclient: get_auth_request con 0x7ff62401e030 auth_method 0 2024-03-04T12:35:40.156 INFO:tasks.workunit.client.0.smithi110.stderr: -101> 2024-03-04T12:35:39.862+0000 7ff62f755640 0 -- 172.21.15.110:0/3563356137 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7ff62401e030 msgr2=0x7ff6240751c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:35:40.156 INFO:tasks.workunit.client.0.smithi110.stderr: -100> 2024-03-04T12:35:40.063+0000 7ff62f755640 10 monclient: get_auth_request con 0x7ff62401e030 auth_method 0 2024-03-04T12:35:40.157 INFO:tasks.workunit.client.0.smithi110.stderr: -99> 2024-03-04T12:35:40.066+0000 7ff62ef54640 10 monclient: get_auth_request con 0x7ff624009040 auth_method 0 2024-03-04T12:35:40.157 INFO:tasks.workunit.client.0.smithi110.stderr: -98> 2024-03-04T12:35:40.068+0000 7ff62ef54640 0 -- 172.21.15.110:0/3563356137 >> [v2:172.21.15.172:6800/824320839,v1:172.21.15.172:6801/824320839] conn(0x556afb928f90 msgr2=0x556afb92b380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:40.157 INFO:tasks.workunit.client.0.smithi110.stderr: -97> 2024-03-04T12:35:40.068+0000 7ff510ff9640 1 client.6573.objecter ms_handle_reset 0x556afb928f90 session 0x556afb927e30 osd.5 2024-03-04T12:35:40.157 INFO:tasks.workunit.client.0.smithi110.stderr: -96> 2024-03-04T12:35:40.068+0000 7ff510ff9640 10 monclient: _renew_subs 2024-03-04T12:35:40.157 INFO:tasks.workunit.client.0.smithi110.stderr: -95> 2024-03-04T12:35:40.068+0000 7ff510ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.157 INFO:tasks.workunit.client.0.smithi110.stderr: -94> 2024-03-04T12:35:40.068+0000 7ff62ef54640 10 monclient: get_auth_request con 0x7ff4f8079c50 auth_method 0 2024-03-04T12:35:40.157 INFO:tasks.workunit.client.0.smithi110.stderr: -93> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:40.157 INFO:tasks.workunit.client.0.smithi110.stderr: -92> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:40.157 INFO:tasks.workunit.client.0.smithi110.stderr: -91> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:40.157 INFO:tasks.workunit.client.0.smithi110.stderr: -90> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:40.157 INFO:tasks.workunit.client.0.smithi110.stderr: -89> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:40.157 INFO:tasks.workunit.client.0.smithi110.stderr: -88> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:40.157 INFO:tasks.workunit.client.0.smithi110.stderr: -87> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.157 INFO:tasks.workunit.client.0.smithi110.stderr: -86> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.158 INFO:tasks.workunit.client.0.smithi110.stderr: -85> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.158 INFO:tasks.workunit.client.0.smithi110.stderr: -84> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:40.158 INFO:tasks.workunit.client.0.smithi110.stderr: -83> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.158 INFO:tasks.workunit.client.0.smithi110.stderr: -82> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:40.158 INFO:tasks.workunit.client.0.smithi110.stderr: -81> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 zone default found 2024-03-04T12:35:40.158 INFO:tasks.workunit.client.0.smithi110.stderr: -80> 2024-03-04T12:35:40.071+0000 7ff63332b800 4 Realm: () 2024-03-04T12:35:40.158 INFO:tasks.workunit.client.0.smithi110.stderr: -79> 2024-03-04T12:35:40.071+0000 7ff63332b800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:40.158 INFO:tasks.workunit.client.0.smithi110.stderr: -78> 2024-03-04T12:35:40.071+0000 7ff63332b800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:40.158 INFO:tasks.workunit.client.0.smithi110.stderr: -77> 2024-03-04T12:35:40.071+0000 7ff63332b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:40.158 INFO:tasks.workunit.client.0.smithi110.stderr: -76> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 zonegroup default 2024-03-04T12:35:40.158 INFO:tasks.workunit.client.0.smithi110.stderr: -75> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.158 INFO:tasks.workunit.client.0.smithi110.stderr: -74> 2024-03-04T12:35:40.072+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.158 INFO:tasks.workunit.client.0.smithi110.stderr: -73> 2024-03-04T12:35:40.072+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.158 INFO:tasks.workunit.client.0.smithi110.stderr: -72> 2024-03-04T12:35:40.072+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.159 INFO:tasks.workunit.client.0.smithi110.stderr: -71> 2024-03-04T12:35:40.072+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.159 INFO:tasks.workunit.client.0.smithi110.stderr: -70> 2024-03-04T12:35:40.072+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.159 INFO:tasks.workunit.client.0.smithi110.stderr: -69> 2024-03-04T12:35:40.072+0000 7ff63332b800 20 started sync module instance, tier type = 2024-03-04T12:35:40.159 INFO:tasks.workunit.client.0.smithi110.stderr: -68> 2024-03-04T12:35:40.072+0000 7ff63332b800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:40.159 INFO:tasks.workunit.client.0.smithi110.stderr: -67> 2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=0 2024-03-04T12:35:40.159 INFO:tasks.workunit.client.0.smithi110.stderr: -66> 2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=1 2024-03-04T12:35:40.159 INFO:tasks.workunit.client.0.smithi110.stderr: -65> 2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=2 2024-03-04T12:35:40.159 INFO:tasks.workunit.client.0.smithi110.stderr: -64> 2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=3 2024-03-04T12:35:40.159 INFO:tasks.workunit.client.0.smithi110.stderr: -63> 2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=4 2024-03-04T12:35:40.159 INFO:tasks.workunit.client.0.smithi110.stderr: -62> 2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=5 2024-03-04T12:35:40.159 INFO:tasks.workunit.client.0.smithi110.stderr: -61> 2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=6 2024-03-04T12:35:40.159 INFO:tasks.workunit.client.0.smithi110.stderr: -60> 2024-03-04T12:35:40.082+0000 7ff63332b800 20 add_watcher() i=7 2024-03-04T12:35:40.159 INFO:tasks.workunit.client.0.smithi110.stderr: -59> 2024-03-04T12:35:40.082+0000 7ff63332b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:40.159 INFO:tasks.workunit.client.0.smithi110.stderr: -58> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding auth protocol: cephx 2024-03-04T12:35:40.159 INFO:tasks.workunit.client.0.smithi110.stderr: -57> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding auth protocol: cephx 2024-03-04T12:35:40.160 INFO:tasks.workunit.client.0.smithi110.stderr: -56> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding auth protocol: cephx 2024-03-04T12:35:40.160 INFO:tasks.workunit.client.0.smithi110.stderr: -55> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: secure 2024-03-04T12:35:40.160 INFO:tasks.workunit.client.0.smithi110.stderr: -54> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: crc 2024-03-04T12:35:40.160 INFO:tasks.workunit.client.0.smithi110.stderr: -53> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: secure 2024-03-04T12:35:40.160 INFO:tasks.workunit.client.0.smithi110.stderr: -52> 2024-03-04T12:35:40.084+0000 7ff4e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:40.160 INFO:tasks.workunit.client.0.smithi110.stderr: -51> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: crc 2024-03-04T12:35:40.160 INFO:tasks.workunit.client.0.smithi110.stderr: -50> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: secure 2024-03-04T12:35:40.160 INFO:tasks.workunit.client.0.smithi110.stderr: -49> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: crc 2024-03-04T12:35:40.160 INFO:tasks.workunit.client.0.smithi110.stderr: -48> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: crc 2024-03-04T12:35:40.160 INFO:tasks.workunit.client.0.smithi110.stderr: -47> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: secure 2024-03-04T12:35:40.160 INFO:tasks.workunit.client.0.smithi110.stderr: -46> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: crc 2024-03-04T12:35:40.160 INFO:tasks.workunit.client.0.smithi110.stderr: -45> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: secure 2024-03-04T12:35:40.160 INFO:tasks.workunit.client.0.smithi110.stderr: -44> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: crc 2024-03-04T12:35:40.160 INFO:tasks.workunit.client.0.smithi110.stderr: -43> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: secure 2024-03-04T12:35:40.161 INFO:tasks.workunit.client.0.smithi110.stderr: -42> 2024-03-04T12:35:40.084+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.161 INFO:tasks.workunit.client.0.smithi110.stderr: -41> 2024-03-04T12:35:40.084+0000 7ff63332b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:40.161 INFO:tasks.workunit.client.0.smithi110.stderr: -40> 2024-03-04T12:35:40.084+0000 7ff63332b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:40.161 INFO:tasks.workunit.client.0.smithi110.stderr: -39> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command cache list hook 0x556afb900480 2024-03-04T12:35:40.161 INFO:tasks.workunit.client.0.smithi110.stderr: -38> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command cache inspect hook 0x556afb900480 2024-03-04T12:35:40.161 INFO:tasks.workunit.client.0.smithi110.stderr: -37> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command cache erase hook 0x556afb900480 2024-03-04T12:35:40.161 INFO:tasks.workunit.client.0.smithi110.stderr: -36> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command cache zap hook 0x556afb900480 2024-03-04T12:35:40.161 INFO:tasks.workunit.client.0.smithi110.stderr: -35> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 note: GC not initialized 2024-03-04T12:35:40.161 INFO:tasks.workunit.client.0.smithi110.stderr: -34> 2024-03-04T12:35:40.085+0000 7ff45ffff640 20 reqs_thread_entry: start 2024-03-04T12:35:40.161 INFO:tasks.workunit.client.0.smithi110.stderr: -33> 2024-03-04T12:35:40.085+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command sync trace show hook 0x7ff624024070 2024-03-04T12:35:40.161 INFO:tasks.workunit.client.0.smithi110.stderr: -32> 2024-03-04T12:35:40.085+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command sync trace history hook 0x7ff624024070 2024-03-04T12:35:40.161 INFO:tasks.workunit.client.0.smithi110.stderr: -31> 2024-03-04T12:35:40.085+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command sync trace active hook 0x7ff624024070 2024-03-04T12:35:40.161 INFO:tasks.workunit.client.0.smithi110.stderr: -30> 2024-03-04T12:35:40.085+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command sync trace active_short hook 0x7ff624024070 2024-03-04T12:35:40.161 INFO:tasks.workunit.client.0.smithi110.stderr: -29> 2024-03-04T12:35:40.085+0000 7ff63332b800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:40.162 INFO:tasks.workunit.client.0.smithi110.stderr: -28> 2024-03-04T12:35:40.085+0000 7ff63332b800 20 Filter name: none 2024-03-04T12:35:40.162 INFO:tasks.workunit.client.0.smithi110.stderr: -27> 2024-03-04T12:35:40.085+0000 7ff45dffb640 20 reqs_thread_entry: start 2024-03-04T12:35:40.162 INFO:tasks.workunit.client.0.smithi110.stderr: -26> 2024-03-04T12:35:40.085+0000 7ff63332b800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-04T12:35:40.162 INFO:tasks.workunit.client.0.smithi110.stderr: -25> 2024-03-04T12:35:40.085+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.162 INFO:tasks.workunit.client.0.smithi110.stderr: -24> 2024-03-04T12:35:40.085+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:35:40.162 INFO:tasks.workunit.client.0.smithi110.stderr: -23> 2024-03-04T12:35:40.085+0000 7ff63332b800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-04T12:35:40.162 INFO:tasks.workunit.client.0.smithi110.stderr: -22> 2024-03-04T12:35:40.085+0000 7ff63332b800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-04T12:35:40.162 INFO:tasks.workunit.client.0.smithi110.stderr: -21> 2024-03-04T12:35:40.085+0000 7ff63332b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 : miss 2024-03-04T12:35:40.162 INFO:tasks.workunit.client.0.smithi110.stderr: -20> 2024-03-04T12:35:40.085+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.162 INFO:tasks.workunit.client.0.smithi110.stderr: -19> 2024-03-04T12:35:40.086+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=385 2024-03-04T12:35:40.162 INFO:tasks.workunit.client.0.smithi110.stderr: -18> 2024-03-04T12:35:40.086+0000 7ff63332b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 info.flags=0x17 2024-03-04T12:35:40.162 INFO:tasks.workunit.client.0.smithi110.stderr: -17> 2024-03-04T12:35:40.086+0000 7ff63332b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 to cache LRU end 2024-03-04T12:35:40.162 INFO:tasks.workunit.client.0.smithi110.stderr: -16> 2024-03-04T12:35:40.086+0000 7ff63332b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:35:40.162 INFO:tasks.workunit.client.0.smithi110.stderr: -15> 2024-03-04T12:35:40.086+0000 7ff63332b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:40.163 INFO:tasks.workunit.client.0.smithi110.stderr: -14> 2024-03-04T12:35:40.086+0000 7ff63332b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 2024-03-04T12:35:40.163 INFO:tasks.workunit.client.0.smithi110.stderr: -13> 2024-03-04T12:35:40.091+0000 7ff63332b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 info.flags=0x17 2024-03-04T12:35:40.163 INFO:tasks.workunit.client.0.smithi110.stderr: -12> 2024-03-04T12:35:40.091+0000 7ff63332b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 to cache LRU end 2024-03-04T12:35:40.163 INFO:tasks.workunit.client.0.smithi110.stderr: -11> 2024-03-04T12:35:40.091+0000 7ff63332b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:40.163 INFO:tasks.workunit.client.0.smithi110.stderr: -10> 2024-03-04T12:35:40.091+0000 7ff63332b800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24, ofs0, ns] 2024-03-04T12:35:40.163 INFO:tasks.workunit.client.0.smithi110.stderr: -9> 2024-03-04T12:35:40.091+0000 7ff511ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824088 cookie 93917975585152 notifier 6573 bl.length()=949 2024-03-04T12:35:40.163 INFO:tasks.workunit.client.0.smithi110.stderr: -8> 2024-03-04T12:35:40.091+0000 7ff511ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 info.flags=0x17 2024-03-04T12:35:40.163 INFO:tasks.workunit.client.0.smithi110.stderr: -7> 2024-03-04T12:35:40.091+0000 7ff511ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 to cache LRU end 2024-03-04T12:35:40.163 INFO:tasks.workunit.client.0.smithi110.stderr: -6> 2024-03-04T12:35:40.091+0000 7ff511ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:40.163 INFO:tasks.workunit.client.0.smithi110.stderr: -5> 2024-03-04T12:35:40.093+0000 7ff63332b800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): orig_sources= new_sources= 2024-03-04T12:35:40.163 INFO:tasks.workunit.client.0.smithi110.stderr: -4> 2024-03-04T12:35:40.093+0000 7ff63332b800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): potential sources added=[] removed=[] 2024-03-04T12:35:40.163 INFO:tasks.workunit.client.0.smithi110.stderr: -3> 2024-03-04T12:35:40.093+0000 7ff63332b800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): orig_dests= new_dests= 2024-03-04T12:35:40.163 INFO:tasks.workunit.client.0.smithi110.stderr: -2> 2024-03-04T12:35:40.093+0000 7ff63332b800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): potential dests added=[] removed=[] 2024-03-04T12:35:40.163 INFO:tasks.workunit.client.0.smithi110.stderr: -1> 2024-03-04T12:35:40.094+0000 7ff63332b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff63332b800 time 2024-03-04T12:35:40.094232+0000 2024-03-04T12:35:40.163 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:35:40.164 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.164 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:35:40.164 INFO:tasks.workunit.client.0.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff634780e86] 2024-03-04T12:35:40.164 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7ff634781044] 2024-03-04T12:35:40.164 INFO:tasks.workunit.client.0.smithi110.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556afa536eb1] 2024-03-04T12:35:40.164 INFO:tasks.workunit.client.0.smithi110.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x556afa54ad74] 2024-03-04T12:35:40.164 INFO:tasks.workunit.client.0.smithi110.stderr: 5: main() 2024-03-04T12:35:40.164 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7ff63363feb0] 2024-03-04T12:35:40.164 INFO:tasks.workunit.client.0.smithi110.stderr: 7: __libc_start_main() 2024-03-04T12:35:40.164 INFO:tasks.workunit.client.0.smithi110.stderr: 8: _start() 2024-03-04T12:35:40.164 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.164 INFO:tasks.workunit.client.0.smithi110.stderr: 0> 2024-03-04T12:35:40.094+0000 7ff63332b800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:35:40.164 INFO:tasks.workunit.client.0.smithi110.stderr: in thread 7ff63332b800 thread_name:radosgw-admin 2024-03-04T12:35:40.164 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.165 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:35:40.165 INFO:tasks.workunit.client.0.smithi110.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7ff633654db0] 2024-03-04T12:35:40.165 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7ff6336a154c] 2024-03-04T12:35:40.165 INFO:tasks.workunit.client.0.smithi110.stderr: 3: raise() 2024-03-04T12:35:40.165 INFO:tasks.workunit.client.0.smithi110.stderr: 4: abort() 2024-03-04T12:35:40.165 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff634780ee0] 2024-03-04T12:35:40.165 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7ff634781044] 2024-03-04T12:35:40.165 INFO:tasks.workunit.client.0.smithi110.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556afa536eb1] 2024-03-04T12:35:40.165 INFO:tasks.workunit.client.0.smithi110.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x556afa54ad74] 2024-03-04T12:35:40.165 INFO:tasks.workunit.client.0.smithi110.stderr: 9: main() 2024-03-04T12:35:40.165 INFO:tasks.workunit.client.0.smithi110.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7ff63363feb0] 2024-03-04T12:35:40.165 INFO:tasks.workunit.client.0.smithi110.stderr: 11: __libc_start_main() 2024-03-04T12:35:40.165 INFO:tasks.workunit.client.0.smithi110.stderr: 12: _start() 2024-03-04T12:35:40.165 INFO:tasks.workunit.client.0.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:35:40.165 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.165 INFO:tasks.workunit.client.0.smithi110.stderr:--- logging levels --- 2024-03-04T12:35:40.166 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 none 2024-03-04T12:35:40.166 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 lockdep 2024-03-04T12:35:40.166 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 context 2024-03-04T12:35:40.166 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 crush 2024-03-04T12:35:40.166 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds 2024-03-04T12:35:40.166 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_balancer 2024-03-04T12:35:40.166 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_locker 2024-03-04T12:35:40.166 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_log 2024-03-04T12:35:40.166 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_log_expire 2024-03-04T12:35:40.166 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_migrator 2024-03-04T12:35:40.166 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 buffer 2024-03-04T12:35:40.166 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 timer 2024-03-04T12:35:40.166 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 filer 2024-03-04T12:35:40.166 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 striper 2024-03-04T12:35:40.166 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 objecter 2024-03-04T12:35:40.167 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rados 2024-03-04T12:35:40.167 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd 2024-03-04T12:35:40.167 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_mirror 2024-03-04T12:35:40.167 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_replay 2024-03-04T12:35:40.167 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_pwl 2024-03-04T12:35:40.167 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 journaler 2024-03-04T12:35:40.167 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 objectcacher 2024-03-04T12:35:40.167 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 immutable_obj_cache 2024-03-04T12:35:40.167 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 client 2024-03-04T12:35:40.167 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 osd 2024-03-04T12:35:40.167 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 optracker 2024-03-04T12:35:40.167 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 objclass 2024-03-04T12:35:40.167 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 filestore 2024-03-04T12:35:40.167 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 journal 2024-03-04T12:35:40.167 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 0 ms 2024-03-04T12:35:40.168 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mon 2024-03-04T12:35:40.168 INFO:tasks.workunit.client.0.smithi110.stderr: 0/10 monc 2024-03-04T12:35:40.168 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 paxos 2024-03-04T12:35:40.168 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 tp 2024-03-04T12:35:40.168 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 auth 2024-03-04T12:35:40.168 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 crypto 2024-03-04T12:35:40.168 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 finisher 2024-03-04T12:35:40.168 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 reserver 2024-03-04T12:35:40.168 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 heartbeatmap 2024-03-04T12:35:40.168 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 perfcounter 2024-03-04T12:35:40.168 INFO:tasks.workunit.client.0.smithi110.stderr: 20/20 rgw 2024-03-04T12:35:40.168 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_sync 2024-03-04T12:35:40.168 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_datacache 2024-03-04T12:35:40.168 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_access 2024-03-04T12:35:40.169 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_dbstore 2024-03-04T12:35:40.169 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_flight 2024-03-04T12:35:40.169 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_lifecycle 2024-03-04T12:35:40.169 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 javaclient 2024-03-04T12:35:40.169 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 asok 2024-03-04T12:35:40.169 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 throttle 2024-03-04T12:35:40.169 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 0 refs 2024-03-04T12:35:40.169 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 compressor 2024-03-04T12:35:40.169 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 bluestore 2024-03-04T12:35:40.169 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 bluefs 2024-03-04T12:35:40.169 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 bdev 2024-03-04T12:35:40.169 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 kstore 2024-03-04T12:35:40.169 INFO:tasks.workunit.client.0.smithi110.stderr: 4/ 5 rocksdb 2024-03-04T12:35:40.169 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 fuse 2024-03-04T12:35:40.170 INFO:tasks.workunit.client.0.smithi110.stderr: 2/ 5 mgr 2024-03-04T12:35:40.170 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mgrc 2024-03-04T12:35:40.170 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 dpdk 2024-03-04T12:35:40.170 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 eventtrace 2024-03-04T12:35:40.170 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 prioritycache 2024-03-04T12:35:40.170 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 test 2024-03-04T12:35:40.170 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cephfs_mirror 2024-03-04T12:35:40.170 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cephsqlite 2024-03-04T12:35:40.170 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 crimson_interrupt 2024-03-04T12:35:40.170 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore 2024-03-04T12:35:40.170 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_onode 2024-03-04T12:35:40.170 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_odata 2024-03-04T12:35:40.170 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_omap 2024-03-04T12:35:40.170 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_tm 2024-03-04T12:35:40.170 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_t 2024-03-04T12:35:40.171 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_cleaner 2024-03-04T12:35:40.171 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_epm 2024-03-04T12:35:40.171 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_lba 2024-03-04T12:35:40.171 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-04T12:35:40.171 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_cache 2024-03-04T12:35:40.171 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_journal 2024-03-04T12:35:40.171 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_device 2024-03-04T12:35:40.171 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_backref 2024-03-04T12:35:40.171 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 alienstore 2024-03-04T12:35:40.171 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mclock 2024-03-04T12:35:40.171 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cyanstore 2024-03-04T12:35:40.171 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 ceph_exporter 2024-03-04T12:35:40.171 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 memstore 2024-03-04T12:35:40.171 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 trace 2024-03-04T12:35:40.171 INFO:tasks.workunit.client.0.smithi110.stderr: -2/-2 (syslog threshold) 2024-03-04T12:35:40.171 INFO:tasks.workunit.client.0.smithi110.stderr: 99/99 (stderr threshold) 2024-03-04T12:35:40.172 INFO:tasks.workunit.client.0.smithi110.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-04T12:35:40.172 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff45dffb640 / http_manager 2024-03-04T12:35:40.172 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff45ffff640 / http_manager 2024-03-04T12:35:40.172 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff4e57e2640 / rgw_dt_lg_renew 2024-03-04T12:35:40.172 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff510ff9640 / ms_dispatch 2024-03-04T12:35:40.172 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff511ffb640 / io_context_pool 2024-03-04T12:35:40.172 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff5127fc640 / io_context_pool 2024-03-04T12:35:40.172 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff518e01640 / ms_dispatch 2024-03-04T12:35:40.172 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff51b606640 / ms_dispatch 2024-03-04T12:35:40.172 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff51ce09640 / io_context_pool 2024-03-04T12:35:40.172 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff62e753640 / msgr-worker-2 2024-03-04T12:35:40.172 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff62ef54640 / msgr-worker-1 2024-03-04T12:35:40.172 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff62f755640 / msgr-worker-0 2024-03-04T12:35:40.173 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff62ff56640 / io_context_pool 2024-03-04T12:35:40.173 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff63332b800 / radosgw-admin 2024-03-04T12:35:40.173 INFO:tasks.workunit.client.0.smithi110.stderr: max_recent 500 2024-03-04T12:35:40.173 INFO:tasks.workunit.client.0.smithi110.stderr: max_new 1000 2024-03-04T12:35:40.173 INFO:tasks.workunit.client.0.smithi110.stderr: log_file /var/log/ceph/ceph-client.admin.97562.log 2024-03-04T12:35:40.173 INFO:tasks.workunit.client.0.smithi110.stderr:--- end dump of recent events --- 2024-03-04T12:35:40.173 INFO:tasks.workunit.client.0.smithi110.stderr:--- begin dump of recent events --- 2024-03-04T12:35:40.173 INFO:tasks.workunit.client.0.smithi110.stderr: -499> 2024-03-04T12:35:39.839+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.173 INFO:tasks.workunit.client.0.smithi110.stderr: -498> 2024-03-04T12:35:39.839+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.173 INFO:tasks.workunit.client.0.smithi110.stderr: -497> 2024-03-04T12:35:39.839+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.173 INFO:tasks.workunit.client.0.smithi110.stderr: -496> 2024-03-04T12:35:39.839+0000 7ff62f755640 10 monclient(hunting): handle_auth_done global_id 6561 payload 274 2024-03-04T12:35:40.173 INFO:tasks.workunit.client.0.smithi110.stderr: -495> 2024-03-04T12:35:39.839+0000 7ff62f755640 10 monclient: _finish_hunting 0 2024-03-04T12:35:40.173 INFO:tasks.workunit.client.0.smithi110.stderr: -494> 2024-03-04T12:35:39.839+0000 7ff62f755640 1 monclient: found mon.noname-a 2024-03-04T12:35:40.173 INFO:tasks.workunit.client.0.smithi110.stderr: -493> 2024-03-04T12:35:39.839+0000 7ff62f755640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.174 INFO:tasks.workunit.client.0.smithi110.stderr: -492> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.174 INFO:tasks.workunit.client.0.smithi110.stderr: -491> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:35:40.174 INFO:tasks.workunit.client.0.smithi110.stderr: -490> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: dump: 2024-03-04T12:35:40.174 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.174 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.174 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.174 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.174 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.174 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.174 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.174 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.174 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.174 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.174 INFO:tasks.workunit.client.0.smithi110.stderr: -489> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: _finish_auth 0 2024-03-04T12:35:40.174 INFO:tasks.workunit.client.0.smithi110.stderr: -488> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: _check_auth_tickets 2024-03-04T12:35:40.175 INFO:tasks.workunit.client.0.smithi110.stderr: -487> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:40.175 INFO:tasks.workunit.client.0.smithi110.stderr: -486> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.175 INFO:tasks.workunit.client.0.smithi110.stderr: -485> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:35:40.175 INFO:tasks.workunit.client.0.smithi110.stderr: -484> 2024-03-04T12:35:39.839+0000 7ff51ce09640 10 monclient: dump: 2024-03-04T12:35:40.175 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.175 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.175 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.175 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.175 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.175 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.175 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.175 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.175 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.175 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.175 INFO:tasks.workunit.client.0.smithi110.stderr: -483> 2024-03-04T12:35:39.839+0000 7ff63332b800 5 monclient: authenticate success, global_id 6561 2024-03-04T12:35:40.176 INFO:tasks.workunit.client.0.smithi110.stderr: -482> 2024-03-04T12:35:39.839+0000 7ff63332b800 10 monclient: get_monmap_and_config success 2024-03-04T12:35:40.176 INFO:tasks.workunit.client.0.smithi110.stderr: -481> 2024-03-04T12:35:39.839+0000 7ff63332b800 4 set_mon_vals no callback set 2024-03-04T12:35:40.176 INFO:tasks.workunit.client.0.smithi110.stderr: -480> 2024-03-04T12:35:39.840+0000 7ff63332b800 10 monclient: shutdown 2024-03-04T12:35:40.176 INFO:tasks.workunit.client.0.smithi110.stderr: -479> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 asok(0x556afb61b0c0) unregister_commands rotate-key 2024-03-04T12:35:40.176 INFO:tasks.workunit.client.0.smithi110.stderr: -478> 2024-03-04T12:35:39.840+0000 7ff63332b800 10 monclient: build_initial_monmap 2024-03-04T12:35:40.176 INFO:tasks.workunit.client.0.smithi110.stderr: -477> 2024-03-04T12:35:39.840+0000 7ff63332b800 1 build_initial for_mkfs: 0 2024-03-04T12:35:40.176 INFO:tasks.workunit.client.0.smithi110.stderr: -476> 2024-03-04T12:35:39.840+0000 7ff63332b800 10 monclient: monmap: 2024-03-04T12:35:40.176 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:35:40.176 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:35:40.176 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:35:40.176 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:35:40.176 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:35:40.176 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.176 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:35:40.177 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:35:40.177 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:35:40.177 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.177 INFO:tasks.workunit.client.0.smithi110.stderr: -475> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding auth protocol: cephx 2024-03-04T12:35:40.177 INFO:tasks.workunit.client.0.smithi110.stderr: -474> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding auth protocol: cephx 2024-03-04T12:35:40.177 INFO:tasks.workunit.client.0.smithi110.stderr: -473> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding auth protocol: cephx 2024-03-04T12:35:40.177 INFO:tasks.workunit.client.0.smithi110.stderr: -472> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: secure 2024-03-04T12:35:40.177 INFO:tasks.workunit.client.0.smithi110.stderr: -471> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: crc 2024-03-04T12:35:40.177 INFO:tasks.workunit.client.0.smithi110.stderr: -470> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: secure 2024-03-04T12:35:40.177 INFO:tasks.workunit.client.0.smithi110.stderr: -469> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: crc 2024-03-04T12:35:40.177 INFO:tasks.workunit.client.0.smithi110.stderr: -468> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: secure 2024-03-04T12:35:40.177 INFO:tasks.workunit.client.0.smithi110.stderr: -467> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: crc 2024-03-04T12:35:40.177 INFO:tasks.workunit.client.0.smithi110.stderr: -466> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: crc 2024-03-04T12:35:40.177 INFO:tasks.workunit.client.0.smithi110.stderr: -465> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: secure 2024-03-04T12:35:40.178 INFO:tasks.workunit.client.0.smithi110.stderr: -464> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: crc 2024-03-04T12:35:40.178 INFO:tasks.workunit.client.0.smithi110.stderr: -463> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: secure 2024-03-04T12:35:40.178 INFO:tasks.workunit.client.0.smithi110.stderr: -462> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: crc 2024-03-04T12:35:40.178 INFO:tasks.workunit.client.0.smithi110.stderr: -461> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb83b020) adding con mode: secure 2024-03-04T12:35:40.178 INFO:tasks.workunit.client.0.smithi110.stderr: -460> 2024-03-04T12:35:39.840+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.178 INFO:tasks.workunit.client.0.smithi110.stderr: -459> 2024-03-04T12:35:39.840+0000 7ff63332b800 1 librados: starting msgr at 2024-03-04T12:35:40.178 INFO:tasks.workunit.client.0.smithi110.stderr: -458> 2024-03-04T12:35:39.840+0000 7ff63332b800 1 librados: starting objecter 2024-03-04T12:35:40.178 INFO:tasks.workunit.client.0.smithi110.stderr: -457> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command objecter_requests hook 0x556afb83daa0 2024-03-04T12:35:40.178 INFO:tasks.workunit.client.0.smithi110.stderr: -456> 2024-03-04T12:35:39.840+0000 7ff63332b800 1 librados: setting wanted keys 2024-03-04T12:35:40.178 INFO:tasks.workunit.client.0.smithi110.stderr: -455> 2024-03-04T12:35:39.840+0000 7ff63332b800 1 librados: calling monclient init 2024-03-04T12:35:40.178 INFO:tasks.workunit.client.0.smithi110.stderr: -454> 2024-03-04T12:35:39.840+0000 7ff63332b800 10 monclient: init 2024-03-04T12:35:40.178 INFO:tasks.workunit.client.0.smithi110.stderr: -453> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding auth protocol: cephx 2024-03-04T12:35:40.178 INFO:tasks.workunit.client.0.smithi110.stderr: -452> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding auth protocol: cephx 2024-03-04T12:35:40.178 INFO:tasks.workunit.client.0.smithi110.stderr: -451> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding auth protocol: cephx 2024-03-04T12:35:40.179 INFO:tasks.workunit.client.0.smithi110.stderr: -450> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: secure 2024-03-04T12:35:40.179 INFO:tasks.workunit.client.0.smithi110.stderr: -449> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: crc 2024-03-04T12:35:40.179 INFO:tasks.workunit.client.0.smithi110.stderr: -448> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: secure 2024-03-04T12:35:40.179 INFO:tasks.workunit.client.0.smithi110.stderr: -447> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: crc 2024-03-04T12:35:40.179 INFO:tasks.workunit.client.0.smithi110.stderr: -446> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: secure 2024-03-04T12:35:40.179 INFO:tasks.workunit.client.0.smithi110.stderr: -445> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: crc 2024-03-04T12:35:40.179 INFO:tasks.workunit.client.0.smithi110.stderr: -444> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: crc 2024-03-04T12:35:40.179 INFO:tasks.workunit.client.0.smithi110.stderr: -443> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: secure 2024-03-04T12:35:40.179 INFO:tasks.workunit.client.0.smithi110.stderr: -442> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: crc 2024-03-04T12:35:40.179 INFO:tasks.workunit.client.0.smithi110.stderr: -441> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: secure 2024-03-04T12:35:40.179 INFO:tasks.workunit.client.0.smithi110.stderr: -440> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: crc 2024-03-04T12:35:40.179 INFO:tasks.workunit.client.0.smithi110.stderr: -439> 2024-03-04T12:35:39.840+0000 7ff63332b800 5 AuthRegistry(0x556afb8391e0) adding con mode: secure 2024-03-04T12:35:40.179 INFO:tasks.workunit.client.0.smithi110.stderr: -438> 2024-03-04T12:35:39.841+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.179 INFO:tasks.workunit.client.0.smithi110.stderr: -437> 2024-03-04T12:35:39.841+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.180 INFO:tasks.workunit.client.0.smithi110.stderr: -436> 2024-03-04T12:35:39.841+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command rotate-key hook 0x556afb839328 2024-03-04T12:35:40.180 INFO:tasks.workunit.client.0.smithi110.stderr: -435> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient: _reopen_session rank -1 2024-03-04T12:35:40.180 INFO:tasks.workunit.client.0.smithi110.stderr: -434> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:35:40.180 INFO:tasks.workunit.client.0.smithi110.stderr: -433> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-b con 0x556afb6e5ce0 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:35:40.180 INFO:tasks.workunit.client.0.smithi110.stderr: -432> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-c con 0x556afb6ef130 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:35:40.180 INFO:tasks.workunit.client.0.smithi110.stderr: -431> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-a con 0x556afb77b340 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:35:40.180 INFO:tasks.workunit.client.0.smithi110.stderr: -430> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.180 INFO:tasks.workunit.client.0.smithi110.stderr: -429> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.180 INFO:tasks.workunit.client.0.smithi110.stderr: -428> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.180 INFO:tasks.workunit.client.0.smithi110.stderr: -427> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient(hunting): _renew_subs 2024-03-04T12:35:40.180 INFO:tasks.workunit.client.0.smithi110.stderr: -426> 2024-03-04T12:35:39.841+0000 7ff63332b800 10 monclient(hunting): authenticate will time out at 1721.200458s 2024-03-04T12:35:40.180 INFO:tasks.workunit.client.0.smithi110.stderr: -425> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient(hunting): get_auth_request con 0x556afb77b340 auth_method 0 2024-03-04T12:35:40.180 INFO:tasks.workunit.client.0.smithi110.stderr: -424> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.181 INFO:tasks.workunit.client.0.smithi110.stderr: -423> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.181 INFO:tasks.workunit.client.0.smithi110.stderr: -422> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.181 INFO:tasks.workunit.client.0.smithi110.stderr: -421> 2024-03-04T12:35:39.841+0000 7ff62e753640 10 monclient(hunting): get_auth_request con 0x556afb6ef130 auth_method 0 2024-03-04T12:35:40.181 INFO:tasks.workunit.client.0.smithi110.stderr: -420> 2024-03-04T12:35:39.841+0000 7ff62e753640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.181 INFO:tasks.workunit.client.0.smithi110.stderr: -419> 2024-03-04T12:35:39.841+0000 7ff62e753640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.181 INFO:tasks.workunit.client.0.smithi110.stderr: -418> 2024-03-04T12:35:39.841+0000 7ff62e753640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.181 INFO:tasks.workunit.client.0.smithi110.stderr: -417> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.181 INFO:tasks.workunit.client.0.smithi110.stderr: -416> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.181 INFO:tasks.workunit.client.0.smithi110.stderr: -415> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.181 INFO:tasks.workunit.client.0.smithi110.stderr: -414> 2024-03-04T12:35:39.841+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.181 INFO:tasks.workunit.client.0.smithi110.stderr: -413> 2024-03-04T12:35:39.841+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.181 INFO:tasks.workunit.client.0.smithi110.stderr: -412> 2024-03-04T12:35:39.841+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.181 INFO:tasks.workunit.client.0.smithi110.stderr: -411> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient(hunting): handle_auth_done global_id 6564 payload 824 2024-03-04T12:35:40.181 INFO:tasks.workunit.client.0.smithi110.stderr: -410> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient: _finish_hunting 0 2024-03-04T12:35:40.182 INFO:tasks.workunit.client.0.smithi110.stderr: -409> 2024-03-04T12:35:39.841+0000 7ff62f755640 1 monclient: found mon.noname-a 2024-03-04T12:35:40.182 INFO:tasks.workunit.client.0.smithi110.stderr: -408> 2024-03-04T12:35:39.841+0000 7ff62f755640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.182 INFO:tasks.workunit.client.0.smithi110.stderr: -407> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.182 INFO:tasks.workunit.client.0.smithi110.stderr: -406> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:35:40.182 INFO:tasks.workunit.client.0.smithi110.stderr: -405> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: dump: 2024-03-04T12:35:40.182 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.182 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.182 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.182 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.182 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.182 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.182 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.182 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.182 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.183 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.183 INFO:tasks.workunit.client.0.smithi110.stderr: -404> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: _finish_auth 0 2024-03-04T12:35:40.183 INFO:tasks.workunit.client.0.smithi110.stderr: -403> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: _check_auth_tickets 2024-03-04T12:35:40.183 INFO:tasks.workunit.client.0.smithi110.stderr: -402> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:40.183 INFO:tasks.workunit.client.0.smithi110.stderr: -401> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.183 INFO:tasks.workunit.client.0.smithi110.stderr: -400> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:35:40.183 INFO:tasks.workunit.client.0.smithi110.stderr: -399> 2024-03-04T12:35:39.842+0000 7ff51b606640 10 monclient: dump: 2024-03-04T12:35:40.183 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.183 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.183 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.183 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.183 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.183 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.183 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.184 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.184 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.184 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.184 INFO:tasks.workunit.client.0.smithi110.stderr: -398> 2024-03-04T12:35:39.842+0000 7ff63332b800 5 monclient: authenticate success, global_id 6564 2024-03-04T12:35:40.184 INFO:tasks.workunit.client.0.smithi110.stderr: -397> 2024-03-04T12:35:39.842+0000 7ff63332b800 10 monclient: _renew_subs 2024-03-04T12:35:40.184 INFO:tasks.workunit.client.0.smithi110.stderr: -396> 2024-03-04T12:35:39.842+0000 7ff51ce09640 4 set_mon_vals no callback set 2024-03-04T12:35:40.184 INFO:tasks.workunit.client.0.smithi110.stderr: -395> 2024-03-04T12:35:39.842+0000 7ff63332b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.184 INFO:tasks.workunit.client.0.smithi110.stderr: -394> 2024-03-04T12:35:39.842+0000 7ff63332b800 10 monclient: _renew_subs 2024-03-04T12:35:40.184 INFO:tasks.workunit.client.0.smithi110.stderr: -393> 2024-03-04T12:35:39.842+0000 7ff63332b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.184 INFO:tasks.workunit.client.0.smithi110.stderr: -392> 2024-03-04T12:35:39.842+0000 7ff63332b800 1 librados: init done 2024-03-04T12:35:40.184 INFO:tasks.workunit.client.0.smithi110.stderr: -391> 2024-03-04T12:35:39.843+0000 7ff51b606640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:35:40.184 INFO:tasks.workunit.client.0.smithi110.stderr: -390> 2024-03-04T12:35:39.843+0000 7ff51b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:40.184 INFO:tasks.workunit.client.0.smithi110.stderr: -389> 2024-03-04T12:35:39.843+0000 7ff51b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:40.184 INFO:tasks.workunit.client.0.smithi110.stderr: -388> 2024-03-04T12:35:39.844+0000 7ff62ef54640 10 monclient: get_auth_request con 0x7ff514069eb0 auth_method 0 2024-03-04T12:35:40.185 INFO:tasks.workunit.client.0.smithi110.stderr: -387> 2024-03-04T12:35:39.844+0000 7ff62e753640 10 monclient: get_auth_request con 0x556afb842b30 auth_method 0 2024-03-04T12:35:40.185 INFO:tasks.workunit.client.0.smithi110.stderr: -386> 2024-03-04T12:35:39.844+0000 7ff62ef54640 10 monclient: get_auth_request con 0x556afb884950 auth_method 0 2024-03-04T12:35:40.185 INFO:tasks.workunit.client.0.smithi110.stderr: -385> 2024-03-04T12:35:39.846+0000 7ff62e753640 10 monclient: get_auth_request con 0x556afb8899e0 auth_method 0 2024-03-04T12:35:40.185 INFO:tasks.workunit.client.0.smithi110.stderr: -384> 2024-03-04T12:35:39.846+0000 7ff63332b800 10 monclient: build_initial_monmap 2024-03-04T12:35:40.185 INFO:tasks.workunit.client.0.smithi110.stderr: -383> 2024-03-04T12:35:39.846+0000 7ff63332b800 1 build_initial for_mkfs: 0 2024-03-04T12:35:40.185 INFO:tasks.workunit.client.0.smithi110.stderr: -382> 2024-03-04T12:35:39.846+0000 7ff63332b800 10 monclient: monmap: 2024-03-04T12:35:40.185 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:35:40.185 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:35:40.185 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:35:40.185 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:35:40.185 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:35:40.185 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.185 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:35:40.185 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:35:40.185 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:35:40.185 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.186 INFO:tasks.workunit.client.0.smithi110.stderr: -381> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding auth protocol: cephx 2024-03-04T12:35:40.186 INFO:tasks.workunit.client.0.smithi110.stderr: -380> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding auth protocol: cephx 2024-03-04T12:35:40.186 INFO:tasks.workunit.client.0.smithi110.stderr: -379> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding auth protocol: cephx 2024-03-04T12:35:40.186 INFO:tasks.workunit.client.0.smithi110.stderr: -378> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: secure 2024-03-04T12:35:40.186 INFO:tasks.workunit.client.0.smithi110.stderr: -377> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: crc 2024-03-04T12:35:40.186 INFO:tasks.workunit.client.0.smithi110.stderr: -376> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: secure 2024-03-04T12:35:40.186 INFO:tasks.workunit.client.0.smithi110.stderr: -375> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: crc 2024-03-04T12:35:40.186 INFO:tasks.workunit.client.0.smithi110.stderr: -374> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: secure 2024-03-04T12:35:40.186 INFO:tasks.workunit.client.0.smithi110.stderr: -373> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: crc 2024-03-04T12:35:40.186 INFO:tasks.workunit.client.0.smithi110.stderr: -372> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: crc 2024-03-04T12:35:40.186 INFO:tasks.workunit.client.0.smithi110.stderr: -371> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: secure 2024-03-04T12:35:40.186 INFO:tasks.workunit.client.0.smithi110.stderr: -370> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: crc 2024-03-04T12:35:40.186 INFO:tasks.workunit.client.0.smithi110.stderr: -369> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: secure 2024-03-04T12:35:40.186 INFO:tasks.workunit.client.0.smithi110.stderr: -368> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: crc 2024-03-04T12:35:40.187 INFO:tasks.workunit.client.0.smithi110.stderr: -367> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88d6d0) adding con mode: secure 2024-03-04T12:35:40.187 INFO:tasks.workunit.client.0.smithi110.stderr: -366> 2024-03-04T12:35:39.847+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.187 INFO:tasks.workunit.client.0.smithi110.stderr: -365> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command objecter_requests cmddesc objecter_requests hook 0x556afb891370 EEXIST 2024-03-04T12:35:40.187 INFO:tasks.workunit.client.0.smithi110.stderr: -364> 2024-03-04T12:35:39.847+0000 7ff63332b800 10 monclient: init 2024-03-04T12:35:40.187 INFO:tasks.workunit.client.0.smithi110.stderr: -363> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding auth protocol: cephx 2024-03-04T12:35:40.187 INFO:tasks.workunit.client.0.smithi110.stderr: -362> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding auth protocol: cephx 2024-03-04T12:35:40.187 INFO:tasks.workunit.client.0.smithi110.stderr: -361> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding auth protocol: cephx 2024-03-04T12:35:40.187 INFO:tasks.workunit.client.0.smithi110.stderr: -360> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: secure 2024-03-04T12:35:40.187 INFO:tasks.workunit.client.0.smithi110.stderr: -359> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: crc 2024-03-04T12:35:40.187 INFO:tasks.workunit.client.0.smithi110.stderr: -358> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: secure 2024-03-04T12:35:40.187 INFO:tasks.workunit.client.0.smithi110.stderr: -357> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: crc 2024-03-04T12:35:40.187 INFO:tasks.workunit.client.0.smithi110.stderr: -356> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: secure 2024-03-04T12:35:40.187 INFO:tasks.workunit.client.0.smithi110.stderr: -355> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: crc 2024-03-04T12:35:40.187 INFO:tasks.workunit.client.0.smithi110.stderr: -354> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: crc 2024-03-04T12:35:40.187 INFO:tasks.workunit.client.0.smithi110.stderr: -353> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: secure 2024-03-04T12:35:40.188 INFO:tasks.workunit.client.0.smithi110.stderr: -352> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: crc 2024-03-04T12:35:40.188 INFO:tasks.workunit.client.0.smithi110.stderr: -351> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: secure 2024-03-04T12:35:40.188 INFO:tasks.workunit.client.0.smithi110.stderr: -350> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: crc 2024-03-04T12:35:40.188 INFO:tasks.workunit.client.0.smithi110.stderr: -349> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 AuthRegistry(0x556afb88c758) adding con mode: secure 2024-03-04T12:35:40.188 INFO:tasks.workunit.client.0.smithi110.stderr: -348> 2024-03-04T12:35:39.847+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.188 INFO:tasks.workunit.client.0.smithi110.stderr: -347> 2024-03-04T12:35:39.847+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.188 INFO:tasks.workunit.client.0.smithi110.stderr: -346> 2024-03-04T12:35:39.847+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command rotate-key cmddesc rotate-key hook 0x556afb88c8a0 EEXIST 2024-03-04T12:35:40.188 INFO:tasks.workunit.client.0.smithi110.stderr: -345> 2024-03-04T12:35:39.847+0000 7ff63332b800 10 monclient: _reopen_session rank -1 2024-03-04T12:35:40.188 INFO:tasks.workunit.client.0.smithi110.stderr: -344> 2024-03-04T12:35:39.847+0000 7ff63332b800 10 monclient: _add_conns ranks=[2,0,1] 2024-03-04T12:35:40.188 INFO:tasks.workunit.client.0.smithi110.stderr: -343> 2024-03-04T12:35:39.847+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-c con 0x556afb8b7ba0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:35:40.188 INFO:tasks.workunit.client.0.smithi110.stderr: -342> 2024-03-04T12:35:39.847+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-a con 0x556afb8b7f80 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:35:40.188 INFO:tasks.workunit.client.0.smithi110.stderr: -341> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-b con 0x556afb8ca930 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:35:40.188 INFO:tasks.workunit.client.0.smithi110.stderr: -340> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.189 INFO:tasks.workunit.client.0.smithi110.stderr: -339> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.189 INFO:tasks.workunit.client.0.smithi110.stderr: -338> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.189 INFO:tasks.workunit.client.0.smithi110.stderr: -337> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient(hunting): _renew_subs 2024-03-04T12:35:40.189 INFO:tasks.workunit.client.0.smithi110.stderr: -336> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient(hunting): authenticate will time out at 1721.207016s 2024-03-04T12:35:40.189 INFO:tasks.workunit.client.0.smithi110.stderr: -335> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient(hunting): get_auth_request con 0x556afb8b7f80 auth_method 0 2024-03-04T12:35:40.189 INFO:tasks.workunit.client.0.smithi110.stderr: -334> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.189 INFO:tasks.workunit.client.0.smithi110.stderr: -333> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.189 INFO:tasks.workunit.client.0.smithi110.stderr: -332> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.189 INFO:tasks.workunit.client.0.smithi110.stderr: -331> 2024-03-04T12:35:39.848+0000 7ff62ef54640 10 monclient(hunting): get_auth_request con 0x556afb8b7ba0 auth_method 0 2024-03-04T12:35:40.189 INFO:tasks.workunit.client.0.smithi110.stderr: -330> 2024-03-04T12:35:39.848+0000 7ff62ef54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.189 INFO:tasks.workunit.client.0.smithi110.stderr: -329> 2024-03-04T12:35:39.848+0000 7ff62ef54640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.189 INFO:tasks.workunit.client.0.smithi110.stderr: -328> 2024-03-04T12:35:39.848+0000 7ff62ef54640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.189 INFO:tasks.workunit.client.0.smithi110.stderr: -327> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.189 INFO:tasks.workunit.client.0.smithi110.stderr: -326> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.189 INFO:tasks.workunit.client.0.smithi110.stderr: -325> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.190 INFO:tasks.workunit.client.0.smithi110.stderr: -324> 2024-03-04T12:35:39.848+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.190 INFO:tasks.workunit.client.0.smithi110.stderr: -323> 2024-03-04T12:35:39.848+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.190 INFO:tasks.workunit.client.0.smithi110.stderr: -322> 2024-03-04T12:35:39.848+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.190 INFO:tasks.workunit.client.0.smithi110.stderr: -321> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient(hunting): handle_auth_done global_id 6567 payload 824 2024-03-04T12:35:40.190 INFO:tasks.workunit.client.0.smithi110.stderr: -320> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient: _finish_hunting 0 2024-03-04T12:35:40.190 INFO:tasks.workunit.client.0.smithi110.stderr: -319> 2024-03-04T12:35:39.848+0000 7ff62e753640 1 monclient: found mon.noname-a 2024-03-04T12:35:40.190 INFO:tasks.workunit.client.0.smithi110.stderr: -318> 2024-03-04T12:35:39.848+0000 7ff62e753640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.190 INFO:tasks.workunit.client.0.smithi110.stderr: -317> 2024-03-04T12:35:39.848+0000 7ff62f755640 10 monclient: get_auth_request con 0x556afb8ca930 auth_method 0 2024-03-04T12:35:40.190 INFO:tasks.workunit.client.0.smithi110.stderr: -316> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.190 INFO:tasks.workunit.client.0.smithi110.stderr: -315> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:35:40.190 INFO:tasks.workunit.client.0.smithi110.stderr: -314> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: dump: 2024-03-04T12:35:40.190 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.190 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.190 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.191 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.191 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.191 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.191 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.191 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.191 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.191 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.191 INFO:tasks.workunit.client.0.smithi110.stderr: -313> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: _finish_auth 0 2024-03-04T12:35:40.191 INFO:tasks.workunit.client.0.smithi110.stderr: -312> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: _check_auth_tickets 2024-03-04T12:35:40.191 INFO:tasks.workunit.client.0.smithi110.stderr: -311> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:40.191 INFO:tasks.workunit.client.0.smithi110.stderr: -310> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.191 INFO:tasks.workunit.client.0.smithi110.stderr: -309> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:35:40.191 INFO:tasks.workunit.client.0.smithi110.stderr: -308> 2024-03-04T12:35:39.848+0000 7ff518e01640 10 monclient: dump: 2024-03-04T12:35:40.191 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.191 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.192 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.192 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.192 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.192 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.192 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.192 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.192 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.192 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.192 INFO:tasks.workunit.client.0.smithi110.stderr: -307> 2024-03-04T12:35:39.848+0000 7ff63332b800 5 monclient: authenticate success, global_id 6567 2024-03-04T12:35:40.192 INFO:tasks.workunit.client.0.smithi110.stderr: -306> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient: _renew_subs 2024-03-04T12:35:40.192 INFO:tasks.workunit.client.0.smithi110.stderr: -305> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.192 INFO:tasks.workunit.client.0.smithi110.stderr: -304> 2024-03-04T12:35:39.848+0000 7ff62ff56640 4 set_mon_vals no callback set 2024-03-04T12:35:40.192 INFO:tasks.workunit.client.0.smithi110.stderr: -303> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient: _renew_subs 2024-03-04T12:35:40.193 INFO:tasks.workunit.client.0.smithi110.stderr: -302> 2024-03-04T12:35:39.848+0000 7ff63332b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.193 INFO:tasks.workunit.client.0.smithi110.stderr: -301> 2024-03-04T12:35:39.850+0000 7ff518e01640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:35:40.193 INFO:tasks.workunit.client.0.smithi110.stderr: -300> 2024-03-04T12:35:39.850+0000 7ff518e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:40.193 INFO:tasks.workunit.client.0.smithi110.stderr: -299> 2024-03-04T12:35:39.850+0000 7ff518e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:40.193 INFO:tasks.workunit.client.0.smithi110.stderr: -298> 2024-03-04T12:35:39.850+0000 7ff63332b800 10 monclient: get_monmap_and_config 2024-03-04T12:35:40.193 INFO:tasks.workunit.client.0.smithi110.stderr: -297> 2024-03-04T12:35:39.850+0000 7ff63332b800 10 monclient: build_initial_monmap 2024-03-04T12:35:40.193 INFO:tasks.workunit.client.0.smithi110.stderr: -296> 2024-03-04T12:35:39.850+0000 7ff63332b800 1 build_initial for_mkfs: 0 2024-03-04T12:35:40.193 INFO:tasks.workunit.client.0.smithi110.stderr: -295> 2024-03-04T12:35:39.850+0000 7ff63332b800 10 monclient: monmap: 2024-03-04T12:35:40.193 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:35:40.193 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:35:40.193 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:35:40.193 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:35:40.193 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:35:40.193 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.194 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:35:40.194 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:35:40.194 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:35:40.194 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.194 INFO:tasks.workunit.client.0.smithi110.stderr: -294> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding auth protocol: cephx 2024-03-04T12:35:40.194 INFO:tasks.workunit.client.0.smithi110.stderr: -293> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding auth protocol: cephx 2024-03-04T12:35:40.194 INFO:tasks.workunit.client.0.smithi110.stderr: -292> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding auth protocol: cephx 2024-03-04T12:35:40.194 INFO:tasks.workunit.client.0.smithi110.stderr: -291> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: secure 2024-03-04T12:35:40.194 INFO:tasks.workunit.client.0.smithi110.stderr: -290> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: crc 2024-03-04T12:35:40.194 INFO:tasks.workunit.client.0.smithi110.stderr: -289> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: secure 2024-03-04T12:35:40.194 INFO:tasks.workunit.client.0.smithi110.stderr: -288> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: crc 2024-03-04T12:35:40.194 INFO:tasks.workunit.client.0.smithi110.stderr: -287> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: secure 2024-03-04T12:35:40.194 INFO:tasks.workunit.client.0.smithi110.stderr: -286> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: crc 2024-03-04T12:35:40.194 INFO:tasks.workunit.client.0.smithi110.stderr: -285> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: crc 2024-03-04T12:35:40.194 INFO:tasks.workunit.client.0.smithi110.stderr: -284> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: secure 2024-03-04T12:35:40.195 INFO:tasks.workunit.client.0.smithi110.stderr: -283> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: crc 2024-03-04T12:35:40.195 INFO:tasks.workunit.client.0.smithi110.stderr: -282> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: secure 2024-03-04T12:35:40.195 INFO:tasks.workunit.client.0.smithi110.stderr: -281> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: crc 2024-03-04T12:35:40.195 INFO:tasks.workunit.client.0.smithi110.stderr: -280> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5660) adding con mode: secure 2024-03-04T12:35:40.195 INFO:tasks.workunit.client.0.smithi110.stderr: -279> 2024-03-04T12:35:39.850+0000 7ff62ef54640 10 monclient: get_auth_request con 0x7ff508069df0 auth_method 0 2024-03-04T12:35:40.195 INFO:tasks.workunit.client.0.smithi110.stderr: -278> 2024-03-04T12:35:39.850+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.195 INFO:tasks.workunit.client.0.smithi110.stderr: -277> 2024-03-04T12:35:39.850+0000 7ff63332b800 10 monclient: init 2024-03-04T12:35:40.195 INFO:tasks.workunit.client.0.smithi110.stderr: -276> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding auth protocol: cephx 2024-03-04T12:35:40.195 INFO:tasks.workunit.client.0.smithi110.stderr: -275> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding auth protocol: cephx 2024-03-04T12:35:40.195 INFO:tasks.workunit.client.0.smithi110.stderr: -274> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding auth protocol: cephx 2024-03-04T12:35:40.195 INFO:tasks.workunit.client.0.smithi110.stderr: -273> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: secure 2024-03-04T12:35:40.195 INFO:tasks.workunit.client.0.smithi110.stderr: -272> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: crc 2024-03-04T12:35:40.195 INFO:tasks.workunit.client.0.smithi110.stderr: -271> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: secure 2024-03-04T12:35:40.195 INFO:tasks.workunit.client.0.smithi110.stderr: -270> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: crc 2024-03-04T12:35:40.196 INFO:tasks.workunit.client.0.smithi110.stderr: -269> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: secure 2024-03-04T12:35:40.196 INFO:tasks.workunit.client.0.smithi110.stderr: -268> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: crc 2024-03-04T12:35:40.196 INFO:tasks.workunit.client.0.smithi110.stderr: -267> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: crc 2024-03-04T12:35:40.196 INFO:tasks.workunit.client.0.smithi110.stderr: -266> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: secure 2024-03-04T12:35:40.196 INFO:tasks.workunit.client.0.smithi110.stderr: -265> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: crc 2024-03-04T12:35:40.196 INFO:tasks.workunit.client.0.smithi110.stderr: -264> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: secure 2024-03-04T12:35:40.196 INFO:tasks.workunit.client.0.smithi110.stderr: -263> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: crc 2024-03-04T12:35:40.196 INFO:tasks.workunit.client.0.smithi110.stderr: -262> 2024-03-04T12:35:39.850+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f3ce0) adding con mode: secure 2024-03-04T12:35:40.196 INFO:tasks.workunit.client.0.smithi110.stderr: -261> 2024-03-04T12:35:39.851+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.196 INFO:tasks.workunit.client.0.smithi110.stderr: -260> 2024-03-04T12:35:39.851+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.196 INFO:tasks.workunit.client.0.smithi110.stderr: -259> 2024-03-04T12:35:39.851+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command rotate-key cmddesc rotate-key hook 0x7ffd944f3e28 EEXIST 2024-03-04T12:35:40.196 INFO:tasks.workunit.client.0.smithi110.stderr: -258> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient: _reopen_session rank -1 2024-03-04T12:35:40.196 INFO:tasks.workunit.client.0.smithi110.stderr: -257> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-04T12:35:40.196 INFO:tasks.workunit.client.0.smithi110.stderr: -256> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-b con 0x556afb90a1a0 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:35:40.197 INFO:tasks.workunit.client.0.smithi110.stderr: -255> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-a con 0x556afb8fbf60 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:35:40.197 INFO:tasks.workunit.client.0.smithi110.stderr: -254> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-c con 0x556afb8fcc70 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:35:40.197 INFO:tasks.workunit.client.0.smithi110.stderr: -253> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.197 INFO:tasks.workunit.client.0.smithi110.stderr: -252> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.197 INFO:tasks.workunit.client.0.smithi110.stderr: -251> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.197 INFO:tasks.workunit.client.0.smithi110.stderr: -250> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient(hunting): _renew_subs 2024-03-04T12:35:40.197 INFO:tasks.workunit.client.0.smithi110.stderr: -249> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient(hunting): authenticate will time out at 1721.210311s 2024-03-04T12:35:40.197 INFO:tasks.workunit.client.0.smithi110.stderr: -248> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient(hunting): get_auth_request con 0x556afb8fbf60 auth_method 0 2024-03-04T12:35:40.197 INFO:tasks.workunit.client.0.smithi110.stderr: -247> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.197 INFO:tasks.workunit.client.0.smithi110.stderr: -246> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.197 INFO:tasks.workunit.client.0.smithi110.stderr: -245> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.197 INFO:tasks.workunit.client.0.smithi110.stderr: -244> 2024-03-04T12:35:39.851+0000 7ff62f755640 10 monclient(hunting): get_auth_request con 0x556afb8fcc70 auth_method 0 2024-03-04T12:35:40.197 INFO:tasks.workunit.client.0.smithi110.stderr: -243> 2024-03-04T12:35:39.851+0000 7ff62f755640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.197 INFO:tasks.workunit.client.0.smithi110.stderr: -242> 2024-03-04T12:35:39.851+0000 7ff62f755640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.197 INFO:tasks.workunit.client.0.smithi110.stderr: -241> 2024-03-04T12:35:39.851+0000 7ff62f755640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.198 INFO:tasks.workunit.client.0.smithi110.stderr: -240> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.198 INFO:tasks.workunit.client.0.smithi110.stderr: -239> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.198 INFO:tasks.workunit.client.0.smithi110.stderr: -238> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.198 INFO:tasks.workunit.client.0.smithi110.stderr: -237> 2024-03-04T12:35:39.851+0000 7ff62f755640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.198 INFO:tasks.workunit.client.0.smithi110.stderr: -236> 2024-03-04T12:35:39.851+0000 7ff62f755640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.198 INFO:tasks.workunit.client.0.smithi110.stderr: -235> 2024-03-04T12:35:39.851+0000 7ff62f755640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.198 INFO:tasks.workunit.client.0.smithi110.stderr: -234> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient(hunting): handle_auth_done global_id 6570 payload 274 2024-03-04T12:35:40.198 INFO:tasks.workunit.client.0.smithi110.stderr: -233> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient: _finish_hunting 0 2024-03-04T12:35:40.198 INFO:tasks.workunit.client.0.smithi110.stderr: -232> 2024-03-04T12:35:39.851+0000 7ff62e753640 1 monclient: found mon.noname-a 2024-03-04T12:35:40.198 INFO:tasks.workunit.client.0.smithi110.stderr: -231> 2024-03-04T12:35:39.851+0000 7ff62e753640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.198 INFO:tasks.workunit.client.0.smithi110.stderr: -230> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.198 INFO:tasks.workunit.client.0.smithi110.stderr: -229> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:35:40.198 INFO:tasks.workunit.client.0.smithi110.stderr: -228> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: dump: 2024-03-04T12:35:40.199 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.199 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.199 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.199 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.199 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.199 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.199 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.199 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.199 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.199 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.199 INFO:tasks.workunit.client.0.smithi110.stderr: -227> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: _finish_auth 0 2024-03-04T12:35:40.199 INFO:tasks.workunit.client.0.smithi110.stderr: -226> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: _check_auth_tickets 2024-03-04T12:35:40.199 INFO:tasks.workunit.client.0.smithi110.stderr: -225> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:40.199 INFO:tasks.workunit.client.0.smithi110.stderr: -224> 2024-03-04T12:35:39.851+0000 7ff63332b800 5 monclient: authenticate success, global_id 6570 2024-03-04T12:35:40.200 INFO:tasks.workunit.client.0.smithi110.stderr: -223> 2024-03-04T12:35:39.851+0000 7ff63332b800 10 monclient: get_monmap_and_config success 2024-03-04T12:35:40.200 INFO:tasks.workunit.client.0.smithi110.stderr: -222> 2024-03-04T12:35:39.851+0000 7ff63332b800 4 set_mon_vals no callback set 2024-03-04T12:35:40.200 INFO:tasks.workunit.client.0.smithi110.stderr: -221> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.200 INFO:tasks.workunit.client.0.smithi110.stderr: -220> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:35:40.200 INFO:tasks.workunit.client.0.smithi110.stderr: -219> 2024-03-04T12:35:39.851+0000 7ff5127fc640 10 monclient: dump: 2024-03-04T12:35:40.200 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.200 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.200 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.200 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.200 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.200 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.200 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.200 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.200 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.200 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.201 INFO:tasks.workunit.client.0.smithi110.stderr: -218> 2024-03-04T12:35:39.852+0000 7ff63332b800 10 monclient: shutdown 2024-03-04T12:35:40.201 INFO:tasks.workunit.client.0.smithi110.stderr: -217> 2024-03-04T12:35:39.852+0000 7ff63332b800 10 monclient: build_initial_monmap 2024-03-04T12:35:40.201 INFO:tasks.workunit.client.0.smithi110.stderr: -216> 2024-03-04T12:35:39.852+0000 7ff63332b800 1 build_initial for_mkfs: 0 2024-03-04T12:35:40.201 INFO:tasks.workunit.client.0.smithi110.stderr: -215> 2024-03-04T12:35:39.852+0000 7ff63332b800 10 monclient: monmap: 2024-03-04T12:35:40.201 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:35:40.201 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:35:40.201 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:35:40.201 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:35:40.201 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:35:40.201 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.201 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:35:40.201 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:35:40.201 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:35:40.201 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.202 INFO:tasks.workunit.client.0.smithi110.stderr: -214> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding auth protocol: cephx 2024-03-04T12:35:40.202 INFO:tasks.workunit.client.0.smithi110.stderr: -213> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding auth protocol: cephx 2024-03-04T12:35:40.202 INFO:tasks.workunit.client.0.smithi110.stderr: -212> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding auth protocol: cephx 2024-03-04T12:35:40.202 INFO:tasks.workunit.client.0.smithi110.stderr: -211> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: secure 2024-03-04T12:35:40.202 INFO:tasks.workunit.client.0.smithi110.stderr: -210> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: crc 2024-03-04T12:35:40.202 INFO:tasks.workunit.client.0.smithi110.stderr: -209> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: secure 2024-03-04T12:35:40.202 INFO:tasks.workunit.client.0.smithi110.stderr: -208> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: crc 2024-03-04T12:35:40.202 INFO:tasks.workunit.client.0.smithi110.stderr: -207> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: secure 2024-03-04T12:35:40.202 INFO:tasks.workunit.client.0.smithi110.stderr: -206> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: crc 2024-03-04T12:35:40.202 INFO:tasks.workunit.client.0.smithi110.stderr: -205> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: crc 2024-03-04T12:35:40.202 INFO:tasks.workunit.client.0.smithi110.stderr: -204> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: secure 2024-03-04T12:35:40.202 INFO:tasks.workunit.client.0.smithi110.stderr: -203> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: crc 2024-03-04T12:35:40.203 INFO:tasks.workunit.client.0.smithi110.stderr: -202> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: secure 2024-03-04T12:35:40.203 INFO:tasks.workunit.client.0.smithi110.stderr: -201> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: crc 2024-03-04T12:35:40.203 INFO:tasks.workunit.client.0.smithi110.stderr: -200> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8d5610) adding con mode: secure 2024-03-04T12:35:40.203 INFO:tasks.workunit.client.0.smithi110.stderr: -199> 2024-03-04T12:35:39.852+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.203 INFO:tasks.workunit.client.0.smithi110.stderr: -198> 2024-03-04T12:35:39.852+0000 7ff63332b800 1 librados: starting msgr at 2024-03-04T12:35:40.203 INFO:tasks.workunit.client.0.smithi110.stderr: -197> 2024-03-04T12:35:39.852+0000 7ff63332b800 1 librados: starting objecter 2024-03-04T12:35:40.203 INFO:tasks.workunit.client.0.smithi110.stderr: -196> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command objecter_requests cmddesc objecter_requests hook 0x556afb8cad10 EEXIST 2024-03-04T12:35:40.203 INFO:tasks.workunit.client.0.smithi110.stderr: -195> 2024-03-04T12:35:39.852+0000 7ff63332b800 1 librados: setting wanted keys 2024-03-04T12:35:40.203 INFO:tasks.workunit.client.0.smithi110.stderr: -194> 2024-03-04T12:35:39.852+0000 7ff63332b800 1 librados: calling monclient init 2024-03-04T12:35:40.203 INFO:tasks.workunit.client.0.smithi110.stderr: -193> 2024-03-04T12:35:39.852+0000 7ff63332b800 10 monclient: init 2024-03-04T12:35:40.203 INFO:tasks.workunit.client.0.smithi110.stderr: -192> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding auth protocol: cephx 2024-03-04T12:35:40.203 INFO:tasks.workunit.client.0.smithi110.stderr: -191> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding auth protocol: cephx 2024-03-04T12:35:40.203 INFO:tasks.workunit.client.0.smithi110.stderr: -190> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding auth protocol: cephx 2024-03-04T12:35:40.204 INFO:tasks.workunit.client.0.smithi110.stderr: -189> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: secure 2024-03-04T12:35:40.204 INFO:tasks.workunit.client.0.smithi110.stderr: -188> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: crc 2024-03-04T12:35:40.204 INFO:tasks.workunit.client.0.smithi110.stderr: -187> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: secure 2024-03-04T12:35:40.204 INFO:tasks.workunit.client.0.smithi110.stderr: -186> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: crc 2024-03-04T12:35:40.204 INFO:tasks.workunit.client.0.smithi110.stderr: -185> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: secure 2024-03-04T12:35:40.204 INFO:tasks.workunit.client.0.smithi110.stderr: -184> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: crc 2024-03-04T12:35:40.204 INFO:tasks.workunit.client.0.smithi110.stderr: -183> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: crc 2024-03-04T12:35:40.204 INFO:tasks.workunit.client.0.smithi110.stderr: -182> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: secure 2024-03-04T12:35:40.204 INFO:tasks.workunit.client.0.smithi110.stderr: -181> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: crc 2024-03-04T12:35:40.204 INFO:tasks.workunit.client.0.smithi110.stderr: -180> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: secure 2024-03-04T12:35:40.204 INFO:tasks.workunit.client.0.smithi110.stderr: -179> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: crc 2024-03-04T12:35:40.204 INFO:tasks.workunit.client.0.smithi110.stderr: -178> 2024-03-04T12:35:39.852+0000 7ff63332b800 5 AuthRegistry(0x556afb8cd540) adding con mode: secure 2024-03-04T12:35:40.204 INFO:tasks.workunit.client.0.smithi110.stderr: -177> 2024-03-04T12:35:39.853+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.204 INFO:tasks.workunit.client.0.smithi110.stderr: -176> 2024-03-04T12:35:39.853+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.205 INFO:tasks.workunit.client.0.smithi110.stderr: -175> 2024-03-04T12:35:39.853+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command rotate-key cmddesc rotate-key hook 0x556afb8cd688 EEXIST 2024-03-04T12:35:40.205 INFO:tasks.workunit.client.0.smithi110.stderr: -174> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient: _reopen_session rank -1 2024-03-04T12:35:40.205 INFO:tasks.workunit.client.0.smithi110.stderr: -173> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient: _add_conns ranks=[0,2,1] 2024-03-04T12:35:40.205 INFO:tasks.workunit.client.0.smithi110.stderr: -172> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-a con 0x556afb8fbf60 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:35:40.205 INFO:tasks.workunit.client.0.smithi110.stderr: -171> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-c con 0x556afb8fcc70 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:35:40.205 INFO:tasks.workunit.client.0.smithi110.stderr: -170> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient(hunting): picked mon.noname-b con 0x556afb90a1a0 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:35:40.205 INFO:tasks.workunit.client.0.smithi110.stderr: -169> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.205 INFO:tasks.workunit.client.0.smithi110.stderr: -168> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.205 INFO:tasks.workunit.client.0.smithi110.stderr: -167> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient(hunting): start opening mon connection 2024-03-04T12:35:40.205 INFO:tasks.workunit.client.0.smithi110.stderr: -166> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient(hunting): _renew_subs 2024-03-04T12:35:40.205 INFO:tasks.workunit.client.0.smithi110.stderr: -165> 2024-03-04T12:35:39.853+0000 7ff63332b800 10 monclient(hunting): authenticate will time out at 1721.212396s 2024-03-04T12:35:40.205 INFO:tasks.workunit.client.0.smithi110.stderr: -164> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient(hunting): get_auth_request con 0x556afb8fbf60 auth_method 0 2024-03-04T12:35:40.205 INFO:tasks.workunit.client.0.smithi110.stderr: -163> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.205 INFO:tasks.workunit.client.0.smithi110.stderr: -162> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.205 INFO:tasks.workunit.client.0.smithi110.stderr: -161> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.206 INFO:tasks.workunit.client.0.smithi110.stderr: -160> 2024-03-04T12:35:39.853+0000 7ff62e753640 10 monclient(hunting): get_auth_request con 0x556afb8fcc70 auth_method 0 2024-03-04T12:35:40.206 INFO:tasks.workunit.client.0.smithi110.stderr: -159> 2024-03-04T12:35:39.853+0000 7ff62e753640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.206 INFO:tasks.workunit.client.0.smithi110.stderr: -158> 2024-03-04T12:35:39.853+0000 7ff62e753640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.206 INFO:tasks.workunit.client.0.smithi110.stderr: -157> 2024-03-04T12:35:39.853+0000 7ff62e753640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.206 INFO:tasks.workunit.client.0.smithi110.stderr: -156> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.206 INFO:tasks.workunit.client.0.smithi110.stderr: -155> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.206 INFO:tasks.workunit.client.0.smithi110.stderr: -154> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.206 INFO:tasks.workunit.client.0.smithi110.stderr: -153> 2024-03-04T12:35:39.853+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:35:40.206 INFO:tasks.workunit.client.0.smithi110.stderr: -152> 2024-03-04T12:35:39.853+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:35:40.206 INFO:tasks.workunit.client.0.smithi110.stderr: -151> 2024-03-04T12:35:39.853+0000 7ff62e753640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:35:40.206 INFO:tasks.workunit.client.0.smithi110.stderr: -150> 2024-03-04T12:35:39.853+0000 7ff62f755640 10 monclient(hunting): get_auth_request con 0x556afb90a1a0 auth_method 0 2024-03-04T12:35:40.206 INFO:tasks.workunit.client.0.smithi110.stderr: -149> 2024-03-04T12:35:39.853+0000 7ff62f755640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:35:40.206 INFO:tasks.workunit.client.0.smithi110.stderr: -148> 2024-03-04T12:35:39.853+0000 7ff62f755640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:35:40.206 INFO:tasks.workunit.client.0.smithi110.stderr: -147> 2024-03-04T12:35:39.853+0000 7ff62f755640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:35:40.207 INFO:tasks.workunit.client.0.smithi110.stderr: -146> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient(hunting): handle_auth_done global_id 6573 payload 824 2024-03-04T12:35:40.207 INFO:tasks.workunit.client.0.smithi110.stderr: -145> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient: _finish_hunting 0 2024-03-04T12:35:40.207 INFO:tasks.workunit.client.0.smithi110.stderr: -144> 2024-03-04T12:35:39.853+0000 7ff62ef54640 1 monclient: found mon.noname-a 2024-03-04T12:35:40.207 INFO:tasks.workunit.client.0.smithi110.stderr: -143> 2024-03-04T12:35:39.853+0000 7ff62ef54640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.207 INFO:tasks.workunit.client.0.smithi110.stderr: -142> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.207 INFO:tasks.workunit.client.0.smithi110.stderr: -141> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:35:40.207 INFO:tasks.workunit.client.0.smithi110.stderr: -140> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: dump: 2024-03-04T12:35:40.207 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.207 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.207 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.207 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.207 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.207 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.207 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.207 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.208 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.208 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.208 INFO:tasks.workunit.client.0.smithi110.stderr: -139> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: _finish_auth 0 2024-03-04T12:35:40.208 INFO:tasks.workunit.client.0.smithi110.stderr: -138> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: _check_auth_tickets 2024-03-04T12:35:40.208 INFO:tasks.workunit.client.0.smithi110.stderr: -137> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:35:40.208 INFO:tasks.workunit.client.0.smithi110.stderr: -136> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:35:40.208 INFO:tasks.workunit.client.0.smithi110.stderr: -135> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:35:40.208 INFO:tasks.workunit.client.0.smithi110.stderr: -134> 2024-03-04T12:35:39.853+0000 7ff510ff9640 10 monclient: dump: 2024-03-04T12:35:40.208 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:35:40.208 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:35:40.208 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.208 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:35:40.208 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:35:40.208 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:35:40.209 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:35:40.209 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:35:40.209 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:35:40.209 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.209 INFO:tasks.workunit.client.0.smithi110.stderr: -133> 2024-03-04T12:35:39.853+0000 7ff63332b800 5 monclient: authenticate success, global_id 6573 2024-03-04T12:35:40.209 INFO:tasks.workunit.client.0.smithi110.stderr: -132> 2024-03-04T12:35:39.854+0000 7ff63332b800 10 monclient: _renew_subs 2024-03-04T12:35:40.209 INFO:tasks.workunit.client.0.smithi110.stderr: -131> 2024-03-04T12:35:39.853+0000 7ff5127fc640 4 set_mon_vals no callback set 2024-03-04T12:35:40.209 INFO:tasks.workunit.client.0.smithi110.stderr: -130> 2024-03-04T12:35:39.854+0000 7ff63332b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.209 INFO:tasks.workunit.client.0.smithi110.stderr: -129> 2024-03-04T12:35:39.854+0000 7ff63332b800 10 monclient: _renew_subs 2024-03-04T12:35:40.209 INFO:tasks.workunit.client.0.smithi110.stderr: -128> 2024-03-04T12:35:39.854+0000 7ff63332b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.209 INFO:tasks.workunit.client.0.smithi110.stderr: -127> 2024-03-04T12:35:39.854+0000 7ff63332b800 1 librados: init done 2024-03-04T12:35:40.209 INFO:tasks.workunit.client.0.smithi110.stderr: -126> 2024-03-04T12:35:39.854+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command cr dump hook 0x556afb918118 2024-03-04T12:35:40.209 INFO:tasks.workunit.client.0.smithi110.stderr: -125> 2024-03-04T12:35:39.855+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.209 INFO:tasks.workunit.client.0.smithi110.stderr: -124> 2024-03-04T12:35:39.855+0000 7ff510ff9640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:35:40.209 INFO:tasks.workunit.client.0.smithi110.stderr: -123> 2024-03-04T12:35:39.855+0000 7ff510ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:40.210 INFO:tasks.workunit.client.0.smithi110.stderr: -122> 2024-03-04T12:35:39.855+0000 7ff510ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:35:40.210 INFO:tasks.workunit.client.0.smithi110.stderr: -121> 2024-03-04T12:35:39.855+0000 7ff62e753640 10 monclient: get_auth_request con 0x7ff4f8069eb0 auth_method 0 2024-03-04T12:35:40.210 INFO:tasks.workunit.client.0.smithi110.stderr: -120> 2024-03-04T12:35:39.856+0000 7ff62f755640 10 monclient: get_auth_request con 0x556afb924c30 auth_method 0 2024-03-04T12:35:40.210 INFO:tasks.workunit.client.0.smithi110.stderr: -119> 2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.210 INFO:tasks.workunit.client.0.smithi110.stderr: -118> 2024-03-04T12:35:39.856+0000 7ff63332b800 20 realm 2024-03-04T12:35:40.210 INFO:tasks.workunit.client.0.smithi110.stderr: -117> 2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.210 INFO:tasks.workunit.client.0.smithi110.stderr: -116> 2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.210 INFO:tasks.workunit.client.0.smithi110.stderr: -115> 2024-03-04T12:35:39.856+0000 7ff63332b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:40.210 INFO:tasks.workunit.client.0.smithi110.stderr: -114> 2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.210 INFO:tasks.workunit.client.0.smithi110.stderr: -113> 2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.210 INFO:tasks.workunit.client.0.smithi110.stderr: -112> 2024-03-04T12:35:39.856+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.210 INFO:tasks.workunit.client.0.smithi110.stderr: -111> 2024-03-04T12:35:39.857+0000 7ff62ef54640 10 monclient: get_auth_request con 0x556afb928f90 auth_method 0 2024-03-04T12:35:40.210 INFO:tasks.workunit.client.0.smithi110.stderr: -110> 2024-03-04T12:35:39.857+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:40.210 INFO:tasks.workunit.client.0.smithi110.stderr: -109> 2024-03-04T12:35:39.857+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.210 INFO:tasks.workunit.client.0.smithi110.stderr: -108> 2024-03-04T12:35:39.858+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:40.211 INFO:tasks.workunit.client.0.smithi110.stderr: -107> 2024-03-04T12:35:39.858+0000 7ff63332b800 20 searching for the correct realm 2024-03-04T12:35:40.211 INFO:tasks.workunit.client.0.smithi110.stderr: -106> 2024-03-04T12:35:39.858+0000 7ff62e753640 10 monclient: get_auth_request con 0x556afb92e0a0 auth_method 0 2024-03-04T12:35:40.211 INFO:tasks.workunit.client.0.smithi110.stderr: -105> 2024-03-04T12:35:39.859+0000 7ff62f755640 10 monclient: get_auth_request con 0x7ff624033060 auth_method 0 2024-03-04T12:35:40.211 INFO:tasks.workunit.client.0.smithi110.stderr: -104> 2024-03-04T12:35:39.859+0000 7ff62ef54640 10 monclient: get_auth_request con 0x7ff628050070 auth_method 0 2024-03-04T12:35:40.211 INFO:tasks.workunit.client.0.smithi110.stderr: -103> 2024-03-04T12:35:39.860+0000 7ff62e753640 10 monclient: get_auth_request con 0x7ff620063790 auth_method 0 2024-03-04T12:35:40.211 INFO:tasks.workunit.client.0.smithi110.stderr: -102> 2024-03-04T12:35:39.862+0000 7ff62f755640 10 monclient: get_auth_request con 0x7ff62401e030 auth_method 0 2024-03-04T12:35:40.211 INFO:tasks.workunit.client.0.smithi110.stderr: -101> 2024-03-04T12:35:39.862+0000 7ff62f755640 0 -- 172.21.15.110:0/3563356137 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7ff62401e030 msgr2=0x7ff6240751c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:35:40.211 INFO:tasks.workunit.client.0.smithi110.stderr: -100> 2024-03-04T12:35:40.063+0000 7ff62f755640 10 monclient: get_auth_request con 0x7ff62401e030 auth_method 0 2024-03-04T12:35:40.211 INFO:tasks.workunit.client.0.smithi110.stderr: -99> 2024-03-04T12:35:40.066+0000 7ff62ef54640 10 monclient: get_auth_request con 0x7ff624009040 auth_method 0 2024-03-04T12:35:40.211 INFO:tasks.workunit.client.0.smithi110.stderr: -98> 2024-03-04T12:35:40.068+0000 7ff62ef54640 0 -- 172.21.15.110:0/3563356137 >> [v2:172.21.15.172:6800/824320839,v1:172.21.15.172:6801/824320839] conn(0x556afb928f90 msgr2=0x556afb92b380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:40.211 INFO:tasks.workunit.client.0.smithi110.stderr: -97> 2024-03-04T12:35:40.068+0000 7ff510ff9640 1 client.6573.objecter ms_handle_reset 0x556afb928f90 session 0x556afb927e30 osd.5 2024-03-04T12:35:40.211 INFO:tasks.workunit.client.0.smithi110.stderr: -96> 2024-03-04T12:35:40.068+0000 7ff510ff9640 10 monclient: _renew_subs 2024-03-04T12:35:40.211 INFO:tasks.workunit.client.0.smithi110.stderr: -95> 2024-03-04T12:35:40.068+0000 7ff510ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:35:40.212 INFO:tasks.workunit.client.0.smithi110.stderr: -94> 2024-03-04T12:35:40.068+0000 7ff62ef54640 10 monclient: get_auth_request con 0x7ff4f8079c50 auth_method 0 2024-03-04T12:35:40.212 INFO:tasks.workunit.client.0.smithi110.stderr: -93> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:40.212 INFO:tasks.workunit.client.0.smithi110.stderr: -92> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:40.212 INFO:tasks.workunit.client.0.smithi110.stderr: -91> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:40.212 INFO:tasks.workunit.client.0.smithi110.stderr: -90> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:40.212 INFO:tasks.workunit.client.0.smithi110.stderr: -89> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:40.212 INFO:tasks.workunit.client.0.smithi110.stderr: -88> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:40.212 INFO:tasks.workunit.client.0.smithi110.stderr: -87> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.212 INFO:tasks.workunit.client.0.smithi110.stderr: -86> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.212 INFO:tasks.workunit.client.0.smithi110.stderr: -85> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.212 INFO:tasks.workunit.client.0.smithi110.stderr: -84> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:40.212 INFO:tasks.workunit.client.0.smithi110.stderr: -83> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.212 INFO:tasks.workunit.client.0.smithi110.stderr: -82> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:40.213 INFO:tasks.workunit.client.0.smithi110.stderr: -81> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 zone default found 2024-03-04T12:35:40.213 INFO:tasks.workunit.client.0.smithi110.stderr: -80> 2024-03-04T12:35:40.071+0000 7ff63332b800 4 Realm: () 2024-03-04T12:35:40.213 INFO:tasks.workunit.client.0.smithi110.stderr: -79> 2024-03-04T12:35:40.071+0000 7ff63332b800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:40.213 INFO:tasks.workunit.client.0.smithi110.stderr: -78> 2024-03-04T12:35:40.071+0000 7ff63332b800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:40.213 INFO:tasks.workunit.client.0.smithi110.stderr: -77> 2024-03-04T12:35:40.071+0000 7ff63332b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:40.213 INFO:tasks.workunit.client.0.smithi110.stderr: -76> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 zonegroup default 2024-03-04T12:35:40.213 INFO:tasks.workunit.client.0.smithi110.stderr: -75> 2024-03-04T12:35:40.071+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.213 INFO:tasks.workunit.client.0.smithi110.stderr: -74> 2024-03-04T12:35:40.072+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.213 INFO:tasks.workunit.client.0.smithi110.stderr: -73> 2024-03-04T12:35:40.072+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.213 INFO:tasks.workunit.client.0.smithi110.stderr: -72> 2024-03-04T12:35:40.072+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.213 INFO:tasks.workunit.client.0.smithi110.stderr: -71> 2024-03-04T12:35:40.072+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.213 INFO:tasks.workunit.client.0.smithi110.stderr: -70> 2024-03-04T12:35:40.072+0000 7ff63332b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.213 INFO:tasks.workunit.client.0.smithi110.stderr: -69> 2024-03-04T12:35:40.072+0000 7ff63332b800 20 started sync module instance, tier type = 2024-03-04T12:35:40.213 INFO:tasks.workunit.client.0.smithi110.stderr: -68> 2024-03-04T12:35:40.072+0000 7ff63332b800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:40.214 INFO:tasks.workunit.client.0.smithi110.stderr: -67> 2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=0 2024-03-04T12:35:40.214 INFO:tasks.workunit.client.0.smithi110.stderr: -66> 2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=1 2024-03-04T12:35:40.214 INFO:tasks.workunit.client.0.smithi110.stderr: -65> 2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=2 2024-03-04T12:35:40.214 INFO:tasks.workunit.client.0.smithi110.stderr: -64> 2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=3 2024-03-04T12:35:40.214 INFO:tasks.workunit.client.0.smithi110.stderr: -63> 2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=4 2024-03-04T12:35:40.214 INFO:tasks.workunit.client.0.smithi110.stderr: -62> 2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=5 2024-03-04T12:35:40.214 INFO:tasks.workunit.client.0.smithi110.stderr: -61> 2024-03-04T12:35:40.081+0000 7ff63332b800 20 add_watcher() i=6 2024-03-04T12:35:40.214 INFO:tasks.workunit.client.0.smithi110.stderr: -60> 2024-03-04T12:35:40.082+0000 7ff63332b800 20 add_watcher() i=7 2024-03-04T12:35:40.214 INFO:tasks.workunit.client.0.smithi110.stderr: -59> 2024-03-04T12:35:40.082+0000 7ff63332b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:40.214 INFO:tasks.workunit.client.0.smithi110.stderr: -58> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding auth protocol: cephx 2024-03-04T12:35:40.214 INFO:tasks.workunit.client.0.smithi110.stderr: -57> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding auth protocol: cephx 2024-03-04T12:35:40.214 INFO:tasks.workunit.client.0.smithi110.stderr: -56> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding auth protocol: cephx 2024-03-04T12:35:40.214 INFO:tasks.workunit.client.0.smithi110.stderr: -55> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: secure 2024-03-04T12:35:40.214 INFO:tasks.workunit.client.0.smithi110.stderr: -54> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: crc 2024-03-04T12:35:40.214 INFO:tasks.workunit.client.0.smithi110.stderr: -53> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: secure 2024-03-04T12:35:40.215 INFO:tasks.workunit.client.0.smithi110.stderr: -52> 2024-03-04T12:35:40.084+0000 7ff4e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:40.215 INFO:tasks.workunit.client.0.smithi110.stderr: -51> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: crc 2024-03-04T12:35:40.215 INFO:tasks.workunit.client.0.smithi110.stderr: -50> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: secure 2024-03-04T12:35:40.215 INFO:tasks.workunit.client.0.smithi110.stderr: -49> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: crc 2024-03-04T12:35:40.215 INFO:tasks.workunit.client.0.smithi110.stderr: -48> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: crc 2024-03-04T12:35:40.215 INFO:tasks.workunit.client.0.smithi110.stderr: -47> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: secure 2024-03-04T12:35:40.215 INFO:tasks.workunit.client.0.smithi110.stderr: -46> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: crc 2024-03-04T12:35:40.215 INFO:tasks.workunit.client.0.smithi110.stderr: -45> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: secure 2024-03-04T12:35:40.215 INFO:tasks.workunit.client.0.smithi110.stderr: -44> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: crc 2024-03-04T12:35:40.215 INFO:tasks.workunit.client.0.smithi110.stderr: -43> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 AuthRegistry(0x7ffd944f4170) adding con mode: secure 2024-03-04T12:35:40.215 INFO:tasks.workunit.client.0.smithi110.stderr: -42> 2024-03-04T12:35:40.084+0000 7ff63332b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:35:40.215 INFO:tasks.workunit.client.0.smithi110.stderr: -41> 2024-03-04T12:35:40.084+0000 7ff63332b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:40.215 INFO:tasks.workunit.client.0.smithi110.stderr: -40> 2024-03-04T12:35:40.084+0000 7ff63332b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:40.215 INFO:tasks.workunit.client.0.smithi110.stderr: -39> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command cache list hook 0x556afb900480 2024-03-04T12:35:40.215 INFO:tasks.workunit.client.0.smithi110.stderr: -38> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command cache inspect hook 0x556afb900480 2024-03-04T12:35:40.216 INFO:tasks.workunit.client.0.smithi110.stderr: -37> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command cache erase hook 0x556afb900480 2024-03-04T12:35:40.216 INFO:tasks.workunit.client.0.smithi110.stderr: -36> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command cache zap hook 0x556afb900480 2024-03-04T12:35:40.216 INFO:tasks.workunit.client.0.smithi110.stderr: -35> 2024-03-04T12:35:40.084+0000 7ff63332b800 5 note: GC not initialized 2024-03-04T12:35:40.216 INFO:tasks.workunit.client.0.smithi110.stderr: -34> 2024-03-04T12:35:40.085+0000 7ff45ffff640 20 reqs_thread_entry: start 2024-03-04T12:35:40.216 INFO:tasks.workunit.client.0.smithi110.stderr: -33> 2024-03-04T12:35:40.085+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command sync trace show hook 0x7ff624024070 2024-03-04T12:35:40.216 INFO:tasks.workunit.client.0.smithi110.stderr: -32> 2024-03-04T12:35:40.085+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command sync trace history hook 0x7ff624024070 2024-03-04T12:35:40.216 INFO:tasks.workunit.client.0.smithi110.stderr: -31> 2024-03-04T12:35:40.085+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command sync trace active hook 0x7ff624024070 2024-03-04T12:35:40.216 INFO:tasks.workunit.client.0.smithi110.stderr: -30> 2024-03-04T12:35:40.085+0000 7ff63332b800 5 asok(0x556afb61b0c0) register_command sync trace active_short hook 0x7ff624024070 2024-03-04T12:35:40.216 INFO:tasks.workunit.client.0.smithi110.stderr: -29> 2024-03-04T12:35:40.085+0000 7ff63332b800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:40.216 INFO:tasks.workunit.client.0.smithi110.stderr: -28> 2024-03-04T12:35:40.085+0000 7ff63332b800 20 Filter name: none 2024-03-04T12:35:40.216 INFO:tasks.workunit.client.0.smithi110.stderr: -27> 2024-03-04T12:35:40.085+0000 7ff45dffb640 20 reqs_thread_entry: start 2024-03-04T12:35:40.216 INFO:tasks.workunit.client.0.smithi110.stderr: -26> 2024-03-04T12:35:40.085+0000 7ff63332b800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-04T12:35:40.216 INFO:tasks.workunit.client.0.smithi110.stderr: -25> 2024-03-04T12:35:40.085+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.216 INFO:tasks.workunit.client.0.smithi110.stderr: -24> 2024-03-04T12:35:40.085+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:35:40.217 INFO:tasks.workunit.client.0.smithi110.stderr: -23> 2024-03-04T12:35:40.085+0000 7ff63332b800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-04T12:35:40.217 INFO:tasks.workunit.client.0.smithi110.stderr: -22> 2024-03-04T12:35:40.085+0000 7ff63332b800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-04T12:35:40.217 INFO:tasks.workunit.client.0.smithi110.stderr: -21> 2024-03-04T12:35:40.085+0000 7ff63332b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 : miss 2024-03-04T12:35:40.217 INFO:tasks.workunit.client.0.smithi110.stderr: -20> 2024-03-04T12:35:40.085+0000 7ff63332b800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.217 INFO:tasks.workunit.client.0.smithi110.stderr: -19> 2024-03-04T12:35:40.086+0000 7ff63332b800 20 rados_obj.operate() r=0 bl.length=385 2024-03-04T12:35:40.217 INFO:tasks.workunit.client.0.smithi110.stderr: -18> 2024-03-04T12:35:40.086+0000 7ff63332b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 info.flags=0x17 2024-03-04T12:35:40.217 INFO:tasks.workunit.client.0.smithi110.stderr: -17> 2024-03-04T12:35:40.086+0000 7ff63332b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 to cache LRU end 2024-03-04T12:35:40.217 INFO:tasks.workunit.client.0.smithi110.stderr: -16> 2024-03-04T12:35:40.086+0000 7ff63332b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:35:40.217 INFO:tasks.workunit.client.0.smithi110.stderr: -15> 2024-03-04T12:35:40.086+0000 7ff63332b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:40.217 INFO:tasks.workunit.client.0.smithi110.stderr: -14> 2024-03-04T12:35:40.086+0000 7ff63332b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 2024-03-04T12:35:40.217 INFO:tasks.workunit.client.0.smithi110.stderr: -13> 2024-03-04T12:35:40.091+0000 7ff63332b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 info.flags=0x17 2024-03-04T12:35:40.217 INFO:tasks.workunit.client.0.smithi110.stderr: -12> 2024-03-04T12:35:40.091+0000 7ff63332b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 to cache LRU end 2024-03-04T12:35:40.217 INFO:tasks.workunit.client.0.smithi110.stderr: -11> 2024-03-04T12:35:40.091+0000 7ff63332b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:40.217 INFO:tasks.workunit.client.0.smithi110.stderr: -10> 2024-03-04T12:35:40.091+0000 7ff63332b800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24, ofs0, ns] 2024-03-04T12:35:40.218 INFO:tasks.workunit.client.0.smithi110.stderr: -9> 2024-03-04T12:35:40.091+0000 7ff511ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824088 cookie 93917975585152 notifier 6573 bl.length()=949 2024-03-04T12:35:40.218 INFO:tasks.workunit.client.0.smithi110.stderr: -8> 2024-03-04T12:35:40.091+0000 7ff511ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 info.flags=0x17 2024-03-04T12:35:40.218 INFO:tasks.workunit.client.0.smithi110.stderr: -7> 2024-03-04T12:35:40.091+0000 7ff511ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 to cache LRU end 2024-03-04T12:35:40.218 INFO:tasks.workunit.client.0.smithi110.stderr: -6> 2024-03-04T12:35:40.091+0000 7ff511ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:40.218 INFO:tasks.workunit.client.0.smithi110.stderr: -5> 2024-03-04T12:35:40.093+0000 7ff63332b800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): orig_sources= new_sources= 2024-03-04T12:35:40.218 INFO:tasks.workunit.client.0.smithi110.stderr: -4> 2024-03-04T12:35:40.093+0000 7ff63332b800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): potential sources added=[] removed=[] 2024-03-04T12:35:40.218 INFO:tasks.workunit.client.0.smithi110.stderr: -3> 2024-03-04T12:35:40.093+0000 7ff63332b800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): orig_dests= new_dests= 2024-03-04T12:35:40.218 INFO:tasks.workunit.client.0.smithi110.stderr: -2> 2024-03-04T12:35:40.093+0000 7ff63332b800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): potential dests added=[] removed=[] 2024-03-04T12:35:40.218 INFO:tasks.workunit.client.0.smithi110.stderr: -1> 2024-03-04T12:35:40.094+0000 7ff63332b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff63332b800 time 2024-03-04T12:35:40.094232+0000 2024-03-04T12:35:40.218 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:35:40.218 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.218 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:35:40.218 INFO:tasks.workunit.client.0.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff634780e86] 2024-03-04T12:35:40.218 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7ff634781044] 2024-03-04T12:35:40.218 INFO:tasks.workunit.client.0.smithi110.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556afa536eb1] 2024-03-04T12:35:40.219 INFO:tasks.workunit.client.0.smithi110.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x556afa54ad74] 2024-03-04T12:35:40.219 INFO:tasks.workunit.client.0.smithi110.stderr: 5: main() 2024-03-04T12:35:40.219 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7ff63363feb0] 2024-03-04T12:35:40.219 INFO:tasks.workunit.client.0.smithi110.stderr: 7: __libc_start_main() 2024-03-04T12:35:40.219 INFO:tasks.workunit.client.0.smithi110.stderr: 8: _start() 2024-03-04T12:35:40.219 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.219 INFO:tasks.workunit.client.0.smithi110.stderr: 0> 2024-03-04T12:35:40.094+0000 7ff63332b800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:35:40.219 INFO:tasks.workunit.client.0.smithi110.stderr: in thread 7ff63332b800 thread_name:radosgw-admin 2024-03-04T12:35:40.219 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.219 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:35:40.219 INFO:tasks.workunit.client.0.smithi110.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7ff633654db0] 2024-03-04T12:35:40.219 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7ff6336a154c] 2024-03-04T12:35:40.219 INFO:tasks.workunit.client.0.smithi110.stderr: 3: raise() 2024-03-04T12:35:40.219 INFO:tasks.workunit.client.0.smithi110.stderr: 4: abort() 2024-03-04T12:35:40.219 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff634780ee0] 2024-03-04T12:35:40.220 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7ff634781044] 2024-03-04T12:35:40.220 INFO:tasks.workunit.client.0.smithi110.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556afa536eb1] 2024-03-04T12:35:40.220 INFO:tasks.workunit.client.0.smithi110.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x556afa54ad74] 2024-03-04T12:35:40.220 INFO:tasks.workunit.client.0.smithi110.stderr: 9: main() 2024-03-04T12:35:40.220 INFO:tasks.workunit.client.0.smithi110.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7ff63363feb0] 2024-03-04T12:35:40.220 INFO:tasks.workunit.client.0.smithi110.stderr: 11: __libc_start_main() 2024-03-04T12:35:40.220 INFO:tasks.workunit.client.0.smithi110.stderr: 12: _start() 2024-03-04T12:35:40.220 INFO:tasks.workunit.client.0.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:35:40.220 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.220 INFO:tasks.workunit.client.0.smithi110.stderr:--- logging levels --- 2024-03-04T12:35:40.220 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 none 2024-03-04T12:35:40.220 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 lockdep 2024-03-04T12:35:40.220 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 context 2024-03-04T12:35:40.220 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 crush 2024-03-04T12:35:40.221 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds 2024-03-04T12:35:40.221 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_balancer 2024-03-04T12:35:40.221 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_locker 2024-03-04T12:35:40.221 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_log 2024-03-04T12:35:40.221 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_log_expire 2024-03-04T12:35:40.221 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_migrator 2024-03-04T12:35:40.221 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 buffer 2024-03-04T12:35:40.221 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 timer 2024-03-04T12:35:40.221 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 filer 2024-03-04T12:35:40.221 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 striper 2024-03-04T12:35:40.221 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 objecter 2024-03-04T12:35:40.221 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rados 2024-03-04T12:35:40.221 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd 2024-03-04T12:35:40.222 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_mirror 2024-03-04T12:35:40.222 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_replay 2024-03-04T12:35:40.222 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_pwl 2024-03-04T12:35:40.222 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 journaler 2024-03-04T12:35:40.222 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 objectcacher 2024-03-04T12:35:40.222 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 immutable_obj_cache 2024-03-04T12:35:40.222 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 client 2024-03-04T12:35:40.222 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 osd 2024-03-04T12:35:40.222 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 optracker 2024-03-04T12:35:40.222 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 objclass 2024-03-04T12:35:40.222 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 filestore 2024-03-04T12:35:40.222 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 journal 2024-03-04T12:35:40.222 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 0 ms 2024-03-04T12:35:40.222 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mon 2024-03-04T12:35:40.222 INFO:tasks.workunit.client.0.smithi110.stderr: 0/10 monc 2024-03-04T12:35:40.223 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 paxos 2024-03-04T12:35:40.223 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 tp 2024-03-04T12:35:40.223 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 auth 2024-03-04T12:35:40.223 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 crypto 2024-03-04T12:35:40.223 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 finisher 2024-03-04T12:35:40.223 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 reserver 2024-03-04T12:35:40.223 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 heartbeatmap 2024-03-04T12:35:40.223 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 perfcounter 2024-03-04T12:35:40.223 INFO:tasks.workunit.client.0.smithi110.stderr: 20/20 rgw 2024-03-04T12:35:40.223 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_sync 2024-03-04T12:35:40.223 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_datacache 2024-03-04T12:35:40.223 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_access 2024-03-04T12:35:40.223 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_dbstore 2024-03-04T12:35:40.223 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_flight 2024-03-04T12:35:40.224 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_lifecycle 2024-03-04T12:35:40.224 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 javaclient 2024-03-04T12:35:40.224 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 asok 2024-03-04T12:35:40.224 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 throttle 2024-03-04T12:35:40.224 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 0 refs 2024-03-04T12:35:40.224 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 compressor 2024-03-04T12:35:40.224 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 bluestore 2024-03-04T12:35:40.224 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 bluefs 2024-03-04T12:35:40.224 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 bdev 2024-03-04T12:35:40.224 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 kstore 2024-03-04T12:35:40.224 INFO:tasks.workunit.client.0.smithi110.stderr: 4/ 5 rocksdb 2024-03-04T12:35:40.224 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 fuse 2024-03-04T12:35:40.224 INFO:tasks.workunit.client.0.smithi110.stderr: 2/ 5 mgr 2024-03-04T12:35:40.225 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mgrc 2024-03-04T12:35:40.225 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 dpdk 2024-03-04T12:35:40.225 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 eventtrace 2024-03-04T12:35:40.225 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 prioritycache 2024-03-04T12:35:40.225 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 test 2024-03-04T12:35:40.225 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cephfs_mirror 2024-03-04T12:35:40.225 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cephsqlite 2024-03-04T12:35:40.225 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 crimson_interrupt 2024-03-04T12:35:40.225 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore 2024-03-04T12:35:40.225 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_onode 2024-03-04T12:35:40.225 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_odata 2024-03-04T12:35:40.225 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_omap 2024-03-04T12:35:40.225 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_tm 2024-03-04T12:35:40.225 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_t 2024-03-04T12:35:40.226 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_cleaner 2024-03-04T12:35:40.226 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_epm 2024-03-04T12:35:40.226 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_lba 2024-03-04T12:35:40.226 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-04T12:35:40.226 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_cache 2024-03-04T12:35:40.226 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_journal 2024-03-04T12:35:40.226 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_device 2024-03-04T12:35:40.226 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_backref 2024-03-04T12:35:40.226 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 alienstore 2024-03-04T12:35:40.226 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mclock 2024-03-04T12:35:40.226 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cyanstore 2024-03-04T12:35:40.226 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 ceph_exporter 2024-03-04T12:35:40.226 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 memstore 2024-03-04T12:35:40.226 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 trace 2024-03-04T12:35:40.227 INFO:tasks.workunit.client.0.smithi110.stderr: -2/-2 (syslog threshold) 2024-03-04T12:35:40.227 INFO:tasks.workunit.client.0.smithi110.stderr: 99/99 (stderr threshold) 2024-03-04T12:35:40.227 INFO:tasks.workunit.client.0.smithi110.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-04T12:35:40.227 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff45dffb640 / http_manager 2024-03-04T12:35:40.227 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff45ffff640 / http_manager 2024-03-04T12:35:40.227 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff4e57e2640 / rgw_dt_lg_renew 2024-03-04T12:35:40.227 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff510ff9640 / ms_dispatch 2024-03-04T12:35:40.227 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff511ffb640 / io_context_pool 2024-03-04T12:35:40.227 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff5127fc640 / io_context_pool 2024-03-04T12:35:40.227 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff518e01640 / ms_dispatch 2024-03-04T12:35:40.227 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff51b606640 / ms_dispatch 2024-03-04T12:35:40.227 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff51ce09640 / io_context_pool 2024-03-04T12:35:40.227 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff62e753640 / msgr-worker-2 2024-03-04T12:35:40.227 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff62ef54640 / msgr-worker-1 2024-03-04T12:35:40.227 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff62f755640 / msgr-worker-0 2024-03-04T12:35:40.228 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff62ff56640 / io_context_pool 2024-03-04T12:35:40.228 INFO:tasks.workunit.client.0.smithi110.stderr: 7ff63332b800 / radosgw-admin 2024-03-04T12:35:40.228 INFO:tasks.workunit.client.0.smithi110.stderr: max_recent 500 2024-03-04T12:35:40.228 INFO:tasks.workunit.client.0.smithi110.stderr: max_new 1000 2024-03-04T12:35:40.228 INFO:tasks.workunit.client.0.smithi110.stderr: log_file /var/lib/ceph/crash/2024-03-04T12:35:40.095576Z_9b29c40d-f811-4139-ab9b-ab4713120b54/log 2024-03-04T12:35:40.228 INFO:tasks.workunit.client.0.smithi110.stderr:--- end dump of recent events --- 2024-03-04T12:35:40.228 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-03-04T12:35:40.230 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:40.230 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:40.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.164+0000 7feebf53c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.165+0000 7feebf53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.165+0000 7feebf53c800 20 realm 2024-03-04T12:35:40.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.165+0000 7feebf53c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.165+0000 7feebf53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.165+0000 7feebf53c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:40.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.165+0000 7feebf53c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.166+0000 7feebf53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.166+0000 7feebf53c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.166+0000 7feebf53c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:40.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.167+0000 7feebf53c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.231 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.167+0000 7feebf53c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:40.231 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.167+0000 7feebf53c800 20 searching for the correct realm 2024-03-04T12:35:40.231 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.171+0000 7feebbafb640 0 -- 172.21.15.110:0/3457694596 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7feea4044900 msgr2=0x7feea40203c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:35:40.384 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.378+0000 7feebb2fa640 0 -- 172.21.15.110:0/3457694596 >> [v2:172.21.15.172:6800/824320839,v1:172.21.15.172:6801/824320839] conn(0x5585e386e940 msgr2=0x5585e3870d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:40.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.380+0000 7feebf53c800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:40.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.380+0000 7feebf53c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:40.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.380+0000 7feebf53c800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:40.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.380+0000 7feebf53c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:40.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.380+0000 7feebf53c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:40.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.380+0000 7feebf53c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:40.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.380+0000 7feebf53c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.381+0000 7feebf53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.381+0000 7feebf53c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.381+0000 7feebf53c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:40.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.381+0000 7feebf53c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.381+0000 7feebf53c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:40.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.381+0000 7feebf53c800 20 zone default found 2024-03-04T12:35:40.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.381+0000 7feebf53c800 4 Realm: () 2024-03-04T12:35:40.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.381+0000 7feebf53c800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:40.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.381+0000 7feebf53c800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:40.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.381+0000 7feebf53c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:40.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.381+0000 7feebf53c800 20 zonegroup default 2024-03-04T12:35:40.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.381+0000 7feebf53c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.381+0000 7feebf53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.382+0000 7feebf53c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.382+0000 7feebf53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.382+0000 7feebf53c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.390 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.382+0000 7feebf53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.390 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.382+0000 7feebf53c800 20 started sync module instance, tier type = 2024-03-04T12:35:40.390 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.382+0000 7feebf53c800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:40.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.392+0000 7feebf53c800 20 add_watcher() i=0 2024-03-04T12:35:40.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.392+0000 7feebf53c800 20 add_watcher() i=1 2024-03-04T12:35:40.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.392+0000 7feebf53c800 20 add_watcher() i=2 2024-03-04T12:35:40.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.392+0000 7feebf53c800 20 add_watcher() i=3 2024-03-04T12:35:40.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.392+0000 7feebf53c800 20 add_watcher() i=4 2024-03-04T12:35:40.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.392+0000 7feebf53c800 20 add_watcher() i=5 2024-03-04T12:35:40.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.392+0000 7feebf53c800 20 add_watcher() i=6 2024-03-04T12:35:40.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.393+0000 7feebf53c800 20 add_watcher() i=7 2024-03-04T12:35:40.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.393+0000 7feebf53c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:40.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.395+0000 7fed71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:40.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.395+0000 7feebf53c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:40.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.395+0000 7feebf53c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:40.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.395+0000 7feebf53c800 5 note: GC not initialized 2024-03-04T12:35:40.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.395+0000 7fed70fe1640 20 reqs_thread_entry: start 2024-03-04T12:35:40.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.395+0000 7feebf53c800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:40.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.395+0000 7feebf53c800 20 Filter name: none 2024-03-04T12:35:40.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.395+0000 7fecea7fc640 20 reqs_thread_entry: start 2024-03-04T12:35:40.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.395+0000 7feebf53c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.403 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.396+0000 7feebf53c800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:35:40.403 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.396+0000 7feebf53c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.397+0000 7feebf53c800 20 rados_obj.operate() r=0 bl.length=417 2024-03-04T12:35:40.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.397+0000 7feebf53c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:40.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.397+0000 7feebf53c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.397+0000 7feebf53c800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:35:40.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.397+0000 7feebf53c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.398+0000 7feebf53c800 20 rados_obj.operate() r=0 bl.length=417 2024-03-04T12:35:40.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.398+0000 7feebf53c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:35:40.405 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.399+0000 7feebf53c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.405 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.399+0000 7feebf53c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.400+0000 7fed71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:40.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.402+0000 7feebf53c800 20 remove_watcher() i=0 2024-03-04T12:35:40.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.402+0000 7feebf53c800 2 removed watcher, disabling cache 2024-03-04T12:35:40.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.403+0000 7feebf53c800 20 remove_watcher() i=1 2024-03-04T12:35:40.410 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.404+0000 7feebf53c800 20 remove_watcher() i=2 2024-03-04T12:35:40.411 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.405+0000 7feebf53c800 20 remove_watcher() i=3 2024-03-04T12:35:40.412 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.406+0000 7feebf53c800 20 remove_watcher() i=4 2024-03-04T12:35:40.413 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.406+0000 7feebf53c800 20 remove_watcher() i=5 2024-03-04T12:35:40.414 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.407+0000 7feebf53c800 20 remove_watcher() i=6 2024-03-04T12:35:40.414 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.408+0000 7feebf53c800 20 remove_watcher() i=7 2024-03-04T12:35:40.424 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.424 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:35:40.424 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: abort-at-block-writes id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:35:40.424 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:35:40.426 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:40.426 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:40.453 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:35:40.453 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:35:40.508 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:35:40.537 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:35:40.537 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:35:40.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.564+0000 7fc167f2c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.566+0000 7fc167f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.566+0000 7fc167f2c800 20 realm 2024-03-04T12:35:40.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.566+0000 7fc167f2c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.566+0000 7fc167f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.566+0000 7fc167f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:35:40.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.566+0000 7fc167f2c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.566+0000 7fc167f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.566+0000 7fc167f2c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.574 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.567+0000 7fc167f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:40.574 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.567+0000 7fc167f2c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.574 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.567+0000 7fc167f2c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:35:40.574 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.567+0000 7fc167f2c800 20 searching for the correct realm 2024-03-04T12:35:40.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.571+0000 7fc15b460640 0 -- 172.21.15.110:0/2344836301 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x564c951c3bc0 msgr2=0x564c951c6080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:40.581 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.575+0000 7fc163c61640 0 -- 172.21.15.110:0/2344836301 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fc14c049040 msgr2=0x7fc14c05b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:35:40.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.579+0000 7fc167f2c800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:35:40.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.579+0000 7fc167f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:35:40.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.579+0000 7fc167f2c800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:35:40.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.579+0000 7fc167f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:35:40.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.579+0000 7fc167f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:35:40.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.579+0000 7fc167f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:35:40.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.579+0000 7fc167f2c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.580+0000 7fc167f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.580+0000 7fc167f2c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.580+0000 7fc167f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:35:40.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.580+0000 7fc167f2c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.580+0000 7fc167f2c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:35:40.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.580+0000 7fc167f2c800 20 zone default found 2024-03-04T12:35:40.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.580+0000 7fc167f2c800 4 Realm: () 2024-03-04T12:35:40.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.580+0000 7fc167f2c800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:35:40.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.580+0000 7fc167f2c800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:35:40.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.580+0000 7fc167f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:35:40.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.580+0000 7fc167f2c800 20 zonegroup default 2024-03-04T12:35:40.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.580+0000 7fc167f2c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.580+0000 7fc167f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.580+0000 7fc167f2c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.581+0000 7fc167f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.581+0000 7fc167f2c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.581+0000 7fc167f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:35:40.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.581+0000 7fc167f2c800 20 started sync module instance, tier type = 2024-03-04T12:35:40.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.581+0000 7fc167f2c800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:35:40.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.590+0000 7fc167f2c800 20 add_watcher() i=0 2024-03-04T12:35:40.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.590+0000 7fc167f2c800 20 add_watcher() i=1 2024-03-04T12:35:40.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.590+0000 7fc167f2c800 20 add_watcher() i=2 2024-03-04T12:35:40.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.590+0000 7fc167f2c800 20 add_watcher() i=3 2024-03-04T12:35:40.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.590+0000 7fc167f2c800 20 add_watcher() i=4 2024-03-04T12:35:40.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.590+0000 7fc167f2c800 20 add_watcher() i=5 2024-03-04T12:35:40.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.590+0000 7fc167f2c800 20 add_watcher() i=6 2024-03-04T12:35:40.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.591+0000 7fc167f2c800 20 add_watcher() i=7 2024-03-04T12:35:40.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.591+0000 7fc167f2c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:35:40.599 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.593+0000 7fc019fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:40.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.593+0000 7fc167f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:35:40.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.593+0000 7fc167f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:35:40.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.593+0000 7fc167f2c800 5 note: GC not initialized 2024-03-04T12:35:40.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.593+0000 7fc018fe1640 20 reqs_thread_entry: start 2024-03-04T12:35:40.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.593+0000 7fc167f2c800 20 init_complete bucket index max shards: 11 2024-03-04T12:35:40.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.593+0000 7fc167f2c800 20 Filter name: none 2024-03-04T12:35:40.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.593+0000 7fbf927fc640 20 reqs_thread_entry: start 2024-03-04T12:35:40.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.593+0000 7fc167f2c800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-04T12:35:40.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.593+0000 7fc167f2c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.594+0000 7fc167f2c800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:35:40.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.594+0000 7fc167f2c800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-04T12:35:40.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.594+0000 7fc167f2c800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-04T12:35:40.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.594+0000 7fc167f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 : miss 2024-03-04T12:35:40.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.594+0000 7fc167f2c800 20 rados->read ofs=0 len=0 2024-03-04T12:35:40.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.594+0000 7fc167f2c800 20 rados_obj.operate() r=0 bl.length=417 2024-03-04T12:35:40.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.594+0000 7fc167f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 info.flags=0x17 2024-03-04T12:35:40.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.594+0000 7fc167f2c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 to cache LRU end 2024-03-04T12:35:40.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.594+0000 7fc167f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:35:40.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.594+0000 7fc167f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:35:40.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.594+0000 7fc167f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 2024-03-04T12:35:40.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.595+0000 7fc167f2c800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 to be held by another RGW process; skipping for now 2024-03-04T12:35:40.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.596+0000 7fc019fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:35:40.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.598+0000 7fc167f2c800 20 remove_watcher() i=0 2024-03-04T12:35:40.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.598+0000 7fc167f2c800 2 removed watcher, disabling cache 2024-03-04T12:35:40.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.599+0000 7fc167f2c800 20 remove_watcher() i=1 2024-03-04T12:35:40.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.600+0000 7fc167f2c800 20 remove_watcher() i=2 2024-03-04T12:35:40.607 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.601+0000 7fc167f2c800 20 remove_watcher() i=3 2024-03-04T12:35:40.608 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.602+0000 7fc167f2c800 20 remove_watcher() i=4 2024-03-04T12:35:40.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.603+0000 7fc167f2c800 20 remove_watcher() i=5 2024-03-04T12:35:40.610 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.604+0000 7fc167f2c800 20 remove_watcher() i=6 2024-03-04T12:35:40.611 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:35:40.605+0000 7fc167f2c800 20 remove_watcher() i=7 2024-03-04T12:35:40.620 INFO:tasks.workunit.client.0.smithi110.stderr:waiting 30 seconds for reshard lock to expire... 2024-03-04T12:36:10.636 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:36:10.669 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:10.670 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:10.708 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.701+0000 7fad68624800 20 rados->read ofs=0 len=0 2024-03-04T12:36:10.709 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.703+0000 7fad68624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:10.709 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.703+0000 7fad68624800 20 realm 2024-03-04T12:36:10.710 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.703+0000 7fad68624800 20 rados->read ofs=0 len=0 2024-03-04T12:36:10.710 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.703+0000 7fad68624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:10.710 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.703+0000 7fad68624800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:10.710 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.703+0000 7fad68624800 20 rados->read ofs=0 len=0 2024-03-04T12:36:10.710 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.703+0000 7fad68624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:10.710 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.703+0000 7fad68624800 20 rados->read ofs=0 len=0 2024-03-04T12:36:10.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.704+0000 7fad68624800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:10.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.704+0000 7fad68624800 20 rados->read ofs=0 len=0 2024-03-04T12:36:10.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.704+0000 7fad68624800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:10.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.704+0000 7fad68624800 20 searching for the correct realm 2024-03-04T12:36:10.714 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.708+0000 7fad65926640 0 -- 172.21.15.110:0/3102569343 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x559490b0abd0 msgr2=0x559490b0d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:10.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.712+0000 7fad66127640 0 -- 172.21.15.110:0/3102569343 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fad5c052020 msgr2=0x7fad5c088aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:10.925 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.918+0000 7fad68624800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:10.925 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.918+0000 7fad68624800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:10.925 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.918+0000 7fad68624800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:10.925 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.918+0000 7fad68624800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:10.925 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.918+0000 7fad68624800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:10.925 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.918+0000 7fad68624800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:10.925 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.918+0000 7fad68624800 20 rados->read ofs=0 len=0 2024-03-04T12:36:10.925 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.919+0000 7fad68624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:10.926 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.919+0000 7fad68624800 20 rados->read ofs=0 len=0 2024-03-04T12:36:10.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.919+0000 7fad68624800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:10.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.919+0000 7fad68624800 20 rados->read ofs=0 len=0 2024-03-04T12:36:10.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.920+0000 7fad68624800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:10.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.920+0000 7fad68624800 20 zone default found 2024-03-04T12:36:10.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.920+0000 7fad68624800 4 Realm: () 2024-03-04T12:36:10.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.920+0000 7fad68624800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:10.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.920+0000 7fad68624800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:10.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.920+0000 7fad68624800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:10.927 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.920+0000 7fad68624800 20 zonegroup default 2024-03-04T12:36:10.928 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.920+0000 7fad68624800 20 rados->read ofs=0 len=0 2024-03-04T12:36:10.928 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.920+0000 7fad68624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:10.928 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.920+0000 7fad68624800 20 rados->read ofs=0 len=0 2024-03-04T12:36:10.928 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.920+0000 7fad68624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:10.928 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.920+0000 7fad68624800 20 rados->read ofs=0 len=0 2024-03-04T12:36:10.928 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.921+0000 7fad68624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:10.928 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.921+0000 7fad68624800 20 started sync module instance, tier type = 2024-03-04T12:36:10.928 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.921+0000 7fad68624800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:10.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.931+0000 7fad68624800 20 add_watcher() i=0 2024-03-04T12:36:10.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.931+0000 7fad68624800 20 add_watcher() i=1 2024-03-04T12:36:10.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.931+0000 7fad68624800 20 add_watcher() i=2 2024-03-04T12:36:10.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.931+0000 7fad68624800 20 add_watcher() i=3 2024-03-04T12:36:10.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.931+0000 7fad68624800 20 add_watcher() i=4 2024-03-04T12:36:10.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.931+0000 7fad68624800 20 add_watcher() i=5 2024-03-04T12:36:10.937 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.931+0000 7fad68624800 20 add_watcher() i=6 2024-03-04T12:36:10.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.932+0000 7fad68624800 20 add_watcher() i=7 2024-03-04T12:36:10.938 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.932+0000 7fad68624800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:10.940 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.933+0000 7fac1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:10.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.934+0000 7fad68624800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:10.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.934+0000 7fad68624800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:10.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.934+0000 7fad68624800 5 note: GC not initialized 2024-03-04T12:36:10.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.934+0000 7fab977fe640 20 reqs_thread_entry: start 2024-03-04T12:36:10.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.934+0000 7fad68624800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:10.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.934+0000 7fad68624800 20 Filter name: none 2024-03-04T12:36:10.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.934+0000 7fab957fa640 20 reqs_thread_entry: start 2024-03-04T12:36:10.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.934+0000 7fad68624800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-04T12:36:10.941 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.934+0000 7fad68624800 20 rados->read ofs=0 len=0 2024-03-04T12:36:10.942 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.935+0000 7fad68624800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:36:10.942 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.935+0000 7fad68624800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-04T12:36:10.942 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.935+0000 7fad68624800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-04T12:36:10.942 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.935+0000 7fad68624800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 : miss 2024-03-04T12:36:10.942 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.935+0000 7fad68624800 20 rados->read ofs=0 len=0 2024-03-04T12:36:10.942 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.936+0000 7fad68624800 20 rados_obj.operate() r=0 bl.length=417 2024-03-04T12:36:10.942 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.936+0000 7fad68624800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 info.flags=0x17 2024-03-04T12:36:10.942 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.936+0000 7fad68624800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 to cache LRU end 2024-03-04T12:36:10.943 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.936+0000 7fad68624800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:36:10.943 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.936+0000 7fad68624800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:10.943 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.936+0000 7fad68624800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 2024-03-04T12:36:10.943 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.937+0000 7fad68624800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-03-04T12:36:10.949 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.943+0000 7fad68624800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 info.flags=0x17 2024-03-04T12:36:10.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.943+0000 7fad68624800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 to cache LRU end 2024-03-04T12:36:10.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.943+0000 7fad68624800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:10.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.943+0000 7fad68624800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24, ofs0, ns] 2024-03-04T12:36:10.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.944+0000 7fac49ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824089 cookie 94096571026368 notifier 6209 bl.length()=949 2024-03-04T12:36:10.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.944+0000 7fac49ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 info.flags=0x17 2024-03-04T12:36:10.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.944+0000 7fac49ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 to cache LRU end 2024-03-04T12:36:10.950 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.944+0000 7fac49ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:10.952 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.946+0000 7fad68624800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): orig_sources= new_sources= 2024-03-04T12:36:10.952 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.946+0000 7fad68624800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): potential sources added=[] removed=[] 2024-03-04T12:36:10.952 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.946+0000 7fad68624800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): orig_dests= new_dests= 2024-03-04T12:36:10.952 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.946+0000 7fad68624800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): potential dests added=[] removed=[] 2024-03-04T12:36:10.956 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.0 2024-03-04T12:36:10.956 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.0 2024-03-04T12:36:10.956 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.1 2024-03-04T12:36:10.956 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.1 2024-03-04T12:36:10.956 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.2 2024-03-04T12:36:10.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.2 2024-03-04T12:36:10.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.3 2024-03-04T12:36:10.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.3 2024-03-04T12:36:10.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.4 2024-03-04T12:36:10.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.4 2024-03-04T12:36:10.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.5 2024-03-04T12:36:10.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.5 2024-03-04T12:36:10.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.6 2024-03-04T12:36:10.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.6 2024-03-04T12:36:10.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.7 2024-03-04T12:36:10.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.7 2024-03-04T12:36:10.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.8 2024-03-04T12:36:10.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.8 2024-03-04T12:36:10.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.9 2024-03-04T12:36:10.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.9 2024-03-04T12:36:10.958 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.10 2024-03-04T12:36:10.958 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.10 2024-03-04T12:36:10.958 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.11 2024-03-04T12:36:10.958 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2.11 2024-03-04T12:36:10.958 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.0 2024-03-04T12:36:10.958 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.950+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.1 2024-03-04T12:36:10.958 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.951+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.2 2024-03-04T12:36:10.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.951+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.3 2024-03-04T12:36:10.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.952+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.4 2024-03-04T12:36:10.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.953+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.5 2024-03-04T12:36:10.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.953+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.6 2024-03-04T12:36:10.960 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.954+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.7 2024-03-04T12:36:10.960 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.954+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.8 2024-03-04T12:36:10.961 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.955+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.9 2024-03-04T12:36:10.961 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.955+0000 7fad68624800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24.10 2024-03-04T12:36:10.965 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.959+0000 7fad68624800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 : hit (requested=0x17, cached=0x17) 2024-03-04T12:36:10.965 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.959+0000 7fad68624800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 2024-03-04T12:36:10.966 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.960+0000 7fad68624800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 info.flags=0x17 2024-03-04T12:36:10.966 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.960+0000 7fad68624800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 to cache LRU end 2024-03-04T12:36:10.966 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.960+0000 7fad68624800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:10.967 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.960+0000 7fad68624800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24, ofs0, ns] 2024-03-04T12:36:10.967 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.961+0000 7fac49ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824090 cookie 94096571026368 notifier 6209 bl.length()=917 2024-03-04T12:36:10.967 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.961+0000 7fac49ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 info.flags=0x17 2024-03-04T12:36:10.967 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.961+0000 7fac49ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 to cache LRU end 2024-03-04T12:36:10.967 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.961+0000 7fac49ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:10.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.963+0000 7fad68624800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): orig_sources= new_sources= 2024-03-04T12:36:10.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.963+0000 7fad68624800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): potential sources added=[] removed=[] 2024-03-04T12:36:10.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.963+0000 7fad68624800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): orig_dests= new_dests= 2024-03-04T12:36:10.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.963+0000 7fad68624800 20 handle_bi_update(): bucket=:abort-at-block-writes[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24]): potential dests added=[] removed=[] 2024-03-04T12:36:10.971 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.965+0000 7fad68624800 1 execute INFO: reshard of bucket "abort-at-block-writes" completed successfully 2024-03-04T12:36:10.973 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.967+0000 7fac1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:10.975 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.969+0000 7fad68624800 20 remove_watcher() i=0 2024-03-04T12:36:10.975 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.969+0000 7fad68624800 2 removed watcher, disabling cache 2024-03-04T12:36:10.976 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.970+0000 7fad68624800 20 remove_watcher() i=1 2024-03-04T12:36:10.977 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.971+0000 7fad68624800 20 remove_watcher() i=2 2024-03-04T12:36:10.978 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.972+0000 7fad68624800 20 remove_watcher() i=3 2024-03-04T12:36:10.979 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.973+0000 7fad68624800 20 remove_watcher() i=4 2024-03-04T12:36:10.980 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.974+0000 7fad68624800 20 remove_watcher() i=5 2024-03-04T12:36:10.981 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.975+0000 7fad68624800 20 remove_watcher() i=6 2024-03-04T12:36:10.982 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:10.976+0000 7fad68624800 20 remove_watcher() i=7 2024-03-04T12:36:10.993 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-03-04T12:36:11.021 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:11.021 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:11.054 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.048+0000 7fc1ef210800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.049+0000 7fc1ef210800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:11.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.049+0000 7fc1ef210800 20 realm 2024-03-04T12:36:11.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.049+0000 7fc1ef210800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.049+0000 7fc1ef210800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:11.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.049+0000 7fc1ef210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:11.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.049+0000 7fc1ef210800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.050+0000 7fc1ef210800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:11.056 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.050+0000 7fc1ef210800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.051+0000 7fc1ef210800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:11.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.051+0000 7fc1ef210800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.051+0000 7fc1ef210800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:11.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.051+0000 7fc1ef210800 20 searching for the correct realm 2024-03-04T12:36:11.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.054+0000 7fc1eb094640 0 -- 172.21.15.110:0/4132717732 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7fc1d4004070 msgr2=0x7fc1d4058160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:11.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.057+0000 7fc1ea893640 0 -- 172.21.15.110:0/4132717732 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fc1d4062830 msgr2=0x7fc1d4001980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:36:11.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.263+0000 7fc1ef210800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:11.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.263+0000 7fc1ef210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:11.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.263+0000 7fc1ef210800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:11.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.263+0000 7fc1ef210800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:11.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.263+0000 7fc1ef210800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:11.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.263+0000 7fc1ef210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:11.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.263+0000 7fc1ef210800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.264+0000 7fc1ef210800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:11.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.264+0000 7fc1ef210800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.264+0000 7fc1ef210800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:11.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.264+0000 7fc1ef210800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.264+0000 7fc1ef210800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:11.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.264+0000 7fc1ef210800 20 zone default found 2024-03-04T12:36:11.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.264+0000 7fc1ef210800 4 Realm: () 2024-03-04T12:36:11.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.264+0000 7fc1ef210800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:11.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.264+0000 7fc1ef210800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:11.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.264+0000 7fc1ef210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:11.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.264+0000 7fc1ef210800 20 zonegroup default 2024-03-04T12:36:11.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.264+0000 7fc1ef210800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.265+0000 7fc1ef210800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:11.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.265+0000 7fc1ef210800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.265+0000 7fc1ef210800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:11.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.265+0000 7fc1ef210800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.265+0000 7fc1ef210800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:11.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.265+0000 7fc1ef210800 20 started sync module instance, tier type = 2024-03-04T12:36:11.273 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.265+0000 7fc1ef210800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:11.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.275+0000 7fc1ef210800 20 add_watcher() i=0 2024-03-04T12:36:11.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.275+0000 7fc1ef210800 20 add_watcher() i=1 2024-03-04T12:36:11.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.275+0000 7fc1ef210800 20 add_watcher() i=2 2024-03-04T12:36:11.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.275+0000 7fc1ef210800 20 add_watcher() i=3 2024-03-04T12:36:11.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.275+0000 7fc1ef210800 20 add_watcher() i=4 2024-03-04T12:36:11.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.275+0000 7fc1ef210800 20 add_watcher() i=5 2024-03-04T12:36:11.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.275+0000 7fc1ef210800 20 add_watcher() i=6 2024-03-04T12:36:11.282 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.276+0000 7fc1ef210800 20 add_watcher() i=7 2024-03-04T12:36:11.282 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.276+0000 7fc1ef210800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:11.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.277+0000 7fc0a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:11.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.278+0000 7fc1ef210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:11.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.278+0000 7fc1ef210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:11.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.278+0000 7fc1ef210800 5 note: GC not initialized 2024-03-04T12:36:11.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.278+0000 7fc01bfff640 20 reqs_thread_entry: start 2024-03-04T12:36:11.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.278+0000 7fc1ef210800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:11.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.278+0000 7fc1ef210800 20 Filter name: none 2024-03-04T12:36:11.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.278+0000 7fc019ffb640 20 reqs_thread_entry: start 2024-03-04T12:36:11.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.278+0000 7fc1ef210800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.278+0000 7fc1ef210800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:36:11.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.278+0000 7fc1ef210800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.279+0000 7fc1ef210800 20 rados_obj.operate() r=0 bl.length=385 2024-03-04T12:36:11.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.279+0000 7fc1ef210800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:11.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.279+0000 7fc1ef210800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.280+0000 7fc1ef210800 20 rados_obj.operate() r=0 bl.length=213 2024-03-04T12:36:11.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.280+0000 7fc1ef210800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.280+0000 7fc1ef210800 20 rados_obj.operate() r=0 bl.length=385 2024-03-04T12:36:11.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.280+0000 7fc1ef210800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:11.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.281+0000 7fc1ef210800 20 rados->read ofs=0 len=0 2024-03-04T12:36:11.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.281+0000 7fc1ef210800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:11.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.282+0000 7fc0a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:11.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.284+0000 7fc1ef210800 20 remove_watcher() i=0 2024-03-04T12:36:11.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.284+0000 7fc1ef210800 2 removed watcher, disabling cache 2024-03-04T12:36:11.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.285+0000 7fc1ef210800 20 remove_watcher() i=1 2024-03-04T12:36:11.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.286+0000 7fc1ef210800 20 remove_watcher() i=2 2024-03-04T12:36:11.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.287+0000 7fc1ef210800 20 remove_watcher() i=3 2024-03-04T12:36:11.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.288+0000 7fc1ef210800 20 remove_watcher() i=4 2024-03-04T12:36:11.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.289+0000 7fc1ef210800 20 remove_watcher() i=5 2024-03-04T12:36:11.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.290+0000 7fc1ef210800 20 remove_watcher() i=6 2024-03-04T12:36:11.297 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:11.291+0000 7fc1ef210800 20 remove_watcher() i=7 2024-03-04T12:36:11.307 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:11.307 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:36:11.307 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: abort-at-block-writes id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-04T12:36:11.307 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:11.308 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:11.308 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:11.331 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:11.332 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:11.479 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:11.480 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:11.607 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-03-04T12:36:11.607 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:11.608 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:11.608 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:11.651 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:11.651 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:11.705 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:11.705 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:11.734 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:11.734 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:11.765 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:11.765 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:11.792 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:11.792 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:11.820 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:11.820 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:11.848 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:11.848 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:11.876 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:11.876 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:11.904 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:11.904 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:11.934 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:11.934 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:11.962 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:11.962 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:11.990 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:11.990 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:12.017 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:12.017 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:12.046 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:12.046 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:12.074 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:12.074 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:12.104 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:12.104 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:12.131 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:12.132 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:12.160 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:12.160 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:12.189 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:12.189 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:12.216 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:12.216 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:12.244 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:12.244 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:12.273 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-04T12:36:12.299 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:12.300 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:12.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.326+0000 7f34b93a2800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.327+0000 7f34b93a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.327+0000 7f34b93a2800 20 realm 2024-03-04T12:36:12.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.327+0000 7f34b93a2800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.327+0000 7f34b93a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.327+0000 7f34b93a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:12.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.327+0000 7f34b93a2800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.328+0000 7f34b93a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.328+0000 7f34b93a2800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.329+0000 7f34b93a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:12.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.329+0000 7f34b93a2800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.329+0000 7f34b93a2800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:12.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.329+0000 7f34b93a2800 20 searching for the correct realm 2024-03-04T12:36:12.339 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.333+0000 7f34ae69d640 0 -- 172.21.15.110:0/2739105763 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f34a802e070 msgr2=0x7f34a80163f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:12.343 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.337+0000 7f34b769f640 0 -- 172.21.15.110:0/2739105763 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7f34a0039040 msgr2=0x7f34a0090580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:12.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.341+0000 7f34b93a2800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:12.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.341+0000 7f34b93a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:12.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.341+0000 7f34b93a2800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:12.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.341+0000 7f34b93a2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:12.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.341+0000 7f34b93a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:12.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.341+0000 7f34b93a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:12.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.341+0000 7f34b93a2800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.341+0000 7f34b93a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.341+0000 7f34b93a2800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.341+0000 7f34b93a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:12.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.341+0000 7f34b93a2800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.342+0000 7f34b93a2800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:12.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.342+0000 7f34b93a2800 20 zone default found 2024-03-04T12:36:12.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.342+0000 7f34b93a2800 4 Realm: () 2024-03-04T12:36:12.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.342+0000 7f34b93a2800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:12.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.342+0000 7f34b93a2800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:12.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.342+0000 7f34b93a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:12.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.342+0000 7f34b93a2800 20 zonegroup default 2024-03-04T12:36:12.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.342+0000 7f34b93a2800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.342+0000 7f34b93a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.342+0000 7f34b93a2800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.342+0000 7f34b93a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.350 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.342+0000 7f34b93a2800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.343+0000 7f34b93a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.343+0000 7f34b93a2800 20 started sync module instance, tier type = 2024-03-04T12:36:12.351 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.343+0000 7f34b93a2800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:12.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.352+0000 7f34b93a2800 20 add_watcher() i=0 2024-03-04T12:36:12.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.352+0000 7f34b93a2800 20 add_watcher() i=1 2024-03-04T12:36:12.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.352+0000 7f34b93a2800 20 add_watcher() i=2 2024-03-04T12:36:12.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.352+0000 7f34b93a2800 20 add_watcher() i=3 2024-03-04T12:36:12.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.352+0000 7f34b93a2800 20 add_watcher() i=4 2024-03-04T12:36:12.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.352+0000 7f34b93a2800 20 add_watcher() i=5 2024-03-04T12:36:12.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.352+0000 7f34b93a2800 20 add_watcher() i=6 2024-03-04T12:36:12.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.353+0000 7f34b93a2800 20 add_watcher() i=7 2024-03-04T12:36:12.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.353+0000 7f34b93a2800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:12.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.355+0000 7f336d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:12.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.355+0000 7f34b93a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:12.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.355+0000 7f34b93a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:12.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.355+0000 7f34b93a2800 5 note: GC not initialized 2024-03-04T12:36:12.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.355+0000 7f32e7fff640 20 reqs_thread_entry: start 2024-03-04T12:36:12.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.355+0000 7f34b93a2800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:12.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.356+0000 7f34b93a2800 20 Filter name: none 2024-03-04T12:36:12.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.356+0000 7f32e5ffb640 20 reqs_thread_entry: start 2024-03-04T12:36:12.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.356+0000 7f34b93a2800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.356+0000 7f34b93a2800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:12.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.356+0000 7f34b93a2800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.357+0000 7f34b93a2800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:12.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.357+0000 7f34b93a2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:12.363 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.357+0000 7f34b93a2800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.357+0000 7f34b93a2800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:12.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.357+0000 7f34b93a2800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.358+0000 7f34b93a2800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:12.364 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.358+0000 7f34b93a2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:12.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.358+0000 7f34b93a2800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.359+0000 7f34b93a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.365 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.359+0000 7f336d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:12.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.362+0000 7f34b93a2800 20 remove_watcher() i=0 2024-03-04T12:36:12.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.362+0000 7f34b93a2800 2 removed watcher, disabling cache 2024-03-04T12:36:12.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.362+0000 7f34b93a2800 20 remove_watcher() i=1 2024-03-04T12:36:12.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.363+0000 7f34b93a2800 20 remove_watcher() i=2 2024-03-04T12:36:12.370 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.364+0000 7f34b93a2800 20 remove_watcher() i=3 2024-03-04T12:36:12.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.365+0000 7f34b93a2800 20 remove_watcher() i=4 2024-03-04T12:36:12.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.366+0000 7f34b93a2800 20 remove_watcher() i=5 2024-03-04T12:36:12.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.367+0000 7f34b93a2800 20 remove_watcher() i=6 2024-03-04T12:36:12.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.368+0000 7f34b93a2800 20 remove_watcher() i=7 2024-03-04T12:36:12.384 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:12.384 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:36:12.384 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: error-at-commit-target-layout id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:36:12.384 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:12.385 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-03-04T12:36:12.418 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:12.418 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:12.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.445+0000 7f316ae12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.446+0000 7f316ae12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.446+0000 7f316ae12800 20 realm 2024-03-04T12:36:12.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.446+0000 7f316ae12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.446+0000 7f316ae12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.446+0000 7f316ae12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:12.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.446+0000 7f316ae12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.446+0000 7f316ae12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.446+0000 7f316ae12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.447+0000 7f316ae12800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:12.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.447+0000 7f316ae12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.447+0000 7f316ae12800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:12.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.447+0000 7f316ae12800 20 searching for the correct realm 2024-03-04T12:36:12.457 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.451+0000 7f3165da8640 0 -- 172.21.15.110:0/3802832484 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x5597cbff1f40 msgr2=0x5597cbff4400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:12.460 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.454+0000 7f31665a9640 0 -- 172.21.15.110:0/3802832484 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f315c008c20 msgr2=0x7f315c064150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:12.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.458+0000 7f316ae12800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:12.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.458+0000 7f316ae12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:12.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.458+0000 7f316ae12800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:12.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.458+0000 7f316ae12800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:12.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.458+0000 7f316ae12800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:12.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.458+0000 7f316ae12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:12.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.458+0000 7f316ae12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.458+0000 7f316ae12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.458+0000 7f316ae12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.459+0000 7f316ae12800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:12.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.459+0000 7f316ae12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.466 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.459+0000 7f316ae12800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:12.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.459+0000 7f316ae12800 20 zone default found 2024-03-04T12:36:12.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.459+0000 7f316ae12800 4 Realm: () 2024-03-04T12:36:12.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.459+0000 7f316ae12800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:12.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.459+0000 7f316ae12800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:12.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.459+0000 7f316ae12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:12.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.459+0000 7f316ae12800 20 zonegroup default 2024-03-04T12:36:12.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.459+0000 7f316ae12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.459+0000 7f316ae12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.459+0000 7f316ae12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.460+0000 7f316ae12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.460+0000 7f316ae12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.460+0000 7f316ae12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.460+0000 7f316ae12800 20 started sync module instance, tier type = 2024-03-04T12:36:12.467 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.460+0000 7f316ae12800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:12.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.469+0000 7f316ae12800 20 add_watcher() i=0 2024-03-04T12:36:12.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.469+0000 7f316ae12800 20 add_watcher() i=1 2024-03-04T12:36:12.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.469+0000 7f316ae12800 20 add_watcher() i=2 2024-03-04T12:36:12.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.469+0000 7f316ae12800 20 add_watcher() i=3 2024-03-04T12:36:12.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.469+0000 7f316ae12800 20 add_watcher() i=4 2024-03-04T12:36:12.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.469+0000 7f316ae12800 20 add_watcher() i=5 2024-03-04T12:36:12.475 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.469+0000 7f316ae12800 20 add_watcher() i=6 2024-03-04T12:36:12.476 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.469+0000 7f316ae12800 20 add_watcher() i=7 2024-03-04T12:36:12.476 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.469+0000 7f316ae12800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:12.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.471+0000 7f301cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:12.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.472+0000 7f316ae12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:12.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.472+0000 7f316ae12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:12.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.472+0000 7f316ae12800 5 note: GC not initialized 2024-03-04T12:36:12.478 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.472+0000 7f2f977fe640 20 reqs_thread_entry: start 2024-03-04T12:36:12.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.472+0000 7f316ae12800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:12.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.472+0000 7f316ae12800 20 Filter name: none 2024-03-04T12:36:12.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.472+0000 7f2f957fa640 20 reqs_thread_entry: start 2024-03-04T12:36:12.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.472+0000 7f316ae12800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-03-04T12:36:12.479 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.472+0000 7f316ae12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.473+0000 7f316ae12800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:12.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.473+0000 7f316ae12800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-03-04T12:36:12.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.473+0000 7f316ae12800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-03-04T12:36:12.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.473+0000 7f316ae12800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 : miss 2024-03-04T12:36:12.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.473+0000 7f316ae12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.473+0000 7f316ae12800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:12.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.473+0000 7f316ae12800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 info.flags=0x17 2024-03-04T12:36:12.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.473+0000 7f316ae12800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 to cache LRU end 2024-03-04T12:36:12.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.473+0000 7f316ae12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:36:12.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.473+0000 7f316ae12800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:12.480 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.473+0000 7f316ae12800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 2024-03-04T12:36:12.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.480+0000 7f316ae12800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 info.flags=0x17 2024-03-04T12:36:12.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.480+0000 7f316ae12800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 to cache LRU end 2024-03-04T12:36:12.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.480+0000 7f316ae12800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:12.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.480+0000 7f316ae12800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25, ofs0, ns] 2024-03-04T12:36:12.486 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.480+0000 7f3049ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824095 cookie 94110450944176 notifier 6257 bl.length()=965 2024-03-04T12:36:12.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.480+0000 7f3049ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 info.flags=0x17 2024-03-04T12:36:12.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.480+0000 7f3049ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 to cache LRU end 2024-03-04T12:36:12.487 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.480+0000 7f3049ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:12.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.482+0000 7f316ae12800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25]): orig_sources= new_sources= 2024-03-04T12:36:12.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.482+0000 7f316ae12800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25]): potential sources added=[] removed=[] 2024-03-04T12:36:12.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.482+0000 7f316ae12800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25]): orig_dests= new_dests= 2024-03-04T12:36:12.488 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.482+0000 7f316ae12800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25]): potential dests added=[] removed=[] 2024-03-04T12:36:12.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.0 2024-03-04T12:36:12.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.0 2024-03-04T12:36:12.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.1 2024-03-04T12:36:12.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.1 2024-03-04T12:36:12.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.2 2024-03-04T12:36:12.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.2 2024-03-04T12:36:12.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.3 2024-03-04T12:36:12.491 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.3 2024-03-04T12:36:12.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.4 2024-03-04T12:36:12.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.4 2024-03-04T12:36:12.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.5 2024-03-04T12:36:12.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.5 2024-03-04T12:36:12.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.6 2024-03-04T12:36:12.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.6 2024-03-04T12:36:12.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.7 2024-03-04T12:36:12.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.7 2024-03-04T12:36:12.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.8 2024-03-04T12:36:12.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.8 2024-03-04T12:36:12.492 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.9 2024-03-04T12:36:12.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.9 2024-03-04T12:36:12.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.10 2024-03-04T12:36:12.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.10 2024-03-04T12:36:12.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.11 2024-03-04T12:36:12.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1.11 2024-03-04T12:36:12.493 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.484+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.0 2024-03-04T12:36:12.494 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.485+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1 2024-03-04T12:36:12.494 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.485+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2 2024-03-04T12:36:12.494 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.486+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.3 2024-03-04T12:36:12.494 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.486+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.4 2024-03-04T12:36:12.494 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.487+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.5 2024-03-04T12:36:12.494 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.487+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.6 2024-03-04T12:36:12.494 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.488+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.7 2024-03-04T12:36:12.495 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.488+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.8 2024-03-04T12:36:12.495 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.489+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.9 2024-03-04T12:36:12.495 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.489+0000 7f316ae12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.10 2024-03-04T12:36:12.498 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.492+0000 7f316ae12800 -1 Injecting error=-5 at location=commit_target_layout 2024-03-04T12:36:12.499 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.492+0000 7f316ae12800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-03-04T12:36:12.504 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.498+0000 7f301cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:12.506 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.500+0000 7f316ae12800 20 remove_watcher() i=0 2024-03-04T12:36:12.506 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.500+0000 7f316ae12800 2 removed watcher, disabling cache 2024-03-04T12:36:12.507 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.501+0000 7f316ae12800 20 remove_watcher() i=1 2024-03-04T12:36:12.512 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.502+0000 7f316ae12800 20 remove_watcher() i=2 2024-03-04T12:36:12.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.503+0000 7f316ae12800 20 remove_watcher() i=3 2024-03-04T12:36:12.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.504+0000 7f316ae12800 20 remove_watcher() i=4 2024-03-04T12:36:12.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.505+0000 7f316ae12800 20 remove_watcher() i=5 2024-03-04T12:36:12.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.506+0000 7f316ae12800 20 remove_watcher() i=6 2024-03-04T12:36:12.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.507+0000 7f316ae12800 20 remove_watcher() i=7 2024-03-04T12:36:12.523 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-04T12:36:12.551 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:12.551 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:12.585 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.578+0000 7f295ac39800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.579+0000 7f295ac39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.579+0000 7f295ac39800 20 realm 2024-03-04T12:36:12.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.579+0000 7f295ac39800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.580+0000 7f295ac39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.580+0000 7f295ac39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:12.587 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.580+0000 7f295ac39800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.587 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.580+0000 7f295ac39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.587 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.580+0000 7f295ac39800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.587 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.581+0000 7f295ac39800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:12.587 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.581+0000 7f295ac39800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.581+0000 7f295ac39800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:12.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.581+0000 7f295ac39800 20 searching for the correct realm 2024-03-04T12:36:12.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.583+0000 7f295586f640 0 -- 172.21.15.110:0/2234933422 >> [v2:172.21.15.110:6800/2482344533,v1:172.21.15.110:6801/2482344533] conn(0x5596fd2056e0 msgr2=0x7f2948056870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:12.794 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.788+0000 7f2956070640 0 -- 172.21.15.110:0/2234933422 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f294c050040 msgr2=0x7f294c050420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:12.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.794+0000 7f295ac39800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:12.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.794+0000 7f295ac39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:12.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.794+0000 7f295ac39800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:12.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.794+0000 7f295ac39800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:12.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.794+0000 7f295ac39800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:12.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.794+0000 7f295ac39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:12.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.794+0000 7f295ac39800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.794+0000 7f295ac39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.794+0000 7f295ac39800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.794+0000 7f295ac39800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:12.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.794+0000 7f295ac39800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.795+0000 7f295ac39800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:12.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.795+0000 7f295ac39800 20 zone default found 2024-03-04T12:36:12.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.795+0000 7f295ac39800 4 Realm: () 2024-03-04T12:36:12.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.795+0000 7f295ac39800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:12.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.795+0000 7f295ac39800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:12.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.795+0000 7f295ac39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:12.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.795+0000 7f295ac39800 20 zonegroup default 2024-03-04T12:36:12.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.795+0000 7f295ac39800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.795+0000 7f295ac39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.795+0000 7f295ac39800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.795+0000 7f295ac39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.795+0000 7f295ac39800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.796+0000 7f295ac39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.796+0000 7f295ac39800 20 started sync module instance, tier type = 2024-03-04T12:36:12.804 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.796+0000 7f295ac39800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:12.811 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.805+0000 7f295ac39800 20 add_watcher() i=0 2024-03-04T12:36:12.811 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.805+0000 7f295ac39800 20 add_watcher() i=1 2024-03-04T12:36:12.811 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.805+0000 7f295ac39800 20 add_watcher() i=2 2024-03-04T12:36:12.811 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.805+0000 7f295ac39800 20 add_watcher() i=3 2024-03-04T12:36:12.812 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.805+0000 7f295ac39800 20 add_watcher() i=4 2024-03-04T12:36:12.812 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.805+0000 7f295ac39800 20 add_watcher() i=5 2024-03-04T12:36:12.812 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.805+0000 7f295ac39800 20 add_watcher() i=6 2024-03-04T12:36:12.812 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.806+0000 7f295ac39800 20 add_watcher() i=7 2024-03-04T12:36:12.812 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.806+0000 7f295ac39800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:12.814 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.808+0000 7f28077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:12.815 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.808+0000 7f295ac39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:12.815 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.808+0000 7f295ac39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:12.815 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.808+0000 7f295ac39800 5 note: GC not initialized 2024-03-04T12:36:12.815 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.808+0000 7f28067fc640 20 reqs_thread_entry: start 2024-03-04T12:36:12.815 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.808+0000 7f295ac39800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:12.815 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.808+0000 7f295ac39800 20 Filter name: none 2024-03-04T12:36:12.815 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.808+0000 7f2777fff640 20 reqs_thread_entry: start 2024-03-04T12:36:12.815 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.809+0000 7f295ac39800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.816 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.809+0000 7f295ac39800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:12.816 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.809+0000 7f295ac39800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.817 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.809+0000 7f295ac39800 20 rados_obj.operate() r=0 bl.length=425 2024-03-04T12:36:12.817 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.809+0000 7f295ac39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:12.817 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.809+0000 7f295ac39800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.817 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.810+0000 7f295ac39800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:12.817 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.810+0000 7f295ac39800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.817 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.810+0000 7f295ac39800 20 rados_obj.operate() r=0 bl.length=425 2024-03-04T12:36:12.817 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.810+0000 7f295ac39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:12.818 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.811+0000 7f295ac39800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.818 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.811+0000 7f295ac39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.818 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.812+0000 7f28077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:12.821 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.815+0000 7f295ac39800 20 remove_watcher() i=0 2024-03-04T12:36:12.821 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.815+0000 7f295ac39800 2 removed watcher, disabling cache 2024-03-04T12:36:12.822 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.816+0000 7f295ac39800 20 remove_watcher() i=1 2024-03-04T12:36:12.823 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.816+0000 7f295ac39800 20 remove_watcher() i=2 2024-03-04T12:36:12.824 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.817+0000 7f295ac39800 20 remove_watcher() i=3 2024-03-04T12:36:12.824 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.818+0000 7f295ac39800 20 remove_watcher() i=4 2024-03-04T12:36:12.826 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.819+0000 7f295ac39800 20 remove_watcher() i=5 2024-03-04T12:36:12.826 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.820+0000 7f295ac39800 20 remove_watcher() i=6 2024-03-04T12:36:12.827 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.821+0000 7f295ac39800 20 remove_watcher() i=7 2024-03-04T12:36:12.837 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:12.837 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:36:12.837 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: error-at-commit-target-layout id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:36:12.837 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:12.839 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:12.839 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:12.865 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:12.865 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:12.921 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:36:12.951 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:12.951 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:12.983 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.977+0000 7f6dc1342800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.984 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.978+0000 7f6dc1342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.978+0000 7f6dc1342800 20 realm 2024-03-04T12:36:12.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.978+0000 7f6dc1342800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.978+0000 7f6dc1342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.978+0000 7f6dc1342800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:12.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.978+0000 7f6dc1342800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.978+0000 7f6dc1342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:12.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.978+0000 7f6dc1342800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.979+0000 7f6dc1342800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:12.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.979+0000 7f6dc1342800 20 rados->read ofs=0 len=0 2024-03-04T12:36:12.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.979+0000 7f6dc1342800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:12.986 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.979+0000 7f6dc1342800 20 searching for the correct realm 2024-03-04T12:36:12.989 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.983+0000 7f6dbd842640 0 -- 172.21.15.110:0/3272619942 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f6da80b3770 msgr2=0x7f6da807d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:12.992 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:12.986+0000 7f6dbd041640 0 -- 172.21.15.110:0/3272619942 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f6da8075860 msgr2=0x7f6da8001050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:13.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.192+0000 7f6dc1342800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:13.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.192+0000 7f6dc1342800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:13.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.192+0000 7f6dc1342800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:13.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.192+0000 7f6dc1342800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:13.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.192+0000 7f6dc1342800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:13.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.192+0000 7f6dc1342800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:13.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.192+0000 7f6dc1342800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.192+0000 7f6dc1342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:13.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.192+0000 7f6dc1342800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.192+0000 7f6dc1342800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:13.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.192+0000 7f6dc1342800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.193+0000 7f6dc1342800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:13.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.193+0000 7f6dc1342800 20 zone default found 2024-03-04T12:36:13.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.193+0000 7f6dc1342800 4 Realm: () 2024-03-04T12:36:13.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.193+0000 7f6dc1342800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:13.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.193+0000 7f6dc1342800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:13.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.193+0000 7f6dc1342800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:13.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.193+0000 7f6dc1342800 20 zonegroup default 2024-03-04T12:36:13.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.193+0000 7f6dc1342800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.193+0000 7f6dc1342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:13.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.193+0000 7f6dc1342800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.193+0000 7f6dc1342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:13.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.193+0000 7f6dc1342800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.194+0000 7f6dc1342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:13.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.194+0000 7f6dc1342800 20 started sync module instance, tier type = 2024-03-04T12:36:13.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.194+0000 7f6dc1342800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:13.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.203+0000 7f6dc1342800 20 add_watcher() i=0 2024-03-04T12:36:13.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.203+0000 7f6dc1342800 20 add_watcher() i=1 2024-03-04T12:36:13.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.203+0000 7f6dc1342800 20 add_watcher() i=2 2024-03-04T12:36:13.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.203+0000 7f6dc1342800 20 add_watcher() i=3 2024-03-04T12:36:13.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.203+0000 7f6dc1342800 20 add_watcher() i=4 2024-03-04T12:36:13.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.203+0000 7f6dc1342800 20 add_watcher() i=5 2024-03-04T12:36:13.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.203+0000 7f6dc1342800 20 add_watcher() i=6 2024-03-04T12:36:13.210 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.204+0000 7f6dc1342800 20 add_watcher() i=7 2024-03-04T12:36:13.210 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.204+0000 7f6dc1342800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:13.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.206+0000 7f6c737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:13.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.206+0000 7f6dc1342800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:13.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.206+0000 7f6dc1342800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:13.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.206+0000 7f6dc1342800 5 note: GC not initialized 2024-03-04T12:36:13.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.206+0000 7f6c727e4640 20 reqs_thread_entry: start 2024-03-04T12:36:13.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.206+0000 7f6dc1342800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:13.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.206+0000 7f6dc1342800 20 Filter name: none 2024-03-04T12:36:13.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.206+0000 7f6be3fff640 20 reqs_thread_entry: start 2024-03-04T12:36:13.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.207+0000 7f6dc1342800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-03-04T12:36:13.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.207+0000 7f6dc1342800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.207+0000 7f6dc1342800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:13.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.207+0000 7f6dc1342800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-03-04T12:36:13.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.207+0000 7f6dc1342800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-03-04T12:36:13.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.207+0000 7f6dc1342800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 : miss 2024-03-04T12:36:13.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.207+0000 7f6dc1342800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.208+0000 7f6dc1342800 20 rados_obj.operate() r=0 bl.length=425 2024-03-04T12:36:13.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.208+0000 7f6dc1342800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 info.flags=0x17 2024-03-04T12:36:13.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.208+0000 7f6dc1342800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 to cache LRU end 2024-03-04T12:36:13.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.208+0000 7f6dc1342800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:36:13.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.208+0000 7f6dc1342800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:13.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.208+0000 7f6dc1342800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 2024-03-04T12:36:13.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.209+0000 7f6dc1342800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-03-04T12:36:13.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.215+0000 7f6dc1342800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 info.flags=0x17 2024-03-04T12:36:13.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.215+0000 7f6dc1342800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 to cache LRU end 2024-03-04T12:36:13.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.215+0000 7f6dc1342800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:13.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.215+0000 7f6dc1342800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25, ofs0, ns] 2024-03-04T12:36:13.222 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.215+0000 7f6c8ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824096 cookie 94208561030112 notifier 6717 bl.length()=965 2024-03-04T12:36:13.222 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.215+0000 7f6c8ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 info.flags=0x17 2024-03-04T12:36:13.222 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.215+0000 7f6c8ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 to cache LRU end 2024-03-04T12:36:13.222 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.215+0000 7f6c8ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:13.223 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.217+0000 7f6dc1342800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25]): orig_sources= new_sources= 2024-03-04T12:36:13.223 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.217+0000 7f6dc1342800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25]): potential sources added=[] removed=[] 2024-03-04T12:36:13.224 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.217+0000 7f6dc1342800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25]): orig_dests= new_dests= 2024-03-04T12:36:13.224 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.217+0000 7f6dc1342800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25]): potential dests added=[] removed=[] 2024-03-04T12:36:13.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.0 2024-03-04T12:36:13.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.0 2024-03-04T12:36:13.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.1 2024-03-04T12:36:13.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.1 2024-03-04T12:36:13.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.2 2024-03-04T12:36:13.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.2 2024-03-04T12:36:13.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.3 2024-03-04T12:36:13.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.3 2024-03-04T12:36:13.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.4 2024-03-04T12:36:13.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.4 2024-03-04T12:36:13.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.5 2024-03-04T12:36:13.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.5 2024-03-04T12:36:13.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.6 2024-03-04T12:36:13.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.6 2024-03-04T12:36:13.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.7 2024-03-04T12:36:13.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.7 2024-03-04T12:36:13.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.8 2024-03-04T12:36:13.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.8 2024-03-04T12:36:13.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.9 2024-03-04T12:36:13.227 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.9 2024-03-04T12:36:13.228 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.10 2024-03-04T12:36:13.228 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.10 2024-03-04T12:36:13.228 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.11 2024-03-04T12:36:13.228 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2.11 2024-03-04T12:36:13.228 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.0 2024-03-04T12:36:13.228 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.1 2024-03-04T12:36:13.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.220+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.2 2024-03-04T12:36:13.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.221+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.3 2024-03-04T12:36:13.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.221+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.4 2024-03-04T12:36:13.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.222+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.5 2024-03-04T12:36:13.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.222+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.6 2024-03-04T12:36:13.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.223+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.7 2024-03-04T12:36:13.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.223+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.8 2024-03-04T12:36:13.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.224+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.9 2024-03-04T12:36:13.230 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.224+0000 7f6dc1342800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25.10 2024-03-04T12:36:13.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.227+0000 7f6dc1342800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 : hit (requested=0x17, cached=0x17) 2024-03-04T12:36:13.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.227+0000 7f6dc1342800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 2024-03-04T12:36:13.235 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.229+0000 7f6dc1342800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 info.flags=0x17 2024-03-04T12:36:13.235 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.229+0000 7f6dc1342800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 to cache LRU end 2024-03-04T12:36:13.235 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.229+0000 7f6dc1342800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:13.235 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.229+0000 7f6dc1342800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25, ofs0, ns] 2024-03-04T12:36:13.235 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.229+0000 7f6ca0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824097 cookie 94208561030112 notifier 6717 bl.length()=933 2024-03-04T12:36:13.235 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.229+0000 7f6ca0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 info.flags=0x17 2024-03-04T12:36:13.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.229+0000 7f6ca0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 to cache LRU end 2024-03-04T12:36:13.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.229+0000 7f6ca0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:13.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.231+0000 7f6dc1342800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25]): orig_sources= new_sources= 2024-03-04T12:36:13.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.231+0000 7f6dc1342800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25]): potential sources added=[] removed=[] 2024-03-04T12:36:13.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.231+0000 7f6dc1342800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25]): orig_dests= new_dests= 2024-03-04T12:36:13.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.231+0000 7f6dc1342800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25]): potential dests added=[] removed=[] 2024-03-04T12:36:13.239 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.233+0000 7f6dc1342800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-03-04T12:36:13.241 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.235+0000 7f6c737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:13.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.237+0000 7f6dc1342800 20 remove_watcher() i=0 2024-03-04T12:36:13.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.237+0000 7f6dc1342800 2 removed watcher, disabling cache 2024-03-04T12:36:13.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.238+0000 7f6dc1342800 20 remove_watcher() i=1 2024-03-04T12:36:13.245 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.239+0000 7f6dc1342800 20 remove_watcher() i=2 2024-03-04T12:36:13.246 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.240+0000 7f6dc1342800 20 remove_watcher() i=3 2024-03-04T12:36:13.247 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.241+0000 7f6dc1342800 20 remove_watcher() i=4 2024-03-04T12:36:13.248 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.242+0000 7f6dc1342800 20 remove_watcher() i=5 2024-03-04T12:36:13.249 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.242+0000 7f6dc1342800 20 remove_watcher() i=6 2024-03-04T12:36:13.249 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.243+0000 7f6dc1342800 20 remove_watcher() i=7 2024-03-04T12:36:13.260 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-04T12:36:13.288 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:13.288 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:13.321 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.315+0000 7f734ee13800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.323 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.316+0000 7f734ee13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:13.323 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.316+0000 7f734ee13800 20 realm 2024-03-04T12:36:13.323 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.316+0000 7f734ee13800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.323 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.316+0000 7f734ee13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:13.323 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.316+0000 7f734ee13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:13.323 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.316+0000 7f734ee13800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.323 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.317+0000 7f734ee13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:13.323 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.317+0000 7f734ee13800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.317+0000 7f734ee13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:13.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.317+0000 7f734ee13800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.318+0000 7f734ee13800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:13.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.318+0000 7f734ee13800 20 searching for the correct realm 2024-03-04T12:36:13.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.320+0000 7f734a3de640 0 -- 172.21.15.110:0/3049838472 >> [v2:172.21.15.110:6800/2482344533,v1:172.21.15.110:6801/2482344533] conn(0x7f7338003bb0 msgr2=0x7f7344023400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:13.531 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.525+0000 7f734abdf640 0 -- 172.21.15.110:0/3049838472 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f7334063030 msgr2=0x7f733407a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:13.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.531+0000 7f734ee13800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:13.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.531+0000 7f734ee13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:13.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.531+0000 7f734ee13800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:13.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.531+0000 7f734ee13800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:13.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.531+0000 7f734ee13800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:13.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.531+0000 7f734ee13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:13.538 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.531+0000 7f734ee13800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.532+0000 7f734ee13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:13.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.532+0000 7f734ee13800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.532+0000 7f734ee13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:13.539 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.532+0000 7f734ee13800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.532+0000 7f734ee13800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:13.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.532+0000 7f734ee13800 20 zone default found 2024-03-04T12:36:13.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.532+0000 7f734ee13800 4 Realm: () 2024-03-04T12:36:13.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.532+0000 7f734ee13800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:13.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.532+0000 7f734ee13800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:13.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.532+0000 7f734ee13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:13.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.532+0000 7f734ee13800 20 zonegroup default 2024-03-04T12:36:13.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.532+0000 7f734ee13800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.532+0000 7f734ee13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:13.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.532+0000 7f734ee13800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.533+0000 7f734ee13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:13.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.533+0000 7f734ee13800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.533+0000 7f734ee13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:13.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.533+0000 7f734ee13800 20 started sync module instance, tier type = 2024-03-04T12:36:13.541 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.533+0000 7f734ee13800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:13.548 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.542+0000 7f734ee13800 20 add_watcher() i=0 2024-03-04T12:36:13.548 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.542+0000 7f734ee13800 20 add_watcher() i=1 2024-03-04T12:36:13.548 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.542+0000 7f734ee13800 20 add_watcher() i=2 2024-03-04T12:36:13.548 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.542+0000 7f734ee13800 20 add_watcher() i=3 2024-03-04T12:36:13.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.542+0000 7f734ee13800 20 add_watcher() i=4 2024-03-04T12:36:13.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.542+0000 7f734ee13800 20 add_watcher() i=5 2024-03-04T12:36:13.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.542+0000 7f734ee13800 20 add_watcher() i=6 2024-03-04T12:36:13.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.543+0000 7f734ee13800 20 add_watcher() i=7 2024-03-04T12:36:13.549 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.543+0000 7f734ee13800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:13.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.545+0000 7f7200fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:13.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.545+0000 7f734ee13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:13.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.545+0000 7f734ee13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:13.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.545+0000 7f734ee13800 5 note: GC not initialized 2024-03-04T12:36:13.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.545+0000 7f717b7fe640 20 reqs_thread_entry: start 2024-03-04T12:36:13.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.545+0000 7f734ee13800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:13.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.545+0000 7f734ee13800 20 Filter name: none 2024-03-04T12:36:13.552 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.545+0000 7f71797fa640 20 reqs_thread_entry: start 2024-03-04T12:36:13.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.546+0000 7f734ee13800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.546+0000 7f734ee13800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:13.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.546+0000 7f734ee13800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.547+0000 7f734ee13800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:13.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.547+0000 7f734ee13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:13.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.547+0000 7f734ee13800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.547+0000 7f734ee13800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:13.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.547+0000 7f734ee13800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.547+0000 7f734ee13800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:13.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.547+0000 7f734ee13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:13.555 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.548+0000 7f734ee13800 20 rados->read ofs=0 len=0 2024-03-04T12:36:13.555 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.549+0000 7f734ee13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:13.555 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.549+0000 7f7200fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:13.558 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.552+0000 7f734ee13800 20 remove_watcher() i=0 2024-03-04T12:36:13.558 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.552+0000 7f734ee13800 2 removed watcher, disabling cache 2024-03-04T12:36:13.559 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.553+0000 7f734ee13800 20 remove_watcher() i=1 2024-03-04T12:36:13.560 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.554+0000 7f734ee13800 20 remove_watcher() i=2 2024-03-04T12:36:13.561 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.555+0000 7f734ee13800 20 remove_watcher() i=3 2024-03-04T12:36:13.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.556+0000 7f734ee13800 20 remove_watcher() i=4 2024-03-04T12:36:13.563 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.557+0000 7f734ee13800 20 remove_watcher() i=5 2024-03-04T12:36:13.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.558+0000 7f734ee13800 20 remove_watcher() i=6 2024-03-04T12:36:13.565 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:13.559+0000 7f734ee13800 20 remove_watcher() i=7 2024-03-04T12:36:13.574 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:13.575 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:36:13.575 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: error-at-commit-target-layout id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-04T12:36:13.575 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:13.577 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:13.577 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:13.594 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:13.594 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:13.747 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:13.747 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:13.871 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-03-04T12:36:13.871 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:13.872 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:13.872 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:13.916 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:13.916 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:13.969 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:13.970 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:13.998 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:13.998 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.026 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.026 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.055 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.055 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.087 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.087 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.113 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.113 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.141 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.141 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.170 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.170 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.200 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.200 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.227 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.227 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.255 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.255 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.284 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.284 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.312 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.312 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.340 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.340 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.369 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.369 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.397 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.397 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.427 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.427 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.455 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.455 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.483 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.483 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.512 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:14.512 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:14.570 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-04T12:36:14.597 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:14.597 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:14.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.623+0000 7fe29473b800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.631 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.625+0000 7fe29473b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.631 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.625+0000 7fe29473b800 20 realm 2024-03-04T12:36:14.631 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.625+0000 7fe29473b800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.631 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.625+0000 7fe29473b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.631 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.625+0000 7fe29473b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:14.632 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.625+0000 7fe29473b800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.632 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.625+0000 7fe29473b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.632 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.625+0000 7fe29473b800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.632 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.626+0000 7fe29473b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:14.632 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.626+0000 7fe29473b800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.633 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.626+0000 7fe29473b800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:14.633 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.626+0000 7fe29473b800 20 searching for the correct realm 2024-03-04T12:36:14.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.630+0000 7fe287fff640 0 -- 172.21.15.110:0/699653384 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x55fe2512f6a0 msgr2=0x55fe25131ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:14.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.633+0000 7fe2904cd640 0 -- 172.21.15.110:0/699653384 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fe278024bb0 msgr2=0x7fe278061040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:14.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.637+0000 7fe29473b800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:14.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.637+0000 7fe29473b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:14.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.637+0000 7fe29473b800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:14.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.637+0000 7fe29473b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:14.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.637+0000 7fe29473b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:14.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.637+0000 7fe29473b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:14.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.637+0000 7fe29473b800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.638+0000 7fe29473b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.638+0000 7fe29473b800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.638+0000 7fe29473b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:14.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.638+0000 7fe29473b800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.638+0000 7fe29473b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:14.646 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.638+0000 7fe29473b800 20 zone default found 2024-03-04T12:36:14.647 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.638+0000 7fe29473b800 4 Realm: () 2024-03-04T12:36:14.647 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.638+0000 7fe29473b800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:14.647 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.638+0000 7fe29473b800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:14.647 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.638+0000 7fe29473b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:14.647 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.638+0000 7fe29473b800 20 zonegroup default 2024-03-04T12:36:14.647 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.638+0000 7fe29473b800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.647 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.638+0000 7fe29473b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.647 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.639+0000 7fe29473b800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.647 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.639+0000 7fe29473b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.647 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.639+0000 7fe29473b800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.647 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.639+0000 7fe29473b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.648 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.639+0000 7fe29473b800 20 started sync module instance, tier type = 2024-03-04T12:36:14.648 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.639+0000 7fe29473b800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:14.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.648+0000 7fe29473b800 20 add_watcher() i=0 2024-03-04T12:36:14.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.648+0000 7fe29473b800 20 add_watcher() i=1 2024-03-04T12:36:14.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.648+0000 7fe29473b800 20 add_watcher() i=2 2024-03-04T12:36:14.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.648+0000 7fe29473b800 20 add_watcher() i=3 2024-03-04T12:36:14.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.648+0000 7fe29473b800 20 add_watcher() i=4 2024-03-04T12:36:14.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.648+0000 7fe29473b800 20 add_watcher() i=5 2024-03-04T12:36:14.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.648+0000 7fe29473b800 20 add_watcher() i=6 2024-03-04T12:36:14.656 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.649+0000 7fe29473b800 20 add_watcher() i=7 2024-03-04T12:36:14.656 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.649+0000 7fe29473b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:14.657 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.651+0000 7fe146fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:14.658 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.651+0000 7fe29473b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:14.658 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.651+0000 7fe29473b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:14.658 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.651+0000 7fe29473b800 5 note: GC not initialized 2024-03-04T12:36:14.658 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.651+0000 7fe145fdb640 20 reqs_thread_entry: start 2024-03-04T12:36:14.658 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.651+0000 7fe29473b800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:14.658 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.651+0000 7fe29473b800 20 Filter name: none 2024-03-04T12:36:14.658 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.652+0000 7fe0b77fe640 20 reqs_thread_entry: start 2024-03-04T12:36:14.658 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.652+0000 7fe29473b800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.659 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.652+0000 7fe29473b800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:14.659 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.652+0000 7fe29473b800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.659 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.653+0000 7fe29473b800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:14.659 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.653+0000 7fe29473b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:14.660 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.653+0000 7fe29473b800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.660 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.653+0000 7fe29473b800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:14.660 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.653+0000 7fe29473b800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.660 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.654+0000 7fe29473b800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:14.660 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.654+0000 7fe29473b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:14.661 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.655+0000 7fe29473b800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.661 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.655+0000 7fe29473b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.662 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.656+0000 7fe146fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:14.664 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.658+0000 7fe29473b800 20 remove_watcher() i=0 2024-03-04T12:36:14.664 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.658+0000 7fe29473b800 2 removed watcher, disabling cache 2024-03-04T12:36:14.665 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.659+0000 7fe29473b800 20 remove_watcher() i=1 2024-03-04T12:36:14.666 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.660+0000 7fe29473b800 20 remove_watcher() i=2 2024-03-04T12:36:14.667 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.661+0000 7fe29473b800 20 remove_watcher() i=3 2024-03-04T12:36:14.668 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.662+0000 7fe29473b800 20 remove_watcher() i=4 2024-03-04T12:36:14.669 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.663+0000 7fe29473b800 20 remove_watcher() i=5 2024-03-04T12:36:14.670 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.664+0000 7fe29473b800 20 remove_watcher() i=6 2024-03-04T12:36:14.671 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.665+0000 7fe29473b800 20 remove_watcher() i=7 2024-03-04T12:36:14.681 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:14.681 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:36:14.681 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: error-at-commit-target-layout id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:36:14.681 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:14.682 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-03-04T12:36:14.717 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:14.717 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:14.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.744+0000 7ffa00a12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.745+0000 7ffa00a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.745+0000 7ffa00a12800 20 realm 2024-03-04T12:36:14.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.745+0000 7ffa00a12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.745+0000 7ffa00a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.745+0000 7ffa00a12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:14.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.745+0000 7ffa00a12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.745+0000 7ffa00a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.745+0000 7ffa00a12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.746+0000 7ffa00a12800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:14.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.746+0000 7ffa00a12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.746+0000 7ffa00a12800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:14.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.746+0000 7ffa00a12800 20 searching for the correct realm 2024-03-04T12:36:14.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.750+0000 7ff9fc882640 0 -- 172.21.15.110:0/1762474611 >> [v2:172.21.15.110:6824/3005097257,v1:172.21.15.110:6825/3005097257] conn(0x5590d939da20 msgr2=0x5590d939fee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:14.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.753+0000 7ff9f3880640 0 -- 172.21.15.110:0/1762474611 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7ff9ec074030 msgr2=0x7ff9ec060460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:14.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.757+0000 7ffa00a12800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:14.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.757+0000 7ffa00a12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:14.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.757+0000 7ffa00a12800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:14.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.757+0000 7ffa00a12800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:14.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.757+0000 7ffa00a12800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:14.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.757+0000 7ffa00a12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:14.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.757+0000 7ffa00a12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.757+0000 7ffa00a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.757+0000 7ffa00a12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.758+0000 7ffa00a12800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:14.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.758+0000 7ffa00a12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.758+0000 7ffa00a12800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:14.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.758+0000 7ffa00a12800 20 zone default found 2024-03-04T12:36:14.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.758+0000 7ffa00a12800 4 Realm: () 2024-03-04T12:36:14.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.758+0000 7ffa00a12800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:14.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.758+0000 7ffa00a12800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:14.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.758+0000 7ffa00a12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:14.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.758+0000 7ffa00a12800 20 zonegroup default 2024-03-04T12:36:14.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.758+0000 7ffa00a12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.758+0000 7ffa00a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.758+0000 7ffa00a12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.759+0000 7ffa00a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.759+0000 7ffa00a12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.759+0000 7ffa00a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.759+0000 7ffa00a12800 20 started sync module instance, tier type = 2024-03-04T12:36:14.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.759+0000 7ffa00a12800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:14.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.768+0000 7ffa00a12800 20 add_watcher() i=0 2024-03-04T12:36:14.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.768+0000 7ffa00a12800 20 add_watcher() i=1 2024-03-04T12:36:14.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.768+0000 7ffa00a12800 20 add_watcher() i=2 2024-03-04T12:36:14.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.768+0000 7ffa00a12800 20 add_watcher() i=3 2024-03-04T12:36:14.774 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.768+0000 7ffa00a12800 20 add_watcher() i=4 2024-03-04T12:36:14.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.768+0000 7ffa00a12800 20 add_watcher() i=5 2024-03-04T12:36:14.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.768+0000 7ffa00a12800 20 add_watcher() i=6 2024-03-04T12:36:14.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.769+0000 7ffa00a12800 20 add_watcher() i=7 2024-03-04T12:36:14.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.769+0000 7ffa00a12800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:14.776 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.770+0000 7ff8b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:14.778 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.771+0000 7ffa00a12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:14.778 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.771+0000 7ffa00a12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:14.778 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.771+0000 7ffa00a12800 5 note: GC not initialized 2024-03-04T12:36:14.778 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.771+0000 7ff8b17e2640 20 reqs_thread_entry: start 2024-03-04T12:36:14.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.771+0000 7ffa00a12800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:14.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.771+0000 7ffa00a12800 20 Filter name: none 2024-03-04T12:36:14.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.771+0000 7ff82affd640 20 reqs_thread_entry: start 2024-03-04T12:36:14.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.771+0000 7ffa00a12800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-03-04T12:36:14.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.771+0000 7ffa00a12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.771+0000 7ffa00a12800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:14.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.771+0000 7ffa00a12800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-03-04T12:36:14.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.771+0000 7ffa00a12800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-03-04T12:36:14.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.771+0000 7ffa00a12800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26 : miss 2024-03-04T12:36:14.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.771+0000 7ffa00a12800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.772+0000 7ffa00a12800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:14.779 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.772+0000 7ffa00a12800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26 info.flags=0x17 2024-03-04T12:36:14.780 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.772+0000 7ffa00a12800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26 to cache LRU end 2024-03-04T12:36:14.780 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.772+0000 7ffa00a12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:36:14.780 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.772+0000 7ffa00a12800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:14.780 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.772+0000 7ffa00a12800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26 2024-03-04T12:36:14.783 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.777+0000 7ffa00a12800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26 info.flags=0x17 2024-03-04T12:36:14.783 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.777+0000 7ffa00a12800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26 to cache LRU end 2024-03-04T12:36:14.783 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.777+0000 7ffa00a12800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:14.783 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.777+0000 7ffa00a12800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26, ofs0, ns] 2024-03-04T12:36:14.784 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.777+0000 7ff8db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824102 cookie 94080608159888 notifier 6341 bl.length()=965 2024-03-04T12:36:14.784 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.777+0000 7ff8db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26 info.flags=0x17 2024-03-04T12:36:14.784 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.777+0000 7ff8db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26 to cache LRU end 2024-03-04T12:36:14.784 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.777+0000 7ff8db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:14.785 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.779+0000 7ffa00a12800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26]): orig_sources= new_sources= 2024-03-04T12:36:14.785 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.779+0000 7ffa00a12800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26]): potential sources added=[] removed=[] 2024-03-04T12:36:14.785 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.779+0000 7ffa00a12800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26]): orig_dests= new_dests= 2024-03-04T12:36:14.785 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.779+0000 7ffa00a12800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26]): potential dests added=[] removed=[] 2024-03-04T12:36:14.788 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.0 2024-03-04T12:36:14.788 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.0 2024-03-04T12:36:14.788 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.1 2024-03-04T12:36:14.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.1 2024-03-04T12:36:14.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.2 2024-03-04T12:36:14.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.2 2024-03-04T12:36:14.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.3 2024-03-04T12:36:14.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.3 2024-03-04T12:36:14.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.4 2024-03-04T12:36:14.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.4 2024-03-04T12:36:14.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.5 2024-03-04T12:36:14.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.5 2024-03-04T12:36:14.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.6 2024-03-04T12:36:14.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.6 2024-03-04T12:36:14.789 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.7 2024-03-04T12:36:14.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.7 2024-03-04T12:36:14.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.8 2024-03-04T12:36:14.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.8 2024-03-04T12:36:14.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.9 2024-03-04T12:36:14.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.9 2024-03-04T12:36:14.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.10 2024-03-04T12:36:14.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.10 2024-03-04T12:36:14.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.11 2024-03-04T12:36:14.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1.11 2024-03-04T12:36:14.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.0 2024-03-04T12:36:14.790 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.782+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.1 2024-03-04T12:36:14.791 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.783+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.2 2024-03-04T12:36:14.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.783+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.3 2024-03-04T12:36:14.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.784+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.4 2024-03-04T12:36:14.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.784+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.5 2024-03-04T12:36:14.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.785+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.6 2024-03-04T12:36:14.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.785+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.7 2024-03-04T12:36:14.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.785+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.8 2024-03-04T12:36:14.792 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.786+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.9 2024-03-04T12:36:14.793 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.787+0000 7ffa00a12800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26.10 2024-03-04T12:36:14.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.790+0000 7ffa00a12800 -1 Injecting error=-125 at location=commit_target_layout 2024-03-04T12:36:14.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.790+0000 7ffa00a12800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26 : hit (requested=0x17, cached=0x17) 2024-03-04T12:36:14.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.790+0000 7ffa00a12800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26 2024-03-04T12:36:14.797 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.791+0000 7ffa00a12800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26 info.flags=0x17 2024-03-04T12:36:14.797 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.791+0000 7ffa00a12800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26 to cache LRU end 2024-03-04T12:36:14.797 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.791+0000 7ffa00a12800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:14.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.791+0000 7ffa00a12800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26, ofs0, ns] 2024-03-04T12:36:14.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.791+0000 7ff8daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824103 cookie 94080608159888 notifier 6341 bl.length()=933 2024-03-04T12:36:14.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.792+0000 7ff8daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26 info.flags=0x17 2024-03-04T12:36:14.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.792+0000 7ff8daffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26 to cache LRU end 2024-03-04T12:36:14.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.792+0000 7ff8daffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:14.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.793+0000 7ffa00a12800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26]): orig_sources= new_sources= 2024-03-04T12:36:14.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.793+0000 7ffa00a12800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26]): potential sources added=[] removed=[] 2024-03-04T12:36:14.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.793+0000 7ffa00a12800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26]): orig_dests= new_dests= 2024-03-04T12:36:14.800 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.793+0000 7ffa00a12800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26]): potential dests added=[] removed=[] 2024-03-04T12:36:14.801 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.795+0000 7ffa00a12800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-03-04T12:36:14.803 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.797+0000 7ff8b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:14.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.799+0000 7ffa00a12800 20 remove_watcher() i=0 2024-03-04T12:36:14.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.799+0000 7ffa00a12800 2 removed watcher, disabling cache 2024-03-04T12:36:14.806 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.800+0000 7ffa00a12800 20 remove_watcher() i=1 2024-03-04T12:36:14.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.801+0000 7ffa00a12800 20 remove_watcher() i=2 2024-03-04T12:36:14.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.802+0000 7ffa00a12800 20 remove_watcher() i=3 2024-03-04T12:36:14.809 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.803+0000 7ffa00a12800 20 remove_watcher() i=4 2024-03-04T12:36:14.810 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.804+0000 7ffa00a12800 20 remove_watcher() i=5 2024-03-04T12:36:14.811 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.805+0000 7ffa00a12800 20 remove_watcher() i=6 2024-03-04T12:36:14.812 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.806+0000 7ffa00a12800 20 remove_watcher() i=7 2024-03-04T12:36:14.822 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-04T12:36:14.852 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:14.852 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:14.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.877+0000 7fe042430800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.879+0000 7fe042430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.879+0000 7fe042430800 20 realm 2024-03-04T12:36:14.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.879+0000 7fe042430800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.879+0000 7fe042430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.879+0000 7fe042430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:14.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.879+0000 7fe042430800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.879+0000 7fe042430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:14.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.879+0000 7fe042430800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.880+0000 7fe042430800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:14.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.880+0000 7fe042430800 20 rados->read ofs=0 len=0 2024-03-04T12:36:14.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.880+0000 7fe042430800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:14.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.880+0000 7fe042430800 20 searching for the correct realm 2024-03-04T12:36:14.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.883+0000 7fe03df31640 0 -- 172.21.15.110:0/240919446 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7fe028084040 msgr2=0x7fe028084420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:14.893 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:14.887+0000 7fe03d730640 0 -- 172.21.15.110:0/240919446 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fe028078420 msgr2=0x7fe028078880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:15.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.093+0000 7fe042430800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:15.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.093+0000 7fe042430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:15.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.093+0000 7fe042430800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:15.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.093+0000 7fe042430800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:15.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.093+0000 7fe042430800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:15.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.093+0000 7fe042430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:15.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.093+0000 7fe042430800 20 rados->read ofs=0 len=0 2024-03-04T12:36:15.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.094+0000 7fe042430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:15.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.094+0000 7fe042430800 20 rados->read ofs=0 len=0 2024-03-04T12:36:15.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.094+0000 7fe042430800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:15.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.094+0000 7fe042430800 20 rados->read ofs=0 len=0 2024-03-04T12:36:15.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.094+0000 7fe042430800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:15.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.094+0000 7fe042430800 20 zone default found 2024-03-04T12:36:15.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.094+0000 7fe042430800 4 Realm: () 2024-03-04T12:36:15.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.094+0000 7fe042430800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:15.102 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.094+0000 7fe042430800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:15.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.094+0000 7fe042430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:15.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.094+0000 7fe042430800 20 zonegroup default 2024-03-04T12:36:15.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.094+0000 7fe042430800 20 rados->read ofs=0 len=0 2024-03-04T12:36:15.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.095+0000 7fe042430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:15.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.095+0000 7fe042430800 20 rados->read ofs=0 len=0 2024-03-04T12:36:15.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.095+0000 7fe042430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:15.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.095+0000 7fe042430800 20 rados->read ofs=0 len=0 2024-03-04T12:36:15.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.095+0000 7fe042430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:15.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.095+0000 7fe042430800 20 started sync module instance, tier type = 2024-03-04T12:36:15.103 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.095+0000 7fe042430800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:15.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.104+0000 7fe042430800 20 add_watcher() i=0 2024-03-04T12:36:15.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.104+0000 7fe042430800 20 add_watcher() i=1 2024-03-04T12:36:15.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.104+0000 7fe042430800 20 add_watcher() i=2 2024-03-04T12:36:15.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.104+0000 7fe042430800 20 add_watcher() i=3 2024-03-04T12:36:15.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.104+0000 7fe042430800 20 add_watcher() i=4 2024-03-04T12:36:15.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.104+0000 7fe042430800 20 add_watcher() i=5 2024-03-04T12:36:15.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.104+0000 7fe042430800 20 add_watcher() i=6 2024-03-04T12:36:15.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.105+0000 7fe042430800 20 add_watcher() i=7 2024-03-04T12:36:15.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.105+0000 7fe042430800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:15.113 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.107+0000 7fdef37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:15.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.107+0000 7fe042430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:15.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.107+0000 7fe042430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:15.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.107+0000 7fe042430800 5 note: GC not initialized 2024-03-04T12:36:15.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.107+0000 7fdef27e4640 20 reqs_thread_entry: start 2024-03-04T12:36:15.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.107+0000 7fe042430800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:15.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.107+0000 7fe042430800 20 Filter name: none 2024-03-04T12:36:15.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.108+0000 7fde63fff640 20 reqs_thread_entry: start 2024-03-04T12:36:15.115 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.108+0000 7fe042430800 20 rados->read ofs=0 len=0 2024-03-04T12:36:15.115 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.108+0000 7fe042430800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:15.115 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.108+0000 7fe042430800 20 rados->read ofs=0 len=0 2024-03-04T12:36:15.115 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.109+0000 7fe042430800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:15.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.109+0000 7fe042430800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:15.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.109+0000 7fe042430800 20 rados->read ofs=0 len=0 2024-03-04T12:36:15.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.109+0000 7fe042430800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:15.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.109+0000 7fe042430800 20 rados->read ofs=0 len=0 2024-03-04T12:36:15.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.110+0000 7fe042430800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:15.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.110+0000 7fe042430800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:15.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.111+0000 7fe042430800 20 rados->read ofs=0 len=0 2024-03-04T12:36:15.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.111+0000 7fe042430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:15.118 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.112+0000 7fdef37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:15.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.114+0000 7fe042430800 20 remove_watcher() i=0 2024-03-04T12:36:15.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.114+0000 7fe042430800 2 removed watcher, disabling cache 2024-03-04T12:36:15.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.115+0000 7fe042430800 20 remove_watcher() i=1 2024-03-04T12:36:15.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.116+0000 7fe042430800 20 remove_watcher() i=2 2024-03-04T12:36:15.123 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.117+0000 7fe042430800 20 remove_watcher() i=3 2024-03-04T12:36:15.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.118+0000 7fe042430800 20 remove_watcher() i=4 2024-03-04T12:36:15.125 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.119+0000 7fe042430800 20 remove_watcher() i=5 2024-03-04T12:36:15.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.120+0000 7fe042430800 20 remove_watcher() i=6 2024-03-04T12:36:15.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:15.121+0000 7fe042430800 20 remove_watcher() i=7 2024-03-04T12:36:15.136 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:15.136 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:36:15.136 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: error-at-commit-target-layout id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-03-04T12:36:15.136 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:15.138 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.139 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.155 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.156 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.310 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.311 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.439 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-03-04T12:36:15.439 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:15.440 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.440 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.485 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.485 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.540 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.540 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.569 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.569 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.597 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.597 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.624 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.625 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.652 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.652 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.681 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.681 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.710 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.710 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.738 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.738 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.767 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.767 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.796 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.796 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.824 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.824 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.855 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.855 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.884 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.884 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.914 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.914 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.941 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.941 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.969 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.969 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:15.998 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:15.998 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:16.028 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:16.028 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:16.056 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:16.056 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:16.084 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:16.084 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:16.113 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-03-04T12:36:16.140 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:16.140 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:16.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.167+0000 7fad38239800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.175 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.168+0000 7fad38239800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.175 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.168+0000 7fad38239800 20 realm 2024-03-04T12:36:16.175 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.168+0000 7fad38239800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.175 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.169+0000 7fad38239800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.175 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.169+0000 7fad38239800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:16.176 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.169+0000 7fad38239800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.176 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.169+0000 7fad38239800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.176 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.169+0000 7fad38239800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.176 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.170+0000 7fad38239800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:16.177 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.170+0000 7fad38239800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.177 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.170+0000 7fad38239800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:16.177 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.170+0000 7fad38239800 20 searching for the correct realm 2024-03-04T12:36:16.180 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.174+0000 7fad3266e640 0 -- 172.21.15.110:0/4248333548 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7fad2c043040 msgr2=0x7fad2c07aa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:16.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.178+0000 7fad33670640 0 -- 172.21.15.110:0/4248333548 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7fad2805f2c0 msgr2=0x7fad28057850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:36:16.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.182+0000 7fad38239800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:16.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.182+0000 7fad38239800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:16.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.182+0000 7fad38239800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:16.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.182+0000 7fad38239800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:16.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.182+0000 7fad38239800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:16.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.182+0000 7fad38239800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:16.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.182+0000 7fad38239800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.182+0000 7fad38239800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.182+0000 7fad38239800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.190 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.183+0000 7fad38239800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:16.190 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.183+0000 7fad38239800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.183+0000 7fad38239800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:16.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.183+0000 7fad38239800 20 zone default found 2024-03-04T12:36:16.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.183+0000 7fad38239800 4 Realm: () 2024-03-04T12:36:16.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.183+0000 7fad38239800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:16.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.183+0000 7fad38239800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:16.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.183+0000 7fad38239800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:16.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.183+0000 7fad38239800 20 zonegroup default 2024-03-04T12:36:16.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.183+0000 7fad38239800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.191 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.183+0000 7fad38239800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.192 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.183+0000 7fad38239800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.192 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.184+0000 7fad38239800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.192 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.184+0000 7fad38239800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.192 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.184+0000 7fad38239800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.192 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.184+0000 7fad38239800 20 started sync module instance, tier type = 2024-03-04T12:36:16.192 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.184+0000 7fad38239800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:16.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.193+0000 7fad38239800 20 add_watcher() i=0 2024-03-04T12:36:16.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.193+0000 7fad38239800 20 add_watcher() i=1 2024-03-04T12:36:16.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.193+0000 7fad38239800 20 add_watcher() i=2 2024-03-04T12:36:16.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.193+0000 7fad38239800 20 add_watcher() i=3 2024-03-04T12:36:16.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.193+0000 7fad38239800 20 add_watcher() i=4 2024-03-04T12:36:16.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.193+0000 7fad38239800 20 add_watcher() i=5 2024-03-04T12:36:16.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.193+0000 7fad38239800 20 add_watcher() i=6 2024-03-04T12:36:16.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.194+0000 7fad38239800 20 add_watcher() i=7 2024-03-04T12:36:16.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.194+0000 7fad38239800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:16.202 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.196+0000 7fabe97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:16.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.196+0000 7fad38239800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:16.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.196+0000 7fad38239800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:16.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.196+0000 7fad38239800 5 note: GC not initialized 2024-03-04T12:36:16.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.196+0000 7fab63fff640 20 reqs_thread_entry: start 2024-03-04T12:36:16.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.196+0000 7fad38239800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:16.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.196+0000 7fad38239800 20 Filter name: none 2024-03-04T12:36:16.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.196+0000 7fab61ffb640 20 reqs_thread_entry: start 2024-03-04T12:36:16.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.196+0000 7fad38239800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.197+0000 7fad38239800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:16.203 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.197+0000 7fad38239800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.204 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.197+0000 7fad38239800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:16.204 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.197+0000 7fad38239800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:16.204 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.197+0000 7fad38239800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.204 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.198+0000 7fad38239800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:16.205 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.198+0000 7fad38239800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.205 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.198+0000 7fad38239800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:16.205 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.198+0000 7fad38239800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:16.205 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.199+0000 7fad38239800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.205 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.199+0000 7fad38239800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.206 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.200+0000 7fabe97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:16.208 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.202+0000 7fad38239800 20 remove_watcher() i=0 2024-03-04T12:36:16.208 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.202+0000 7fad38239800 2 removed watcher, disabling cache 2024-03-04T12:36:16.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.203+0000 7fad38239800 20 remove_watcher() i=1 2024-03-04T12:36:16.210 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.204+0000 7fad38239800 20 remove_watcher() i=2 2024-03-04T12:36:16.211 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.205+0000 7fad38239800 20 remove_watcher() i=3 2024-03-04T12:36:16.212 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.206+0000 7fad38239800 20 remove_watcher() i=4 2024-03-04T12:36:16.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.207+0000 7fad38239800 20 remove_watcher() i=5 2024-03-04T12:36:16.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.208+0000 7fad38239800 20 remove_watcher() i=6 2024-03-04T12:36:16.215 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.209+0000 7fad38239800 20 remove_watcher() i=7 2024-03-04T12:36:16.224 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.225 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:36:16.225 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: abort-at-commit-target-layout id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:36:16.225 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.226 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-03-04T12:36:16.259 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:16.259 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:16.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.286+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.287+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.287+0000 7fba72020800 20 realm 2024-03-04T12:36:16.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.287+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.287+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.287+0000 7fba72020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:16.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.287+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.287+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.287+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.288+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:16.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.288+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.289+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:16.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.289+0000 7fba72020800 20 searching for the correct realm 2024-03-04T12:36:16.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.292+0000 7fba67fff640 0 -- 172.21.15.110:0/1478264816 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7fba6001e060 msgr2=0x7fba6005f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:36:16.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.497+0000 7fba6fb1c640 0 -- 172.21.15.110:0/1478264816 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fba58079bf0 msgr2=0x7fba58077420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:36:16.710 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:16.710 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:16.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:16.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:16.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:16.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:16.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.704+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.704+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.704+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.704+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:16.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.704+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.712 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.704+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:16.712 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.704+0000 7fba72020800 20 zone default found 2024-03-04T12:36:16.712 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.704+0000 7fba72020800 4 Realm: () 2024-03-04T12:36:16.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.704+0000 7fba72020800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:16.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.704+0000 7fba72020800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:16.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.704+0000 7fba72020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:16.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.704+0000 7fba72020800 20 zonegroup default 2024-03-04T12:36:16.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.704+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.705+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.705+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.705+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.705+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.705+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.705+0000 7fba72020800 20 started sync module instance, tier type = 2024-03-04T12:36:16.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.705+0000 7fba72020800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:16.723 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=0 2024-03-04T12:36:16.723 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=1 2024-03-04T12:36:16.723 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=2 2024-03-04T12:36:16.723 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=3 2024-03-04T12:36:16.723 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=4 2024-03-04T12:36:16.723 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=5 2024-03-04T12:36:16.723 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=6 2024-03-04T12:36:16.724 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.718+0000 7fba72020800 20 add_watcher() i=7 2024-03-04T12:36:16.724 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.718+0000 7fba72020800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:16.726 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.720+0000 7fb925fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:16.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.720+0000 7fba72020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:16.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.720+0000 7fba72020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:16.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.720+0000 7fba72020800 5 note: GC not initialized 2024-03-04T12:36:16.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.720+0000 7fb924fe1640 20 reqs_thread_entry: start 2024-03-04T12:36:16.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.720+0000 7fba72020800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:16.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.720+0000 7fba72020800 20 Filter name: none 2024-03-04T12:36:16.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.720+0000 7fb89e7fc640 20 reqs_thread_entry: start 2024-03-04T12:36:16.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.720+0000 7fba72020800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-04T12:36:16.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.720+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.721+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:16.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.721+0000 7fba72020800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-04T12:36:16.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.721+0000 7fba72020800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-04T12:36:16.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.721+0000 7fba72020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 : miss 2024-03-04T12:36:16.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.721+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.721+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:16.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.721+0000 7fba72020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 info.flags=0x17 2024-03-04T12:36:16.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.721+0000 7fba72020800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 to cache LRU end 2024-03-04T12:36:16.729 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.721+0000 7fba72020800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:36:16.729 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.721+0000 7fba72020800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:16.729 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.721+0000 7fba72020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 2024-03-04T12:36:16.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.727+0000 7fba72020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 info.flags=0x17 2024-03-04T12:36:16.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.727+0000 7fba72020800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 to cache LRU end 2024-03-04T12:36:16.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.727+0000 7fba72020800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:16.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.727+0000 7fba72020800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27, ofs0, ns] 2024-03-04T12:36:16.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.727+0000 7fb94effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824035 cookie 94200321313504 notifier 6828 bl.length()=965 2024-03-04T12:36:16.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.727+0000 7fb94effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 info.flags=0x17 2024-03-04T12:36:16.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.727+0000 7fb94effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 to cache LRU end 2024-03-04T12:36:16.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.727+0000 7fb94effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:16.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.729+0000 7fba72020800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): orig_sources= new_sources= 2024-03-04T12:36:16.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.729+0000 7fba72020800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): potential sources added=[] removed=[] 2024-03-04T12:36:16.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.729+0000 7fba72020800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): orig_dests= new_dests= 2024-03-04T12:36:16.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.729+0000 7fba72020800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): potential dests added=[] removed=[] 2024-03-04T12:36:16.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.0 2024-03-04T12:36:16.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.0 2024-03-04T12:36:16.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.1 2024-03-04T12:36:16.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.1 2024-03-04T12:36:16.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.2 2024-03-04T12:36:16.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.2 2024-03-04T12:36:16.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.3 2024-03-04T12:36:16.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.3 2024-03-04T12:36:16.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.4 2024-03-04T12:36:16.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.4 2024-03-04T12:36:16.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.5 2024-03-04T12:36:16.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.5 2024-03-04T12:36:16.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.6 2024-03-04T12:36:16.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.6 2024-03-04T12:36:16.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.7 2024-03-04T12:36:16.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.7 2024-03-04T12:36:16.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.8 2024-03-04T12:36:16.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.8 2024-03-04T12:36:16.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.9 2024-03-04T12:36:16.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.9 2024-03-04T12:36:16.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.10 2024-03-04T12:36:16.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.10 2024-03-04T12:36:16.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.11 2024-03-04T12:36:16.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.11 2024-03-04T12:36:16.739 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.0 2024-03-04T12:36:16.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1 2024-03-04T12:36:16.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.733+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.2 2024-03-04T12:36:16.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.733+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.3 2024-03-04T12:36:16.741 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.734+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.4 2024-03-04T12:36:16.741 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.734+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.5 2024-03-04T12:36:16.741 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.735+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.6 2024-03-04T12:36:16.741 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.735+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.7 2024-03-04T12:36:16.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.736+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.8 2024-03-04T12:36:16.742 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.736+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.9 2024-03-04T12:36:16.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.737+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.10 2024-03-04T12:36:16.746 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fba72020800 time 2024-03-04T12:36:16.740866+0000 2024-03-04T12:36:16.746 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:36:16.746 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:36:16.747 INFO:tasks.workunit.client.0.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fba75380e86] 2024-03-04T12:36:16.747 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fba75381044] 2024-03-04T12:36:16.747 INFO:tasks.workunit.client.0.smithi110.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acb6b5feb1] 2024-03-04T12:36:16.747 INFO:tasks.workunit.client.0.smithi110.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x55acb6b74088] 2024-03-04T12:36:16.747 INFO:tasks.workunit.client.0.smithi110.stderr: 5: main() 2024-03-04T12:36:16.747 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fba7423feb0] 2024-03-04T12:36:16.747 INFO:tasks.workunit.client.0.smithi110.stderr: 7: __libc_start_main() 2024-03-04T12:36:16.747 INFO:tasks.workunit.client.0.smithi110.stderr: 8: _start() 2024-03-04T12:36:16.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.740+0000 7fba72020800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fba72020800 time 2024-03-04T12:36:16.740866+0000 2024-03-04T12:36:16.747 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:36:16.747 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.747 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:36:16.747 INFO:tasks.workunit.client.0.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fba75380e86] 2024-03-04T12:36:16.747 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fba75381044] 2024-03-04T12:36:16.748 INFO:tasks.workunit.client.0.smithi110.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acb6b5feb1] 2024-03-04T12:36:16.748 INFO:tasks.workunit.client.0.smithi110.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x55acb6b74088] 2024-03-04T12:36:16.748 INFO:tasks.workunit.client.0.smithi110.stderr: 5: main() 2024-03-04T12:36:16.748 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fba7423feb0] 2024-03-04T12:36:16.748 INFO:tasks.workunit.client.0.smithi110.stderr: 7: __libc_start_main() 2024-03-04T12:36:16.748 INFO:tasks.workunit.client.0.smithi110.stderr: 8: _start() 2024-03-04T12:36:16.748 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.748 INFO:tasks.workunit.client.0.smithi110.stderr:*** Caught signal (Aborted) ** 2024-03-04T12:36:16.748 INFO:tasks.workunit.client.0.smithi110.stderr: in thread 7fba72020800 thread_name:radosgw-admin 2024-03-04T12:36:16.764 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:36:16.764 INFO:tasks.workunit.client.0.smithi110.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fba74254db0] 2024-03-04T12:36:16.764 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fba742a154c] 2024-03-04T12:36:16.764 INFO:tasks.workunit.client.0.smithi110.stderr: 3: raise() 2024-03-04T12:36:16.764 INFO:tasks.workunit.client.0.smithi110.stderr: 4: abort() 2024-03-04T12:36:16.764 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fba75380ee0] 2024-03-04T12:36:16.764 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fba75381044] 2024-03-04T12:36:16.764 INFO:tasks.workunit.client.0.smithi110.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acb6b5feb1] 2024-03-04T12:36:16.764 INFO:tasks.workunit.client.0.smithi110.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x55acb6b74088] 2024-03-04T12:36:16.765 INFO:tasks.workunit.client.0.smithi110.stderr: 9: main() 2024-03-04T12:36:16.765 INFO:tasks.workunit.client.0.smithi110.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fba7423feb0] 2024-03-04T12:36:16.765 INFO:tasks.workunit.client.0.smithi110.stderr: 11: __libc_start_main() 2024-03-04T12:36:16.765 INFO:tasks.workunit.client.0.smithi110.stderr: 12: _start() 2024-03-04T12:36:16.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.741+0000 7fba72020800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:36:16.765 INFO:tasks.workunit.client.0.smithi110.stderr: in thread 7fba72020800 thread_name:radosgw-admin 2024-03-04T12:36:16.765 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.765 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:36:16.765 INFO:tasks.workunit.client.0.smithi110.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fba74254db0] 2024-03-04T12:36:16.765 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fba742a154c] 2024-03-04T12:36:16.765 INFO:tasks.workunit.client.0.smithi110.stderr: 3: raise() 2024-03-04T12:36:16.765 INFO:tasks.workunit.client.0.smithi110.stderr: 4: abort() 2024-03-04T12:36:16.765 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fba75380ee0] 2024-03-04T12:36:16.766 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fba75381044] 2024-03-04T12:36:16.766 INFO:tasks.workunit.client.0.smithi110.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acb6b5feb1] 2024-03-04T12:36:16.766 INFO:tasks.workunit.client.0.smithi110.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x55acb6b74088] 2024-03-04T12:36:16.766 INFO:tasks.workunit.client.0.smithi110.stderr: 9: main() 2024-03-04T12:36:16.766 INFO:tasks.workunit.client.0.smithi110.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fba7423feb0] 2024-03-04T12:36:16.766 INFO:tasks.workunit.client.0.smithi110.stderr: 11: __libc_start_main() 2024-03-04T12:36:16.766 INFO:tasks.workunit.client.0.smithi110.stderr: 12: _start() 2024-03-04T12:36:16.766 INFO:tasks.workunit.client.0.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:36:16.766 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.766 INFO:tasks.workunit.client.0.smithi110.stderr:--- begin dump of recent events --- 2024-03-04T12:36:16.766 INFO:tasks.workunit.client.0.smithi110.stderr: -499> 2024-03-04T12:36:16.272+0000 7fba72020800 5 AuthRegistry(0x55acb8a0bd60) adding con mode: crc 2024-03-04T12:36:16.766 INFO:tasks.workunit.client.0.smithi110.stderr: -498> 2024-03-04T12:36:16.272+0000 7fba72020800 5 AuthRegistry(0x55acb8a0bd60) adding con mode: secure 2024-03-04T12:36:16.767 INFO:tasks.workunit.client.0.smithi110.stderr: -497> 2024-03-04T12:36:16.272+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.767 INFO:tasks.workunit.client.0.smithi110.stderr: -496> 2024-03-04T12:36:16.272+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.767 INFO:tasks.workunit.client.0.smithi110.stderr: -495> 2024-03-04T12:36:16.272+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command rotate-key hook 0x55acb8a0bea8 2024-03-04T12:36:16.767 INFO:tasks.workunit.client.0.smithi110.stderr: -494> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient: _reopen_session rank -1 2024-03-04T12:36:16.767 INFO:tasks.workunit.client.0.smithi110.stderr: -493> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-04T12:36:16.767 INFO:tasks.workunit.client.0.smithi110.stderr: -492> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient(hunting): picked mon.noname-c con 0x55acb88b85b0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:36:16.767 INFO:tasks.workunit.client.0.smithi110.stderr: -491> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient(hunting): picked mon.noname-b con 0x55acb88c3130 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:36:16.767 INFO:tasks.workunit.client.0.smithi110.stderr: -490> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient(hunting): picked mon.noname-a con 0x55acb894ed40 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:36:16.767 INFO:tasks.workunit.client.0.smithi110.stderr: -489> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.767 INFO:tasks.workunit.client.0.smithi110.stderr: -488> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.767 INFO:tasks.workunit.client.0.smithi110.stderr: -487> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.768 INFO:tasks.workunit.client.0.smithi110.stderr: -486> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient(hunting): _renew_subs 2024-03-04T12:36:16.768 INFO:tasks.workunit.client.0.smithi110.stderr: -485> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient(hunting): authenticate will time out at 1757.631615s 2024-03-04T12:36:16.768 INFO:tasks.workunit.client.0.smithi110.stderr: -484> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient(hunting): get_auth_request con 0x55acb88b85b0 auth_method 0 2024-03-04T12:36:16.768 INFO:tasks.workunit.client.0.smithi110.stderr: -483> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.768 INFO:tasks.workunit.client.0.smithi110.stderr: -482> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.768 INFO:tasks.workunit.client.0.smithi110.stderr: -481> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.768 INFO:tasks.workunit.client.0.smithi110.stderr: -480> 2024-03-04T12:36:16.272+0000 7fba7031d640 10 monclient(hunting): get_auth_request con 0x55acb894ed40 auth_method 0 2024-03-04T12:36:16.768 INFO:tasks.workunit.client.0.smithi110.stderr: -479> 2024-03-04T12:36:16.272+0000 7fba7031d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.768 INFO:tasks.workunit.client.0.smithi110.stderr: -478> 2024-03-04T12:36:16.272+0000 7fba7031d640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.768 INFO:tasks.workunit.client.0.smithi110.stderr: -477> 2024-03-04T12:36:16.272+0000 7fba7031d640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.768 INFO:tasks.workunit.client.0.smithi110.stderr: -476> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.768 INFO:tasks.workunit.client.0.smithi110.stderr: -475> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.768 INFO:tasks.workunit.client.0.smithi110.stderr: -474> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.768 INFO:tasks.workunit.client.0.smithi110.stderr: -473> 2024-03-04T12:36:16.272+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.769 INFO:tasks.workunit.client.0.smithi110.stderr: -472> 2024-03-04T12:36:16.272+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.769 INFO:tasks.workunit.client.0.smithi110.stderr: -471> 2024-03-04T12:36:16.272+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.769 INFO:tasks.workunit.client.0.smithi110.stderr: -470> 2024-03-04T12:36:16.272+0000 7fba67fff640 10 monclient(hunting): get_auth_request con 0x55acb88c3130 auth_method 0 2024-03-04T12:36:16.769 INFO:tasks.workunit.client.0.smithi110.stderr: -469> 2024-03-04T12:36:16.272+0000 7fba67fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.769 INFO:tasks.workunit.client.0.smithi110.stderr: -468> 2024-03-04T12:36:16.272+0000 7fba67fff640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.769 INFO:tasks.workunit.client.0.smithi110.stderr: -467> 2024-03-04T12:36:16.272+0000 7fba67fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.769 INFO:tasks.workunit.client.0.smithi110.stderr: -466> 2024-03-04T12:36:16.272+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.769 INFO:tasks.workunit.client.0.smithi110.stderr: -465> 2024-03-04T12:36:16.272+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.769 INFO:tasks.workunit.client.0.smithi110.stderr: -464> 2024-03-04T12:36:16.272+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.769 INFO:tasks.workunit.client.0.smithi110.stderr: -463> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_done global_id 6380 payload 824 2024-03-04T12:36:16.769 INFO:tasks.workunit.client.0.smithi110.stderr: -462> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient: _finish_hunting 0 2024-03-04T12:36:16.769 INFO:tasks.workunit.client.0.smithi110.stderr: -461> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 1 monclient: found mon.noname-c 2024-03-04T12:36:16.769 INFO:tasks.workunit.client.0.smithi110.stderr: -460> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.110:3301/0 2024-03-04T12:36:16.769 INFO:tasks.workunit.client.0.smithi110.stderr: -459> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:16.769 INFO:tasks.workunit.client.0.smithi110.stderr: -458> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:36:16.770 INFO:tasks.workunit.client.0.smithi110.stderr: -457> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: dump: 2024-03-04T12:36:16.770 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:16.770 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:16.770 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.770 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.770 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:16.770 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.770 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:16.770 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:16.770 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:16.770 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.770 INFO:tasks.workunit.client.0.smithi110.stderr: -456> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: _finish_auth 0 2024-03-04T12:36:16.770 INFO:tasks.workunit.client.0.smithi110.stderr: -455> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: _check_auth_tickets 2024-03-04T12:36:16.770 INFO:tasks.workunit.client.0.smithi110.stderr: -454> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:16.770 INFO:tasks.workunit.client.0.smithi110.stderr: -453> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:16.771 INFO:tasks.workunit.client.0.smithi110.stderr: -452> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:36:16.771 INFO:tasks.workunit.client.0.smithi110.stderr: -451> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: dump: 2024-03-04T12:36:16.771 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:16.771 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:16.771 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.771 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.771 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:16.771 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.771 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:16.771 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:16.771 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:16.771 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.771 INFO:tasks.workunit.client.0.smithi110.stderr: -450> 2024-03-04T12:36:16.273+0000 7fba72020800 5 monclient: authenticate success, global_id 6380 2024-03-04T12:36:16.771 INFO:tasks.workunit.client.0.smithi110.stderr: -449> 2024-03-04T12:36:16.273+0000 7fb95de0b640 4 set_mon_vals no callback set 2024-03-04T12:36:16.772 INFO:tasks.workunit.client.0.smithi110.stderr: -448> 2024-03-04T12:36:16.273+0000 7fba72020800 10 monclient: _renew_subs 2024-03-04T12:36:16.772 INFO:tasks.workunit.client.0.smithi110.stderr: -447> 2024-03-04T12:36:16.273+0000 7fba72020800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:16.772 INFO:tasks.workunit.client.0.smithi110.stderr: -446> 2024-03-04T12:36:16.273+0000 7fba72020800 10 monclient: _renew_subs 2024-03-04T12:36:16.772 INFO:tasks.workunit.client.0.smithi110.stderr: -445> 2024-03-04T12:36:16.273+0000 7fba72020800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:16.772 INFO:tasks.workunit.client.0.smithi110.stderr: -444> 2024-03-04T12:36:16.273+0000 7fba72020800 1 librados: init done 2024-03-04T12:36:16.772 INFO:tasks.workunit.client.0.smithi110.stderr: -443> 2024-03-04T12:36:16.274+0000 7fb957fff640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:36:16.772 INFO:tasks.workunit.client.0.smithi110.stderr: -442> 2024-03-04T12:36:16.274+0000 7fb957fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:16.772 INFO:tasks.workunit.client.0.smithi110.stderr: -441> 2024-03-04T12:36:16.274+0000 7fb957fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:16.772 INFO:tasks.workunit.client.0.smithi110.stderr: -440> 2024-03-04T12:36:16.275+0000 7fba67fff640 10 monclient: get_auth_request con 0x7fb958069eb0 auth_method 0 2024-03-04T12:36:16.772 INFO:tasks.workunit.client.0.smithi110.stderr: -439> 2024-03-04T12:36:16.275+0000 7fba7031d640 10 monclient: get_auth_request con 0x55acb8a36c20 auth_method 0 2024-03-04T12:36:16.772 INFO:tasks.workunit.client.0.smithi110.stderr: -438> 2024-03-04T12:36:16.275+0000 7fba6fb1c640 10 monclient: get_auth_request con 0x55acb8a57230 auth_method 0 2024-03-04T12:36:16.772 INFO:tasks.workunit.client.0.smithi110.stderr: -437> 2024-03-04T12:36:16.277+0000 7fba67fff640 10 monclient: get_auth_request con 0x55acb8a5c870 auth_method 0 2024-03-04T12:36:16.772 INFO:tasks.workunit.client.0.smithi110.stderr: -436> 2024-03-04T12:36:16.277+0000 7fba72020800 10 monclient: build_initial_monmap 2024-03-04T12:36:16.772 INFO:tasks.workunit.client.0.smithi110.stderr: -435> 2024-03-04T12:36:16.277+0000 7fba72020800 1 build_initial for_mkfs: 0 2024-03-04T12:36:16.773 INFO:tasks.workunit.client.0.smithi110.stderr: -434> 2024-03-04T12:36:16.277+0000 7fba72020800 10 monclient: monmap: 2024-03-04T12:36:16.773 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:36:16.773 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:36:16.773 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:36:16.773 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:36:16.773 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:36:16.773 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.773 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:36:16.773 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:36:16.773 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:36:16.773 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.773 INFO:tasks.workunit.client.0.smithi110.stderr: -433> 2024-03-04T12:36:16.277+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding auth protocol: cephx 2024-03-04T12:36:16.773 INFO:tasks.workunit.client.0.smithi110.stderr: -432> 2024-03-04T12:36:16.277+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding auth protocol: cephx 2024-03-04T12:36:16.773 INFO:tasks.workunit.client.0.smithi110.stderr: -431> 2024-03-04T12:36:16.277+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding auth protocol: cephx 2024-03-04T12:36:16.774 INFO:tasks.workunit.client.0.smithi110.stderr: -430> 2024-03-04T12:36:16.277+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: secure 2024-03-04T12:36:16.774 INFO:tasks.workunit.client.0.smithi110.stderr: -429> 2024-03-04T12:36:16.277+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: crc 2024-03-04T12:36:16.774 INFO:tasks.workunit.client.0.smithi110.stderr: -428> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: secure 2024-03-04T12:36:16.774 INFO:tasks.workunit.client.0.smithi110.stderr: -427> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: crc 2024-03-04T12:36:16.774 INFO:tasks.workunit.client.0.smithi110.stderr: -426> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: secure 2024-03-04T12:36:16.774 INFO:tasks.workunit.client.0.smithi110.stderr: -425> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: crc 2024-03-04T12:36:16.774 INFO:tasks.workunit.client.0.smithi110.stderr: -424> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: crc 2024-03-04T12:36:16.774 INFO:tasks.workunit.client.0.smithi110.stderr: -423> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: secure 2024-03-04T12:36:16.774 INFO:tasks.workunit.client.0.smithi110.stderr: -422> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: crc 2024-03-04T12:36:16.774 INFO:tasks.workunit.client.0.smithi110.stderr: -421> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: secure 2024-03-04T12:36:16.774 INFO:tasks.workunit.client.0.smithi110.stderr: -420> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: crc 2024-03-04T12:36:16.774 INFO:tasks.workunit.client.0.smithi110.stderr: -419> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: secure 2024-03-04T12:36:16.774 INFO:tasks.workunit.client.0.smithi110.stderr: -418> 2024-03-04T12:36:16.278+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.775 INFO:tasks.workunit.client.0.smithi110.stderr: -417> 2024-03-04T12:36:16.278+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command objecter_requests cmddesc objecter_requests hook 0x55acb8a641c0 EEXIST 2024-03-04T12:36:16.775 INFO:tasks.workunit.client.0.smithi110.stderr: -416> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient: init 2024-03-04T12:36:16.775 INFO:tasks.workunit.client.0.smithi110.stderr: -415> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding auth protocol: cephx 2024-03-04T12:36:16.775 INFO:tasks.workunit.client.0.smithi110.stderr: -414> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding auth protocol: cephx 2024-03-04T12:36:16.775 INFO:tasks.workunit.client.0.smithi110.stderr: -413> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding auth protocol: cephx 2024-03-04T12:36:16.775 INFO:tasks.workunit.client.0.smithi110.stderr: -412> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: secure 2024-03-04T12:36:16.775 INFO:tasks.workunit.client.0.smithi110.stderr: -411> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: crc 2024-03-04T12:36:16.775 INFO:tasks.workunit.client.0.smithi110.stderr: -410> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: secure 2024-03-04T12:36:16.775 INFO:tasks.workunit.client.0.smithi110.stderr: -409> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: crc 2024-03-04T12:36:16.775 INFO:tasks.workunit.client.0.smithi110.stderr: -408> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: secure 2024-03-04T12:36:16.775 INFO:tasks.workunit.client.0.smithi110.stderr: -407> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: crc 2024-03-04T12:36:16.775 INFO:tasks.workunit.client.0.smithi110.stderr: -406> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: crc 2024-03-04T12:36:16.775 INFO:tasks.workunit.client.0.smithi110.stderr: -405> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: secure 2024-03-04T12:36:16.775 INFO:tasks.workunit.client.0.smithi110.stderr: -404> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: crc 2024-03-04T12:36:16.775 INFO:tasks.workunit.client.0.smithi110.stderr: -403> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: secure 2024-03-04T12:36:16.776 INFO:tasks.workunit.client.0.smithi110.stderr: -402> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: crc 2024-03-04T12:36:16.776 INFO:tasks.workunit.client.0.smithi110.stderr: -401> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: secure 2024-03-04T12:36:16.776 INFO:tasks.workunit.client.0.smithi110.stderr: -400> 2024-03-04T12:36:16.278+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.776 INFO:tasks.workunit.client.0.smithi110.stderr: -399> 2024-03-04T12:36:16.278+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.776 INFO:tasks.workunit.client.0.smithi110.stderr: -398> 2024-03-04T12:36:16.278+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command rotate-key cmddesc rotate-key hook 0x55acb8a5f700 EEXIST 2024-03-04T12:36:16.776 INFO:tasks.workunit.client.0.smithi110.stderr: -397> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient: _reopen_session rank -1 2024-03-04T12:36:16.776 INFO:tasks.workunit.client.0.smithi110.stderr: -396> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:36:16.776 INFO:tasks.workunit.client.0.smithi110.stderr: -395> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient(hunting): picked mon.noname-b con 0x55acb8a8a9f0 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:36:16.776 INFO:tasks.workunit.client.0.smithi110.stderr: -394> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient(hunting): picked mon.noname-c con 0x55acb8a8add0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:36:16.776 INFO:tasks.workunit.client.0.smithi110.stderr: -393> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient(hunting): picked mon.noname-a con 0x55acb8a9d780 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:36:16.776 INFO:tasks.workunit.client.0.smithi110.stderr: -392> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.776 INFO:tasks.workunit.client.0.smithi110.stderr: -391> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.776 INFO:tasks.workunit.client.0.smithi110.stderr: -390> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.776 INFO:tasks.workunit.client.0.smithi110.stderr: -389> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient(hunting): _renew_subs 2024-03-04T12:36:16.777 INFO:tasks.workunit.client.0.smithi110.stderr: -388> 2024-03-04T12:36:16.279+0000 7fba72020800 10 monclient(hunting): authenticate will time out at 1757.638006s 2024-03-04T12:36:16.777 INFO:tasks.workunit.client.0.smithi110.stderr: -387> 2024-03-04T12:36:16.279+0000 7fba67fff640 10 monclient(hunting): get_auth_request con 0x55acb8a8add0 auth_method 0 2024-03-04T12:36:16.777 INFO:tasks.workunit.client.0.smithi110.stderr: -386> 2024-03-04T12:36:16.279+0000 7fba67fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.777 INFO:tasks.workunit.client.0.smithi110.stderr: -385> 2024-03-04T12:36:16.279+0000 7fba67fff640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.777 INFO:tasks.workunit.client.0.smithi110.stderr: -384> 2024-03-04T12:36:16.279+0000 7fba67fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.777 INFO:tasks.workunit.client.0.smithi110.stderr: -383> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient(hunting): get_auth_request con 0x55acb8a9d780 auth_method 0 2024-03-04T12:36:16.777 INFO:tasks.workunit.client.0.smithi110.stderr: -382> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.777 INFO:tasks.workunit.client.0.smithi110.stderr: -381> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.777 INFO:tasks.workunit.client.0.smithi110.stderr: -380> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.777 INFO:tasks.workunit.client.0.smithi110.stderr: -379> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.778 INFO:tasks.workunit.client.0.smithi110.stderr: -378> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.778 INFO:tasks.workunit.client.0.smithi110.stderr: -377> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.778 INFO:tasks.workunit.client.0.smithi110.stderr: -376> 2024-03-04T12:36:16.279+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.778 INFO:tasks.workunit.client.0.smithi110.stderr: -375> 2024-03-04T12:36:16.279+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.778 INFO:tasks.workunit.client.0.smithi110.stderr: -374> 2024-03-04T12:36:16.279+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.778 INFO:tasks.workunit.client.0.smithi110.stderr: -373> 2024-03-04T12:36:16.279+0000 7fba6fb1c640 10 monclient(hunting): get_auth_request con 0x55acb8a8a9f0 auth_method 0 2024-03-04T12:36:16.778 INFO:tasks.workunit.client.0.smithi110.stderr: -372> 2024-03-04T12:36:16.279+0000 7fba6fb1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.778 INFO:tasks.workunit.client.0.smithi110.stderr: -371> 2024-03-04T12:36:16.279+0000 7fba6fb1c640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.778 INFO:tasks.workunit.client.0.smithi110.stderr: -370> 2024-03-04T12:36:16.279+0000 7fba6fb1c640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.778 INFO:tasks.workunit.client.0.smithi110.stderr: -369> 2024-03-04T12:36:16.279+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.778 INFO:tasks.workunit.client.0.smithi110.stderr: -368> 2024-03-04T12:36:16.279+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.778 INFO:tasks.workunit.client.0.smithi110.stderr: -367> 2024-03-04T12:36:16.279+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.778 INFO:tasks.workunit.client.0.smithi110.stderr: -366> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient(hunting): handle_auth_done global_id 6822 payload 824 2024-03-04T12:36:16.778 INFO:tasks.workunit.client.0.smithi110.stderr: -365> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient: _finish_hunting 0 2024-03-04T12:36:16.779 INFO:tasks.workunit.client.0.smithi110.stderr: -364> 2024-03-04T12:36:16.279+0000 7fba7031d640 1 monclient: found mon.noname-a 2024-03-04T12:36:16.779 INFO:tasks.workunit.client.0.smithi110.stderr: -363> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:36:16.779 INFO:tasks.workunit.client.0.smithi110.stderr: -362> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:16.779 INFO:tasks.workunit.client.0.smithi110.stderr: -361> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:36:16.779 INFO:tasks.workunit.client.0.smithi110.stderr: -360> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: dump: 2024-03-04T12:36:16.779 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:16.779 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:16.779 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.779 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.779 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:16.779 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.779 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:16.779 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:16.779 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:16.780 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.780 INFO:tasks.workunit.client.0.smithi110.stderr: -359> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: _finish_auth 0 2024-03-04T12:36:16.780 INFO:tasks.workunit.client.0.smithi110.stderr: -358> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: _check_auth_tickets 2024-03-04T12:36:16.780 INFO:tasks.workunit.client.0.smithi110.stderr: -357> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:16.780 INFO:tasks.workunit.client.0.smithi110.stderr: -356> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:16.780 INFO:tasks.workunit.client.0.smithi110.stderr: -355> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:36:16.780 INFO:tasks.workunit.client.0.smithi110.stderr: -354> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: dump: 2024-03-04T12:36:16.780 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:16.780 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:16.780 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.780 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.780 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:16.780 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.780 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:16.781 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:16.781 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:16.781 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.781 INFO:tasks.workunit.client.0.smithi110.stderr: -353> 2024-03-04T12:36:16.279+0000 7fba70b1e640 4 set_mon_vals no callback set 2024-03-04T12:36:16.781 INFO:tasks.workunit.client.0.smithi110.stderr: -352> 2024-03-04T12:36:16.279+0000 7fba72020800 5 monclient: authenticate success, global_id 6822 2024-03-04T12:36:16.781 INFO:tasks.workunit.client.0.smithi110.stderr: -351> 2024-03-04T12:36:16.279+0000 7fba72020800 10 monclient: _renew_subs 2024-03-04T12:36:16.781 INFO:tasks.workunit.client.0.smithi110.stderr: -350> 2024-03-04T12:36:16.279+0000 7fba72020800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:36:16.781 INFO:tasks.workunit.client.0.smithi110.stderr: -349> 2024-03-04T12:36:16.279+0000 7fba72020800 10 monclient: _renew_subs 2024-03-04T12:36:16.781 INFO:tasks.workunit.client.0.smithi110.stderr: -348> 2024-03-04T12:36:16.279+0000 7fba72020800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:36:16.781 INFO:tasks.workunit.client.0.smithi110.stderr: -347> 2024-03-04T12:36:16.281+0000 7fb9557fa640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:36:16.781 INFO:tasks.workunit.client.0.smithi110.stderr: -346> 2024-03-04T12:36:16.281+0000 7fb9557fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:16.781 INFO:tasks.workunit.client.0.smithi110.stderr: -345> 2024-03-04T12:36:16.281+0000 7fb9557fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:16.781 INFO:tasks.workunit.client.0.smithi110.stderr: -344> 2024-03-04T12:36:16.281+0000 7fba6fb1c640 10 monclient: get_auth_request con 0x7fb948069df0 auth_method 0 2024-03-04T12:36:16.781 INFO:tasks.workunit.client.0.smithi110.stderr: -343> 2024-03-04T12:36:16.281+0000 7fba72020800 10 monclient: get_monmap_and_config 2024-03-04T12:36:16.781 INFO:tasks.workunit.client.0.smithi110.stderr: -342> 2024-03-04T12:36:16.281+0000 7fba72020800 10 monclient: build_initial_monmap 2024-03-04T12:36:16.782 INFO:tasks.workunit.client.0.smithi110.stderr: -341> 2024-03-04T12:36:16.281+0000 7fba72020800 1 build_initial for_mkfs: 0 2024-03-04T12:36:16.782 INFO:tasks.workunit.client.0.smithi110.stderr: -340> 2024-03-04T12:36:16.281+0000 7fba72020800 10 monclient: monmap: 2024-03-04T12:36:16.782 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:36:16.782 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:36:16.782 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:36:16.782 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:36:16.782 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:36:16.782 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.782 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:36:16.782 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:36:16.782 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:36:16.782 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.782 INFO:tasks.workunit.client.0.smithi110.stderr: -339> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding auth protocol: cephx 2024-03-04T12:36:16.782 INFO:tasks.workunit.client.0.smithi110.stderr: -338> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding auth protocol: cephx 2024-03-04T12:36:16.783 INFO:tasks.workunit.client.0.smithi110.stderr: -337> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding auth protocol: cephx 2024-03-04T12:36:16.783 INFO:tasks.workunit.client.0.smithi110.stderr: -336> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: secure 2024-03-04T12:36:16.783 INFO:tasks.workunit.client.0.smithi110.stderr: -335> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: crc 2024-03-04T12:36:16.783 INFO:tasks.workunit.client.0.smithi110.stderr: -334> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: secure 2024-03-04T12:36:16.783 INFO:tasks.workunit.client.0.smithi110.stderr: -333> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: crc 2024-03-04T12:36:16.783 INFO:tasks.workunit.client.0.smithi110.stderr: -332> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: secure 2024-03-04T12:36:16.783 INFO:tasks.workunit.client.0.smithi110.stderr: -331> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: crc 2024-03-04T12:36:16.783 INFO:tasks.workunit.client.0.smithi110.stderr: -330> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: crc 2024-03-04T12:36:16.783 INFO:tasks.workunit.client.0.smithi110.stderr: -329> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: secure 2024-03-04T12:36:16.783 INFO:tasks.workunit.client.0.smithi110.stderr: -328> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: crc 2024-03-04T12:36:16.783 INFO:tasks.workunit.client.0.smithi110.stderr: -327> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: secure 2024-03-04T12:36:16.783 INFO:tasks.workunit.client.0.smithi110.stderr: -326> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: crc 2024-03-04T12:36:16.783 INFO:tasks.workunit.client.0.smithi110.stderr: -325> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: secure 2024-03-04T12:36:16.783 INFO:tasks.workunit.client.0.smithi110.stderr: -324> 2024-03-04T12:36:16.281+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.784 INFO:tasks.workunit.client.0.smithi110.stderr: -323> 2024-03-04T12:36:16.281+0000 7fba72020800 10 monclient: init 2024-03-04T12:36:16.784 INFO:tasks.workunit.client.0.smithi110.stderr: -322> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding auth protocol: cephx 2024-03-04T12:36:16.784 INFO:tasks.workunit.client.0.smithi110.stderr: -321> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding auth protocol: cephx 2024-03-04T12:36:16.784 INFO:tasks.workunit.client.0.smithi110.stderr: -320> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding auth protocol: cephx 2024-03-04T12:36:16.784 INFO:tasks.workunit.client.0.smithi110.stderr: -319> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: secure 2024-03-04T12:36:16.784 INFO:tasks.workunit.client.0.smithi110.stderr: -318> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: crc 2024-03-04T12:36:16.784 INFO:tasks.workunit.client.0.smithi110.stderr: -317> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: secure 2024-03-04T12:36:16.784 INFO:tasks.workunit.client.0.smithi110.stderr: -316> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: crc 2024-03-04T12:36:16.784 INFO:tasks.workunit.client.0.smithi110.stderr: -315> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: secure 2024-03-04T12:36:16.784 INFO:tasks.workunit.client.0.smithi110.stderr: -314> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: crc 2024-03-04T12:36:16.784 INFO:tasks.workunit.client.0.smithi110.stderr: -313> 2024-03-04T12:36:16.282+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: crc 2024-03-04T12:36:16.784 INFO:tasks.workunit.client.0.smithi110.stderr: -312> 2024-03-04T12:36:16.282+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: secure 2024-03-04T12:36:16.784 INFO:tasks.workunit.client.0.smithi110.stderr: -311> 2024-03-04T12:36:16.282+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: crc 2024-03-04T12:36:16.785 INFO:tasks.workunit.client.0.smithi110.stderr: -310> 2024-03-04T12:36:16.282+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: secure 2024-03-04T12:36:16.785 INFO:tasks.workunit.client.0.smithi110.stderr: -309> 2024-03-04T12:36:16.282+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: crc 2024-03-04T12:36:16.785 INFO:tasks.workunit.client.0.smithi110.stderr: -308> 2024-03-04T12:36:16.282+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: secure 2024-03-04T12:36:16.785 INFO:tasks.workunit.client.0.smithi110.stderr: -307> 2024-03-04T12:36:16.282+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.785 INFO:tasks.workunit.client.0.smithi110.stderr: -306> 2024-03-04T12:36:16.282+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.785 INFO:tasks.workunit.client.0.smithi110.stderr: -305> 2024-03-04T12:36:16.282+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command rotate-key cmddesc rotate-key hook 0x7ffef706d328 EEXIST 2024-03-04T12:36:16.785 INFO:tasks.workunit.client.0.smithi110.stderr: -304> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient: _reopen_session rank -1 2024-03-04T12:36:16.785 INFO:tasks.workunit.client.0.smithi110.stderr: -303> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:36:16.785 INFO:tasks.workunit.client.0.smithi110.stderr: -302> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient(hunting): picked mon.noname-b con 0x55acb8adcf80 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:36:16.785 INFO:tasks.workunit.client.0.smithi110.stderr: -301> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient(hunting): picked mon.noname-c con 0x55acb8ad84d0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:36:16.785 INFO:tasks.workunit.client.0.smithi110.stderr: -300> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient(hunting): picked mon.noname-a con 0x55acb8aceed0 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:36:16.785 INFO:tasks.workunit.client.0.smithi110.stderr: -299> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.785 INFO:tasks.workunit.client.0.smithi110.stderr: -298> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.785 INFO:tasks.workunit.client.0.smithi110.stderr: -297> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.786 INFO:tasks.workunit.client.0.smithi110.stderr: -296> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient(hunting): _renew_subs 2024-03-04T12:36:16.786 INFO:tasks.workunit.client.0.smithi110.stderr: -295> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient(hunting): authenticate will time out at 1757.641479s 2024-03-04T12:36:16.786 INFO:tasks.workunit.client.0.smithi110.stderr: -294> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient(hunting): get_auth_request con 0x55acb8ad84d0 auth_method 0 2024-03-04T12:36:16.786 INFO:tasks.workunit.client.0.smithi110.stderr: -293> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.786 INFO:tasks.workunit.client.0.smithi110.stderr: -292> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.786 INFO:tasks.workunit.client.0.smithi110.stderr: -291> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.786 INFO:tasks.workunit.client.0.smithi110.stderr: -290> 2024-03-04T12:36:16.282+0000 7fba7031d640 10 monclient(hunting): get_auth_request con 0x55acb8aceed0 auth_method 0 2024-03-04T12:36:16.786 INFO:tasks.workunit.client.0.smithi110.stderr: -289> 2024-03-04T12:36:16.282+0000 7fba7031d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.786 INFO:tasks.workunit.client.0.smithi110.stderr: -288> 2024-03-04T12:36:16.282+0000 7fba7031d640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.786 INFO:tasks.workunit.client.0.smithi110.stderr: -287> 2024-03-04T12:36:16.282+0000 7fba7031d640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.786 INFO:tasks.workunit.client.0.smithi110.stderr: -286> 2024-03-04T12:36:16.282+0000 7fba6fb1c640 10 monclient(hunting): get_auth_request con 0x55acb8adcf80 auth_method 0 2024-03-04T12:36:16.786 INFO:tasks.workunit.client.0.smithi110.stderr: -285> 2024-03-04T12:36:16.282+0000 7fba6fb1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.786 INFO:tasks.workunit.client.0.smithi110.stderr: -284> 2024-03-04T12:36:16.282+0000 7fba6fb1c640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.786 INFO:tasks.workunit.client.0.smithi110.stderr: -283> 2024-03-04T12:36:16.282+0000 7fba6fb1c640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.787 INFO:tasks.workunit.client.0.smithi110.stderr: -282> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.787 INFO:tasks.workunit.client.0.smithi110.stderr: -281> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.787 INFO:tasks.workunit.client.0.smithi110.stderr: -280> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.787 INFO:tasks.workunit.client.0.smithi110.stderr: -279> 2024-03-04T12:36:16.282+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.787 INFO:tasks.workunit.client.0.smithi110.stderr: -278> 2024-03-04T12:36:16.282+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.787 INFO:tasks.workunit.client.0.smithi110.stderr: -277> 2024-03-04T12:36:16.282+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.787 INFO:tasks.workunit.client.0.smithi110.stderr: -276> 2024-03-04T12:36:16.282+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.787 INFO:tasks.workunit.client.0.smithi110.stderr: -275> 2024-03-04T12:36:16.282+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.787 INFO:tasks.workunit.client.0.smithi110.stderr: -274> 2024-03-04T12:36:16.282+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.787 INFO:tasks.workunit.client.0.smithi110.stderr: -273> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient(hunting): handle_auth_done global_id 6386 payload 274 2024-03-04T12:36:16.787 INFO:tasks.workunit.client.0.smithi110.stderr: -272> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient: _finish_hunting 0 2024-03-04T12:36:16.788 INFO:tasks.workunit.client.0.smithi110.stderr: -271> 2024-03-04T12:36:16.282+0000 7fba67fff640 1 monclient: found mon.noname-c 2024-03-04T12:36:16.788 INFO:tasks.workunit.client.0.smithi110.stderr: -270> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.110:3301/0 2024-03-04T12:36:16.788 INFO:tasks.workunit.client.0.smithi110.stderr: -269> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:16.788 INFO:tasks.workunit.client.0.smithi110.stderr: -268> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:36:16.788 INFO:tasks.workunit.client.0.smithi110.stderr: -267> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: dump: 2024-03-04T12:36:16.788 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:16.788 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:16.788 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.788 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.788 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:16.788 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.788 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:16.788 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:16.789 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:16.789 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.789 INFO:tasks.workunit.client.0.smithi110.stderr: -266> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: _finish_auth 0 2024-03-04T12:36:16.789 INFO:tasks.workunit.client.0.smithi110.stderr: -265> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: _check_auth_tickets 2024-03-04T12:36:16.789 INFO:tasks.workunit.client.0.smithi110.stderr: -264> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:16.789 INFO:tasks.workunit.client.0.smithi110.stderr: -263> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:16.789 INFO:tasks.workunit.client.0.smithi110.stderr: -262> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:36:16.789 INFO:tasks.workunit.client.0.smithi110.stderr: -261> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: dump: 2024-03-04T12:36:16.789 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:16.789 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:16.789 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.789 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.789 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:16.789 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.790 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:16.790 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:16.790 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:16.790 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.790 INFO:tasks.workunit.client.0.smithi110.stderr: -260> 2024-03-04T12:36:16.283+0000 7fba72020800 5 monclient: authenticate success, global_id 6386 2024-03-04T12:36:16.790 INFO:tasks.workunit.client.0.smithi110.stderr: -259> 2024-03-04T12:36:16.283+0000 7fba72020800 10 monclient: get_monmap_and_config success 2024-03-04T12:36:16.790 INFO:tasks.workunit.client.0.smithi110.stderr: -258> 2024-03-04T12:36:16.283+0000 7fba72020800 4 set_mon_vals no callback set 2024-03-04T12:36:16.790 INFO:tasks.workunit.client.0.smithi110.stderr: -257> 2024-03-04T12:36:16.283+0000 7fba72020800 10 monclient: shutdown 2024-03-04T12:36:16.790 INFO:tasks.workunit.client.0.smithi110.stderr: -256> 2024-03-04T12:36:16.283+0000 7fba72020800 10 monclient: build_initial_monmap 2024-03-04T12:36:16.790 INFO:tasks.workunit.client.0.smithi110.stderr: -255> 2024-03-04T12:36:16.283+0000 7fba72020800 1 build_initial for_mkfs: 0 2024-03-04T12:36:16.790 INFO:tasks.workunit.client.0.smithi110.stderr: -254> 2024-03-04T12:36:16.283+0000 7fba72020800 10 monclient: monmap: 2024-03-04T12:36:16.790 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:36:16.790 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:36:16.790 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:36:16.791 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:36:16.791 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:36:16.791 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.791 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:36:16.791 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:36:16.791 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:36:16.791 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.791 INFO:tasks.workunit.client.0.smithi110.stderr: -253> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding auth protocol: cephx 2024-03-04T12:36:16.791 INFO:tasks.workunit.client.0.smithi110.stderr: -252> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding auth protocol: cephx 2024-03-04T12:36:16.791 INFO:tasks.workunit.client.0.smithi110.stderr: -251> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding auth protocol: cephx 2024-03-04T12:36:16.791 INFO:tasks.workunit.client.0.smithi110.stderr: -250> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: secure 2024-03-04T12:36:16.791 INFO:tasks.workunit.client.0.smithi110.stderr: -249> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: crc 2024-03-04T12:36:16.791 INFO:tasks.workunit.client.0.smithi110.stderr: -248> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: secure 2024-03-04T12:36:16.792 INFO:tasks.workunit.client.0.smithi110.stderr: -247> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: crc 2024-03-04T12:36:16.792 INFO:tasks.workunit.client.0.smithi110.stderr: -246> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: secure 2024-03-04T12:36:16.792 INFO:tasks.workunit.client.0.smithi110.stderr: -245> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: crc 2024-03-04T12:36:16.792 INFO:tasks.workunit.client.0.smithi110.stderr: -244> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: crc 2024-03-04T12:36:16.792 INFO:tasks.workunit.client.0.smithi110.stderr: -243> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: secure 2024-03-04T12:36:16.792 INFO:tasks.workunit.client.0.smithi110.stderr: -242> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: crc 2024-03-04T12:36:16.792 INFO:tasks.workunit.client.0.smithi110.stderr: -241> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: secure 2024-03-04T12:36:16.792 INFO:tasks.workunit.client.0.smithi110.stderr: -240> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: crc 2024-03-04T12:36:16.792 INFO:tasks.workunit.client.0.smithi110.stderr: -239> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: secure 2024-03-04T12:36:16.792 INFO:tasks.workunit.client.0.smithi110.stderr: -238> 2024-03-04T12:36:16.283+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.792 INFO:tasks.workunit.client.0.smithi110.stderr: -237> 2024-03-04T12:36:16.283+0000 7fba72020800 1 librados: starting msgr at 2024-03-04T12:36:16.792 INFO:tasks.workunit.client.0.smithi110.stderr: -236> 2024-03-04T12:36:16.283+0000 7fba72020800 1 librados: starting objecter 2024-03-04T12:36:16.792 INFO:tasks.workunit.client.0.smithi110.stderr: -235> 2024-03-04T12:36:16.284+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command objecter_requests cmddesc objecter_requests hook 0x55acb8aacb80 EEXIST 2024-03-04T12:36:16.792 INFO:tasks.workunit.client.0.smithi110.stderr: -234> 2024-03-04T12:36:16.284+0000 7fba72020800 1 librados: setting wanted keys 2024-03-04T12:36:16.793 INFO:tasks.workunit.client.0.smithi110.stderr: -233> 2024-03-04T12:36:16.284+0000 7fba72020800 1 librados: calling monclient init 2024-03-04T12:36:16.793 INFO:tasks.workunit.client.0.smithi110.stderr: -232> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient: init 2024-03-04T12:36:16.793 INFO:tasks.workunit.client.0.smithi110.stderr: -231> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding auth protocol: cephx 2024-03-04T12:36:16.793 INFO:tasks.workunit.client.0.smithi110.stderr: -230> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding auth protocol: cephx 2024-03-04T12:36:16.793 INFO:tasks.workunit.client.0.smithi110.stderr: -229> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding auth protocol: cephx 2024-03-04T12:36:16.793 INFO:tasks.workunit.client.0.smithi110.stderr: -228> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: secure 2024-03-04T12:36:16.793 INFO:tasks.workunit.client.0.smithi110.stderr: -227> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: crc 2024-03-04T12:36:16.793 INFO:tasks.workunit.client.0.smithi110.stderr: -226> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: secure 2024-03-04T12:36:16.793 INFO:tasks.workunit.client.0.smithi110.stderr: -225> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: crc 2024-03-04T12:36:16.793 INFO:tasks.workunit.client.0.smithi110.stderr: -224> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: secure 2024-03-04T12:36:16.793 INFO:tasks.workunit.client.0.smithi110.stderr: -223> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: crc 2024-03-04T12:36:16.793 INFO:tasks.workunit.client.0.smithi110.stderr: -222> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: crc 2024-03-04T12:36:16.793 INFO:tasks.workunit.client.0.smithi110.stderr: -221> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: secure 2024-03-04T12:36:16.793 INFO:tasks.workunit.client.0.smithi110.stderr: -220> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: crc 2024-03-04T12:36:16.794 INFO:tasks.workunit.client.0.smithi110.stderr: -219> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: secure 2024-03-04T12:36:16.794 INFO:tasks.workunit.client.0.smithi110.stderr: -218> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: crc 2024-03-04T12:36:16.794 INFO:tasks.workunit.client.0.smithi110.stderr: -217> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: secure 2024-03-04T12:36:16.794 INFO:tasks.workunit.client.0.smithi110.stderr: -216> 2024-03-04T12:36:16.284+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.794 INFO:tasks.workunit.client.0.smithi110.stderr: -215> 2024-03-04T12:36:16.284+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.794 INFO:tasks.workunit.client.0.smithi110.stderr: -214> 2024-03-04T12:36:16.284+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command rotate-key cmddesc rotate-key hook 0x55acb8aa04d8 EEXIST 2024-03-04T12:36:16.794 INFO:tasks.workunit.client.0.smithi110.stderr: -213> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient: _reopen_session rank -1 2024-03-04T12:36:16.794 INFO:tasks.workunit.client.0.smithi110.stderr: -212> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient: _add_conns ranks=[0,2,1] 2024-03-04T12:36:16.794 INFO:tasks.workunit.client.0.smithi110.stderr: -211> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient(hunting): picked mon.noname-a con 0x55acb8aceed0 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:36:16.794 INFO:tasks.workunit.client.0.smithi110.stderr: -210> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient(hunting): picked mon.noname-c con 0x55acb8ad84d0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:36:16.794 INFO:tasks.workunit.client.0.smithi110.stderr: -209> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient(hunting): picked mon.noname-b con 0x55acb8adcf80 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:36:16.794 INFO:tasks.workunit.client.0.smithi110.stderr: -208> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.794 INFO:tasks.workunit.client.0.smithi110.stderr: -207> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.794 INFO:tasks.workunit.client.0.smithi110.stderr: -206> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.795 INFO:tasks.workunit.client.0.smithi110.stderr: -205> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient(hunting): _renew_subs 2024-03-04T12:36:16.795 INFO:tasks.workunit.client.0.smithi110.stderr: -204> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient(hunting): authenticate will time out at 1757.643645s 2024-03-04T12:36:16.795 INFO:tasks.workunit.client.0.smithi110.stderr: -203> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient(hunting): get_auth_request con 0x55acb8aceed0 auth_method 0 2024-03-04T12:36:16.795 INFO:tasks.workunit.client.0.smithi110.stderr: -202> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.795 INFO:tasks.workunit.client.0.smithi110.stderr: -201> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.795 INFO:tasks.workunit.client.0.smithi110.stderr: -200> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.795 INFO:tasks.workunit.client.0.smithi110.stderr: -199> 2024-03-04T12:36:16.284+0000 7fba67fff640 10 monclient(hunting): get_auth_request con 0x55acb8ad84d0 auth_method 0 2024-03-04T12:36:16.795 INFO:tasks.workunit.client.0.smithi110.stderr: -198> 2024-03-04T12:36:16.284+0000 7fba67fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.795 INFO:tasks.workunit.client.0.smithi110.stderr: -197> 2024-03-04T12:36:16.284+0000 7fba67fff640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.795 INFO:tasks.workunit.client.0.smithi110.stderr: -196> 2024-03-04T12:36:16.284+0000 7fba67fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.795 INFO:tasks.workunit.client.0.smithi110.stderr: -195> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.795 INFO:tasks.workunit.client.0.smithi110.stderr: -194> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.795 INFO:tasks.workunit.client.0.smithi110.stderr: -193> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.795 INFO:tasks.workunit.client.0.smithi110.stderr: -192> 2024-03-04T12:36:16.284+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.796 INFO:tasks.workunit.client.0.smithi110.stderr: -191> 2024-03-04T12:36:16.284+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.796 INFO:tasks.workunit.client.0.smithi110.stderr: -190> 2024-03-04T12:36:16.284+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.796 INFO:tasks.workunit.client.0.smithi110.stderr: -189> 2024-03-04T12:36:16.284+0000 7fba7031d640 10 monclient(hunting): get_auth_request con 0x55acb8adcf80 auth_method 0 2024-03-04T12:36:16.796 INFO:tasks.workunit.client.0.smithi110.stderr: -188> 2024-03-04T12:36:16.284+0000 7fba7031d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.796 INFO:tasks.workunit.client.0.smithi110.stderr: -187> 2024-03-04T12:36:16.284+0000 7fba7031d640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.796 INFO:tasks.workunit.client.0.smithi110.stderr: -186> 2024-03-04T12:36:16.284+0000 7fba7031d640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.796 INFO:tasks.workunit.client.0.smithi110.stderr: -185> 2024-03-04T12:36:16.284+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.796 INFO:tasks.workunit.client.0.smithi110.stderr: -184> 2024-03-04T12:36:16.284+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.796 INFO:tasks.workunit.client.0.smithi110.stderr: -183> 2024-03-04T12:36:16.284+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.796 INFO:tasks.workunit.client.0.smithi110.stderr: -182> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_done global_id 6828 payload 824 2024-03-04T12:36:16.796 INFO:tasks.workunit.client.0.smithi110.stderr: -181> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient: _finish_hunting 0 2024-03-04T12:36:16.796 INFO:tasks.workunit.client.0.smithi110.stderr: -180> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 1 monclient: found mon.noname-a 2024-03-04T12:36:16.796 INFO:tasks.workunit.client.0.smithi110.stderr: -179> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:36:16.797 INFO:tasks.workunit.client.0.smithi110.stderr: -178> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:16.797 INFO:tasks.workunit.client.0.smithi110.stderr: -177> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:36:16.797 INFO:tasks.workunit.client.0.smithi110.stderr: -176> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: dump: 2024-03-04T12:36:16.797 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:16.797 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:16.797 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.797 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.797 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:16.797 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.797 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:16.798 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:16.798 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:16.798 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.798 INFO:tasks.workunit.client.0.smithi110.stderr: -175> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: _finish_auth 0 2024-03-04T12:36:16.798 INFO:tasks.workunit.client.0.smithi110.stderr: -174> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: _check_auth_tickets 2024-03-04T12:36:16.798 INFO:tasks.workunit.client.0.smithi110.stderr: -173> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:16.798 INFO:tasks.workunit.client.0.smithi110.stderr: -172> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:16.798 INFO:tasks.workunit.client.0.smithi110.stderr: -171> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:36:16.798 INFO:tasks.workunit.client.0.smithi110.stderr: -170> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: dump: 2024-03-04T12:36:16.798 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:16.798 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:16.798 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.798 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.798 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:16.799 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.799 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:16.799 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:16.799 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:16.799 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.799 INFO:tasks.workunit.client.0.smithi110.stderr: -169> 2024-03-04T12:36:16.285+0000 7fb94effd640 4 set_mon_vals no callback set 2024-03-04T12:36:16.799 INFO:tasks.workunit.client.0.smithi110.stderr: -168> 2024-03-04T12:36:16.285+0000 7fba72020800 5 monclient: authenticate success, global_id 6828 2024-03-04T12:36:16.799 INFO:tasks.workunit.client.0.smithi110.stderr: -167> 2024-03-04T12:36:16.285+0000 7fba72020800 10 monclient: _renew_subs 2024-03-04T12:36:16.799 INFO:tasks.workunit.client.0.smithi110.stderr: -166> 2024-03-04T12:36:16.285+0000 7fba72020800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:36:16.799 INFO:tasks.workunit.client.0.smithi110.stderr: -165> 2024-03-04T12:36:16.285+0000 7fba72020800 10 monclient: _renew_subs 2024-03-04T12:36:16.799 INFO:tasks.workunit.client.0.smithi110.stderr: -164> 2024-03-04T12:36:16.285+0000 7fba72020800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:36:16.799 INFO:tasks.workunit.client.0.smithi110.stderr: -163> 2024-03-04T12:36:16.285+0000 7fba72020800 1 librados: init done 2024-03-04T12:36:16.799 INFO:tasks.workunit.client.0.smithi110.stderr: -162> 2024-03-04T12:36:16.285+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command cr dump hook 0x55acb8ad7808 2024-03-04T12:36:16.799 INFO:tasks.workunit.client.0.smithi110.stderr: -161> 2024-03-04T12:36:16.286+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.800 INFO:tasks.workunit.client.0.smithi110.stderr: -160> 2024-03-04T12:36:16.286+0000 7fb94d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:36:16.800 INFO:tasks.workunit.client.0.smithi110.stderr: -159> 2024-03-04T12:36:16.286+0000 7fb94d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:16.800 INFO:tasks.workunit.client.0.smithi110.stderr: -158> 2024-03-04T12:36:16.286+0000 7fb94d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:16.800 INFO:tasks.workunit.client.0.smithi110.stderr: -157> 2024-03-04T12:36:16.286+0000 7fba67fff640 10 monclient: get_auth_request con 0x7fb938069eb0 auth_method 0 2024-03-04T12:36:16.800 INFO:tasks.workunit.client.0.smithi110.stderr: -156> 2024-03-04T12:36:16.287+0000 7fba7031d640 10 monclient: get_auth_request con 0x55acb8af7620 auth_method 0 2024-03-04T12:36:16.800 INFO:tasks.workunit.client.0.smithi110.stderr: -155> 2024-03-04T12:36:16.287+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.800 INFO:tasks.workunit.client.0.smithi110.stderr: -154> 2024-03-04T12:36:16.287+0000 7fba72020800 20 realm 2024-03-04T12:36:16.800 INFO:tasks.workunit.client.0.smithi110.stderr: -153> 2024-03-04T12:36:16.287+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.800 INFO:tasks.workunit.client.0.smithi110.stderr: -152> 2024-03-04T12:36:16.287+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.800 INFO:tasks.workunit.client.0.smithi110.stderr: -151> 2024-03-04T12:36:16.287+0000 7fba72020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:16.800 INFO:tasks.workunit.client.0.smithi110.stderr: -150> 2024-03-04T12:36:16.287+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.800 INFO:tasks.workunit.client.0.smithi110.stderr: -149> 2024-03-04T12:36:16.287+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.800 INFO:tasks.workunit.client.0.smithi110.stderr: -148> 2024-03-04T12:36:16.287+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.800 INFO:tasks.workunit.client.0.smithi110.stderr: -147> 2024-03-04T12:36:16.288+0000 7fba6fb1c640 10 monclient: get_auth_request con 0x55acb8afb890 auth_method 0 2024-03-04T12:36:16.801 INFO:tasks.workunit.client.0.smithi110.stderr: -146> 2024-03-04T12:36:16.288+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:16.801 INFO:tasks.workunit.client.0.smithi110.stderr: -145> 2024-03-04T12:36:16.288+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.801 INFO:tasks.workunit.client.0.smithi110.stderr: -144> 2024-03-04T12:36:16.289+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:16.801 INFO:tasks.workunit.client.0.smithi110.stderr: -143> 2024-03-04T12:36:16.289+0000 7fba72020800 20 searching for the correct realm 2024-03-04T12:36:16.801 INFO:tasks.workunit.client.0.smithi110.stderr: -142> 2024-03-04T12:36:16.289+0000 7fba67fff640 10 monclient: get_auth_request con 0x55acb8b00ac0 auth_method 0 2024-03-04T12:36:16.801 INFO:tasks.workunit.client.0.smithi110.stderr: -141> 2024-03-04T12:36:16.290+0000 7fba7031d640 10 monclient: get_auth_request con 0x7fba58077040 auth_method 0 2024-03-04T12:36:16.801 INFO:tasks.workunit.client.0.smithi110.stderr: -140> 2024-03-04T12:36:16.290+0000 7fba6fb1c640 10 monclient: get_auth_request con 0x7fba6805bb60 auth_method 0 2024-03-04T12:36:16.801 INFO:tasks.workunit.client.0.smithi110.stderr: -139> 2024-03-04T12:36:16.291+0000 7fb94d7fa640 1 client.6828.objecter ms_handle_reset 0x7fba6805bb60 session 0x7fba6800f040 osd.2 2024-03-04T12:36:16.801 INFO:tasks.workunit.client.0.smithi110.stderr: -138> 2024-03-04T12:36:16.291+0000 7fb94d7fa640 10 monclient: _renew_subs 2024-03-04T12:36:16.801 INFO:tasks.workunit.client.0.smithi110.stderr: -137> 2024-03-04T12:36:16.291+0000 7fb94d7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:36:16.801 INFO:tasks.workunit.client.0.smithi110.stderr: -136> 2024-03-04T12:36:16.291+0000 7fba6fb1c640 10 monclient: get_auth_request con 0x7fb938079c50 auth_method 0 2024-03-04T12:36:16.801 INFO:tasks.workunit.client.0.smithi110.stderr: -135> 2024-03-04T12:36:16.291+0000 7fba67fff640 10 monclient: get_auth_request con 0x7fba6001e060 auth_method 0 2024-03-04T12:36:16.801 INFO:tasks.workunit.client.0.smithi110.stderr: -134> 2024-03-04T12:36:16.292+0000 7fba67fff640 0 -- 172.21.15.110:0/1478264816 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7fba6001e060 msgr2=0x7fba6005f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:36:16.801 INFO:tasks.workunit.client.0.smithi110.stderr: -133> 2024-03-04T12:36:16.493+0000 7fba67fff640 10 monclient: get_auth_request con 0x7fba6001e060 auth_method 0 2024-03-04T12:36:16.801 INFO:tasks.workunit.client.0.smithi110.stderr: -132> 2024-03-04T12:36:16.495+0000 7fba7031d640 10 monclient: get_auth_request con 0x7fba5805b070 auth_method 0 2024-03-04T12:36:16.801 INFO:tasks.workunit.client.0.smithi110.stderr: -131> 2024-03-04T12:36:16.497+0000 7fba6fb1c640 10 monclient: get_auth_request con 0x7fba58079bf0 auth_method 0 2024-03-04T12:36:16.802 INFO:tasks.workunit.client.0.smithi110.stderr: -130> 2024-03-04T12:36:16.497+0000 7fba6fb1c640 0 -- 172.21.15.110:0/1478264816 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fba58079bf0 msgr2=0x7fba58077420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:36:16.802 INFO:tasks.workunit.client.0.smithi110.stderr: -129> 2024-03-04T12:36:16.698+0000 7fba6fb1c640 10 monclient: get_auth_request con 0x7fba58079bf0 auth_method 0 2024-03-04T12:36:16.802 INFO:tasks.workunit.client.0.smithi110.stderr: -128> 2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:16.802 INFO:tasks.workunit.client.0.smithi110.stderr: -127> 2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:16.802 INFO:tasks.workunit.client.0.smithi110.stderr: -126> 2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:16.802 INFO:tasks.workunit.client.0.smithi110.stderr: -125> 2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:16.802 INFO:tasks.workunit.client.0.smithi110.stderr: -124> 2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:16.802 INFO:tasks.workunit.client.0.smithi110.stderr: -123> 2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:16.802 INFO:tasks.workunit.client.0.smithi110.stderr: -122> 2024-03-04T12:36:16.704+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.802 INFO:tasks.workunit.client.0.smithi110.stderr: -121> 2024-03-04T12:36:16.704+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.802 INFO:tasks.workunit.client.0.smithi110.stderr: -120> 2024-03-04T12:36:16.704+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.802 INFO:tasks.workunit.client.0.smithi110.stderr: -119> 2024-03-04T12:36:16.704+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:16.802 INFO:tasks.workunit.client.0.smithi110.stderr: -118> 2024-03-04T12:36:16.704+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.803 INFO:tasks.workunit.client.0.smithi110.stderr: -117> 2024-03-04T12:36:16.704+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:16.803 INFO:tasks.workunit.client.0.smithi110.stderr: -116> 2024-03-04T12:36:16.704+0000 7fba72020800 20 zone default found 2024-03-04T12:36:16.803 INFO:tasks.workunit.client.0.smithi110.stderr: -115> 2024-03-04T12:36:16.704+0000 7fba72020800 4 Realm: () 2024-03-04T12:36:16.803 INFO:tasks.workunit.client.0.smithi110.stderr: -114> 2024-03-04T12:36:16.704+0000 7fba72020800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:16.803 INFO:tasks.workunit.client.0.smithi110.stderr: -113> 2024-03-04T12:36:16.704+0000 7fba72020800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:16.803 INFO:tasks.workunit.client.0.smithi110.stderr: -112> 2024-03-04T12:36:16.704+0000 7fba72020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:16.803 INFO:tasks.workunit.client.0.smithi110.stderr: -111> 2024-03-04T12:36:16.704+0000 7fba72020800 20 zonegroup default 2024-03-04T12:36:16.803 INFO:tasks.workunit.client.0.smithi110.stderr: -110> 2024-03-04T12:36:16.704+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.803 INFO:tasks.workunit.client.0.smithi110.stderr: -109> 2024-03-04T12:36:16.705+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.803 INFO:tasks.workunit.client.0.smithi110.stderr: -108> 2024-03-04T12:36:16.705+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.803 INFO:tasks.workunit.client.0.smithi110.stderr: -107> 2024-03-04T12:36:16.705+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.803 INFO:tasks.workunit.client.0.smithi110.stderr: -106> 2024-03-04T12:36:16.705+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.803 INFO:tasks.workunit.client.0.smithi110.stderr: -105> 2024-03-04T12:36:16.705+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.803 INFO:tasks.workunit.client.0.smithi110.stderr: -104> 2024-03-04T12:36:16.705+0000 7fba72020800 20 started sync module instance, tier type = 2024-03-04T12:36:16.804 INFO:tasks.workunit.client.0.smithi110.stderr: -103> 2024-03-04T12:36:16.705+0000 7fba72020800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:16.804 INFO:tasks.workunit.client.0.smithi110.stderr: -102> 2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=0 2024-03-04T12:36:16.804 INFO:tasks.workunit.client.0.smithi110.stderr: -101> 2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=1 2024-03-04T12:36:16.804 INFO:tasks.workunit.client.0.smithi110.stderr: -100> 2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=2 2024-03-04T12:36:16.804 INFO:tasks.workunit.client.0.smithi110.stderr: -99> 2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=3 2024-03-04T12:36:16.804 INFO:tasks.workunit.client.0.smithi110.stderr: -98> 2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=4 2024-03-04T12:36:16.804 INFO:tasks.workunit.client.0.smithi110.stderr: -97> 2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=5 2024-03-04T12:36:16.804 INFO:tasks.workunit.client.0.smithi110.stderr: -96> 2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=6 2024-03-04T12:36:16.804 INFO:tasks.workunit.client.0.smithi110.stderr: -95> 2024-03-04T12:36:16.718+0000 7fba72020800 20 add_watcher() i=7 2024-03-04T12:36:16.804 INFO:tasks.workunit.client.0.smithi110.stderr: -94> 2024-03-04T12:36:16.718+0000 7fba72020800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:16.804 INFO:tasks.workunit.client.0.smithi110.stderr: -93> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding auth protocol: cephx 2024-03-04T12:36:16.804 INFO:tasks.workunit.client.0.smithi110.stderr: -92> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding auth protocol: cephx 2024-03-04T12:36:16.804 INFO:tasks.workunit.client.0.smithi110.stderr: -91> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding auth protocol: cephx 2024-03-04T12:36:16.804 INFO:tasks.workunit.client.0.smithi110.stderr: -90> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: secure 2024-03-04T12:36:16.804 INFO:tasks.workunit.client.0.smithi110.stderr: -89> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: crc 2024-03-04T12:36:16.805 INFO:tasks.workunit.client.0.smithi110.stderr: -88> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: secure 2024-03-04T12:36:16.805 INFO:tasks.workunit.client.0.smithi110.stderr: -87> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: crc 2024-03-04T12:36:16.805 INFO:tasks.workunit.client.0.smithi110.stderr: -86> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: secure 2024-03-04T12:36:16.805 INFO:tasks.workunit.client.0.smithi110.stderr: -85> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: crc 2024-03-04T12:36:16.805 INFO:tasks.workunit.client.0.smithi110.stderr: -84> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: crc 2024-03-04T12:36:16.805 INFO:tasks.workunit.client.0.smithi110.stderr: -83> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: secure 2024-03-04T12:36:16.805 INFO:tasks.workunit.client.0.smithi110.stderr: -82> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: crc 2024-03-04T12:36:16.805 INFO:tasks.workunit.client.0.smithi110.stderr: -81> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: secure 2024-03-04T12:36:16.805 INFO:tasks.workunit.client.0.smithi110.stderr: -80> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: crc 2024-03-04T12:36:16.805 INFO:tasks.workunit.client.0.smithi110.stderr: -79> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: secure 2024-03-04T12:36:16.805 INFO:tasks.workunit.client.0.smithi110.stderr: -78> 2024-03-04T12:36:16.720+0000 7fb925fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:16.805 INFO:tasks.workunit.client.0.smithi110.stderr: -77> 2024-03-04T12:36:16.720+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.805 INFO:tasks.workunit.client.0.smithi110.stderr: -76> 2024-03-04T12:36:16.720+0000 7fba72020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:16.805 INFO:tasks.workunit.client.0.smithi110.stderr: -75> 2024-03-04T12:36:16.720+0000 7fba72020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:16.805 INFO:tasks.workunit.client.0.smithi110.stderr: -74> 2024-03-04T12:36:16.720+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command cache list hook 0x55acb8ad3a40 2024-03-04T12:36:16.806 INFO:tasks.workunit.client.0.smithi110.stderr: -73> 2024-03-04T12:36:16.720+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command cache inspect hook 0x55acb8ad3a40 2024-03-04T12:36:16.806 INFO:tasks.workunit.client.0.smithi110.stderr: -72> 2024-03-04T12:36:16.720+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command cache erase hook 0x55acb8ad3a40 2024-03-04T12:36:16.806 INFO:tasks.workunit.client.0.smithi110.stderr: -71> 2024-03-04T12:36:16.720+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command cache zap hook 0x55acb8ad3a40 2024-03-04T12:36:16.806 INFO:tasks.workunit.client.0.smithi110.stderr: -70> 2024-03-04T12:36:16.720+0000 7fba72020800 5 note: GC not initialized 2024-03-04T12:36:16.806 INFO:tasks.workunit.client.0.smithi110.stderr: -69> 2024-03-04T12:36:16.720+0000 7fb924fe1640 20 reqs_thread_entry: start 2024-03-04T12:36:16.806 INFO:tasks.workunit.client.0.smithi110.stderr: -68> 2024-03-04T12:36:16.720+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command sync trace show hook 0x7fba600042e0 2024-03-04T12:36:16.806 INFO:tasks.workunit.client.0.smithi110.stderr: -67> 2024-03-04T12:36:16.720+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command sync trace history hook 0x7fba600042e0 2024-03-04T12:36:16.806 INFO:tasks.workunit.client.0.smithi110.stderr: -66> 2024-03-04T12:36:16.720+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command sync trace active hook 0x7fba600042e0 2024-03-04T12:36:16.806 INFO:tasks.workunit.client.0.smithi110.stderr: -65> 2024-03-04T12:36:16.720+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command sync trace active_short hook 0x7fba600042e0 2024-03-04T12:36:16.806 INFO:tasks.workunit.client.0.smithi110.stderr: -64> 2024-03-04T12:36:16.720+0000 7fba72020800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:16.806 INFO:tasks.workunit.client.0.smithi110.stderr: -63> 2024-03-04T12:36:16.720+0000 7fba72020800 20 Filter name: none 2024-03-04T12:36:16.806 INFO:tasks.workunit.client.0.smithi110.stderr: -62> 2024-03-04T12:36:16.720+0000 7fb89e7fc640 20 reqs_thread_entry: start 2024-03-04T12:36:16.806 INFO:tasks.workunit.client.0.smithi110.stderr: -61> 2024-03-04T12:36:16.720+0000 7fba72020800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-04T12:36:16.806 INFO:tasks.workunit.client.0.smithi110.stderr: -60> 2024-03-04T12:36:16.720+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.806 INFO:tasks.workunit.client.0.smithi110.stderr: -59> 2024-03-04T12:36:16.721+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:16.807 INFO:tasks.workunit.client.0.smithi110.stderr: -58> 2024-03-04T12:36:16.721+0000 7fba72020800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-04T12:36:16.807 INFO:tasks.workunit.client.0.smithi110.stderr: -57> 2024-03-04T12:36:16.721+0000 7fba72020800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-04T12:36:16.807 INFO:tasks.workunit.client.0.smithi110.stderr: -56> 2024-03-04T12:36:16.721+0000 7fba72020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 : miss 2024-03-04T12:36:16.807 INFO:tasks.workunit.client.0.smithi110.stderr: -55> 2024-03-04T12:36:16.721+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.807 INFO:tasks.workunit.client.0.smithi110.stderr: -54> 2024-03-04T12:36:16.721+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:16.807 INFO:tasks.workunit.client.0.smithi110.stderr: -53> 2024-03-04T12:36:16.721+0000 7fba72020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 info.flags=0x17 2024-03-04T12:36:16.807 INFO:tasks.workunit.client.0.smithi110.stderr: -52> 2024-03-04T12:36:16.721+0000 7fba72020800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 to cache LRU end 2024-03-04T12:36:16.807 INFO:tasks.workunit.client.0.smithi110.stderr: -51> 2024-03-04T12:36:16.721+0000 7fba72020800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:36:16.807 INFO:tasks.workunit.client.0.smithi110.stderr: -50> 2024-03-04T12:36:16.721+0000 7fba72020800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:16.807 INFO:tasks.workunit.client.0.smithi110.stderr: -49> 2024-03-04T12:36:16.721+0000 7fba72020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 2024-03-04T12:36:16.807 INFO:tasks.workunit.client.0.smithi110.stderr: -48> 2024-03-04T12:36:16.727+0000 7fba72020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 info.flags=0x17 2024-03-04T12:36:16.807 INFO:tasks.workunit.client.0.smithi110.stderr: -47> 2024-03-04T12:36:16.727+0000 7fba72020800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 to cache LRU end 2024-03-04T12:36:16.807 INFO:tasks.workunit.client.0.smithi110.stderr: -46> 2024-03-04T12:36:16.727+0000 7fba72020800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:16.808 INFO:tasks.workunit.client.0.smithi110.stderr: -45> 2024-03-04T12:36:16.727+0000 7fba72020800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27, ofs0, ns] 2024-03-04T12:36:16.808 INFO:tasks.workunit.client.0.smithi110.stderr: -44> 2024-03-04T12:36:16.727+0000 7fb94effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824035 cookie 94200321313504 notifier 6828 bl.length()=965 2024-03-04T12:36:16.808 INFO:tasks.workunit.client.0.smithi110.stderr: -43> 2024-03-04T12:36:16.727+0000 7fb94effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 info.flags=0x17 2024-03-04T12:36:16.808 INFO:tasks.workunit.client.0.smithi110.stderr: -42> 2024-03-04T12:36:16.727+0000 7fb94effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 to cache LRU end 2024-03-04T12:36:16.808 INFO:tasks.workunit.client.0.smithi110.stderr: -41> 2024-03-04T12:36:16.727+0000 7fb94effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:16.808 INFO:tasks.workunit.client.0.smithi110.stderr: -40> 2024-03-04T12:36:16.729+0000 7fba72020800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): orig_sources= new_sources= 2024-03-04T12:36:16.808 INFO:tasks.workunit.client.0.smithi110.stderr: -39> 2024-03-04T12:36:16.729+0000 7fba72020800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): potential sources added=[] removed=[] 2024-03-04T12:36:16.808 INFO:tasks.workunit.client.0.smithi110.stderr: -38> 2024-03-04T12:36:16.729+0000 7fba72020800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): orig_dests= new_dests= 2024-03-04T12:36:16.808 INFO:tasks.workunit.client.0.smithi110.stderr: -37> 2024-03-04T12:36:16.729+0000 7fba72020800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): potential dests added=[] removed=[] 2024-03-04T12:36:16.808 INFO:tasks.workunit.client.0.smithi110.stderr: -36> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.0 2024-03-04T12:36:16.808 INFO:tasks.workunit.client.0.smithi110.stderr: -35> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.0 2024-03-04T12:36:16.808 INFO:tasks.workunit.client.0.smithi110.stderr: -34> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.1 2024-03-04T12:36:16.809 INFO:tasks.workunit.client.0.smithi110.stderr: -33> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.1 2024-03-04T12:36:16.809 INFO:tasks.workunit.client.0.smithi110.stderr: -32> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.2 2024-03-04T12:36:16.809 INFO:tasks.workunit.client.0.smithi110.stderr: -31> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.2 2024-03-04T12:36:16.809 INFO:tasks.workunit.client.0.smithi110.stderr: -30> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.3 2024-03-04T12:36:16.809 INFO:tasks.workunit.client.0.smithi110.stderr: -29> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.3 2024-03-04T12:36:16.809 INFO:tasks.workunit.client.0.smithi110.stderr: -28> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.4 2024-03-04T12:36:16.809 INFO:tasks.workunit.client.0.smithi110.stderr: -27> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.4 2024-03-04T12:36:16.809 INFO:tasks.workunit.client.0.smithi110.stderr: -26> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.5 2024-03-04T12:36:16.809 INFO:tasks.workunit.client.0.smithi110.stderr: -25> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.5 2024-03-04T12:36:16.809 INFO:tasks.workunit.client.0.smithi110.stderr: -24> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.6 2024-03-04T12:36:16.809 INFO:tasks.workunit.client.0.smithi110.stderr: -23> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.6 2024-03-04T12:36:16.809 INFO:tasks.workunit.client.0.smithi110.stderr: -22> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.7 2024-03-04T12:36:16.809 INFO:tasks.workunit.client.0.smithi110.stderr: -21> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.7 2024-03-04T12:36:16.810 INFO:tasks.workunit.client.0.smithi110.stderr: -20> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.8 2024-03-04T12:36:16.810 INFO:tasks.workunit.client.0.smithi110.stderr: -19> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.8 2024-03-04T12:36:16.810 INFO:tasks.workunit.client.0.smithi110.stderr: -18> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.9 2024-03-04T12:36:16.810 INFO:tasks.workunit.client.0.smithi110.stderr: -17> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.9 2024-03-04T12:36:16.810 INFO:tasks.workunit.client.0.smithi110.stderr: -16> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.10 2024-03-04T12:36:16.810 INFO:tasks.workunit.client.0.smithi110.stderr: -15> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.10 2024-03-04T12:36:16.810 INFO:tasks.workunit.client.0.smithi110.stderr: -14> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.11 2024-03-04T12:36:16.810 INFO:tasks.workunit.client.0.smithi110.stderr: -13> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.11 2024-03-04T12:36:16.810 INFO:tasks.workunit.client.0.smithi110.stderr: -12> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.0 2024-03-04T12:36:16.810 INFO:tasks.workunit.client.0.smithi110.stderr: -11> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1 2024-03-04T12:36:16.810 INFO:tasks.workunit.client.0.smithi110.stderr: -10> 2024-03-04T12:36:16.733+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.2 2024-03-04T12:36:16.810 INFO:tasks.workunit.client.0.smithi110.stderr: -9> 2024-03-04T12:36:16.733+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.3 2024-03-04T12:36:16.810 INFO:tasks.workunit.client.0.smithi110.stderr: -8> 2024-03-04T12:36:16.734+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.4 2024-03-04T12:36:16.810 INFO:tasks.workunit.client.0.smithi110.stderr: -7> 2024-03-04T12:36:16.734+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.5 2024-03-04T12:36:16.811 INFO:tasks.workunit.client.0.smithi110.stderr: -6> 2024-03-04T12:36:16.735+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.6 2024-03-04T12:36:16.811 INFO:tasks.workunit.client.0.smithi110.stderr: -5> 2024-03-04T12:36:16.735+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.7 2024-03-04T12:36:16.811 INFO:tasks.workunit.client.0.smithi110.stderr: -4> 2024-03-04T12:36:16.736+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.8 2024-03-04T12:36:16.811 INFO:tasks.workunit.client.0.smithi110.stderr: -3> 2024-03-04T12:36:16.736+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.9 2024-03-04T12:36:16.811 INFO:tasks.workunit.client.0.smithi110.stderr: -2> 2024-03-04T12:36:16.737+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.10 2024-03-04T12:36:16.811 INFO:tasks.workunit.client.0.smithi110.stderr: -1> 2024-03-04T12:36:16.740+0000 7fba72020800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fba72020800 time 2024-03-04T12:36:16.740866+0000 2024-03-04T12:36:16.811 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:36:16.811 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.811 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:36:16.811 INFO:tasks.workunit.client.0.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fba75380e86] 2024-03-04T12:36:16.811 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fba75381044] 2024-03-04T12:36:16.811 INFO:tasks.workunit.client.0.smithi110.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acb6b5feb1] 2024-03-04T12:36:16.812 INFO:tasks.workunit.client.0.smithi110.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x55acb6b74088] 2024-03-04T12:36:16.812 INFO:tasks.workunit.client.0.smithi110.stderr: 5: main() 2024-03-04T12:36:16.812 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fba7423feb0] 2024-03-04T12:36:16.812 INFO:tasks.workunit.client.0.smithi110.stderr: 7: __libc_start_main() 2024-03-04T12:36:16.812 INFO:tasks.workunit.client.0.smithi110.stderr: 8: _start() 2024-03-04T12:36:16.812 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.812 INFO:tasks.workunit.client.0.smithi110.stderr: 0> 2024-03-04T12:36:16.741+0000 7fba72020800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:36:16.812 INFO:tasks.workunit.client.0.smithi110.stderr: in thread 7fba72020800 thread_name:radosgw-admin 2024-03-04T12:36:16.812 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.812 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:36:16.812 INFO:tasks.workunit.client.0.smithi110.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fba74254db0] 2024-03-04T12:36:16.812 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fba742a154c] 2024-03-04T12:36:16.812 INFO:tasks.workunit.client.0.smithi110.stderr: 3: raise() 2024-03-04T12:36:16.813 INFO:tasks.workunit.client.0.smithi110.stderr: 4: abort() 2024-03-04T12:36:16.813 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fba75380ee0] 2024-03-04T12:36:16.813 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fba75381044] 2024-03-04T12:36:16.813 INFO:tasks.workunit.client.0.smithi110.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acb6b5feb1] 2024-03-04T12:36:16.813 INFO:tasks.workunit.client.0.smithi110.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x55acb6b74088] 2024-03-04T12:36:16.813 INFO:tasks.workunit.client.0.smithi110.stderr: 9: main() 2024-03-04T12:36:16.813 INFO:tasks.workunit.client.0.smithi110.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fba7423feb0] 2024-03-04T12:36:16.813 INFO:tasks.workunit.client.0.smithi110.stderr: 11: __libc_start_main() 2024-03-04T12:36:16.813 INFO:tasks.workunit.client.0.smithi110.stderr: 12: _start() 2024-03-04T12:36:16.813 INFO:tasks.workunit.client.0.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:36:16.813 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.813 INFO:tasks.workunit.client.0.smithi110.stderr:--- logging levels --- 2024-03-04T12:36:16.813 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 none 2024-03-04T12:36:16.814 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 lockdep 2024-03-04T12:36:16.814 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 context 2024-03-04T12:36:16.814 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 crush 2024-03-04T12:36:16.814 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds 2024-03-04T12:36:16.814 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_balancer 2024-03-04T12:36:16.814 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_locker 2024-03-04T12:36:16.814 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_log 2024-03-04T12:36:16.814 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_log_expire 2024-03-04T12:36:16.814 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_migrator 2024-03-04T12:36:16.814 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 buffer 2024-03-04T12:36:16.814 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 timer 2024-03-04T12:36:16.814 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 filer 2024-03-04T12:36:16.814 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 striper 2024-03-04T12:36:16.814 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 objecter 2024-03-04T12:36:16.815 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rados 2024-03-04T12:36:16.815 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd 2024-03-04T12:36:16.815 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_mirror 2024-03-04T12:36:16.815 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_replay 2024-03-04T12:36:16.815 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_pwl 2024-03-04T12:36:16.815 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 journaler 2024-03-04T12:36:16.815 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 objectcacher 2024-03-04T12:36:16.815 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 immutable_obj_cache 2024-03-04T12:36:16.815 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 client 2024-03-04T12:36:16.815 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 osd 2024-03-04T12:36:16.815 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 optracker 2024-03-04T12:36:16.815 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 objclass 2024-03-04T12:36:16.815 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 filestore 2024-03-04T12:36:16.815 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 journal 2024-03-04T12:36:16.816 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 0 ms 2024-03-04T12:36:16.816 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mon 2024-03-04T12:36:16.816 INFO:tasks.workunit.client.0.smithi110.stderr: 0/10 monc 2024-03-04T12:36:16.816 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 paxos 2024-03-04T12:36:16.816 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 tp 2024-03-04T12:36:16.816 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 auth 2024-03-04T12:36:16.816 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 crypto 2024-03-04T12:36:16.816 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 finisher 2024-03-04T12:36:16.816 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 reserver 2024-03-04T12:36:16.816 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 heartbeatmap 2024-03-04T12:36:16.816 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 perfcounter 2024-03-04T12:36:16.816 INFO:tasks.workunit.client.0.smithi110.stderr: 20/20 rgw 2024-03-04T12:36:16.816 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_sync 2024-03-04T12:36:16.816 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_datacache 2024-03-04T12:36:16.817 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_access 2024-03-04T12:36:16.817 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_dbstore 2024-03-04T12:36:16.817 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_flight 2024-03-04T12:36:16.817 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_lifecycle 2024-03-04T12:36:16.817 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 javaclient 2024-03-04T12:36:16.817 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 asok 2024-03-04T12:36:16.817 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 throttle 2024-03-04T12:36:16.817 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 0 refs 2024-03-04T12:36:16.817 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 compressor 2024-03-04T12:36:16.817 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 bluestore 2024-03-04T12:36:16.817 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 bluefs 2024-03-04T12:36:16.817 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 bdev 2024-03-04T12:36:16.817 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 kstore 2024-03-04T12:36:16.817 INFO:tasks.workunit.client.0.smithi110.stderr: 4/ 5 rocksdb 2024-03-04T12:36:16.818 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 fuse 2024-03-04T12:36:16.818 INFO:tasks.workunit.client.0.smithi110.stderr: 2/ 5 mgr 2024-03-04T12:36:16.818 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mgrc 2024-03-04T12:36:16.818 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 dpdk 2024-03-04T12:36:16.818 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 eventtrace 2024-03-04T12:36:16.818 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 prioritycache 2024-03-04T12:36:16.818 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 test 2024-03-04T12:36:16.818 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cephfs_mirror 2024-03-04T12:36:16.818 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cephsqlite 2024-03-04T12:36:16.818 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 crimson_interrupt 2024-03-04T12:36:16.818 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore 2024-03-04T12:36:16.818 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_onode 2024-03-04T12:36:16.818 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_odata 2024-03-04T12:36:16.818 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_omap 2024-03-04T12:36:16.819 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_tm 2024-03-04T12:36:16.819 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_t 2024-03-04T12:36:16.819 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_cleaner 2024-03-04T12:36:16.819 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_epm 2024-03-04T12:36:16.819 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_lba 2024-03-04T12:36:16.819 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-04T12:36:16.819 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_cache 2024-03-04T12:36:16.819 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_journal 2024-03-04T12:36:16.819 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_device 2024-03-04T12:36:16.819 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_backref 2024-03-04T12:36:16.819 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 alienstore 2024-03-04T12:36:16.819 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mclock 2024-03-04T12:36:16.819 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cyanstore 2024-03-04T12:36:16.819 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 ceph_exporter 2024-03-04T12:36:16.819 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 memstore 2024-03-04T12:36:16.820 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 trace 2024-03-04T12:36:16.820 INFO:tasks.workunit.client.0.smithi110.stderr: -2/-2 (syslog threshold) 2024-03-04T12:36:16.820 INFO:tasks.workunit.client.0.smithi110.stderr: 99/99 (stderr threshold) 2024-03-04T12:36:16.820 INFO:tasks.workunit.client.0.smithi110.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-04T12:36:16.820 INFO:tasks.workunit.client.0.smithi110.stderr: 7fb89e7fc640 / http_manager 2024-03-04T12:36:16.820 INFO:tasks.workunit.client.0.smithi110.stderr: 7fb924fe1640 / http_manager 2024-03-04T12:36:16.820 INFO:tasks.workunit.client.0.smithi110.stderr: 7fb925fe3640 / rgw_dt_lg_renew 2024-03-04T12:36:16.820 INFO:tasks.workunit.client.0.smithi110.stderr: 7fb94d7fa640 / ms_dispatch 2024-03-04T12:36:16.820 INFO:tasks.workunit.client.0.smithi110.stderr: 7fb94effd640 / io_context_pool 2024-03-04T12:36:16.820 INFO:tasks.workunit.client.0.smithi110.stderr: 7fb9557fa640 / ms_dispatch 2024-03-04T12:36:16.820 INFO:tasks.workunit.client.0.smithi110.stderr: 7fb957fff640 / ms_dispatch 2024-03-04T12:36:16.820 INFO:tasks.workunit.client.0.smithi110.stderr: 7fb95de0b640 / io_context_pool 2024-03-04T12:36:16.820 INFO:tasks.workunit.client.0.smithi110.stderr: 7fba67fff640 / msgr-worker-2 2024-03-04T12:36:16.821 INFO:tasks.workunit.client.0.smithi110.stderr: 7fba6fb1c640 / msgr-worker-1 2024-03-04T12:36:16.821 INFO:tasks.workunit.client.0.smithi110.stderr: 7fba7031d640 / msgr-worker-0 2024-03-04T12:36:16.821 INFO:tasks.workunit.client.0.smithi110.stderr: 7fba70b1e640 / io_context_pool 2024-03-04T12:36:16.821 INFO:tasks.workunit.client.0.smithi110.stderr: 7fba72020800 / radosgw-admin 2024-03-04T12:36:16.821 INFO:tasks.workunit.client.0.smithi110.stderr: max_recent 500 2024-03-04T12:36:16.821 INFO:tasks.workunit.client.0.smithi110.stderr: max_new 1000 2024-03-04T12:36:16.821 INFO:tasks.workunit.client.0.smithi110.stderr: log_file /var/log/ceph/ceph-client.admin.105809.log 2024-03-04T12:36:16.821 INFO:tasks.workunit.client.0.smithi110.stderr:--- end dump of recent events --- 2024-03-04T12:36:16.821 INFO:tasks.workunit.client.0.smithi110.stderr:--- begin dump of recent events --- 2024-03-04T12:36:16.821 INFO:tasks.workunit.client.0.smithi110.stderr: -499> 2024-03-04T12:36:16.272+0000 7fba72020800 5 AuthRegistry(0x55acb8a0bd60) adding con mode: crc 2024-03-04T12:36:16.821 INFO:tasks.workunit.client.0.smithi110.stderr: -498> 2024-03-04T12:36:16.272+0000 7fba72020800 5 AuthRegistry(0x55acb8a0bd60) adding con mode: secure 2024-03-04T12:36:16.821 INFO:tasks.workunit.client.0.smithi110.stderr: -497> 2024-03-04T12:36:16.272+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.821 INFO:tasks.workunit.client.0.smithi110.stderr: -496> 2024-03-04T12:36:16.272+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.821 INFO:tasks.workunit.client.0.smithi110.stderr: -495> 2024-03-04T12:36:16.272+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command rotate-key hook 0x55acb8a0bea8 2024-03-04T12:36:16.821 INFO:tasks.workunit.client.0.smithi110.stderr: -494> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient: _reopen_session rank -1 2024-03-04T12:36:16.822 INFO:tasks.workunit.client.0.smithi110.stderr: -493> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-04T12:36:16.822 INFO:tasks.workunit.client.0.smithi110.stderr: -492> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient(hunting): picked mon.noname-c con 0x55acb88b85b0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:36:16.822 INFO:tasks.workunit.client.0.smithi110.stderr: -491> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient(hunting): picked mon.noname-b con 0x55acb88c3130 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:36:16.822 INFO:tasks.workunit.client.0.smithi110.stderr: -490> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient(hunting): picked mon.noname-a con 0x55acb894ed40 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:36:16.822 INFO:tasks.workunit.client.0.smithi110.stderr: -489> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.822 INFO:tasks.workunit.client.0.smithi110.stderr: -488> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.822 INFO:tasks.workunit.client.0.smithi110.stderr: -487> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.822 INFO:tasks.workunit.client.0.smithi110.stderr: -486> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient(hunting): _renew_subs 2024-03-04T12:36:16.822 INFO:tasks.workunit.client.0.smithi110.stderr: -485> 2024-03-04T12:36:16.272+0000 7fba72020800 10 monclient(hunting): authenticate will time out at 1757.631615s 2024-03-04T12:36:16.822 INFO:tasks.workunit.client.0.smithi110.stderr: -484> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient(hunting): get_auth_request con 0x55acb88b85b0 auth_method 0 2024-03-04T12:36:16.822 INFO:tasks.workunit.client.0.smithi110.stderr: -483> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.822 INFO:tasks.workunit.client.0.smithi110.stderr: -482> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.822 INFO:tasks.workunit.client.0.smithi110.stderr: -481> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.822 INFO:tasks.workunit.client.0.smithi110.stderr: -480> 2024-03-04T12:36:16.272+0000 7fba7031d640 10 monclient(hunting): get_auth_request con 0x55acb894ed40 auth_method 0 2024-03-04T12:36:16.823 INFO:tasks.workunit.client.0.smithi110.stderr: -479> 2024-03-04T12:36:16.272+0000 7fba7031d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.823 INFO:tasks.workunit.client.0.smithi110.stderr: -478> 2024-03-04T12:36:16.272+0000 7fba7031d640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.823 INFO:tasks.workunit.client.0.smithi110.stderr: -477> 2024-03-04T12:36:16.272+0000 7fba7031d640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.823 INFO:tasks.workunit.client.0.smithi110.stderr: -476> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.823 INFO:tasks.workunit.client.0.smithi110.stderr: -475> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.823 INFO:tasks.workunit.client.0.smithi110.stderr: -474> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.823 INFO:tasks.workunit.client.0.smithi110.stderr: -473> 2024-03-04T12:36:16.272+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.823 INFO:tasks.workunit.client.0.smithi110.stderr: -472> 2024-03-04T12:36:16.272+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.823 INFO:tasks.workunit.client.0.smithi110.stderr: -471> 2024-03-04T12:36:16.272+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.823 INFO:tasks.workunit.client.0.smithi110.stderr: -470> 2024-03-04T12:36:16.272+0000 7fba67fff640 10 monclient(hunting): get_auth_request con 0x55acb88c3130 auth_method 0 2024-03-04T12:36:16.823 INFO:tasks.workunit.client.0.smithi110.stderr: -469> 2024-03-04T12:36:16.272+0000 7fba67fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.823 INFO:tasks.workunit.client.0.smithi110.stderr: -468> 2024-03-04T12:36:16.272+0000 7fba67fff640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.823 INFO:tasks.workunit.client.0.smithi110.stderr: -467> 2024-03-04T12:36:16.272+0000 7fba67fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.823 INFO:tasks.workunit.client.0.smithi110.stderr: -466> 2024-03-04T12:36:16.272+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.823 INFO:tasks.workunit.client.0.smithi110.stderr: -465> 2024-03-04T12:36:16.272+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.823 INFO:tasks.workunit.client.0.smithi110.stderr: -464> 2024-03-04T12:36:16.272+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.824 INFO:tasks.workunit.client.0.smithi110.stderr: -463> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_done global_id 6380 payload 824 2024-03-04T12:36:16.824 INFO:tasks.workunit.client.0.smithi110.stderr: -462> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient: _finish_hunting 0 2024-03-04T12:36:16.824 INFO:tasks.workunit.client.0.smithi110.stderr: -461> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 1 monclient: found mon.noname-c 2024-03-04T12:36:16.824 INFO:tasks.workunit.client.0.smithi110.stderr: -460> 2024-03-04T12:36:16.272+0000 7fba6fb1c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.110:3301/0 2024-03-04T12:36:16.824 INFO:tasks.workunit.client.0.smithi110.stderr: -459> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:16.824 INFO:tasks.workunit.client.0.smithi110.stderr: -458> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:36:16.824 INFO:tasks.workunit.client.0.smithi110.stderr: -457> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: dump: 2024-03-04T12:36:16.824 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:16.824 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:16.824 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.824 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.824 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:16.824 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.824 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:16.825 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:16.825 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:16.825 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.825 INFO:tasks.workunit.client.0.smithi110.stderr: -456> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: _finish_auth 0 2024-03-04T12:36:16.825 INFO:tasks.workunit.client.0.smithi110.stderr: -455> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: _check_auth_tickets 2024-03-04T12:36:16.825 INFO:tasks.workunit.client.0.smithi110.stderr: -454> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:16.825 INFO:tasks.workunit.client.0.smithi110.stderr: -453> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:16.825 INFO:tasks.workunit.client.0.smithi110.stderr: -452> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:36:16.825 INFO:tasks.workunit.client.0.smithi110.stderr: -451> 2024-03-04T12:36:16.273+0000 7fb957fff640 10 monclient: dump: 2024-03-04T12:36:16.825 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:16.825 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:16.825 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.825 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.826 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:16.826 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.826 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:16.826 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:16.826 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:16.826 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.826 INFO:tasks.workunit.client.0.smithi110.stderr: -450> 2024-03-04T12:36:16.273+0000 7fba72020800 5 monclient: authenticate success, global_id 6380 2024-03-04T12:36:16.826 INFO:tasks.workunit.client.0.smithi110.stderr: -449> 2024-03-04T12:36:16.273+0000 7fb95de0b640 4 set_mon_vals no callback set 2024-03-04T12:36:16.826 INFO:tasks.workunit.client.0.smithi110.stderr: -448> 2024-03-04T12:36:16.273+0000 7fba72020800 10 monclient: _renew_subs 2024-03-04T12:36:16.826 INFO:tasks.workunit.client.0.smithi110.stderr: -447> 2024-03-04T12:36:16.273+0000 7fba72020800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:16.826 INFO:tasks.workunit.client.0.smithi110.stderr: -446> 2024-03-04T12:36:16.273+0000 7fba72020800 10 monclient: _renew_subs 2024-03-04T12:36:16.826 INFO:tasks.workunit.client.0.smithi110.stderr: -445> 2024-03-04T12:36:16.273+0000 7fba72020800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:16.826 INFO:tasks.workunit.client.0.smithi110.stderr: -444> 2024-03-04T12:36:16.273+0000 7fba72020800 1 librados: init done 2024-03-04T12:36:16.826 INFO:tasks.workunit.client.0.smithi110.stderr: -443> 2024-03-04T12:36:16.274+0000 7fb957fff640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:36:16.826 INFO:tasks.workunit.client.0.smithi110.stderr: -442> 2024-03-04T12:36:16.274+0000 7fb957fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:16.827 INFO:tasks.workunit.client.0.smithi110.stderr: -441> 2024-03-04T12:36:16.274+0000 7fb957fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:16.827 INFO:tasks.workunit.client.0.smithi110.stderr: -440> 2024-03-04T12:36:16.275+0000 7fba67fff640 10 monclient: get_auth_request con 0x7fb958069eb0 auth_method 0 2024-03-04T12:36:16.827 INFO:tasks.workunit.client.0.smithi110.stderr: -439> 2024-03-04T12:36:16.275+0000 7fba7031d640 10 monclient: get_auth_request con 0x55acb8a36c20 auth_method 0 2024-03-04T12:36:16.827 INFO:tasks.workunit.client.0.smithi110.stderr: -438> 2024-03-04T12:36:16.275+0000 7fba6fb1c640 10 monclient: get_auth_request con 0x55acb8a57230 auth_method 0 2024-03-04T12:36:16.827 INFO:tasks.workunit.client.0.smithi110.stderr: -437> 2024-03-04T12:36:16.277+0000 7fba67fff640 10 monclient: get_auth_request con 0x55acb8a5c870 auth_method 0 2024-03-04T12:36:16.827 INFO:tasks.workunit.client.0.smithi110.stderr: -436> 2024-03-04T12:36:16.277+0000 7fba72020800 10 monclient: build_initial_monmap 2024-03-04T12:36:16.827 INFO:tasks.workunit.client.0.smithi110.stderr: -435> 2024-03-04T12:36:16.277+0000 7fba72020800 1 build_initial for_mkfs: 0 2024-03-04T12:36:16.827 INFO:tasks.workunit.client.0.smithi110.stderr: -434> 2024-03-04T12:36:16.277+0000 7fba72020800 10 monclient: monmap: 2024-03-04T12:36:16.827 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:36:16.827 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:36:16.827 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:36:16.827 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:36:16.827 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:36:16.827 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.828 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:36:16.828 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:36:16.828 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:36:16.828 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.828 INFO:tasks.workunit.client.0.smithi110.stderr: -433> 2024-03-04T12:36:16.277+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding auth protocol: cephx 2024-03-04T12:36:16.828 INFO:tasks.workunit.client.0.smithi110.stderr: -432> 2024-03-04T12:36:16.277+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding auth protocol: cephx 2024-03-04T12:36:16.828 INFO:tasks.workunit.client.0.smithi110.stderr: -431> 2024-03-04T12:36:16.277+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding auth protocol: cephx 2024-03-04T12:36:16.828 INFO:tasks.workunit.client.0.smithi110.stderr: -430> 2024-03-04T12:36:16.277+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: secure 2024-03-04T12:36:16.828 INFO:tasks.workunit.client.0.smithi110.stderr: -429> 2024-03-04T12:36:16.277+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: crc 2024-03-04T12:36:16.828 INFO:tasks.workunit.client.0.smithi110.stderr: -428> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: secure 2024-03-04T12:36:16.828 INFO:tasks.workunit.client.0.smithi110.stderr: -427> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: crc 2024-03-04T12:36:16.828 INFO:tasks.workunit.client.0.smithi110.stderr: -426> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: secure 2024-03-04T12:36:16.828 INFO:tasks.workunit.client.0.smithi110.stderr: -425> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: crc 2024-03-04T12:36:16.828 INFO:tasks.workunit.client.0.smithi110.stderr: -424> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: crc 2024-03-04T12:36:16.829 INFO:tasks.workunit.client.0.smithi110.stderr: -423> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: secure 2024-03-04T12:36:16.829 INFO:tasks.workunit.client.0.smithi110.stderr: -422> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: crc 2024-03-04T12:36:16.829 INFO:tasks.workunit.client.0.smithi110.stderr: -421> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: secure 2024-03-04T12:36:16.829 INFO:tasks.workunit.client.0.smithi110.stderr: -420> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: crc 2024-03-04T12:36:16.829 INFO:tasks.workunit.client.0.smithi110.stderr: -419> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a60540) adding con mode: secure 2024-03-04T12:36:16.829 INFO:tasks.workunit.client.0.smithi110.stderr: -418> 2024-03-04T12:36:16.278+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.829 INFO:tasks.workunit.client.0.smithi110.stderr: -417> 2024-03-04T12:36:16.278+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command objecter_requests cmddesc objecter_requests hook 0x55acb8a641c0 EEXIST 2024-03-04T12:36:16.829 INFO:tasks.workunit.client.0.smithi110.stderr: -416> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient: init 2024-03-04T12:36:16.829 INFO:tasks.workunit.client.0.smithi110.stderr: -415> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding auth protocol: cephx 2024-03-04T12:36:16.829 INFO:tasks.workunit.client.0.smithi110.stderr: -414> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding auth protocol: cephx 2024-03-04T12:36:16.829 INFO:tasks.workunit.client.0.smithi110.stderr: -413> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding auth protocol: cephx 2024-03-04T12:36:16.829 INFO:tasks.workunit.client.0.smithi110.stderr: -412> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: secure 2024-03-04T12:36:16.829 INFO:tasks.workunit.client.0.smithi110.stderr: -411> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: crc 2024-03-04T12:36:16.829 INFO:tasks.workunit.client.0.smithi110.stderr: -410> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: secure 2024-03-04T12:36:16.829 INFO:tasks.workunit.client.0.smithi110.stderr: -409> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: crc 2024-03-04T12:36:16.829 INFO:tasks.workunit.client.0.smithi110.stderr: -408> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: secure 2024-03-04T12:36:16.830 INFO:tasks.workunit.client.0.smithi110.stderr: -407> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: crc 2024-03-04T12:36:16.830 INFO:tasks.workunit.client.0.smithi110.stderr: -406> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: crc 2024-03-04T12:36:16.830 INFO:tasks.workunit.client.0.smithi110.stderr: -405> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: secure 2024-03-04T12:36:16.830 INFO:tasks.workunit.client.0.smithi110.stderr: -404> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: crc 2024-03-04T12:36:16.830 INFO:tasks.workunit.client.0.smithi110.stderr: -403> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: secure 2024-03-04T12:36:16.830 INFO:tasks.workunit.client.0.smithi110.stderr: -402> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: crc 2024-03-04T12:36:16.830 INFO:tasks.workunit.client.0.smithi110.stderr: -401> 2024-03-04T12:36:16.278+0000 7fba72020800 5 AuthRegistry(0x55acb8a5f5b8) adding con mode: secure 2024-03-04T12:36:16.830 INFO:tasks.workunit.client.0.smithi110.stderr: -400> 2024-03-04T12:36:16.278+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.830 INFO:tasks.workunit.client.0.smithi110.stderr: -399> 2024-03-04T12:36:16.278+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.830 INFO:tasks.workunit.client.0.smithi110.stderr: -398> 2024-03-04T12:36:16.278+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command rotate-key cmddesc rotate-key hook 0x55acb8a5f700 EEXIST 2024-03-04T12:36:16.830 INFO:tasks.workunit.client.0.smithi110.stderr: -397> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient: _reopen_session rank -1 2024-03-04T12:36:16.830 INFO:tasks.workunit.client.0.smithi110.stderr: -396> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:36:16.830 INFO:tasks.workunit.client.0.smithi110.stderr: -395> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient(hunting): picked mon.noname-b con 0x55acb8a8a9f0 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:36:16.830 INFO:tasks.workunit.client.0.smithi110.stderr: -394> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient(hunting): picked mon.noname-c con 0x55acb8a8add0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:36:16.831 INFO:tasks.workunit.client.0.smithi110.stderr: -393> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient(hunting): picked mon.noname-a con 0x55acb8a9d780 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:36:16.831 INFO:tasks.workunit.client.0.smithi110.stderr: -392> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.831 INFO:tasks.workunit.client.0.smithi110.stderr: -391> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.831 INFO:tasks.workunit.client.0.smithi110.stderr: -390> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.831 INFO:tasks.workunit.client.0.smithi110.stderr: -389> 2024-03-04T12:36:16.278+0000 7fba72020800 10 monclient(hunting): _renew_subs 2024-03-04T12:36:16.831 INFO:tasks.workunit.client.0.smithi110.stderr: -388> 2024-03-04T12:36:16.279+0000 7fba72020800 10 monclient(hunting): authenticate will time out at 1757.638006s 2024-03-04T12:36:16.831 INFO:tasks.workunit.client.0.smithi110.stderr: -387> 2024-03-04T12:36:16.279+0000 7fba67fff640 10 monclient(hunting): get_auth_request con 0x55acb8a8add0 auth_method 0 2024-03-04T12:36:16.831 INFO:tasks.workunit.client.0.smithi110.stderr: -386> 2024-03-04T12:36:16.279+0000 7fba67fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.831 INFO:tasks.workunit.client.0.smithi110.stderr: -385> 2024-03-04T12:36:16.279+0000 7fba67fff640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.831 INFO:tasks.workunit.client.0.smithi110.stderr: -384> 2024-03-04T12:36:16.279+0000 7fba67fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.831 INFO:tasks.workunit.client.0.smithi110.stderr: -383> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient(hunting): get_auth_request con 0x55acb8a9d780 auth_method 0 2024-03-04T12:36:16.831 INFO:tasks.workunit.client.0.smithi110.stderr: -382> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.831 INFO:tasks.workunit.client.0.smithi110.stderr: -381> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.831 INFO:tasks.workunit.client.0.smithi110.stderr: -380> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.831 INFO:tasks.workunit.client.0.smithi110.stderr: -379> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.832 INFO:tasks.workunit.client.0.smithi110.stderr: -378> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.832 INFO:tasks.workunit.client.0.smithi110.stderr: -377> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.832 INFO:tasks.workunit.client.0.smithi110.stderr: -376> 2024-03-04T12:36:16.279+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.832 INFO:tasks.workunit.client.0.smithi110.stderr: -375> 2024-03-04T12:36:16.279+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.832 INFO:tasks.workunit.client.0.smithi110.stderr: -374> 2024-03-04T12:36:16.279+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.832 INFO:tasks.workunit.client.0.smithi110.stderr: -373> 2024-03-04T12:36:16.279+0000 7fba6fb1c640 10 monclient(hunting): get_auth_request con 0x55acb8a8a9f0 auth_method 0 2024-03-04T12:36:16.832 INFO:tasks.workunit.client.0.smithi110.stderr: -372> 2024-03-04T12:36:16.279+0000 7fba6fb1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.832 INFO:tasks.workunit.client.0.smithi110.stderr: -371> 2024-03-04T12:36:16.279+0000 7fba6fb1c640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.832 INFO:tasks.workunit.client.0.smithi110.stderr: -370> 2024-03-04T12:36:16.279+0000 7fba6fb1c640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.832 INFO:tasks.workunit.client.0.smithi110.stderr: -369> 2024-03-04T12:36:16.279+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.832 INFO:tasks.workunit.client.0.smithi110.stderr: -368> 2024-03-04T12:36:16.279+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.832 INFO:tasks.workunit.client.0.smithi110.stderr: -367> 2024-03-04T12:36:16.279+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.832 INFO:tasks.workunit.client.0.smithi110.stderr: -366> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient(hunting): handle_auth_done global_id 6822 payload 824 2024-03-04T12:36:16.833 INFO:tasks.workunit.client.0.smithi110.stderr: -365> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient: _finish_hunting 0 2024-03-04T12:36:16.833 INFO:tasks.workunit.client.0.smithi110.stderr: -364> 2024-03-04T12:36:16.279+0000 7fba7031d640 1 monclient: found mon.noname-a 2024-03-04T12:36:16.833 INFO:tasks.workunit.client.0.smithi110.stderr: -363> 2024-03-04T12:36:16.279+0000 7fba7031d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:36:16.833 INFO:tasks.workunit.client.0.smithi110.stderr: -362> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:16.833 INFO:tasks.workunit.client.0.smithi110.stderr: -361> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:36:16.833 INFO:tasks.workunit.client.0.smithi110.stderr: -360> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: dump: 2024-03-04T12:36:16.833 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:16.833 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:16.833 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.833 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.833 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:16.833 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.833 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:16.833 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:16.833 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:16.834 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.834 INFO:tasks.workunit.client.0.smithi110.stderr: -359> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: _finish_auth 0 2024-03-04T12:36:16.834 INFO:tasks.workunit.client.0.smithi110.stderr: -358> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: _check_auth_tickets 2024-03-04T12:36:16.834 INFO:tasks.workunit.client.0.smithi110.stderr: -357> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:16.834 INFO:tasks.workunit.client.0.smithi110.stderr: -356> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:16.834 INFO:tasks.workunit.client.0.smithi110.stderr: -355> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:36:16.834 INFO:tasks.workunit.client.0.smithi110.stderr: -354> 2024-03-04T12:36:16.279+0000 7fb9557fa640 10 monclient: dump: 2024-03-04T12:36:16.834 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:16.834 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:16.834 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.834 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.834 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:16.834 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.834 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:16.834 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:16.835 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:16.835 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.835 INFO:tasks.workunit.client.0.smithi110.stderr: -353> 2024-03-04T12:36:16.279+0000 7fba70b1e640 4 set_mon_vals no callback set 2024-03-04T12:36:16.835 INFO:tasks.workunit.client.0.smithi110.stderr: -352> 2024-03-04T12:36:16.279+0000 7fba72020800 5 monclient: authenticate success, global_id 6822 2024-03-04T12:36:16.835 INFO:tasks.workunit.client.0.smithi110.stderr: -351> 2024-03-04T12:36:16.279+0000 7fba72020800 10 monclient: _renew_subs 2024-03-04T12:36:16.835 INFO:tasks.workunit.client.0.smithi110.stderr: -350> 2024-03-04T12:36:16.279+0000 7fba72020800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:36:16.835 INFO:tasks.workunit.client.0.smithi110.stderr: -349> 2024-03-04T12:36:16.279+0000 7fba72020800 10 monclient: _renew_subs 2024-03-04T12:36:16.835 INFO:tasks.workunit.client.0.smithi110.stderr: -348> 2024-03-04T12:36:16.279+0000 7fba72020800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:36:16.835 INFO:tasks.workunit.client.0.smithi110.stderr: -347> 2024-03-04T12:36:16.281+0000 7fb9557fa640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:36:16.835 INFO:tasks.workunit.client.0.smithi110.stderr: -346> 2024-03-04T12:36:16.281+0000 7fb9557fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:16.835 INFO:tasks.workunit.client.0.smithi110.stderr: -345> 2024-03-04T12:36:16.281+0000 7fb9557fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:16.835 INFO:tasks.workunit.client.0.smithi110.stderr: -344> 2024-03-04T12:36:16.281+0000 7fba6fb1c640 10 monclient: get_auth_request con 0x7fb948069df0 auth_method 0 2024-03-04T12:36:16.835 INFO:tasks.workunit.client.0.smithi110.stderr: -343> 2024-03-04T12:36:16.281+0000 7fba72020800 10 monclient: get_monmap_and_config 2024-03-04T12:36:16.835 INFO:tasks.workunit.client.0.smithi110.stderr: -342> 2024-03-04T12:36:16.281+0000 7fba72020800 10 monclient: build_initial_monmap 2024-03-04T12:36:16.835 INFO:tasks.workunit.client.0.smithi110.stderr: -341> 2024-03-04T12:36:16.281+0000 7fba72020800 1 build_initial for_mkfs: 0 2024-03-04T12:36:16.836 INFO:tasks.workunit.client.0.smithi110.stderr: -340> 2024-03-04T12:36:16.281+0000 7fba72020800 10 monclient: monmap: 2024-03-04T12:36:16.836 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:36:16.836 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:36:16.836 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:36:16.836 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:36:16.836 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:36:16.836 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.836 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:36:16.836 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:36:16.836 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:36:16.836 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.836 INFO:tasks.workunit.client.0.smithi110.stderr: -339> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding auth protocol: cephx 2024-03-04T12:36:16.836 INFO:tasks.workunit.client.0.smithi110.stderr: -338> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding auth protocol: cephx 2024-03-04T12:36:16.837 INFO:tasks.workunit.client.0.smithi110.stderr: -337> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding auth protocol: cephx 2024-03-04T12:36:16.837 INFO:tasks.workunit.client.0.smithi110.stderr: -336> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: secure 2024-03-04T12:36:16.837 INFO:tasks.workunit.client.0.smithi110.stderr: -335> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: crc 2024-03-04T12:36:16.837 INFO:tasks.workunit.client.0.smithi110.stderr: -334> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: secure 2024-03-04T12:36:16.837 INFO:tasks.workunit.client.0.smithi110.stderr: -333> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: crc 2024-03-04T12:36:16.837 INFO:tasks.workunit.client.0.smithi110.stderr: -332> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: secure 2024-03-04T12:36:16.837 INFO:tasks.workunit.client.0.smithi110.stderr: -331> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: crc 2024-03-04T12:36:16.837 INFO:tasks.workunit.client.0.smithi110.stderr: -330> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: crc 2024-03-04T12:36:16.837 INFO:tasks.workunit.client.0.smithi110.stderr: -329> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: secure 2024-03-04T12:36:16.837 INFO:tasks.workunit.client.0.smithi110.stderr: -328> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: crc 2024-03-04T12:36:16.837 INFO:tasks.workunit.client.0.smithi110.stderr: -327> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: secure 2024-03-04T12:36:16.837 INFO:tasks.workunit.client.0.smithi110.stderr: -326> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: crc 2024-03-04T12:36:16.837 INFO:tasks.workunit.client.0.smithi110.stderr: -325> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x55acb8aa8410) adding con mode: secure 2024-03-04T12:36:16.837 INFO:tasks.workunit.client.0.smithi110.stderr: -324> 2024-03-04T12:36:16.281+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.837 INFO:tasks.workunit.client.0.smithi110.stderr: -323> 2024-03-04T12:36:16.281+0000 7fba72020800 10 monclient: init 2024-03-04T12:36:16.838 INFO:tasks.workunit.client.0.smithi110.stderr: -322> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding auth protocol: cephx 2024-03-04T12:36:16.838 INFO:tasks.workunit.client.0.smithi110.stderr: -321> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding auth protocol: cephx 2024-03-04T12:36:16.838 INFO:tasks.workunit.client.0.smithi110.stderr: -320> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding auth protocol: cephx 2024-03-04T12:36:16.838 INFO:tasks.workunit.client.0.smithi110.stderr: -319> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: secure 2024-03-04T12:36:16.838 INFO:tasks.workunit.client.0.smithi110.stderr: -318> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: crc 2024-03-04T12:36:16.838 INFO:tasks.workunit.client.0.smithi110.stderr: -317> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: secure 2024-03-04T12:36:16.838 INFO:tasks.workunit.client.0.smithi110.stderr: -316> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: crc 2024-03-04T12:36:16.838 INFO:tasks.workunit.client.0.smithi110.stderr: -315> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: secure 2024-03-04T12:36:16.838 INFO:tasks.workunit.client.0.smithi110.stderr: -314> 2024-03-04T12:36:16.281+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: crc 2024-03-04T12:36:16.838 INFO:tasks.workunit.client.0.smithi110.stderr: -313> 2024-03-04T12:36:16.282+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: crc 2024-03-04T12:36:16.838 INFO:tasks.workunit.client.0.smithi110.stderr: -312> 2024-03-04T12:36:16.282+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: secure 2024-03-04T12:36:16.838 INFO:tasks.workunit.client.0.smithi110.stderr: -311> 2024-03-04T12:36:16.282+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: crc 2024-03-04T12:36:16.838 INFO:tasks.workunit.client.0.smithi110.stderr: -310> 2024-03-04T12:36:16.282+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: secure 2024-03-04T12:36:16.838 INFO:tasks.workunit.client.0.smithi110.stderr: -309> 2024-03-04T12:36:16.282+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: crc 2024-03-04T12:36:16.838 INFO:tasks.workunit.client.0.smithi110.stderr: -308> 2024-03-04T12:36:16.282+0000 7fba72020800 5 AuthRegistry(0x7ffef706d1e0) adding con mode: secure 2024-03-04T12:36:16.839 INFO:tasks.workunit.client.0.smithi110.stderr: -307> 2024-03-04T12:36:16.282+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.839 INFO:tasks.workunit.client.0.smithi110.stderr: -306> 2024-03-04T12:36:16.282+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.839 INFO:tasks.workunit.client.0.smithi110.stderr: -305> 2024-03-04T12:36:16.282+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command rotate-key cmddesc rotate-key hook 0x7ffef706d328 EEXIST 2024-03-04T12:36:16.839 INFO:tasks.workunit.client.0.smithi110.stderr: -304> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient: _reopen_session rank -1 2024-03-04T12:36:16.839 INFO:tasks.workunit.client.0.smithi110.stderr: -303> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:36:16.839 INFO:tasks.workunit.client.0.smithi110.stderr: -302> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient(hunting): picked mon.noname-b con 0x55acb8adcf80 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:36:16.839 INFO:tasks.workunit.client.0.smithi110.stderr: -301> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient(hunting): picked mon.noname-c con 0x55acb8ad84d0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:36:16.839 INFO:tasks.workunit.client.0.smithi110.stderr: -300> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient(hunting): picked mon.noname-a con 0x55acb8aceed0 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:36:16.839 INFO:tasks.workunit.client.0.smithi110.stderr: -299> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.839 INFO:tasks.workunit.client.0.smithi110.stderr: -298> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.839 INFO:tasks.workunit.client.0.smithi110.stderr: -297> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.839 INFO:tasks.workunit.client.0.smithi110.stderr: -296> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient(hunting): _renew_subs 2024-03-04T12:36:16.839 INFO:tasks.workunit.client.0.smithi110.stderr: -295> 2024-03-04T12:36:16.282+0000 7fba72020800 10 monclient(hunting): authenticate will time out at 1757.641479s 2024-03-04T12:36:16.839 INFO:tasks.workunit.client.0.smithi110.stderr: -294> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient(hunting): get_auth_request con 0x55acb8ad84d0 auth_method 0 2024-03-04T12:36:16.840 INFO:tasks.workunit.client.0.smithi110.stderr: -293> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.840 INFO:tasks.workunit.client.0.smithi110.stderr: -292> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.840 INFO:tasks.workunit.client.0.smithi110.stderr: -291> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.840 INFO:tasks.workunit.client.0.smithi110.stderr: -290> 2024-03-04T12:36:16.282+0000 7fba7031d640 10 monclient(hunting): get_auth_request con 0x55acb8aceed0 auth_method 0 2024-03-04T12:36:16.840 INFO:tasks.workunit.client.0.smithi110.stderr: -289> 2024-03-04T12:36:16.282+0000 7fba7031d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.840 INFO:tasks.workunit.client.0.smithi110.stderr: -288> 2024-03-04T12:36:16.282+0000 7fba7031d640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.840 INFO:tasks.workunit.client.0.smithi110.stderr: -287> 2024-03-04T12:36:16.282+0000 7fba7031d640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.840 INFO:tasks.workunit.client.0.smithi110.stderr: -286> 2024-03-04T12:36:16.282+0000 7fba6fb1c640 10 monclient(hunting): get_auth_request con 0x55acb8adcf80 auth_method 0 2024-03-04T12:36:16.840 INFO:tasks.workunit.client.0.smithi110.stderr: -285> 2024-03-04T12:36:16.282+0000 7fba6fb1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.840 INFO:tasks.workunit.client.0.smithi110.stderr: -284> 2024-03-04T12:36:16.282+0000 7fba6fb1c640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.840 INFO:tasks.workunit.client.0.smithi110.stderr: -283> 2024-03-04T12:36:16.282+0000 7fba6fb1c640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.840 INFO:tasks.workunit.client.0.smithi110.stderr: -282> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.840 INFO:tasks.workunit.client.0.smithi110.stderr: -281> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.840 INFO:tasks.workunit.client.0.smithi110.stderr: -280> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.841 INFO:tasks.workunit.client.0.smithi110.stderr: -279> 2024-03-04T12:36:16.282+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.841 INFO:tasks.workunit.client.0.smithi110.stderr: -278> 2024-03-04T12:36:16.282+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.841 INFO:tasks.workunit.client.0.smithi110.stderr: -277> 2024-03-04T12:36:16.282+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.841 INFO:tasks.workunit.client.0.smithi110.stderr: -276> 2024-03-04T12:36:16.282+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.841 INFO:tasks.workunit.client.0.smithi110.stderr: -275> 2024-03-04T12:36:16.282+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.841 INFO:tasks.workunit.client.0.smithi110.stderr: -274> 2024-03-04T12:36:16.282+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.841 INFO:tasks.workunit.client.0.smithi110.stderr: -273> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient(hunting): handle_auth_done global_id 6386 payload 274 2024-03-04T12:36:16.841 INFO:tasks.workunit.client.0.smithi110.stderr: -272> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient: _finish_hunting 0 2024-03-04T12:36:16.841 INFO:tasks.workunit.client.0.smithi110.stderr: -271> 2024-03-04T12:36:16.282+0000 7fba67fff640 1 monclient: found mon.noname-c 2024-03-04T12:36:16.841 INFO:tasks.workunit.client.0.smithi110.stderr: -270> 2024-03-04T12:36:16.282+0000 7fba67fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.110:3301/0 2024-03-04T12:36:16.841 INFO:tasks.workunit.client.0.smithi110.stderr: -269> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:16.841 INFO:tasks.workunit.client.0.smithi110.stderr: -268> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:36:16.841 INFO:tasks.workunit.client.0.smithi110.stderr: -267> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: dump: 2024-03-04T12:36:16.841 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:16.842 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:16.842 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.842 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.842 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:16.842 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.842 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:16.842 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:16.842 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:16.842 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.842 INFO:tasks.workunit.client.0.smithi110.stderr: -266> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: _finish_auth 0 2024-03-04T12:36:16.842 INFO:tasks.workunit.client.0.smithi110.stderr: -265> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: _check_auth_tickets 2024-03-04T12:36:16.842 INFO:tasks.workunit.client.0.smithi110.stderr: -264> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:16.842 INFO:tasks.workunit.client.0.smithi110.stderr: -263> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:16.843 INFO:tasks.workunit.client.0.smithi110.stderr: -262> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:36:16.843 INFO:tasks.workunit.client.0.smithi110.stderr: -261> 2024-03-04T12:36:16.283+0000 7fb94effd640 10 monclient: dump: 2024-03-04T12:36:16.843 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:16.843 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:16.843 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.843 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.843 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:16.843 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.843 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:16.843 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:16.843 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:16.843 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.843 INFO:tasks.workunit.client.0.smithi110.stderr: -260> 2024-03-04T12:36:16.283+0000 7fba72020800 5 monclient: authenticate success, global_id 6386 2024-03-04T12:36:16.843 INFO:tasks.workunit.client.0.smithi110.stderr: -259> 2024-03-04T12:36:16.283+0000 7fba72020800 10 monclient: get_monmap_and_config success 2024-03-04T12:36:16.844 INFO:tasks.workunit.client.0.smithi110.stderr: -258> 2024-03-04T12:36:16.283+0000 7fba72020800 4 set_mon_vals no callback set 2024-03-04T12:36:16.844 INFO:tasks.workunit.client.0.smithi110.stderr: -257> 2024-03-04T12:36:16.283+0000 7fba72020800 10 monclient: shutdown 2024-03-04T12:36:16.844 INFO:tasks.workunit.client.0.smithi110.stderr: -256> 2024-03-04T12:36:16.283+0000 7fba72020800 10 monclient: build_initial_monmap 2024-03-04T12:36:16.844 INFO:tasks.workunit.client.0.smithi110.stderr: -255> 2024-03-04T12:36:16.283+0000 7fba72020800 1 build_initial for_mkfs: 0 2024-03-04T12:36:16.844 INFO:tasks.workunit.client.0.smithi110.stderr: -254> 2024-03-04T12:36:16.283+0000 7fba72020800 10 monclient: monmap: 2024-03-04T12:36:16.844 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:36:16.844 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:36:16.844 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:36:16.844 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:36:16.844 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:36:16.844 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.844 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:36:16.844 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:36:16.844 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:36:16.845 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.845 INFO:tasks.workunit.client.0.smithi110.stderr: -253> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding auth protocol: cephx 2024-03-04T12:36:16.845 INFO:tasks.workunit.client.0.smithi110.stderr: -252> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding auth protocol: cephx 2024-03-04T12:36:16.845 INFO:tasks.workunit.client.0.smithi110.stderr: -251> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding auth protocol: cephx 2024-03-04T12:36:16.845 INFO:tasks.workunit.client.0.smithi110.stderr: -250> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: secure 2024-03-04T12:36:16.845 INFO:tasks.workunit.client.0.smithi110.stderr: -249> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: crc 2024-03-04T12:36:16.845 INFO:tasks.workunit.client.0.smithi110.stderr: -248> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: secure 2024-03-04T12:36:16.845 INFO:tasks.workunit.client.0.smithi110.stderr: -247> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: crc 2024-03-04T12:36:16.845 INFO:tasks.workunit.client.0.smithi110.stderr: -246> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: secure 2024-03-04T12:36:16.845 INFO:tasks.workunit.client.0.smithi110.stderr: -245> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: crc 2024-03-04T12:36:16.845 INFO:tasks.workunit.client.0.smithi110.stderr: -244> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: crc 2024-03-04T12:36:16.845 INFO:tasks.workunit.client.0.smithi110.stderr: -243> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: secure 2024-03-04T12:36:16.845 INFO:tasks.workunit.client.0.smithi110.stderr: -242> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: crc 2024-03-04T12:36:16.845 INFO:tasks.workunit.client.0.smithi110.stderr: -241> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: secure 2024-03-04T12:36:16.846 INFO:tasks.workunit.client.0.smithi110.stderr: -240> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: crc 2024-03-04T12:36:16.846 INFO:tasks.workunit.client.0.smithi110.stderr: -239> 2024-03-04T12:36:16.283+0000 7fba72020800 5 AuthRegistry(0x55acb8aa83c0) adding con mode: secure 2024-03-04T12:36:16.846 INFO:tasks.workunit.client.0.smithi110.stderr: -238> 2024-03-04T12:36:16.283+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.846 INFO:tasks.workunit.client.0.smithi110.stderr: -237> 2024-03-04T12:36:16.283+0000 7fba72020800 1 librados: starting msgr at 2024-03-04T12:36:16.846 INFO:tasks.workunit.client.0.smithi110.stderr: -236> 2024-03-04T12:36:16.283+0000 7fba72020800 1 librados: starting objecter 2024-03-04T12:36:16.846 INFO:tasks.workunit.client.0.smithi110.stderr: -235> 2024-03-04T12:36:16.284+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command objecter_requests cmddesc objecter_requests hook 0x55acb8aacb80 EEXIST 2024-03-04T12:36:16.846 INFO:tasks.workunit.client.0.smithi110.stderr: -234> 2024-03-04T12:36:16.284+0000 7fba72020800 1 librados: setting wanted keys 2024-03-04T12:36:16.846 INFO:tasks.workunit.client.0.smithi110.stderr: -233> 2024-03-04T12:36:16.284+0000 7fba72020800 1 librados: calling monclient init 2024-03-04T12:36:16.846 INFO:tasks.workunit.client.0.smithi110.stderr: -232> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient: init 2024-03-04T12:36:16.846 INFO:tasks.workunit.client.0.smithi110.stderr: -231> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding auth protocol: cephx 2024-03-04T12:36:16.846 INFO:tasks.workunit.client.0.smithi110.stderr: -230> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding auth protocol: cephx 2024-03-04T12:36:16.846 INFO:tasks.workunit.client.0.smithi110.stderr: -229> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding auth protocol: cephx 2024-03-04T12:36:16.846 INFO:tasks.workunit.client.0.smithi110.stderr: -228> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: secure 2024-03-04T12:36:16.846 INFO:tasks.workunit.client.0.smithi110.stderr: -227> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: crc 2024-03-04T12:36:16.847 INFO:tasks.workunit.client.0.smithi110.stderr: -226> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: secure 2024-03-04T12:36:16.847 INFO:tasks.workunit.client.0.smithi110.stderr: -225> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: crc 2024-03-04T12:36:16.847 INFO:tasks.workunit.client.0.smithi110.stderr: -224> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: secure 2024-03-04T12:36:16.847 INFO:tasks.workunit.client.0.smithi110.stderr: -223> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: crc 2024-03-04T12:36:16.847 INFO:tasks.workunit.client.0.smithi110.stderr: -222> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: crc 2024-03-04T12:36:16.847 INFO:tasks.workunit.client.0.smithi110.stderr: -221> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: secure 2024-03-04T12:36:16.847 INFO:tasks.workunit.client.0.smithi110.stderr: -220> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: crc 2024-03-04T12:36:16.847 INFO:tasks.workunit.client.0.smithi110.stderr: -219> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: secure 2024-03-04T12:36:16.847 INFO:tasks.workunit.client.0.smithi110.stderr: -218> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: crc 2024-03-04T12:36:16.847 INFO:tasks.workunit.client.0.smithi110.stderr: -217> 2024-03-04T12:36:16.284+0000 7fba72020800 5 AuthRegistry(0x55acb8aa0390) adding con mode: secure 2024-03-04T12:36:16.847 INFO:tasks.workunit.client.0.smithi110.stderr: -216> 2024-03-04T12:36:16.284+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.847 INFO:tasks.workunit.client.0.smithi110.stderr: -215> 2024-03-04T12:36:16.284+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.847 INFO:tasks.workunit.client.0.smithi110.stderr: -214> 2024-03-04T12:36:16.284+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command rotate-key cmddesc rotate-key hook 0x55acb8aa04d8 EEXIST 2024-03-04T12:36:16.847 INFO:tasks.workunit.client.0.smithi110.stderr: -213> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient: _reopen_session rank -1 2024-03-04T12:36:16.848 INFO:tasks.workunit.client.0.smithi110.stderr: -212> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient: _add_conns ranks=[0,2,1] 2024-03-04T12:36:16.848 INFO:tasks.workunit.client.0.smithi110.stderr: -211> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient(hunting): picked mon.noname-a con 0x55acb8aceed0 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:36:16.848 INFO:tasks.workunit.client.0.smithi110.stderr: -210> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient(hunting): picked mon.noname-c con 0x55acb8ad84d0 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:36:16.848 INFO:tasks.workunit.client.0.smithi110.stderr: -209> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient(hunting): picked mon.noname-b con 0x55acb8adcf80 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:36:16.848 INFO:tasks.workunit.client.0.smithi110.stderr: -208> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.848 INFO:tasks.workunit.client.0.smithi110.stderr: -207> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.848 INFO:tasks.workunit.client.0.smithi110.stderr: -206> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:16.848 INFO:tasks.workunit.client.0.smithi110.stderr: -205> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient(hunting): _renew_subs 2024-03-04T12:36:16.848 INFO:tasks.workunit.client.0.smithi110.stderr: -204> 2024-03-04T12:36:16.284+0000 7fba72020800 10 monclient(hunting): authenticate will time out at 1757.643645s 2024-03-04T12:36:16.848 INFO:tasks.workunit.client.0.smithi110.stderr: -203> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient(hunting): get_auth_request con 0x55acb8aceed0 auth_method 0 2024-03-04T12:36:16.848 INFO:tasks.workunit.client.0.smithi110.stderr: -202> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.848 INFO:tasks.workunit.client.0.smithi110.stderr: -201> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.848 INFO:tasks.workunit.client.0.smithi110.stderr: -200> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.848 INFO:tasks.workunit.client.0.smithi110.stderr: -199> 2024-03-04T12:36:16.284+0000 7fba67fff640 10 monclient(hunting): get_auth_request con 0x55acb8ad84d0 auth_method 0 2024-03-04T12:36:16.849 INFO:tasks.workunit.client.0.smithi110.stderr: -198> 2024-03-04T12:36:16.284+0000 7fba67fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.849 INFO:tasks.workunit.client.0.smithi110.stderr: -197> 2024-03-04T12:36:16.284+0000 7fba67fff640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.849 INFO:tasks.workunit.client.0.smithi110.stderr: -196> 2024-03-04T12:36:16.284+0000 7fba67fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.849 INFO:tasks.workunit.client.0.smithi110.stderr: -195> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.849 INFO:tasks.workunit.client.0.smithi110.stderr: -194> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.849 INFO:tasks.workunit.client.0.smithi110.stderr: -193> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.849 INFO:tasks.workunit.client.0.smithi110.stderr: -192> 2024-03-04T12:36:16.284+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.849 INFO:tasks.workunit.client.0.smithi110.stderr: -191> 2024-03-04T12:36:16.284+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.849 INFO:tasks.workunit.client.0.smithi110.stderr: -190> 2024-03-04T12:36:16.284+0000 7fba67fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.849 INFO:tasks.workunit.client.0.smithi110.stderr: -189> 2024-03-04T12:36:16.284+0000 7fba7031d640 10 monclient(hunting): get_auth_request con 0x55acb8adcf80 auth_method 0 2024-03-04T12:36:16.849 INFO:tasks.workunit.client.0.smithi110.stderr: -188> 2024-03-04T12:36:16.284+0000 7fba7031d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:16.849 INFO:tasks.workunit.client.0.smithi110.stderr: -187> 2024-03-04T12:36:16.284+0000 7fba7031d640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:16.849 INFO:tasks.workunit.client.0.smithi110.stderr: -186> 2024-03-04T12:36:16.284+0000 7fba7031d640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:16.849 INFO:tasks.workunit.client.0.smithi110.stderr: -185> 2024-03-04T12:36:16.284+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:16.849 INFO:tasks.workunit.client.0.smithi110.stderr: -184> 2024-03-04T12:36:16.284+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:16.850 INFO:tasks.workunit.client.0.smithi110.stderr: -183> 2024-03-04T12:36:16.284+0000 7fba7031d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:16.850 INFO:tasks.workunit.client.0.smithi110.stderr: -182> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient(hunting): handle_auth_done global_id 6828 payload 824 2024-03-04T12:36:16.850 INFO:tasks.workunit.client.0.smithi110.stderr: -181> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient: _finish_hunting 0 2024-03-04T12:36:16.850 INFO:tasks.workunit.client.0.smithi110.stderr: -180> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 1 monclient: found mon.noname-a 2024-03-04T12:36:16.850 INFO:tasks.workunit.client.0.smithi110.stderr: -179> 2024-03-04T12:36:16.284+0000 7fba6fb1c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:36:16.850 INFO:tasks.workunit.client.0.smithi110.stderr: -178> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:16.850 INFO:tasks.workunit.client.0.smithi110.stderr: -177> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:36:16.850 INFO:tasks.workunit.client.0.smithi110.stderr: -176> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: dump: 2024-03-04T12:36:16.850 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:16.850 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:16.850 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.850 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.850 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:16.850 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.851 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:16.851 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:16.851 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:16.851 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.851 INFO:tasks.workunit.client.0.smithi110.stderr: -175> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: _finish_auth 0 2024-03-04T12:36:16.851 INFO:tasks.workunit.client.0.smithi110.stderr: -174> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: _check_auth_tickets 2024-03-04T12:36:16.851 INFO:tasks.workunit.client.0.smithi110.stderr: -173> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:16.851 INFO:tasks.workunit.client.0.smithi110.stderr: -172> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:16.851 INFO:tasks.workunit.client.0.smithi110.stderr: -171> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:36:16.851 INFO:tasks.workunit.client.0.smithi110.stderr: -170> 2024-03-04T12:36:16.285+0000 7fb94d7fa640 10 monclient: dump: 2024-03-04T12:36:16.851 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:16.851 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:16.851 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.851 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:16.851 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:16.852 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:16.852 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:16.852 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:16.852 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:16.852 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.852 INFO:tasks.workunit.client.0.smithi110.stderr: -169> 2024-03-04T12:36:16.285+0000 7fb94effd640 4 set_mon_vals no callback set 2024-03-04T12:36:16.852 INFO:tasks.workunit.client.0.smithi110.stderr: -168> 2024-03-04T12:36:16.285+0000 7fba72020800 5 monclient: authenticate success, global_id 6828 2024-03-04T12:36:16.852 INFO:tasks.workunit.client.0.smithi110.stderr: -167> 2024-03-04T12:36:16.285+0000 7fba72020800 10 monclient: _renew_subs 2024-03-04T12:36:16.852 INFO:tasks.workunit.client.0.smithi110.stderr: -166> 2024-03-04T12:36:16.285+0000 7fba72020800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:36:16.852 INFO:tasks.workunit.client.0.smithi110.stderr: -165> 2024-03-04T12:36:16.285+0000 7fba72020800 10 monclient: _renew_subs 2024-03-04T12:36:16.852 INFO:tasks.workunit.client.0.smithi110.stderr: -164> 2024-03-04T12:36:16.285+0000 7fba72020800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:36:16.852 INFO:tasks.workunit.client.0.smithi110.stderr: -163> 2024-03-04T12:36:16.285+0000 7fba72020800 1 librados: init done 2024-03-04T12:36:16.852 INFO:tasks.workunit.client.0.smithi110.stderr: -162> 2024-03-04T12:36:16.285+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command cr dump hook 0x55acb8ad7808 2024-03-04T12:36:16.853 INFO:tasks.workunit.client.0.smithi110.stderr: -161> 2024-03-04T12:36:16.286+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.853 INFO:tasks.workunit.client.0.smithi110.stderr: -160> 2024-03-04T12:36:16.286+0000 7fb94d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:36:16.853 INFO:tasks.workunit.client.0.smithi110.stderr: -159> 2024-03-04T12:36:16.286+0000 7fb94d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:16.853 INFO:tasks.workunit.client.0.smithi110.stderr: -158> 2024-03-04T12:36:16.286+0000 7fb94d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:16.853 INFO:tasks.workunit.client.0.smithi110.stderr: -157> 2024-03-04T12:36:16.286+0000 7fba67fff640 10 monclient: get_auth_request con 0x7fb938069eb0 auth_method 0 2024-03-04T12:36:16.853 INFO:tasks.workunit.client.0.smithi110.stderr: -156> 2024-03-04T12:36:16.287+0000 7fba7031d640 10 monclient: get_auth_request con 0x55acb8af7620 auth_method 0 2024-03-04T12:36:16.853 INFO:tasks.workunit.client.0.smithi110.stderr: -155> 2024-03-04T12:36:16.287+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.853 INFO:tasks.workunit.client.0.smithi110.stderr: -154> 2024-03-04T12:36:16.287+0000 7fba72020800 20 realm 2024-03-04T12:36:16.853 INFO:tasks.workunit.client.0.smithi110.stderr: -153> 2024-03-04T12:36:16.287+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.853 INFO:tasks.workunit.client.0.smithi110.stderr: -152> 2024-03-04T12:36:16.287+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.853 INFO:tasks.workunit.client.0.smithi110.stderr: -151> 2024-03-04T12:36:16.287+0000 7fba72020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:16.853 INFO:tasks.workunit.client.0.smithi110.stderr: -150> 2024-03-04T12:36:16.287+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.853 INFO:tasks.workunit.client.0.smithi110.stderr: -149> 2024-03-04T12:36:16.287+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.853 INFO:tasks.workunit.client.0.smithi110.stderr: -148> 2024-03-04T12:36:16.287+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.854 INFO:tasks.workunit.client.0.smithi110.stderr: -147> 2024-03-04T12:36:16.288+0000 7fba6fb1c640 10 monclient: get_auth_request con 0x55acb8afb890 auth_method 0 2024-03-04T12:36:16.854 INFO:tasks.workunit.client.0.smithi110.stderr: -146> 2024-03-04T12:36:16.288+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:16.854 INFO:tasks.workunit.client.0.smithi110.stderr: -145> 2024-03-04T12:36:16.288+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.854 INFO:tasks.workunit.client.0.smithi110.stderr: -144> 2024-03-04T12:36:16.289+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:16.854 INFO:tasks.workunit.client.0.smithi110.stderr: -143> 2024-03-04T12:36:16.289+0000 7fba72020800 20 searching for the correct realm 2024-03-04T12:36:16.854 INFO:tasks.workunit.client.0.smithi110.stderr: -142> 2024-03-04T12:36:16.289+0000 7fba67fff640 10 monclient: get_auth_request con 0x55acb8b00ac0 auth_method 0 2024-03-04T12:36:16.854 INFO:tasks.workunit.client.0.smithi110.stderr: -141> 2024-03-04T12:36:16.290+0000 7fba7031d640 10 monclient: get_auth_request con 0x7fba58077040 auth_method 0 2024-03-04T12:36:16.854 INFO:tasks.workunit.client.0.smithi110.stderr: -140> 2024-03-04T12:36:16.290+0000 7fba6fb1c640 10 monclient: get_auth_request con 0x7fba6805bb60 auth_method 0 2024-03-04T12:36:16.854 INFO:tasks.workunit.client.0.smithi110.stderr: -139> 2024-03-04T12:36:16.291+0000 7fb94d7fa640 1 client.6828.objecter ms_handle_reset 0x7fba6805bb60 session 0x7fba6800f040 osd.2 2024-03-04T12:36:16.854 INFO:tasks.workunit.client.0.smithi110.stderr: -138> 2024-03-04T12:36:16.291+0000 7fb94d7fa640 10 monclient: _renew_subs 2024-03-04T12:36:16.854 INFO:tasks.workunit.client.0.smithi110.stderr: -137> 2024-03-04T12:36:16.291+0000 7fb94d7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.110:3300/0 2024-03-04T12:36:16.854 INFO:tasks.workunit.client.0.smithi110.stderr: -136> 2024-03-04T12:36:16.291+0000 7fba6fb1c640 10 monclient: get_auth_request con 0x7fb938079c50 auth_method 0 2024-03-04T12:36:16.854 INFO:tasks.workunit.client.0.smithi110.stderr: -135> 2024-03-04T12:36:16.291+0000 7fba67fff640 10 monclient: get_auth_request con 0x7fba6001e060 auth_method 0 2024-03-04T12:36:16.854 INFO:tasks.workunit.client.0.smithi110.stderr: -134> 2024-03-04T12:36:16.292+0000 7fba67fff640 0 -- 172.21.15.110:0/1478264816 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7fba6001e060 msgr2=0x7fba6005f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:36:16.854 INFO:tasks.workunit.client.0.smithi110.stderr: -133> 2024-03-04T12:36:16.493+0000 7fba67fff640 10 monclient: get_auth_request con 0x7fba6001e060 auth_method 0 2024-03-04T12:36:16.855 INFO:tasks.workunit.client.0.smithi110.stderr: -132> 2024-03-04T12:36:16.495+0000 7fba7031d640 10 monclient: get_auth_request con 0x7fba5805b070 auth_method 0 2024-03-04T12:36:16.855 INFO:tasks.workunit.client.0.smithi110.stderr: -131> 2024-03-04T12:36:16.497+0000 7fba6fb1c640 10 monclient: get_auth_request con 0x7fba58079bf0 auth_method 0 2024-03-04T12:36:16.855 INFO:tasks.workunit.client.0.smithi110.stderr: -130> 2024-03-04T12:36:16.497+0000 7fba6fb1c640 0 -- 172.21.15.110:0/1478264816 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fba58079bf0 msgr2=0x7fba58077420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:36:16.855 INFO:tasks.workunit.client.0.smithi110.stderr: -129> 2024-03-04T12:36:16.698+0000 7fba6fb1c640 10 monclient: get_auth_request con 0x7fba58079bf0 auth_method 0 2024-03-04T12:36:16.855 INFO:tasks.workunit.client.0.smithi110.stderr: -128> 2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:16.855 INFO:tasks.workunit.client.0.smithi110.stderr: -127> 2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:16.855 INFO:tasks.workunit.client.0.smithi110.stderr: -126> 2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:16.855 INFO:tasks.workunit.client.0.smithi110.stderr: -125> 2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:16.855 INFO:tasks.workunit.client.0.smithi110.stderr: -124> 2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:16.855 INFO:tasks.workunit.client.0.smithi110.stderr: -123> 2024-03-04T12:36:16.703+0000 7fba72020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:16.855 INFO:tasks.workunit.client.0.smithi110.stderr: -122> 2024-03-04T12:36:16.704+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.855 INFO:tasks.workunit.client.0.smithi110.stderr: -121> 2024-03-04T12:36:16.704+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.855 INFO:tasks.workunit.client.0.smithi110.stderr: -120> 2024-03-04T12:36:16.704+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.855 INFO:tasks.workunit.client.0.smithi110.stderr: -119> 2024-03-04T12:36:16.704+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:16.856 INFO:tasks.workunit.client.0.smithi110.stderr: -118> 2024-03-04T12:36:16.704+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.856 INFO:tasks.workunit.client.0.smithi110.stderr: -117> 2024-03-04T12:36:16.704+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:16.856 INFO:tasks.workunit.client.0.smithi110.stderr: -116> 2024-03-04T12:36:16.704+0000 7fba72020800 20 zone default found 2024-03-04T12:36:16.856 INFO:tasks.workunit.client.0.smithi110.stderr: -115> 2024-03-04T12:36:16.704+0000 7fba72020800 4 Realm: () 2024-03-04T12:36:16.856 INFO:tasks.workunit.client.0.smithi110.stderr: -114> 2024-03-04T12:36:16.704+0000 7fba72020800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:16.856 INFO:tasks.workunit.client.0.smithi110.stderr: -113> 2024-03-04T12:36:16.704+0000 7fba72020800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:16.856 INFO:tasks.workunit.client.0.smithi110.stderr: -112> 2024-03-04T12:36:16.704+0000 7fba72020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:16.856 INFO:tasks.workunit.client.0.smithi110.stderr: -111> 2024-03-04T12:36:16.704+0000 7fba72020800 20 zonegroup default 2024-03-04T12:36:16.856 INFO:tasks.workunit.client.0.smithi110.stderr: -110> 2024-03-04T12:36:16.704+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.856 INFO:tasks.workunit.client.0.smithi110.stderr: -109> 2024-03-04T12:36:16.705+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.856 INFO:tasks.workunit.client.0.smithi110.stderr: -108> 2024-03-04T12:36:16.705+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.856 INFO:tasks.workunit.client.0.smithi110.stderr: -107> 2024-03-04T12:36:16.705+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.856 INFO:tasks.workunit.client.0.smithi110.stderr: -106> 2024-03-04T12:36:16.705+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.856 INFO:tasks.workunit.client.0.smithi110.stderr: -105> 2024-03-04T12:36:16.705+0000 7fba72020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.857 INFO:tasks.workunit.client.0.smithi110.stderr: -104> 2024-03-04T12:36:16.705+0000 7fba72020800 20 started sync module instance, tier type = 2024-03-04T12:36:16.857 INFO:tasks.workunit.client.0.smithi110.stderr: -103> 2024-03-04T12:36:16.705+0000 7fba72020800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:16.857 INFO:tasks.workunit.client.0.smithi110.stderr: -102> 2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=0 2024-03-04T12:36:16.857 INFO:tasks.workunit.client.0.smithi110.stderr: -101> 2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=1 2024-03-04T12:36:16.857 INFO:tasks.workunit.client.0.smithi110.stderr: -100> 2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=2 2024-03-04T12:36:16.857 INFO:tasks.workunit.client.0.smithi110.stderr: -99> 2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=3 2024-03-04T12:36:16.857 INFO:tasks.workunit.client.0.smithi110.stderr: -98> 2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=4 2024-03-04T12:36:16.857 INFO:tasks.workunit.client.0.smithi110.stderr: -97> 2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=5 2024-03-04T12:36:16.857 INFO:tasks.workunit.client.0.smithi110.stderr: -96> 2024-03-04T12:36:16.717+0000 7fba72020800 20 add_watcher() i=6 2024-03-04T12:36:16.857 INFO:tasks.workunit.client.0.smithi110.stderr: -95> 2024-03-04T12:36:16.718+0000 7fba72020800 20 add_watcher() i=7 2024-03-04T12:36:16.857 INFO:tasks.workunit.client.0.smithi110.stderr: -94> 2024-03-04T12:36:16.718+0000 7fba72020800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:16.857 INFO:tasks.workunit.client.0.smithi110.stderr: -93> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding auth protocol: cephx 2024-03-04T12:36:16.857 INFO:tasks.workunit.client.0.smithi110.stderr: -92> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding auth protocol: cephx 2024-03-04T12:36:16.857 INFO:tasks.workunit.client.0.smithi110.stderr: -91> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding auth protocol: cephx 2024-03-04T12:36:16.858 INFO:tasks.workunit.client.0.smithi110.stderr: -90> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: secure 2024-03-04T12:36:16.858 INFO:tasks.workunit.client.0.smithi110.stderr: -89> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: crc 2024-03-04T12:36:16.858 INFO:tasks.workunit.client.0.smithi110.stderr: -88> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: secure 2024-03-04T12:36:16.858 INFO:tasks.workunit.client.0.smithi110.stderr: -87> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: crc 2024-03-04T12:36:16.858 INFO:tasks.workunit.client.0.smithi110.stderr: -86> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: secure 2024-03-04T12:36:16.858 INFO:tasks.workunit.client.0.smithi110.stderr: -85> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: crc 2024-03-04T12:36:16.858 INFO:tasks.workunit.client.0.smithi110.stderr: -84> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: crc 2024-03-04T12:36:16.858 INFO:tasks.workunit.client.0.smithi110.stderr: -83> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: secure 2024-03-04T12:36:16.858 INFO:tasks.workunit.client.0.smithi110.stderr: -82> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: crc 2024-03-04T12:36:16.858 INFO:tasks.workunit.client.0.smithi110.stderr: -81> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: secure 2024-03-04T12:36:16.858 INFO:tasks.workunit.client.0.smithi110.stderr: -80> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: crc 2024-03-04T12:36:16.858 INFO:tasks.workunit.client.0.smithi110.stderr: -79> 2024-03-04T12:36:16.720+0000 7fba72020800 5 AuthRegistry(0x7ffef706d670) adding con mode: secure 2024-03-04T12:36:16.858 INFO:tasks.workunit.client.0.smithi110.stderr: -78> 2024-03-04T12:36:16.720+0000 7fb925fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:16.859 INFO:tasks.workunit.client.0.smithi110.stderr: -77> 2024-03-04T12:36:16.720+0000 7fba72020800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:16.859 INFO:tasks.workunit.client.0.smithi110.stderr: -76> 2024-03-04T12:36:16.720+0000 7fba72020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:16.859 INFO:tasks.workunit.client.0.smithi110.stderr: -75> 2024-03-04T12:36:16.720+0000 7fba72020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:16.859 INFO:tasks.workunit.client.0.smithi110.stderr: -74> 2024-03-04T12:36:16.720+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command cache list hook 0x55acb8ad3a40 2024-03-04T12:36:16.859 INFO:tasks.workunit.client.0.smithi110.stderr: -73> 2024-03-04T12:36:16.720+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command cache inspect hook 0x55acb8ad3a40 2024-03-04T12:36:16.859 INFO:tasks.workunit.client.0.smithi110.stderr: -72> 2024-03-04T12:36:16.720+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command cache erase hook 0x55acb8ad3a40 2024-03-04T12:36:16.859 INFO:tasks.workunit.client.0.smithi110.stderr: -71> 2024-03-04T12:36:16.720+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command cache zap hook 0x55acb8ad3a40 2024-03-04T12:36:16.859 INFO:tasks.workunit.client.0.smithi110.stderr: -70> 2024-03-04T12:36:16.720+0000 7fba72020800 5 note: GC not initialized 2024-03-04T12:36:16.859 INFO:tasks.workunit.client.0.smithi110.stderr: -69> 2024-03-04T12:36:16.720+0000 7fb924fe1640 20 reqs_thread_entry: start 2024-03-04T12:36:16.859 INFO:tasks.workunit.client.0.smithi110.stderr: -68> 2024-03-04T12:36:16.720+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command sync trace show hook 0x7fba600042e0 2024-03-04T12:36:16.859 INFO:tasks.workunit.client.0.smithi110.stderr: -67> 2024-03-04T12:36:16.720+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command sync trace history hook 0x7fba600042e0 2024-03-04T12:36:16.859 INFO:tasks.workunit.client.0.smithi110.stderr: -66> 2024-03-04T12:36:16.720+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command sync trace active hook 0x7fba600042e0 2024-03-04T12:36:16.859 INFO:tasks.workunit.client.0.smithi110.stderr: -65> 2024-03-04T12:36:16.720+0000 7fba72020800 5 asok(0x55acb87ef0c0) register_command sync trace active_short hook 0x7fba600042e0 2024-03-04T12:36:16.859 INFO:tasks.workunit.client.0.smithi110.stderr: -64> 2024-03-04T12:36:16.720+0000 7fba72020800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:16.860 INFO:tasks.workunit.client.0.smithi110.stderr: -63> 2024-03-04T12:36:16.720+0000 7fba72020800 20 Filter name: none 2024-03-04T12:36:16.860 INFO:tasks.workunit.client.0.smithi110.stderr: -62> 2024-03-04T12:36:16.720+0000 7fb89e7fc640 20 reqs_thread_entry: start 2024-03-04T12:36:16.860 INFO:tasks.workunit.client.0.smithi110.stderr: -61> 2024-03-04T12:36:16.720+0000 7fba72020800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-04T12:36:16.860 INFO:tasks.workunit.client.0.smithi110.stderr: -60> 2024-03-04T12:36:16.720+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.860 INFO:tasks.workunit.client.0.smithi110.stderr: -59> 2024-03-04T12:36:16.721+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:16.860 INFO:tasks.workunit.client.0.smithi110.stderr: -58> 2024-03-04T12:36:16.721+0000 7fba72020800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-04T12:36:16.860 INFO:tasks.workunit.client.0.smithi110.stderr: -57> 2024-03-04T12:36:16.721+0000 7fba72020800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-04T12:36:16.860 INFO:tasks.workunit.client.0.smithi110.stderr: -56> 2024-03-04T12:36:16.721+0000 7fba72020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 : miss 2024-03-04T12:36:16.860 INFO:tasks.workunit.client.0.smithi110.stderr: -55> 2024-03-04T12:36:16.721+0000 7fba72020800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.860 INFO:tasks.workunit.client.0.smithi110.stderr: -54> 2024-03-04T12:36:16.721+0000 7fba72020800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:16.860 INFO:tasks.workunit.client.0.smithi110.stderr: -53> 2024-03-04T12:36:16.721+0000 7fba72020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 info.flags=0x17 2024-03-04T12:36:16.860 INFO:tasks.workunit.client.0.smithi110.stderr: -52> 2024-03-04T12:36:16.721+0000 7fba72020800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 to cache LRU end 2024-03-04T12:36:16.860 INFO:tasks.workunit.client.0.smithi110.stderr: -51> 2024-03-04T12:36:16.721+0000 7fba72020800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:36:16.860 INFO:tasks.workunit.client.0.smithi110.stderr: -50> 2024-03-04T12:36:16.721+0000 7fba72020800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:16.861 INFO:tasks.workunit.client.0.smithi110.stderr: -49> 2024-03-04T12:36:16.721+0000 7fba72020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 2024-03-04T12:36:16.861 INFO:tasks.workunit.client.0.smithi110.stderr: -48> 2024-03-04T12:36:16.727+0000 7fba72020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 info.flags=0x17 2024-03-04T12:36:16.861 INFO:tasks.workunit.client.0.smithi110.stderr: -47> 2024-03-04T12:36:16.727+0000 7fba72020800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 to cache LRU end 2024-03-04T12:36:16.861 INFO:tasks.workunit.client.0.smithi110.stderr: -46> 2024-03-04T12:36:16.727+0000 7fba72020800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:16.861 INFO:tasks.workunit.client.0.smithi110.stderr: -45> 2024-03-04T12:36:16.727+0000 7fba72020800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27, ofs0, ns] 2024-03-04T12:36:16.861 INFO:tasks.workunit.client.0.smithi110.stderr: -44> 2024-03-04T12:36:16.727+0000 7fb94effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824035 cookie 94200321313504 notifier 6828 bl.length()=965 2024-03-04T12:36:16.861 INFO:tasks.workunit.client.0.smithi110.stderr: -43> 2024-03-04T12:36:16.727+0000 7fb94effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 info.flags=0x17 2024-03-04T12:36:16.861 INFO:tasks.workunit.client.0.smithi110.stderr: -42> 2024-03-04T12:36:16.727+0000 7fb94effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 to cache LRU end 2024-03-04T12:36:16.861 INFO:tasks.workunit.client.0.smithi110.stderr: -41> 2024-03-04T12:36:16.727+0000 7fb94effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:16.861 INFO:tasks.workunit.client.0.smithi110.stderr: -40> 2024-03-04T12:36:16.729+0000 7fba72020800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): orig_sources= new_sources= 2024-03-04T12:36:16.861 INFO:tasks.workunit.client.0.smithi110.stderr: -39> 2024-03-04T12:36:16.729+0000 7fba72020800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): potential sources added=[] removed=[] 2024-03-04T12:36:16.861 INFO:tasks.workunit.client.0.smithi110.stderr: -38> 2024-03-04T12:36:16.729+0000 7fba72020800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): orig_dests= new_dests= 2024-03-04T12:36:16.861 INFO:tasks.workunit.client.0.smithi110.stderr: -37> 2024-03-04T12:36:16.729+0000 7fba72020800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): potential dests added=[] removed=[] 2024-03-04T12:36:16.862 INFO:tasks.workunit.client.0.smithi110.stderr: -36> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.0 2024-03-04T12:36:16.862 INFO:tasks.workunit.client.0.smithi110.stderr: -35> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.0 2024-03-04T12:36:16.862 INFO:tasks.workunit.client.0.smithi110.stderr: -34> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.1 2024-03-04T12:36:16.862 INFO:tasks.workunit.client.0.smithi110.stderr: -33> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.1 2024-03-04T12:36:16.862 INFO:tasks.workunit.client.0.smithi110.stderr: -32> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.2 2024-03-04T12:36:16.862 INFO:tasks.workunit.client.0.smithi110.stderr: -31> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.2 2024-03-04T12:36:16.862 INFO:tasks.workunit.client.0.smithi110.stderr: -30> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.3 2024-03-04T12:36:16.862 INFO:tasks.workunit.client.0.smithi110.stderr: -29> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.3 2024-03-04T12:36:16.862 INFO:tasks.workunit.client.0.smithi110.stderr: -28> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.4 2024-03-04T12:36:16.862 INFO:tasks.workunit.client.0.smithi110.stderr: -27> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.4 2024-03-04T12:36:16.862 INFO:tasks.workunit.client.0.smithi110.stderr: -26> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.5 2024-03-04T12:36:16.862 INFO:tasks.workunit.client.0.smithi110.stderr: -25> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.5 2024-03-04T12:36:16.862 INFO:tasks.workunit.client.0.smithi110.stderr: -24> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.6 2024-03-04T12:36:16.862 INFO:tasks.workunit.client.0.smithi110.stderr: -23> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.6 2024-03-04T12:36:16.863 INFO:tasks.workunit.client.0.smithi110.stderr: -22> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.7 2024-03-04T12:36:16.863 INFO:tasks.workunit.client.0.smithi110.stderr: -21> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.7 2024-03-04T12:36:16.863 INFO:tasks.workunit.client.0.smithi110.stderr: -20> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.8 2024-03-04T12:36:16.863 INFO:tasks.workunit.client.0.smithi110.stderr: -19> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.8 2024-03-04T12:36:16.863 INFO:tasks.workunit.client.0.smithi110.stderr: -18> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.9 2024-03-04T12:36:16.863 INFO:tasks.workunit.client.0.smithi110.stderr: -17> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.9 2024-03-04T12:36:16.863 INFO:tasks.workunit.client.0.smithi110.stderr: -16> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.10 2024-03-04T12:36:16.863 INFO:tasks.workunit.client.0.smithi110.stderr: -15> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.10 2024-03-04T12:36:16.863 INFO:tasks.workunit.client.0.smithi110.stderr: -14> 2024-03-04T12:36:16.732+0000 7fba72020800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.11 2024-03-04T12:36:16.863 INFO:tasks.workunit.client.0.smithi110.stderr: -13> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.11 2024-03-04T12:36:16.863 INFO:tasks.workunit.client.0.smithi110.stderr: -12> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.0 2024-03-04T12:36:16.863 INFO:tasks.workunit.client.0.smithi110.stderr: -11> 2024-03-04T12:36:16.732+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1 2024-03-04T12:36:16.863 INFO:tasks.workunit.client.0.smithi110.stderr: -10> 2024-03-04T12:36:16.733+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.2 2024-03-04T12:36:16.863 INFO:tasks.workunit.client.0.smithi110.stderr: -9> 2024-03-04T12:36:16.733+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.3 2024-03-04T12:36:16.864 INFO:tasks.workunit.client.0.smithi110.stderr: -8> 2024-03-04T12:36:16.734+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.4 2024-03-04T12:36:16.864 INFO:tasks.workunit.client.0.smithi110.stderr: -7> 2024-03-04T12:36:16.734+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.5 2024-03-04T12:36:16.864 INFO:tasks.workunit.client.0.smithi110.stderr: -6> 2024-03-04T12:36:16.735+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.6 2024-03-04T12:36:16.864 INFO:tasks.workunit.client.0.smithi110.stderr: -5> 2024-03-04T12:36:16.735+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.7 2024-03-04T12:36:16.864 INFO:tasks.workunit.client.0.smithi110.stderr: -4> 2024-03-04T12:36:16.736+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.8 2024-03-04T12:36:16.864 INFO:tasks.workunit.client.0.smithi110.stderr: -3> 2024-03-04T12:36:16.736+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.9 2024-03-04T12:36:16.864 INFO:tasks.workunit.client.0.smithi110.stderr: -2> 2024-03-04T12:36:16.737+0000 7fba72020800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.10 2024-03-04T12:36:16.864 INFO:tasks.workunit.client.0.smithi110.stderr: -1> 2024-03-04T12:36:16.740+0000 7fba72020800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fba72020800 time 2024-03-04T12:36:16.740866+0000 2024-03-04T12:36:16.864 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:36:16.864 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.864 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:36:16.864 INFO:tasks.workunit.client.0.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fba75380e86] 2024-03-04T12:36:16.864 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fba75381044] 2024-03-04T12:36:16.864 INFO:tasks.workunit.client.0.smithi110.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acb6b5feb1] 2024-03-04T12:36:16.865 INFO:tasks.workunit.client.0.smithi110.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x55acb6b74088] 2024-03-04T12:36:16.865 INFO:tasks.workunit.client.0.smithi110.stderr: 5: main() 2024-03-04T12:36:16.865 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fba7423feb0] 2024-03-04T12:36:16.865 INFO:tasks.workunit.client.0.smithi110.stderr: 7: __libc_start_main() 2024-03-04T12:36:16.865 INFO:tasks.workunit.client.0.smithi110.stderr: 8: _start() 2024-03-04T12:36:16.865 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.865 INFO:tasks.workunit.client.0.smithi110.stderr: 0> 2024-03-04T12:36:16.741+0000 7fba72020800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:36:16.865 INFO:tasks.workunit.client.0.smithi110.stderr: in thread 7fba72020800 thread_name:radosgw-admin 2024-03-04T12:36:16.865 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.865 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:36:16.865 INFO:tasks.workunit.client.0.smithi110.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fba74254db0] 2024-03-04T12:36:16.865 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fba742a154c] 2024-03-04T12:36:16.865 INFO:tasks.workunit.client.0.smithi110.stderr: 3: raise() 2024-03-04T12:36:16.865 INFO:tasks.workunit.client.0.smithi110.stderr: 4: abort() 2024-03-04T12:36:16.866 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fba75380ee0] 2024-03-04T12:36:16.866 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7fba75381044] 2024-03-04T12:36:16.866 INFO:tasks.workunit.client.0.smithi110.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acb6b5feb1] 2024-03-04T12:36:16.866 INFO:tasks.workunit.client.0.smithi110.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x55acb6b74088] 2024-03-04T12:36:16.866 INFO:tasks.workunit.client.0.smithi110.stderr: 9: main() 2024-03-04T12:36:16.866 INFO:tasks.workunit.client.0.smithi110.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fba7423feb0] 2024-03-04T12:36:16.866 INFO:tasks.workunit.client.0.smithi110.stderr: 11: __libc_start_main() 2024-03-04T12:36:16.866 INFO:tasks.workunit.client.0.smithi110.stderr: 12: _start() 2024-03-04T12:36:16.866 INFO:tasks.workunit.client.0.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:36:16.866 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.866 INFO:tasks.workunit.client.0.smithi110.stderr:--- logging levels --- 2024-03-04T12:36:16.866 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 none 2024-03-04T12:36:16.866 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 lockdep 2024-03-04T12:36:16.866 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 context 2024-03-04T12:36:16.867 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 crush 2024-03-04T12:36:16.867 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds 2024-03-04T12:36:16.867 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_balancer 2024-03-04T12:36:16.867 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_locker 2024-03-04T12:36:16.867 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_log 2024-03-04T12:36:16.867 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_log_expire 2024-03-04T12:36:16.867 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_migrator 2024-03-04T12:36:16.867 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 buffer 2024-03-04T12:36:16.867 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 timer 2024-03-04T12:36:16.867 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 filer 2024-03-04T12:36:16.867 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 striper 2024-03-04T12:36:16.867 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 objecter 2024-03-04T12:36:16.867 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rados 2024-03-04T12:36:16.867 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd 2024-03-04T12:36:16.867 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_mirror 2024-03-04T12:36:16.868 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_replay 2024-03-04T12:36:16.868 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_pwl 2024-03-04T12:36:16.868 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 journaler 2024-03-04T12:36:16.868 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 objectcacher 2024-03-04T12:36:16.868 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 immutable_obj_cache 2024-03-04T12:36:16.868 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 client 2024-03-04T12:36:16.868 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 osd 2024-03-04T12:36:16.868 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 optracker 2024-03-04T12:36:16.868 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 objclass 2024-03-04T12:36:16.868 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 filestore 2024-03-04T12:36:16.868 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 journal 2024-03-04T12:36:16.868 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 0 ms 2024-03-04T12:36:16.868 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mon 2024-03-04T12:36:16.868 INFO:tasks.workunit.client.0.smithi110.stderr: 0/10 monc 2024-03-04T12:36:16.869 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 paxos 2024-03-04T12:36:16.869 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 tp 2024-03-04T12:36:16.869 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 auth 2024-03-04T12:36:16.869 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 crypto 2024-03-04T12:36:16.869 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 finisher 2024-03-04T12:36:16.869 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 reserver 2024-03-04T12:36:16.869 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 heartbeatmap 2024-03-04T12:36:16.869 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 perfcounter 2024-03-04T12:36:16.869 INFO:tasks.workunit.client.0.smithi110.stderr: 20/20 rgw 2024-03-04T12:36:16.869 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_sync 2024-03-04T12:36:16.869 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_datacache 2024-03-04T12:36:16.869 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_access 2024-03-04T12:36:16.869 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_dbstore 2024-03-04T12:36:16.869 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_flight 2024-03-04T12:36:16.869 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_lifecycle 2024-03-04T12:36:16.870 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 javaclient 2024-03-04T12:36:16.870 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 asok 2024-03-04T12:36:16.870 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 throttle 2024-03-04T12:36:16.870 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 0 refs 2024-03-04T12:36:16.870 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 compressor 2024-03-04T12:36:16.870 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 bluestore 2024-03-04T12:36:16.870 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 bluefs 2024-03-04T12:36:16.870 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 bdev 2024-03-04T12:36:16.870 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 kstore 2024-03-04T12:36:16.870 INFO:tasks.workunit.client.0.smithi110.stderr: 4/ 5 rocksdb 2024-03-04T12:36:16.870 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 fuse 2024-03-04T12:36:16.870 INFO:tasks.workunit.client.0.smithi110.stderr: 2/ 5 mgr 2024-03-04T12:36:16.870 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mgrc 2024-03-04T12:36:16.870 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 dpdk 2024-03-04T12:36:16.870 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 eventtrace 2024-03-04T12:36:16.871 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 prioritycache 2024-03-04T12:36:16.871 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 test 2024-03-04T12:36:16.871 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cephfs_mirror 2024-03-04T12:36:16.871 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cephsqlite 2024-03-04T12:36:16.871 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 crimson_interrupt 2024-03-04T12:36:16.871 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore 2024-03-04T12:36:16.871 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_onode 2024-03-04T12:36:16.871 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_odata 2024-03-04T12:36:16.871 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_omap 2024-03-04T12:36:16.871 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_tm 2024-03-04T12:36:16.871 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_t 2024-03-04T12:36:16.871 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_cleaner 2024-03-04T12:36:16.871 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_epm 2024-03-04T12:36:16.871 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_lba 2024-03-04T12:36:16.872 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-04T12:36:16.872 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_cache 2024-03-04T12:36:16.872 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_journal 2024-03-04T12:36:16.872 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_device 2024-03-04T12:36:16.872 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_backref 2024-03-04T12:36:16.872 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 alienstore 2024-03-04T12:36:16.872 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mclock 2024-03-04T12:36:16.872 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cyanstore 2024-03-04T12:36:16.872 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 ceph_exporter 2024-03-04T12:36:16.872 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 memstore 2024-03-04T12:36:16.872 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 trace 2024-03-04T12:36:16.872 INFO:tasks.workunit.client.0.smithi110.stderr: -2/-2 (syslog threshold) 2024-03-04T12:36:16.872 INFO:tasks.workunit.client.0.smithi110.stderr: 99/99 (stderr threshold) 2024-03-04T12:36:16.872 INFO:tasks.workunit.client.0.smithi110.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-04T12:36:16.873 INFO:tasks.workunit.client.0.smithi110.stderr: 7fb89e7fc640 / http_manager 2024-03-04T12:36:16.873 INFO:tasks.workunit.client.0.smithi110.stderr: 7fb924fe1640 / http_manager 2024-03-04T12:36:16.873 INFO:tasks.workunit.client.0.smithi110.stderr: 7fb925fe3640 / rgw_dt_lg_renew 2024-03-04T12:36:16.873 INFO:tasks.workunit.client.0.smithi110.stderr: 7fb94d7fa640 / ms_dispatch 2024-03-04T12:36:16.873 INFO:tasks.workunit.client.0.smithi110.stderr: 7fb94effd640 / io_context_pool 2024-03-04T12:36:16.873 INFO:tasks.workunit.client.0.smithi110.stderr: 7fb9557fa640 / ms_dispatch 2024-03-04T12:36:16.873 INFO:tasks.workunit.client.0.smithi110.stderr: 7fb957fff640 / ms_dispatch 2024-03-04T12:36:16.873 INFO:tasks.workunit.client.0.smithi110.stderr: 7fb95de0b640 / io_context_pool 2024-03-04T12:36:16.873 INFO:tasks.workunit.client.0.smithi110.stderr: 7fba67fff640 / msgr-worker-2 2024-03-04T12:36:16.873 INFO:tasks.workunit.client.0.smithi110.stderr: 7fba6fb1c640 / msgr-worker-1 2024-03-04T12:36:16.873 INFO:tasks.workunit.client.0.smithi110.stderr: 7fba7031d640 / msgr-worker-0 2024-03-04T12:36:16.873 INFO:tasks.workunit.client.0.smithi110.stderr: 7fba70b1e640 / io_context_pool 2024-03-04T12:36:16.873 INFO:tasks.workunit.client.0.smithi110.stderr: 7fba72020800 / radosgw-admin 2024-03-04T12:36:16.873 INFO:tasks.workunit.client.0.smithi110.stderr: max_recent 500 2024-03-04T12:36:16.873 INFO:tasks.workunit.client.0.smithi110.stderr: max_new 1000 2024-03-04T12:36:16.874 INFO:tasks.workunit.client.0.smithi110.stderr: log_file /var/lib/ceph/crash/2024-03-04T12:36:16.742217Z_9a336119-652a-4e6e-bbdf-07cff528226e/log 2024-03-04T12:36:16.874 INFO:tasks.workunit.client.0.smithi110.stderr:--- end dump of recent events --- 2024-03-04T12:36:16.874 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-03-04T12:36:16.879 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:16.880 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:16.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.811+0000 7f91d4c16800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.812+0000 7f91d4c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.812+0000 7f91d4c16800 20 realm 2024-03-04T12:36:16.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.812+0000 7f91d4c16800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.812+0000 7f91d4c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.812+0000 7f91d4c16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:16.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.812+0000 7f91d4c16800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.813+0000 7f91d4c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.813+0000 7f91d4c16800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.813+0000 7f91d4c16800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:16.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.813+0000 7f91d4c16800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.814+0000 7f91d4c16800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:16.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.814+0000 7f91d4c16800 20 searching for the correct realm 2024-03-04T12:36:16.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.817+0000 7f91c7fff640 0 -- 172.21.15.110:0/2731451638 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x55e73d33aec0 msgr2=0x55e73d33d330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:16.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.820+0000 7f91d035e640 0 -- 172.21.15.110:0/2731451638 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f91b80c6b50 msgr2=0x7f91b8068a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:16.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.825+0000 7f91d4c16800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:16.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.825+0000 7f91d4c16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:16.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.825+0000 7f91d4c16800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:16.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.825+0000 7f91d4c16800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:16.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.825+0000 7f91d4c16800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:16.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.825+0000 7f91d4c16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:16.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.825+0000 7f91d4c16800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.826+0000 7f91d4c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.826+0000 7f91d4c16800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.826+0000 7f91d4c16800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:16.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.826+0000 7f91d4c16800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.826+0000 7f91d4c16800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:16.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.826+0000 7f91d4c16800 20 zone default found 2024-03-04T12:36:16.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.826+0000 7f91d4c16800 4 Realm: () 2024-03-04T12:36:16.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.826+0000 7f91d4c16800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:16.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.826+0000 7f91d4c16800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:16.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.826+0000 7f91d4c16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:16.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.826+0000 7f91d4c16800 20 zonegroup default 2024-03-04T12:36:16.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.826+0000 7f91d4c16800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.827+0000 7f91d4c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.827+0000 7f91d4c16800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.827+0000 7f91d4c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.827+0000 7f91d4c16800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.827+0000 7f91d4c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.827+0000 7f91d4c16800 20 started sync module instance, tier type = 2024-03-04T12:36:16.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.827+0000 7f91d4c16800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:16.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.837+0000 7f91d4c16800 20 add_watcher() i=0 2024-03-04T12:36:16.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.837+0000 7f91d4c16800 20 add_watcher() i=1 2024-03-04T12:36:16.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.837+0000 7f91d4c16800 20 add_watcher() i=2 2024-03-04T12:36:16.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.837+0000 7f91d4c16800 20 add_watcher() i=3 2024-03-04T12:36:16.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.837+0000 7f91d4c16800 20 add_watcher() i=4 2024-03-04T12:36:16.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.837+0000 7f91d4c16800 20 add_watcher() i=5 2024-03-04T12:36:16.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.837+0000 7f91d4c16800 20 add_watcher() i=6 2024-03-04T12:36:16.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.838+0000 7f91d4c16800 20 add_watcher() i=7 2024-03-04T12:36:16.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.838+0000 7f91d4c16800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:16.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.840+0000 7f9086fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:16.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.840+0000 7f91d4c16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:16.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.840+0000 7f91d4c16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:16.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.840+0000 7f91d4c16800 5 note: GC not initialized 2024-03-04T12:36:16.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.840+0000 7f9085fdb640 20 reqs_thread_entry: start 2024-03-04T12:36:16.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.840+0000 7f91d4c16800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:16.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.840+0000 7f91d4c16800 20 Filter name: none 2024-03-04T12:36:16.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.840+0000 7f8ff77fe640 20 reqs_thread_entry: start 2024-03-04T12:36:16.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.840+0000 7f91d4c16800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.841+0000 7f91d4c16800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:16.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.841+0000 7f91d4c16800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.841+0000 7f91d4c16800 20 rados_obj.operate() r=0 bl.length=425 2024-03-04T12:36:16.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.841+0000 7f91d4c16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:16.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.841+0000 7f91d4c16800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.842+0000 7f91d4c16800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:16.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.842+0000 7f91d4c16800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.842+0000 7f91d4c16800 20 rados_obj.operate() r=0 bl.length=425 2024-03-04T12:36:16.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.842+0000 7f91d4c16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:16.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.843+0000 7f91d4c16800 20 rados->read ofs=0 len=0 2024-03-04T12:36:16.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.843+0000 7f91d4c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:16.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.844+0000 7f9086fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:16.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.846+0000 7f91d4c16800 20 remove_watcher() i=0 2024-03-04T12:36:16.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.846+0000 7f91d4c16800 2 removed watcher, disabling cache 2024-03-04T12:36:16.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.847+0000 7f91d4c16800 20 remove_watcher() i=1 2024-03-04T12:36:16.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.848+0000 7f91d4c16800 20 remove_watcher() i=2 2024-03-04T12:36:16.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.849+0000 7f91d4c16800 20 remove_watcher() i=3 2024-03-04T12:36:16.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.850+0000 7f91d4c16800 20 remove_watcher() i=4 2024-03-04T12:36:16.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.851+0000 7f91d4c16800 20 remove_watcher() i=5 2024-03-04T12:36:16.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.852+0000 7f91d4c16800 20 remove_watcher() i=6 2024-03-04T12:36:16.885 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:16.853+0000 7f91d4c16800 20 remove_watcher() i=7 2024-03-04T12:36:16.885 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.885 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:36:16.885 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: abort-at-commit-target-layout id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:36:16.885 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:16.886 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:16.886 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:47.004 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:47.004 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:47.060 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:36:47.093 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:47.093 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:47.128 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.122+0000 7f3e8e48c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.130 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.123+0000 7f3e8e48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:47.130 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.123+0000 7f3e8e48c800 20 realm 2024-03-04T12:36:47.130 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.123+0000 7f3e8e48c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.130 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.123+0000 7f3e8e48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:47.130 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.123+0000 7f3e8e48c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:47.130 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.123+0000 7f3e8e48c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.130 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.123+0000 7f3e8e48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:47.130 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.123+0000 7f3e8e48c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.131 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.124+0000 7f3e8e48c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:47.131 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.124+0000 7f3e8e48c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.131 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.125+0000 7f3e8e48c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:47.131 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.125+0000 7f3e8e48c800 20 searching for the correct realm 2024-03-04T12:36:47.136 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.130+0000 7f3e8c789640 0 -- 172.21.15.110:0/2934529369 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7f3e74068980 msgr2=0x7f3e740907c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:36:47.342 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.336+0000 7f3e8bf88640 0 -- 172.21.15.110:0/2934529369 >> [v2:172.21.15.172:6800/824320839,v1:172.21.15.172:6801/824320839] conn(0x5601045b8470 msgr2=0x5601045ba8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:47.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.339+0000 7f3e8e48c800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:47.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.339+0000 7f3e8e48c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:47.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.339+0000 7f3e8e48c800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:47.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.339+0000 7f3e8e48c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:47.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.339+0000 7f3e8e48c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:47.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.339+0000 7f3e8e48c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:47.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.339+0000 7f3e8e48c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.339+0000 7f3e8e48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:47.345 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.339+0000 7f3e8e48c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.346 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.339+0000 7f3e8e48c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:47.346 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.339+0000 7f3e8e48c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.346 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.340+0000 7f3e8e48c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:47.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.340+0000 7f3e8e48c800 20 zone default found 2024-03-04T12:36:47.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.340+0000 7f3e8e48c800 4 Realm: () 2024-03-04T12:36:47.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.340+0000 7f3e8e48c800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:47.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.340+0000 7f3e8e48c800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:47.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.340+0000 7f3e8e48c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:47.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.340+0000 7f3e8e48c800 20 zonegroup default 2024-03-04T12:36:47.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.340+0000 7f3e8e48c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.340+0000 7f3e8e48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:47.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.340+0000 7f3e8e48c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.340+0000 7f3e8e48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:47.347 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.340+0000 7f3e8e48c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.341+0000 7f3e8e48c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:47.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.341+0000 7f3e8e48c800 20 started sync module instance, tier type = 2024-03-04T12:36:47.348 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.341+0000 7f3e8e48c800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:47.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.350+0000 7f3e8e48c800 20 add_watcher() i=0 2024-03-04T12:36:47.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.350+0000 7f3e8e48c800 20 add_watcher() i=1 2024-03-04T12:36:47.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.350+0000 7f3e8e48c800 20 add_watcher() i=2 2024-03-04T12:36:47.356 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.350+0000 7f3e8e48c800 20 add_watcher() i=3 2024-03-04T12:36:47.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.350+0000 7f3e8e48c800 20 add_watcher() i=4 2024-03-04T12:36:47.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.350+0000 7f3e8e48c800 20 add_watcher() i=5 2024-03-04T12:36:47.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.350+0000 7f3e8e48c800 20 add_watcher() i=6 2024-03-04T12:36:47.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.351+0000 7f3e8e48c800 20 add_watcher() i=7 2024-03-04T12:36:47.357 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.351+0000 7f3e8e48c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:47.358 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.352+0000 7f3d41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:47.359 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.353+0000 7f3e8e48c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:47.360 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.353+0000 7f3e8e48c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:47.360 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.353+0000 7f3e8e48c800 5 note: GC not initialized 2024-03-04T12:36:47.360 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.353+0000 7f3d40fe1640 20 reqs_thread_entry: start 2024-03-04T12:36:47.360 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.353+0000 7f3e8e48c800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:47.360 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.353+0000 7f3e8e48c800 20 Filter name: none 2024-03-04T12:36:47.360 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.353+0000 7f3cba7fc640 20 reqs_thread_entry: start 2024-03-04T12:36:47.360 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.353+0000 7f3e8e48c800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-04T12:36:47.360 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.353+0000 7f3e8e48c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.354+0000 7f3e8e48c800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:47.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.354+0000 7f3e8e48c800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-04T12:36:47.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.354+0000 7f3e8e48c800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-04T12:36:47.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.354+0000 7f3e8e48c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 : miss 2024-03-04T12:36:47.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.354+0000 7f3e8e48c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.354+0000 7f3e8e48c800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:47.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.354+0000 7f3e8e48c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 info.flags=0x17 2024-03-04T12:36:47.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.354+0000 7f3e8e48c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 to cache LRU end 2024-03-04T12:36:47.361 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.354+0000 7f3e8e48c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:36:47.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.354+0000 7f3e8e48c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:47.362 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.354+0000 7f3e8e48c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 2024-03-04T12:36:47.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.360+0000 7f3e8e48c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 info.flags=0x17 2024-03-04T12:36:47.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.360+0000 7f3e8e48c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 to cache LRU end 2024-03-04T12:36:47.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.360+0000 7f3e8e48c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:47.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.360+0000 7f3e8e48c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27, ofs0, ns] 2024-03-04T12:36:47.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.360+0000 7f3d6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824037 cookie 94562368095968 notifier 6425 bl.length()=965 2024-03-04T12:36:47.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.360+0000 7f3d6affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 info.flags=0x17 2024-03-04T12:36:47.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.360+0000 7f3d6affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 to cache LRU end 2024-03-04T12:36:47.368 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.360+0000 7f3d6affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:47.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.362+0000 7f3e8e48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): orig_sources= new_sources= 2024-03-04T12:36:47.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.362+0000 7f3e8e48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): potential sources added=[] removed=[] 2024-03-04T12:36:47.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.362+0000 7f3e8e48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): orig_dests= new_dests= 2024-03-04T12:36:47.369 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.362+0000 7f3e8e48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): potential dests added=[] removed=[] 2024-03-04T12:36:47.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.365+0000 7f3e8e48c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.0 2024-03-04T12:36:47.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.365+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.0 2024-03-04T12:36:47.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.1 2024-03-04T12:36:47.372 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.1 2024-03-04T12:36:47.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.2 2024-03-04T12:36:47.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.2 2024-03-04T12:36:47.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.3 2024-03-04T12:36:47.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.3 2024-03-04T12:36:47.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.4 2024-03-04T12:36:47.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.4 2024-03-04T12:36:47.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.5 2024-03-04T12:36:47.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.5 2024-03-04T12:36:47.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.6 2024-03-04T12:36:47.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.6 2024-03-04T12:36:47.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.7 2024-03-04T12:36:47.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.7 2024-03-04T12:36:47.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.8 2024-03-04T12:36:47.373 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.8 2024-03-04T12:36:47.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.9 2024-03-04T12:36:47.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.9 2024-03-04T12:36:47.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.10 2024-03-04T12:36:47.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.10 2024-03-04T12:36:47.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.11 2024-03-04T12:36:47.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1.11 2024-03-04T12:36:47.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.0 2024-03-04T12:36:47.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.366+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.1 2024-03-04T12:36:47.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.367+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.2 2024-03-04T12:36:47.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.367+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.3 2024-03-04T12:36:47.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.368+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.4 2024-03-04T12:36:47.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.368+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.5 2024-03-04T12:36:47.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.369+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.6 2024-03-04T12:36:47.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.369+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.7 2024-03-04T12:36:47.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.370+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.8 2024-03-04T12:36:47.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.370+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.9 2024-03-04T12:36:47.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.371+0000 7f3e8e48c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27.10 2024-03-04T12:36:47.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.373+0000 7f3e8e48c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 : hit (requested=0x17, cached=0x17) 2024-03-04T12:36:47.379 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.373+0000 7f3e8e48c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 2024-03-04T12:36:47.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.375+0000 7f3e8e48c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 info.flags=0x17 2024-03-04T12:36:47.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.375+0000 7f3e8e48c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 to cache LRU end 2024-03-04T12:36:47.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.375+0000 7f3e8e48c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:47.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.375+0000 7f3e8e48c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27, ofs0, ns] 2024-03-04T12:36:47.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.375+0000 7f3d6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824038 cookie 94562368095968 notifier 6425 bl.length()=933 2024-03-04T12:36:47.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.375+0000 7f3d6affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 info.flags=0x17 2024-03-04T12:36:47.381 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.375+0000 7f3d6affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 to cache LRU end 2024-03-04T12:36:47.382 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.375+0000 7f3d6affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:47.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.377+0000 7f3e8e48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): orig_sources= new_sources= 2024-03-04T12:36:47.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.377+0000 7f3e8e48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): potential sources added=[] removed=[] 2024-03-04T12:36:47.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.377+0000 7f3e8e48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): orig_dests= new_dests= 2024-03-04T12:36:47.383 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.377+0000 7f3e8e48c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27]): potential dests added=[] removed=[] 2024-03-04T12:36:47.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.379+0000 7f3e8e48c800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" completed successfully 2024-03-04T12:36:47.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.381+0000 7f3d41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:47.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.383+0000 7f3e8e48c800 20 remove_watcher() i=0 2024-03-04T12:36:47.389 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.383+0000 7f3e8e48c800 2 removed watcher, disabling cache 2024-03-04T12:36:47.391 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.385+0000 7f3e8e48c800 20 remove_watcher() i=1 2024-03-04T12:36:47.392 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.386+0000 7f3e8e48c800 20 remove_watcher() i=2 2024-03-04T12:36:47.393 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.387+0000 7f3e8e48c800 20 remove_watcher() i=3 2024-03-04T12:36:47.394 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.388+0000 7f3e8e48c800 20 remove_watcher() i=4 2024-03-04T12:36:47.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.389+0000 7f3e8e48c800 20 remove_watcher() i=5 2024-03-04T12:36:47.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.390+0000 7f3e8e48c800 20 remove_watcher() i=6 2024-03-04T12:36:47.397 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.391+0000 7f3e8e48c800 20 remove_watcher() i=7 2024-03-04T12:36:47.408 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-03-04T12:36:47.436 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:47.436 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:47.468 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.462+0000 7fcfe8baf800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.470 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.464+0000 7fcfe8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:47.470 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.464+0000 7fcfe8baf800 20 realm 2024-03-04T12:36:47.470 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.464+0000 7fcfe8baf800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.470 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.464+0000 7fcfe8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:47.470 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.464+0000 7fcfe8baf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:47.471 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.464+0000 7fcfe8baf800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.471 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.464+0000 7fcfe8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:47.471 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.464+0000 7fcfe8baf800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.471 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.465+0000 7fcfe8baf800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:47.471 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.465+0000 7fcfe8baf800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.472 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.465+0000 7fcfe8baf800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:47.472 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.465+0000 7fcfe8baf800 20 searching for the correct realm 2024-03-04T12:36:47.474 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.468+0000 7fcfe5eaa640 0 -- 172.21.15.110:0/2419889961 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7fcfd8087070 msgr2=0x7fcfd8080a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:47.477 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.471+0000 7fcfe66ab640 0 -- 172.21.15.110:0/2419889961 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fcfdc05fb20 msgr2=0x7fcfdc0ad630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:36:47.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.677+0000 7fcfe8baf800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:47.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.677+0000 7fcfe8baf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:47.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.677+0000 7fcfe8baf800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:47.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.677+0000 7fcfe8baf800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:47.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.677+0000 7fcfe8baf800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:47.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.677+0000 7fcfe8baf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:47.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.677+0000 7fcfe8baf800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.677+0000 7fcfe8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:47.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.677+0000 7fcfe8baf800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.678+0000 7fcfe8baf800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:47.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.678+0000 7fcfe8baf800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.678+0000 7fcfe8baf800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:47.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.678+0000 7fcfe8baf800 20 zone default found 2024-03-04T12:36:47.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.678+0000 7fcfe8baf800 4 Realm: () 2024-03-04T12:36:47.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.678+0000 7fcfe8baf800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:47.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.678+0000 7fcfe8baf800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:47.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.678+0000 7fcfe8baf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:47.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.678+0000 7fcfe8baf800 20 zonegroup default 2024-03-04T12:36:47.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.678+0000 7fcfe8baf800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.678+0000 7fcfe8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:47.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.678+0000 7fcfe8baf800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.678+0000 7fcfe8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:47.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.678+0000 7fcfe8baf800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.679+0000 7fcfe8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:47.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.679+0000 7fcfe8baf800 20 started sync module instance, tier type = 2024-03-04T12:36:47.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.679+0000 7fcfe8baf800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:47.694 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.688+0000 7fcfe8baf800 20 add_watcher() i=0 2024-03-04T12:36:47.694 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.688+0000 7fcfe8baf800 20 add_watcher() i=1 2024-03-04T12:36:47.694 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.688+0000 7fcfe8baf800 20 add_watcher() i=2 2024-03-04T12:36:47.694 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.688+0000 7fcfe8baf800 20 add_watcher() i=3 2024-03-04T12:36:47.694 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.688+0000 7fcfe8baf800 20 add_watcher() i=4 2024-03-04T12:36:47.694 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.688+0000 7fcfe8baf800 20 add_watcher() i=5 2024-03-04T12:36:47.695 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.688+0000 7fcfe8baf800 20 add_watcher() i=6 2024-03-04T12:36:47.695 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.689+0000 7fcfe8baf800 20 add_watcher() i=7 2024-03-04T12:36:47.695 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.689+0000 7fcfe8baf800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:47.696 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.690+0000 7fce9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:47.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.691+0000 7fcfe8baf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:47.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.691+0000 7fcfe8baf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:47.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.691+0000 7fcfe8baf800 5 note: GC not initialized 2024-03-04T12:36:47.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.691+0000 7fce177fe640 20 reqs_thread_entry: start 2024-03-04T12:36:47.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.691+0000 7fcfe8baf800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:47.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.691+0000 7fcfe8baf800 20 Filter name: none 2024-03-04T12:36:47.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.691+0000 7fce157fa640 20 reqs_thread_entry: start 2024-03-04T12:36:47.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.691+0000 7fcfe8baf800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.698 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.692+0000 7fcfe8baf800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:47.699 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.692+0000 7fcfe8baf800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.699 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.692+0000 7fcfe8baf800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:47.700 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.692+0000 7fcfe8baf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:47.700 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.692+0000 7fcfe8baf800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.700 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.693+0000 7fcfe8baf800 20 rados_obj.operate() r=0 bl.length=221 2024-03-04T12:36:47.700 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.693+0000 7fcfe8baf800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.700 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.693+0000 7fcfe8baf800 20 rados_obj.operate() r=0 bl.length=393 2024-03-04T12:36:47.700 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.693+0000 7fcfe8baf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:47.700 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.694+0000 7fcfe8baf800 20 rados->read ofs=0 len=0 2024-03-04T12:36:47.700 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.694+0000 7fcfe8baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:47.701 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.695+0000 7fce9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:47.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.697+0000 7fcfe8baf800 20 remove_watcher() i=0 2024-03-04T12:36:47.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.697+0000 7fcfe8baf800 2 removed watcher, disabling cache 2024-03-04T12:36:47.704 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.698+0000 7fcfe8baf800 20 remove_watcher() i=1 2024-03-04T12:36:47.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.699+0000 7fcfe8baf800 20 remove_watcher() i=2 2024-03-04T12:36:47.706 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.700+0000 7fcfe8baf800 20 remove_watcher() i=3 2024-03-04T12:36:47.707 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.701+0000 7fcfe8baf800 20 remove_watcher() i=4 2024-03-04T12:36:47.708 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.702+0000 7fcfe8baf800 20 remove_watcher() i=5 2024-03-04T12:36:47.709 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.703+0000 7fcfe8baf800 20 remove_watcher() i=6 2024-03-04T12:36:47.711 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:47.704+0000 7fcfe8baf800 20 remove_watcher() i=7 2024-03-04T12:36:47.720 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:47.720 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:36:47.720 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: abort-at-commit-target-layout id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-04T12:36:47.720 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:47.722 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:47.722 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:47.739 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:47.739 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:47.888 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:47.888 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.013 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-03-04T12:36:48.014 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:48.015 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.015 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.059 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.059 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.113 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.113 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.141 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.141 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.173 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.173 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.202 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.202 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.229 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.230 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.257 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.257 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.286 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.286 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.313 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.313 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.341 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.342 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.370 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.371 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.398 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.398 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.426 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.426 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.453 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.454 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.482 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.482 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.511 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.511 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.539 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.539 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.566 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.566 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.596 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.596 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.623 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.623 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.652 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:48.652 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:48.681 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-03-04T12:36:48.708 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:48.708 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:48.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.734+0000 7f97e8667800 20 rados->read ofs=0 len=0 2024-03-04T12:36:48.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.735+0000 7f97e8667800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:48.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.735+0000 7f97e8667800 20 realm 2024-03-04T12:36:48.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.735+0000 7f97e8667800 20 rados->read ofs=0 len=0 2024-03-04T12:36:48.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.736+0000 7f97e8667800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:48.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.736+0000 7f97e8667800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:48.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.736+0000 7f97e8667800 20 rados->read ofs=0 len=0 2024-03-04T12:36:48.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.736+0000 7f97e8667800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:48.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.736+0000 7f97e8667800 20 rados->read ofs=0 len=0 2024-03-04T12:36:48.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.737+0000 7f97e8667800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:48.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.737+0000 7f97e8667800 20 rados->read ofs=0 len=0 2024-03-04T12:36:48.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.737+0000 7f97e8667800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:48.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.737+0000 7f97e8667800 20 searching for the correct realm 2024-03-04T12:36:48.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.741+0000 7f97e6964640 0 -- 172.21.15.110:0/2640183046 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7f97d004f940 msgr2=0x7f97d0040410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:48.954 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.948+0000 7f97e6163640 0 -- 172.21.15.110:0/2640183046 >> [v2:172.21.15.172:6800/824320839,v1:172.21.15.172:6801/824320839] conn(0x557c70d5ab00 msgr2=0x557c70d5cef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:48.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:48.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:48.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:48.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:48.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:48.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:48.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 20 rados->read ofs=0 len=0 2024-03-04T12:36:48.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:48.957 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 20 rados->read ofs=0 len=0 2024-03-04T12:36:48.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:48.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 20 rados->read ofs=0 len=0 2024-03-04T12:36:48.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:48.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 20 zone default found 2024-03-04T12:36:48.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 4 Realm: () 2024-03-04T12:36:48.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:48.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:48.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:48.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 20 zonegroup default 2024-03-04T12:36:48.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.951+0000 7f97e8667800 20 rados->read ofs=0 len=0 2024-03-04T12:36:48.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.952+0000 7f97e8667800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:48.959 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.952+0000 7f97e8667800 20 rados->read ofs=0 len=0 2024-03-04T12:36:48.960 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.952+0000 7f97e8667800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:48.960 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.952+0000 7f97e8667800 20 rados->read ofs=0 len=0 2024-03-04T12:36:48.960 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.952+0000 7f97e8667800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:48.960 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.952+0000 7f97e8667800 20 started sync module instance, tier type = 2024-03-04T12:36:48.960 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.952+0000 7f97e8667800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:48.968 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.962+0000 7f97e8667800 20 add_watcher() i=0 2024-03-04T12:36:48.968 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.962+0000 7f97e8667800 20 add_watcher() i=1 2024-03-04T12:36:48.968 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.962+0000 7f97e8667800 20 add_watcher() i=2 2024-03-04T12:36:48.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.962+0000 7f97e8667800 20 add_watcher() i=3 2024-03-04T12:36:48.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.962+0000 7f97e8667800 20 add_watcher() i=4 2024-03-04T12:36:48.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.962+0000 7f97e8667800 20 add_watcher() i=5 2024-03-04T12:36:48.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.962+0000 7f97e8667800 20 add_watcher() i=6 2024-03-04T12:36:48.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.963+0000 7f97e8667800 20 add_watcher() i=7 2024-03-04T12:36:48.969 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.963+0000 7f97e8667800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:48.971 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.965+0000 7f969cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:48.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.965+0000 7f97e8667800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:48.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.965+0000 7f97e8667800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:48.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.965+0000 7f97e8667800 5 note: GC not initialized 2024-03-04T12:36:48.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.965+0000 7f96177fe640 20 reqs_thread_entry: start 2024-03-04T12:36:48.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.965+0000 7f97e8667800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:48.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.965+0000 7f97e8667800 20 Filter name: none 2024-03-04T12:36:48.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.966+0000 7f96157fa640 20 reqs_thread_entry: start 2024-03-04T12:36:48.972 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.966+0000 7f97e8667800 20 rados->read ofs=0 len=0 2024-03-04T12:36:48.973 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.966+0000 7f97e8667800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:36:48.973 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.966+0000 7f97e8667800 20 rados->read ofs=0 len=0 2024-03-04T12:36:48.974 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.967+0000 7f97e8667800 20 rados_obj.operate() r=0 bl.length=383 2024-03-04T12:36:48.974 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.967+0000 7f97e8667800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:48.974 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.967+0000 7f97e8667800 20 rados->read ofs=0 len=0 2024-03-04T12:36:48.974 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.967+0000 7f97e8667800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:36:48.974 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.967+0000 7f97e8667800 20 rados->read ofs=0 len=0 2024-03-04T12:36:48.974 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.968+0000 7f97e8667800 20 rados_obj.operate() r=0 bl.length=383 2024-03-04T12:36:48.974 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.968+0000 7f97e8667800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:48.974 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.968+0000 7f97e8667800 20 rados->read ofs=0 len=0 2024-03-04T12:36:48.975 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.969+0000 7f97e8667800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:48.975 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.969+0000 7f969cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:48.978 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.972+0000 7f97e8667800 20 remove_watcher() i=0 2024-03-04T12:36:48.978 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.972+0000 7f97e8667800 2 removed watcher, disabling cache 2024-03-04T12:36:48.979 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.973+0000 7f97e8667800 20 remove_watcher() i=1 2024-03-04T12:36:48.980 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.974+0000 7f97e8667800 20 remove_watcher() i=2 2024-03-04T12:36:48.982 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.976+0000 7f97e8667800 20 remove_watcher() i=3 2024-03-04T12:36:48.983 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.977+0000 7f97e8667800 20 remove_watcher() i=4 2024-03-04T12:36:48.984 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.978+0000 7f97e8667800 20 remove_watcher() i=5 2024-03-04T12:36:48.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.979+0000 7f97e8667800 20 remove_watcher() i=6 2024-03-04T12:36:48.985 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:48.979+0000 7f97e8667800 20 remove_watcher() i=7 2024-03-04T12:36:48.995 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:48.995 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:36:48.995 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: error-at-do-reshard id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:36:48.995 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:48.996 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-03-04T12:36:49.029 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:49.030 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:49.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.056+0000 7fda9663d800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.057+0000 7fda9663d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.057+0000 7fda9663d800 20 realm 2024-03-04T12:36:49.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.057+0000 7fda9663d800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.057+0000 7fda9663d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.057+0000 7fda9663d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:49.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.057+0000 7fda9663d800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.057+0000 7fda9663d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.057+0000 7fda9663d800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.058+0000 7fda9663d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:49.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.058+0000 7fda9663d800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.059+0000 7fda9663d800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:49.065 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.059+0000 7fda9663d800 20 searching for the correct realm 2024-03-04T12:36:49.068 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.062+0000 7fda9493a640 0 -- 172.21.15.110:0/3161837385 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7fda8803a790 msgr2=0x7fda8803a200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:49.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.065+0000 7fda94139640 0 -- 172.21.15.110:0/3161837385 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fda88080d50 msgr2=0x7fda88060810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:36:49.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.271+0000 7fda9663d800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:49.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.271+0000 7fda9663d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:49.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.271+0000 7fda9663d800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:49.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.271+0000 7fda9663d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:49.278 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.271+0000 7fda9663d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:49.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.271+0000 7fda9663d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:49.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.271+0000 7fda9663d800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.272+0000 7fda9663d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.272+0000 7fda9663d800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.272+0000 7fda9663d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:49.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.272+0000 7fda9663d800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.272+0000 7fda9663d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:49.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.272+0000 7fda9663d800 20 zone default found 2024-03-04T12:36:49.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.273+0000 7fda9663d800 4 Realm: () 2024-03-04T12:36:49.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.273+0000 7fda9663d800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:49.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.273+0000 7fda9663d800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:49.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.273+0000 7fda9663d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:49.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.273+0000 7fda9663d800 20 zonegroup default 2024-03-04T12:36:49.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.273+0000 7fda9663d800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.273+0000 7fda9663d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.273+0000 7fda9663d800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.273+0000 7fda9663d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.273+0000 7fda9663d800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.273+0000 7fda9663d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.273+0000 7fda9663d800 20 started sync module instance, tier type = 2024-03-04T12:36:49.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.273+0000 7fda9663d800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:49.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.285+0000 7fda9663d800 20 add_watcher() i=0 2024-03-04T12:36:49.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.285+0000 7fda9663d800 20 add_watcher() i=1 2024-03-04T12:36:49.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.285+0000 7fda9663d800 20 add_watcher() i=2 2024-03-04T12:36:49.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.285+0000 7fda9663d800 20 add_watcher() i=3 2024-03-04T12:36:49.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.285+0000 7fda9663d800 20 add_watcher() i=4 2024-03-04T12:36:49.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.285+0000 7fda9663d800 20 add_watcher() i=5 2024-03-04T12:36:49.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.285+0000 7fda9663d800 20 add_watcher() i=6 2024-03-04T12:36:49.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.286+0000 7fda9663d800 20 add_watcher() i=7 2024-03-04T12:36:49.292 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.286+0000 7fda9663d800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:49.294 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.288+0000 7fd94afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:49.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.288+0000 7fda9663d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:49.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.288+0000 7fda9663d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:49.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.288+0000 7fda9663d800 5 note: GC not initialized 2024-03-04T12:36:49.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.288+0000 7fd949fdb640 20 reqs_thread_entry: start 2024-03-04T12:36:49.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.288+0000 7fda9663d800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:49.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.288+0000 7fda9663d800 20 Filter name: none 2024-03-04T12:36:49.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.289+0000 7fd8bb7fe640 20 reqs_thread_entry: start 2024-03-04T12:36:49.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.289+0000 7fda9663d800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-03-04T12:36:49.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.289+0000 7fda9663d800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.289+0000 7fda9663d800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:36:49.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.289+0000 7fda9663d800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-03-04T12:36:49.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.289+0000 7fda9663d800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-03-04T12:36:49.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.289+0000 7fda9663d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 : miss 2024-03-04T12:36:49.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.289+0000 7fda9663d800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.290+0000 7fda9663d800 20 rados_obj.operate() r=0 bl.length=383 2024-03-04T12:36:49.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.290+0000 7fda9663d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 info.flags=0x17 2024-03-04T12:36:49.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.290+0000 7fda9663d800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 to cache LRU end 2024-03-04T12:36:49.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.290+0000 7fda9663d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:36:49.297 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.290+0000 7fda9663d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:49.297 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.290+0000 7fda9663d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 2024-03-04T12:36:49.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.295+0000 7fda9663d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 info.flags=0x17 2024-03-04T12:36:49.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.295+0000 7fda9663d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 to cache LRU end 2024-03-04T12:36:49.302 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.295+0000 7fda9663d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:49.302 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.295+0000 7fda9663d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28, ofs0, ns] 2024-03-04T12:36:49.302 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.295+0000 7fd96affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824108 cookie 94527855132096 notifier 6479 bl.length()=945 2024-03-04T12:36:49.302 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.295+0000 7fd96affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 info.flags=0x17 2024-03-04T12:36:49.302 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.295+0000 7fd96affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 to cache LRU end 2024-03-04T12:36:49.302 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.295+0000 7fd96affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:49.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.297+0000 7fda9663d800 20 handle_bi_update(): bucket=:error-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28]): orig_sources= new_sources= 2024-03-04T12:36:49.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.297+0000 7fda9663d800 20 handle_bi_update(): bucket=:error-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28]): potential sources added=[] removed=[] 2024-03-04T12:36:49.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.297+0000 7fda9663d800 20 handle_bi_update(): bucket=:error-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28]): orig_dests= new_dests= 2024-03-04T12:36:49.303 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.297+0000 7fda9663d800 20 handle_bi_update(): bucket=:error-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28]): potential dests added=[] removed=[] 2024-03-04T12:36:49.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.299+0000 7fda9663d800 -1 Injecting error=-5 at location=do_reshard 2024-03-04T12:36:49.310 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.304+0000 7fda9663d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 : hit (requested=0x17, cached=0x17) 2024-03-04T12:36:49.311 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.304+0000 7fda9663d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 2024-03-04T12:36:49.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.305+0000 7fda9663d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 info.flags=0x17 2024-03-04T12:36:49.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.305+0000 7fda9663d800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 to cache LRU end 2024-03-04T12:36:49.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.305+0000 7fda9663d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:49.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.305+0000 7fda9663d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28, ofs0, ns] 2024-03-04T12:36:49.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.306+0000 7fd96affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824109 cookie 94527855132096 notifier 6479 bl.length()=913 2024-03-04T12:36:49.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.306+0000 7fd96affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 info.flags=0x17 2024-03-04T12:36:49.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.306+0000 7fd96affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 to cache LRU end 2024-03-04T12:36:49.312 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.306+0000 7fd96affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:49.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.307+0000 7fda9663d800 20 handle_bi_update(): bucket=:error-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28]): orig_sources= new_sources= 2024-03-04T12:36:49.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.307+0000 7fda9663d800 20 handle_bi_update(): bucket=:error-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28]): potential sources added=[] removed=[] 2024-03-04T12:36:49.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.307+0000 7fda9663d800 20 handle_bi_update(): bucket=:error-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28]): orig_dests= new_dests= 2024-03-04T12:36:49.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.307+0000 7fda9663d800 20 handle_bi_update(): bucket=:error-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28]): potential dests added=[] removed=[] 2024-03-04T12:36:49.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.307+0000 7fda9663d800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-03-04T12:36:49.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.309+0000 7fd94afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:49.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.312+0000 7fda9663d800 20 remove_watcher() i=0 2024-03-04T12:36:49.318 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.312+0000 7fda9663d800 2 removed watcher, disabling cache 2024-03-04T12:36:49.319 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.313+0000 7fda9663d800 20 remove_watcher() i=1 2024-03-04T12:36:49.320 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.314+0000 7fda9663d800 20 remove_watcher() i=2 2024-03-04T12:36:49.321 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.315+0000 7fda9663d800 20 remove_watcher() i=3 2024-03-04T12:36:49.322 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.316+0000 7fda9663d800 20 remove_watcher() i=4 2024-03-04T12:36:49.323 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.317+0000 7fda9663d800 20 remove_watcher() i=5 2024-03-04T12:36:49.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.318+0000 7fda9663d800 20 remove_watcher() i=6 2024-03-04T12:36:49.325 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.319+0000 7fda9663d800 20 remove_watcher() i=7 2024-03-04T12:36:49.336 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-03-04T12:36:49.363 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:49.363 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:49.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.390+0000 7fbcaa124800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.391+0000 7fbcaa124800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.391+0000 7fbcaa124800 20 realm 2024-03-04T12:36:49.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.391+0000 7fbcaa124800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.391+0000 7fbcaa124800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.391+0000 7fbcaa124800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:49.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.391+0000 7fbcaa124800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.392+0000 7fbcaa124800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.392+0000 7fbcaa124800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.392+0000 7fbcaa124800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:49.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.392+0000 7fbcaa124800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.393+0000 7fbcaa124800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:49.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.393+0000 7fbcaa124800 20 searching for the correct realm 2024-03-04T12:36:49.402 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.396+0000 7fbca66b5640 0 -- 172.21.15.110:0/958724540 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7fbc9c037410 msgr2=0x7fbc9c037870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:49.405 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.399+0000 7fbca5eb4640 0 -- 172.21.15.110:0/958724540 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fbc9c0273f0 msgr2=0x7fbc9c027870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:49.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.605+0000 7fbcaa124800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:49.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.605+0000 7fbcaa124800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:49.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.605+0000 7fbcaa124800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:49.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.605+0000 7fbcaa124800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:49.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.605+0000 7fbcaa124800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:49.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.605+0000 7fbcaa124800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:49.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.605+0000 7fbcaa124800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.605+0000 7fbcaa124800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.605+0000 7fbcaa124800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.606+0000 7fbcaa124800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:49.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.606+0000 7fbcaa124800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.606+0000 7fbcaa124800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:49.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.606+0000 7fbcaa124800 20 zone default found 2024-03-04T12:36:49.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.606+0000 7fbcaa124800 4 Realm: () 2024-03-04T12:36:49.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.606+0000 7fbcaa124800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:49.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.606+0000 7fbcaa124800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:49.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.606+0000 7fbcaa124800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:49.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.606+0000 7fbcaa124800 20 zonegroup default 2024-03-04T12:36:49.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.606+0000 7fbcaa124800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.606+0000 7fbcaa124800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.606+0000 7fbcaa124800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.607+0000 7fbcaa124800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.607+0000 7fbcaa124800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.607+0000 7fbcaa124800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.607+0000 7fbcaa124800 20 started sync module instance, tier type = 2024-03-04T12:36:49.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.607+0000 7fbcaa124800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:49.623 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.617+0000 7fbcaa124800 20 add_watcher() i=0 2024-03-04T12:36:49.623 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.617+0000 7fbcaa124800 20 add_watcher() i=1 2024-03-04T12:36:49.623 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.617+0000 7fbcaa124800 20 add_watcher() i=2 2024-03-04T12:36:49.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.617+0000 7fbcaa124800 20 add_watcher() i=3 2024-03-04T12:36:49.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.617+0000 7fbcaa124800 20 add_watcher() i=4 2024-03-04T12:36:49.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.617+0000 7fbcaa124800 20 add_watcher() i=5 2024-03-04T12:36:49.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.618+0000 7fbcaa124800 20 add_watcher() i=6 2024-03-04T12:36:49.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.618+0000 7fbcaa124800 20 add_watcher() i=7 2024-03-04T12:36:49.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.618+0000 7fbcaa124800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:49.626 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.620+0000 7fbb577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:49.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.620+0000 7fbcaa124800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:49.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.620+0000 7fbcaa124800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:49.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.620+0000 7fbcaa124800 5 note: GC not initialized 2024-03-04T12:36:49.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.620+0000 7fbb567fc640 20 reqs_thread_entry: start 2024-03-04T12:36:49.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.621+0000 7fbcaa124800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:49.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.621+0000 7fbcaa124800 20 Filter name: none 2024-03-04T12:36:49.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.621+0000 7fbac7fff640 20 reqs_thread_entry: start 2024-03-04T12:36:49.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.621+0000 7fbcaa124800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.628 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.621+0000 7fbcaa124800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:36:49.628 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.621+0000 7fbcaa124800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.628 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.622+0000 7fbcaa124800 20 rados_obj.operate() r=0 bl.length=383 2024-03-04T12:36:49.628 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.622+0000 7fbcaa124800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:49.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.622+0000 7fbcaa124800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.622+0000 7fbcaa124800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:36:49.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.622+0000 7fbcaa124800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.623+0000 7fbcaa124800 20 rados_obj.operate() r=0 bl.length=383 2024-03-04T12:36:49.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.623+0000 7fbcaa124800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:49.630 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.624+0000 7fbcaa124800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.630 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.624+0000 7fbcaa124800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.631 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.625+0000 7fbb577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:49.633 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.627+0000 7fbcaa124800 20 remove_watcher() i=0 2024-03-04T12:36:49.634 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.627+0000 7fbcaa124800 2 removed watcher, disabling cache 2024-03-04T12:36:49.635 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.629+0000 7fbcaa124800 20 remove_watcher() i=1 2024-03-04T12:36:49.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.630+0000 7fbcaa124800 20 remove_watcher() i=2 2024-03-04T12:36:49.637 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.631+0000 7fbcaa124800 20 remove_watcher() i=3 2024-03-04T12:36:49.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.632+0000 7fbcaa124800 20 remove_watcher() i=4 2024-03-04T12:36:49.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.633+0000 7fbcaa124800 20 remove_watcher() i=5 2024-03-04T12:36:49.640 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.634+0000 7fbcaa124800 20 remove_watcher() i=6 2024-03-04T12:36:49.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.635+0000 7fbcaa124800 20 remove_watcher() i=7 2024-03-04T12:36:49.650 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:49.650 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:36:49.650 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: error-at-do-reshard id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:36:49.651 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:49.652 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:49.652 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:49.678 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:49.678 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:49.733 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:36:49.762 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:49.762 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:49.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.790+0000 7fde2053c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.797 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.791+0000 7fde2053c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.797 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.791+0000 7fde2053c800 20 realm 2024-03-04T12:36:49.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.791+0000 7fde2053c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.791+0000 7fde2053c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.791+0000 7fde2053c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:49.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.791+0000 7fde2053c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.791+0000 7fde2053c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:49.798 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.791+0000 7fde2053c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.792+0000 7fde2053c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:49.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.792+0000 7fde2053c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:49.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.793+0000 7fde2053c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:49.799 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.793+0000 7fde2053c800 20 searching for the correct realm 2024-03-04T12:36:49.802 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.796+0000 7fde1cafb640 0 -- 172.21.15.110:0/1952050310 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7fde04018040 msgr2=0x7fde04062de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:49.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:49.799+0000 7fde1c2fa640 0 -- 172.21.15.110:0/1952050310 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fde04064180 msgr2=0x7fde040648b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:50.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.005+0000 7fde2053c800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:50.012 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.006+0000 7fde2053c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:50.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.006+0000 7fde2053c800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:50.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.006+0000 7fde2053c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:50.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.006+0000 7fde2053c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:50.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.006+0000 7fde2053c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:50.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.006+0000 7fde2053c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.006+0000 7fde2053c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:50.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.006+0000 7fde2053c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.006+0000 7fde2053c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:50.013 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.006+0000 7fde2053c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.007+0000 7fde2053c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:50.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.007+0000 7fde2053c800 20 zone default found 2024-03-04T12:36:50.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.007+0000 7fde2053c800 4 Realm: () 2024-03-04T12:36:50.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.007+0000 7fde2053c800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:50.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.007+0000 7fde2053c800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:50.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.007+0000 7fde2053c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:50.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.007+0000 7fde2053c800 20 zonegroup default 2024-03-04T12:36:50.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.007+0000 7fde2053c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.007+0000 7fde2053c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:50.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.007+0000 7fde2053c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.007+0000 7fde2053c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:50.015 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.007+0000 7fde2053c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.016 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.008+0000 7fde2053c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:50.016 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.008+0000 7fde2053c800 20 started sync module instance, tier type = 2024-03-04T12:36:50.016 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.008+0000 7fde2053c800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:50.024 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.017+0000 7fde2053c800 20 add_watcher() i=0 2024-03-04T12:36:50.024 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.017+0000 7fde2053c800 20 add_watcher() i=1 2024-03-04T12:36:50.024 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.017+0000 7fde2053c800 20 add_watcher() i=2 2024-03-04T12:36:50.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.017+0000 7fde2053c800 20 add_watcher() i=3 2024-03-04T12:36:50.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.017+0000 7fde2053c800 20 add_watcher() i=4 2024-03-04T12:36:50.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.017+0000 7fde2053c800 20 add_watcher() i=5 2024-03-04T12:36:50.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.017+0000 7fde2053c800 20 add_watcher() i=6 2024-03-04T12:36:50.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.017+0000 7fde2053c800 20 add_watcher() i=7 2024-03-04T12:36:50.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.017+0000 7fde2053c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:50.025 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.019+0000 7fdcd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:50.026 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.020+0000 7fde2053c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:50.026 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.020+0000 7fde2053c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:50.026 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.020+0000 7fde2053c800 5 note: GC not initialized 2024-03-04T12:36:50.027 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.020+0000 7fdcd1fdb640 20 reqs_thread_entry: start 2024-03-04T12:36:50.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.020+0000 7fde2053c800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:50.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.020+0000 7fde2053c800 20 Filter name: none 2024-03-04T12:36:50.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.020+0000 7fdc437fe640 20 reqs_thread_entry: start 2024-03-04T12:36:50.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.020+0000 7fde2053c800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-03-04T12:36:50.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.020+0000 7fde2053c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.021+0000 7fde2053c800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:36:50.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.021+0000 7fde2053c800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-03-04T12:36:50.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.021+0000 7fde2053c800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-03-04T12:36:50.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.021+0000 7fde2053c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 : miss 2024-03-04T12:36:50.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.021+0000 7fde2053c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.021+0000 7fde2053c800 20 rados_obj.operate() r=0 bl.length=383 2024-03-04T12:36:50.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.021+0000 7fde2053c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 info.flags=0x17 2024-03-04T12:36:50.028 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.021+0000 7fde2053c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 to cache LRU end 2024-03-04T12:36:50.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.021+0000 7fde2053c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:36:50.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.021+0000 7fde2053c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:50.029 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.021+0000 7fde2053c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 2024-03-04T12:36:50.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.028+0000 7fde2053c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 info.flags=0x17 2024-03-04T12:36:50.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.028+0000 7fde2053c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 to cache LRU end 2024-03-04T12:36:50.034 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.028+0000 7fde2053c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:50.035 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.028+0000 7fde2053c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28, ofs0, ns] 2024-03-04T12:36:50.035 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.029+0000 7fdcf37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824110 cookie 93934021360160 notifier 6942 bl.length()=945 2024-03-04T12:36:50.035 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.029+0000 7fdcf37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 info.flags=0x17 2024-03-04T12:36:50.035 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.029+0000 7fdcf37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 to cache LRU end 2024-03-04T12:36:50.035 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.029+0000 7fdcf37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:50.036 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.030+0000 7fde2053c800 20 handle_bi_update(): bucket=:error-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28]): orig_sources= new_sources= 2024-03-04T12:36:50.036 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.030+0000 7fde2053c800 20 handle_bi_update(): bucket=:error-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28]): potential sources added=[] removed=[] 2024-03-04T12:36:50.036 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.030+0000 7fde2053c800 20 handle_bi_update(): bucket=:error-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28]): orig_dests= new_dests= 2024-03-04T12:36:50.036 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.030+0000 7fde2053c800 20 handle_bi_update(): bucket=:error-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28]): potential dests added=[] removed=[] 2024-03-04T12:36:50.039 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.0 2024-03-04T12:36:50.039 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.0 2024-03-04T12:36:50.039 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.1 2024-03-04T12:36:50.039 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.1 2024-03-04T12:36:50.039 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.2 2024-03-04T12:36:50.039 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.2 2024-03-04T12:36:50.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.3 2024-03-04T12:36:50.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.3 2024-03-04T12:36:50.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.4 2024-03-04T12:36:50.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.4 2024-03-04T12:36:50.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.5 2024-03-04T12:36:50.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.5 2024-03-04T12:36:50.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.6 2024-03-04T12:36:50.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.6 2024-03-04T12:36:50.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.7 2024-03-04T12:36:50.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.7 2024-03-04T12:36:50.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.8 2024-03-04T12:36:50.040 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.8 2024-03-04T12:36:50.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.9 2024-03-04T12:36:50.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.9 2024-03-04T12:36:50.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.10 2024-03-04T12:36:50.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.10 2024-03-04T12:36:50.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.11 2024-03-04T12:36:50.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1.11 2024-03-04T12:36:50.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.0 2024-03-04T12:36:50.041 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.033+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.1 2024-03-04T12:36:50.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.034+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.2 2024-03-04T12:36:50.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.034+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.3 2024-03-04T12:36:50.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.035+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.4 2024-03-04T12:36:50.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.035+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.5 2024-03-04T12:36:50.042 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.036+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.6 2024-03-04T12:36:50.043 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.036+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.7 2024-03-04T12:36:50.043 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.037+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.8 2024-03-04T12:36:50.043 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.037+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.9 2024-03-04T12:36:50.044 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.037+0000 7fde2053c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28.10 2024-03-04T12:36:50.048 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.042+0000 7fde2053c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 : hit (requested=0x17, cached=0x17) 2024-03-04T12:36:50.048 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.042+0000 7fde2053c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 2024-03-04T12:36:50.050 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.044+0000 7fde2053c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 info.flags=0x17 2024-03-04T12:36:50.050 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.044+0000 7fde2053c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 to cache LRU end 2024-03-04T12:36:50.050 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.044+0000 7fde2053c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:50.050 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.044+0000 7fde2053c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28, ofs0, ns] 2024-03-04T12:36:50.050 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.044+0000 7fdcf37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824111 cookie 93934021360160 notifier 6942 bl.length()=913 2024-03-04T12:36:50.050 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.044+0000 7fdcf37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 info.flags=0x17 2024-03-04T12:36:50.050 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.044+0000 7fdcf37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 to cache LRU end 2024-03-04T12:36:50.050 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.044+0000 7fdcf37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:50.052 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.045+0000 7fde2053c800 20 handle_bi_update(): bucket=:error-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28]): orig_sources= new_sources= 2024-03-04T12:36:50.052 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.045+0000 7fde2053c800 20 handle_bi_update(): bucket=:error-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28]): potential sources added=[] removed=[] 2024-03-04T12:36:50.052 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.045+0000 7fde2053c800 20 handle_bi_update(): bucket=:error-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28]): orig_dests= new_dests= 2024-03-04T12:36:50.052 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.045+0000 7fde2053c800 20 handle_bi_update(): bucket=:error-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28]): potential dests added=[] removed=[] 2024-03-04T12:36:50.054 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.047+0000 7fde2053c800 1 execute INFO: reshard of bucket "error-at-do-reshard" completed successfully 2024-03-04T12:36:50.055 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.049+0000 7fdcd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:50.057 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.051+0000 7fde2053c800 20 remove_watcher() i=0 2024-03-04T12:36:50.058 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.051+0000 7fde2053c800 2 removed watcher, disabling cache 2024-03-04T12:36:50.059 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.053+0000 7fde2053c800 20 remove_watcher() i=1 2024-03-04T12:36:50.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.054+0000 7fde2053c800 20 remove_watcher() i=2 2024-03-04T12:36:50.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.055+0000 7fde2053c800 20 remove_watcher() i=3 2024-03-04T12:36:50.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.056+0000 7fde2053c800 20 remove_watcher() i=4 2024-03-04T12:36:50.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.056+0000 7fde2053c800 20 remove_watcher() i=5 2024-03-04T12:36:50.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.057+0000 7fde2053c800 20 remove_watcher() i=6 2024-03-04T12:36:50.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.058+0000 7fde2053c800 20 remove_watcher() i=7 2024-03-04T12:36:50.075 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-03-04T12:36:50.102 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:50.103 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:50.135 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.129+0000 7fabc8a44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.131+0000 7fabc8a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:50.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.131+0000 7fabc8a44800 20 realm 2024-03-04T12:36:50.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.131+0000 7fabc8a44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.131+0000 7fabc8a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:50.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.131+0000 7fabc8a44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:50.137 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.131+0000 7fabc8a44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.131+0000 7fabc8a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:50.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.131+0000 7fabc8a44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.132+0000 7fabc8a44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:50.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.132+0000 7fabc8a44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.132+0000 7fabc8a44800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:50.138 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.132+0000 7fabc8a44800 20 searching for the correct realm 2024-03-04T12:36:50.142 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.136+0000 7fabbffff640 0 -- 172.21.15.110:0/2200143375 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x55ecfe563950 msgr2=0x55ecfe565da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:50.145 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.139+0000 7fabc6540640 0 -- 172.21.15.110:0/2200143375 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fabb0067b60 msgr2=0x7fabb005df50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:50.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.144+0000 7fabc8a44800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:50.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.144+0000 7fabc8a44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:50.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.144+0000 7fabc8a44800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:50.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.144+0000 7fabc8a44800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:50.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.144+0000 7fabc8a44800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:50.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.144+0000 7fabc8a44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:50.150 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.144+0000 7fabc8a44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.144+0000 7fabc8a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:50.151 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.144+0000 7fabc8a44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.144+0000 7fabc8a44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:50.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.144+0000 7fabc8a44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.145+0000 7fabc8a44800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:50.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.145+0000 7fabc8a44800 20 zone default found 2024-03-04T12:36:50.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.145+0000 7fabc8a44800 4 Realm: () 2024-03-04T12:36:50.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.145+0000 7fabc8a44800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:50.152 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.145+0000 7fabc8a44800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:50.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.145+0000 7fabc8a44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:50.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.145+0000 7fabc8a44800 20 zonegroup default 2024-03-04T12:36:50.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.145+0000 7fabc8a44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.145+0000 7fabc8a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:50.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.145+0000 7fabc8a44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.145+0000 7fabc8a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:50.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.145+0000 7fabc8a44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.146+0000 7fabc8a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:50.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.146+0000 7fabc8a44800 20 started sync module instance, tier type = 2024-03-04T12:36:50.153 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.146+0000 7fabc8a44800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:50.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.154+0000 7fabc8a44800 20 add_watcher() i=0 2024-03-04T12:36:50.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.154+0000 7fabc8a44800 20 add_watcher() i=1 2024-03-04T12:36:50.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.154+0000 7fabc8a44800 20 add_watcher() i=2 2024-03-04T12:36:50.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.154+0000 7fabc8a44800 20 add_watcher() i=3 2024-03-04T12:36:50.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.154+0000 7fabc8a44800 20 add_watcher() i=4 2024-03-04T12:36:50.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.154+0000 7fabc8a44800 20 add_watcher() i=5 2024-03-04T12:36:50.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.154+0000 7fabc8a44800 20 add_watcher() i=6 2024-03-04T12:36:50.161 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.155+0000 7fabc8a44800 20 add_watcher() i=7 2024-03-04T12:36:50.162 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.155+0000 7fabc8a44800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:50.163 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.157+0000 7faa7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:50.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.157+0000 7fabc8a44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:50.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.157+0000 7fabc8a44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:50.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.157+0000 7fabc8a44800 5 note: GC not initialized 2024-03-04T12:36:50.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.157+0000 7fa9f77fe640 20 reqs_thread_entry: start 2024-03-04T12:36:50.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.157+0000 7fabc8a44800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:50.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.157+0000 7fabc8a44800 20 Filter name: none 2024-03-04T12:36:50.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.157+0000 7fa9f57fa640 20 reqs_thread_entry: start 2024-03-04T12:36:50.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.157+0000 7fabc8a44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.158+0000 7fabc8a44800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:36:50.164 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.158+0000 7fabc8a44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.158+0000 7fabc8a44800 20 rados_obj.operate() r=0 bl.length=383 2024-03-04T12:36:50.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.159+0000 7fabc8a44800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:50.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.159+0000 7fabc8a44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.165 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.159+0000 7fabc8a44800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:36:50.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.159+0000 7fabc8a44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.159+0000 7fabc8a44800 20 rados_obj.operate() r=0 bl.length=383 2024-03-04T12:36:50.166 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.159+0000 7fabc8a44800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:50.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.160+0000 7fabc8a44800 20 rados->read ofs=0 len=0 2024-03-04T12:36:50.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.160+0000 7fabc8a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:50.167 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.161+0000 7faa7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:50.169 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.163+0000 7fabc8a44800 20 remove_watcher() i=0 2024-03-04T12:36:50.169 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.163+0000 7fabc8a44800 2 removed watcher, disabling cache 2024-03-04T12:36:50.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.164+0000 7fabc8a44800 20 remove_watcher() i=1 2024-03-04T12:36:50.172 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.166+0000 7fabc8a44800 20 remove_watcher() i=2 2024-03-04T12:36:50.172 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.167+0000 7fabc8a44800 20 remove_watcher() i=3 2024-03-04T12:36:50.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.168+0000 7fabc8a44800 20 remove_watcher() i=4 2024-03-04T12:36:50.174 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.168+0000 7fabc8a44800 20 remove_watcher() i=5 2024-03-04T12:36:50.175 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.169+0000 7fabc8a44800 20 remove_watcher() i=6 2024-03-04T12:36:50.176 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:50.170+0000 7fabc8a44800 20 remove_watcher() i=7 2024-03-04T12:36:50.186 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:50.186 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:36:50.186 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: error-at-do-reshard id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-04T12:36:50.186 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:50.188 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.188 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.205 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.205 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.359 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.359 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.483 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: reshard bucket with abort at do_reshard 2024-03-04T12:36:50.484 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:50.484 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.485 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.531 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.531 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.585 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.585 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.614 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.614 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.643 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.643 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.672 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.672 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.699 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.700 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.727 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.728 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.755 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.755 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.783 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.783 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.811 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.811 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.839 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.840 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.869 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.869 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.897 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.897 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.925 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.925 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.953 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.953 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:50.983 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:50.983 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:51.011 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:51.011 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:51.040 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:51.040 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:51.069 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:51.070 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:51.097 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:51.097 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:51.126 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:51.126 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:36:51.155 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-03-04T12:36:51.182 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:51.182 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:51.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.208+0000 7f8a3de24800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.210+0000 7f8a3de24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.210+0000 7f8a3de24800 20 realm 2024-03-04T12:36:51.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.210+0000 7f8a3de24800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.210+0000 7f8a3de24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.210+0000 7f8a3de24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:51.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.210+0000 7f8a3de24800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.210+0000 7f8a3de24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.210+0000 7f8a3de24800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.211+0000 7f8a3de24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:51.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.211+0000 7f8a3de24800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.211+0000 7f8a3de24800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:51.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.211+0000 7f8a3de24800 20 searching for the correct realm 2024-03-04T12:36:51.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.214+0000 7f8a3c128640 0 -- 172.21.15.110:0/2453142 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f8a2408e060 msgr2=0x7f8a240c2770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:51.224 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.218+0000 7f8a3b927640 0 -- 172.21.15.110:0/2453142 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f8a2408e6a0 msgr2=0x7f8a2408f6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:51.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.424+0000 7f8a3de24800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:51.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.424+0000 7f8a3de24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:51.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.424+0000 7f8a3de24800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:51.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.424+0000 7f8a3de24800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:51.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.424+0000 7f8a3de24800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:51.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.424+0000 7f8a3de24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:51.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.424+0000 7f8a3de24800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.424+0000 7f8a3de24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.431 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.424+0000 7f8a3de24800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.432 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.425+0000 7f8a3de24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:51.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.425+0000 7f8a3de24800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.425+0000 7f8a3de24800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:51.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.425+0000 7f8a3de24800 20 zone default found 2024-03-04T12:36:51.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.425+0000 7f8a3de24800 4 Realm: () 2024-03-04T12:36:51.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.425+0000 7f8a3de24800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:51.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.425+0000 7f8a3de24800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:51.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.425+0000 7f8a3de24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:51.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.425+0000 7f8a3de24800 20 zonegroup default 2024-03-04T12:36:51.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.425+0000 7f8a3de24800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.425+0000 7f8a3de24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.425+0000 7f8a3de24800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.426+0000 7f8a3de24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.433 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.426+0000 7f8a3de24800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.426+0000 7f8a3de24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.426+0000 7f8a3de24800 20 started sync module instance, tier type = 2024-03-04T12:36:51.434 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.426+0000 7f8a3de24800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:51.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.435+0000 7f8a3de24800 20 add_watcher() i=0 2024-03-04T12:36:51.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.435+0000 7f8a3de24800 20 add_watcher() i=1 2024-03-04T12:36:51.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.435+0000 7f8a3de24800 20 add_watcher() i=2 2024-03-04T12:36:51.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.435+0000 7f8a3de24800 20 add_watcher() i=3 2024-03-04T12:36:51.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.435+0000 7f8a3de24800 20 add_watcher() i=4 2024-03-04T12:36:51.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.435+0000 7f8a3de24800 20 add_watcher() i=5 2024-03-04T12:36:51.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.435+0000 7f8a3de24800 20 add_watcher() i=6 2024-03-04T12:36:51.442 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.436+0000 7f8a3de24800 20 add_watcher() i=7 2024-03-04T12:36:51.443 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.436+0000 7f8a3de24800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:51.444 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.438+0000 7f88f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:51.445 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.439+0000 7f8a3de24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:51.446 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.439+0000 7f8a3de24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:51.446 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.439+0000 7f8a3de24800 5 note: GC not initialized 2024-03-04T12:36:51.446 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.439+0000 7f88f0fe1640 20 reqs_thread_entry: start 2024-03-04T12:36:51.446 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.439+0000 7f8a3de24800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:51.446 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.439+0000 7f8a3de24800 20 Filter name: none 2024-03-04T12:36:51.446 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.439+0000 7f886a7fc640 20 reqs_thread_entry: start 2024-03-04T12:36:51.446 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.439+0000 7f8a3de24800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.440+0000 7f8a3de24800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:36:51.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.440+0000 7f8a3de24800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.440+0000 7f8a3de24800 20 rados_obj.operate() r=0 bl.length=383 2024-03-04T12:36:51.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.440+0000 7f8a3de24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:51.447 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.440+0000 7f8a3de24800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.448 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.441+0000 7f8a3de24800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:36:51.448 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.441+0000 7f8a3de24800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.448 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.441+0000 7f8a3de24800 20 rados_obj.operate() r=0 bl.length=383 2024-03-04T12:36:51.448 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.441+0000 7f8a3de24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:51.449 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.442+0000 7f8a3de24800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.449 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.443+0000 7f8a3de24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.449 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.443+0000 7f88f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:51.451 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.445+0000 7f8a3de24800 20 remove_watcher() i=0 2024-03-04T12:36:51.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.445+0000 7f8a3de24800 2 removed watcher, disabling cache 2024-03-04T12:36:51.452 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.446+0000 7f8a3de24800 20 remove_watcher() i=1 2024-03-04T12:36:51.453 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.447+0000 7f8a3de24800 20 remove_watcher() i=2 2024-03-04T12:36:51.454 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.448+0000 7f8a3de24800 20 remove_watcher() i=3 2024-03-04T12:36:51.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.449+0000 7f8a3de24800 20 remove_watcher() i=4 2024-03-04T12:36:51.460 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.450+0000 7f8a3de24800 20 remove_watcher() i=5 2024-03-04T12:36:51.460 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.451+0000 7f8a3de24800 20 remove_watcher() i=6 2024-03-04T12:36:51.460 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.452+0000 7f8a3de24800 20 remove_watcher() i=7 2024-03-04T12:36:51.467 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.468 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:36:51.468 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: abort-at-do-reshard id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:36:51.468 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.469 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-03-04T12:36:51.502 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:51.502 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:51.534 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.528+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.529+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.529+0000 7f107068c800 20 realm 2024-03-04T12:36:51.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.529+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.530+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.530+0000 7f107068c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:51.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.530+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.530+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.536 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.530+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.537 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.531+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:51.537 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.531+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.537 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.531+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:51.537 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.531+0000 7f107068c800 20 searching for the correct realm 2024-03-04T12:36:51.540 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.534+0000 7f106e989640 0 -- 172.21.15.110:0/2908460802 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f1058026070 msgr2=0x7f105808bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:51.543 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.537+0000 7f106e188640 0 -- 172.21.15.110:0/2908460802 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f10580834d0 msgr2=0x7f1058084790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:36:51.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:51.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:51.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:51.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:51.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:51.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:51.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.743+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.743+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.743+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.744+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:51.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.744+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.744+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:51.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.744+0000 7f107068c800 20 zone default found 2024-03-04T12:36:51.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.744+0000 7f107068c800 4 Realm: () 2024-03-04T12:36:51.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.744+0000 7f107068c800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:51.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.744+0000 7f107068c800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:51.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.744+0000 7f107068c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:51.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.744+0000 7f107068c800 20 zonegroup default 2024-03-04T12:36:51.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.744+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.744+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.744+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.745+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.745+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.745+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.745+0000 7f107068c800 20 started sync module instance, tier type = 2024-03-04T12:36:51.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.745+0000 7f107068c800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:51.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=0 2024-03-04T12:36:51.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=1 2024-03-04T12:36:51.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=2 2024-03-04T12:36:51.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=3 2024-03-04T12:36:51.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=4 2024-03-04T12:36:51.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=5 2024-03-04T12:36:51.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=6 2024-03-04T12:36:51.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.754+0000 7f107068c800 20 add_watcher() i=7 2024-03-04T12:36:51.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.754+0000 7f107068c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:51.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.756+0000 7f0f24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:51.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.756+0000 7f107068c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:51.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.756+0000 7f107068c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:51.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.756+0000 7f107068c800 5 note: GC not initialized 2024-03-04T12:36:51.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.756+0000 7f0e9f7fe640 20 reqs_thread_entry: start 2024-03-04T12:36:51.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.756+0000 7f107068c800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:51.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.757+0000 7f107068c800 20 Filter name: none 2024-03-04T12:36:51.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.757+0000 7f0e9d7fa640 20 reqs_thread_entry: start 2024-03-04T12:36:51.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.757+0000 7f107068c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-04T12:36:51.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.757+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.764 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.757+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:36:51.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.757+0000 7f107068c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-04T12:36:51.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.757+0000 7f107068c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-04T12:36:51.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.757+0000 7f107068c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 : miss 2024-03-04T12:36:51.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.757+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.757+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=383 2024-03-04T12:36:51.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.757+0000 7f107068c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 info.flags=0x17 2024-03-04T12:36:51.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.757+0000 7f107068c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 to cache LRU end 2024-03-04T12:36:51.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.757+0000 7f107068c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:36:51.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.757+0000 7f107068c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:51.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.757+0000 7f107068c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 2024-03-04T12:36:51.768 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.762+0000 7f107068c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 info.flags=0x17 2024-03-04T12:36:51.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.762+0000 7f107068c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 to cache LRU end 2024-03-04T12:36:51.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.762+0000 7f107068c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:51.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.762+0000 7f107068c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29, ofs0, ns] 2024-03-04T12:36:51.769 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.762+0000 7f0f517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824005 cookie 94397373732944 notifier 6569 bl.length()=945 2024-03-04T12:36:51.770 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.763+0000 7f0f517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 info.flags=0x17 2024-03-04T12:36:51.770 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.763+0000 7f0f517fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 to cache LRU end 2024-03-04T12:36:51.770 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.763+0000 7f0f517fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:51.770 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.764+0000 7f107068c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): orig_sources= new_sources= 2024-03-04T12:36:51.770 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.764+0000 7f107068c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): potential sources added=[] removed=[] 2024-03-04T12:36:51.770 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.764+0000 7f107068c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): orig_dests= new_dests= 2024-03-04T12:36:51.770 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.764+0000 7f107068c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): potential dests added=[] removed=[] 2024-03-04T12:36:51.773 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f107068c800 time 2024-03-04T12:36:51.768303+0000 2024-03-04T12:36:51.773 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:36:51.774 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:36:51.774 INFO:tasks.workunit.client.0.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1073980e86] 2024-03-04T12:36:51.774 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1073981044] 2024-03-04T12:36:51.774 INFO:tasks.workunit.client.0.smithi110.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da9819ceb1] 2024-03-04T12:36:51.774 INFO:tasks.workunit.client.0.smithi110.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55da981b0de4] 2024-03-04T12:36:51.774 INFO:tasks.workunit.client.0.smithi110.stderr: 5: main() 2024-03-04T12:36:51.774 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f107283feb0] 2024-03-04T12:36:51.775 INFO:tasks.workunit.client.0.smithi110.stderr: 7: __libc_start_main() 2024-03-04T12:36:51.775 INFO:tasks.workunit.client.0.smithi110.stderr: 8: _start() 2024-03-04T12:36:51.775 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.768+0000 7f107068c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f107068c800 time 2024-03-04T12:36:51.768303+0000 2024-03-04T12:36:51.775 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:36:51.775 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.775 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:36:51.775 INFO:tasks.workunit.client.0.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1073980e86] 2024-03-04T12:36:51.775 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1073981044] 2024-03-04T12:36:51.775 INFO:tasks.workunit.client.0.smithi110.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da9819ceb1] 2024-03-04T12:36:51.775 INFO:tasks.workunit.client.0.smithi110.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55da981b0de4] 2024-03-04T12:36:51.775 INFO:tasks.workunit.client.0.smithi110.stderr: 5: main() 2024-03-04T12:36:51.775 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f107283feb0] 2024-03-04T12:36:51.776 INFO:tasks.workunit.client.0.smithi110.stderr: 7: __libc_start_main() 2024-03-04T12:36:51.776 INFO:tasks.workunit.client.0.smithi110.stderr: 8: _start() 2024-03-04T12:36:51.776 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.776 INFO:tasks.workunit.client.0.smithi110.stderr:*** Caught signal (Aborted) ** 2024-03-04T12:36:51.776 INFO:tasks.workunit.client.0.smithi110.stderr: in thread 7f107068c800 thread_name:radosgw-admin 2024-03-04T12:36:51.795 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:36:51.795 INFO:tasks.workunit.client.0.smithi110.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1072854db0] 2024-03-04T12:36:51.795 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f10728a154c] 2024-03-04T12:36:51.795 INFO:tasks.workunit.client.0.smithi110.stderr: 3: raise() 2024-03-04T12:36:51.795 INFO:tasks.workunit.client.0.smithi110.stderr: 4: abort() 2024-03-04T12:36:51.795 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1073980ee0] 2024-03-04T12:36:51.795 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1073981044] 2024-03-04T12:36:51.796 INFO:tasks.workunit.client.0.smithi110.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da9819ceb1] 2024-03-04T12:36:51.796 INFO:tasks.workunit.client.0.smithi110.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55da981b0de4] 2024-03-04T12:36:51.796 INFO:tasks.workunit.client.0.smithi110.stderr: 9: main() 2024-03-04T12:36:51.796 INFO:tasks.workunit.client.0.smithi110.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f107283feb0] 2024-03-04T12:36:51.796 INFO:tasks.workunit.client.0.smithi110.stderr: 11: __libc_start_main() 2024-03-04T12:36:51.796 INFO:tasks.workunit.client.0.smithi110.stderr: 12: _start() 2024-03-04T12:36:51.796 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.768+0000 7f107068c800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:36:51.796 INFO:tasks.workunit.client.0.smithi110.stderr: in thread 7f107068c800 thread_name:radosgw-admin 2024-03-04T12:36:51.796 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.796 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:36:51.796 INFO:tasks.workunit.client.0.smithi110.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1072854db0] 2024-03-04T12:36:51.796 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f10728a154c] 2024-03-04T12:36:51.796 INFO:tasks.workunit.client.0.smithi110.stderr: 3: raise() 2024-03-04T12:36:51.796 INFO:tasks.workunit.client.0.smithi110.stderr: 4: abort() 2024-03-04T12:36:51.797 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1073980ee0] 2024-03-04T12:36:51.797 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1073981044] 2024-03-04T12:36:51.797 INFO:tasks.workunit.client.0.smithi110.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da9819ceb1] 2024-03-04T12:36:51.797 INFO:tasks.workunit.client.0.smithi110.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55da981b0de4] 2024-03-04T12:36:51.797 INFO:tasks.workunit.client.0.smithi110.stderr: 9: main() 2024-03-04T12:36:51.797 INFO:tasks.workunit.client.0.smithi110.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f107283feb0] 2024-03-04T12:36:51.797 INFO:tasks.workunit.client.0.smithi110.stderr: 11: __libc_start_main() 2024-03-04T12:36:51.797 INFO:tasks.workunit.client.0.smithi110.stderr: 12: _start() 2024-03-04T12:36:51.797 INFO:tasks.workunit.client.0.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:36:51.797 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.797 INFO:tasks.workunit.client.0.smithi110.stderr:--- begin dump of recent events --- 2024-03-04T12:36:51.797 INFO:tasks.workunit.client.0.smithi110.stderr: -499> 2024-03-04T12:36:51.513+0000 7f0f5c608640 10 monclient: _finish_auth 0 2024-03-04T12:36:51.797 INFO:tasks.workunit.client.0.smithi110.stderr: -498> 2024-03-04T12:36:51.513+0000 7f0f5c608640 10 monclient: _check_auth_tickets 2024-03-04T12:36:51.797 INFO:tasks.workunit.client.0.smithi110.stderr: -497> 2024-03-04T12:36:51.513+0000 7f0f5c608640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:51.798 INFO:tasks.workunit.client.0.smithi110.stderr: -496> 2024-03-04T12:36:51.513+0000 7f0f5c608640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.798 INFO:tasks.workunit.client.0.smithi110.stderr: -495> 2024-03-04T12:36:51.513+0000 7f0f5c608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:36:51.798 INFO:tasks.workunit.client.0.smithi110.stderr: -494> 2024-03-04T12:36:51.513+0000 7f0f5c608640 10 monclient: dump: 2024-03-04T12:36:51.798 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.798 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.798 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.798 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.798 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.798 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.798 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.798 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.798 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.798 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.799 INFO:tasks.workunit.client.0.smithi110.stderr: -493> 2024-03-04T12:36:51.513+0000 7f107068c800 5 monclient: authenticate success, global_id 6557 2024-03-04T12:36:51.799 INFO:tasks.workunit.client.0.smithi110.stderr: -492> 2024-03-04T12:36:51.513+0000 7f107068c800 10 monclient: get_monmap_and_config success 2024-03-04T12:36:51.799 INFO:tasks.workunit.client.0.smithi110.stderr: -491> 2024-03-04T12:36:51.513+0000 7f107068c800 4 set_mon_vals no callback set 2024-03-04T12:36:51.799 INFO:tasks.workunit.client.0.smithi110.stderr: -490> 2024-03-04T12:36:51.514+0000 7f107068c800 10 monclient: shutdown 2024-03-04T12:36:51.799 INFO:tasks.workunit.client.0.smithi110.stderr: -489> 2024-03-04T12:36:51.514+0000 7f107068c800 5 asok(0x55da99bc00c0) unregister_commands rotate-key 2024-03-04T12:36:51.799 INFO:tasks.workunit.client.0.smithi110.stderr: -488> 2024-03-04T12:36:51.514+0000 7f107068c800 10 monclient: build_initial_monmap 2024-03-04T12:36:51.799 INFO:tasks.workunit.client.0.smithi110.stderr: -487> 2024-03-04T12:36:51.514+0000 7f107068c800 1 build_initial for_mkfs: 0 2024-03-04T12:36:51.799 INFO:tasks.workunit.client.0.smithi110.stderr: -486> 2024-03-04T12:36:51.514+0000 7f107068c800 10 monclient: monmap: 2024-03-04T12:36:51.799 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:36:51.799 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:36:51.799 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:36:51.799 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:36:51.799 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:36:51.799 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.800 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:36:51.800 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:36:51.800 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:36:51.800 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.800 INFO:tasks.workunit.client.0.smithi110.stderr: -485> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding auth protocol: cephx 2024-03-04T12:36:51.800 INFO:tasks.workunit.client.0.smithi110.stderr: -484> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding auth protocol: cephx 2024-03-04T12:36:51.800 INFO:tasks.workunit.client.0.smithi110.stderr: -483> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding auth protocol: cephx 2024-03-04T12:36:51.800 INFO:tasks.workunit.client.0.smithi110.stderr: -482> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: secure 2024-03-04T12:36:51.800 INFO:tasks.workunit.client.0.smithi110.stderr: -481> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: crc 2024-03-04T12:36:51.800 INFO:tasks.workunit.client.0.smithi110.stderr: -480> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: secure 2024-03-04T12:36:51.800 INFO:tasks.workunit.client.0.smithi110.stderr: -479> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: crc 2024-03-04T12:36:51.800 INFO:tasks.workunit.client.0.smithi110.stderr: -478> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: secure 2024-03-04T12:36:51.800 INFO:tasks.workunit.client.0.smithi110.stderr: -477> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: crc 2024-03-04T12:36:51.800 INFO:tasks.workunit.client.0.smithi110.stderr: -476> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: crc 2024-03-04T12:36:51.801 INFO:tasks.workunit.client.0.smithi110.stderr: -475> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: secure 2024-03-04T12:36:51.801 INFO:tasks.workunit.client.0.smithi110.stderr: -474> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: crc 2024-03-04T12:36:51.801 INFO:tasks.workunit.client.0.smithi110.stderr: -473> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: secure 2024-03-04T12:36:51.801 INFO:tasks.workunit.client.0.smithi110.stderr: -472> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: crc 2024-03-04T12:36:51.801 INFO:tasks.workunit.client.0.smithi110.stderr: -471> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: secure 2024-03-04T12:36:51.801 INFO:tasks.workunit.client.0.smithi110.stderr: -470> 2024-03-04T12:36:51.514+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.801 INFO:tasks.workunit.client.0.smithi110.stderr: -469> 2024-03-04T12:36:51.514+0000 7f107068c800 1 librados: starting msgr at 2024-03-04T12:36:51.801 INFO:tasks.workunit.client.0.smithi110.stderr: -468> 2024-03-04T12:36:51.514+0000 7f107068c800 1 librados: starting objecter 2024-03-04T12:36:51.801 INFO:tasks.workunit.client.0.smithi110.stderr: -467> 2024-03-04T12:36:51.514+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command objecter_requests hook 0x55da99e093f0 2024-03-04T12:36:51.801 INFO:tasks.workunit.client.0.smithi110.stderr: -466> 2024-03-04T12:36:51.514+0000 7f107068c800 1 librados: setting wanted keys 2024-03-04T12:36:51.801 INFO:tasks.workunit.client.0.smithi110.stderr: -465> 2024-03-04T12:36:51.514+0000 7f107068c800 1 librados: calling monclient init 2024-03-04T12:36:51.801 INFO:tasks.workunit.client.0.smithi110.stderr: -464> 2024-03-04T12:36:51.514+0000 7f107068c800 10 monclient: init 2024-03-04T12:36:51.801 INFO:tasks.workunit.client.0.smithi110.stderr: -463> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding auth protocol: cephx 2024-03-04T12:36:51.801 INFO:tasks.workunit.client.0.smithi110.stderr: -462> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding auth protocol: cephx 2024-03-04T12:36:51.802 INFO:tasks.workunit.client.0.smithi110.stderr: -461> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding auth protocol: cephx 2024-03-04T12:36:51.802 INFO:tasks.workunit.client.0.smithi110.stderr: -460> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: secure 2024-03-04T12:36:51.802 INFO:tasks.workunit.client.0.smithi110.stderr: -459> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: crc 2024-03-04T12:36:51.802 INFO:tasks.workunit.client.0.smithi110.stderr: -458> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: secure 2024-03-04T12:36:51.802 INFO:tasks.workunit.client.0.smithi110.stderr: -457> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: crc 2024-03-04T12:36:51.802 INFO:tasks.workunit.client.0.smithi110.stderr: -456> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: secure 2024-03-04T12:36:51.802 INFO:tasks.workunit.client.0.smithi110.stderr: -455> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: crc 2024-03-04T12:36:51.802 INFO:tasks.workunit.client.0.smithi110.stderr: -454> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: crc 2024-03-04T12:36:51.802 INFO:tasks.workunit.client.0.smithi110.stderr: -453> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: secure 2024-03-04T12:36:51.802 INFO:tasks.workunit.client.0.smithi110.stderr: -452> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: crc 2024-03-04T12:36:51.802 INFO:tasks.workunit.client.0.smithi110.stderr: -451> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: secure 2024-03-04T12:36:51.802 INFO:tasks.workunit.client.0.smithi110.stderr: -450> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: crc 2024-03-04T12:36:51.802 INFO:tasks.workunit.client.0.smithi110.stderr: -449> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: secure 2024-03-04T12:36:51.802 INFO:tasks.workunit.client.0.smithi110.stderr: -448> 2024-03-04T12:36:51.514+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.803 INFO:tasks.workunit.client.0.smithi110.stderr: -447> 2024-03-04T12:36:51.515+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.803 INFO:tasks.workunit.client.0.smithi110.stderr: -446> 2024-03-04T12:36:51.515+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command rotate-key hook 0x55da99dddcf8 2024-03-04T12:36:51.803 INFO:tasks.workunit.client.0.smithi110.stderr: -445> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient: _reopen_session rank -1 2024-03-04T12:36:51.803 INFO:tasks.workunit.client.0.smithi110.stderr: -444> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:36:51.803 INFO:tasks.workunit.client.0.smithi110.stderr: -443> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient(hunting): picked mon.noname-b con 0x55da99c66b40 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:36:51.803 INFO:tasks.workunit.client.0.smithi110.stderr: -442> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient(hunting): picked mon.noname-c con 0x55da99c8ad20 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:36:51.803 INFO:tasks.workunit.client.0.smithi110.stderr: -441> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient(hunting): picked mon.noname-a con 0x55da99de41c0 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:36:51.803 INFO:tasks.workunit.client.0.smithi110.stderr: -440> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.803 INFO:tasks.workunit.client.0.smithi110.stderr: -439> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.803 INFO:tasks.workunit.client.0.smithi110.stderr: -438> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.803 INFO:tasks.workunit.client.0.smithi110.stderr: -437> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient(hunting): _renew_subs 2024-03-04T12:36:51.803 INFO:tasks.workunit.client.0.smithi110.stderr: -436> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient(hunting): authenticate will time out at 1792.874276s 2024-03-04T12:36:51.803 INFO:tasks.workunit.client.0.smithi110.stderr: -435> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient(hunting): get_auth_request con 0x55da99c8ad20 auth_method 0 2024-03-04T12:36:51.803 INFO:tasks.workunit.client.0.smithi110.stderr: -434> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.804 INFO:tasks.workunit.client.0.smithi110.stderr: -433> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.804 INFO:tasks.workunit.client.0.smithi110.stderr: -432> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.804 INFO:tasks.workunit.client.0.smithi110.stderr: -431> 2024-03-04T12:36:51.515+0000 7f106e989640 10 monclient(hunting): get_auth_request con 0x55da99de41c0 auth_method 0 2024-03-04T12:36:51.804 INFO:tasks.workunit.client.0.smithi110.stderr: -430> 2024-03-04T12:36:51.515+0000 7f106e989640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.804 INFO:tasks.workunit.client.0.smithi110.stderr: -429> 2024-03-04T12:36:51.515+0000 7f106e989640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.804 INFO:tasks.workunit.client.0.smithi110.stderr: -428> 2024-03-04T12:36:51.515+0000 7f106e989640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.804 INFO:tasks.workunit.client.0.smithi110.stderr: -427> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.804 INFO:tasks.workunit.client.0.smithi110.stderr: -426> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.804 INFO:tasks.workunit.client.0.smithi110.stderr: -425> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.804 INFO:tasks.workunit.client.0.smithi110.stderr: -424> 2024-03-04T12:36:51.515+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.804 INFO:tasks.workunit.client.0.smithi110.stderr: -423> 2024-03-04T12:36:51.515+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.804 INFO:tasks.workunit.client.0.smithi110.stderr: -422> 2024-03-04T12:36:51.515+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.804 INFO:tasks.workunit.client.0.smithi110.stderr: -421> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient(hunting): handle_auth_done global_id 6560 payload 824 2024-03-04T12:36:51.804 INFO:tasks.workunit.client.0.smithi110.stderr: -420> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient: _finish_hunting 0 2024-03-04T12:36:51.805 INFO:tasks.workunit.client.0.smithi110.stderr: -419> 2024-03-04T12:36:51.515+0000 7f1065987640 1 monclient: found mon.noname-c 2024-03-04T12:36:51.805 INFO:tasks.workunit.client.0.smithi110.stderr: -418> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.805 INFO:tasks.workunit.client.0.smithi110.stderr: -417> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.805 INFO:tasks.workunit.client.0.smithi110.stderr: -416> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:36:51.805 INFO:tasks.workunit.client.0.smithi110.stderr: -415> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: dump: 2024-03-04T12:36:51.805 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.805 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.805 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.805 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.805 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.805 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.805 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.805 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.805 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.806 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.806 INFO:tasks.workunit.client.0.smithi110.stderr: -414> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: _finish_auth 0 2024-03-04T12:36:51.806 INFO:tasks.workunit.client.0.smithi110.stderr: -413> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: _check_auth_tickets 2024-03-04T12:36:51.806 INFO:tasks.workunit.client.0.smithi110.stderr: -412> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:51.806 INFO:tasks.workunit.client.0.smithi110.stderr: -411> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.806 INFO:tasks.workunit.client.0.smithi110.stderr: -410> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:36:51.806 INFO:tasks.workunit.client.0.smithi110.stderr: -409> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: dump: 2024-03-04T12:36:51.806 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.806 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.806 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.806 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.806 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.806 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.806 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.807 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.807 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.807 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.807 INFO:tasks.workunit.client.0.smithi110.stderr: -408> 2024-03-04T12:36:51.515+0000 7f107068c800 5 monclient: authenticate success, global_id 6560 2024-03-04T12:36:51.807 INFO:tasks.workunit.client.0.smithi110.stderr: -407> 2024-03-04T12:36:51.515+0000 7f0f5c608640 4 set_mon_vals no callback set 2024-03-04T12:36:51.807 INFO:tasks.workunit.client.0.smithi110.stderr: -406> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient: _renew_subs 2024-03-04T12:36:51.807 INFO:tasks.workunit.client.0.smithi110.stderr: -405> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.807 INFO:tasks.workunit.client.0.smithi110.stderr: -404> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient: _renew_subs 2024-03-04T12:36:51.807 INFO:tasks.workunit.client.0.smithi110.stderr: -403> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.807 INFO:tasks.workunit.client.0.smithi110.stderr: -402> 2024-03-04T12:36:51.515+0000 7f107068c800 1 librados: init done 2024-03-04T12:36:51.807 INFO:tasks.workunit.client.0.smithi110.stderr: -401> 2024-03-04T12:36:51.517+0000 7f0f5ae05640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:36:51.807 INFO:tasks.workunit.client.0.smithi110.stderr: -400> 2024-03-04T12:36:51.517+0000 7f0f5ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:51.807 INFO:tasks.workunit.client.0.smithi110.stderr: -399> 2024-03-04T12:36:51.517+0000 7f0f5ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:51.807 INFO:tasks.workunit.client.0.smithi110.stderr: -398> 2024-03-04T12:36:51.517+0000 7f106e188640 10 monclient: get_auth_request con 0x7f0f54069eb0 auth_method 0 2024-03-04T12:36:51.808 INFO:tasks.workunit.client.0.smithi110.stderr: -397> 2024-03-04T12:36:51.517+0000 7f106e989640 10 monclient: get_auth_request con 0x55da99de7370 auth_method 0 2024-03-04T12:36:51.808 INFO:tasks.workunit.client.0.smithi110.stderr: -396> 2024-03-04T12:36:51.518+0000 7f106e188640 10 monclient: get_auth_request con 0x55da99e29b90 auth_method 0 2024-03-04T12:36:51.808 INFO:tasks.workunit.client.0.smithi110.stderr: -395> 2024-03-04T12:36:51.519+0000 7f1065987640 10 monclient: get_auth_request con 0x55da99e2d410 auth_method 0 2024-03-04T12:36:51.808 INFO:tasks.workunit.client.0.smithi110.stderr: -394> 2024-03-04T12:36:51.520+0000 7f107068c800 10 monclient: build_initial_monmap 2024-03-04T12:36:51.808 INFO:tasks.workunit.client.0.smithi110.stderr: -393> 2024-03-04T12:36:51.520+0000 7f107068c800 1 build_initial for_mkfs: 0 2024-03-04T12:36:51.808 INFO:tasks.workunit.client.0.smithi110.stderr: -392> 2024-03-04T12:36:51.520+0000 7f107068c800 10 monclient: monmap: 2024-03-04T12:36:51.808 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:36:51.808 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:36:51.808 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:36:51.808 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:36:51.808 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:36:51.808 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.808 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:36:51.808 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:36:51.809 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:36:51.809 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.809 INFO:tasks.workunit.client.0.smithi110.stderr: -391> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding auth protocol: cephx 2024-03-04T12:36:51.809 INFO:tasks.workunit.client.0.smithi110.stderr: -390> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding auth protocol: cephx 2024-03-04T12:36:51.809 INFO:tasks.workunit.client.0.smithi110.stderr: -389> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding auth protocol: cephx 2024-03-04T12:36:51.809 INFO:tasks.workunit.client.0.smithi110.stderr: -388> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: secure 2024-03-04T12:36:51.809 INFO:tasks.workunit.client.0.smithi110.stderr: -387> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: crc 2024-03-04T12:36:51.809 INFO:tasks.workunit.client.0.smithi110.stderr: -386> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: secure 2024-03-04T12:36:51.809 INFO:tasks.workunit.client.0.smithi110.stderr: -385> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: crc 2024-03-04T12:36:51.809 INFO:tasks.workunit.client.0.smithi110.stderr: -384> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: secure 2024-03-04T12:36:51.809 INFO:tasks.workunit.client.0.smithi110.stderr: -383> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: crc 2024-03-04T12:36:51.809 INFO:tasks.workunit.client.0.smithi110.stderr: -382> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: crc 2024-03-04T12:36:51.809 INFO:tasks.workunit.client.0.smithi110.stderr: -381> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: secure 2024-03-04T12:36:51.810 INFO:tasks.workunit.client.0.smithi110.stderr: -380> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: crc 2024-03-04T12:36:51.810 INFO:tasks.workunit.client.0.smithi110.stderr: -379> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: secure 2024-03-04T12:36:51.810 INFO:tasks.workunit.client.0.smithi110.stderr: -378> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: crc 2024-03-04T12:36:51.810 INFO:tasks.workunit.client.0.smithi110.stderr: -377> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: secure 2024-03-04T12:36:51.810 INFO:tasks.workunit.client.0.smithi110.stderr: -376> 2024-03-04T12:36:51.520+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.810 INFO:tasks.workunit.client.0.smithi110.stderr: -375> 2024-03-04T12:36:51.520+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command objecter_requests cmddesc objecter_requests hook 0x55da99e36b50 EEXIST 2024-03-04T12:36:51.810 INFO:tasks.workunit.client.0.smithi110.stderr: -374> 2024-03-04T12:36:51.520+0000 7f107068c800 10 monclient: init 2024-03-04T12:36:51.810 INFO:tasks.workunit.client.0.smithi110.stderr: -373> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding auth protocol: cephx 2024-03-04T12:36:51.810 INFO:tasks.workunit.client.0.smithi110.stderr: -372> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding auth protocol: cephx 2024-03-04T12:36:51.810 INFO:tasks.workunit.client.0.smithi110.stderr: -371> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding auth protocol: cephx 2024-03-04T12:36:51.810 INFO:tasks.workunit.client.0.smithi110.stderr: -370> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: secure 2024-03-04T12:36:51.810 INFO:tasks.workunit.client.0.smithi110.stderr: -369> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: crc 2024-03-04T12:36:51.810 INFO:tasks.workunit.client.0.smithi110.stderr: -368> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: secure 2024-03-04T12:36:51.810 INFO:tasks.workunit.client.0.smithi110.stderr: -367> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: crc 2024-03-04T12:36:51.811 INFO:tasks.workunit.client.0.smithi110.stderr: -366> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: secure 2024-03-04T12:36:51.811 INFO:tasks.workunit.client.0.smithi110.stderr: -365> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: crc 2024-03-04T12:36:51.811 INFO:tasks.workunit.client.0.smithi110.stderr: -364> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: crc 2024-03-04T12:36:51.811 INFO:tasks.workunit.client.0.smithi110.stderr: -363> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: secure 2024-03-04T12:36:51.811 INFO:tasks.workunit.client.0.smithi110.stderr: -362> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: crc 2024-03-04T12:36:51.811 INFO:tasks.workunit.client.0.smithi110.stderr: -361> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: secure 2024-03-04T12:36:51.811 INFO:tasks.workunit.client.0.smithi110.stderr: -360> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: crc 2024-03-04T12:36:51.811 INFO:tasks.workunit.client.0.smithi110.stderr: -359> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: secure 2024-03-04T12:36:51.811 INFO:tasks.workunit.client.0.smithi110.stderr: -358> 2024-03-04T12:36:51.521+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.811 INFO:tasks.workunit.client.0.smithi110.stderr: -357> 2024-03-04T12:36:51.521+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.811 INFO:tasks.workunit.client.0.smithi110.stderr: -356> 2024-03-04T12:36:51.521+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command rotate-key cmddesc rotate-key hook 0x55da99e31f20 EEXIST 2024-03-04T12:36:51.811 INFO:tasks.workunit.client.0.smithi110.stderr: -355> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient: _reopen_session rank -1 2024-03-04T12:36:51.811 INFO:tasks.workunit.client.0.smithi110.stderr: -354> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:36:51.811 INFO:tasks.workunit.client.0.smithi110.stderr: -353> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient(hunting): picked mon.noname-b con 0x55da99e5d380 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:36:51.812 INFO:tasks.workunit.client.0.smithi110.stderr: -352> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient(hunting): picked mon.noname-c con 0x55da99e5d760 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:36:51.812 INFO:tasks.workunit.client.0.smithi110.stderr: -351> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient(hunting): picked mon.noname-a con 0x55da99e70110 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:36:51.812 INFO:tasks.workunit.client.0.smithi110.stderr: -350> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.812 INFO:tasks.workunit.client.0.smithi110.stderr: -349> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.812 INFO:tasks.workunit.client.0.smithi110.stderr: -348> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.812 INFO:tasks.workunit.client.0.smithi110.stderr: -347> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient(hunting): _renew_subs 2024-03-04T12:36:51.812 INFO:tasks.workunit.client.0.smithi110.stderr: -346> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient(hunting): authenticate will time out at 1792.880473s 2024-03-04T12:36:51.812 INFO:tasks.workunit.client.0.smithi110.stderr: -345> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient(hunting): get_auth_request con 0x55da99e5d760 auth_method 0 2024-03-04T12:36:51.812 INFO:tasks.workunit.client.0.smithi110.stderr: -344> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.812 INFO:tasks.workunit.client.0.smithi110.stderr: -343> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.812 INFO:tasks.workunit.client.0.smithi110.stderr: -342> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.812 INFO:tasks.workunit.client.0.smithi110.stderr: -341> 2024-03-04T12:36:51.521+0000 7f106e989640 10 monclient(hunting): get_auth_request con 0x55da99e70110 auth_method 0 2024-03-04T12:36:51.812 INFO:tasks.workunit.client.0.smithi110.stderr: -340> 2024-03-04T12:36:51.521+0000 7f106e989640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.813 INFO:tasks.workunit.client.0.smithi110.stderr: -339> 2024-03-04T12:36:51.521+0000 7f106e989640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.813 INFO:tasks.workunit.client.0.smithi110.stderr: -338> 2024-03-04T12:36:51.521+0000 7f106e989640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.813 INFO:tasks.workunit.client.0.smithi110.stderr: -337> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.813 INFO:tasks.workunit.client.0.smithi110.stderr: -336> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.813 INFO:tasks.workunit.client.0.smithi110.stderr: -335> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.813 INFO:tasks.workunit.client.0.smithi110.stderr: -334> 2024-03-04T12:36:51.521+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.813 INFO:tasks.workunit.client.0.smithi110.stderr: -333> 2024-03-04T12:36:51.521+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.813 INFO:tasks.workunit.client.0.smithi110.stderr: -332> 2024-03-04T12:36:51.521+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.813 INFO:tasks.workunit.client.0.smithi110.stderr: -331> 2024-03-04T12:36:51.521+0000 7f106e188640 10 monclient(hunting): get_auth_request con 0x55da99e5d380 auth_method 0 2024-03-04T12:36:51.813 INFO:tasks.workunit.client.0.smithi110.stderr: -330> 2024-03-04T12:36:51.521+0000 7f106e188640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.813 INFO:tasks.workunit.client.0.smithi110.stderr: -329> 2024-03-04T12:36:51.521+0000 7f106e188640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.813 INFO:tasks.workunit.client.0.smithi110.stderr: -328> 2024-03-04T12:36:51.521+0000 7f106e188640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.813 INFO:tasks.workunit.client.0.smithi110.stderr: -327> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient(hunting): handle_auth_done global_id 6563 payload 824 2024-03-04T12:36:51.813 INFO:tasks.workunit.client.0.smithi110.stderr: -326> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient: _finish_hunting 0 2024-03-04T12:36:51.813 INFO:tasks.workunit.client.0.smithi110.stderr: -325> 2024-03-04T12:36:51.521+0000 7f1065987640 1 monclient: found mon.noname-c 2024-03-04T12:36:51.814 INFO:tasks.workunit.client.0.smithi110.stderr: -324> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.814 INFO:tasks.workunit.client.0.smithi110.stderr: -323> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.814 INFO:tasks.workunit.client.0.smithi110.stderr: -322> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:36:51.814 INFO:tasks.workunit.client.0.smithi110.stderr: -321> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: dump: 2024-03-04T12:36:51.814 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.814 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.814 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.814 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.814 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.814 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.814 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.814 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.814 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.814 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.815 INFO:tasks.workunit.client.0.smithi110.stderr: -320> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: _finish_auth 0 2024-03-04T12:36:51.815 INFO:tasks.workunit.client.0.smithi110.stderr: -319> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: _check_auth_tickets 2024-03-04T12:36:51.815 INFO:tasks.workunit.client.0.smithi110.stderr: -318> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:51.815 INFO:tasks.workunit.client.0.smithi110.stderr: -317> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.815 INFO:tasks.workunit.client.0.smithi110.stderr: -316> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:36:51.815 INFO:tasks.workunit.client.0.smithi110.stderr: -315> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: dump: 2024-03-04T12:36:51.815 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.815 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.815 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.815 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.815 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.815 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.815 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.816 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.816 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.816 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.816 INFO:tasks.workunit.client.0.smithi110.stderr: -314> 2024-03-04T12:36:51.522+0000 7f106f18a640 4 set_mon_vals no callback set 2024-03-04T12:36:51.816 INFO:tasks.workunit.client.0.smithi110.stderr: -313> 2024-03-04T12:36:51.522+0000 7f107068c800 5 monclient: authenticate success, global_id 6563 2024-03-04T12:36:51.816 INFO:tasks.workunit.client.0.smithi110.stderr: -312> 2024-03-04T12:36:51.522+0000 7f107068c800 10 monclient: _renew_subs 2024-03-04T12:36:51.816 INFO:tasks.workunit.client.0.smithi110.stderr: -311> 2024-03-04T12:36:51.522+0000 7f107068c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.816 INFO:tasks.workunit.client.0.smithi110.stderr: -310> 2024-03-04T12:36:51.522+0000 7f107068c800 10 monclient: _renew_subs 2024-03-04T12:36:51.816 INFO:tasks.workunit.client.0.smithi110.stderr: -309> 2024-03-04T12:36:51.522+0000 7f107068c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.816 INFO:tasks.workunit.client.0.smithi110.stderr: -308> 2024-03-04T12:36:51.523+0000 7f0f53fff640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:36:51.816 INFO:tasks.workunit.client.0.smithi110.stderr: -307> 2024-03-04T12:36:51.523+0000 7f0f53fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:51.816 INFO:tasks.workunit.client.0.smithi110.stderr: -306> 2024-03-04T12:36:51.523+0000 7f0f53fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:51.816 INFO:tasks.workunit.client.0.smithi110.stderr: -305> 2024-03-04T12:36:51.523+0000 7f106e188640 10 monclient: get_auth_request con 0x7f0f48069df0 auth_method 0 2024-03-04T12:36:51.816 INFO:tasks.workunit.client.0.smithi110.stderr: -304> 2024-03-04T12:36:51.523+0000 7f107068c800 10 monclient: get_monmap_and_config 2024-03-04T12:36:51.817 INFO:tasks.workunit.client.0.smithi110.stderr: -303> 2024-03-04T12:36:51.523+0000 7f107068c800 10 monclient: build_initial_monmap 2024-03-04T12:36:51.817 INFO:tasks.workunit.client.0.smithi110.stderr: -302> 2024-03-04T12:36:51.523+0000 7f107068c800 1 build_initial for_mkfs: 0 2024-03-04T12:36:51.817 INFO:tasks.workunit.client.0.smithi110.stderr: -301> 2024-03-04T12:36:51.523+0000 7f107068c800 10 monclient: monmap: 2024-03-04T12:36:51.817 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:36:51.817 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:36:51.817 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:36:51.817 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:36:51.817 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:36:51.817 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.817 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:36:51.817 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:36:51.817 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:36:51.817 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.818 INFO:tasks.workunit.client.0.smithi110.stderr: -300> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding auth protocol: cephx 2024-03-04T12:36:51.818 INFO:tasks.workunit.client.0.smithi110.stderr: -299> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding auth protocol: cephx 2024-03-04T12:36:51.818 INFO:tasks.workunit.client.0.smithi110.stderr: -298> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding auth protocol: cephx 2024-03-04T12:36:51.818 INFO:tasks.workunit.client.0.smithi110.stderr: -297> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: secure 2024-03-04T12:36:51.818 INFO:tasks.workunit.client.0.smithi110.stderr: -296> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: crc 2024-03-04T12:36:51.818 INFO:tasks.workunit.client.0.smithi110.stderr: -295> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: secure 2024-03-04T12:36:51.818 INFO:tasks.workunit.client.0.smithi110.stderr: -294> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: crc 2024-03-04T12:36:51.818 INFO:tasks.workunit.client.0.smithi110.stderr: -293> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: secure 2024-03-04T12:36:51.818 INFO:tasks.workunit.client.0.smithi110.stderr: -292> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: crc 2024-03-04T12:36:51.818 INFO:tasks.workunit.client.0.smithi110.stderr: -291> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: crc 2024-03-04T12:36:51.818 INFO:tasks.workunit.client.0.smithi110.stderr: -290> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: secure 2024-03-04T12:36:51.818 INFO:tasks.workunit.client.0.smithi110.stderr: -289> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: crc 2024-03-04T12:36:51.818 INFO:tasks.workunit.client.0.smithi110.stderr: -288> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: secure 2024-03-04T12:36:51.818 INFO:tasks.workunit.client.0.smithi110.stderr: -287> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: crc 2024-03-04T12:36:51.819 INFO:tasks.workunit.client.0.smithi110.stderr: -286> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: secure 2024-03-04T12:36:51.819 INFO:tasks.workunit.client.0.smithi110.stderr: -285> 2024-03-04T12:36:51.524+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.819 INFO:tasks.workunit.client.0.smithi110.stderr: -284> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient: init 2024-03-04T12:36:51.819 INFO:tasks.workunit.client.0.smithi110.stderr: -283> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding auth protocol: cephx 2024-03-04T12:36:51.819 INFO:tasks.workunit.client.0.smithi110.stderr: -282> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding auth protocol: cephx 2024-03-04T12:36:51.819 INFO:tasks.workunit.client.0.smithi110.stderr: -281> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding auth protocol: cephx 2024-03-04T12:36:51.819 INFO:tasks.workunit.client.0.smithi110.stderr: -280> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: secure 2024-03-04T12:36:51.819 INFO:tasks.workunit.client.0.smithi110.stderr: -279> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: crc 2024-03-04T12:36:51.819 INFO:tasks.workunit.client.0.smithi110.stderr: -278> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: secure 2024-03-04T12:36:51.819 INFO:tasks.workunit.client.0.smithi110.stderr: -277> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: crc 2024-03-04T12:36:51.819 INFO:tasks.workunit.client.0.smithi110.stderr: -276> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: secure 2024-03-04T12:36:51.819 INFO:tasks.workunit.client.0.smithi110.stderr: -275> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: crc 2024-03-04T12:36:51.819 INFO:tasks.workunit.client.0.smithi110.stderr: -274> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: crc 2024-03-04T12:36:51.819 INFO:tasks.workunit.client.0.smithi110.stderr: -273> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: secure 2024-03-04T12:36:51.820 INFO:tasks.workunit.client.0.smithi110.stderr: -272> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: crc 2024-03-04T12:36:51.820 INFO:tasks.workunit.client.0.smithi110.stderr: -271> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: secure 2024-03-04T12:36:51.820 INFO:tasks.workunit.client.0.smithi110.stderr: -270> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: crc 2024-03-04T12:36:51.820 INFO:tasks.workunit.client.0.smithi110.stderr: -269> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: secure 2024-03-04T12:36:51.820 INFO:tasks.workunit.client.0.smithi110.stderr: -268> 2024-03-04T12:36:51.524+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.820 INFO:tasks.workunit.client.0.smithi110.stderr: -267> 2024-03-04T12:36:51.524+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.820 INFO:tasks.workunit.client.0.smithi110.stderr: -266> 2024-03-04T12:36:51.524+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command rotate-key cmddesc rotate-key hook 0x7ffd024c5398 EEXIST 2024-03-04T12:36:51.820 INFO:tasks.workunit.client.0.smithi110.stderr: -265> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient: _reopen_session rank -1 2024-03-04T12:36:51.820 INFO:tasks.workunit.client.0.smithi110.stderr: -264> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient: _add_conns ranks=[0,2,1] 2024-03-04T12:36:51.820 INFO:tasks.workunit.client.0.smithi110.stderr: -263> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient(hunting): picked mon.noname-a con 0x55da99eaf440 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:36:51.820 INFO:tasks.workunit.client.0.smithi110.stderr: -262> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient(hunting): picked mon.noname-c con 0x55da99eaa990 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:36:51.820 INFO:tasks.workunit.client.0.smithi110.stderr: -261> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient(hunting): picked mon.noname-b con 0x55da99ea1390 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:36:51.820 INFO:tasks.workunit.client.0.smithi110.stderr: -260> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.821 INFO:tasks.workunit.client.0.smithi110.stderr: -259> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.821 INFO:tasks.workunit.client.0.smithi110.stderr: -258> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.821 INFO:tasks.workunit.client.0.smithi110.stderr: -257> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient(hunting): _renew_subs 2024-03-04T12:36:51.821 INFO:tasks.workunit.client.0.smithi110.stderr: -256> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient(hunting): authenticate will time out at 1792.883675s 2024-03-04T12:36:51.821 INFO:tasks.workunit.client.0.smithi110.stderr: -255> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient(hunting): get_auth_request con 0x55da99eaf440 auth_method 0 2024-03-04T12:36:51.821 INFO:tasks.workunit.client.0.smithi110.stderr: -254> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.821 INFO:tasks.workunit.client.0.smithi110.stderr: -253> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.821 INFO:tasks.workunit.client.0.smithi110.stderr: -252> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.821 INFO:tasks.workunit.client.0.smithi110.stderr: -251> 2024-03-04T12:36:51.524+0000 7f1065987640 10 monclient(hunting): get_auth_request con 0x55da99eaa990 auth_method 0 2024-03-04T12:36:51.821 INFO:tasks.workunit.client.0.smithi110.stderr: -250> 2024-03-04T12:36:51.524+0000 7f1065987640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.821 INFO:tasks.workunit.client.0.smithi110.stderr: -249> 2024-03-04T12:36:51.524+0000 7f1065987640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.821 INFO:tasks.workunit.client.0.smithi110.stderr: -248> 2024-03-04T12:36:51.524+0000 7f1065987640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.821 INFO:tasks.workunit.client.0.smithi110.stderr: -247> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.821 INFO:tasks.workunit.client.0.smithi110.stderr: -246> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.822 INFO:tasks.workunit.client.0.smithi110.stderr: -245> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.822 INFO:tasks.workunit.client.0.smithi110.stderr: -244> 2024-03-04T12:36:51.524+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.822 INFO:tasks.workunit.client.0.smithi110.stderr: -243> 2024-03-04T12:36:51.524+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.822 INFO:tasks.workunit.client.0.smithi110.stderr: -242> 2024-03-04T12:36:51.524+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.822 INFO:tasks.workunit.client.0.smithi110.stderr: -241> 2024-03-04T12:36:51.524+0000 7f106e989640 10 monclient(hunting): get_auth_request con 0x55da99ea1390 auth_method 0 2024-03-04T12:36:51.822 INFO:tasks.workunit.client.0.smithi110.stderr: -240> 2024-03-04T12:36:51.524+0000 7f106e989640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.822 INFO:tasks.workunit.client.0.smithi110.stderr: -239> 2024-03-04T12:36:51.524+0000 7f106e989640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.822 INFO:tasks.workunit.client.0.smithi110.stderr: -238> 2024-03-04T12:36:51.524+0000 7f106e989640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.822 INFO:tasks.workunit.client.0.smithi110.stderr: -237> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient(hunting): handle_auth_done global_id 6996 payload 274 2024-03-04T12:36:51.822 INFO:tasks.workunit.client.0.smithi110.stderr: -236> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient: _finish_hunting 0 2024-03-04T12:36:51.822 INFO:tasks.workunit.client.0.smithi110.stderr: -235> 2024-03-04T12:36:51.524+0000 7f106e188640 1 monclient: found mon.noname-a 2024-03-04T12:36:51.822 INFO:tasks.workunit.client.0.smithi110.stderr: -234> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:36:51.822 INFO:tasks.workunit.client.0.smithi110.stderr: -233> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.822 INFO:tasks.workunit.client.0.smithi110.stderr: -232> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:36:51.823 INFO:tasks.workunit.client.0.smithi110.stderr: -231> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: dump: 2024-03-04T12:36:51.823 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.823 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.823 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.823 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.823 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.823 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.823 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.823 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.823 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.823 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.823 INFO:tasks.workunit.client.0.smithi110.stderr: -230> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: _finish_auth 0 2024-03-04T12:36:51.823 INFO:tasks.workunit.client.0.smithi110.stderr: -229> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: _check_auth_tickets 2024-03-04T12:36:51.823 INFO:tasks.workunit.client.0.smithi110.stderr: -228> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:51.824 INFO:tasks.workunit.client.0.smithi110.stderr: -227> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.824 INFO:tasks.workunit.client.0.smithi110.stderr: -226> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:36:51.824 INFO:tasks.workunit.client.0.smithi110.stderr: -225> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: dump: 2024-03-04T12:36:51.824 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.824 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.824 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.824 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.824 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.824 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.824 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.824 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.824 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.824 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.824 INFO:tasks.workunit.client.0.smithi110.stderr: -224> 2024-03-04T12:36:51.525+0000 7f107068c800 5 monclient: authenticate success, global_id 6996 2024-03-04T12:36:51.825 INFO:tasks.workunit.client.0.smithi110.stderr: -223> 2024-03-04T12:36:51.525+0000 7f107068c800 10 monclient: get_monmap_and_config success 2024-03-04T12:36:51.825 INFO:tasks.workunit.client.0.smithi110.stderr: -222> 2024-03-04T12:36:51.525+0000 7f107068c800 4 set_mon_vals no callback set 2024-03-04T12:36:51.825 INFO:tasks.workunit.client.0.smithi110.stderr: -221> 2024-03-04T12:36:51.525+0000 7f107068c800 10 monclient: shutdown 2024-03-04T12:36:51.825 INFO:tasks.workunit.client.0.smithi110.stderr: -220> 2024-03-04T12:36:51.525+0000 7f107068c800 10 monclient: build_initial_monmap 2024-03-04T12:36:51.825 INFO:tasks.workunit.client.0.smithi110.stderr: -219> 2024-03-04T12:36:51.525+0000 7f107068c800 1 build_initial for_mkfs: 0 2024-03-04T12:36:51.825 INFO:tasks.workunit.client.0.smithi110.stderr: -218> 2024-03-04T12:36:51.525+0000 7f107068c800 10 monclient: monmap: 2024-03-04T12:36:51.825 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:36:51.825 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:36:51.825 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:36:51.825 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:36:51.825 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:36:51.825 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.825 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:36:51.825 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:36:51.826 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:36:51.826 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.826 INFO:tasks.workunit.client.0.smithi110.stderr: -217> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding auth protocol: cephx 2024-03-04T12:36:51.826 INFO:tasks.workunit.client.0.smithi110.stderr: -216> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding auth protocol: cephx 2024-03-04T12:36:51.826 INFO:tasks.workunit.client.0.smithi110.stderr: -215> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding auth protocol: cephx 2024-03-04T12:36:51.826 INFO:tasks.workunit.client.0.smithi110.stderr: -214> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: secure 2024-03-04T12:36:51.826 INFO:tasks.workunit.client.0.smithi110.stderr: -213> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: crc 2024-03-04T12:36:51.826 INFO:tasks.workunit.client.0.smithi110.stderr: -212> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: secure 2024-03-04T12:36:51.826 INFO:tasks.workunit.client.0.smithi110.stderr: -211> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: crc 2024-03-04T12:36:51.826 INFO:tasks.workunit.client.0.smithi110.stderr: -210> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: secure 2024-03-04T12:36:51.826 INFO:tasks.workunit.client.0.smithi110.stderr: -209> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: crc 2024-03-04T12:36:51.826 INFO:tasks.workunit.client.0.smithi110.stderr: -208> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: crc 2024-03-04T12:36:51.826 INFO:tasks.workunit.client.0.smithi110.stderr: -207> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: secure 2024-03-04T12:36:51.826 INFO:tasks.workunit.client.0.smithi110.stderr: -206> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: crc 2024-03-04T12:36:51.826 INFO:tasks.workunit.client.0.smithi110.stderr: -205> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: secure 2024-03-04T12:36:51.827 INFO:tasks.workunit.client.0.smithi110.stderr: -204> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: crc 2024-03-04T12:36:51.827 INFO:tasks.workunit.client.0.smithi110.stderr: -203> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: secure 2024-03-04T12:36:51.827 INFO:tasks.workunit.client.0.smithi110.stderr: -202> 2024-03-04T12:36:51.526+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.827 INFO:tasks.workunit.client.0.smithi110.stderr: -201> 2024-03-04T12:36:51.526+0000 7f107068c800 1 librados: starting msgr at 2024-03-04T12:36:51.827 INFO:tasks.workunit.client.0.smithi110.stderr: -200> 2024-03-04T12:36:51.526+0000 7f107068c800 1 librados: starting objecter 2024-03-04T12:36:51.827 INFO:tasks.workunit.client.0.smithi110.stderr: -199> 2024-03-04T12:36:51.526+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command objecter_requests cmddesc objecter_requests hook 0x55da99e7d880 EEXIST 2024-03-04T12:36:51.827 INFO:tasks.workunit.client.0.smithi110.stderr: -198> 2024-03-04T12:36:51.526+0000 7f107068c800 1 librados: setting wanted keys 2024-03-04T12:36:51.827 INFO:tasks.workunit.client.0.smithi110.stderr: -197> 2024-03-04T12:36:51.526+0000 7f107068c800 1 librados: calling monclient init 2024-03-04T12:36:51.827 INFO:tasks.workunit.client.0.smithi110.stderr: -196> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient: init 2024-03-04T12:36:51.827 INFO:tasks.workunit.client.0.smithi110.stderr: -195> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding auth protocol: cephx 2024-03-04T12:36:51.827 INFO:tasks.workunit.client.0.smithi110.stderr: -194> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding auth protocol: cephx 2024-03-04T12:36:51.827 INFO:tasks.workunit.client.0.smithi110.stderr: -193> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding auth protocol: cephx 2024-03-04T12:36:51.827 INFO:tasks.workunit.client.0.smithi110.stderr: -192> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: secure 2024-03-04T12:36:51.827 INFO:tasks.workunit.client.0.smithi110.stderr: -191> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: crc 2024-03-04T12:36:51.827 INFO:tasks.workunit.client.0.smithi110.stderr: -190> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: secure 2024-03-04T12:36:51.828 INFO:tasks.workunit.client.0.smithi110.stderr: -189> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: crc 2024-03-04T12:36:51.828 INFO:tasks.workunit.client.0.smithi110.stderr: -188> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: secure 2024-03-04T12:36:51.828 INFO:tasks.workunit.client.0.smithi110.stderr: -187> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: crc 2024-03-04T12:36:51.828 INFO:tasks.workunit.client.0.smithi110.stderr: -186> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: crc 2024-03-04T12:36:51.828 INFO:tasks.workunit.client.0.smithi110.stderr: -185> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: secure 2024-03-04T12:36:51.828 INFO:tasks.workunit.client.0.smithi110.stderr: -184> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: crc 2024-03-04T12:36:51.828 INFO:tasks.workunit.client.0.smithi110.stderr: -183> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: secure 2024-03-04T12:36:51.828 INFO:tasks.workunit.client.0.smithi110.stderr: -182> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: crc 2024-03-04T12:36:51.828 INFO:tasks.workunit.client.0.smithi110.stderr: -181> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: secure 2024-03-04T12:36:51.828 INFO:tasks.workunit.client.0.smithi110.stderr: -180> 2024-03-04T12:36:51.526+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.828 INFO:tasks.workunit.client.0.smithi110.stderr: -179> 2024-03-04T12:36:51.526+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.828 INFO:tasks.workunit.client.0.smithi110.stderr: -178> 2024-03-04T12:36:51.526+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command rotate-key cmddesc rotate-key hook 0x55da99e72e68 EEXIST 2024-03-04T12:36:51.828 INFO:tasks.workunit.client.0.smithi110.stderr: -177> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient: _reopen_session rank -1 2024-03-04T12:36:51.828 INFO:tasks.workunit.client.0.smithi110.stderr: -176> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-04T12:36:51.829 INFO:tasks.workunit.client.0.smithi110.stderr: -175> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient(hunting): picked mon.noname-c con 0x55da99ea1390 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:36:51.829 INFO:tasks.workunit.client.0.smithi110.stderr: -174> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient(hunting): picked mon.noname-b con 0x55da99eaa990 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:36:51.829 INFO:tasks.workunit.client.0.smithi110.stderr: -173> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient(hunting): picked mon.noname-a con 0x55da99eaf440 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:36:51.829 INFO:tasks.workunit.client.0.smithi110.stderr: -172> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.829 INFO:tasks.workunit.client.0.smithi110.stderr: -171> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.829 INFO:tasks.workunit.client.0.smithi110.stderr: -170> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.829 INFO:tasks.workunit.client.0.smithi110.stderr: -169> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient(hunting): _renew_subs 2024-03-04T12:36:51.829 INFO:tasks.workunit.client.0.smithi110.stderr: -168> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient(hunting): authenticate will time out at 1792.885854s 2024-03-04T12:36:51.829 INFO:tasks.workunit.client.0.smithi110.stderr: -167> 2024-03-04T12:36:51.526+0000 7f106e188640 10 monclient(hunting): get_auth_request con 0x55da99ea1390 auth_method 0 2024-03-04T12:36:51.829 INFO:tasks.workunit.client.0.smithi110.stderr: -166> 2024-03-04T12:36:51.526+0000 7f106e188640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.829 INFO:tasks.workunit.client.0.smithi110.stderr: -165> 2024-03-04T12:36:51.526+0000 7f106e188640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.829 INFO:tasks.workunit.client.0.smithi110.stderr: -164> 2024-03-04T12:36:51.526+0000 7f106e188640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.829 INFO:tasks.workunit.client.0.smithi110.stderr: -163> 2024-03-04T12:36:51.526+0000 7f106e989640 10 monclient(hunting): get_auth_request con 0x55da99eaf440 auth_method 0 2024-03-04T12:36:51.830 INFO:tasks.workunit.client.0.smithi110.stderr: -162> 2024-03-04T12:36:51.526+0000 7f106e989640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.830 INFO:tasks.workunit.client.0.smithi110.stderr: -161> 2024-03-04T12:36:51.526+0000 7f106e989640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.830 INFO:tasks.workunit.client.0.smithi110.stderr: -160> 2024-03-04T12:36:51.526+0000 7f106e989640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.830 INFO:tasks.workunit.client.0.smithi110.stderr: -159> 2024-03-04T12:36:51.526+0000 7f106e188640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.830 INFO:tasks.workunit.client.0.smithi110.stderr: -158> 2024-03-04T12:36:51.526+0000 7f106e188640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.830 INFO:tasks.workunit.client.0.smithi110.stderr: -157> 2024-03-04T12:36:51.527+0000 7f106e188640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.830 INFO:tasks.workunit.client.0.smithi110.stderr: -156> 2024-03-04T12:36:51.527+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.830 INFO:tasks.workunit.client.0.smithi110.stderr: -155> 2024-03-04T12:36:51.527+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.830 INFO:tasks.workunit.client.0.smithi110.stderr: -154> 2024-03-04T12:36:51.527+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.830 INFO:tasks.workunit.client.0.smithi110.stderr: -153> 2024-03-04T12:36:51.527+0000 7f1065987640 10 monclient(hunting): get_auth_request con 0x55da99eaa990 auth_method 0 2024-03-04T12:36:51.830 INFO:tasks.workunit.client.0.smithi110.stderr: -152> 2024-03-04T12:36:51.527+0000 7f1065987640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.830 INFO:tasks.workunit.client.0.smithi110.stderr: -151> 2024-03-04T12:36:51.527+0000 7f1065987640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.830 INFO:tasks.workunit.client.0.smithi110.stderr: -150> 2024-03-04T12:36:51.527+0000 7f1065987640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.830 INFO:tasks.workunit.client.0.smithi110.stderr: -149> 2024-03-04T12:36:51.527+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.830 INFO:tasks.workunit.client.0.smithi110.stderr: -148> 2024-03-04T12:36:51.527+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.831 INFO:tasks.workunit.client.0.smithi110.stderr: -147> 2024-03-04T12:36:51.527+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.831 INFO:tasks.workunit.client.0.smithi110.stderr: -146> 2024-03-04T12:36:51.527+0000 7f106e188640 10 monclient(hunting): handle_auth_done global_id 6569 payload 824 2024-03-04T12:36:51.831 INFO:tasks.workunit.client.0.smithi110.stderr: -145> 2024-03-04T12:36:51.527+0000 7f106e188640 10 monclient: _finish_hunting 0 2024-03-04T12:36:51.831 INFO:tasks.workunit.client.0.smithi110.stderr: -144> 2024-03-04T12:36:51.527+0000 7f106e188640 1 monclient: found mon.noname-c 2024-03-04T12:36:51.831 INFO:tasks.workunit.client.0.smithi110.stderr: -143> 2024-03-04T12:36:51.527+0000 7f106e188640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.831 INFO:tasks.workunit.client.0.smithi110.stderr: -142> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.831 INFO:tasks.workunit.client.0.smithi110.stderr: -141> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:36:51.831 INFO:tasks.workunit.client.0.smithi110.stderr: -140> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: dump: 2024-03-04T12:36:51.831 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.831 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.831 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.831 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.831 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.831 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.832 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.832 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.832 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.832 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.832 INFO:tasks.workunit.client.0.smithi110.stderr: -139> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: _finish_auth 0 2024-03-04T12:36:51.832 INFO:tasks.workunit.client.0.smithi110.stderr: -138> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: _check_auth_tickets 2024-03-04T12:36:51.832 INFO:tasks.workunit.client.0.smithi110.stderr: -137> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:51.832 INFO:tasks.workunit.client.0.smithi110.stderr: -136> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.832 INFO:tasks.workunit.client.0.smithi110.stderr: -135> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:36:51.832 INFO:tasks.workunit.client.0.smithi110.stderr: -134> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: dump: 2024-03-04T12:36:51.832 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.832 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.832 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.832 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.832 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.833 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.833 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.833 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.833 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.833 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.833 INFO:tasks.workunit.client.0.smithi110.stderr: -133> 2024-03-04T12:36:51.527+0000 7f107068c800 5 monclient: authenticate success, global_id 6569 2024-03-04T12:36:51.833 INFO:tasks.workunit.client.0.smithi110.stderr: -132> 2024-03-04T12:36:51.527+0000 7f0f51ffb640 4 set_mon_vals no callback set 2024-03-04T12:36:51.833 INFO:tasks.workunit.client.0.smithi110.stderr: -131> 2024-03-04T12:36:51.527+0000 7f107068c800 10 monclient: _renew_subs 2024-03-04T12:36:51.833 INFO:tasks.workunit.client.0.smithi110.stderr: -130> 2024-03-04T12:36:51.527+0000 7f107068c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.833 INFO:tasks.workunit.client.0.smithi110.stderr: -129> 2024-03-04T12:36:51.527+0000 7f107068c800 10 monclient: _renew_subs 2024-03-04T12:36:51.833 INFO:tasks.workunit.client.0.smithi110.stderr: -128> 2024-03-04T12:36:51.527+0000 7f107068c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.833 INFO:tasks.workunit.client.0.smithi110.stderr: -127> 2024-03-04T12:36:51.527+0000 7f107068c800 1 librados: init done 2024-03-04T12:36:51.833 INFO:tasks.workunit.client.0.smithi110.stderr: -126> 2024-03-04T12:36:51.527+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command cr dump hook 0x55da99ea6608 2024-03-04T12:36:51.833 INFO:tasks.workunit.client.0.smithi110.stderr: -125> 2024-03-04T12:36:51.528+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.834 INFO:tasks.workunit.client.0.smithi110.stderr: -124> 2024-03-04T12:36:51.529+0000 7f0f3ffff640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:36:51.834 INFO:tasks.workunit.client.0.smithi110.stderr: -123> 2024-03-04T12:36:51.529+0000 7f0f3ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:51.834 INFO:tasks.workunit.client.0.smithi110.stderr: -122> 2024-03-04T12:36:51.529+0000 7f0f3ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:51.834 INFO:tasks.workunit.client.0.smithi110.stderr: -121> 2024-03-04T12:36:51.529+0000 7f1065987640 10 monclient: get_auth_request con 0x7f0f38069eb0 auth_method 0 2024-03-04T12:36:51.834 INFO:tasks.workunit.client.0.smithi110.stderr: -120> 2024-03-04T12:36:51.529+0000 7f106e989640 10 monclient: get_auth_request con 0x55da99ec9990 auth_method 0 2024-03-04T12:36:51.834 INFO:tasks.workunit.client.0.smithi110.stderr: -119> 2024-03-04T12:36:51.529+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.834 INFO:tasks.workunit.client.0.smithi110.stderr: -118> 2024-03-04T12:36:51.529+0000 7f107068c800 20 realm 2024-03-04T12:36:51.834 INFO:tasks.workunit.client.0.smithi110.stderr: -117> 2024-03-04T12:36:51.529+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.834 INFO:tasks.workunit.client.0.smithi110.stderr: -116> 2024-03-04T12:36:51.530+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.834 INFO:tasks.workunit.client.0.smithi110.stderr: -115> 2024-03-04T12:36:51.530+0000 7f107068c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:51.834 INFO:tasks.workunit.client.0.smithi110.stderr: -114> 2024-03-04T12:36:51.530+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.834 INFO:tasks.workunit.client.0.smithi110.stderr: -113> 2024-03-04T12:36:51.530+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.834 INFO:tasks.workunit.client.0.smithi110.stderr: -112> 2024-03-04T12:36:51.530+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.835 INFO:tasks.workunit.client.0.smithi110.stderr: -111> 2024-03-04T12:36:51.530+0000 7f106e188640 10 monclient: get_auth_request con 0x55da99ecdc90 auth_method 0 2024-03-04T12:36:51.835 INFO:tasks.workunit.client.0.smithi110.stderr: -110> 2024-03-04T12:36:51.531+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:51.835 INFO:tasks.workunit.client.0.smithi110.stderr: -109> 2024-03-04T12:36:51.531+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.835 INFO:tasks.workunit.client.0.smithi110.stderr: -108> 2024-03-04T12:36:51.531+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:51.835 INFO:tasks.workunit.client.0.smithi110.stderr: -107> 2024-03-04T12:36:51.531+0000 7f107068c800 20 searching for the correct realm 2024-03-04T12:36:51.835 INFO:tasks.workunit.client.0.smithi110.stderr: -106> 2024-03-04T12:36:51.531+0000 7f1065987640 10 monclient: get_auth_request con 0x55da99ed2dc0 auth_method 0 2024-03-04T12:36:51.835 INFO:tasks.workunit.client.0.smithi110.stderr: -105> 2024-03-04T12:36:51.532+0000 7f106e989640 10 monclient: get_auth_request con 0x7f1058026070 auth_method 0 2024-03-04T12:36:51.835 INFO:tasks.workunit.client.0.smithi110.stderr: -104> 2024-03-04T12:36:51.533+0000 7f106e188640 10 monclient: get_auth_request con 0x7f106806e040 auth_method 0 2024-03-04T12:36:51.835 INFO:tasks.workunit.client.0.smithi110.stderr: -103> 2024-03-04T12:36:51.533+0000 7f1065987640 10 monclient: get_auth_request con 0x7f1060049070 auth_method 0 2024-03-04T12:36:51.835 INFO:tasks.workunit.client.0.smithi110.stderr: -102> 2024-03-04T12:36:51.534+0000 7f106e989640 0 -- 172.21.15.110:0/2908460802 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f1058026070 msgr2=0x7f105808bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:51.835 INFO:tasks.workunit.client.0.smithi110.stderr: -101> 2024-03-04T12:36:51.534+0000 7f0f3ffff640 1 client.6569.objecter ms_handle_reset 0x7f1058026070 session 0x7f1058005040 osd.7 2024-03-04T12:36:51.835 INFO:tasks.workunit.client.0.smithi110.stderr: -100> 2024-03-04T12:36:51.534+0000 7f0f3ffff640 10 monclient: _renew_subs 2024-03-04T12:36:51.835 INFO:tasks.workunit.client.0.smithi110.stderr: -99> 2024-03-04T12:36:51.534+0000 7f0f3ffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.835 INFO:tasks.workunit.client.0.smithi110.stderr: -98> 2024-03-04T12:36:51.534+0000 7f106e989640 10 monclient: get_auth_request con 0x7f0f38079c50 auth_method 0 2024-03-04T12:36:51.835 INFO:tasks.workunit.client.0.smithi110.stderr: -97> 2024-03-04T12:36:51.535+0000 7f106e989640 10 monclient: get_auth_request con 0x7f1058045890 auth_method 0 2024-03-04T12:36:51.836 INFO:tasks.workunit.client.0.smithi110.stderr: -96> 2024-03-04T12:36:51.537+0000 7f106e188640 10 monclient: get_auth_request con 0x7f10580834d0 auth_method 0 2024-03-04T12:36:51.836 INFO:tasks.workunit.client.0.smithi110.stderr: -95> 2024-03-04T12:36:51.537+0000 7f106e188640 0 -- 172.21.15.110:0/2908460802 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f10580834d0 msgr2=0x7f1058084790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:36:51.836 INFO:tasks.workunit.client.0.smithi110.stderr: -94> 2024-03-04T12:36:51.738+0000 7f106e188640 10 monclient: get_auth_request con 0x7f10580834d0 auth_method 0 2024-03-04T12:36:51.836 INFO:tasks.workunit.client.0.smithi110.stderr: -93> 2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:51.836 INFO:tasks.workunit.client.0.smithi110.stderr: -92> 2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:51.836 INFO:tasks.workunit.client.0.smithi110.stderr: -91> 2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:51.836 INFO:tasks.workunit.client.0.smithi110.stderr: -90> 2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:51.836 INFO:tasks.workunit.client.0.smithi110.stderr: -89> 2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:51.836 INFO:tasks.workunit.client.0.smithi110.stderr: -88> 2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:51.836 INFO:tasks.workunit.client.0.smithi110.stderr: -87> 2024-03-04T12:36:51.743+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.836 INFO:tasks.workunit.client.0.smithi110.stderr: -86> 2024-03-04T12:36:51.743+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.836 INFO:tasks.workunit.client.0.smithi110.stderr: -85> 2024-03-04T12:36:51.743+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.836 INFO:tasks.workunit.client.0.smithi110.stderr: -84> 2024-03-04T12:36:51.744+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:51.836 INFO:tasks.workunit.client.0.smithi110.stderr: -83> 2024-03-04T12:36:51.744+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.837 INFO:tasks.workunit.client.0.smithi110.stderr: -82> 2024-03-04T12:36:51.744+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:51.837 INFO:tasks.workunit.client.0.smithi110.stderr: -81> 2024-03-04T12:36:51.744+0000 7f107068c800 20 zone default found 2024-03-04T12:36:51.837 INFO:tasks.workunit.client.0.smithi110.stderr: -80> 2024-03-04T12:36:51.744+0000 7f107068c800 4 Realm: () 2024-03-04T12:36:51.837 INFO:tasks.workunit.client.0.smithi110.stderr: -79> 2024-03-04T12:36:51.744+0000 7f107068c800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:51.837 INFO:tasks.workunit.client.0.smithi110.stderr: -78> 2024-03-04T12:36:51.744+0000 7f107068c800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:51.837 INFO:tasks.workunit.client.0.smithi110.stderr: -77> 2024-03-04T12:36:51.744+0000 7f107068c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:51.837 INFO:tasks.workunit.client.0.smithi110.stderr: -76> 2024-03-04T12:36:51.744+0000 7f107068c800 20 zonegroup default 2024-03-04T12:36:51.837 INFO:tasks.workunit.client.0.smithi110.stderr: -75> 2024-03-04T12:36:51.744+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.837 INFO:tasks.workunit.client.0.smithi110.stderr: -74> 2024-03-04T12:36:51.744+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.837 INFO:tasks.workunit.client.0.smithi110.stderr: -73> 2024-03-04T12:36:51.744+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.837 INFO:tasks.workunit.client.0.smithi110.stderr: -72> 2024-03-04T12:36:51.745+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.837 INFO:tasks.workunit.client.0.smithi110.stderr: -71> 2024-03-04T12:36:51.745+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.837 INFO:tasks.workunit.client.0.smithi110.stderr: -70> 2024-03-04T12:36:51.745+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.837 INFO:tasks.workunit.client.0.smithi110.stderr: -69> 2024-03-04T12:36:51.745+0000 7f107068c800 20 started sync module instance, tier type = 2024-03-04T12:36:51.838 INFO:tasks.workunit.client.0.smithi110.stderr: -68> 2024-03-04T12:36:51.745+0000 7f107068c800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:51.838 INFO:tasks.workunit.client.0.smithi110.stderr: -67> 2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=0 2024-03-04T12:36:51.838 INFO:tasks.workunit.client.0.smithi110.stderr: -66> 2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=1 2024-03-04T12:36:51.838 INFO:tasks.workunit.client.0.smithi110.stderr: -65> 2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=2 2024-03-04T12:36:51.838 INFO:tasks.workunit.client.0.smithi110.stderr: -64> 2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=3 2024-03-04T12:36:51.838 INFO:tasks.workunit.client.0.smithi110.stderr: -63> 2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=4 2024-03-04T12:36:51.838 INFO:tasks.workunit.client.0.smithi110.stderr: -62> 2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=5 2024-03-04T12:36:51.838 INFO:tasks.workunit.client.0.smithi110.stderr: -61> 2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=6 2024-03-04T12:36:51.838 INFO:tasks.workunit.client.0.smithi110.stderr: -60> 2024-03-04T12:36:51.754+0000 7f107068c800 20 add_watcher() i=7 2024-03-04T12:36:51.838 INFO:tasks.workunit.client.0.smithi110.stderr: -59> 2024-03-04T12:36:51.754+0000 7f107068c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:51.838 INFO:tasks.workunit.client.0.smithi110.stderr: -58> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding auth protocol: cephx 2024-03-04T12:36:51.838 INFO:tasks.workunit.client.0.smithi110.stderr: -57> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding auth protocol: cephx 2024-03-04T12:36:51.838 INFO:tasks.workunit.client.0.smithi110.stderr: -56> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding auth protocol: cephx 2024-03-04T12:36:51.838 INFO:tasks.workunit.client.0.smithi110.stderr: -55> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: secure 2024-03-04T12:36:51.838 INFO:tasks.workunit.client.0.smithi110.stderr: -54> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: crc 2024-03-04T12:36:51.839 INFO:tasks.workunit.client.0.smithi110.stderr: -53> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: secure 2024-03-04T12:36:51.839 INFO:tasks.workunit.client.0.smithi110.stderr: -52> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: crc 2024-03-04T12:36:51.839 INFO:tasks.workunit.client.0.smithi110.stderr: -51> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: secure 2024-03-04T12:36:51.839 INFO:tasks.workunit.client.0.smithi110.stderr: -50> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: crc 2024-03-04T12:36:51.839 INFO:tasks.workunit.client.0.smithi110.stderr: -49> 2024-03-04T12:36:51.756+0000 7f0f24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:51.839 INFO:tasks.workunit.client.0.smithi110.stderr: -48> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: crc 2024-03-04T12:36:51.839 INFO:tasks.workunit.client.0.smithi110.stderr: -47> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: secure 2024-03-04T12:36:51.839 INFO:tasks.workunit.client.0.smithi110.stderr: -46> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: crc 2024-03-04T12:36:51.839 INFO:tasks.workunit.client.0.smithi110.stderr: -45> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: secure 2024-03-04T12:36:51.839 INFO:tasks.workunit.client.0.smithi110.stderr: -44> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: crc 2024-03-04T12:36:51.839 INFO:tasks.workunit.client.0.smithi110.stderr: -43> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: secure 2024-03-04T12:36:51.839 INFO:tasks.workunit.client.0.smithi110.stderr: -42> 2024-03-04T12:36:51.756+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.839 INFO:tasks.workunit.client.0.smithi110.stderr: -41> 2024-03-04T12:36:51.756+0000 7f107068c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:51.839 INFO:tasks.workunit.client.0.smithi110.stderr: -40> 2024-03-04T12:36:51.756+0000 7f107068c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:51.839 INFO:tasks.workunit.client.0.smithi110.stderr: -39> 2024-03-04T12:36:51.756+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command cache list hook 0x55da99eaed10 2024-03-04T12:36:51.840 INFO:tasks.workunit.client.0.smithi110.stderr: -38> 2024-03-04T12:36:51.756+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command cache inspect hook 0x55da99eaed10 2024-03-04T12:36:51.840 INFO:tasks.workunit.client.0.smithi110.stderr: -37> 2024-03-04T12:36:51.756+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command cache erase hook 0x55da99eaed10 2024-03-04T12:36:51.840 INFO:tasks.workunit.client.0.smithi110.stderr: -36> 2024-03-04T12:36:51.756+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command cache zap hook 0x55da99eaed10 2024-03-04T12:36:51.840 INFO:tasks.workunit.client.0.smithi110.stderr: -35> 2024-03-04T12:36:51.756+0000 7f107068c800 5 note: GC not initialized 2024-03-04T12:36:51.840 INFO:tasks.workunit.client.0.smithi110.stderr: -34> 2024-03-04T12:36:51.756+0000 7f0e9f7fe640 20 reqs_thread_entry: start 2024-03-04T12:36:51.840 INFO:tasks.workunit.client.0.smithi110.stderr: -33> 2024-03-04T12:36:51.756+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command sync trace show hook 0x7f106001d440 2024-03-04T12:36:51.840 INFO:tasks.workunit.client.0.smithi110.stderr: -32> 2024-03-04T12:36:51.756+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command sync trace history hook 0x7f106001d440 2024-03-04T12:36:51.840 INFO:tasks.workunit.client.0.smithi110.stderr: -31> 2024-03-04T12:36:51.756+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command sync trace active hook 0x7f106001d440 2024-03-04T12:36:51.840 INFO:tasks.workunit.client.0.smithi110.stderr: -30> 2024-03-04T12:36:51.756+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command sync trace active_short hook 0x7f106001d440 2024-03-04T12:36:51.840 INFO:tasks.workunit.client.0.smithi110.stderr: -29> 2024-03-04T12:36:51.756+0000 7f107068c800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:51.840 INFO:tasks.workunit.client.0.smithi110.stderr: -28> 2024-03-04T12:36:51.757+0000 7f107068c800 20 Filter name: none 2024-03-04T12:36:51.840 INFO:tasks.workunit.client.0.smithi110.stderr: -27> 2024-03-04T12:36:51.757+0000 7f0e9d7fa640 20 reqs_thread_entry: start 2024-03-04T12:36:51.840 INFO:tasks.workunit.client.0.smithi110.stderr: -26> 2024-03-04T12:36:51.757+0000 7f107068c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-04T12:36:51.840 INFO:tasks.workunit.client.0.smithi110.stderr: -25> 2024-03-04T12:36:51.757+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.841 INFO:tasks.workunit.client.0.smithi110.stderr: -24> 2024-03-04T12:36:51.757+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:36:51.841 INFO:tasks.workunit.client.0.smithi110.stderr: -23> 2024-03-04T12:36:51.757+0000 7f107068c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-04T12:36:51.841 INFO:tasks.workunit.client.0.smithi110.stderr: -22> 2024-03-04T12:36:51.757+0000 7f107068c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-04T12:36:51.841 INFO:tasks.workunit.client.0.smithi110.stderr: -21> 2024-03-04T12:36:51.757+0000 7f107068c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 : miss 2024-03-04T12:36:51.841 INFO:tasks.workunit.client.0.smithi110.stderr: -20> 2024-03-04T12:36:51.757+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.841 INFO:tasks.workunit.client.0.smithi110.stderr: -19> 2024-03-04T12:36:51.757+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=383 2024-03-04T12:36:51.841 INFO:tasks.workunit.client.0.smithi110.stderr: -18> 2024-03-04T12:36:51.757+0000 7f107068c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 info.flags=0x17 2024-03-04T12:36:51.841 INFO:tasks.workunit.client.0.smithi110.stderr: -17> 2024-03-04T12:36:51.757+0000 7f107068c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 to cache LRU end 2024-03-04T12:36:51.841 INFO:tasks.workunit.client.0.smithi110.stderr: -16> 2024-03-04T12:36:51.757+0000 7f107068c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:36:51.841 INFO:tasks.workunit.client.0.smithi110.stderr: -15> 2024-03-04T12:36:51.757+0000 7f107068c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:51.841 INFO:tasks.workunit.client.0.smithi110.stderr: -14> 2024-03-04T12:36:51.757+0000 7f107068c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 2024-03-04T12:36:51.841 INFO:tasks.workunit.client.0.smithi110.stderr: -13> 2024-03-04T12:36:51.762+0000 7f107068c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 info.flags=0x17 2024-03-04T12:36:51.841 INFO:tasks.workunit.client.0.smithi110.stderr: -12> 2024-03-04T12:36:51.762+0000 7f107068c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 to cache LRU end 2024-03-04T12:36:51.842 INFO:tasks.workunit.client.0.smithi110.stderr: -11> 2024-03-04T12:36:51.762+0000 7f107068c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:51.842 INFO:tasks.workunit.client.0.smithi110.stderr: -10> 2024-03-04T12:36:51.762+0000 7f107068c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29, ofs0, ns] 2024-03-04T12:36:51.842 INFO:tasks.workunit.client.0.smithi110.stderr: -9> 2024-03-04T12:36:51.762+0000 7f0f517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824005 cookie 94397373732944 notifier 6569 bl.length()=945 2024-03-04T12:36:51.842 INFO:tasks.workunit.client.0.smithi110.stderr: -8> 2024-03-04T12:36:51.763+0000 7f0f517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 info.flags=0x17 2024-03-04T12:36:51.842 INFO:tasks.workunit.client.0.smithi110.stderr: -7> 2024-03-04T12:36:51.763+0000 7f0f517fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 to cache LRU end 2024-03-04T12:36:51.842 INFO:tasks.workunit.client.0.smithi110.stderr: -6> 2024-03-04T12:36:51.763+0000 7f0f517fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:51.842 INFO:tasks.workunit.client.0.smithi110.stderr: -5> 2024-03-04T12:36:51.764+0000 7f107068c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): orig_sources= new_sources= 2024-03-04T12:36:51.842 INFO:tasks.workunit.client.0.smithi110.stderr: -4> 2024-03-04T12:36:51.764+0000 7f107068c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): potential sources added=[] removed=[] 2024-03-04T12:36:51.842 INFO:tasks.workunit.client.0.smithi110.stderr: -3> 2024-03-04T12:36:51.764+0000 7f107068c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): orig_dests= new_dests= 2024-03-04T12:36:51.842 INFO:tasks.workunit.client.0.smithi110.stderr: -2> 2024-03-04T12:36:51.764+0000 7f107068c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): potential dests added=[] removed=[] 2024-03-04T12:36:51.842 INFO:tasks.workunit.client.0.smithi110.stderr: -1> 2024-03-04T12:36:51.768+0000 7f107068c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f107068c800 time 2024-03-04T12:36:51.768303+0000 2024-03-04T12:36:51.842 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:36:51.842 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.843 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:36:51.843 INFO:tasks.workunit.client.0.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1073980e86] 2024-03-04T12:36:51.843 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1073981044] 2024-03-04T12:36:51.843 INFO:tasks.workunit.client.0.smithi110.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da9819ceb1] 2024-03-04T12:36:51.843 INFO:tasks.workunit.client.0.smithi110.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55da981b0de4] 2024-03-04T12:36:51.843 INFO:tasks.workunit.client.0.smithi110.stderr: 5: main() 2024-03-04T12:36:51.843 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f107283feb0] 2024-03-04T12:36:51.843 INFO:tasks.workunit.client.0.smithi110.stderr: 7: __libc_start_main() 2024-03-04T12:36:51.843 INFO:tasks.workunit.client.0.smithi110.stderr: 8: _start() 2024-03-04T12:36:51.843 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.843 INFO:tasks.workunit.client.0.smithi110.stderr: 0> 2024-03-04T12:36:51.768+0000 7f107068c800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:36:51.843 INFO:tasks.workunit.client.0.smithi110.stderr: in thread 7f107068c800 thread_name:radosgw-admin 2024-03-04T12:36:51.844 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.844 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:36:51.844 INFO:tasks.workunit.client.0.smithi110.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1072854db0] 2024-03-04T12:36:51.844 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f10728a154c] 2024-03-04T12:36:51.844 INFO:tasks.workunit.client.0.smithi110.stderr: 3: raise() 2024-03-04T12:36:51.844 INFO:tasks.workunit.client.0.smithi110.stderr: 4: abort() 2024-03-04T12:36:51.844 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1073980ee0] 2024-03-04T12:36:51.844 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1073981044] 2024-03-04T12:36:51.844 INFO:tasks.workunit.client.0.smithi110.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da9819ceb1] 2024-03-04T12:36:51.844 INFO:tasks.workunit.client.0.smithi110.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55da981b0de4] 2024-03-04T12:36:51.844 INFO:tasks.workunit.client.0.smithi110.stderr: 9: main() 2024-03-04T12:36:51.844 INFO:tasks.workunit.client.0.smithi110.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f107283feb0] 2024-03-04T12:36:51.844 INFO:tasks.workunit.client.0.smithi110.stderr: 11: __libc_start_main() 2024-03-04T12:36:51.844 INFO:tasks.workunit.client.0.smithi110.stderr: 12: _start() 2024-03-04T12:36:51.845 INFO:tasks.workunit.client.0.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:36:51.845 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.845 INFO:tasks.workunit.client.0.smithi110.stderr:--- logging levels --- 2024-03-04T12:36:51.845 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 none 2024-03-04T12:36:51.845 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 lockdep 2024-03-04T12:36:51.845 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 context 2024-03-04T12:36:51.845 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 crush 2024-03-04T12:36:51.845 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds 2024-03-04T12:36:51.845 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_balancer 2024-03-04T12:36:51.845 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_locker 2024-03-04T12:36:51.845 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_log 2024-03-04T12:36:51.845 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_log_expire 2024-03-04T12:36:51.845 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_migrator 2024-03-04T12:36:51.845 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 buffer 2024-03-04T12:36:51.846 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 timer 2024-03-04T12:36:51.846 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 filer 2024-03-04T12:36:51.846 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 striper 2024-03-04T12:36:51.846 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 objecter 2024-03-04T12:36:51.846 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rados 2024-03-04T12:36:51.846 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd 2024-03-04T12:36:51.846 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_mirror 2024-03-04T12:36:51.846 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_replay 2024-03-04T12:36:51.846 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_pwl 2024-03-04T12:36:51.846 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 journaler 2024-03-04T12:36:51.846 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 objectcacher 2024-03-04T12:36:51.846 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 immutable_obj_cache 2024-03-04T12:36:51.846 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 client 2024-03-04T12:36:51.846 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 osd 2024-03-04T12:36:51.846 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 optracker 2024-03-04T12:36:51.847 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 objclass 2024-03-04T12:36:51.847 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 filestore 2024-03-04T12:36:51.847 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 journal 2024-03-04T12:36:51.847 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 0 ms 2024-03-04T12:36:51.847 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mon 2024-03-04T12:36:51.847 INFO:tasks.workunit.client.0.smithi110.stderr: 0/10 monc 2024-03-04T12:36:51.847 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 paxos 2024-03-04T12:36:51.847 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 tp 2024-03-04T12:36:51.847 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 auth 2024-03-04T12:36:51.847 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 crypto 2024-03-04T12:36:51.847 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 finisher 2024-03-04T12:36:51.847 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 reserver 2024-03-04T12:36:51.847 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 heartbeatmap 2024-03-04T12:36:51.847 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 perfcounter 2024-03-04T12:36:51.848 INFO:tasks.workunit.client.0.smithi110.stderr: 20/20 rgw 2024-03-04T12:36:51.848 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_sync 2024-03-04T12:36:51.848 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_datacache 2024-03-04T12:36:51.848 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_access 2024-03-04T12:36:51.848 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_dbstore 2024-03-04T12:36:51.848 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_flight 2024-03-04T12:36:51.848 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_lifecycle 2024-03-04T12:36:51.848 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 javaclient 2024-03-04T12:36:51.848 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 asok 2024-03-04T12:36:51.848 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 throttle 2024-03-04T12:36:51.848 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 0 refs 2024-03-04T12:36:51.848 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 compressor 2024-03-04T12:36:51.848 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 bluestore 2024-03-04T12:36:51.848 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 bluefs 2024-03-04T12:36:51.849 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 bdev 2024-03-04T12:36:51.849 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 kstore 2024-03-04T12:36:51.849 INFO:tasks.workunit.client.0.smithi110.stderr: 4/ 5 rocksdb 2024-03-04T12:36:51.849 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 fuse 2024-03-04T12:36:51.849 INFO:tasks.workunit.client.0.smithi110.stderr: 2/ 5 mgr 2024-03-04T12:36:51.849 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mgrc 2024-03-04T12:36:51.849 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 dpdk 2024-03-04T12:36:51.849 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 eventtrace 2024-03-04T12:36:51.849 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 prioritycache 2024-03-04T12:36:51.849 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 test 2024-03-04T12:36:51.849 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cephfs_mirror 2024-03-04T12:36:51.849 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cephsqlite 2024-03-04T12:36:51.849 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 crimson_interrupt 2024-03-04T12:36:51.850 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore 2024-03-04T12:36:51.850 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_onode 2024-03-04T12:36:51.850 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_odata 2024-03-04T12:36:51.850 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_omap 2024-03-04T12:36:51.850 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_tm 2024-03-04T12:36:51.850 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_t 2024-03-04T12:36:51.850 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_cleaner 2024-03-04T12:36:51.850 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_epm 2024-03-04T12:36:51.850 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_lba 2024-03-04T12:36:51.850 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-04T12:36:51.850 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_cache 2024-03-04T12:36:51.850 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_journal 2024-03-04T12:36:51.850 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_device 2024-03-04T12:36:51.850 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_backref 2024-03-04T12:36:51.851 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 alienstore 2024-03-04T12:36:51.851 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mclock 2024-03-04T12:36:51.851 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cyanstore 2024-03-04T12:36:51.851 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 ceph_exporter 2024-03-04T12:36:51.851 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 memstore 2024-03-04T12:36:51.851 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 trace 2024-03-04T12:36:51.851 INFO:tasks.workunit.client.0.smithi110.stderr: -2/-2 (syslog threshold) 2024-03-04T12:36:51.851 INFO:tasks.workunit.client.0.smithi110.stderr: 99/99 (stderr threshold) 2024-03-04T12:36:51.851 INFO:tasks.workunit.client.0.smithi110.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-04T12:36:51.851 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0e9d7fa640 / http_manager 2024-03-04T12:36:51.851 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0e9f7fe640 / http_manager 2024-03-04T12:36:51.851 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0f24fe1640 / rgw_dt_lg_renew 2024-03-04T12:36:51.851 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0f3ffff640 / ms_dispatch 2024-03-04T12:36:51.851 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0f517fa640 / io_context_pool 2024-03-04T12:36:51.852 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0f51ffb640 / io_context_pool 2024-03-04T12:36:51.852 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0f53fff640 / ms_dispatch 2024-03-04T12:36:51.852 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0f5ae05640 / ms_dispatch 2024-03-04T12:36:51.852 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0f5c608640 / io_context_pool 2024-03-04T12:36:51.852 INFO:tasks.workunit.client.0.smithi110.stderr: 7f1065987640 / msgr-worker-2 2024-03-04T12:36:51.852 INFO:tasks.workunit.client.0.smithi110.stderr: 7f106e188640 / msgr-worker-1 2024-03-04T12:36:51.852 INFO:tasks.workunit.client.0.smithi110.stderr: 7f106e989640 / msgr-worker-0 2024-03-04T12:36:51.852 INFO:tasks.workunit.client.0.smithi110.stderr: 7f106f18a640 / io_context_pool 2024-03-04T12:36:51.852 INFO:tasks.workunit.client.0.smithi110.stderr: 7f107068c800 / radosgw-admin 2024-03-04T12:36:51.852 INFO:tasks.workunit.client.0.smithi110.stderr: max_recent 500 2024-03-04T12:36:51.852 INFO:tasks.workunit.client.0.smithi110.stderr: max_new 1000 2024-03-04T12:36:51.852 INFO:tasks.workunit.client.0.smithi110.stderr: log_file /var/log/ceph/ceph-client.admin.111700.log 2024-03-04T12:36:51.852 INFO:tasks.workunit.client.0.smithi110.stderr:--- end dump of recent events --- 2024-03-04T12:36:51.853 INFO:tasks.workunit.client.0.smithi110.stderr:--- begin dump of recent events --- 2024-03-04T12:36:51.853 INFO:tasks.workunit.client.0.smithi110.stderr: -499> 2024-03-04T12:36:51.513+0000 7f0f5c608640 10 monclient: _finish_auth 0 2024-03-04T12:36:51.853 INFO:tasks.workunit.client.0.smithi110.stderr: -498> 2024-03-04T12:36:51.513+0000 7f0f5c608640 10 monclient: _check_auth_tickets 2024-03-04T12:36:51.853 INFO:tasks.workunit.client.0.smithi110.stderr: -497> 2024-03-04T12:36:51.513+0000 7f0f5c608640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:51.853 INFO:tasks.workunit.client.0.smithi110.stderr: -496> 2024-03-04T12:36:51.513+0000 7f0f5c608640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.853 INFO:tasks.workunit.client.0.smithi110.stderr: -495> 2024-03-04T12:36:51.513+0000 7f0f5c608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:36:51.853 INFO:tasks.workunit.client.0.smithi110.stderr: -494> 2024-03-04T12:36:51.513+0000 7f0f5c608640 10 monclient: dump: 2024-03-04T12:36:51.853 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.853 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.853 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.853 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.853 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.853 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.854 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.854 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.854 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.854 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.854 INFO:tasks.workunit.client.0.smithi110.stderr: -493> 2024-03-04T12:36:51.513+0000 7f107068c800 5 monclient: authenticate success, global_id 6557 2024-03-04T12:36:51.854 INFO:tasks.workunit.client.0.smithi110.stderr: -492> 2024-03-04T12:36:51.513+0000 7f107068c800 10 monclient: get_monmap_and_config success 2024-03-04T12:36:51.854 INFO:tasks.workunit.client.0.smithi110.stderr: -491> 2024-03-04T12:36:51.513+0000 7f107068c800 4 set_mon_vals no callback set 2024-03-04T12:36:51.854 INFO:tasks.workunit.client.0.smithi110.stderr: -490> 2024-03-04T12:36:51.514+0000 7f107068c800 10 monclient: shutdown 2024-03-04T12:36:51.854 INFO:tasks.workunit.client.0.smithi110.stderr: -489> 2024-03-04T12:36:51.514+0000 7f107068c800 5 asok(0x55da99bc00c0) unregister_commands rotate-key 2024-03-04T12:36:51.854 INFO:tasks.workunit.client.0.smithi110.stderr: -488> 2024-03-04T12:36:51.514+0000 7f107068c800 10 monclient: build_initial_monmap 2024-03-04T12:36:51.854 INFO:tasks.workunit.client.0.smithi110.stderr: -487> 2024-03-04T12:36:51.514+0000 7f107068c800 1 build_initial for_mkfs: 0 2024-03-04T12:36:51.854 INFO:tasks.workunit.client.0.smithi110.stderr: -486> 2024-03-04T12:36:51.514+0000 7f107068c800 10 monclient: monmap: 2024-03-04T12:36:51.854 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:36:51.854 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:36:51.854 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:36:51.855 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:36:51.855 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:36:51.855 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.855 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:36:51.855 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:36:51.855 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:36:51.855 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.855 INFO:tasks.workunit.client.0.smithi110.stderr: -485> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding auth protocol: cephx 2024-03-04T12:36:51.855 INFO:tasks.workunit.client.0.smithi110.stderr: -484> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding auth protocol: cephx 2024-03-04T12:36:51.855 INFO:tasks.workunit.client.0.smithi110.stderr: -483> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding auth protocol: cephx 2024-03-04T12:36:51.855 INFO:tasks.workunit.client.0.smithi110.stderr: -482> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: secure 2024-03-04T12:36:51.855 INFO:tasks.workunit.client.0.smithi110.stderr: -481> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: crc 2024-03-04T12:36:51.855 INFO:tasks.workunit.client.0.smithi110.stderr: -480> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: secure 2024-03-04T12:36:51.855 INFO:tasks.workunit.client.0.smithi110.stderr: -479> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: crc 2024-03-04T12:36:51.856 INFO:tasks.workunit.client.0.smithi110.stderr: -478> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: secure 2024-03-04T12:36:51.856 INFO:tasks.workunit.client.0.smithi110.stderr: -477> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: crc 2024-03-04T12:36:51.856 INFO:tasks.workunit.client.0.smithi110.stderr: -476> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: crc 2024-03-04T12:36:51.856 INFO:tasks.workunit.client.0.smithi110.stderr: -475> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: secure 2024-03-04T12:36:51.856 INFO:tasks.workunit.client.0.smithi110.stderr: -474> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: crc 2024-03-04T12:36:51.856 INFO:tasks.workunit.client.0.smithi110.stderr: -473> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: secure 2024-03-04T12:36:51.856 INFO:tasks.workunit.client.0.smithi110.stderr: -472> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: crc 2024-03-04T12:36:51.856 INFO:tasks.workunit.client.0.smithi110.stderr: -471> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99de4750) adding con mode: secure 2024-03-04T12:36:51.856 INFO:tasks.workunit.client.0.smithi110.stderr: -470> 2024-03-04T12:36:51.514+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.856 INFO:tasks.workunit.client.0.smithi110.stderr: -469> 2024-03-04T12:36:51.514+0000 7f107068c800 1 librados: starting msgr at 2024-03-04T12:36:51.856 INFO:tasks.workunit.client.0.smithi110.stderr: -468> 2024-03-04T12:36:51.514+0000 7f107068c800 1 librados: starting objecter 2024-03-04T12:36:51.856 INFO:tasks.workunit.client.0.smithi110.stderr: -467> 2024-03-04T12:36:51.514+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command objecter_requests hook 0x55da99e093f0 2024-03-04T12:36:51.856 INFO:tasks.workunit.client.0.smithi110.stderr: -466> 2024-03-04T12:36:51.514+0000 7f107068c800 1 librados: setting wanted keys 2024-03-04T12:36:51.856 INFO:tasks.workunit.client.0.smithi110.stderr: -465> 2024-03-04T12:36:51.514+0000 7f107068c800 1 librados: calling monclient init 2024-03-04T12:36:51.857 INFO:tasks.workunit.client.0.smithi110.stderr: -464> 2024-03-04T12:36:51.514+0000 7f107068c800 10 monclient: init 2024-03-04T12:36:51.857 INFO:tasks.workunit.client.0.smithi110.stderr: -463> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding auth protocol: cephx 2024-03-04T12:36:51.857 INFO:tasks.workunit.client.0.smithi110.stderr: -462> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding auth protocol: cephx 2024-03-04T12:36:51.857 INFO:tasks.workunit.client.0.smithi110.stderr: -461> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding auth protocol: cephx 2024-03-04T12:36:51.857 INFO:tasks.workunit.client.0.smithi110.stderr: -460> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: secure 2024-03-04T12:36:51.857 INFO:tasks.workunit.client.0.smithi110.stderr: -459> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: crc 2024-03-04T12:36:51.857 INFO:tasks.workunit.client.0.smithi110.stderr: -458> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: secure 2024-03-04T12:36:51.857 INFO:tasks.workunit.client.0.smithi110.stderr: -457> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: crc 2024-03-04T12:36:51.857 INFO:tasks.workunit.client.0.smithi110.stderr: -456> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: secure 2024-03-04T12:36:51.857 INFO:tasks.workunit.client.0.smithi110.stderr: -455> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: crc 2024-03-04T12:36:51.857 INFO:tasks.workunit.client.0.smithi110.stderr: -454> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: crc 2024-03-04T12:36:51.857 INFO:tasks.workunit.client.0.smithi110.stderr: -453> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: secure 2024-03-04T12:36:51.857 INFO:tasks.workunit.client.0.smithi110.stderr: -452> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: crc 2024-03-04T12:36:51.857 INFO:tasks.workunit.client.0.smithi110.stderr: -451> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: secure 2024-03-04T12:36:51.858 INFO:tasks.workunit.client.0.smithi110.stderr: -450> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: crc 2024-03-04T12:36:51.858 INFO:tasks.workunit.client.0.smithi110.stderr: -449> 2024-03-04T12:36:51.514+0000 7f107068c800 5 AuthRegistry(0x55da99dddbb0) adding con mode: secure 2024-03-04T12:36:51.858 INFO:tasks.workunit.client.0.smithi110.stderr: -448> 2024-03-04T12:36:51.514+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.858 INFO:tasks.workunit.client.0.smithi110.stderr: -447> 2024-03-04T12:36:51.515+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.858 INFO:tasks.workunit.client.0.smithi110.stderr: -446> 2024-03-04T12:36:51.515+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command rotate-key hook 0x55da99dddcf8 2024-03-04T12:36:51.858 INFO:tasks.workunit.client.0.smithi110.stderr: -445> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient: _reopen_session rank -1 2024-03-04T12:36:51.858 INFO:tasks.workunit.client.0.smithi110.stderr: -444> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:36:51.858 INFO:tasks.workunit.client.0.smithi110.stderr: -443> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient(hunting): picked mon.noname-b con 0x55da99c66b40 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:36:51.858 INFO:tasks.workunit.client.0.smithi110.stderr: -442> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient(hunting): picked mon.noname-c con 0x55da99c8ad20 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:36:51.858 INFO:tasks.workunit.client.0.smithi110.stderr: -441> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient(hunting): picked mon.noname-a con 0x55da99de41c0 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:36:51.858 INFO:tasks.workunit.client.0.smithi110.stderr: -440> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.858 INFO:tasks.workunit.client.0.smithi110.stderr: -439> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.858 INFO:tasks.workunit.client.0.smithi110.stderr: -438> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.859 INFO:tasks.workunit.client.0.smithi110.stderr: -437> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient(hunting): _renew_subs 2024-03-04T12:36:51.859 INFO:tasks.workunit.client.0.smithi110.stderr: -436> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient(hunting): authenticate will time out at 1792.874276s 2024-03-04T12:36:51.859 INFO:tasks.workunit.client.0.smithi110.stderr: -435> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient(hunting): get_auth_request con 0x55da99c8ad20 auth_method 0 2024-03-04T12:36:51.859 INFO:tasks.workunit.client.0.smithi110.stderr: -434> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.859 INFO:tasks.workunit.client.0.smithi110.stderr: -433> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.859 INFO:tasks.workunit.client.0.smithi110.stderr: -432> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.859 INFO:tasks.workunit.client.0.smithi110.stderr: -431> 2024-03-04T12:36:51.515+0000 7f106e989640 10 monclient(hunting): get_auth_request con 0x55da99de41c0 auth_method 0 2024-03-04T12:36:51.859 INFO:tasks.workunit.client.0.smithi110.stderr: -430> 2024-03-04T12:36:51.515+0000 7f106e989640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.859 INFO:tasks.workunit.client.0.smithi110.stderr: -429> 2024-03-04T12:36:51.515+0000 7f106e989640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.859 INFO:tasks.workunit.client.0.smithi110.stderr: -428> 2024-03-04T12:36:51.515+0000 7f106e989640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.859 INFO:tasks.workunit.client.0.smithi110.stderr: -427> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.859 INFO:tasks.workunit.client.0.smithi110.stderr: -426> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.859 INFO:tasks.workunit.client.0.smithi110.stderr: -425> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.859 INFO:tasks.workunit.client.0.smithi110.stderr: -424> 2024-03-04T12:36:51.515+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.860 INFO:tasks.workunit.client.0.smithi110.stderr: -423> 2024-03-04T12:36:51.515+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.860 INFO:tasks.workunit.client.0.smithi110.stderr: -422> 2024-03-04T12:36:51.515+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.860 INFO:tasks.workunit.client.0.smithi110.stderr: -421> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient(hunting): handle_auth_done global_id 6560 payload 824 2024-03-04T12:36:51.860 INFO:tasks.workunit.client.0.smithi110.stderr: -420> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient: _finish_hunting 0 2024-03-04T12:36:51.860 INFO:tasks.workunit.client.0.smithi110.stderr: -419> 2024-03-04T12:36:51.515+0000 7f1065987640 1 monclient: found mon.noname-c 2024-03-04T12:36:51.860 INFO:tasks.workunit.client.0.smithi110.stderr: -418> 2024-03-04T12:36:51.515+0000 7f1065987640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.860 INFO:tasks.workunit.client.0.smithi110.stderr: -417> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.860 INFO:tasks.workunit.client.0.smithi110.stderr: -416> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:36:51.860 INFO:tasks.workunit.client.0.smithi110.stderr: -415> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: dump: 2024-03-04T12:36:51.860 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.860 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.860 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.860 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.860 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.861 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.861 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.861 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.861 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.861 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.861 INFO:tasks.workunit.client.0.smithi110.stderr: -414> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: _finish_auth 0 2024-03-04T12:36:51.861 INFO:tasks.workunit.client.0.smithi110.stderr: -413> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: _check_auth_tickets 2024-03-04T12:36:51.861 INFO:tasks.workunit.client.0.smithi110.stderr: -412> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:51.861 INFO:tasks.workunit.client.0.smithi110.stderr: -411> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.861 INFO:tasks.workunit.client.0.smithi110.stderr: -410> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:36:51.861 INFO:tasks.workunit.client.0.smithi110.stderr: -409> 2024-03-04T12:36:51.515+0000 7f0f5ae05640 10 monclient: dump: 2024-03-04T12:36:51.861 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.861 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.861 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.862 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.862 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.862 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.862 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.862 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.862 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.862 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.862 INFO:tasks.workunit.client.0.smithi110.stderr: -408> 2024-03-04T12:36:51.515+0000 7f107068c800 5 monclient: authenticate success, global_id 6560 2024-03-04T12:36:51.862 INFO:tasks.workunit.client.0.smithi110.stderr: -407> 2024-03-04T12:36:51.515+0000 7f0f5c608640 4 set_mon_vals no callback set 2024-03-04T12:36:51.862 INFO:tasks.workunit.client.0.smithi110.stderr: -406> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient: _renew_subs 2024-03-04T12:36:51.862 INFO:tasks.workunit.client.0.smithi110.stderr: -405> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.862 INFO:tasks.workunit.client.0.smithi110.stderr: -404> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient: _renew_subs 2024-03-04T12:36:51.862 INFO:tasks.workunit.client.0.smithi110.stderr: -403> 2024-03-04T12:36:51.515+0000 7f107068c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.863 INFO:tasks.workunit.client.0.smithi110.stderr: -402> 2024-03-04T12:36:51.515+0000 7f107068c800 1 librados: init done 2024-03-04T12:36:51.863 INFO:tasks.workunit.client.0.smithi110.stderr: -401> 2024-03-04T12:36:51.517+0000 7f0f5ae05640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:36:51.863 INFO:tasks.workunit.client.0.smithi110.stderr: -400> 2024-03-04T12:36:51.517+0000 7f0f5ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:51.863 INFO:tasks.workunit.client.0.smithi110.stderr: -399> 2024-03-04T12:36:51.517+0000 7f0f5ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:51.863 INFO:tasks.workunit.client.0.smithi110.stderr: -398> 2024-03-04T12:36:51.517+0000 7f106e188640 10 monclient: get_auth_request con 0x7f0f54069eb0 auth_method 0 2024-03-04T12:36:51.863 INFO:tasks.workunit.client.0.smithi110.stderr: -397> 2024-03-04T12:36:51.517+0000 7f106e989640 10 monclient: get_auth_request con 0x55da99de7370 auth_method 0 2024-03-04T12:36:51.863 INFO:tasks.workunit.client.0.smithi110.stderr: -396> 2024-03-04T12:36:51.518+0000 7f106e188640 10 monclient: get_auth_request con 0x55da99e29b90 auth_method 0 2024-03-04T12:36:51.863 INFO:tasks.workunit.client.0.smithi110.stderr: -395> 2024-03-04T12:36:51.519+0000 7f1065987640 10 monclient: get_auth_request con 0x55da99e2d410 auth_method 0 2024-03-04T12:36:51.863 INFO:tasks.workunit.client.0.smithi110.stderr: -394> 2024-03-04T12:36:51.520+0000 7f107068c800 10 monclient: build_initial_monmap 2024-03-04T12:36:51.863 INFO:tasks.workunit.client.0.smithi110.stderr: -393> 2024-03-04T12:36:51.520+0000 7f107068c800 1 build_initial for_mkfs: 0 2024-03-04T12:36:51.863 INFO:tasks.workunit.client.0.smithi110.stderr: -392> 2024-03-04T12:36:51.520+0000 7f107068c800 10 monclient: monmap: 2024-03-04T12:36:51.863 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:36:51.863 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:36:51.863 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:36:51.864 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:36:51.864 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:36:51.864 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.864 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:36:51.864 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:36:51.864 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:36:51.864 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.864 INFO:tasks.workunit.client.0.smithi110.stderr: -391> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding auth protocol: cephx 2024-03-04T12:36:51.864 INFO:tasks.workunit.client.0.smithi110.stderr: -390> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding auth protocol: cephx 2024-03-04T12:36:51.864 INFO:tasks.workunit.client.0.smithi110.stderr: -389> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding auth protocol: cephx 2024-03-04T12:36:51.864 INFO:tasks.workunit.client.0.smithi110.stderr: -388> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: secure 2024-03-04T12:36:51.864 INFO:tasks.workunit.client.0.smithi110.stderr: -387> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: crc 2024-03-04T12:36:51.864 INFO:tasks.workunit.client.0.smithi110.stderr: -386> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: secure 2024-03-04T12:36:51.865 INFO:tasks.workunit.client.0.smithi110.stderr: -385> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: crc 2024-03-04T12:36:51.865 INFO:tasks.workunit.client.0.smithi110.stderr: -384> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: secure 2024-03-04T12:36:51.865 INFO:tasks.workunit.client.0.smithi110.stderr: -383> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: crc 2024-03-04T12:36:51.865 INFO:tasks.workunit.client.0.smithi110.stderr: -382> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: crc 2024-03-04T12:36:51.867 INFO:tasks.workunit.client.0.smithi110.stderr: -381> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: secure 2024-03-04T12:36:51.867 INFO:tasks.workunit.client.0.smithi110.stderr: -380> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: crc 2024-03-04T12:36:51.867 INFO:tasks.workunit.client.0.smithi110.stderr: -379> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: secure 2024-03-04T12:36:51.867 INFO:tasks.workunit.client.0.smithi110.stderr: -378> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: crc 2024-03-04T12:36:51.867 INFO:tasks.workunit.client.0.smithi110.stderr: -377> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e32df0) adding con mode: secure 2024-03-04T12:36:51.867 INFO:tasks.workunit.client.0.smithi110.stderr: -376> 2024-03-04T12:36:51.520+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.867 INFO:tasks.workunit.client.0.smithi110.stderr: -375> 2024-03-04T12:36:51.520+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command objecter_requests cmddesc objecter_requests hook 0x55da99e36b50 EEXIST 2024-03-04T12:36:51.868 INFO:tasks.workunit.client.0.smithi110.stderr: -374> 2024-03-04T12:36:51.520+0000 7f107068c800 10 monclient: init 2024-03-04T12:36:51.868 INFO:tasks.workunit.client.0.smithi110.stderr: -373> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding auth protocol: cephx 2024-03-04T12:36:51.868 INFO:tasks.workunit.client.0.smithi110.stderr: -372> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding auth protocol: cephx 2024-03-04T12:36:51.868 INFO:tasks.workunit.client.0.smithi110.stderr: -371> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding auth protocol: cephx 2024-03-04T12:36:51.868 INFO:tasks.workunit.client.0.smithi110.stderr: -370> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: secure 2024-03-04T12:36:51.868 INFO:tasks.workunit.client.0.smithi110.stderr: -369> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: crc 2024-03-04T12:36:51.868 INFO:tasks.workunit.client.0.smithi110.stderr: -368> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: secure 2024-03-04T12:36:51.868 INFO:tasks.workunit.client.0.smithi110.stderr: -367> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: crc 2024-03-04T12:36:51.868 INFO:tasks.workunit.client.0.smithi110.stderr: -366> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: secure 2024-03-04T12:36:51.868 INFO:tasks.workunit.client.0.smithi110.stderr: -365> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: crc 2024-03-04T12:36:51.868 INFO:tasks.workunit.client.0.smithi110.stderr: -364> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: crc 2024-03-04T12:36:51.868 INFO:tasks.workunit.client.0.smithi110.stderr: -363> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: secure 2024-03-04T12:36:51.868 INFO:tasks.workunit.client.0.smithi110.stderr: -362> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: crc 2024-03-04T12:36:51.869 INFO:tasks.workunit.client.0.smithi110.stderr: -361> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: secure 2024-03-04T12:36:51.869 INFO:tasks.workunit.client.0.smithi110.stderr: -360> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: crc 2024-03-04T12:36:51.869 INFO:tasks.workunit.client.0.smithi110.stderr: -359> 2024-03-04T12:36:51.520+0000 7f107068c800 5 AuthRegistry(0x55da99e31dd8) adding con mode: secure 2024-03-04T12:36:51.869 INFO:tasks.workunit.client.0.smithi110.stderr: -358> 2024-03-04T12:36:51.521+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.869 INFO:tasks.workunit.client.0.smithi110.stderr: -357> 2024-03-04T12:36:51.521+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.869 INFO:tasks.workunit.client.0.smithi110.stderr: -356> 2024-03-04T12:36:51.521+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command rotate-key cmddesc rotate-key hook 0x55da99e31f20 EEXIST 2024-03-04T12:36:51.869 INFO:tasks.workunit.client.0.smithi110.stderr: -355> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient: _reopen_session rank -1 2024-03-04T12:36:51.869 INFO:tasks.workunit.client.0.smithi110.stderr: -354> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-04T12:36:51.869 INFO:tasks.workunit.client.0.smithi110.stderr: -353> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient(hunting): picked mon.noname-b con 0x55da99e5d380 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:36:51.869 INFO:tasks.workunit.client.0.smithi110.stderr: -352> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient(hunting): picked mon.noname-c con 0x55da99e5d760 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:36:51.869 INFO:tasks.workunit.client.0.smithi110.stderr: -351> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient(hunting): picked mon.noname-a con 0x55da99e70110 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:36:51.869 INFO:tasks.workunit.client.0.smithi110.stderr: -350> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.869 INFO:tasks.workunit.client.0.smithi110.stderr: -349> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.870 INFO:tasks.workunit.client.0.smithi110.stderr: -348> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.870 INFO:tasks.workunit.client.0.smithi110.stderr: -347> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient(hunting): _renew_subs 2024-03-04T12:36:51.870 INFO:tasks.workunit.client.0.smithi110.stderr: -346> 2024-03-04T12:36:51.521+0000 7f107068c800 10 monclient(hunting): authenticate will time out at 1792.880473s 2024-03-04T12:36:51.870 INFO:tasks.workunit.client.0.smithi110.stderr: -345> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient(hunting): get_auth_request con 0x55da99e5d760 auth_method 0 2024-03-04T12:36:51.870 INFO:tasks.workunit.client.0.smithi110.stderr: -344> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.870 INFO:tasks.workunit.client.0.smithi110.stderr: -343> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.870 INFO:tasks.workunit.client.0.smithi110.stderr: -342> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.870 INFO:tasks.workunit.client.0.smithi110.stderr: -341> 2024-03-04T12:36:51.521+0000 7f106e989640 10 monclient(hunting): get_auth_request con 0x55da99e70110 auth_method 0 2024-03-04T12:36:51.870 INFO:tasks.workunit.client.0.smithi110.stderr: -340> 2024-03-04T12:36:51.521+0000 7f106e989640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.870 INFO:tasks.workunit.client.0.smithi110.stderr: -339> 2024-03-04T12:36:51.521+0000 7f106e989640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.870 INFO:tasks.workunit.client.0.smithi110.stderr: -338> 2024-03-04T12:36:51.521+0000 7f106e989640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.870 INFO:tasks.workunit.client.0.smithi110.stderr: -337> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.870 INFO:tasks.workunit.client.0.smithi110.stderr: -336> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.870 INFO:tasks.workunit.client.0.smithi110.stderr: -335> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.870 INFO:tasks.workunit.client.0.smithi110.stderr: -334> 2024-03-04T12:36:51.521+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.871 INFO:tasks.workunit.client.0.smithi110.stderr: -333> 2024-03-04T12:36:51.521+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.871 INFO:tasks.workunit.client.0.smithi110.stderr: -332> 2024-03-04T12:36:51.521+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.871 INFO:tasks.workunit.client.0.smithi110.stderr: -331> 2024-03-04T12:36:51.521+0000 7f106e188640 10 monclient(hunting): get_auth_request con 0x55da99e5d380 auth_method 0 2024-03-04T12:36:51.871 INFO:tasks.workunit.client.0.smithi110.stderr: -330> 2024-03-04T12:36:51.521+0000 7f106e188640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.871 INFO:tasks.workunit.client.0.smithi110.stderr: -329> 2024-03-04T12:36:51.521+0000 7f106e188640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.871 INFO:tasks.workunit.client.0.smithi110.stderr: -328> 2024-03-04T12:36:51.521+0000 7f106e188640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.871 INFO:tasks.workunit.client.0.smithi110.stderr: -327> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient(hunting): handle_auth_done global_id 6563 payload 824 2024-03-04T12:36:51.871 INFO:tasks.workunit.client.0.smithi110.stderr: -326> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient: _finish_hunting 0 2024-03-04T12:36:51.871 INFO:tasks.workunit.client.0.smithi110.stderr: -325> 2024-03-04T12:36:51.521+0000 7f1065987640 1 monclient: found mon.noname-c 2024-03-04T12:36:51.871 INFO:tasks.workunit.client.0.smithi110.stderr: -324> 2024-03-04T12:36:51.521+0000 7f1065987640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.871 INFO:tasks.workunit.client.0.smithi110.stderr: -323> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.871 INFO:tasks.workunit.client.0.smithi110.stderr: -322> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:36:51.871 INFO:tasks.workunit.client.0.smithi110.stderr: -321> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: dump: 2024-03-04T12:36:51.871 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.871 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.872 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.872 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.872 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.872 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.872 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.872 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.872 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.872 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.872 INFO:tasks.workunit.client.0.smithi110.stderr: -320> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: _finish_auth 0 2024-03-04T12:36:51.872 INFO:tasks.workunit.client.0.smithi110.stderr: -319> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: _check_auth_tickets 2024-03-04T12:36:51.872 INFO:tasks.workunit.client.0.smithi110.stderr: -318> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:51.872 INFO:tasks.workunit.client.0.smithi110.stderr: -317> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.872 INFO:tasks.workunit.client.0.smithi110.stderr: -316> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:36:51.873 INFO:tasks.workunit.client.0.smithi110.stderr: -315> 2024-03-04T12:36:51.522+0000 7f0f53fff640 10 monclient: dump: 2024-03-04T12:36:51.873 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.873 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.873 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.873 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.873 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.873 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.873 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.873 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.873 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.873 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.873 INFO:tasks.workunit.client.0.smithi110.stderr: -314> 2024-03-04T12:36:51.522+0000 7f106f18a640 4 set_mon_vals no callback set 2024-03-04T12:36:51.873 INFO:tasks.workunit.client.0.smithi110.stderr: -313> 2024-03-04T12:36:51.522+0000 7f107068c800 5 monclient: authenticate success, global_id 6563 2024-03-04T12:36:51.873 INFO:tasks.workunit.client.0.smithi110.stderr: -312> 2024-03-04T12:36:51.522+0000 7f107068c800 10 monclient: _renew_subs 2024-03-04T12:36:51.873 INFO:tasks.workunit.client.0.smithi110.stderr: -311> 2024-03-04T12:36:51.522+0000 7f107068c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.874 INFO:tasks.workunit.client.0.smithi110.stderr: -310> 2024-03-04T12:36:51.522+0000 7f107068c800 10 monclient: _renew_subs 2024-03-04T12:36:51.874 INFO:tasks.workunit.client.0.smithi110.stderr: -309> 2024-03-04T12:36:51.522+0000 7f107068c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.874 INFO:tasks.workunit.client.0.smithi110.stderr: -308> 2024-03-04T12:36:51.523+0000 7f0f53fff640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:36:51.874 INFO:tasks.workunit.client.0.smithi110.stderr: -307> 2024-03-04T12:36:51.523+0000 7f0f53fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:51.874 INFO:tasks.workunit.client.0.smithi110.stderr: -306> 2024-03-04T12:36:51.523+0000 7f0f53fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:51.874 INFO:tasks.workunit.client.0.smithi110.stderr: -305> 2024-03-04T12:36:51.523+0000 7f106e188640 10 monclient: get_auth_request con 0x7f0f48069df0 auth_method 0 2024-03-04T12:36:51.874 INFO:tasks.workunit.client.0.smithi110.stderr: -304> 2024-03-04T12:36:51.523+0000 7f107068c800 10 monclient: get_monmap_and_config 2024-03-04T12:36:51.874 INFO:tasks.workunit.client.0.smithi110.stderr: -303> 2024-03-04T12:36:51.523+0000 7f107068c800 10 monclient: build_initial_monmap 2024-03-04T12:36:51.874 INFO:tasks.workunit.client.0.smithi110.stderr: -302> 2024-03-04T12:36:51.523+0000 7f107068c800 1 build_initial for_mkfs: 0 2024-03-04T12:36:51.874 INFO:tasks.workunit.client.0.smithi110.stderr: -301> 2024-03-04T12:36:51.523+0000 7f107068c800 10 monclient: monmap: 2024-03-04T12:36:51.874 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:36:51.874 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:36:51.874 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:36:51.874 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:36:51.874 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:36:51.875 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.875 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:36:51.875 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:36:51.875 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:36:51.875 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.875 INFO:tasks.workunit.client.0.smithi110.stderr: -300> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding auth protocol: cephx 2024-03-04T12:36:51.875 INFO:tasks.workunit.client.0.smithi110.stderr: -299> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding auth protocol: cephx 2024-03-04T12:36:51.875 INFO:tasks.workunit.client.0.smithi110.stderr: -298> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding auth protocol: cephx 2024-03-04T12:36:51.875 INFO:tasks.workunit.client.0.smithi110.stderr: -297> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: secure 2024-03-04T12:36:51.875 INFO:tasks.workunit.client.0.smithi110.stderr: -296> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: crc 2024-03-04T12:36:51.875 INFO:tasks.workunit.client.0.smithi110.stderr: -295> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: secure 2024-03-04T12:36:51.875 INFO:tasks.workunit.client.0.smithi110.stderr: -294> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: crc 2024-03-04T12:36:51.875 INFO:tasks.workunit.client.0.smithi110.stderr: -293> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: secure 2024-03-04T12:36:51.875 INFO:tasks.workunit.client.0.smithi110.stderr: -292> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: crc 2024-03-04T12:36:51.876 INFO:tasks.workunit.client.0.smithi110.stderr: -291> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: crc 2024-03-04T12:36:51.876 INFO:tasks.workunit.client.0.smithi110.stderr: -290> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: secure 2024-03-04T12:36:51.876 INFO:tasks.workunit.client.0.smithi110.stderr: -289> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: crc 2024-03-04T12:36:51.876 INFO:tasks.workunit.client.0.smithi110.stderr: -288> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: secure 2024-03-04T12:36:51.876 INFO:tasks.workunit.client.0.smithi110.stderr: -287> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: crc 2024-03-04T12:36:51.876 INFO:tasks.workunit.client.0.smithi110.stderr: -286> 2024-03-04T12:36:51.523+0000 7f107068c800 5 AuthRegistry(0x55da99e7a8e0) adding con mode: secure 2024-03-04T12:36:51.876 INFO:tasks.workunit.client.0.smithi110.stderr: -285> 2024-03-04T12:36:51.524+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.876 INFO:tasks.workunit.client.0.smithi110.stderr: -284> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient: init 2024-03-04T12:36:51.876 INFO:tasks.workunit.client.0.smithi110.stderr: -283> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding auth protocol: cephx 2024-03-04T12:36:51.876 INFO:tasks.workunit.client.0.smithi110.stderr: -282> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding auth protocol: cephx 2024-03-04T12:36:51.876 INFO:tasks.workunit.client.0.smithi110.stderr: -281> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding auth protocol: cephx 2024-03-04T12:36:51.876 INFO:tasks.workunit.client.0.smithi110.stderr: -280> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: secure 2024-03-04T12:36:51.876 INFO:tasks.workunit.client.0.smithi110.stderr: -279> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: crc 2024-03-04T12:36:51.877 INFO:tasks.workunit.client.0.smithi110.stderr: -278> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: secure 2024-03-04T12:36:51.877 INFO:tasks.workunit.client.0.smithi110.stderr: -277> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: crc 2024-03-04T12:36:51.877 INFO:tasks.workunit.client.0.smithi110.stderr: -276> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: secure 2024-03-04T12:36:51.877 INFO:tasks.workunit.client.0.smithi110.stderr: -275> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: crc 2024-03-04T12:36:51.877 INFO:tasks.workunit.client.0.smithi110.stderr: -274> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: crc 2024-03-04T12:36:51.877 INFO:tasks.workunit.client.0.smithi110.stderr: -273> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: secure 2024-03-04T12:36:51.877 INFO:tasks.workunit.client.0.smithi110.stderr: -272> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: crc 2024-03-04T12:36:51.877 INFO:tasks.workunit.client.0.smithi110.stderr: -271> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: secure 2024-03-04T12:36:51.877 INFO:tasks.workunit.client.0.smithi110.stderr: -270> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: crc 2024-03-04T12:36:51.877 INFO:tasks.workunit.client.0.smithi110.stderr: -269> 2024-03-04T12:36:51.524+0000 7f107068c800 5 AuthRegistry(0x7ffd024c5250) adding con mode: secure 2024-03-04T12:36:51.877 INFO:tasks.workunit.client.0.smithi110.stderr: -268> 2024-03-04T12:36:51.524+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.877 INFO:tasks.workunit.client.0.smithi110.stderr: -267> 2024-03-04T12:36:51.524+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.877 INFO:tasks.workunit.client.0.smithi110.stderr: -266> 2024-03-04T12:36:51.524+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command rotate-key cmddesc rotate-key hook 0x7ffd024c5398 EEXIST 2024-03-04T12:36:51.877 INFO:tasks.workunit.client.0.smithi110.stderr: -265> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient: _reopen_session rank -1 2024-03-04T12:36:51.877 INFO:tasks.workunit.client.0.smithi110.stderr: -264> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient: _add_conns ranks=[0,2,1] 2024-03-04T12:36:51.878 INFO:tasks.workunit.client.0.smithi110.stderr: -263> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient(hunting): picked mon.noname-a con 0x55da99eaf440 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:36:51.878 INFO:tasks.workunit.client.0.smithi110.stderr: -262> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient(hunting): picked mon.noname-c con 0x55da99eaa990 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:36:51.878 INFO:tasks.workunit.client.0.smithi110.stderr: -261> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient(hunting): picked mon.noname-b con 0x55da99ea1390 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:36:51.878 INFO:tasks.workunit.client.0.smithi110.stderr: -260> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.878 INFO:tasks.workunit.client.0.smithi110.stderr: -259> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.878 INFO:tasks.workunit.client.0.smithi110.stderr: -258> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.878 INFO:tasks.workunit.client.0.smithi110.stderr: -257> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient(hunting): _renew_subs 2024-03-04T12:36:51.878 INFO:tasks.workunit.client.0.smithi110.stderr: -256> 2024-03-04T12:36:51.524+0000 7f107068c800 10 monclient(hunting): authenticate will time out at 1792.883675s 2024-03-04T12:36:51.878 INFO:tasks.workunit.client.0.smithi110.stderr: -255> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient(hunting): get_auth_request con 0x55da99eaf440 auth_method 0 2024-03-04T12:36:51.878 INFO:tasks.workunit.client.0.smithi110.stderr: -254> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.878 INFO:tasks.workunit.client.0.smithi110.stderr: -253> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.878 INFO:tasks.workunit.client.0.smithi110.stderr: -252> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.878 INFO:tasks.workunit.client.0.smithi110.stderr: -251> 2024-03-04T12:36:51.524+0000 7f1065987640 10 monclient(hunting): get_auth_request con 0x55da99eaa990 auth_method 0 2024-03-04T12:36:51.878 INFO:tasks.workunit.client.0.smithi110.stderr: -250> 2024-03-04T12:36:51.524+0000 7f1065987640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.879 INFO:tasks.workunit.client.0.smithi110.stderr: -249> 2024-03-04T12:36:51.524+0000 7f1065987640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.879 INFO:tasks.workunit.client.0.smithi110.stderr: -248> 2024-03-04T12:36:51.524+0000 7f1065987640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.879 INFO:tasks.workunit.client.0.smithi110.stderr: -247> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.879 INFO:tasks.workunit.client.0.smithi110.stderr: -246> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.879 INFO:tasks.workunit.client.0.smithi110.stderr: -245> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.879 INFO:tasks.workunit.client.0.smithi110.stderr: -244> 2024-03-04T12:36:51.524+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.879 INFO:tasks.workunit.client.0.smithi110.stderr: -243> 2024-03-04T12:36:51.524+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.879 INFO:tasks.workunit.client.0.smithi110.stderr: -242> 2024-03-04T12:36:51.524+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.879 INFO:tasks.workunit.client.0.smithi110.stderr: -241> 2024-03-04T12:36:51.524+0000 7f106e989640 10 monclient(hunting): get_auth_request con 0x55da99ea1390 auth_method 0 2024-03-04T12:36:51.879 INFO:tasks.workunit.client.0.smithi110.stderr: -240> 2024-03-04T12:36:51.524+0000 7f106e989640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.879 INFO:tasks.workunit.client.0.smithi110.stderr: -239> 2024-03-04T12:36:51.524+0000 7f106e989640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.879 INFO:tasks.workunit.client.0.smithi110.stderr: -238> 2024-03-04T12:36:51.524+0000 7f106e989640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.879 INFO:tasks.workunit.client.0.smithi110.stderr: -237> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient(hunting): handle_auth_done global_id 6996 payload 274 2024-03-04T12:36:51.879 INFO:tasks.workunit.client.0.smithi110.stderr: -236> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient: _finish_hunting 0 2024-03-04T12:36:51.880 INFO:tasks.workunit.client.0.smithi110.stderr: -235> 2024-03-04T12:36:51.524+0000 7f106e188640 1 monclient: found mon.noname-a 2024-03-04T12:36:51.880 INFO:tasks.workunit.client.0.smithi110.stderr: -234> 2024-03-04T12:36:51.524+0000 7f106e188640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.110:3300/0 2024-03-04T12:36:51.880 INFO:tasks.workunit.client.0.smithi110.stderr: -233> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.880 INFO:tasks.workunit.client.0.smithi110.stderr: -232> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-04T12:36:51.880 INFO:tasks.workunit.client.0.smithi110.stderr: -231> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: dump: 2024-03-04T12:36:51.880 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.880 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.880 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.880 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.880 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.880 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.880 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.880 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.881 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.881 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.881 INFO:tasks.workunit.client.0.smithi110.stderr: -230> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: _finish_auth 0 2024-03-04T12:36:51.881 INFO:tasks.workunit.client.0.smithi110.stderr: -229> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: _check_auth_tickets 2024-03-04T12:36:51.881 INFO:tasks.workunit.client.0.smithi110.stderr: -228> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:51.881 INFO:tasks.workunit.client.0.smithi110.stderr: -227> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.881 INFO:tasks.workunit.client.0.smithi110.stderr: -226> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-04T12:36:51.881 INFO:tasks.workunit.client.0.smithi110.stderr: -225> 2024-03-04T12:36:51.525+0000 7f0f51ffb640 10 monclient: dump: 2024-03-04T12:36:51.881 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.881 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.881 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.881 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.882 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.882 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.882 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.882 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.882 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.882 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.882 INFO:tasks.workunit.client.0.smithi110.stderr: -224> 2024-03-04T12:36:51.525+0000 7f107068c800 5 monclient: authenticate success, global_id 6996 2024-03-04T12:36:51.882 INFO:tasks.workunit.client.0.smithi110.stderr: -223> 2024-03-04T12:36:51.525+0000 7f107068c800 10 monclient: get_monmap_and_config success 2024-03-04T12:36:51.882 INFO:tasks.workunit.client.0.smithi110.stderr: -222> 2024-03-04T12:36:51.525+0000 7f107068c800 4 set_mon_vals no callback set 2024-03-04T12:36:51.882 INFO:tasks.workunit.client.0.smithi110.stderr: -221> 2024-03-04T12:36:51.525+0000 7f107068c800 10 monclient: shutdown 2024-03-04T12:36:51.882 INFO:tasks.workunit.client.0.smithi110.stderr: -220> 2024-03-04T12:36:51.525+0000 7f107068c800 10 monclient: build_initial_monmap 2024-03-04T12:36:51.882 INFO:tasks.workunit.client.0.smithi110.stderr: -219> 2024-03-04T12:36:51.525+0000 7f107068c800 1 build_initial for_mkfs: 0 2024-03-04T12:36:51.882 INFO:tasks.workunit.client.0.smithi110.stderr: -218> 2024-03-04T12:36:51.525+0000 7f107068c800 10 monclient: monmap: 2024-03-04T12:36:51.882 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 0 2024-03-04T12:36:51.883 INFO:tasks.workunit.client.0.smithi110.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-04T12:36:51.883 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 0.000000 2024-03-04T12:36:51.883 INFO:tasks.workunit.client.0.smithi110.stderr:created 0.000000 2024-03-04T12:36:51.883 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 0 (unknown) 2024-03-04T12:36:51.883 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.883 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.noname-a 2024-03-04T12:36:51.883 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.noname-b 2024-03-04T12:36:51.883 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.noname-c 2024-03-04T12:36:51.883 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.883 INFO:tasks.workunit.client.0.smithi110.stderr: -217> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding auth protocol: cephx 2024-03-04T12:36:51.883 INFO:tasks.workunit.client.0.smithi110.stderr: -216> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding auth protocol: cephx 2024-03-04T12:36:51.883 INFO:tasks.workunit.client.0.smithi110.stderr: -215> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding auth protocol: cephx 2024-03-04T12:36:51.883 INFO:tasks.workunit.client.0.smithi110.stderr: -214> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: secure 2024-03-04T12:36:51.883 INFO:tasks.workunit.client.0.smithi110.stderr: -213> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: crc 2024-03-04T12:36:51.884 INFO:tasks.workunit.client.0.smithi110.stderr: -212> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: secure 2024-03-04T12:36:51.884 INFO:tasks.workunit.client.0.smithi110.stderr: -211> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: crc 2024-03-04T12:36:51.884 INFO:tasks.workunit.client.0.smithi110.stderr: -210> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: secure 2024-03-04T12:36:51.884 INFO:tasks.workunit.client.0.smithi110.stderr: -209> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: crc 2024-03-04T12:36:51.884 INFO:tasks.workunit.client.0.smithi110.stderr: -208> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: crc 2024-03-04T12:36:51.884 INFO:tasks.workunit.client.0.smithi110.stderr: -207> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: secure 2024-03-04T12:36:51.884 INFO:tasks.workunit.client.0.smithi110.stderr: -206> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: crc 2024-03-04T12:36:51.884 INFO:tasks.workunit.client.0.smithi110.stderr: -205> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: secure 2024-03-04T12:36:51.884 INFO:tasks.workunit.client.0.smithi110.stderr: -204> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: crc 2024-03-04T12:36:51.884 INFO:tasks.workunit.client.0.smithi110.stderr: -203> 2024-03-04T12:36:51.525+0000 7f107068c800 5 AuthRegistry(0x55da99e7a890) adding con mode: secure 2024-03-04T12:36:51.884 INFO:tasks.workunit.client.0.smithi110.stderr: -202> 2024-03-04T12:36:51.526+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.884 INFO:tasks.workunit.client.0.smithi110.stderr: -201> 2024-03-04T12:36:51.526+0000 7f107068c800 1 librados: starting msgr at 2024-03-04T12:36:51.884 INFO:tasks.workunit.client.0.smithi110.stderr: -200> 2024-03-04T12:36:51.526+0000 7f107068c800 1 librados: starting objecter 2024-03-04T12:36:51.884 INFO:tasks.workunit.client.0.smithi110.stderr: -199> 2024-03-04T12:36:51.526+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command objecter_requests cmddesc objecter_requests hook 0x55da99e7d880 EEXIST 2024-03-04T12:36:51.885 INFO:tasks.workunit.client.0.smithi110.stderr: -198> 2024-03-04T12:36:51.526+0000 7f107068c800 1 librados: setting wanted keys 2024-03-04T12:36:51.885 INFO:tasks.workunit.client.0.smithi110.stderr: -197> 2024-03-04T12:36:51.526+0000 7f107068c800 1 librados: calling monclient init 2024-03-04T12:36:51.885 INFO:tasks.workunit.client.0.smithi110.stderr: -196> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient: init 2024-03-04T12:36:51.885 INFO:tasks.workunit.client.0.smithi110.stderr: -195> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding auth protocol: cephx 2024-03-04T12:36:51.885 INFO:tasks.workunit.client.0.smithi110.stderr: -194> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding auth protocol: cephx 2024-03-04T12:36:51.885 INFO:tasks.workunit.client.0.smithi110.stderr: -193> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding auth protocol: cephx 2024-03-04T12:36:51.885 INFO:tasks.workunit.client.0.smithi110.stderr: -192> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: secure 2024-03-04T12:36:51.885 INFO:tasks.workunit.client.0.smithi110.stderr: -191> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: crc 2024-03-04T12:36:51.885 INFO:tasks.workunit.client.0.smithi110.stderr: -190> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: secure 2024-03-04T12:36:51.885 INFO:tasks.workunit.client.0.smithi110.stderr: -189> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: crc 2024-03-04T12:36:51.885 INFO:tasks.workunit.client.0.smithi110.stderr: -188> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: secure 2024-03-04T12:36:51.885 INFO:tasks.workunit.client.0.smithi110.stderr: -187> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: crc 2024-03-04T12:36:51.885 INFO:tasks.workunit.client.0.smithi110.stderr: -186> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: crc 2024-03-04T12:36:51.885 INFO:tasks.workunit.client.0.smithi110.stderr: -185> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: secure 2024-03-04T12:36:51.885 INFO:tasks.workunit.client.0.smithi110.stderr: -184> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: crc 2024-03-04T12:36:51.885 INFO:tasks.workunit.client.0.smithi110.stderr: -183> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: secure 2024-03-04T12:36:51.886 INFO:tasks.workunit.client.0.smithi110.stderr: -182> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: crc 2024-03-04T12:36:51.886 INFO:tasks.workunit.client.0.smithi110.stderr: -181> 2024-03-04T12:36:51.526+0000 7f107068c800 5 AuthRegistry(0x55da99e72d20) adding con mode: secure 2024-03-04T12:36:51.886 INFO:tasks.workunit.client.0.smithi110.stderr: -180> 2024-03-04T12:36:51.526+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.886 INFO:tasks.workunit.client.0.smithi110.stderr: -179> 2024-03-04T12:36:51.526+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.886 INFO:tasks.workunit.client.0.smithi110.stderr: -178> 2024-03-04T12:36:51.526+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command rotate-key cmddesc rotate-key hook 0x55da99e72e68 EEXIST 2024-03-04T12:36:51.886 INFO:tasks.workunit.client.0.smithi110.stderr: -177> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient: _reopen_session rank -1 2024-03-04T12:36:51.886 INFO:tasks.workunit.client.0.smithi110.stderr: -176> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-04T12:36:51.886 INFO:tasks.workunit.client.0.smithi110.stderr: -175> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient(hunting): picked mon.noname-c con 0x55da99ea1390 addr [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] 2024-03-04T12:36:51.886 INFO:tasks.workunit.client.0.smithi110.stderr: -174> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient(hunting): picked mon.noname-b con 0x55da99eaa990 addr [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-03-04T12:36:51.886 INFO:tasks.workunit.client.0.smithi110.stderr: -173> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient(hunting): picked mon.noname-a con 0x55da99eaf440 addr [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] 2024-03-04T12:36:51.886 INFO:tasks.workunit.client.0.smithi110.stderr: -172> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.886 INFO:tasks.workunit.client.0.smithi110.stderr: -171> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.886 INFO:tasks.workunit.client.0.smithi110.stderr: -170> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient(hunting): start opening mon connection 2024-03-04T12:36:51.886 INFO:tasks.workunit.client.0.smithi110.stderr: -169> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient(hunting): _renew_subs 2024-03-04T12:36:51.887 INFO:tasks.workunit.client.0.smithi110.stderr: -168> 2024-03-04T12:36:51.526+0000 7f107068c800 10 monclient(hunting): authenticate will time out at 1792.885854s 2024-03-04T12:36:51.887 INFO:tasks.workunit.client.0.smithi110.stderr: -167> 2024-03-04T12:36:51.526+0000 7f106e188640 10 monclient(hunting): get_auth_request con 0x55da99ea1390 auth_method 0 2024-03-04T12:36:51.887 INFO:tasks.workunit.client.0.smithi110.stderr: -166> 2024-03-04T12:36:51.526+0000 7f106e188640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.887 INFO:tasks.workunit.client.0.smithi110.stderr: -165> 2024-03-04T12:36:51.526+0000 7f106e188640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.887 INFO:tasks.workunit.client.0.smithi110.stderr: -164> 2024-03-04T12:36:51.526+0000 7f106e188640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.887 INFO:tasks.workunit.client.0.smithi110.stderr: -163> 2024-03-04T12:36:51.526+0000 7f106e989640 10 monclient(hunting): get_auth_request con 0x55da99eaf440 auth_method 0 2024-03-04T12:36:51.887 INFO:tasks.workunit.client.0.smithi110.stderr: -162> 2024-03-04T12:36:51.526+0000 7f106e989640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.887 INFO:tasks.workunit.client.0.smithi110.stderr: -161> 2024-03-04T12:36:51.526+0000 7f106e989640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.887 INFO:tasks.workunit.client.0.smithi110.stderr: -160> 2024-03-04T12:36:51.526+0000 7f106e989640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.887 INFO:tasks.workunit.client.0.smithi110.stderr: -159> 2024-03-04T12:36:51.526+0000 7f106e188640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.887 INFO:tasks.workunit.client.0.smithi110.stderr: -158> 2024-03-04T12:36:51.526+0000 7f106e188640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.887 INFO:tasks.workunit.client.0.smithi110.stderr: -157> 2024-03-04T12:36:51.527+0000 7f106e188640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.887 INFO:tasks.workunit.client.0.smithi110.stderr: -156> 2024-03-04T12:36:51.527+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.887 INFO:tasks.workunit.client.0.smithi110.stderr: -155> 2024-03-04T12:36:51.527+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.888 INFO:tasks.workunit.client.0.smithi110.stderr: -154> 2024-03-04T12:36:51.527+0000 7f106e989640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.888 INFO:tasks.workunit.client.0.smithi110.stderr: -153> 2024-03-04T12:36:51.527+0000 7f1065987640 10 monclient(hunting): get_auth_request con 0x55da99eaa990 auth_method 0 2024-03-04T12:36:51.888 INFO:tasks.workunit.client.0.smithi110.stderr: -152> 2024-03-04T12:36:51.527+0000 7f1065987640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-04T12:36:51.888 INFO:tasks.workunit.client.0.smithi110.stderr: -151> 2024-03-04T12:36:51.527+0000 7f1065987640 10 monclient(hunting): _init_auth method 2 2024-03-04T12:36:51.888 INFO:tasks.workunit.client.0.smithi110.stderr: -150> 2024-03-04T12:36:51.527+0000 7f1065987640 10 monclient(hunting): _init_auth creating new auth 2024-03-04T12:36:51.888 INFO:tasks.workunit.client.0.smithi110.stderr: -149> 2024-03-04T12:36:51.527+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-04T12:36:51.888 INFO:tasks.workunit.client.0.smithi110.stderr: -148> 2024-03-04T12:36:51.527+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-04T12:36:51.888 INFO:tasks.workunit.client.0.smithi110.stderr: -147> 2024-03-04T12:36:51.527+0000 7f1065987640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-04T12:36:51.888 INFO:tasks.workunit.client.0.smithi110.stderr: -146> 2024-03-04T12:36:51.527+0000 7f106e188640 10 monclient(hunting): handle_auth_done global_id 6569 payload 824 2024-03-04T12:36:51.888 INFO:tasks.workunit.client.0.smithi110.stderr: -145> 2024-03-04T12:36:51.527+0000 7f106e188640 10 monclient: _finish_hunting 0 2024-03-04T12:36:51.888 INFO:tasks.workunit.client.0.smithi110.stderr: -144> 2024-03-04T12:36:51.527+0000 7f106e188640 1 monclient: found mon.noname-c 2024-03-04T12:36:51.888 INFO:tasks.workunit.client.0.smithi110.stderr: -143> 2024-03-04T12:36:51.527+0000 7f106e188640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.888 INFO:tasks.workunit.client.0.smithi110.stderr: -142> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.888 INFO:tasks.workunit.client.0.smithi110.stderr: -141> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-04T12:36:51.889 INFO:tasks.workunit.client.0.smithi110.stderr: -140> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: dump: 2024-03-04T12:36:51.889 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.889 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.889 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.889 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.889 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.889 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.889 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.889 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.889 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.889 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.889 INFO:tasks.workunit.client.0.smithi110.stderr: -139> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: _finish_auth 0 2024-03-04T12:36:51.889 INFO:tasks.workunit.client.0.smithi110.stderr: -138> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: _check_auth_tickets 2024-03-04T12:36:51.889 INFO:tasks.workunit.client.0.smithi110.stderr: -137> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: handle_config config(0 keys) v1 2024-03-04T12:36:51.889 INFO:tasks.workunit.client.0.smithi110.stderr: -136> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-04T12:36:51.890 INFO:tasks.workunit.client.0.smithi110.stderr: -135> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-04T12:36:51.890 INFO:tasks.workunit.client.0.smithi110.stderr: -134> 2024-03-04T12:36:51.527+0000 7f0f3ffff640 10 monclient: dump: 2024-03-04T12:36:51.890 INFO:tasks.workunit.client.0.smithi110.stderr:epoch 1 2024-03-04T12:36:51.890 INFO:tasks.workunit.client.0.smithi110.stderr:fsid d1d8dd61-f240-416d-a8c7-564800fa8311 2024-03-04T12:36:51.890 INFO:tasks.workunit.client.0.smithi110.stderr:last_changed 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.890 INFO:tasks.workunit.client.0.smithi110.stderr:created 2024-03-04T12:19:08.023641+0000 2024-03-04T12:36:51.890 INFO:tasks.workunit.client.0.smithi110.stderr:min_mon_release 19 (squid) 2024-03-04T12:36:51.890 INFO:tasks.workunit.client.0.smithi110.stderr:election_strategy: 1 2024-03-04T12:36:51.890 INFO:tasks.workunit.client.0.smithi110.stderr:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-03-04T12:36:51.890 INFO:tasks.workunit.client.0.smithi110.stderr:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-03-04T12:36:51.890 INFO:tasks.workunit.client.0.smithi110.stderr:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-04T12:36:51.890 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.890 INFO:tasks.workunit.client.0.smithi110.stderr: -133> 2024-03-04T12:36:51.527+0000 7f107068c800 5 monclient: authenticate success, global_id 6569 2024-03-04T12:36:51.891 INFO:tasks.workunit.client.0.smithi110.stderr: -132> 2024-03-04T12:36:51.527+0000 7f0f51ffb640 4 set_mon_vals no callback set 2024-03-04T12:36:51.891 INFO:tasks.workunit.client.0.smithi110.stderr: -131> 2024-03-04T12:36:51.527+0000 7f107068c800 10 monclient: _renew_subs 2024-03-04T12:36:51.891 INFO:tasks.workunit.client.0.smithi110.stderr: -130> 2024-03-04T12:36:51.527+0000 7f107068c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.891 INFO:tasks.workunit.client.0.smithi110.stderr: -129> 2024-03-04T12:36:51.527+0000 7f107068c800 10 monclient: _renew_subs 2024-03-04T12:36:51.891 INFO:tasks.workunit.client.0.smithi110.stderr: -128> 2024-03-04T12:36:51.527+0000 7f107068c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.891 INFO:tasks.workunit.client.0.smithi110.stderr: -127> 2024-03-04T12:36:51.527+0000 7f107068c800 1 librados: init done 2024-03-04T12:36:51.891 INFO:tasks.workunit.client.0.smithi110.stderr: -126> 2024-03-04T12:36:51.527+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command cr dump hook 0x55da99ea6608 2024-03-04T12:36:51.891 INFO:tasks.workunit.client.0.smithi110.stderr: -125> 2024-03-04T12:36:51.528+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.891 INFO:tasks.workunit.client.0.smithi110.stderr: -124> 2024-03-04T12:36:51.529+0000 7f0f3ffff640 4 mgrc handle_mgr_map Got map version 5 2024-03-04T12:36:51.891 INFO:tasks.workunit.client.0.smithi110.stderr: -123> 2024-03-04T12:36:51.529+0000 7f0f3ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:51.891 INFO:tasks.workunit.client.0.smithi110.stderr: -122> 2024-03-04T12:36:51.529+0000 7f0f3ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.172:6832/1816111885,v1:172.21.15.172:6833/1816111885] 2024-03-04T12:36:51.891 INFO:tasks.workunit.client.0.smithi110.stderr: -121> 2024-03-04T12:36:51.529+0000 7f1065987640 10 monclient: get_auth_request con 0x7f0f38069eb0 auth_method 0 2024-03-04T12:36:51.891 INFO:tasks.workunit.client.0.smithi110.stderr: -120> 2024-03-04T12:36:51.529+0000 7f106e989640 10 monclient: get_auth_request con 0x55da99ec9990 auth_method 0 2024-03-04T12:36:51.891 INFO:tasks.workunit.client.0.smithi110.stderr: -119> 2024-03-04T12:36:51.529+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.892 INFO:tasks.workunit.client.0.smithi110.stderr: -118> 2024-03-04T12:36:51.529+0000 7f107068c800 20 realm 2024-03-04T12:36:51.892 INFO:tasks.workunit.client.0.smithi110.stderr: -117> 2024-03-04T12:36:51.529+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.892 INFO:tasks.workunit.client.0.smithi110.stderr: -116> 2024-03-04T12:36:51.530+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.892 INFO:tasks.workunit.client.0.smithi110.stderr: -115> 2024-03-04T12:36:51.530+0000 7f107068c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:51.892 INFO:tasks.workunit.client.0.smithi110.stderr: -114> 2024-03-04T12:36:51.530+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.892 INFO:tasks.workunit.client.0.smithi110.stderr: -113> 2024-03-04T12:36:51.530+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.892 INFO:tasks.workunit.client.0.smithi110.stderr: -112> 2024-03-04T12:36:51.530+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.892 INFO:tasks.workunit.client.0.smithi110.stderr: -111> 2024-03-04T12:36:51.530+0000 7f106e188640 10 monclient: get_auth_request con 0x55da99ecdc90 auth_method 0 2024-03-04T12:36:51.892 INFO:tasks.workunit.client.0.smithi110.stderr: -110> 2024-03-04T12:36:51.531+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:51.892 INFO:tasks.workunit.client.0.smithi110.stderr: -109> 2024-03-04T12:36:51.531+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.892 INFO:tasks.workunit.client.0.smithi110.stderr: -108> 2024-03-04T12:36:51.531+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:51.892 INFO:tasks.workunit.client.0.smithi110.stderr: -107> 2024-03-04T12:36:51.531+0000 7f107068c800 20 searching for the correct realm 2024-03-04T12:36:51.892 INFO:tasks.workunit.client.0.smithi110.stderr: -106> 2024-03-04T12:36:51.531+0000 7f1065987640 10 monclient: get_auth_request con 0x55da99ed2dc0 auth_method 0 2024-03-04T12:36:51.893 INFO:tasks.workunit.client.0.smithi110.stderr: -105> 2024-03-04T12:36:51.532+0000 7f106e989640 10 monclient: get_auth_request con 0x7f1058026070 auth_method 0 2024-03-04T12:36:51.893 INFO:tasks.workunit.client.0.smithi110.stderr: -104> 2024-03-04T12:36:51.533+0000 7f106e188640 10 monclient: get_auth_request con 0x7f106806e040 auth_method 0 2024-03-04T12:36:51.893 INFO:tasks.workunit.client.0.smithi110.stderr: -103> 2024-03-04T12:36:51.533+0000 7f1065987640 10 monclient: get_auth_request con 0x7f1060049070 auth_method 0 2024-03-04T12:36:51.893 INFO:tasks.workunit.client.0.smithi110.stderr: -102> 2024-03-04T12:36:51.534+0000 7f106e989640 0 -- 172.21.15.110:0/2908460802 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f1058026070 msgr2=0x7f105808bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:51.893 INFO:tasks.workunit.client.0.smithi110.stderr: -101> 2024-03-04T12:36:51.534+0000 7f0f3ffff640 1 client.6569.objecter ms_handle_reset 0x7f1058026070 session 0x7f1058005040 osd.7 2024-03-04T12:36:51.893 INFO:tasks.workunit.client.0.smithi110.stderr: -100> 2024-03-04T12:36:51.534+0000 7f0f3ffff640 10 monclient: _renew_subs 2024-03-04T12:36:51.893 INFO:tasks.workunit.client.0.smithi110.stderr: -99> 2024-03-04T12:36:51.534+0000 7f0f3ffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.110:3301/0 2024-03-04T12:36:51.893 INFO:tasks.workunit.client.0.smithi110.stderr: -98> 2024-03-04T12:36:51.534+0000 7f106e989640 10 monclient: get_auth_request con 0x7f0f38079c50 auth_method 0 2024-03-04T12:36:51.893 INFO:tasks.workunit.client.0.smithi110.stderr: -97> 2024-03-04T12:36:51.535+0000 7f106e989640 10 monclient: get_auth_request con 0x7f1058045890 auth_method 0 2024-03-04T12:36:51.893 INFO:tasks.workunit.client.0.smithi110.stderr: -96> 2024-03-04T12:36:51.537+0000 7f106e188640 10 monclient: get_auth_request con 0x7f10580834d0 auth_method 0 2024-03-04T12:36:51.893 INFO:tasks.workunit.client.0.smithi110.stderr: -95> 2024-03-04T12:36:51.537+0000 7f106e188640 0 -- 172.21.15.110:0/2908460802 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f10580834d0 msgr2=0x7f1058084790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:36:51.893 INFO:tasks.workunit.client.0.smithi110.stderr: -94> 2024-03-04T12:36:51.738+0000 7f106e188640 10 monclient: get_auth_request con 0x7f10580834d0 auth_method 0 2024-03-04T12:36:51.893 INFO:tasks.workunit.client.0.smithi110.stderr: -93> 2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:51.893 INFO:tasks.workunit.client.0.smithi110.stderr: -92> 2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:51.894 INFO:tasks.workunit.client.0.smithi110.stderr: -91> 2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:51.894 INFO:tasks.workunit.client.0.smithi110.stderr: -90> 2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:51.894 INFO:tasks.workunit.client.0.smithi110.stderr: -89> 2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:51.894 INFO:tasks.workunit.client.0.smithi110.stderr: -88> 2024-03-04T12:36:51.743+0000 7f107068c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:51.894 INFO:tasks.workunit.client.0.smithi110.stderr: -87> 2024-03-04T12:36:51.743+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.894 INFO:tasks.workunit.client.0.smithi110.stderr: -86> 2024-03-04T12:36:51.743+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.894 INFO:tasks.workunit.client.0.smithi110.stderr: -85> 2024-03-04T12:36:51.743+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.894 INFO:tasks.workunit.client.0.smithi110.stderr: -84> 2024-03-04T12:36:51.744+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:51.894 INFO:tasks.workunit.client.0.smithi110.stderr: -83> 2024-03-04T12:36:51.744+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.894 INFO:tasks.workunit.client.0.smithi110.stderr: -82> 2024-03-04T12:36:51.744+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:51.894 INFO:tasks.workunit.client.0.smithi110.stderr: -81> 2024-03-04T12:36:51.744+0000 7f107068c800 20 zone default found 2024-03-04T12:36:51.894 INFO:tasks.workunit.client.0.smithi110.stderr: -80> 2024-03-04T12:36:51.744+0000 7f107068c800 4 Realm: () 2024-03-04T12:36:51.894 INFO:tasks.workunit.client.0.smithi110.stderr: -79> 2024-03-04T12:36:51.744+0000 7f107068c800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:51.895 INFO:tasks.workunit.client.0.smithi110.stderr: -78> 2024-03-04T12:36:51.744+0000 7f107068c800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:51.895 INFO:tasks.workunit.client.0.smithi110.stderr: -77> 2024-03-04T12:36:51.744+0000 7f107068c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:51.895 INFO:tasks.workunit.client.0.smithi110.stderr: -76> 2024-03-04T12:36:51.744+0000 7f107068c800 20 zonegroup default 2024-03-04T12:36:51.895 INFO:tasks.workunit.client.0.smithi110.stderr: -75> 2024-03-04T12:36:51.744+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.895 INFO:tasks.workunit.client.0.smithi110.stderr: -74> 2024-03-04T12:36:51.744+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.895 INFO:tasks.workunit.client.0.smithi110.stderr: -73> 2024-03-04T12:36:51.744+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.895 INFO:tasks.workunit.client.0.smithi110.stderr: -72> 2024-03-04T12:36:51.745+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.895 INFO:tasks.workunit.client.0.smithi110.stderr: -71> 2024-03-04T12:36:51.745+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.895 INFO:tasks.workunit.client.0.smithi110.stderr: -70> 2024-03-04T12:36:51.745+0000 7f107068c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.895 INFO:tasks.workunit.client.0.smithi110.stderr: -69> 2024-03-04T12:36:51.745+0000 7f107068c800 20 started sync module instance, tier type = 2024-03-04T12:36:51.895 INFO:tasks.workunit.client.0.smithi110.stderr: -68> 2024-03-04T12:36:51.745+0000 7f107068c800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:51.895 INFO:tasks.workunit.client.0.smithi110.stderr: -67> 2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=0 2024-03-04T12:36:51.895 INFO:tasks.workunit.client.0.smithi110.stderr: -66> 2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=1 2024-03-04T12:36:51.895 INFO:tasks.workunit.client.0.smithi110.stderr: -65> 2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=2 2024-03-04T12:36:51.896 INFO:tasks.workunit.client.0.smithi110.stderr: -64> 2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=3 2024-03-04T12:36:51.896 INFO:tasks.workunit.client.0.smithi110.stderr: -63> 2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=4 2024-03-04T12:36:51.896 INFO:tasks.workunit.client.0.smithi110.stderr: -62> 2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=5 2024-03-04T12:36:51.896 INFO:tasks.workunit.client.0.smithi110.stderr: -61> 2024-03-04T12:36:51.753+0000 7f107068c800 20 add_watcher() i=6 2024-03-04T12:36:51.896 INFO:tasks.workunit.client.0.smithi110.stderr: -60> 2024-03-04T12:36:51.754+0000 7f107068c800 20 add_watcher() i=7 2024-03-04T12:36:51.896 INFO:tasks.workunit.client.0.smithi110.stderr: -59> 2024-03-04T12:36:51.754+0000 7f107068c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:51.896 INFO:tasks.workunit.client.0.smithi110.stderr: -58> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding auth protocol: cephx 2024-03-04T12:36:51.896 INFO:tasks.workunit.client.0.smithi110.stderr: -57> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding auth protocol: cephx 2024-03-04T12:36:51.896 INFO:tasks.workunit.client.0.smithi110.stderr: -56> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding auth protocol: cephx 2024-03-04T12:36:51.896 INFO:tasks.workunit.client.0.smithi110.stderr: -55> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: secure 2024-03-04T12:36:51.896 INFO:tasks.workunit.client.0.smithi110.stderr: -54> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: crc 2024-03-04T12:36:51.896 INFO:tasks.workunit.client.0.smithi110.stderr: -53> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: secure 2024-03-04T12:36:51.896 INFO:tasks.workunit.client.0.smithi110.stderr: -52> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: crc 2024-03-04T12:36:51.896 INFO:tasks.workunit.client.0.smithi110.stderr: -51> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: secure 2024-03-04T12:36:51.897 INFO:tasks.workunit.client.0.smithi110.stderr: -50> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: crc 2024-03-04T12:36:51.897 INFO:tasks.workunit.client.0.smithi110.stderr: -49> 2024-03-04T12:36:51.756+0000 7f0f24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:51.897 INFO:tasks.workunit.client.0.smithi110.stderr: -48> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: crc 2024-03-04T12:36:51.897 INFO:tasks.workunit.client.0.smithi110.stderr: -47> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: secure 2024-03-04T12:36:51.897 INFO:tasks.workunit.client.0.smithi110.stderr: -46> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: crc 2024-03-04T12:36:51.897 INFO:tasks.workunit.client.0.smithi110.stderr: -45> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: secure 2024-03-04T12:36:51.897 INFO:tasks.workunit.client.0.smithi110.stderr: -44> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: crc 2024-03-04T12:36:51.897 INFO:tasks.workunit.client.0.smithi110.stderr: -43> 2024-03-04T12:36:51.756+0000 7f107068c800 5 AuthRegistry(0x7ffd024c56e0) adding con mode: secure 2024-03-04T12:36:51.897 INFO:tasks.workunit.client.0.smithi110.stderr: -42> 2024-03-04T12:36:51.756+0000 7f107068c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-04T12:36:51.897 INFO:tasks.workunit.client.0.smithi110.stderr: -41> 2024-03-04T12:36:51.756+0000 7f107068c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:51.897 INFO:tasks.workunit.client.0.smithi110.stderr: -40> 2024-03-04T12:36:51.756+0000 7f107068c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:51.897 INFO:tasks.workunit.client.0.smithi110.stderr: -39> 2024-03-04T12:36:51.756+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command cache list hook 0x55da99eaed10 2024-03-04T12:36:51.897 INFO:tasks.workunit.client.0.smithi110.stderr: -38> 2024-03-04T12:36:51.756+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command cache inspect hook 0x55da99eaed10 2024-03-04T12:36:51.897 INFO:tasks.workunit.client.0.smithi110.stderr: -37> 2024-03-04T12:36:51.756+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command cache erase hook 0x55da99eaed10 2024-03-04T12:36:51.897 INFO:tasks.workunit.client.0.smithi110.stderr: -36> 2024-03-04T12:36:51.756+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command cache zap hook 0x55da99eaed10 2024-03-04T12:36:51.898 INFO:tasks.workunit.client.0.smithi110.stderr: -35> 2024-03-04T12:36:51.756+0000 7f107068c800 5 note: GC not initialized 2024-03-04T12:36:51.898 INFO:tasks.workunit.client.0.smithi110.stderr: -34> 2024-03-04T12:36:51.756+0000 7f0e9f7fe640 20 reqs_thread_entry: start 2024-03-04T12:36:51.898 INFO:tasks.workunit.client.0.smithi110.stderr: -33> 2024-03-04T12:36:51.756+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command sync trace show hook 0x7f106001d440 2024-03-04T12:36:51.898 INFO:tasks.workunit.client.0.smithi110.stderr: -32> 2024-03-04T12:36:51.756+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command sync trace history hook 0x7f106001d440 2024-03-04T12:36:51.898 INFO:tasks.workunit.client.0.smithi110.stderr: -31> 2024-03-04T12:36:51.756+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command sync trace active hook 0x7f106001d440 2024-03-04T12:36:51.898 INFO:tasks.workunit.client.0.smithi110.stderr: -30> 2024-03-04T12:36:51.756+0000 7f107068c800 5 asok(0x55da99bc00c0) register_command sync trace active_short hook 0x7f106001d440 2024-03-04T12:36:51.898 INFO:tasks.workunit.client.0.smithi110.stderr: -29> 2024-03-04T12:36:51.756+0000 7f107068c800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:51.898 INFO:tasks.workunit.client.0.smithi110.stderr: -28> 2024-03-04T12:36:51.757+0000 7f107068c800 20 Filter name: none 2024-03-04T12:36:51.898 INFO:tasks.workunit.client.0.smithi110.stderr: -27> 2024-03-04T12:36:51.757+0000 7f0e9d7fa640 20 reqs_thread_entry: start 2024-03-04T12:36:51.898 INFO:tasks.workunit.client.0.smithi110.stderr: -26> 2024-03-04T12:36:51.757+0000 7f107068c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-04T12:36:51.898 INFO:tasks.workunit.client.0.smithi110.stderr: -25> 2024-03-04T12:36:51.757+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.898 INFO:tasks.workunit.client.0.smithi110.stderr: -24> 2024-03-04T12:36:51.757+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:36:51.898 INFO:tasks.workunit.client.0.smithi110.stderr: -23> 2024-03-04T12:36:51.757+0000 7f107068c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-04T12:36:51.898 INFO:tasks.workunit.client.0.smithi110.stderr: -22> 2024-03-04T12:36:51.757+0000 7f107068c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-04T12:36:51.899 INFO:tasks.workunit.client.0.smithi110.stderr: -21> 2024-03-04T12:36:51.757+0000 7f107068c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 : miss 2024-03-04T12:36:51.899 INFO:tasks.workunit.client.0.smithi110.stderr: -20> 2024-03-04T12:36:51.757+0000 7f107068c800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.899 INFO:tasks.workunit.client.0.smithi110.stderr: -19> 2024-03-04T12:36:51.757+0000 7f107068c800 20 rados_obj.operate() r=0 bl.length=383 2024-03-04T12:36:51.899 INFO:tasks.workunit.client.0.smithi110.stderr: -18> 2024-03-04T12:36:51.757+0000 7f107068c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 info.flags=0x17 2024-03-04T12:36:51.899 INFO:tasks.workunit.client.0.smithi110.stderr: -17> 2024-03-04T12:36:51.757+0000 7f107068c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 to cache LRU end 2024-03-04T12:36:51.899 INFO:tasks.workunit.client.0.smithi110.stderr: -16> 2024-03-04T12:36:51.757+0000 7f107068c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:36:51.899 INFO:tasks.workunit.client.0.smithi110.stderr: -15> 2024-03-04T12:36:51.757+0000 7f107068c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:51.899 INFO:tasks.workunit.client.0.smithi110.stderr: -14> 2024-03-04T12:36:51.757+0000 7f107068c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 2024-03-04T12:36:51.899 INFO:tasks.workunit.client.0.smithi110.stderr: -13> 2024-03-04T12:36:51.762+0000 7f107068c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 info.flags=0x17 2024-03-04T12:36:51.899 INFO:tasks.workunit.client.0.smithi110.stderr: -12> 2024-03-04T12:36:51.762+0000 7f107068c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 to cache LRU end 2024-03-04T12:36:51.899 INFO:tasks.workunit.client.0.smithi110.stderr: -11> 2024-03-04T12:36:51.762+0000 7f107068c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:51.899 INFO:tasks.workunit.client.0.smithi110.stderr: -10> 2024-03-04T12:36:51.762+0000 7f107068c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29, ofs0, ns] 2024-03-04T12:36:51.899 INFO:tasks.workunit.client.0.smithi110.stderr: -9> 2024-03-04T12:36:51.762+0000 7f0f517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824005 cookie 94397373732944 notifier 6569 bl.length()=945 2024-03-04T12:36:51.899 INFO:tasks.workunit.client.0.smithi110.stderr: -8> 2024-03-04T12:36:51.763+0000 7f0f517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 info.flags=0x17 2024-03-04T12:36:51.900 INFO:tasks.workunit.client.0.smithi110.stderr: -7> 2024-03-04T12:36:51.763+0000 7f0f517fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 to cache LRU end 2024-03-04T12:36:51.900 INFO:tasks.workunit.client.0.smithi110.stderr: -6> 2024-03-04T12:36:51.763+0000 7f0f517fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:36:51.900 INFO:tasks.workunit.client.0.smithi110.stderr: -5> 2024-03-04T12:36:51.764+0000 7f107068c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): orig_sources= new_sources= 2024-03-04T12:36:51.900 INFO:tasks.workunit.client.0.smithi110.stderr: -4> 2024-03-04T12:36:51.764+0000 7f107068c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): potential sources added=[] removed=[] 2024-03-04T12:36:51.900 INFO:tasks.workunit.client.0.smithi110.stderr: -3> 2024-03-04T12:36:51.764+0000 7f107068c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): orig_dests= new_dests= 2024-03-04T12:36:51.900 INFO:tasks.workunit.client.0.smithi110.stderr: -2> 2024-03-04T12:36:51.764+0000 7f107068c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): potential dests added=[] removed=[] 2024-03-04T12:36:51.900 INFO:tasks.workunit.client.0.smithi110.stderr: -1> 2024-03-04T12:36:51.768+0000 7f107068c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f107068c800 time 2024-03-04T12:36:51.768303+0000 2024-03-04T12:36:51.900 INFO:tasks.workunit.client.0.smithi110.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1871-g3aec3903/rpm/el9/BUILD/ceph-19.0.0-1871-g3aec3903/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-04T12:36:51.900 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.900 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:36:51.900 INFO:tasks.workunit.client.0.smithi110.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1073980e86] 2024-03-04T12:36:51.900 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1073981044] 2024-03-04T12:36:51.900 INFO:tasks.workunit.client.0.smithi110.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da9819ceb1] 2024-03-04T12:36:51.901 INFO:tasks.workunit.client.0.smithi110.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55da981b0de4] 2024-03-04T12:36:51.901 INFO:tasks.workunit.client.0.smithi110.stderr: 5: main() 2024-03-04T12:36:51.901 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f107283feb0] 2024-03-04T12:36:51.901 INFO:tasks.workunit.client.0.smithi110.stderr: 7: __libc_start_main() 2024-03-04T12:36:51.901 INFO:tasks.workunit.client.0.smithi110.stderr: 8: _start() 2024-03-04T12:36:51.901 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.901 INFO:tasks.workunit.client.0.smithi110.stderr: 0> 2024-03-04T12:36:51.768+0000 7f107068c800 -1 *** Caught signal (Aborted) ** 2024-03-04T12:36:51.901 INFO:tasks.workunit.client.0.smithi110.stderr: in thread 7f107068c800 thread_name:radosgw-admin 2024-03-04T12:36:51.901 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.901 INFO:tasks.workunit.client.0.smithi110.stderr: ceph version 19.0.0-1871-g3aec3903 (3aec390336fdfdc8f927818b718cfb0361bd47c8) squid (dev) 2024-03-04T12:36:51.901 INFO:tasks.workunit.client.0.smithi110.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1072854db0] 2024-03-04T12:36:51.901 INFO:tasks.workunit.client.0.smithi110.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f10728a154c] 2024-03-04T12:36:51.901 INFO:tasks.workunit.client.0.smithi110.stderr: 3: raise() 2024-03-04T12:36:51.901 INFO:tasks.workunit.client.0.smithi110.stderr: 4: abort() 2024-03-04T12:36:51.902 INFO:tasks.workunit.client.0.smithi110.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1073980ee0] 2024-03-04T12:36:51.902 INFO:tasks.workunit.client.0.smithi110.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1073981044] 2024-03-04T12:36:51.902 INFO:tasks.workunit.client.0.smithi110.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da9819ceb1] 2024-03-04T12:36:51.902 INFO:tasks.workunit.client.0.smithi110.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x55da981b0de4] 2024-03-04T12:36:51.902 INFO:tasks.workunit.client.0.smithi110.stderr: 9: main() 2024-03-04T12:36:51.902 INFO:tasks.workunit.client.0.smithi110.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f107283feb0] 2024-03-04T12:36:51.902 INFO:tasks.workunit.client.0.smithi110.stderr: 11: __libc_start_main() 2024-03-04T12:36:51.902 INFO:tasks.workunit.client.0.smithi110.stderr: 12: _start() 2024-03-04T12:36:51.902 INFO:tasks.workunit.client.0.smithi110.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-04T12:36:51.902 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:51.902 INFO:tasks.workunit.client.0.smithi110.stderr:--- logging levels --- 2024-03-04T12:36:51.902 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 none 2024-03-04T12:36:51.903 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 lockdep 2024-03-04T12:36:51.903 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 context 2024-03-04T12:36:51.903 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 crush 2024-03-04T12:36:51.903 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds 2024-03-04T12:36:51.903 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_balancer 2024-03-04T12:36:51.903 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_locker 2024-03-04T12:36:51.903 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_log 2024-03-04T12:36:51.903 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_log_expire 2024-03-04T12:36:51.903 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mds_migrator 2024-03-04T12:36:51.903 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 buffer 2024-03-04T12:36:51.903 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 timer 2024-03-04T12:36:51.903 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 filer 2024-03-04T12:36:51.903 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 striper 2024-03-04T12:36:51.903 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 1 objecter 2024-03-04T12:36:51.904 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rados 2024-03-04T12:36:51.904 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd 2024-03-04T12:36:51.904 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_mirror 2024-03-04T12:36:51.904 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_replay 2024-03-04T12:36:51.904 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 rbd_pwl 2024-03-04T12:36:51.904 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 journaler 2024-03-04T12:36:51.904 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 objectcacher 2024-03-04T12:36:51.904 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 immutable_obj_cache 2024-03-04T12:36:51.904 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 client 2024-03-04T12:36:51.904 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 osd 2024-03-04T12:36:51.904 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 optracker 2024-03-04T12:36:51.904 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 objclass 2024-03-04T12:36:51.904 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 filestore 2024-03-04T12:36:51.904 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 journal 2024-03-04T12:36:51.904 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 0 ms 2024-03-04T12:36:51.905 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mon 2024-03-04T12:36:51.905 INFO:tasks.workunit.client.0.smithi110.stderr: 0/10 monc 2024-03-04T12:36:51.905 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 paxos 2024-03-04T12:36:51.905 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 tp 2024-03-04T12:36:51.905 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 auth 2024-03-04T12:36:51.905 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 crypto 2024-03-04T12:36:51.905 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 finisher 2024-03-04T12:36:51.905 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 reserver 2024-03-04T12:36:51.905 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 heartbeatmap 2024-03-04T12:36:51.905 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 perfcounter 2024-03-04T12:36:51.905 INFO:tasks.workunit.client.0.smithi110.stderr: 20/20 rgw 2024-03-04T12:36:51.905 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_sync 2024-03-04T12:36:51.905 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_datacache 2024-03-04T12:36:51.906 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_access 2024-03-04T12:36:51.906 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_dbstore 2024-03-04T12:36:51.906 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_flight 2024-03-04T12:36:51.906 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 rgw_lifecycle 2024-03-04T12:36:51.906 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 javaclient 2024-03-04T12:36:51.906 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 asok 2024-03-04T12:36:51.906 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 1 throttle 2024-03-04T12:36:51.906 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 0 refs 2024-03-04T12:36:51.906 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 compressor 2024-03-04T12:36:51.906 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 bluestore 2024-03-04T12:36:51.906 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 bluefs 2024-03-04T12:36:51.906 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 3 bdev 2024-03-04T12:36:51.906 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 kstore 2024-03-04T12:36:51.906 INFO:tasks.workunit.client.0.smithi110.stderr: 4/ 5 rocksdb 2024-03-04T12:36:51.906 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 fuse 2024-03-04T12:36:51.907 INFO:tasks.workunit.client.0.smithi110.stderr: 2/ 5 mgr 2024-03-04T12:36:51.907 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mgrc 2024-03-04T12:36:51.907 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 dpdk 2024-03-04T12:36:51.907 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 eventtrace 2024-03-04T12:36:51.907 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 prioritycache 2024-03-04T12:36:51.907 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 test 2024-03-04T12:36:51.907 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cephfs_mirror 2024-03-04T12:36:51.907 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cephsqlite 2024-03-04T12:36:51.907 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 crimson_interrupt 2024-03-04T12:36:51.907 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore 2024-03-04T12:36:51.907 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_onode 2024-03-04T12:36:51.907 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_odata 2024-03-04T12:36:51.907 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_omap 2024-03-04T12:36:51.907 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_tm 2024-03-04T12:36:51.907 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_t 2024-03-04T12:36:51.907 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_cleaner 2024-03-04T12:36:51.908 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_epm 2024-03-04T12:36:51.908 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_lba 2024-03-04T12:36:51.908 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-04T12:36:51.908 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_cache 2024-03-04T12:36:51.908 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_journal 2024-03-04T12:36:51.908 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_device 2024-03-04T12:36:51.908 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 seastore_backref 2024-03-04T12:36:51.908 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 alienstore 2024-03-04T12:36:51.908 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 mclock 2024-03-04T12:36:51.908 INFO:tasks.workunit.client.0.smithi110.stderr: 0/ 5 cyanstore 2024-03-04T12:36:51.908 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 ceph_exporter 2024-03-04T12:36:51.908 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 memstore 2024-03-04T12:36:51.908 INFO:tasks.workunit.client.0.smithi110.stderr: 1/ 5 trace 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr: -2/-2 (syslog threshold) 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr: 99/99 (stderr threshold) 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0e9d7fa640 / http_manager 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0e9f7fe640 / http_manager 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0f24fe1640 / rgw_dt_lg_renew 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0f3ffff640 / ms_dispatch 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0f517fa640 / io_context_pool 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0f51ffb640 / io_context_pool 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0f53fff640 / ms_dispatch 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0f5ae05640 / ms_dispatch 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr: 7f0f5c608640 / io_context_pool 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr: 7f1065987640 / msgr-worker-2 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr: 7f106e188640 / msgr-worker-1 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr: 7f106e989640 / msgr-worker-0 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr: 7f106f18a640 / io_context_pool 2024-03-04T12:36:51.909 INFO:tasks.workunit.client.0.smithi110.stderr: 7f107068c800 / radosgw-admin 2024-03-04T12:36:51.910 INFO:tasks.workunit.client.0.smithi110.stderr: max_recent 500 2024-03-04T12:36:51.910 INFO:tasks.workunit.client.0.smithi110.stderr: max_new 1000 2024-03-04T12:36:51.910 INFO:tasks.workunit.client.0.smithi110.stderr: log_file /var/lib/ceph/crash/2024-03-04T12:36:51.769678Z_4de64c4e-6748-4d55-9b34-a3705b696488/log 2024-03-04T12:36:51.910 INFO:tasks.workunit.client.0.smithi110.stderr:--- end dump of recent events --- 2024-03-04T12:36:51.910 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-03-04T12:36:51.911 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:36:51.912 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:36:51.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.838+0000 7f628662e800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.839+0000 7f628662e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.839+0000 7f628662e800 20 realm 2024-03-04T12:36:51.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.839+0000 7f628662e800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.840+0000 7f628662e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.840+0000 7f628662e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:36:51.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.840+0000 7f628662e800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.840+0000 7f628662e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:51.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.840+0000 7f628662e800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.841+0000 7f628662e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:51.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.841+0000 7f628662e800 20 rados->read ofs=0 len=0 2024-03-04T12:36:51.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.841+0000 7f628662e800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:36:51.913 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.841+0000 7f628662e800 20 searching for the correct realm 2024-03-04T12:36:51.913 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.844+0000 7f627912f640 0 -- 172.21.15.110:0/3380122719 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f62740bb060 msgr2=0x7f62740d3ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:51.913 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:51.847+0000 7f6281930640 0 -- 172.21.15.110:0/3380122719 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f626c06bb10 msgr2=0x7f626c069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:36:52.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.053+0000 7f628662e800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:36:52.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.053+0000 7f628662e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:36:52.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.053+0000 7f628662e800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:36:52.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.053+0000 7f628662e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:36:52.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.053+0000 7f628662e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:36:52.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.053+0000 7f628662e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:36:52.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.053+0000 7f628662e800 20 rados->read ofs=0 len=0 2024-03-04T12:36:52.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.054+0000 7f628662e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:52.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.054+0000 7f628662e800 20 rados->read ofs=0 len=0 2024-03-04T12:36:52.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.054+0000 7f628662e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:36:52.061 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.054+0000 7f628662e800 20 rados->read ofs=0 len=0 2024-03-04T12:36:52.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.054+0000 7f628662e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:36:52.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.054+0000 7f628662e800 20 zone default found 2024-03-04T12:36:52.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.054+0000 7f628662e800 4 Realm: () 2024-03-04T12:36:52.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.054+0000 7f628662e800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:36:52.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.054+0000 7f628662e800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:36:52.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.054+0000 7f628662e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:36:52.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.054+0000 7f628662e800 20 zonegroup default 2024-03-04T12:36:52.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.054+0000 7f628662e800 20 rados->read ofs=0 len=0 2024-03-04T12:36:52.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.055+0000 7f628662e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:52.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.055+0000 7f628662e800 20 rados->read ofs=0 len=0 2024-03-04T12:36:52.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.055+0000 7f628662e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:52.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.055+0000 7f628662e800 20 rados->read ofs=0 len=0 2024-03-04T12:36:52.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.055+0000 7f628662e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:52.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.055+0000 7f628662e800 20 started sync module instance, tier type = 2024-03-04T12:36:52.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.055+0000 7f628662e800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:36:52.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.064+0000 7f628662e800 20 add_watcher() i=0 2024-03-04T12:36:52.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.064+0000 7f628662e800 20 add_watcher() i=1 2024-03-04T12:36:52.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.064+0000 7f628662e800 20 add_watcher() i=2 2024-03-04T12:36:52.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.064+0000 7f628662e800 20 add_watcher() i=3 2024-03-04T12:36:52.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.064+0000 7f628662e800 20 add_watcher() i=4 2024-03-04T12:36:52.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.064+0000 7f628662e800 20 add_watcher() i=5 2024-03-04T12:36:52.071 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.065+0000 7f628662e800 20 add_watcher() i=6 2024-03-04T12:36:52.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.065+0000 7f628662e800 20 add_watcher() i=7 2024-03-04T12:36:52.072 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.065+0000 7f628662e800 2 all 8 watchers are set, enabling cache 2024-03-04T12:36:52.073 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.067+0000 7f61337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:52.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.067+0000 7f628662e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:36:52.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.067+0000 7f628662e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:36:52.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.067+0000 7f628662e800 5 note: GC not initialized 2024-03-04T12:36:52.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.068+0000 7f61327fc640 20 reqs_thread_entry: start 2024-03-04T12:36:52.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.068+0000 7f628662e800 20 init_complete bucket index max shards: 11 2024-03-04T12:36:52.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.068+0000 7f628662e800 20 Filter name: none 2024-03-04T12:36:52.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.068+0000 7f60a7fff640 20 reqs_thread_entry: start 2024-03-04T12:36:52.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.068+0000 7f628662e800 20 rados->read ofs=0 len=0 2024-03-04T12:36:52.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.068+0000 7f628662e800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:36:52.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.068+0000 7f628662e800 20 rados->read ofs=0 len=0 2024-03-04T12:36:52.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.069+0000 7f628662e800 20 rados_obj.operate() r=0 bl.length=415 2024-03-04T12:36:52.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.069+0000 7f628662e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:52.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.069+0000 7f628662e800 20 rados->read ofs=0 len=0 2024-03-04T12:36:52.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.069+0000 7f628662e800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:36:52.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.069+0000 7f628662e800 20 rados->read ofs=0 len=0 2024-03-04T12:36:52.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.070+0000 7f628662e800 20 rados_obj.operate() r=0 bl.length=415 2024-03-04T12:36:52.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.070+0000 7f628662e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:36:52.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.071+0000 7f628662e800 20 rados->read ofs=0 len=0 2024-03-04T12:36:52.077 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.071+0000 7f628662e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:36:52.078 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.072+0000 7f61337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:36:52.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.074+0000 7f628662e800 20 remove_watcher() i=0 2024-03-04T12:36:52.080 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.074+0000 7f628662e800 2 removed watcher, disabling cache 2024-03-04T12:36:52.081 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.075+0000 7f628662e800 20 remove_watcher() i=1 2024-03-04T12:36:52.082 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.076+0000 7f628662e800 20 remove_watcher() i=2 2024-03-04T12:36:52.083 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.077+0000 7f628662e800 20 remove_watcher() i=3 2024-03-04T12:36:52.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.078+0000 7f628662e800 20 remove_watcher() i=4 2024-03-04T12:36:52.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.079+0000 7f628662e800 20 remove_watcher() i=5 2024-03-04T12:36:52.086 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.080+0000 7f628662e800 20 remove_watcher() i=6 2024-03-04T12:36:52.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:36:52.081+0000 7f628662e800 20 remove_watcher() i=7 2024-03-04T12:36:52.096 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:52.096 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:36:52.096 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: abort-at-do-reshard id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-04T12:36:52.096 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:36:52.098 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:36:52.098 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:22.203 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:22.203 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:22.268 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-04T12:37:22.299 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:22.299 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:22.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.328+0000 7fbd8c424800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.336 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.329+0000 7fbd8c424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.336 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.329+0000 7fbd8c424800 20 realm 2024-03-04T12:37:22.336 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.329+0000 7fbd8c424800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.336 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.330+0000 7fbd8c424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.336 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.330+0000 7fbd8c424800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:22.336 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.330+0000 7fbd8c424800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.336 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.330+0000 7fbd8c424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.336 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.330+0000 7fbd8c424800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.337 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.331+0000 7fbd8c424800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:22.337 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.331+0000 7fbd8c424800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.337 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.331+0000 7fbd8c424800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:22.337 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.331+0000 7fbd8c424800 20 searching for the correct realm 2024-03-04T12:37:22.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.334+0000 7fbd8a721640 0 -- 172.21.15.110:0/3356315495 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7fbd7402d040 msgr2=0x7fbd74022ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:22.344 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.338+0000 7fbd89f20640 0 -- 172.21.15.110:0/3356315495 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fbd7404e430 msgr2=0x7fbd7403a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:22.550 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.544+0000 7fbd8c424800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:22.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.544+0000 7fbd8c424800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:22.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.544+0000 7fbd8c424800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:22.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.544+0000 7fbd8c424800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:22.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.544+0000 7fbd8c424800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:22.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.544+0000 7fbd8c424800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:22.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.544+0000 7fbd8c424800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.544+0000 7fbd8c424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.551 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.544+0000 7fbd8c424800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.545+0000 7fbd8c424800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:22.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.545+0000 7fbd8c424800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.545+0000 7fbd8c424800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:22.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.545+0000 7fbd8c424800 20 zone default found 2024-03-04T12:37:22.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.545+0000 7fbd8c424800 4 Realm: () 2024-03-04T12:37:22.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.545+0000 7fbd8c424800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:22.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.545+0000 7fbd8c424800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:22.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.545+0000 7fbd8c424800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:22.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.545+0000 7fbd8c424800 20 zonegroup default 2024-03-04T12:37:22.553 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.545+0000 7fbd8c424800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.545+0000 7fbd8c424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.545+0000 7fbd8c424800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.546+0000 7fbd8c424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.546+0000 7fbd8c424800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.546+0000 7fbd8c424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.546+0000 7fbd8c424800 20 started sync module instance, tier type = 2024-03-04T12:37:22.554 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.546+0000 7fbd8c424800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:22.561 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.555+0000 7fbd8c424800 20 add_watcher() i=0 2024-03-04T12:37:22.561 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.555+0000 7fbd8c424800 20 add_watcher() i=1 2024-03-04T12:37:22.561 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.555+0000 7fbd8c424800 20 add_watcher() i=2 2024-03-04T12:37:22.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.555+0000 7fbd8c424800 20 add_watcher() i=3 2024-03-04T12:37:22.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.555+0000 7fbd8c424800 20 add_watcher() i=4 2024-03-04T12:37:22.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.555+0000 7fbd8c424800 20 add_watcher() i=5 2024-03-04T12:37:22.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.555+0000 7fbd8c424800 20 add_watcher() i=6 2024-03-04T12:37:22.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.556+0000 7fbd8c424800 20 add_watcher() i=7 2024-03-04T12:37:22.562 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.556+0000 7fbd8c424800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:22.564 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.558+0000 7fbc3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:22.566 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.558+0000 7fbd8c424800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:22.566 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.558+0000 7fbd8c424800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:22.566 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.558+0000 7fbd8c424800 5 note: GC not initialized 2024-03-04T12:37:22.566 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.559+0000 7fbc3a7fc640 20 reqs_thread_entry: start 2024-03-04T12:37:22.566 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.559+0000 7fbd8c424800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:22.566 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.559+0000 7fbd8c424800 20 Filter name: none 2024-03-04T12:37:22.566 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.559+0000 7fbbabfff640 20 reqs_thread_entry: start 2024-03-04T12:37:22.566 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.559+0000 7fbd8c424800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-04T12:37:22.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.559+0000 7fbd8c424800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.559+0000 7fbd8c424800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:37:22.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.559+0000 7fbd8c424800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-04T12:37:22.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.559+0000 7fbd8c424800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-04T12:37:22.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.559+0000 7fbd8c424800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 : miss 2024-03-04T12:37:22.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.559+0000 7fbd8c424800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.560+0000 7fbd8c424800 20 rados_obj.operate() r=0 bl.length=383 2024-03-04T12:37:22.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.560+0000 7fbd8c424800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 info.flags=0x17 2024-03-04T12:37:22.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.560+0000 7fbd8c424800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 to cache LRU end 2024-03-04T12:37:22.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.560+0000 7fbd8c424800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:37:22.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.560+0000 7fbd8c424800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:37:22.567 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.560+0000 7fbd8c424800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 2024-03-04T12:37:22.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.565+0000 7fbd8c424800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 info.flags=0x17 2024-03-04T12:37:22.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.565+0000 7fbd8c424800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 to cache LRU end 2024-03-04T12:37:22.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.565+0000 7fbd8c424800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:37:22.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.565+0000 7fbd8c424800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29, ofs0, ns] 2024-03-04T12:37:22.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.565+0000 7fbc6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824007 cookie 93933337389120 notifier 6605 bl.length()=945 2024-03-04T12:37:22.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.565+0000 7fbc6d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 info.flags=0x17 2024-03-04T12:37:22.571 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.565+0000 7fbc6d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 to cache LRU end 2024-03-04T12:37:22.572 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.565+0000 7fbc6d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:37:22.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.567+0000 7fbd8c424800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): orig_sources= new_sources= 2024-03-04T12:37:22.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.567+0000 7fbd8c424800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): potential sources added=[] removed=[] 2024-03-04T12:37:22.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.567+0000 7fbd8c424800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): orig_dests= new_dests= 2024-03-04T12:37:22.573 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.567+0000 7fbd8c424800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): potential dests added=[] removed=[] 2024-03-04T12:37:22.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.0 2024-03-04T12:37:22.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.0 2024-03-04T12:37:22.576 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.1 2024-03-04T12:37:22.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.1 2024-03-04T12:37:22.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.2 2024-03-04T12:37:22.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.2 2024-03-04T12:37:22.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.3 2024-03-04T12:37:22.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.3 2024-03-04T12:37:22.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.4 2024-03-04T12:37:22.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.4 2024-03-04T12:37:22.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.5 2024-03-04T12:37:22.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.5 2024-03-04T12:37:22.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.6 2024-03-04T12:37:22.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.6 2024-03-04T12:37:22.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.7 2024-03-04T12:37:22.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.7 2024-03-04T12:37:22.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.8 2024-03-04T12:37:22.577 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.8 2024-03-04T12:37:22.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.9 2024-03-04T12:37:22.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.9 2024-03-04T12:37:22.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.10 2024-03-04T12:37:22.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.10 2024-03-04T12:37:22.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.11 2024-03-04T12:37:22.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1.11 2024-03-04T12:37:22.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.0 2024-03-04T12:37:22.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.1 2024-03-04T12:37:22.578 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.570+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.2 2024-03-04T12:37:22.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.571+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.3 2024-03-04T12:37:22.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.571+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.4 2024-03-04T12:37:22.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.572+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.5 2024-03-04T12:37:22.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.572+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.6 2024-03-04T12:37:22.579 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.573+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.7 2024-03-04T12:37:22.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.574+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.8 2024-03-04T12:37:22.580 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.574+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.9 2024-03-04T12:37:22.581 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.575+0000 7fbd8c424800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29.10 2024-03-04T12:37:22.584 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.578+0000 7fbd8c424800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 : hit (requested=0x17, cached=0x17) 2024-03-04T12:37:22.584 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.578+0000 7fbd8c424800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 2024-03-04T12:37:22.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.580+0000 7fbd8c424800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 info.flags=0x17 2024-03-04T12:37:22.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.580+0000 7fbd8c424800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 to cache LRU end 2024-03-04T12:37:22.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.580+0000 7fbd8c424800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:37:22.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.580+0000 7fbd8c424800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29, ofs0, ns] 2024-03-04T12:37:22.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.580+0000 7fbc6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824008 cookie 93933337389120 notifier 6605 bl.length()=913 2024-03-04T12:37:22.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.580+0000 7fbc6d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 info.flags=0x17 2024-03-04T12:37:22.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.580+0000 7fbc6d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 to cache LRU end 2024-03-04T12:37:22.586 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.580+0000 7fbc6d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-04T12:37:22.587 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.581+0000 7fbd8c424800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): orig_sources= new_sources= 2024-03-04T12:37:22.587 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.581+0000 7fbd8c424800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): potential sources added=[] removed=[] 2024-03-04T12:37:22.587 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.581+0000 7fbd8c424800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): orig_dests= new_dests= 2024-03-04T12:37:22.588 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.581+0000 7fbd8c424800 20 handle_bi_update(): bucket=:abort-at-do-reshard[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29]): potential dests added=[] removed=[] 2024-03-04T12:37:22.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.584+0000 7fbd8c424800 1 execute INFO: reshard of bucket "abort-at-do-reshard" completed successfully 2024-03-04T12:37:22.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.586+0000 7fbc3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:22.594 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.588+0000 7fbd8c424800 20 remove_watcher() i=0 2024-03-04T12:37:22.594 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.588+0000 7fbd8c424800 2 removed watcher, disabling cache 2024-03-04T12:37:22.595 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.589+0000 7fbd8c424800 20 remove_watcher() i=1 2024-03-04T12:37:22.596 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.590+0000 7fbd8c424800 20 remove_watcher() i=2 2024-03-04T12:37:22.597 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.591+0000 7fbd8c424800 20 remove_watcher() i=3 2024-03-04T12:37:22.598 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.592+0000 7fbd8c424800 20 remove_watcher() i=4 2024-03-04T12:37:22.599 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.593+0000 7fbd8c424800 20 remove_watcher() i=5 2024-03-04T12:37:22.600 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.594+0000 7fbd8c424800 20 remove_watcher() i=6 2024-03-04T12:37:22.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.595+0000 7fbd8c424800 20 remove_watcher() i=7 2024-03-04T12:37:22.612 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-03-04T12:37:22.639 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:22.639 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:22.671 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.665+0000 7fc32ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.667+0000 7fc32ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.667+0000 7fc32ae15800 20 realm 2024-03-04T12:37:22.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.667+0000 7fc32ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.667+0000 7fc32ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.667+0000 7fc32ae15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:22.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.667+0000 7fc32ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.667+0000 7fc32ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.667+0000 7fc32ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.668+0000 7fc32ae15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:22.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.668+0000 7fc32ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.668+0000 7fc32ae15800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:22.675 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.668+0000 7fc32ae15800 20 searching for the correct realm 2024-03-04T12:37:22.678 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.672+0000 7fc326bdf640 0 -- 172.21.15.110:0/2455895773 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7fc31c077050 msgr2=0x7fc31c0429f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:22.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.878+0000 7fc3263de640 0 -- 172.21.15.110:0/2455895773 >> [v2:172.21.15.172:6800/824320839,v1:172.21.15.172:6801/824320839] conn(0x55b72f630610 msgr2=0x55b72f632ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:22.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.881+0000 7fc32ae15800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:22.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.881+0000 7fc32ae15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:22.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.881+0000 7fc32ae15800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:22.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.881+0000 7fc32ae15800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:22.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.881+0000 7fc32ae15800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:22.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.881+0000 7fc32ae15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:22.887 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.881+0000 7fc32ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.881+0000 7fc32ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.881+0000 7fc32ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.881+0000 7fc32ae15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:22.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.881+0000 7fc32ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.882+0000 7fc32ae15800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:22.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.882+0000 7fc32ae15800 20 zone default found 2024-03-04T12:37:22.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.882+0000 7fc32ae15800 4 Realm: () 2024-03-04T12:37:22.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.882+0000 7fc32ae15800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:22.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.882+0000 7fc32ae15800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:22.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.882+0000 7fc32ae15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:22.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.882+0000 7fc32ae15800 20 zonegroup default 2024-03-04T12:37:22.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.882+0000 7fc32ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.882+0000 7fc32ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.882+0000 7fc32ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.882+0000 7fc32ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.882+0000 7fc32ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.883+0000 7fc32ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.883+0000 7fc32ae15800 20 started sync module instance, tier type = 2024-03-04T12:37:22.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.883+0000 7fc32ae15800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:22.897 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.891+0000 7fc32ae15800 20 add_watcher() i=0 2024-03-04T12:37:22.897 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.891+0000 7fc32ae15800 20 add_watcher() i=1 2024-03-04T12:37:22.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.891+0000 7fc32ae15800 20 add_watcher() i=2 2024-03-04T12:37:22.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.891+0000 7fc32ae15800 20 add_watcher() i=3 2024-03-04T12:37:22.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.891+0000 7fc32ae15800 20 add_watcher() i=4 2024-03-04T12:37:22.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.891+0000 7fc32ae15800 20 add_watcher() i=5 2024-03-04T12:37:22.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.891+0000 7fc32ae15800 20 add_watcher() i=6 2024-03-04T12:37:22.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.892+0000 7fc32ae15800 20 add_watcher() i=7 2024-03-04T12:37:22.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.892+0000 7fc32ae15800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:22.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.894+0000 7fc1dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:22.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.894+0000 7fc32ae15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:22.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.894+0000 7fc32ae15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:22.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.894+0000 7fc32ae15800 5 note: GC not initialized 2024-03-04T12:37:22.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.894+0000 7fc1577fe640 20 reqs_thread_entry: start 2024-03-04T12:37:22.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.894+0000 7fc32ae15800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:22.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.895+0000 7fc32ae15800 20 Filter name: none 2024-03-04T12:37:22.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.895+0000 7fc1557fa640 20 reqs_thread_entry: start 2024-03-04T12:37:22.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.895+0000 7fc32ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.895+0000 7fc32ae15800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:37:22.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.895+0000 7fc32ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.903 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.896+0000 7fc32ae15800 20 rados_obj.operate() r=0 bl.length=383 2024-03-04T12:37:22.903 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.896+0000 7fc32ae15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:22.903 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.896+0000 7fc32ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.903 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.896+0000 7fc32ae15800 20 rados_obj.operate() r=0 bl.length=211 2024-03-04T12:37:22.903 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.896+0000 7fc32ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.903 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.896+0000 7fc32ae15800 20 rados_obj.operate() r=0 bl.length=383 2024-03-04T12:37:22.903 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.896+0000 7fc32ae15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:22.903 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.897+0000 7fc32ae15800 20 rados->read ofs=0 len=0 2024-03-04T12:37:22.904 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.897+0000 7fc32ae15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:22.904 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.898+0000 7fc1dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:22.908 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.902+0000 7fc32ae15800 20 remove_watcher() i=0 2024-03-04T12:37:22.908 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.902+0000 7fc32ae15800 2 removed watcher, disabling cache 2024-03-04T12:37:22.908 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.903+0000 7fc32ae15800 20 remove_watcher() i=1 2024-03-04T12:37:22.909 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.904+0000 7fc32ae15800 20 remove_watcher() i=2 2024-03-04T12:37:22.910 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.905+0000 7fc32ae15800 20 remove_watcher() i=3 2024-03-04T12:37:22.911 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.905+0000 7fc32ae15800 20 remove_watcher() i=4 2024-03-04T12:37:22.912 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.906+0000 7fc32ae15800 20 remove_watcher() i=5 2024-03-04T12:37:22.913 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.907+0000 7fc32ae15800 20 remove_watcher() i=6 2024-03-04T12:37:22.914 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:22.908+0000 7fc32ae15800 20 remove_watcher() i=7 2024-03-04T12:37:22.923 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:37:22.924 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:37:22.924 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: abort-at-do-reshard id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-04T12:37:22.924 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:37:22.926 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:22.926 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:22.941 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:22.941 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:23.091 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:23.091 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:23.222 INFO:tasks.workunit.client.0.smithi110.stderr: test: reshard versioned bucket 2024-03-04T12:37:23.224 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket myver 2024-03-04T12:37:23.251 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:23.251 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:23.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.278+0000 7f8d19e12800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.279+0000 7f8d19e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.279+0000 7f8d19e12800 20 realm 2024-03-04T12:37:23.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.279+0000 7f8d19e12800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.279+0000 7f8d19e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.279+0000 7f8d19e12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:23.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.279+0000 7f8d19e12800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.279+0000 7f8d19e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.279+0000 7f8d19e12800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.280+0000 7f8d19e12800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:23.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.280+0000 7f8d19e12800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.280+0000 7f8d19e12800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:23.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.281+0000 7f8d19e12800 20 searching for the correct realm 2024-03-04T12:37:23.290 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.285+0000 7f8d15bf1640 0 -- 172.21.15.110:0/1673717765 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7f8d00009040 msgr2=0x7f8d0004a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:23.497 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.491+0000 7f8d153f0640 0 -- 172.21.15.110:0/1673717765 >> [v2:172.21.15.172:6800/824320839,v1:172.21.15.172:6801/824320839] conn(0x55e5648c3bc0 msgr2=0x55e5648c5fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:23.499 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.493+0000 7f8d19e12800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:23.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.493+0000 7f8d19e12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:23.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.493+0000 7f8d19e12800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:23.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.493+0000 7f8d19e12800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:23.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.493+0000 7f8d19e12800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:23.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.493+0000 7f8d19e12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:23.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.493+0000 7f8d19e12800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.494+0000 7f8d19e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.500 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.494+0000 7f8d19e12800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.501 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.494+0000 7f8d19e12800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:23.501 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.494+0000 7f8d19e12800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.501 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.494+0000 7f8d19e12800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:23.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.494+0000 7f8d19e12800 20 zone default found 2024-03-04T12:37:23.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.494+0000 7f8d19e12800 4 Realm: () 2024-03-04T12:37:23.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.494+0000 7f8d19e12800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:23.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.494+0000 7f8d19e12800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:23.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.494+0000 7f8d19e12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:23.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.494+0000 7f8d19e12800 20 zonegroup default 2024-03-04T12:37:23.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.494+0000 7f8d19e12800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.494+0000 7f8d19e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.494+0000 7f8d19e12800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.495+0000 7f8d19e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.495+0000 7f8d19e12800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.495+0000 7f8d19e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.502 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.495+0000 7f8d19e12800 20 started sync module instance, tier type = 2024-03-04T12:37:23.503 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.495+0000 7f8d19e12800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:23.510 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.504+0000 7f8d19e12800 20 add_watcher() i=0 2024-03-04T12:37:23.510 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.504+0000 7f8d19e12800 20 add_watcher() i=1 2024-03-04T12:37:23.510 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.504+0000 7f8d19e12800 20 add_watcher() i=2 2024-03-04T12:37:23.510 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.504+0000 7f8d19e12800 20 add_watcher() i=3 2024-03-04T12:37:23.511 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.504+0000 7f8d19e12800 20 add_watcher() i=4 2024-03-04T12:37:23.511 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.504+0000 7f8d19e12800 20 add_watcher() i=5 2024-03-04T12:37:23.511 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.504+0000 7f8d19e12800 20 add_watcher() i=6 2024-03-04T12:37:23.511 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.505+0000 7f8d19e12800 20 add_watcher() i=7 2024-03-04T12:37:23.511 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.505+0000 7f8d19e12800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:23.513 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.507+0000 7f8bcb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:23.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.507+0000 7f8d19e12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:23.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.507+0000 7f8d19e12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:23.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.507+0000 7f8d19e12800 5 note: GC not initialized 2024-03-04T12:37:23.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.507+0000 7f8bca7e4640 20 reqs_thread_entry: start 2024-03-04T12:37:23.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.507+0000 7f8d19e12800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:23.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.507+0000 7f8d19e12800 20 Filter name: none 2024-03-04T12:37:23.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.507+0000 7f8b3bfff640 20 reqs_thread_entry: start 2024-03-04T12:37:23.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.507+0000 7f8d19e12800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.508+0000 7f8d19e12800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:37:23.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.508+0000 7f8d19e12800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.508+0000 7f8d19e12800 20 rados_obj.operate() r=0 bl.length=369 2024-03-04T12:37:23.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.508+0000 7f8d19e12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:23.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.508+0000 7f8d19e12800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.509+0000 7f8d19e12800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:37:23.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.509+0000 7f8d19e12800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.509+0000 7f8d19e12800 20 rados_obj.operate() r=0 bl.length=369 2024-03-04T12:37:23.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.509+0000 7f8d19e12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:23.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.510+0000 7f8d19e12800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.510+0000 7f8d19e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.517 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.511+0000 7f8bcb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:23.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.513+0000 7f8d19e12800 20 remove_watcher() i=0 2024-03-04T12:37:23.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.513+0000 7f8d19e12800 2 removed watcher, disabling cache 2024-03-04T12:37:23.520 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.514+0000 7f8d19e12800 20 remove_watcher() i=1 2024-03-04T12:37:23.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.515+0000 7f8d19e12800 20 remove_watcher() i=2 2024-03-04T12:37:23.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.517+0000 7f8d19e12800 20 remove_watcher() i=3 2024-03-04T12:37:23.524 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.518+0000 7f8d19e12800 20 remove_watcher() i=4 2024-03-04T12:37:23.524 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.519+0000 7f8d19e12800 20 remove_watcher() i=5 2024-03-04T12:37:23.525 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.519+0000 7f8d19e12800 20 remove_watcher() i=6 2024-03-04T12:37:23.526 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.520+0000 7f8d19e12800 20 remove_watcher() i=7 2024-03-04T12:37:23.536 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:37:23.536 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:37:23.536 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: myver id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-03-04T12:37:23.536 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:37:23.537 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-03-04T12:37:23.567 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:23.567 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:23.599 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.593+0000 7f1a19c1b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.595+0000 7f1a19c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.595+0000 7f1a19c1b800 20 realm 2024-03-04T12:37:23.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.595+0000 7f1a19c1b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.595+0000 7f1a19c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.595+0000 7f1a19c1b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:23.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.595+0000 7f1a19c1b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.595+0000 7f1a19c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.595+0000 7f1a19c1b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.596+0000 7f1a19c1b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:23.602 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.596+0000 7f1a19c1b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.596+0000 7f1a19c1b800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:23.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.596+0000 7f1a19c1b800 20 searching for the correct realm 2024-03-04T12:37:23.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.600+0000 7f1a17f18640 0 -- 172.21.15.110:0/2296094484 >> [v2:172.21.15.110:6824/3005097257,v1:172.21.15.110:6825/3005097257] conn(0x5571a445afa0 msgr2=0x5571a445d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:23.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.603+0000 7f1a16f16640 0 -- 172.21.15.110:0/2296094484 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f1a080673f0 msgr2=0x7f1a08061040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:37:23.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.608+0000 7f1a19c1b800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:23.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.608+0000 7f1a19c1b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:23.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.608+0000 7f1a19c1b800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:23.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.608+0000 7f1a19c1b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:23.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.608+0000 7f1a19c1b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:23.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.608+0000 7f1a19c1b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:23.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.608+0000 7f1a19c1b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.608+0000 7f1a19c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.608+0000 7f1a19c1b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.608+0000 7f1a19c1b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:23.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.608+0000 7f1a19c1b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.609+0000 7f1a19c1b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:23.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.609+0000 7f1a19c1b800 20 zone default found 2024-03-04T12:37:23.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.609+0000 7f1a19c1b800 4 Realm: () 2024-03-04T12:37:23.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.609+0000 7f1a19c1b800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:23.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.609+0000 7f1a19c1b800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:23.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.609+0000 7f1a19c1b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:23.617 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.609+0000 7f1a19c1b800 20 zonegroup default 2024-03-04T12:37:23.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.609+0000 7f1a19c1b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.609+0000 7f1a19c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.609+0000 7f1a19c1b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.609+0000 7f1a19c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.609+0000 7f1a19c1b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.609+0000 7f1a19c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.609+0000 7f1a19c1b800 20 started sync module instance, tier type = 2024-03-04T12:37:23.618 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.609+0000 7f1a19c1b800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:23.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.618+0000 7f1a19c1b800 20 add_watcher() i=0 2024-03-04T12:37:23.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.618+0000 7f1a19c1b800 20 add_watcher() i=1 2024-03-04T12:37:23.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.618+0000 7f1a19c1b800 20 add_watcher() i=2 2024-03-04T12:37:23.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.618+0000 7f1a19c1b800 20 add_watcher() i=3 2024-03-04T12:37:23.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.618+0000 7f1a19c1b800 20 add_watcher() i=4 2024-03-04T12:37:23.624 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.618+0000 7f1a19c1b800 20 add_watcher() i=5 2024-03-04T12:37:23.625 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.618+0000 7f1a19c1b800 20 add_watcher() i=6 2024-03-04T12:37:23.625 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.619+0000 7f1a19c1b800 20 add_watcher() i=7 2024-03-04T12:37:23.625 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.619+0000 7f1a19c1b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:23.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.620+0000 7f18cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:23.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.621+0000 7f1a19c1b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:23.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.621+0000 7f1a19c1b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:23.627 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.621+0000 7f1a19c1b800 5 note: GC not initialized 2024-03-04T12:37:23.628 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.621+0000 7f18ccfe1640 20 reqs_thread_entry: start 2024-03-04T12:37:23.628 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.621+0000 7f1a19c1b800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:23.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.621+0000 7f1a19c1b800 20 Filter name: none 2024-03-04T12:37:23.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.621+0000 7f18467fc640 20 reqs_thread_entry: start 2024-03-04T12:37:23.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.621+0000 7f1a19c1b800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-04T12:37:23.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.621+0000 7f1a19c1b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.621+0000 7f1a19c1b800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:37:23.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.621+0000 7f1a19c1b800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-04T12:37:23.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.621+0000 7f1a19c1b800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-04T12:37:23.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.621+0000 7f1a19c1b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 : miss 2024-03-04T12:37:23.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.621+0000 7f1a19c1b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.622+0000 7f1a19c1b800 20 rados_obj.operate() r=0 bl.length=369 2024-03-04T12:37:23.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.622+0000 7f1a19c1b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 info.flags=0x17 2024-03-04T12:37:23.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.622+0000 7f1a19c1b800 10 adding default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 to cache LRU end 2024-03-04T12:37:23.629 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.622+0000 7f1a19c1b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:37:23.630 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.622+0000 7f1a19c1b800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:23.630 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.622+0000 7f1a19c1b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 2024-03-04T12:37:23.633 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.627+0000 7f1a19c1b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 info.flags=0x17 2024-03-04T12:37:23.633 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.627+0000 7f1a19c1b800 10 moving default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 to cache LRU end 2024-03-04T12:37:23.634 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.627+0000 7f1a19c1b800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:23.634 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.627+0000 7f1a19c1b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19, ofs0, ns] 2024-03-04T12:37:23.634 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.628+0000 7f18faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824114 cookie 93946575757152 notifier 7086 bl.length()=855 2024-03-04T12:37:23.634 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.628+0000 7f18faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 info.flags=0x17 2024-03-04T12:37:23.634 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.628+0000 7f18faffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 to cache LRU end 2024-03-04T12:37:23.634 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.628+0000 7f18faffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:23.635 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.629+0000 7f1a19c1b800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): orig_sources= new_sources= 2024-03-04T12:37:23.635 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.629+0000 7f1a19c1b800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): potential sources added=[] removed=[] 2024-03-04T12:37:23.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.629+0000 7f1a19c1b800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): orig_dests= new_dests= 2024-03-04T12:37:23.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.629+0000 7f1a19c1b800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): potential dests added=[] removed=[] 2024-03-04T12:37:23.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.0 2024-03-04T12:37:23.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.0 2024-03-04T12:37:23.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.1 2024-03-04T12:37:23.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.1 2024-03-04T12:37:23.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.2 2024-03-04T12:37:23.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.2 2024-03-04T12:37:23.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.3 2024-03-04T12:37:23.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.3 2024-03-04T12:37:23.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.4 2024-03-04T12:37:23.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.4 2024-03-04T12:37:23.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.5 2024-03-04T12:37:23.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.5 2024-03-04T12:37:23.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.6 2024-03-04T12:37:23.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.6 2024-03-04T12:37:23.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.7 2024-03-04T12:37:23.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.7 2024-03-04T12:37:23.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.8 2024-03-04T12:37:23.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.8 2024-03-04T12:37:23.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.9 2024-03-04T12:37:23.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.9 2024-03-04T12:37:23.639 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.10 2024-03-04T12:37:23.640 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.10 2024-03-04T12:37:23.640 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.11 2024-03-04T12:37:23.640 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.11 2024-03-04T12:37:23.640 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.0 2024-03-04T12:37:23.640 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1 2024-03-04T12:37:23.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.632+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2 2024-03-04T12:37:23.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.633+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3 2024-03-04T12:37:23.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.633+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.4 2024-03-04T12:37:23.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.634+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.5 2024-03-04T12:37:23.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.634+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.6 2024-03-04T12:37:23.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.635+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.7 2024-03-04T12:37:23.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.635+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.8 2024-03-04T12:37:23.642 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.635+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.9 2024-03-04T12:37:23.642 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.636+0000 7f1a19c1b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.10 2024-03-04T12:37:23.642 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.636+0000 7f1a19c1b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 : hit (requested=0x17, cached=0x17) 2024-03-04T12:37:23.642 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.636+0000 7f1a19c1b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 2024-03-04T12:37:23.644 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.638+0000 7f1a19c1b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 info.flags=0x17 2024-03-04T12:37:23.644 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.638+0000 7f1a19c1b800 10 moving default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 to cache LRU end 2024-03-04T12:37:23.644 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.638+0000 7f1a19c1b800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:23.644 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.638+0000 7f1a19c1b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19, ofs0, ns] 2024-03-04T12:37:23.644 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.638+0000 7f18fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824115 cookie 93946575757152 notifier 7086 bl.length()=823 2024-03-04T12:37:23.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.638+0000 7f18fa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 info.flags=0x17 2024-03-04T12:37:23.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.638+0000 7f18fa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 to cache LRU end 2024-03-04T12:37:23.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.638+0000 7f18fa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:23.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.639+0000 7f1a19c1b800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): orig_sources= new_sources= 2024-03-04T12:37:23.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.639+0000 7f1a19c1b800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): potential sources added=[] removed=[] 2024-03-04T12:37:23.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.639+0000 7f1a19c1b800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): orig_dests= new_dests= 2024-03-04T12:37:23.645 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.639+0000 7f1a19c1b800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): potential dests added=[] removed=[] 2024-03-04T12:37:23.647 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.641+0000 7f1a19c1b800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-03-04T12:37:23.649 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.643+0000 7f18cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:23.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.645+0000 7f1a19c1b800 20 remove_watcher() i=0 2024-03-04T12:37:23.651 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.645+0000 7f1a19c1b800 2 removed watcher, disabling cache 2024-03-04T12:37:23.652 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.646+0000 7f1a19c1b800 20 remove_watcher() i=1 2024-03-04T12:37:23.653 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.647+0000 7f1a19c1b800 20 remove_watcher() i=2 2024-03-04T12:37:23.654 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.648+0000 7f1a19c1b800 20 remove_watcher() i=3 2024-03-04T12:37:23.655 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.649+0000 7f1a19c1b800 20 remove_watcher() i=4 2024-03-04T12:37:23.656 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.650+0000 7f1a19c1b800 20 remove_watcher() i=5 2024-03-04T12:37:23.657 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.651+0000 7f1a19c1b800 20 remove_watcher() i=6 2024-03-04T12:37:23.657 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.651+0000 7f1a19c1b800 20 remove_watcher() i=7 2024-03-04T12:37:23.668 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket myver 2024-03-04T12:37:23.696 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:23.696 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:23.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.722+0000 7f1e7ff31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.724+0000 7f1e7ff31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.724+0000 7f1e7ff31800 20 realm 2024-03-04T12:37:23.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.724+0000 7f1e7ff31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.724+0000 7f1e7ff31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.724+0000 7f1e7ff31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:23.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.724+0000 7f1e7ff31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.724+0000 7f1e7ff31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.724+0000 7f1e7ff31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.725+0000 7f1e7ff31800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:23.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.725+0000 7f1e7ff31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.725+0000 7f1e7ff31800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:23.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.725+0000 7f1e7ff31800 20 searching for the correct realm 2024-03-04T12:37:23.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.728+0000 7f1e73fff640 0 -- 172.21.15.110:0/1874361039 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x55a6c20ef770 msgr2=0x55a6c20f1be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:37:23.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.732+0000 7f1e7bc31640 0 -- 172.21.15.110:0/1874361039 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f1e64056440 msgr2=0x7f1e640568c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:23.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.736+0000 7f1e7ff31800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:23.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.736+0000 7f1e7ff31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:23.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.736+0000 7f1e7ff31800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:23.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.736+0000 7f1e7ff31800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:23.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.736+0000 7f1e7ff31800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:23.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.736+0000 7f1e7ff31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:23.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.736+0000 7f1e7ff31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.736+0000 7f1e7ff31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.736+0000 7f1e7ff31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.737+0000 7f1e7ff31800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:23.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.737+0000 7f1e7ff31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.737+0000 7f1e7ff31800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:23.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.737+0000 7f1e7ff31800 20 zone default found 2024-03-04T12:37:23.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.737+0000 7f1e7ff31800 4 Realm: () 2024-03-04T12:37:23.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.737+0000 7f1e7ff31800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:23.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.737+0000 7f1e7ff31800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:23.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.737+0000 7f1e7ff31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:23.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.737+0000 7f1e7ff31800 20 zonegroup default 2024-03-04T12:37:23.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.737+0000 7f1e7ff31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.737+0000 7f1e7ff31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.737+0000 7f1e7ff31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.738+0000 7f1e7ff31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.738+0000 7f1e7ff31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.738+0000 7f1e7ff31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.738+0000 7f1e7ff31800 20 started sync module instance, tier type = 2024-03-04T12:37:23.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.738+0000 7f1e7ff31800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:23.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.746+0000 7f1e7ff31800 20 add_watcher() i=0 2024-03-04T12:37:23.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.746+0000 7f1e7ff31800 20 add_watcher() i=1 2024-03-04T12:37:23.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.746+0000 7f1e7ff31800 20 add_watcher() i=2 2024-03-04T12:37:23.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.746+0000 7f1e7ff31800 20 add_watcher() i=3 2024-03-04T12:37:23.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.746+0000 7f1e7ff31800 20 add_watcher() i=4 2024-03-04T12:37:23.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.746+0000 7f1e7ff31800 20 add_watcher() i=5 2024-03-04T12:37:23.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.746+0000 7f1e7ff31800 20 add_watcher() i=6 2024-03-04T12:37:23.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.747+0000 7f1e7ff31800 20 add_watcher() i=7 2024-03-04T12:37:23.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.747+0000 7f1e7ff31800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:23.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.749+0000 7f1d31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:23.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.749+0000 7f1e7ff31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:23.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.749+0000 7f1e7ff31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:23.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.749+0000 7f1e7ff31800 5 note: GC not initialized 2024-03-04T12:37:23.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.749+0000 7f1d30fe1640 20 reqs_thread_entry: start 2024-03-04T12:37:23.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.749+0000 7f1e7ff31800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:23.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.749+0000 7f1e7ff31800 20 Filter name: none 2024-03-04T12:37:23.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.750+0000 7f1caa7fc640 20 reqs_thread_entry: start 2024-03-04T12:37:23.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.750+0000 7f1e7ff31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.750+0000 7f1e7ff31800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:37:23.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.750+0000 7f1e7ff31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.750+0000 7f1e7ff31800 20 rados_obj.operate() r=0 bl.length=369 2024-03-04T12:37:23.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.750+0000 7f1e7ff31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:23.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.750+0000 7f1e7ff31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.751+0000 7f1e7ff31800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:37:23.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.751+0000 7f1e7ff31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.751+0000 7f1e7ff31800 20 rados_obj.operate() r=0 bl.length=369 2024-03-04T12:37:23.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.751+0000 7f1e7ff31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:23.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.752+0000 7f1e7ff31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:23.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.752+0000 7f1e7ff31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:23.759 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.753+0000 7f1d31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:23.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.755+0000 7f1e7ff31800 20 remove_watcher() i=0 2024-03-04T12:37:23.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.755+0000 7f1e7ff31800 2 removed watcher, disabling cache 2024-03-04T12:37:23.762 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.756+0000 7f1e7ff31800 20 remove_watcher() i=1 2024-03-04T12:37:23.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.757+0000 7f1e7ff31800 20 remove_watcher() i=2 2024-03-04T12:37:23.764 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.758+0000 7f1e7ff31800 20 remove_watcher() i=3 2024-03-04T12:37:23.765 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.759+0000 7f1e7ff31800 20 remove_watcher() i=4 2024-03-04T12:37:23.766 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.760+0000 7f1e7ff31800 20 remove_watcher() i=5 2024-03-04T12:37:23.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.761+0000 7f1e7ff31800 20 remove_watcher() i=6 2024-03-04T12:37:23.767 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:23.762+0000 7f1e7ff31800 20 remove_watcher() i=7 2024-03-04T12:37:23.777 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:37:23.777 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:37:23.777 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: myver id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-03-04T12:37:23.777 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:37:23.780 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:23.780 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:23.796 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:23.796 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:23.849 INFO:tasks.workunit.client.0.smithi110.stderr: test: reshard removes olh entries with empty name 2024-03-04T12:37:23.852 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:23.852 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:23.923 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:23.924 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:24.001 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-04T12:37:24.028 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:24.028 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:24.060 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.054+0000 7fbdec922800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.056+0000 7fbdec922800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.056+0000 7fbdec922800 20 realm 2024-03-04T12:37:24.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.056+0000 7fbdec922800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.056+0000 7fbdec922800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.056+0000 7fbdec922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:24.062 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.056+0000 7fbdec922800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.056+0000 7fbdec922800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.056+0000 7fbdec922800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.057+0000 7fbdec922800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:24.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.057+0000 7fbdec922800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.063 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.057+0000 7fbdec922800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:24.064 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.057+0000 7fbdec922800 20 searching for the correct realm 2024-03-04T12:37:24.066 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.060+0000 7fbde7e22640 0 -- 172.21.15.110:0/886012234 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x560f94618ad0 msgr2=0x560f9461af40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:24.070 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.064+0000 7fbde8623640 0 -- 172.21.15.110:0/886012234 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fbddc062040 msgr2=0x7fbddc02b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:24.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.067+0000 7fbdec922800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:24.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.067+0000 7fbdec922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:24.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.067+0000 7fbdec922800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:24.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.067+0000 7fbdec922800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:24.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.068+0000 7fbdec922800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:24.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.068+0000 7fbdec922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:24.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.068+0000 7fbdec922800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.068+0000 7fbdec922800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.068+0000 7fbdec922800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.074 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.068+0000 7fbdec922800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:24.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.068+0000 7fbdec922800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.075 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.068+0000 7fbdec922800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:24.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.068+0000 7fbdec922800 20 zone default found 2024-03-04T12:37:24.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.068+0000 7fbdec922800 4 Realm: () 2024-03-04T12:37:24.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.068+0000 7fbdec922800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:24.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.068+0000 7fbdec922800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:24.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.068+0000 7fbdec922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:24.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.068+0000 7fbdec922800 20 zonegroup default 2024-03-04T12:37:24.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.068+0000 7fbdec922800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.069+0000 7fbdec922800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.069+0000 7fbdec922800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.069+0000 7fbdec922800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.069+0000 7fbdec922800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.069+0000 7fbdec922800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.069+0000 7fbdec922800 20 started sync module instance, tier type = 2024-03-04T12:37:24.076 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.069+0000 7fbdec922800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:24.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.078+0000 7fbdec922800 20 add_watcher() i=0 2024-03-04T12:37:24.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.078+0000 7fbdec922800 20 add_watcher() i=1 2024-03-04T12:37:24.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.078+0000 7fbdec922800 20 add_watcher() i=2 2024-03-04T12:37:24.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.078+0000 7fbdec922800 20 add_watcher() i=3 2024-03-04T12:37:24.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.078+0000 7fbdec922800 20 add_watcher() i=4 2024-03-04T12:37:24.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.078+0000 7fbdec922800 20 add_watcher() i=5 2024-03-04T12:37:24.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.078+0000 7fbdec922800 20 add_watcher() i=6 2024-03-04T12:37:24.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.078+0000 7fbdec922800 20 add_watcher() i=7 2024-03-04T12:37:24.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.078+0000 7fbdec922800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:24.086 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.080+0000 7fbc9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:24.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.080+0000 7fbdec922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:24.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.080+0000 7fbdec922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:24.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.081+0000 7fbdec922800 5 note: GC not initialized 2024-03-04T12:37:24.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.081+0000 7fbc9dfdb640 20 reqs_thread_entry: start 2024-03-04T12:37:24.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.081+0000 7fbdec922800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:24.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.081+0000 7fbdec922800 20 Filter name: none 2024-03-04T12:37:24.087 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.081+0000 7fbc0f7fe640 20 reqs_thread_entry: start 2024-03-04T12:37:24.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.081+0000 7fbdec922800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.088 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.082+0000 7fbdec922800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:37:24.089 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.082+0000 7fbdec922800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.089 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.082+0000 7fbdec922800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:37:24.089 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.082+0000 7fbdec922800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:24.089 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.082+0000 7fbdec922800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.089 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.082+0000 7fbdec922800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:37:24.089 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.082+0000 7fbdec922800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.089 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.083+0000 7fbdec922800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:37:24.089 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.083+0000 7fbdec922800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:24.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.084+0000 7fbdec922800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.084+0000 7fbdec922800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.084+0000 7fbc9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:24.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.086+0000 7fbdec922800 20 remove_watcher() i=0 2024-03-04T12:37:24.092 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.086+0000 7fbdec922800 2 removed watcher, disabling cache 2024-03-04T12:37:24.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.087+0000 7fbdec922800 20 remove_watcher() i=1 2024-03-04T12:37:24.094 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.088+0000 7fbdec922800 20 remove_watcher() i=2 2024-03-04T12:37:24.095 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.089+0000 7fbdec922800 20 remove_watcher() i=3 2024-03-04T12:37:24.096 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.090+0000 7fbdec922800 20 remove_watcher() i=4 2024-03-04T12:37:24.097 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.091+0000 7fbdec922800 20 remove_watcher() i=5 2024-03-04T12:37:24.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.092+0000 7fbdec922800 20 remove_watcher() i=6 2024-03-04T12:37:24.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.093+0000 7fbdec922800 20 remove_watcher() i=7 2024-03-04T12:37:24.109 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:37:24.109 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:37:24.109 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: a-bucket id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-03-04T12:37:24.109 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:37:24.110 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-03-04T12:37:24.137 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:24.137 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:24.169 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.163+0000 7f4aeda16800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.165+0000 7f4aeda16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.165+0000 7f4aeda16800 20 realm 2024-03-04T12:37:24.171 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.165+0000 7f4aeda16800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.172 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.165+0000 7f4aeda16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.172 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.165+0000 7f4aeda16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:24.172 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.165+0000 7f4aeda16800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.172 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.165+0000 7f4aeda16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.172 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.165+0000 7f4aeda16800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.172 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.166+0000 7f4aeda16800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:24.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.166+0000 7f4aeda16800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.167+0000 7f4aeda16800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:24.173 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.167+0000 7f4aeda16800 20 searching for the correct realm 2024-03-04T12:37:24.175 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.170+0000 7f4ae9882640 0 -- 172.21.15.110:0/2062354747 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x560577049250 msgr2=0x7f4ae0060a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:24.179 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.173+0000 7f4ae9081640 0 -- 172.21.15.110:0/2062354747 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f4ae00193c0 msgr2=0x7f4ae0019840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:24.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.379+0000 7f4aeda16800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:24.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.379+0000 7f4aeda16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:24.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.379+0000 7f4aeda16800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:24.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.379+0000 7f4aeda16800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:24.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.379+0000 7f4aeda16800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:24.385 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.379+0000 7f4aeda16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:24.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.379+0000 7f4aeda16800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.379+0000 7f4aeda16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.379+0000 7f4aeda16800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.379+0000 7f4aeda16800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:24.386 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.379+0000 7f4aeda16800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.380+0000 7f4aeda16800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:24.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.380+0000 7f4aeda16800 20 zone default found 2024-03-04T12:37:24.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.380+0000 7f4aeda16800 4 Realm: () 2024-03-04T12:37:24.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.380+0000 7f4aeda16800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:24.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.380+0000 7f4aeda16800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:24.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.380+0000 7f4aeda16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:24.387 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.380+0000 7f4aeda16800 20 zonegroup default 2024-03-04T12:37:24.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.380+0000 7f4aeda16800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.380+0000 7f4aeda16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.380+0000 7f4aeda16800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.380+0000 7f4aeda16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.380+0000 7f4aeda16800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.380+0000 7f4aeda16800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.380+0000 7f4aeda16800 20 started sync module instance, tier type = 2024-03-04T12:37:24.388 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.380+0000 7f4aeda16800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:24.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.389+0000 7f4aeda16800 20 add_watcher() i=0 2024-03-04T12:37:24.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.389+0000 7f4aeda16800 20 add_watcher() i=1 2024-03-04T12:37:24.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.389+0000 7f4aeda16800 20 add_watcher() i=2 2024-03-04T12:37:24.395 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.389+0000 7f4aeda16800 20 add_watcher() i=3 2024-03-04T12:37:24.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.389+0000 7f4aeda16800 20 add_watcher() i=4 2024-03-04T12:37:24.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.389+0000 7f4aeda16800 20 add_watcher() i=5 2024-03-04T12:37:24.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.389+0000 7f4aeda16800 20 add_watcher() i=6 2024-03-04T12:37:24.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.390+0000 7f4aeda16800 20 add_watcher() i=7 2024-03-04T12:37:24.396 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.390+0000 7f4aeda16800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:24.398 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.392+0000 7f499f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:24.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.392+0000 7f4aeda16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:24.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.392+0000 7f4aeda16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:24.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.392+0000 7f4aeda16800 5 note: GC not initialized 2024-03-04T12:37:24.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.392+0000 7f499e7e4640 20 reqs_thread_entry: start 2024-03-04T12:37:24.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.393+0000 7f4aeda16800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:24.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.393+0000 7f4aeda16800 20 Filter name: none 2024-03-04T12:37:24.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.393+0000 7f490ffff640 20 reqs_thread_entry: start 2024-03-04T12:37:24.399 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.393+0000 7f4aeda16800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.393+0000 7f4aeda16800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:37:24.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.393+0000 7f4aeda16800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.394+0000 7f4aeda16800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:37:24.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.394+0000 7f4aeda16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:24.400 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.394+0000 7f499f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:24.403 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.397+0000 7f4aeda16800 20 remove_watcher() i=0 2024-03-04T12:37:24.403 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.397+0000 7f4aeda16800 2 removed watcher, disabling cache 2024-03-04T12:37:24.403 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.398+0000 7f4aeda16800 20 remove_watcher() i=1 2024-03-04T12:37:24.404 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.398+0000 7f4aeda16800 20 remove_watcher() i=2 2024-03-04T12:37:24.405 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.399+0000 7f4aeda16800 20 remove_watcher() i=3 2024-03-04T12:37:24.406 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.400+0000 7f4aeda16800 20 remove_watcher() i=4 2024-03-04T12:37:24.407 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.401+0000 7f4aeda16800 20 remove_watcher() i=5 2024-03-04T12:37:24.408 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.402+0000 7f4aeda16800 20 remove_watcher() i=6 2024-03-04T12:37:24.409 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.403+0000 7f4aeda16800 20 remove_watcher() i=7 2024-03-04T12:37:24.420 INFO:tasks.workunit.client.0.smithi110.stderr:rados -p default.rgw.buckets.index setomapval .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-03-04T12:37:24.444 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:24.444 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:24.460 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket a-bucket 2024-03-04T12:37:24.487 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:24.487 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:24.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.512+0000 7ff65d610800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.514+0000 7ff65d610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.514+0000 7ff65d610800 20 realm 2024-03-04T12:37:24.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.514+0000 7ff65d610800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.514+0000 7ff65d610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.514+0000 7ff65d610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:24.521 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.514+0000 7ff65d610800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.514+0000 7ff65d610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.514+0000 7ff65d610800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.515+0000 7ff65d610800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:24.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.515+0000 7ff65d610800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.522 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.515+0000 7ff65d610800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:24.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.515+0000 7ff65d610800 20 searching for the correct realm 2024-03-04T12:37:24.524 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.517+0000 7ff653fff640 0 -- 172.21.15.110:0/1854679918 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7ff64c007f00 msgr2=0x7ff64c093ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:24.729 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.721+0000 7ff658c93640 0 -- 172.21.15.110:0/1854679918 >> [v2:172.21.15.172:6800/824320839,v1:172.21.15.172:6801/824320839] conn(0x55c5082b5620 msgr2=0x55c5082b7a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:37:24.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.727+0000 7ff65d610800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:24.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.727+0000 7ff65d610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:24.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.727+0000 7ff65d610800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:24.734 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.727+0000 7ff65d610800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:24.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.727+0000 7ff65d610800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:24.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.727+0000 7ff65d610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:24.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.727+0000 7ff65d610800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.727+0000 7ff65d610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.735 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.727+0000 7ff65d610800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.728+0000 7ff65d610800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:24.736 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.728+0000 7ff65d610800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.728+0000 7ff65d610800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:24.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.728+0000 7ff65d610800 20 zone default found 2024-03-04T12:37:24.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.728+0000 7ff65d610800 4 Realm: () 2024-03-04T12:37:24.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.728+0000 7ff65d610800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:24.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.728+0000 7ff65d610800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:24.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.728+0000 7ff65d610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:24.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.728+0000 7ff65d610800 20 zonegroup default 2024-03-04T12:37:24.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.728+0000 7ff65d610800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.728+0000 7ff65d610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.728+0000 7ff65d610800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.728+0000 7ff65d610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.728+0000 7ff65d610800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.737 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.729+0000 7ff65d610800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.729+0000 7ff65d610800 20 started sync module instance, tier type = 2024-03-04T12:37:24.738 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.729+0000 7ff65d610800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:24.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.737+0000 7ff65d610800 20 add_watcher() i=0 2024-03-04T12:37:24.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.737+0000 7ff65d610800 20 add_watcher() i=1 2024-03-04T12:37:24.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.737+0000 7ff65d610800 20 add_watcher() i=2 2024-03-04T12:37:24.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.737+0000 7ff65d610800 20 add_watcher() i=3 2024-03-04T12:37:24.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.737+0000 7ff65d610800 20 add_watcher() i=4 2024-03-04T12:37:24.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.737+0000 7ff65d610800 20 add_watcher() i=5 2024-03-04T12:37:24.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.737+0000 7ff65d610800 20 add_watcher() i=6 2024-03-04T12:37:24.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.738+0000 7ff65d610800 20 add_watcher() i=7 2024-03-04T12:37:24.745 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.738+0000 7ff65d610800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:24.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.740+0000 7ff50efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:24.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.740+0000 7ff65d610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:24.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.740+0000 7ff65d610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:24.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.740+0000 7ff65d610800 5 note: GC not initialized 2024-03-04T12:37:24.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.740+0000 7ff50dfe3640 20 reqs_thread_entry: start 2024-03-04T12:37:24.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.740+0000 7ff65d610800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:24.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.740+0000 7ff65d610800 20 Filter name: none 2024-03-04T12:37:24.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.740+0000 7ff47f7fe640 20 reqs_thread_entry: start 2024-03-04T12:37:24.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.740+0000 7ff65d610800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.741+0000 7ff65d610800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:37:24.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.741+0000 7ff65d610800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.742+0000 7ff65d610800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:37:24.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.742+0000 7ff65d610800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:24.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.742+0000 7ff65d610800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-03-04T12:37:24.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.742+0000 7ff65d610800 20 INFO: main: starting shard=0 2024-03-04T12:37:24.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.742+0000 7ff65d610800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.0 2024-03-04T12:37:24.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.742+0000 7ff65d610800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.0 2024-03-04T12:37:24.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.742+0000 7ff65d610800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-04T12:37:24.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.742+0000 7ff65d610800 20 INFO: main: starting shard=1 2024-03-04T12:37:24.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.742+0000 7ff65d610800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.1 2024-03-04T12:37:24.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.742+0000 7ff65d610800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.1 2024-03-04T12:37:24.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.742+0000 7ff65d610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:24.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.742+0000 7ff65d610800 20 INFO: main: starting shard=2 2024-03-04T12:37:24.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.742+0000 7ff65d610800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.2 2024-03-04T12:37:24.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.742+0000 7ff65d610800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.2 2024-03-04T12:37:24.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.743+0000 7ff65d610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:24.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.743+0000 7ff65d610800 20 INFO: main: starting shard=3 2024-03-04T12:37:24.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.743+0000 7ff65d610800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.3 2024-03-04T12:37:24.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.743+0000 7ff65d610800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.3 2024-03-04T12:37:24.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.743+0000 7ff65d610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:24.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.743+0000 7ff65d610800 20 INFO: main: starting shard=4 2024-03-04T12:37:24.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.743+0000 7ff65d610800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.4 2024-03-04T12:37:24.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.743+0000 7ff65d610800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.4 2024-03-04T12:37:24.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.744+0000 7ff65d610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:24.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.744+0000 7ff65d610800 20 INFO: main: starting shard=5 2024-03-04T12:37:24.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.744+0000 7ff65d610800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.5 2024-03-04T12:37:24.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.744+0000 7ff65d610800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.5 2024-03-04T12:37:24.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.744+0000 7ff65d610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:24.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.744+0000 7ff65d610800 20 INFO: main: starting shard=6 2024-03-04T12:37:24.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.744+0000 7ff65d610800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.6 2024-03-04T12:37:24.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.744+0000 7ff65d610800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.6 2024-03-04T12:37:24.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.745+0000 7ff65d610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:24.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.745+0000 7ff65d610800 20 INFO: main: starting shard=7 2024-03-04T12:37:24.754 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.745+0000 7ff65d610800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.7 2024-03-04T12:37:24.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.745+0000 7ff65d610800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.7 2024-03-04T12:37:24.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.745+0000 7ff65d610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:24.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.745+0000 7ff65d610800 20 INFO: main: starting shard=8 2024-03-04T12:37:24.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.745+0000 7ff65d610800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.8 2024-03-04T12:37:24.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.745+0000 7ff65d610800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.8 2024-03-04T12:37:24.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.746+0000 7ff65d610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:24.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.746+0000 7ff65d610800 20 INFO: main: starting shard=9 2024-03-04T12:37:24.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.746+0000 7ff65d610800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.9 2024-03-04T12:37:24.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.746+0000 7ff65d610800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.9 2024-03-04T12:37:24.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.746+0000 7ff65d610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:24.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.746+0000 7ff65d610800 20 INFO: main: starting shard=10 2024-03-04T12:37:24.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.746+0000 7ff65d610800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.10 2024-03-04T12:37:24.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.746+0000 7ff65d610800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.10 2024-03-04T12:37:24.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.747+0000 7ff65d610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:24.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.747+0000 7ff65d610800 20 INFO: main: starting shard=11 2024-03-04T12:37:24.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.747+0000 7ff65d610800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.11 2024-03-04T12:37:24.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.747+0000 7ff65d610800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.11 2024-03-04T12:37:24.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.747+0000 7ff65d610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:24.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.747+0000 7ff65d610800 20 INFO: main: starting shard=12 2024-03-04T12:37:24.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.747+0000 7ff65d610800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.12 2024-03-04T12:37:24.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.747+0000 7ff65d610800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.12 2024-03-04T12:37:24.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.748+0000 7ff65d610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:24.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.748+0000 7ff65d610800 20 INFO: main: done 2024-03-04T12:37:24.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.748+0000 7ff50efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:24.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.750+0000 7ff65d610800 20 remove_watcher() i=0 2024-03-04T12:37:24.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.750+0000 7ff65d610800 2 removed watcher, disabling cache 2024-03-04T12:37:24.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.751+0000 7ff65d610800 20 remove_watcher() i=1 2024-03-04T12:37:24.759 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.752+0000 7ff65d610800 20 remove_watcher() i=2 2024-03-04T12:37:24.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.753+0000 7ff65d610800 20 remove_watcher() i=3 2024-03-04T12:37:24.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.754+0000 7ff65d610800 20 remove_watcher() i=4 2024-03-04T12:37:24.762 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.755+0000 7ff65d610800 20 remove_watcher() i=5 2024-03-04T12:37:24.763 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.756+0000 7ff65d610800 20 remove_watcher() i=6 2024-03-04T12:37:24.764 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.757+0000 7ff65d610800 20 remove_watcher() i=7 2024-03-04T12:37:24.775 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-03-04T12:37:24.806 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:24.806 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:24.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.831+0000 7f08465a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.833+0000 7f08465a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.833+0000 7f08465a2800 20 realm 2024-03-04T12:37:24.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.833+0000 7f08465a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.841 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.833+0000 7f08465a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.841 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.833+0000 7f08465a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:24.841 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.833+0000 7f08465a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.841 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.833+0000 7f08465a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:24.841 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.833+0000 7f08465a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.842 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.834+0000 7f08465a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:24.842 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.834+0000 7f08465a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:24.842 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.834+0000 7f08465a2800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:24.842 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.834+0000 7f08465a2800 20 searching for the correct realm 2024-03-04T12:37:24.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:24.837+0000 7f083bfff640 0 -- 172.21.15.110:0/259333779 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f08340c5040 msgr2=0x7f08340959e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:37:25.050 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.043+0000 7f084409e640 0 -- 172.21.15.110:0/259333779 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f082c082040 msgr2=0x7f082c072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:25.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.248+0000 7f08465a2800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:25.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.248+0000 7f08465a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:25.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.248+0000 7f08465a2800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:25.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.248+0000 7f08465a2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:25.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.248+0000 7f08465a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:25.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.248+0000 7f08465a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:25.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.248+0000 7f08465a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.248+0000 7f08465a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.248+0000 7f08465a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.249+0000 7f08465a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:25.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.249+0000 7f08465a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.249+0000 7f08465a2800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:25.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.249+0000 7f08465a2800 20 zone default found 2024-03-04T12:37:25.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.249+0000 7f08465a2800 4 Realm: () 2024-03-04T12:37:25.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.249+0000 7f08465a2800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:25.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.249+0000 7f08465a2800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:25.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.249+0000 7f08465a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:25.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.249+0000 7f08465a2800 20 zonegroup default 2024-03-04T12:37:25.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.249+0000 7f08465a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.249+0000 7f08465a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.249+0000 7f08465a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.250+0000 7f08465a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.259 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.250+0000 7f08465a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.259 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.250+0000 7f08465a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.259 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.250+0000 7f08465a2800 20 started sync module instance, tier type = 2024-03-04T12:37:25.259 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.250+0000 7f08465a2800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:25.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.260+0000 7f08465a2800 20 add_watcher() i=0 2024-03-04T12:37:25.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.260+0000 7f08465a2800 20 add_watcher() i=1 2024-03-04T12:37:25.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.260+0000 7f08465a2800 20 add_watcher() i=2 2024-03-04T12:37:25.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.260+0000 7f08465a2800 20 add_watcher() i=3 2024-03-04T12:37:25.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.260+0000 7f08465a2800 20 add_watcher() i=4 2024-03-04T12:37:25.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.260+0000 7f08465a2800 20 add_watcher() i=5 2024-03-04T12:37:25.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.260+0000 7f08465a2800 20 add_watcher() i=6 2024-03-04T12:37:25.267 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.261+0000 7f08465a2800 20 add_watcher() i=7 2024-03-04T12:37:25.268 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.261+0000 7f08465a2800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:25.269 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.262+0000 7f06fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:25.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.263+0000 7f08465a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:25.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.263+0000 7f08465a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:25.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.263+0000 7f08465a2800 5 note: GC not initialized 2024-03-04T12:37:25.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.263+0000 7f06f9fdb640 20 reqs_thread_entry: start 2024-03-04T12:37:25.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.263+0000 7f08465a2800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:25.270 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.263+0000 7f08465a2800 20 Filter name: none 2024-03-04T12:37:25.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.263+0000 7f066b7fe640 20 reqs_thread_entry: start 2024-03-04T12:37:25.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.263+0000 7f08465a2800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-04T12:37:25.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.263+0000 7f08465a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.264+0000 7f08465a2800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:37:25.271 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.264+0000 7f08465a2800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-03-04T12:37:25.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.264+0000 7f08465a2800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-04T12:37:25.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.264+0000 7f08465a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 : miss 2024-03-04T12:37:25.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.264+0000 7f08465a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.264+0000 7f08465a2800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:37:25.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.264+0000 7f08465a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:37:25.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.264+0000 7f08465a2800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:37:25.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.264+0000 7f08465a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:37:25.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.264+0000 7f08465a2800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:25.272 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.264+0000 7f08465a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 2024-03-04T12:37:25.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.268+0000 7f08465a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:37:25.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.268+0000 7f08465a2800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:37:25.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.268+0000 7f08465a2800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:25.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.268+0000 7f08465a2800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18, ofs0, ns] 2024-03-04T12:37:25.275 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.268+0000 7f071affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824040 cookie 94570179302640 notifier 6190 bl.length()=861 2024-03-04T12:37:25.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.268+0000 7f071affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:37:25.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.268+0000 7f071affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:37:25.276 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.268+0000 7f071affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:25.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.270+0000 7f08465a2800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): orig_sources= new_sources= 2024-03-04T12:37:25.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.270+0000 7f08465a2800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): potential sources added=[] removed=[] 2024-03-04T12:37:25.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.270+0000 7f08465a2800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): orig_dests= new_dests= 2024-03-04T12:37:25.279 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.270+0000 7f08465a2800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): potential dests added=[] removed=[] 2024-03-04T12:37:25.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.272+0000 7f08465a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.3.0 2024-03-04T12:37:25.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.272+0000 7f08465a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.3.0 2024-03-04T12:37:25.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.272+0000 7f08465a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.0 2024-03-04T12:37:25.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.272+0000 7f08465a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.0 2024-03-04T12:37:25.280 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.273+0000 7f08465a2800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-03-04T12:37:25.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.273+0000 7f08465a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.1 2024-03-04T12:37:25.281 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.273+0000 7f08465a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.1 2024-03-04T12:37:25.282 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.273+0000 7f08465a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.2 2024-03-04T12:37:25.282 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.273+0000 7f08465a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.2 2024-03-04T12:37:25.282 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.274+0000 7f08465a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.3 2024-03-04T12:37:25.282 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.274+0000 7f08465a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.3 2024-03-04T12:37:25.282 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.274+0000 7f08465a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.4 2024-03-04T12:37:25.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.274+0000 7f08465a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.4 2024-03-04T12:37:25.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.274+0000 7f08465a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.5 2024-03-04T12:37:25.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.274+0000 7f08465a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.5 2024-03-04T12:37:25.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.275+0000 7f08465a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.6 2024-03-04T12:37:25.283 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.275+0000 7f08465a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.6 2024-03-04T12:37:25.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.275+0000 7f08465a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.7 2024-03-04T12:37:25.284 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.275+0000 7f08465a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.7 2024-03-04T12:37:25.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.276+0000 7f08465a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.8 2024-03-04T12:37:25.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.276+0000 7f08465a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.8 2024-03-04T12:37:25.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.276+0000 7f08465a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.9 2024-03-04T12:37:25.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.276+0000 7f08465a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.9 2024-03-04T12:37:25.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.277+0000 7f08465a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.10 2024-03-04T12:37:25.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.277+0000 7f08465a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.10 2024-03-04T12:37:25.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.277+0000 7f08465a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.11 2024-03-04T12:37:25.285 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.277+0000 7f08465a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.11 2024-03-04T12:37:25.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.278+0000 7f08465a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.12 2024-03-04T12:37:25.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.278+0000 7f08465a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.2.12 2024-03-04T12:37:25.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.278+0000 7f08465a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 : hit (requested=0x17, cached=0x17) 2024-03-04T12:37:25.286 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.278+0000 7f08465a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 2024-03-04T12:37:25.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.280+0000 7f08465a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:37:25.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.280+0000 7f08465a2800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:37:25.287 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.280+0000 7f08465a2800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:25.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.280+0000 7f08465a2800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18, ofs0, ns] 2024-03-04T12:37:25.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.280+0000 7f071affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824041 cookie 94570179302640 notifier 6190 bl.length()=829 2024-03-04T12:37:25.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.280+0000 7f071affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 info.flags=0x17 2024-03-04T12:37:25.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.280+0000 7f071affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18 to cache LRU end 2024-03-04T12:37:25.288 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.280+0000 7f071affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:25.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.282+0000 7f08465a2800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): orig_sources= new_sources= 2024-03-04T12:37:25.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.282+0000 7f08465a2800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): potential sources added=[] removed=[] 2024-03-04T12:37:25.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.282+0000 7f08465a2800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): orig_dests= new_dests= 2024-03-04T12:37:25.289 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.282+0000 7f08465a2800 20 handle_bi_update(): bucket=:a-bucket[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18]): potential dests added=[] removed=[] 2024-03-04T12:37:25.291 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.284+0000 7f08465a2800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-03-04T12:37:25.293 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.286+0000 7f06fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:25.295 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.288+0000 7f08465a2800 20 remove_watcher() i=0 2024-03-04T12:37:25.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.288+0000 7f08465a2800 2 removed watcher, disabling cache 2024-03-04T12:37:25.296 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.289+0000 7f08465a2800 20 remove_watcher() i=1 2024-03-04T12:37:25.298 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.291+0000 7f08465a2800 20 remove_watcher() i=2 2024-03-04T12:37:25.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.292+0000 7f08465a2800 20 remove_watcher() i=3 2024-03-04T12:37:25.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.293+0000 7f08465a2800 20 remove_watcher() i=4 2024-03-04T12:37:25.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.293+0000 7f08465a2800 20 remove_watcher() i=5 2024-03-04T12:37:25.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.294+0000 7f08465a2800 20 remove_watcher() i=6 2024-03-04T12:37:25.302 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.295+0000 7f08465a2800 20 remove_watcher() i=7 2024-03-04T12:37:25.313 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket a-bucket 2024-03-04T12:37:25.341 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:25.341 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:25.374 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.366+0000 7fc2f1ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.368+0000 7fc2f1ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.375 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.368+0000 7fc2f1ba2800 20 realm 2024-03-04T12:37:25.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.368+0000 7fc2f1ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.368+0000 7fc2f1ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.368+0000 7fc2f1ba2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:25.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.368+0000 7fc2f1ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.368+0000 7fc2f1ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.376 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.368+0000 7fc2f1ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.369+0000 7fc2f1ba2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:25.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.369+0000 7fc2f1ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.369+0000 7fc2f1ba2800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:25.377 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.369+0000 7fc2f1ba2800 20 searching for the correct realm 2024-03-04T12:37:25.582 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.574+0000 7fc2e7fff640 0 -- 172.21.15.110:0/2582925868 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7fc2e0056790 msgr2=0x7fc2e00879c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:25.585 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.578+0000 7fc2e7fff640 0 -- 172.21.15.110:0/2582925868 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7fc1b8079c80 msgr2=0x7fc1b807c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:25.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.582+0000 7fc2f1ba2800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:25.589 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.582+0000 7fc2f1ba2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:25.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.582+0000 7fc2f1ba2800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:25.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.582+0000 7fc2f1ba2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:25.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.582+0000 7fc2f1ba2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:25.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.582+0000 7fc2f1ba2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:25.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.582+0000 7fc2f1ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.582+0000 7fc2f1ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.590 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.582+0000 7fc2f1ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.591 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.583+0000 7fc2f1ba2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:25.591 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.583+0000 7fc2f1ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.591 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.583+0000 7fc2f1ba2800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:25.591 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.583+0000 7fc2f1ba2800 20 zone default found 2024-03-04T12:37:25.591 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.583+0000 7fc2f1ba2800 4 Realm: () 2024-03-04T12:37:25.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.583+0000 7fc2f1ba2800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:25.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.583+0000 7fc2f1ba2800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:25.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.583+0000 7fc2f1ba2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:25.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.583+0000 7fc2f1ba2800 20 zonegroup default 2024-03-04T12:37:25.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.583+0000 7fc2f1ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.583+0000 7fc2f1ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.583+0000 7fc2f1ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.584+0000 7fc2f1ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.584+0000 7fc2f1ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.584+0000 7fc2f1ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.584+0000 7fc2f1ba2800 20 started sync module instance, tier type = 2024-03-04T12:37:25.592 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.584+0000 7fc2f1ba2800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:25.600 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.593+0000 7fc2f1ba2800 20 add_watcher() i=0 2024-03-04T12:37:25.600 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.593+0000 7fc2f1ba2800 20 add_watcher() i=1 2024-03-04T12:37:25.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.593+0000 7fc2f1ba2800 20 add_watcher() i=2 2024-03-04T12:37:25.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.593+0000 7fc2f1ba2800 20 add_watcher() i=3 2024-03-04T12:37:25.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.593+0000 7fc2f1ba2800 20 add_watcher() i=4 2024-03-04T12:37:25.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.593+0000 7fc2f1ba2800 20 add_watcher() i=5 2024-03-04T12:37:25.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.593+0000 7fc2f1ba2800 20 add_watcher() i=6 2024-03-04T12:37:25.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.594+0000 7fc2f1ba2800 20 add_watcher() i=7 2024-03-04T12:37:25.601 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.594+0000 7fc2f1ba2800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:25.603 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.596+0000 7fc1a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:25.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.596+0000 7fc2f1ba2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:25.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.596+0000 7fc2f1ba2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:25.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.596+0000 7fc2f1ba2800 5 note: GC not initialized 2024-03-04T12:37:25.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.596+0000 7fc1a4fe1640 20 reqs_thread_entry: start 2024-03-04T12:37:25.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.596+0000 7fc2f1ba2800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:25.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.597+0000 7fc2f1ba2800 20 Filter name: none 2024-03-04T12:37:25.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.597+0000 7fc11e7fc640 20 reqs_thread_entry: start 2024-03-04T12:37:25.604 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.597+0000 7fc2f1ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.598+0000 7fc2f1ba2800 20 rados_obj.operate() r=0 bl.length=200 2024-03-04T12:37:25.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.598+0000 7fc2f1ba2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.598+0000 7fc2f1ba2800 20 rados_obj.operate() r=0 bl.length=372 2024-03-04T12:37:25.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.598+0000 7fc2f1ba2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:25.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.598+0000 7fc2f1ba2800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-03-04T12:37:25.605 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.598+0000 7fc2f1ba2800 20 INFO: main: starting shard=0 2024-03-04T12:37:25.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.598+0000 7fc2f1ba2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.3.0 2024-03-04T12:37:25.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.598+0000 7fc2f1ba2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18.3.0 2024-03-04T12:37:25.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.599+0000 7fc2f1ba2800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:25.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.599+0000 7fc2f1ba2800 20 INFO: main: done 2024-03-04T12:37:25.606 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.599+0000 7fc1a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:25.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.602+0000 7fc2f1ba2800 20 remove_watcher() i=0 2024-03-04T12:37:25.609 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.602+0000 7fc2f1ba2800 2 removed watcher, disabling cache 2024-03-04T12:37:25.610 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.603+0000 7fc2f1ba2800 20 remove_watcher() i=1 2024-03-04T12:37:25.611 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.604+0000 7fc2f1ba2800 20 remove_watcher() i=2 2024-03-04T12:37:25.612 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.605+0000 7fc2f1ba2800 20 remove_watcher() i=3 2024-03-04T12:37:25.613 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.606+0000 7fc2f1ba2800 20 remove_watcher() i=4 2024-03-04T12:37:25.614 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.607+0000 7fc2f1ba2800 20 remove_watcher() i=5 2024-03-04T12:37:25.615 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.608+0000 7fc2f1ba2800 20 remove_watcher() i=6 2024-03-04T12:37:25.616 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.609+0000 7fc2f1ba2800 20 remove_watcher() i=7 2024-03-04T12:37:25.625 INFO:tasks.workunit.client.0.smithi110.stderr: test: PUT succeeds during reshard 2024-03-04T12:37:25.627 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket myver 2024-03-04T12:37:25.654 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:25.654 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:25.688 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.680+0000 7f3463b31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.682+0000 7f3463b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.682+0000 7f3463b31800 20 realm 2024-03-04T12:37:25.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.682+0000 7f3463b31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.682+0000 7f3463b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.682+0000 7f3463b31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:25.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.682+0000 7f3463b31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.682+0000 7f3463b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.682+0000 7f3463b31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.683+0000 7f3463b31800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:25.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.683+0000 7f3463b31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.683+0000 7f3463b31800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:25.691 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.683+0000 7f3463b31800 20 searching for the correct realm 2024-03-04T12:37:25.692 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.685+0000 7f345f864640 0 -- 172.21.15.110:0/867232626 >> [v2:172.21.15.110:6800/2482344533,v1:172.21.15.110:6801/2482344533] conn(0x7f345802c040 msgr2=0x7f345801c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:25.696 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.689+0000 7f345f864640 0 -- 172.21.15.110:0/867232626 >> [v2:172.21.15.110:6800/2482344533,v1:172.21.15.110:6801/2482344533] conn(0x7f3328079c50 msgr2=0x7f332807c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:37:25.702 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.695+0000 7f3463b31800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:25.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.695+0000 7f3463b31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:25.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.695+0000 7f3463b31800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:25.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.695+0000 7f3463b31800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:25.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.695+0000 7f3463b31800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:25.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.695+0000 7f3463b31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:25.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.695+0000 7f3463b31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.695+0000 7f3463b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.695+0000 7f3463b31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.696+0000 7f3463b31800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:25.703 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.696+0000 7f3463b31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.704 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.696+0000 7f3463b31800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:25.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.696+0000 7f3463b31800 20 zone default found 2024-03-04T12:37:25.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.696+0000 7f3463b31800 4 Realm: () 2024-03-04T12:37:25.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.696+0000 7f3463b31800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:25.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.696+0000 7f3463b31800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:25.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.696+0000 7f3463b31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:25.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.696+0000 7f3463b31800 20 zonegroup default 2024-03-04T12:37:25.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.696+0000 7f3463b31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.696+0000 7f3463b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.696+0000 7f3463b31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.697+0000 7f3463b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.697+0000 7f3463b31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.697+0000 7f3463b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.697+0000 7f3463b31800 20 started sync module instance, tier type = 2024-03-04T12:37:25.705 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.697+0000 7f3463b31800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:25.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.706+0000 7f3463b31800 20 add_watcher() i=0 2024-03-04T12:37:25.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.706+0000 7f3463b31800 20 add_watcher() i=1 2024-03-04T12:37:25.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.706+0000 7f3463b31800 20 add_watcher() i=2 2024-03-04T12:37:25.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.706+0000 7f3463b31800 20 add_watcher() i=3 2024-03-04T12:37:25.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.706+0000 7f3463b31800 20 add_watcher() i=4 2024-03-04T12:37:25.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.706+0000 7f3463b31800 20 add_watcher() i=5 2024-03-04T12:37:25.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.706+0000 7f3463b31800 20 add_watcher() i=6 2024-03-04T12:37:25.713 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.706+0000 7f3463b31800 20 add_watcher() i=7 2024-03-04T12:37:25.714 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.706+0000 7f3463b31800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:25.715 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.708+0000 7f3315fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:25.716 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.708+0000 7f3463b31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:25.716 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.708+0000 7f3463b31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:25.716 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.708+0000 7f3463b31800 5 note: GC not initialized 2024-03-04T12:37:25.716 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.709+0000 7f3314fe1640 20 reqs_thread_entry: start 2024-03-04T12:37:25.716 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.709+0000 7f3463b31800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:25.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.709+0000 7f3463b31800 20 Filter name: none 2024-03-04T12:37:25.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.709+0000 7f328e7fc640 20 reqs_thread_entry: start 2024-03-04T12:37:25.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.709+0000 7f3463b31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.709+0000 7f3463b31800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:37:25.717 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.709+0000 7f3463b31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.710+0000 7f3463b31800 20 rados_obj.operate() r=0 bl.length=369 2024-03-04T12:37:25.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.710+0000 7f3463b31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:25.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.710+0000 7f3463b31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.710+0000 7f3463b31800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:37:25.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.710+0000 7f3463b31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.710+0000 7f3463b31800 20 rados_obj.operate() r=0 bl.length=369 2024-03-04T12:37:25.718 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.711+0000 7f3463b31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:25.719 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.712+0000 7f3463b31800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.719 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.712+0000 7f3463b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.720 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.713+0000 7f3315fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:25.722 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.715+0000 7f3463b31800 20 remove_watcher() i=0 2024-03-04T12:37:25.722 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.715+0000 7f3463b31800 2 removed watcher, disabling cache 2024-03-04T12:37:25.723 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.716+0000 7f3463b31800 20 remove_watcher() i=1 2024-03-04T12:37:25.724 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.717+0000 7f3463b31800 20 remove_watcher() i=2 2024-03-04T12:37:25.725 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.719+0000 7f3463b31800 20 remove_watcher() i=3 2024-03-04T12:37:25.726 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.719+0000 7f3463b31800 20 remove_watcher() i=4 2024-03-04T12:37:25.727 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.720+0000 7f3463b31800 20 remove_watcher() i=5 2024-03-04T12:37:25.728 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.721+0000 7f3463b31800 20 remove_watcher() i=6 2024-03-04T12:37:25.729 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.722+0000 7f3463b31800 20 remove_watcher() i=7 2024-03-04T12:37:25.738 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:37:25.739 INFO:tasks.workunit.client.0.smithi110.stderr:BUCKET_STATS: 2024-03-04T12:37:25.739 INFO:tasks.workunit.client.0.smithi110.stderr:bucket: myver id: 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-03-04T12:37:25.739 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:37:25.740 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-03-04T12:37:25.771 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:25.771 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:25.805 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.798+0000 7f89d03a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.799+0000 7f89d03a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.799+0000 7f89d03a2800 20 realm 2024-03-04T12:37:25.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.799+0000 7f89d03a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.799+0000 7f89d03a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.799+0000 7f89d03a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:25.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.799+0000 7f89d03a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.800+0000 7f89d03a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.807 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.800+0000 7f89d03a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.801+0000 7f89d03a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:25.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.801+0000 7f89d03a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.801+0000 7f89d03a2800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:25.808 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.801+0000 7f89d03a2800 20 searching for the correct realm 2024-03-04T12:37:25.811 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.804+0000 7f89ce69f640 0 -- 172.21.15.110:0/738818478 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f89b808a040 msgr2=0x7f89b8089410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:25.814 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.808+0000 7f89cde9e640 0 -- 172.21.15.110:0/738818478 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f89b8051070 msgr2=0x7f89b809d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:25.819 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.812+0000 7f89d03a2800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:25.819 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.812+0000 7f89d03a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:25.819 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.812+0000 7f89d03a2800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:25.819 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.812+0000 7f89d03a2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:25.819 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.812+0000 7f89d03a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:25.820 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.812+0000 7f89d03a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:25.820 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.812+0000 7f89d03a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.820 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.812+0000 7f89d03a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.820 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.812+0000 7f89d03a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.821 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.813+0000 7f89d03a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:25.821 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.813+0000 7f89d03a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.821 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.813+0000 7f89d03a2800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:25.821 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.813+0000 7f89d03a2800 20 zone default found 2024-03-04T12:37:25.821 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.813+0000 7f89d03a2800 4 Realm: () 2024-03-04T12:37:25.821 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.813+0000 7f89d03a2800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:25.821 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.813+0000 7f89d03a2800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:25.822 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.813+0000 7f89d03a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:25.822 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.813+0000 7f89d03a2800 20 zonegroup default 2024-03-04T12:37:25.822 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.813+0000 7f89d03a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.822 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.813+0000 7f89d03a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.822 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.813+0000 7f89d03a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.822 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.814+0000 7f89d03a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.822 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.814+0000 7f89d03a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.822 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.814+0000 7f89d03a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:25.822 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.814+0000 7f89d03a2800 20 started sync module instance, tier type = 2024-03-04T12:37:25.822 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.814+0000 7f89d03a2800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:25.829 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.822+0000 7f89d03a2800 20 add_watcher() i=0 2024-03-04T12:37:25.829 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.822+0000 7f89d03a2800 20 add_watcher() i=1 2024-03-04T12:37:25.830 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.822+0000 7f89d03a2800 20 add_watcher() i=2 2024-03-04T12:37:25.830 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.822+0000 7f89d03a2800 20 add_watcher() i=3 2024-03-04T12:37:25.830 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.822+0000 7f89d03a2800 20 add_watcher() i=4 2024-03-04T12:37:25.830 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.822+0000 7f89d03a2800 20 add_watcher() i=5 2024-03-04T12:37:25.830 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.822+0000 7f89d03a2800 20 add_watcher() i=6 2024-03-04T12:37:25.830 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.823+0000 7f89d03a2800 20 add_watcher() i=7 2024-03-04T12:37:25.830 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.823+0000 7f89d03a2800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:25.832 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.825+0000 7f887f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:25.833 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.825+0000 7f89d03a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:25.833 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.825+0000 7f89d03a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:25.833 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.825+0000 7f89d03a2800 5 note: GC not initialized 2024-03-04T12:37:25.833 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.825+0000 7f887e7fc640 20 reqs_thread_entry: start 2024-03-04T12:37:25.833 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.825+0000 7f89d03a2800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:25.833 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.825+0000 7f89d03a2800 20 Filter name: none 2024-03-04T12:37:25.833 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.825+0000 7f87effff640 20 reqs_thread_entry: start 2024-03-04T12:37:25.833 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.826+0000 7f89d03a2800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-04T12:37:25.833 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.826+0000 7f89d03a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.833 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.826+0000 7f89d03a2800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:37:25.833 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.826+0000 7f89d03a2800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-04T12:37:25.834 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.826+0000 7f89d03a2800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-04T12:37:25.834 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.826+0000 7f89d03a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 : miss 2024-03-04T12:37:25.834 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.826+0000 7f89d03a2800 20 rados->read ofs=0 len=0 2024-03-04T12:37:25.834 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.826+0000 7f89d03a2800 20 rados_obj.operate() r=0 bl.length=369 2024-03-04T12:37:25.834 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.826+0000 7f89d03a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 info.flags=0x17 2024-03-04T12:37:25.834 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.826+0000 7f89d03a2800 10 adding default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 to cache LRU end 2024-03-04T12:37:25.834 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.826+0000 7f89d03a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:37:25.835 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.826+0000 7f89d03a2800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:25.835 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.826+0000 7f89d03a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 2024-03-04T12:37:25.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.831+0000 7f89d03a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 info.flags=0x17 2024-03-04T12:37:25.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.831+0000 7f89d03a2800 10 moving default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 to cache LRU end 2024-03-04T12:37:25.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.831+0000 7f89d03a2800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:25.838 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.831+0000 7f89d03a2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19, ofs0, ns] 2024-03-04T12:37:25.839 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.831+0000 7f88b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824116 cookie 94534276824160 notifier 7245 bl.length()=855 2024-03-04T12:37:25.839 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.831+0000 7f88b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 info.flags=0x17 2024-03-04T12:37:25.839 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.831+0000 7f88b0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 to cache LRU end 2024-03-04T12:37:25.839 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.831+0000 7f88b0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:25.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.833+0000 7f89d03a2800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): orig_sources= new_sources= 2024-03-04T12:37:25.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.833+0000 7f89d03a2800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): potential sources added=[] removed=[] 2024-03-04T12:37:25.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.833+0000 7f89d03a2800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): orig_dests= new_dests= 2024-03-04T12:37:25.840 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.833+0000 7f89d03a2800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): potential dests added=[] removed=[] 2024-03-04T12:37:25.843 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:25.836+0000 7f89d03a2800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-03-04T12:37:26.744 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:26.744 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:30.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.0 2024-03-04T12:37:30.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.0 2024-03-04T12:37:30.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.1 2024-03-04T12:37:30.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.1 2024-03-04T12:37:30.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.2 2024-03-04T12:37:30.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.2 2024-03-04T12:37:30.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.3 2024-03-04T12:37:30.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.3 2024-03-04T12:37:30.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.4 2024-03-04T12:37:30.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.4 2024-03-04T12:37:30.844 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.5 2024-03-04T12:37:30.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.5 2024-03-04T12:37:30.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.6 2024-03-04T12:37:30.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.6 2024-03-04T12:37:30.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.7 2024-03-04T12:37:30.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.7 2024-03-04T12:37:30.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.8 2024-03-04T12:37:30.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.8 2024-03-04T12:37:30.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.9 2024-03-04T12:37:30.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.9 2024-03-04T12:37:30.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.10 2024-03-04T12:37:30.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.10 2024-03-04T12:37:30.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.11 2024-03-04T12:37:30.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.11 2024-03-04T12:37:30.845 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.12 2024-03-04T12:37:30.846 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.12 2024-03-04T12:37:30.846 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.0 2024-03-04T12:37:30.846 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.0 2024-03-04T12:37:30.846 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.1 2024-03-04T12:37:30.846 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.1 2024-03-04T12:37:30.846 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.2 2024-03-04T12:37:30.847 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.837+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.2 2024-03-04T12:37:30.847 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.838+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.3 2024-03-04T12:37:30.847 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.838+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.3 2024-03-04T12:37:30.847 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.839+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.4 2024-03-04T12:37:30.847 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.839+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.4 2024-03-04T12:37:30.847 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.840+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.5 2024-03-04T12:37:30.847 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.840+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.5 2024-03-04T12:37:30.848 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.841+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.6 2024-03-04T12:37:30.848 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.841+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.6 2024-03-04T12:37:30.848 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.841+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.7 2024-03-04T12:37:30.848 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.841+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.7 2024-03-04T12:37:30.849 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.842+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.8 2024-03-04T12:37:30.849 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.842+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.8 2024-03-04T12:37:30.849 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.842+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.9 2024-03-04T12:37:30.849 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.842+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.9 2024-03-04T12:37:30.850 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.843+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.10 2024-03-04T12:37:30.850 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.843+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.10 2024-03-04T12:37:30.851 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.844+0000 7f89d03a2800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.11 2024-03-04T12:37:30.851 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.844+0000 7f89d03a2800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.1.11 2024-03-04T12:37:30.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.845+0000 7f89d03a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 : hit (requested=0x17, cached=0x17) 2024-03-04T12:37:30.852 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.845+0000 7f89d03a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 2024-03-04T12:37:30.853 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.846+0000 7f89d03a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 info.flags=0x17 2024-03-04T12:37:30.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.846+0000 7f89d03a2800 10 moving default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 to cache LRU end 2024-03-04T12:37:30.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.846+0000 7f89d03a2800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:30.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.846+0000 7f89d03a2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19, ofs0, ns] 2024-03-04T12:37:30.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.847+0000 7f88b17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824117 cookie 94534276824160 notifier 7245 bl.length()=823 2024-03-04T12:37:30.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.847+0000 7f88b17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 info.flags=0x17 2024-03-04T12:37:30.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.847+0000 7f88b17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 to cache LRU end 2024-03-04T12:37:30.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.847+0000 7f88b17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:30.856 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.849+0000 7f89d03a2800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): orig_sources= new_sources= 2024-03-04T12:37:30.856 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.849+0000 7f89d03a2800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): potential sources added=[] removed=[] 2024-03-04T12:37:30.856 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.849+0000 7f89d03a2800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): orig_dests= new_dests= 2024-03-04T12:37:30.856 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.849+0000 7f89d03a2800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): potential dests added=[] removed=[] 2024-03-04T12:37:30.858 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.851+0000 7f89d03a2800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-03-04T12:37:30.861 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.854+0000 7f887f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:30.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.856+0000 7f89d03a2800 20 remove_watcher() i=0 2024-03-04T12:37:30.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.856+0000 7f89d03a2800 2 removed watcher, disabling cache 2024-03-04T12:37:30.864 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.857+0000 7f89d03a2800 20 remove_watcher() i=1 2024-03-04T12:37:30.865 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.858+0000 7f89d03a2800 20 remove_watcher() i=2 2024-03-04T12:37:30.867 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.860+0000 7f89d03a2800 20 remove_watcher() i=3 2024-03-04T12:37:30.868 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.861+0000 7f89d03a2800 20 remove_watcher() i=4 2024-03-04T12:37:30.869 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.862+0000 7f89d03a2800 20 remove_watcher() i=5 2024-03-04T12:37:30.870 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.863+0000 7f89d03a2800 20 remove_watcher() i=6 2024-03-04T12:37:30.871 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:30.865+0000 7f89d03a2800 20 remove_watcher() i=7 2024-03-04T12:37:31.832 INFO:tasks.workunit.client.0.smithi110.stderr:put object successful 2024-03-04T12:37:31.833 INFO:tasks.workunit.client.0.smithi110.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-03-04T12:37:31.833 INFO:tasks.workunit.client.0.smithi110.stderr: 2024-03-04T12:37:31.835 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:31.835 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:31.905 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:31.905 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:31.960 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:31.960 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:32.006 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:32.006 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:32.030 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:32.030 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:32.075 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:32.075 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:32.097 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:32.097 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:32.142 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:32.142 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:32.163 INFO:tasks.workunit.client.0.smithi110.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-03-04T12:37:32.548 INFO:tasks.workunit.client.0.smithi110.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-03-04T12:37:33.933 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:33.933 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:34.012 INFO:tasks.workunit.client.0.smithi110.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:37:34.014 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket myver --object x 2024-03-04T12:37:34.045 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:34.045 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:34.084 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.076+0000 7f062032f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.077+0000 7f062032f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.077+0000 7f062032f800 20 realm 2024-03-04T12:37:34.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.077+0000 7f062032f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.077+0000 7f062032f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.077+0000 7f062032f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:34.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.077+0000 7f062032f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.078+0000 7f062032f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.085 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.078+0000 7f062032f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.086 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.079+0000 7f062032f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:34.086 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.079+0000 7f062032f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.086 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.079+0000 7f062032f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:34.086 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.079+0000 7f062032f800 20 searching for the correct realm 2024-03-04T12:37:34.090 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.083+0000 7f061c7b1640 0 -- 172.21.15.110:0/2377081478 >> [v2:172.21.15.110:6824/3005097257,v1:172.21.15.110:6825/3005097257] conn(0x560e85fd9330 msgr2=0x560e85fdb7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:34.093 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.087+0000 7f0613fff640 0 -- 172.21.15.110:0/2377081478 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f060c04f020 msgr2=0x7f060c094a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:34.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.090+0000 7f062032f800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:34.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.090+0000 7f062032f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:34.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.090+0000 7f062032f800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:34.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.090+0000 7f062032f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:34.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.090+0000 7f062032f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:34.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.090+0000 7f062032f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:34.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.090+0000 7f062032f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.091+0000 7f062032f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.098 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.091+0000 7f062032f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.091+0000 7f062032f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:34.099 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.091+0000 7f062032f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.091+0000 7f062032f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:34.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.091+0000 7f062032f800 20 zone default found 2024-03-04T12:37:34.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.091+0000 7f062032f800 4 Realm: () 2024-03-04T12:37:34.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.091+0000 7f062032f800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:34.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.091+0000 7f062032f800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:34.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.091+0000 7f062032f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:34.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.091+0000 7f062032f800 20 zonegroup default 2024-03-04T12:37:34.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.091+0000 7f062032f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.091+0000 7f062032f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.100 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.091+0000 7f062032f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.092+0000 7f062032f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.092+0000 7f062032f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.092+0000 7f062032f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.092+0000 7f062032f800 20 started sync module instance, tier type = 2024-03-04T12:37:34.101 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.092+0000 7f062032f800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:34.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.101+0000 7f062032f800 20 add_watcher() i=0 2024-03-04T12:37:34.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.101+0000 7f062032f800 20 add_watcher() i=1 2024-03-04T12:37:34.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.101+0000 7f062032f800 20 add_watcher() i=2 2024-03-04T12:37:34.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.101+0000 7f062032f800 20 add_watcher() i=3 2024-03-04T12:37:34.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.101+0000 7f062032f800 20 add_watcher() i=4 2024-03-04T12:37:34.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.101+0000 7f062032f800 20 add_watcher() i=5 2024-03-04T12:37:34.108 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.101+0000 7f062032f800 20 add_watcher() i=6 2024-03-04T12:37:34.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.102+0000 7f062032f800 20 add_watcher() i=7 2024-03-04T12:37:34.109 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.102+0000 7f062032f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:34.110 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.103+0000 7f04d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:34.111 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.104+0000 7f062032f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:34.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.104+0000 7f062032f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:34.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.104+0000 7f062032f800 5 note: GC not initialized 2024-03-04T12:37:34.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.104+0000 7f04d0fe1640 20 reqs_thread_entry: start 2024-03-04T12:37:34.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.104+0000 7f062032f800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:34.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.104+0000 7f062032f800 20 Filter name: none 2024-03-04T12:37:34.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.104+0000 7f044a7fc640 20 reqs_thread_entry: start 2024-03-04T12:37:34.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.104+0000 7f062032f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.104+0000 7f062032f800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:37:34.112 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.104+0000 7f062032f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.113 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.105+0000 7f062032f800 20 rados_obj.operate() r=0 bl.length=369 2024-03-04T12:37:34.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.105+0000 7f062032f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:34.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.105+0000 7f062032f800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-03-04T12:37:34.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.105+0000 7f062032f800 20 INFO: main: starting shard=0 2024-03-04T12:37:34.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.105+0000 7f062032f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.0 2024-03-04T12:37:34.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.105+0000 7f062032f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.0 2024-03-04T12:37:34.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.105+0000 7f062032f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.105+0000 7f062032f800 20 INFO: main: starting shard=1 2024-03-04T12:37:34.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.105+0000 7f062032f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.1 2024-03-04T12:37:34.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.105+0000 7f062032f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.1 2024-03-04T12:37:34.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.106+0000 7f062032f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.106+0000 7f062032f800 20 INFO: main: starting shard=2 2024-03-04T12:37:34.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.106+0000 7f062032f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.2 2024-03-04T12:37:34.114 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.106+0000 7f062032f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.2 2024-03-04T12:37:34.115 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.106+0000 7f062032f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.115 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.106+0000 7f062032f800 20 INFO: main: starting shard=3 2024-03-04T12:37:34.115 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.106+0000 7f062032f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.3 2024-03-04T12:37:34.115 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.106+0000 7f062032f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.3 2024-03-04T12:37:34.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.107+0000 7f062032f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.107+0000 7f062032f800 20 INFO: main: starting shard=4 2024-03-04T12:37:34.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.107+0000 7f062032f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.4 2024-03-04T12:37:34.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.107+0000 7f062032f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.4 2024-03-04T12:37:34.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.107+0000 7f062032f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.116 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.107+0000 7f062032f800 20 INFO: main: starting shard=5 2024-03-04T12:37:34.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.107+0000 7f062032f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.5 2024-03-04T12:37:34.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.107+0000 7f062032f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.5 2024-03-04T12:37:34.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.108+0000 7f062032f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-04T12:37:34.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.108+0000 7f062032f800 20 INFO: main: starting shard=6 2024-03-04T12:37:34.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.108+0000 7f062032f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.6 2024-03-04T12:37:34.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.108+0000 7f062032f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.6 2024-03-04T12:37:34.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.109+0000 7f062032f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.109+0000 7f062032f800 20 INFO: main: starting shard=7 2024-03-04T12:37:34.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.109+0000 7f062032f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.7 2024-03-04T12:37:34.117 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.109+0000 7f062032f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.7 2024-03-04T12:37:34.118 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.109+0000 7f062032f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.118 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.109+0000 7f062032f800 20 INFO: main: starting shard=8 2024-03-04T12:37:34.118 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.109+0000 7f062032f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.8 2024-03-04T12:37:34.118 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.109+0000 7f062032f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.8 2024-03-04T12:37:34.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.110+0000 7f062032f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.110+0000 7f062032f800 20 INFO: main: starting shard=9 2024-03-04T12:37:34.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.110+0000 7f062032f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.9 2024-03-04T12:37:34.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.110+0000 7f062032f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.9 2024-03-04T12:37:34.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.111+0000 7f062032f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.111+0000 7f062032f800 20 INFO: main: starting shard=10 2024-03-04T12:37:34.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.111+0000 7f062032f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.10 2024-03-04T12:37:34.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.111+0000 7f062032f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.10 2024-03-04T12:37:34.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.111+0000 7f062032f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.111+0000 7f062032f800 20 INFO: main: starting shard=11 2024-03-04T12:37:34.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.111+0000 7f062032f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.11 2024-03-04T12:37:34.119 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.111+0000 7f062032f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.11 2024-03-04T12:37:34.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.112+0000 7f062032f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.112+0000 7f062032f800 20 INFO: main: starting shard=12 2024-03-04T12:37:34.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.112+0000 7f062032f800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.12 2024-03-04T12:37:34.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.112+0000 7f062032f800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.12 2024-03-04T12:37:34.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.112+0000 7f062032f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.120 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.112+0000 7f062032f800 20 INFO: main: done 2024-03-04T12:37:34.121 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.113+0000 7f04d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:34.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.115+0000 7f062032f800 20 remove_watcher() i=0 2024-03-04T12:37:34.122 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.116+0000 7f062032f800 2 removed watcher, disabling cache 2024-03-04T12:37:34.124 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.117+0000 7f062032f800 20 remove_watcher() i=1 2024-03-04T12:37:34.125 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.118+0000 7f062032f800 20 remove_watcher() i=2 2024-03-04T12:37:34.126 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.119+0000 7f062032f800 20 remove_watcher() i=3 2024-03-04T12:37:34.127 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.120+0000 7f062032f800 20 remove_watcher() i=4 2024-03-04T12:37:34.128 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.121+0000 7f062032f800 20 remove_watcher() i=5 2024-03-04T12:37:34.128 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.122+0000 7f062032f800 20 remove_watcher() i=6 2024-03-04T12:37:34.129 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.123+0000 7f062032f800 20 remove_watcher() i=7 2024-03-04T12:37:34.141 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:34.141 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:34.161 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:34.162 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:34.236 INFO:tasks.workunit.client.0.smithi110.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:37:34.238 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket myver --object y 2024-03-04T12:37:34.266 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:34.266 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:34.299 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.292+0000 7fb0ed931800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.293+0000 7fb0ed931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.300 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.293+0000 7fb0ed931800 20 realm 2024-03-04T12:37:34.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.293+0000 7fb0ed931800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.293+0000 7fb0ed931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.293+0000 7fb0ed931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:34.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.293+0000 7fb0ed931800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.293+0000 7fb0ed931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.293+0000 7fb0ed931800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.294+0000 7fb0ed931800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:34.301 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.294+0000 7fb0ed931800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.302 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.295+0000 7fb0ed931800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:34.302 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.295+0000 7fb0ed931800 20 searching for the correct realm 2024-03-04T12:37:34.305 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.298+0000 7fb0e0e30640 0 -- 172.21.15.110:0/3705962722 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x55b66acc0cd0 msgr2=0x55b66acc3160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:34.308 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.301+0000 7fb0e9631640 0 -- 172.21.15.110:0/3705962722 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fb0d4061920 msgr2=0x7fb0d4036400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:37:34.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.306+0000 7fb0ed931800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:34.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.306+0000 7fb0ed931800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:34.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.306+0000 7fb0ed931800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:34.313 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.306+0000 7fb0ed931800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:34.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.306+0000 7fb0ed931800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:34.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.306+0000 7fb0ed931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:34.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.306+0000 7fb0ed931800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.306+0000 7fb0ed931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.314 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.306+0000 7fb0ed931800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.307+0000 7fb0ed931800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:34.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.307+0000 7fb0ed931800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.307+0000 7fb0ed931800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:34.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.307+0000 7fb0ed931800 20 zone default found 2024-03-04T12:37:34.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.307+0000 7fb0ed931800 4 Realm: () 2024-03-04T12:37:34.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.307+0000 7fb0ed931800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:34.315 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.307+0000 7fb0ed931800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:34.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.307+0000 7fb0ed931800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:34.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.307+0000 7fb0ed931800 20 zonegroup default 2024-03-04T12:37:34.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.307+0000 7fb0ed931800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.307+0000 7fb0ed931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.307+0000 7fb0ed931800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.308+0000 7fb0ed931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.308+0000 7fb0ed931800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.308+0000 7fb0ed931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.308+0000 7fb0ed931800 20 started sync module instance, tier type = 2024-03-04T12:37:34.316 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.308+0000 7fb0ed931800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:34.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.317+0000 7fb0ed931800 20 add_watcher() i=0 2024-03-04T12:37:34.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.317+0000 7fb0ed931800 20 add_watcher() i=1 2024-03-04T12:37:34.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.317+0000 7fb0ed931800 20 add_watcher() i=2 2024-03-04T12:37:34.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.317+0000 7fb0ed931800 20 add_watcher() i=3 2024-03-04T12:37:34.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.317+0000 7fb0ed931800 20 add_watcher() i=4 2024-03-04T12:37:34.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.317+0000 7fb0ed931800 20 add_watcher() i=5 2024-03-04T12:37:34.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.317+0000 7fb0ed931800 20 add_watcher() i=6 2024-03-04T12:37:34.324 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.317+0000 7fb0ed931800 20 add_watcher() i=7 2024-03-04T12:37:34.325 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.317+0000 7fb0ed931800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:34.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.319+0000 7faf9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:34.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.319+0000 7fb0ed931800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:34.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.319+0000 7fb0ed931800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:34.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.319+0000 7fb0ed931800 5 note: GC not initialized 2024-03-04T12:37:34.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.319+0000 7faf9e7e4640 20 reqs_thread_entry: start 2024-03-04T12:37:34.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.319+0000 7fb0ed931800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:34.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.319+0000 7fb0ed931800 20 Filter name: none 2024-03-04T12:37:34.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.320+0000 7faf0ffff640 20 reqs_thread_entry: start 2024-03-04T12:37:34.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.320+0000 7fb0ed931800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.320+0000 7fb0ed931800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:37:34.327 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.320+0000 7fb0ed931800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.320+0000 7fb0ed931800 20 rados_obj.operate() r=0 bl.length=369 2024-03-04T12:37:34.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.320+0000 7fb0ed931800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:34.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.320+0000 7fb0ed931800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-03-04T12:37:34.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.320+0000 7fb0ed931800 20 INFO: main: starting shard=0 2024-03-04T12:37:34.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.320+0000 7fb0ed931800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.0 2024-03-04T12:37:34.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.320+0000 7fb0ed931800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.0 2024-03-04T12:37:34.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.321+0000 7fb0ed931800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.321+0000 7fb0ed931800 20 INFO: main: starting shard=1 2024-03-04T12:37:34.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.321+0000 7fb0ed931800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.1 2024-03-04T12:37:34.329 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.321+0000 7fb0ed931800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.1 2024-03-04T12:37:34.330 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.321+0000 7fb0ed931800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.330 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.321+0000 7fb0ed931800 20 INFO: main: starting shard=2 2024-03-04T12:37:34.330 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.321+0000 7fb0ed931800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.2 2024-03-04T12:37:34.330 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.321+0000 7fb0ed931800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.2 2024-03-04T12:37:34.330 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.322+0000 7fb0ed931800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.330 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.322+0000 7fb0ed931800 20 INFO: main: starting shard=3 2024-03-04T12:37:34.330 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.322+0000 7fb0ed931800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.3 2024-03-04T12:37:34.330 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.322+0000 7fb0ed931800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.3 2024-03-04T12:37:34.331 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.322+0000 7fb0ed931800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.331 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.322+0000 7fb0ed931800 20 INFO: main: starting shard=4 2024-03-04T12:37:34.331 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.322+0000 7fb0ed931800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.4 2024-03-04T12:37:34.331 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.322+0000 7fb0ed931800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.4 2024-03-04T12:37:34.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.323+0000 7fb0ed931800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.323+0000 7fb0ed931800 20 INFO: main: starting shard=5 2024-03-04T12:37:34.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.323+0000 7fb0ed931800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.5 2024-03-04T12:37:34.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.323+0000 7fb0ed931800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.5 2024-03-04T12:37:34.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.323+0000 7fb0ed931800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.323+0000 7fb0ed931800 20 INFO: main: starting shard=6 2024-03-04T12:37:34.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.323+0000 7fb0ed931800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.6 2024-03-04T12:37:34.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.323+0000 7fb0ed931800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.6 2024-03-04T12:37:34.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.324+0000 7fb0ed931800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.324+0000 7fb0ed931800 20 INFO: main: starting shard=7 2024-03-04T12:37:34.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.324+0000 7fb0ed931800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.7 2024-03-04T12:37:34.332 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.324+0000 7fb0ed931800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.7 2024-03-04T12:37:34.333 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.324+0000 7fb0ed931800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.333 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.324+0000 7fb0ed931800 20 INFO: main: starting shard=8 2024-03-04T12:37:34.333 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.324+0000 7fb0ed931800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.8 2024-03-04T12:37:34.333 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.324+0000 7fb0ed931800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.8 2024-03-04T12:37:34.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.325+0000 7fb0ed931800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.325+0000 7fb0ed931800 20 INFO: main: starting shard=9 2024-03-04T12:37:34.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.325+0000 7fb0ed931800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.9 2024-03-04T12:37:34.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.325+0000 7fb0ed931800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.9 2024-03-04T12:37:34.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.325+0000 7fb0ed931800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-04T12:37:34.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.325+0000 7fb0ed931800 20 INFO: main: starting shard=10 2024-03-04T12:37:34.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.325+0000 7fb0ed931800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.10 2024-03-04T12:37:34.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.325+0000 7fb0ed931800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.10 2024-03-04T12:37:34.334 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.326+0000 7fb0ed931800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.326+0000 7fb0ed931800 20 INFO: main: starting shard=11 2024-03-04T12:37:34.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.326+0000 7fb0ed931800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.11 2024-03-04T12:37:34.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.326+0000 7fb0ed931800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.11 2024-03-04T12:37:34.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.326+0000 7fb0ed931800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.326+0000 7fb0ed931800 20 INFO: main: starting shard=12 2024-03-04T12:37:34.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.326+0000 7fb0ed931800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.12 2024-03-04T12:37:34.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.326+0000 7fb0ed931800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.12 2024-03-04T12:37:34.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.327+0000 7fb0ed931800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.327+0000 7fb0ed931800 20 INFO: main: done 2024-03-04T12:37:34.335 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.328+0000 7faf9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:34.336 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.330+0000 7fb0ed931800 20 remove_watcher() i=0 2024-03-04T12:37:34.337 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.330+0000 7fb0ed931800 2 removed watcher, disabling cache 2024-03-04T12:37:34.338 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.331+0000 7fb0ed931800 20 remove_watcher() i=1 2024-03-04T12:37:34.339 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.332+0000 7fb0ed931800 20 remove_watcher() i=2 2024-03-04T12:37:34.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.333+0000 7fb0ed931800 20 remove_watcher() i=3 2024-03-04T12:37:34.340 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.334+0000 7fb0ed931800 20 remove_watcher() i=4 2024-03-04T12:37:34.341 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.335+0000 7fb0ed931800 20 remove_watcher() i=5 2024-03-04T12:37:34.342 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.335+0000 7fb0ed931800 20 remove_watcher() i=6 2024-03-04T12:37:34.343 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.336+0000 7fb0ed931800 20 remove_watcher() i=7 2024-03-04T12:37:34.355 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:34.355 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:34.376 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:34.377 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:34.451 INFO:tasks.workunit.client.0.smithi110.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-04T12:37:34.452 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bi list --bucket myver --object z 2024-03-04T12:37:34.481 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:34.481 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:34.514 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.506+0000 7f18f268c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.508+0000 7f18f268c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.508+0000 7f18f268c800 20 realm 2024-03-04T12:37:34.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.508+0000 7f18f268c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.508+0000 7f18f268c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.508+0000 7f18f268c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:34.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.508+0000 7f18f268c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.508+0000 7f18f268c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.516 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.508+0000 7f18f268c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.509+0000 7f18f268c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:34.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.509+0000 7f18f268c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.509+0000 7f18f268c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:34.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.509+0000 7f18f268c800 20 searching for the correct realm 2024-03-04T12:37:34.519 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.512+0000 7f18ef987640 0 -- 172.21.15.110:0/2396603277 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f18e80647b0 msgr2=0x7f18e8094730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:34.523 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.516+0000 7f18f0188640 0 -- 172.21.15.110:0/2396603277 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f18d80478f0 msgr2=0x7f18d801d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:34.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.723+0000 7f18f268c800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:34.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.723+0000 7f18f268c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:34.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.723+0000 7f18f268c800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:34.730 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.723+0000 7f18f268c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:34.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.723+0000 7f18f268c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:34.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.723+0000 7f18f268c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:34.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.723+0000 7f18f268c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.723+0000 7f18f268c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.723+0000 7f18f268c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.723+0000 7f18f268c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:34.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.723+0000 7f18f268c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.724+0000 7f18f268c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:34.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.724+0000 7f18f268c800 20 zone default found 2024-03-04T12:37:34.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.724+0000 7f18f268c800 4 Realm: () 2024-03-04T12:37:34.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.724+0000 7f18f268c800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:34.731 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.724+0000 7f18f268c800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:34.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.724+0000 7f18f268c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:34.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.724+0000 7f18f268c800 20 zonegroup default 2024-03-04T12:37:34.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.724+0000 7f18f268c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.724+0000 7f18f268c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.732 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.724+0000 7f18f268c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.724+0000 7f18f268c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.724+0000 7f18f268c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.725+0000 7f18f268c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:34.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.725+0000 7f18f268c800 20 started sync module instance, tier type = 2024-03-04T12:37:34.733 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.725+0000 7f18f268c800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:34.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.734+0000 7f18f268c800 20 add_watcher() i=0 2024-03-04T12:37:34.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.734+0000 7f18f268c800 20 add_watcher() i=1 2024-03-04T12:37:34.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.734+0000 7f18f268c800 20 add_watcher() i=2 2024-03-04T12:37:34.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.734+0000 7f18f268c800 20 add_watcher() i=3 2024-03-04T12:37:34.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.734+0000 7f18f268c800 20 add_watcher() i=4 2024-03-04T12:37:34.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.734+0000 7f18f268c800 20 add_watcher() i=5 2024-03-04T12:37:34.740 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.734+0000 7f18f268c800 20 add_watcher() i=6 2024-03-04T12:37:34.741 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.735+0000 7f18f268c800 20 add_watcher() i=7 2024-03-04T12:37:34.741 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.735+0000 7f18f268c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:34.743 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.737+0000 7f17a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:34.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.737+0000 7f18f268c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:34.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.737+0000 7f18f268c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:34.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.737+0000 7f18f268c800 5 note: GC not initialized 2024-03-04T12:37:34.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.737+0000 7f17a5fdb640 20 reqs_thread_entry: start 2024-03-04T12:37:34.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.737+0000 7f18f268c800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:34.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.737+0000 7f18f268c800 20 Filter name: none 2024-03-04T12:37:34.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.738+0000 7f17177fe640 20 reqs_thread_entry: start 2024-03-04T12:37:34.744 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.738+0000 7f18f268c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.738+0000 7f18f268c800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:37:34.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.738+0000 7f18f268c800 20 rados->read ofs=0 len=0 2024-03-04T12:37:34.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.738+0000 7f18f268c800 20 rados_obj.operate() r=0 bl.length=369 2024-03-04T12:37:34.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.738+0000 7f18f268c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:34.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.738+0000 7f18f268c800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-03-04T12:37:34.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.738+0000 7f18f268c800 20 INFO: main: starting shard=0 2024-03-04T12:37:34.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.738+0000 7f18f268c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.0 2024-03-04T12:37:34.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.738+0000 7f18f268c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.0 2024-03-04T12:37:34.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.739+0000 7f18f268c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-04T12:37:34.746 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.739+0000 7f18f268c800 20 INFO: main: starting shard=1 2024-03-04T12:37:34.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.739+0000 7f18f268c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.1 2024-03-04T12:37:34.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.739+0000 7f18f268c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.1 2024-03-04T12:37:34.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.739+0000 7f18f268c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.739+0000 7f18f268c800 20 INFO: main: starting shard=2 2024-03-04T12:37:34.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.739+0000 7f18f268c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.2 2024-03-04T12:37:34.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.739+0000 7f18f268c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.2 2024-03-04T12:37:34.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.740+0000 7f18f268c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.740+0000 7f18f268c800 20 INFO: main: starting shard=3 2024-03-04T12:37:34.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.740+0000 7f18f268c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.3 2024-03-04T12:37:34.747 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.740+0000 7f18f268c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.3 2024-03-04T12:37:34.748 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.740+0000 7f18f268c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.740+0000 7f18f268c800 20 INFO: main: starting shard=4 2024-03-04T12:37:34.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.740+0000 7f18f268c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.4 2024-03-04T12:37:34.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.740+0000 7f18f268c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.4 2024-03-04T12:37:34.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.741+0000 7f18f268c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.741+0000 7f18f268c800 20 INFO: main: starting shard=5 2024-03-04T12:37:34.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.741+0000 7f18f268c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.5 2024-03-04T12:37:34.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.741+0000 7f18f268c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.5 2024-03-04T12:37:34.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.741+0000 7f18f268c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.741+0000 7f18f268c800 20 INFO: main: starting shard=6 2024-03-04T12:37:34.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.741+0000 7f18f268c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.6 2024-03-04T12:37:34.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.741+0000 7f18f268c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.6 2024-03-04T12:37:34.749 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.742+0000 7f18f268c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.742+0000 7f18f268c800 20 INFO: main: starting shard=7 2024-03-04T12:37:34.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.742+0000 7f18f268c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.7 2024-03-04T12:37:34.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.742+0000 7f18f268c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.7 2024-03-04T12:37:34.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.743+0000 7f18f268c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.750 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.743+0000 7f18f268c800 20 INFO: main: starting shard=8 2024-03-04T12:37:34.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.743+0000 7f18f268c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.8 2024-03-04T12:37:34.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.743+0000 7f18f268c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.8 2024-03-04T12:37:34.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.744+0000 7f18f268c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.744+0000 7f18f268c800 20 INFO: main: starting shard=9 2024-03-04T12:37:34.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.744+0000 7f18f268c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.9 2024-03-04T12:37:34.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.744+0000 7f18f268c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.9 2024-03-04T12:37:34.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.744+0000 7f18f268c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.744+0000 7f18f268c800 20 INFO: main: starting shard=10 2024-03-04T12:37:34.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.744+0000 7f18f268c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.10 2024-03-04T12:37:34.751 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.744+0000 7f18f268c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.10 2024-03-04T12:37:34.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.745+0000 7f18f268c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.745+0000 7f18f268c800 20 INFO: main: starting shard=11 2024-03-04T12:37:34.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.745+0000 7f18f268c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.11 2024-03-04T12:37:34.752 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.745+0000 7f18f268c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.11 2024-03-04T12:37:34.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.745+0000 7f18f268c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.745+0000 7f18f268c800 20 INFO: main: starting shard=12 2024-03-04T12:37:34.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.745+0000 7f18f268c800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.12 2024-03-04T12:37:34.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.745+0000 7f18f268c800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.12 2024-03-04T12:37:34.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.746+0000 7f18f268c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-04T12:37:34.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.746+0000 7f18f268c800 20 INFO: main: done 2024-03-04T12:37:34.753 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.747+0000 7f17a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:34.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.749+0000 7f18f268c800 20 remove_watcher() i=0 2024-03-04T12:37:34.755 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.749+0000 7f18f268c800 2 removed watcher, disabling cache 2024-03-04T12:37:34.756 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.750+0000 7f18f268c800 20 remove_watcher() i=1 2024-03-04T12:37:34.757 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.751+0000 7f18f268c800 20 remove_watcher() i=2 2024-03-04T12:37:34.758 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.752+0000 7f18f268c800 20 remove_watcher() i=3 2024-03-04T12:37:34.759 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.753+0000 7f18f268c800 20 remove_watcher() i=4 2024-03-04T12:37:34.760 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.754+0000 7f18f268c800 20 remove_watcher() i=5 2024-03-04T12:37:34.761 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.755+0000 7f18f268c800 20 remove_watcher() i=6 2024-03-04T12:37:34.762 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:34.756+0000 7f18f268c800 20 remove_watcher() i=7 2024-03-04T12:37:34.774 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:34.774 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:34.794 INFO:tasks.workunit.client.0.smithi110.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-03-04T12:37:35.179 INFO:tasks.workunit.client.0.smithi110.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-03-04T12:37:35.571 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-03-04T12:37:35.601 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:35.601 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:35.635 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.628+0000 7f935fd33800 20 rados->read ofs=0 len=0 2024-03-04T12:37:35.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.630+0000 7f935fd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:35.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.630+0000 7f935fd33800 20 realm 2024-03-04T12:37:35.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.630+0000 7f935fd33800 20 rados->read ofs=0 len=0 2024-03-04T12:37:35.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.630+0000 7f935fd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:35.636 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.630+0000 7f935fd33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:35.637 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.630+0000 7f935fd33800 20 rados->read ofs=0 len=0 2024-03-04T12:37:35.637 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.630+0000 7f935fd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:35.637 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.630+0000 7f935fd33800 20 rados->read ofs=0 len=0 2024-03-04T12:37:35.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.631+0000 7f935fd33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:35.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.631+0000 7f935fd33800 20 rados->read ofs=0 len=0 2024-03-04T12:37:35.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.631+0000 7f935fd33800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:35.638 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.631+0000 7f935fd33800 20 searching for the correct realm 2024-03-04T12:37:35.641 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.635+0000 7f935c265640 0 -- 172.21.15.110:0/778147059 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f9350046930 msgr2=0x7f9350037420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:35.644 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.638+0000 7f935ba64640 0 -- 172.21.15.110:0/778147059 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f9350008930 msgr2=0x7f93500543d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:37:35.853 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.844+0000 7f935fd33800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:35.853 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.844+0000 7f935fd33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:35.853 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.844+0000 7f935fd33800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:35.853 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.844+0000 7f935fd33800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:35.853 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.844+0000 7f935fd33800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:35.853 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.844+0000 7f935fd33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:35.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.844+0000 7f935fd33800 20 rados->read ofs=0 len=0 2024-03-04T12:37:35.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.845+0000 7f935fd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:35.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.845+0000 7f935fd33800 20 rados->read ofs=0 len=0 2024-03-04T12:37:35.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.845+0000 7f935fd33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:35.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.845+0000 7f935fd33800 20 rados->read ofs=0 len=0 2024-03-04T12:37:35.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.845+0000 7f935fd33800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:35.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.845+0000 7f935fd33800 20 zone default found 2024-03-04T12:37:35.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.845+0000 7f935fd33800 4 Realm: () 2024-03-04T12:37:35.854 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.845+0000 7f935fd33800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:35.855 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.845+0000 7f935fd33800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:35.855 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.845+0000 7f935fd33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:35.855 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.845+0000 7f935fd33800 20 zonegroup default 2024-03-04T12:37:35.855 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.845+0000 7f935fd33800 20 rados->read ofs=0 len=0 2024-03-04T12:37:35.855 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.846+0000 7f935fd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:35.855 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.846+0000 7f935fd33800 20 rados->read ofs=0 len=0 2024-03-04T12:37:35.855 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.846+0000 7f935fd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:35.855 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.846+0000 7f935fd33800 20 rados->read ofs=0 len=0 2024-03-04T12:37:35.856 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.846+0000 7f935fd33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:35.856 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.846+0000 7f935fd33800 20 started sync module instance, tier type = 2024-03-04T12:37:35.856 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.846+0000 7f935fd33800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:35.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.856+0000 7f935fd33800 20 add_watcher() i=0 2024-03-04T12:37:35.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.856+0000 7f935fd33800 20 add_watcher() i=1 2024-03-04T12:37:35.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.856+0000 7f935fd33800 20 add_watcher() i=2 2024-03-04T12:37:35.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.856+0000 7f935fd33800 20 add_watcher() i=3 2024-03-04T12:37:35.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.856+0000 7f935fd33800 20 add_watcher() i=4 2024-03-04T12:37:35.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.856+0000 7f935fd33800 20 add_watcher() i=5 2024-03-04T12:37:35.863 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.856+0000 7f935fd33800 20 add_watcher() i=6 2024-03-04T12:37:35.864 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.857+0000 7f935fd33800 20 add_watcher() i=7 2024-03-04T12:37:35.864 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.857+0000 7f935fd33800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:35.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.859+0000 7f9211fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:35.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.859+0000 7f935fd33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:35.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.859+0000 7f935fd33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:35.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.859+0000 7f935fd33800 5 note: GC not initialized 2024-03-04T12:37:35.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.859+0000 7f9210fe1640 20 reqs_thread_entry: start 2024-03-04T12:37:35.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.859+0000 7f935fd33800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:35.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.860+0000 7f935fd33800 20 Filter name: none 2024-03-04T12:37:35.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.860+0000 7f918a7fc640 20 reqs_thread_entry: start 2024-03-04T12:37:35.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.860+0000 7f935fd33800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-04T12:37:35.866 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.860+0000 7f935fd33800 20 rados->read ofs=0 len=0 2024-03-04T12:37:35.867 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.860+0000 7f935fd33800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:37:35.867 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.860+0000 7f935fd33800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-04T12:37:35.867 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.860+0000 7f935fd33800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-04T12:37:35.867 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.860+0000 7f935fd33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 : miss 2024-03-04T12:37:35.867 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.860+0000 7f935fd33800 20 rados->read ofs=0 len=0 2024-03-04T12:37:35.867 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.860+0000 7f935fd33800 20 rados_obj.operate() r=0 bl.length=369 2024-03-04T12:37:35.868 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.860+0000 7f935fd33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 info.flags=0x17 2024-03-04T12:37:35.868 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.860+0000 7f935fd33800 10 adding default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 to cache LRU end 2024-03-04T12:37:35.868 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.860+0000 7f935fd33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:37:35.868 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.860+0000 7f935fd33800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:35.868 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.860+0000 7f935fd33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 2024-03-04T12:37:35.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.867+0000 7f935fd33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 info.flags=0x17 2024-03-04T12:37:35.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.867+0000 7f935fd33800 10 moving default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 to cache LRU end 2024-03-04T12:37:35.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.867+0000 7f935fd33800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:35.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.867+0000 7f935fd33800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19, ofs0, ns] 2024-03-04T12:37:35.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.867+0000 7f923affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824118 cookie 93848361462032 notifier 7350 bl.length()=855 2024-03-04T12:37:35.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.867+0000 7f923affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 info.flags=0x17 2024-03-04T12:37:35.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.867+0000 7f923affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 to cache LRU end 2024-03-04T12:37:35.873 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.867+0000 7f923affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:35.875 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.869+0000 7f935fd33800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): orig_sources= new_sources= 2024-03-04T12:37:35.875 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.869+0000 7f935fd33800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): potential sources added=[] removed=[] 2024-03-04T12:37:35.875 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.869+0000 7f935fd33800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): orig_dests= new_dests= 2024-03-04T12:37:35.875 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.869+0000 7f935fd33800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): potential dests added=[] removed=[] 2024-03-04T12:37:35.877 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.0 2024-03-04T12:37:35.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.0 2024-03-04T12:37:35.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.1 2024-03-04T12:37:35.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.1 2024-03-04T12:37:35.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.2 2024-03-04T12:37:35.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.2 2024-03-04T12:37:35.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.3 2024-03-04T12:37:35.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.3 2024-03-04T12:37:35.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.4 2024-03-04T12:37:35.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.4 2024-03-04T12:37:35.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.5 2024-03-04T12:37:35.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.5 2024-03-04T12:37:35.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.6 2024-03-04T12:37:35.878 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.6 2024-03-04T12:37:35.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.7 2024-03-04T12:37:35.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.7 2024-03-04T12:37:35.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.8 2024-03-04T12:37:35.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.8 2024-03-04T12:37:35.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:35.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:35.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.10 2024-03-04T12:37:35.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.10 2024-03-04T12:37:35.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.11 2024-03-04T12:37:35.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.11 2024-03-04T12:37:35.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.12 2024-03-04T12:37:35.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.12 2024-03-04T12:37:35.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.13 2024-03-04T12:37:35.879 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.13 2024-03-04T12:37:35.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.14 2024-03-04T12:37:35.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.14 2024-03-04T12:37:35.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.15 2024-03-04T12:37:35.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.15 2024-03-04T12:37:35.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.16 2024-03-04T12:37:35.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.16 2024-03-04T12:37:35.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.0 2024-03-04T12:37:35.880 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.871+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.0 2024-03-04T12:37:35.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.872+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.1 2024-03-04T12:37:35.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.872+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.1 2024-03-04T12:37:35.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.872+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.2 2024-03-04T12:37:35.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.872+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.2 2024-03-04T12:37:35.881 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.873+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.3 2024-03-04T12:37:35.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.873+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.3 2024-03-04T12:37:35.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.873+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.4 2024-03-04T12:37:35.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.873+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.4 2024-03-04T12:37:35.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.874+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.5 2024-03-04T12:37:35.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.874+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.5 2024-03-04T12:37:35.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.874+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.6 2024-03-04T12:37:35.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.874+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.6 2024-03-04T12:37:35.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.875+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.7 2024-03-04T12:37:35.882 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.875+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.7 2024-03-04T12:37:35.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.876+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.8 2024-03-04T12:37:35.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.876+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.8 2024-03-04T12:37:35.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.876+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.9 2024-03-04T12:37:35.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.876+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.9 2024-03-04T12:37:35.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.877+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.10 2024-03-04T12:37:35.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.877+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.10 2024-03-04T12:37:35.883 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.877+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.11 2024-03-04T12:37:35.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.877+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.11 2024-03-04T12:37:35.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.878+0000 7f935fd33800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.12 2024-03-04T12:37:35.884 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.878+0000 7f935fd33800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.2.12 2024-03-04T12:37:35.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.880+0000 7f935fd33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 : hit (requested=0x17, cached=0x17) 2024-03-04T12:37:35.886 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.880+0000 7f935fd33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 2024-03-04T12:37:35.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.882+0000 7f935fd33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 info.flags=0x17 2024-03-04T12:37:35.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.882+0000 7f935fd33800 10 moving default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 to cache LRU end 2024-03-04T12:37:35.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.882+0000 7f935fd33800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:35.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.882+0000 7f935fd33800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19, ofs0, ns] 2024-03-04T12:37:35.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.882+0000 7f923affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824119 cookie 93848361462032 notifier 7350 bl.length()=823 2024-03-04T12:37:35.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.882+0000 7f923affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 info.flags=0x17 2024-03-04T12:37:35.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.882+0000 7f923affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 to cache LRU end 2024-03-04T12:37:35.888 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.882+0000 7f923affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:35.889 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.883+0000 7f935fd33800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): orig_sources= new_sources= 2024-03-04T12:37:35.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.883+0000 7f935fd33800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): potential sources added=[] removed=[] 2024-03-04T12:37:35.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.883+0000 7f935fd33800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): orig_dests= new_dests= 2024-03-04T12:37:35.890 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.883+0000 7f935fd33800 20 handle_bi_update(): bucket=:myver[82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19]): potential dests added=[] removed=[] 2024-03-04T12:37:35.892 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.886+0000 7f935fd33800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-03-04T12:37:35.894 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.888+0000 7f9211fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:35.896 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.890+0000 7f935fd33800 20 remove_watcher() i=0 2024-03-04T12:37:35.896 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.890+0000 7f935fd33800 2 removed watcher, disabling cache 2024-03-04T12:37:35.897 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.891+0000 7f935fd33800 20 remove_watcher() i=1 2024-03-04T12:37:35.898 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.892+0000 7f935fd33800 20 remove_watcher() i=2 2024-03-04T12:37:35.899 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.893+0000 7f935fd33800 20 remove_watcher() i=3 2024-03-04T12:37:35.900 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.894+0000 7f935fd33800 20 remove_watcher() i=4 2024-03-04T12:37:35.901 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.895+0000 7f935fd33800 20 remove_watcher() i=5 2024-03-04T12:37:35.902 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.896+0000 7f935fd33800 20 remove_watcher() i=6 2024-03-04T12:37:35.903 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:35.897+0000 7f935fd33800 20 remove_watcher() i=7 2024-03-04T12:37:35.914 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-04T12:37:35.947 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:35.948 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:36.178 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.172+0000 7f2f71ccc640 0 --2- 172.21.15.110:0/1101415238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed5598d0c0 0x55ed5598d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-03-04T12:37:36.182 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.176+0000 7f2f7673b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.177+0000 7f2f7673b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:36.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.177+0000 7f2f7673b800 20 realm 2024-03-04T12:37:36.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.177+0000 7f2f7673b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.178+0000 7f2f7673b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:36.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.178+0000 7f2f7673b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:36.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.178+0000 7f2f7673b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.178+0000 7f2f7673b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:36.184 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.178+0000 7f2f7673b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.185 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.179+0000 7f2f7673b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:36.185 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.179+0000 7f2f7673b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.185 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.179+0000 7f2f7673b800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:36.185 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.179+0000 7f2f7673b800 20 searching for the correct realm 2024-03-04T12:37:36.186 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.179+0000 7f2f71ccc640 0 -- 172.21.15.110:0/2579202379 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x55ed559b4630 msgr2=0x55ed559b6ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:36.189 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.183+0000 7f2f71ccc640 0 -- 172.21.15.110:0/2579202379 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x7f2e3c07a7c0 msgr2=0x7f2e3c07cbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:36.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.191+0000 7f2f7673b800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:36.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.191+0000 7f2f7673b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:36.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.191+0000 7f2f7673b800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:36.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.191+0000 7f2f7673b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:36.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.191+0000 7f2f7673b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:36.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.191+0000 7f2f7673b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:36.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.191+0000 7f2f7673b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.192+0000 7f2f7673b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:36.198 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.192+0000 7f2f7673b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.192+0000 7f2f7673b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:36.199 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.192+0000 7f2f7673b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.192+0000 7f2f7673b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:36.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.192+0000 7f2f7673b800 20 zone default found 2024-03-04T12:37:36.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.192+0000 7f2f7673b800 4 Realm: () 2024-03-04T12:37:36.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.192+0000 7f2f7673b800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:36.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.192+0000 7f2f7673b800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:36.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.192+0000 7f2f7673b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:36.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.192+0000 7f2f7673b800 20 zonegroup default 2024-03-04T12:37:36.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.192+0000 7f2f7673b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.200 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.193+0000 7f2f7673b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:36.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.193+0000 7f2f7673b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.193+0000 7f2f7673b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:36.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.193+0000 7f2f7673b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.193+0000 7f2f7673b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:36.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.193+0000 7f2f7673b800 20 started sync module instance, tier type = 2024-03-04T12:37:36.201 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.193+0000 7f2f7673b800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:36.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.203+0000 7f2f7673b800 20 add_watcher() i=0 2024-03-04T12:37:36.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.203+0000 7f2f7673b800 20 add_watcher() i=1 2024-03-04T12:37:36.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.203+0000 7f2f7673b800 20 add_watcher() i=2 2024-03-04T12:37:36.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.203+0000 7f2f7673b800 20 add_watcher() i=3 2024-03-04T12:37:36.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.203+0000 7f2f7673b800 20 add_watcher() i=4 2024-03-04T12:37:36.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.203+0000 7f2f7673b800 20 add_watcher() i=5 2024-03-04T12:37:36.209 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.203+0000 7f2f7673b800 20 add_watcher() i=6 2024-03-04T12:37:36.210 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.203+0000 7f2f7673b800 20 add_watcher() i=7 2024-03-04T12:37:36.210 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.203+0000 7f2f7673b800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:36.211 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.205+0000 7f2e28fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:36.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.205+0000 7f2f7673b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:36.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.205+0000 7f2f7673b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:36.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.205+0000 7f2f7673b800 5 note: GC not initialized 2024-03-04T12:37:36.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.206+0000 7f2da37fe640 20 reqs_thread_entry: start 2024-03-04T12:37:36.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.206+0000 7f2f7673b800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:36.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.206+0000 7f2f7673b800 20 Filter name: none 2024-03-04T12:37:36.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.206+0000 7f2da17fa640 20 reqs_thread_entry: start 2024-03-04T12:37:36.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.206+0000 7f2f7673b800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-04T12:37:36.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.206+0000 7f2f7673b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.213 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.206+0000 7f2f7673b800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:37:36.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.206+0000 7f2f7673b800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-04T12:37:36.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.206+0000 7f2f7673b800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-04T12:37:36.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.206+0000 7f2f7673b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 : miss 2024-03-04T12:37:36.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.206+0000 7f2f7673b800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.207+0000 7f2f7673b800 20 rados_obj.operate() r=0 bl.length=369 2024-03-04T12:37:36.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.207+0000 7f2f7673b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 info.flags=0x17 2024-03-04T12:37:36.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.207+0000 7f2f7673b800 10 adding default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 to cache LRU end 2024-03-04T12:37:36.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.207+0000 7f2f7673b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:37:36.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.207+0000 7f2f7673b800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-04T12:37:36.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.207+0000 7f2f7673b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19 2024-03-04T12:37:36.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.207+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.0 2024-03-04T12:37:36.214 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.207+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.0 2024-03-04T12:37:36.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.207+0000 7f2f7673b800 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-04T12:37:36.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.207+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.1 2024-03-04T12:37:36.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.207+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.1 2024-03-04T12:37:36.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.208+0000 7f2f7673b800 1 NOTICE: finished shard 1 (0 entries removed) 2024-03-04T12:37:36.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.208+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.2 2024-03-04T12:37:36.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.208+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.2 2024-03-04T12:37:36.216 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.208+0000 7f2f7673b800 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-04T12:37:36.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.208+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.3 2024-03-04T12:37:36.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.208+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.3 2024-03-04T12:37:36.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.209+0000 7f2f7673b800 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-04T12:37:36.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.209+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.4 2024-03-04T12:37:36.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.209+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.4 2024-03-04T12:37:36.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.209+0000 7f2f7673b800 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-04T12:37:36.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.209+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.5 2024-03-04T12:37:36.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.209+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.5 2024-03-04T12:37:36.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.210+0000 7f2f7673b800 1 NOTICE: finished shard 5 (0 entries removed) 2024-03-04T12:37:36.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.210+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.6 2024-03-04T12:37:36.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.210+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.6 2024-03-04T12:37:36.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.210+0000 7f2f7673b800 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-04T12:37:36.217 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.210+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.7 2024-03-04T12:37:36.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.210+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.7 2024-03-04T12:37:36.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.211+0000 7f2f7673b800 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-04T12:37:36.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.211+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.8 2024-03-04T12:37:36.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.211+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.8 2024-03-04T12:37:36.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.212+0000 7f2f7673b800 1 NOTICE: finished shard 8 (0 entries removed) 2024-03-04T12:37:36.218 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.212+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.219 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.212+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.219 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.212+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.10 2024-03-04T12:37:36.219 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.212+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.10 2024-03-04T12:37:36.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.213+0000 7f2f7673b800 1 NOTICE: finished shard 10 (0 entries removed) 2024-03-04T12:37:36.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.213+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.11 2024-03-04T12:37:36.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.213+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.11 2024-03-04T12:37:36.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.213+0000 7f2f7673b800 1 NOTICE: finished shard 11 (0 entries removed) 2024-03-04T12:37:36.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.213+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.12 2024-03-04T12:37:36.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.213+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.12 2024-03-04T12:37:36.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.214+0000 7f2f7673b800 1 NOTICE: finished shard 12 (0 entries removed) 2024-03-04T12:37:36.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.214+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.13 2024-03-04T12:37:36.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.214+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.13 2024-03-04T12:37:36.220 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.214+0000 7f2f7673b800 1 NOTICE: finished shard 13 (0 entries removed) 2024-03-04T12:37:36.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.214+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.14 2024-03-04T12:37:36.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.214+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.14 2024-03-04T12:37:36.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.214+0000 7f2f7673b800 1 NOTICE: finished shard 14 (0 entries removed) 2024-03-04T12:37:36.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.214+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.15 2024-03-04T12:37:36.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.214+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.15 2024-03-04T12:37:36.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.215+0000 7f2f7673b800 1 NOTICE: finished shard 15 (0 entries removed) 2024-03-04T12:37:36.221 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.215+0000 7f2f7673b800 10 bucket_obj is .dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.16 2024-03-04T12:37:36.222 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.215+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.16 2024-03-04T12:37:36.222 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.216+0000 7f2f7673b800 1 NOTICE: finished shard 16 (0 entries removed) 2024-03-04T12:37:36.222 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.216+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.223 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.216+0000 7f2f7673b800 20 get_obj_state: octx=0x55ed557473f0 obj=myver:x state=0x55ed559e52c8 s->prefetch_data=0 2024-03-04T12:37:36.223 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.216+0000 7f2f7673b800 20 get_obj_state: setting s->obj_tag to x0sqi2113aimnl1r0omnzjf2wkkoye4t 2024-03-04T12:37:36.223 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.216+0000 7f2f7673b800 20 get_obj_state_impl: setting s->olh_tag to qo44f4rpe357ahy2d6bzahahwnyyx1et 2024-03-04T12:37:36.223 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.216+0000 7f2f7673b800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qo44f4rpe357ahy2d6bzahahwnyyx1et 2024-03-04T12:37:36.223 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.217+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.225 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.219+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.225 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.219+0000 7f2f7673b800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-03-04T12:37:36.225 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.219+0000 7f2f7673b800 20 olh_log_entry: epoch=2 op=3 key=x[9mG.z810.bygQI-8pvvBRoGFX.3Impj] 2024-03-04T12:37:36.225 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.219+0000 7f2f7673b800 20 get_obj_state: octx=0x55ed557473f0 obj=myver:_:9mG.z810.bygQI-8pvvBRoGFX.3Impj_x state=0x55ed55a280c8 s->prefetch_data=0 2024-03-04T12:37:36.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.220+0000 7f2f7673b800 10 manifest: total_size = 22 2024-03-04T12:37:36.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.220+0000 7f2f7673b800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12093806675306077165 2024-03-04T12:37:36.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.220+0000 7f2f7673b800 20 get_obj_state: octx=0x55ed557473f0 obj=myver:_:9mG.z810.bygQI-8pvvBRoGFX.3Impj_x state=0x55ed55a280c8 s->prefetch_data=0 2024-03-04T12:37:36.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.220+0000 7f2f7673b800 20 prepare_atomic_modification: state is not atomic. state=0x55ed55a280c8 2024-03-04T12:37:36.226 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.220+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.223+0000 7f2f7673b800 20 get_obj_state: octx=0x55ed557473f0 obj=myver:x state=0x55ed559e52c8 s->prefetch_data=0 2024-03-04T12:37:36.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.223+0000 7f2f7673b800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qo44f4rpe357ahy2d6bzahahwnyyx1et 2024-03-04T12:37:36.229 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.223+0000 7f2e557fa640 20 handle_completion(): completion ok for obj=x[9mG.z810.bygQI-8pvvBRoGFX.3Impj] 2024-03-04T12:37:36.231 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.225+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.226+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.232 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.226+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.227+0000 7f2f7673b800 20 get_obj_state: octx=0x55ed557473f0 obj=myver:y state=0x55ed559e5268 s->prefetch_data=0 2024-03-04T12:37:36.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.227+0000 7f2f7673b800 20 get_obj_state: setting s->obj_tag to a2tyzgm4cap0co6ew95nyt4uypr0q2vl 2024-03-04T12:37:36.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.227+0000 7f2f7673b800 20 get_obj_state_impl: setting s->olh_tag to k8hg11w19aebchf4ef9juegn710fy6wn 2024-03-04T12:37:36.233 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.227+0000 7f2f7673b800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=k8hg11w19aebchf4ef9juegn710fy6wn 2024-03-04T12:37:36.234 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.228+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.235 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.229+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.230+0000 7f2f7673b800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-03-04T12:37:36.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.230+0000 7f2f7673b800 20 olh_log_entry: epoch=2 op=3 key=y[uu4FyIhUWKkvzF-HEe.QobDjC9gXA3p] 2024-03-04T12:37:36.236 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.230+0000 7f2f7673b800 20 get_obj_state: octx=0x55ed557473f0 obj=myver:_:uu4FyIhUWKkvzF-HEe.QobDjC9gXA3p_y state=0x55ed55a280c8 s->prefetch_data=0 2024-03-04T12:37:36.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.230+0000 7f2f7673b800 10 manifest: total_size = 12 2024-03-04T12:37:36.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.230+0000 7f2f7673b800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15874531843924825156 2024-03-04T12:37:36.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.230+0000 7f2f7673b800 20 get_obj_state: octx=0x55ed557473f0 obj=myver:_:uu4FyIhUWKkvzF-HEe.QobDjC9gXA3p_y state=0x55ed55a280c8 s->prefetch_data=0 2024-03-04T12:37:36.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.230+0000 7f2f7673b800 20 prepare_atomic_modification: state is not atomic. state=0x55ed55a280c8 2024-03-04T12:37:36.237 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.230+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.240 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.234+0000 7f2f7673b800 20 get_obj_state: octx=0x55ed557473f0 obj=myver:y state=0x55ed559e5268 s->prefetch_data=0 2024-03-04T12:37:36.240 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.234+0000 7f2f7673b800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=k8hg11w19aebchf4ef9juegn710fy6wn 2024-03-04T12:37:36.240 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.234+0000 7f2e55ffb640 20 handle_completion(): completion ok for obj=y[uu4FyIhUWKkvzF-HEe.QobDjC9gXA3p] 2024-03-04T12:37:36.242 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.236+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.237+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.237+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.243 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.238+0000 7f2f7673b800 20 get_obj_state: octx=0x55ed557473f0 obj=myver:z state=0x55ed559e39a8 s->prefetch_data=0 2024-03-04T12:37:36.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.238+0000 7f2f7673b800 20 get_obj_state: setting s->obj_tag to one7pytn7ip7dt2hpa2k0dmjzbk13ry2 2024-03-04T12:37:36.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.238+0000 7f2f7673b800 20 get_obj_state_impl: setting s->olh_tag to dgaurelztrr8lyh83yok1jrvmeho2hd6 2024-03-04T12:37:36.244 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.238+0000 7f2f7673b800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=dgaurelztrr8lyh83yok1jrvmeho2hd6 2024-03-04T12:37:36.245 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.239+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.247 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.241+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.247 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.241+0000 7f2f7673b800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-03-04T12:37:36.247 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.241+0000 7f2f7673b800 20 olh_log_entry: epoch=2 op=3 key=z[eShNTq7WM793o1UtwNDkkcT.G5HpPrz] 2024-03-04T12:37:36.248 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.241+0000 7f2f7673b800 20 get_obj_state: octx=0x55ed557473f0 obj=myver:_:eShNTq7WM793o1UtwNDkkcT.G5HpPrz_z state=0x55ed55a280c8 s->prefetch_data=0 2024-03-04T12:37:36.248 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.241+0000 7f2f7673b800 10 manifest: total_size = 11 2024-03-04T12:37:36.248 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.241+0000 7f2f7673b800 20 get_obj_state: setting s->obj_tag to 82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9236047074159409422 2024-03-04T12:37:36.248 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.241+0000 7f2f7673b800 20 get_obj_state: octx=0x55ed557473f0 obj=myver:_:eShNTq7WM793o1UtwNDkkcT.G5HpPrz_z state=0x55ed55a280c8 s->prefetch_data=0 2024-03-04T12:37:36.248 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.241+0000 7f2f7673b800 20 prepare_atomic_modification: state is not atomic. state=0x55ed55a280c8 2024-03-04T12:37:36.248 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.241+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.251 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.245+0000 7f2e55ffb640 20 handle_completion(): completion ok for obj=z[eShNTq7WM793o1UtwNDkkcT.G5HpPrz] 2024-03-04T12:37:36.251 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.245+0000 7f2f7673b800 20 get_obj_state: octx=0x55ed557473f0 obj=myver:z state=0x55ed559e39a8 s->prefetch_data=0 2024-03-04T12:37:36.251 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.245+0000 7f2f7673b800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=dgaurelztrr8lyh83yok1jrvmeho2hd6 2024-03-04T12:37:36.253 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.247+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.248+0000 7f2f7673b800 20 bucket index object: :.dir.82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.19.3.9 2024-03-04T12:37:36.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.248+0000 7f2f7673b800 1 NOTICE: finished shard 9 (3 entries removed) 2024-03-04T12:37:36.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.248+0000 7f2f7673b800 1 NOTICE: finished all shards (3 entries removed) 2024-03-04T12:37:36.254 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.249+0000 7f2e28fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:36.256 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.251+0000 7f2f7673b800 20 remove_watcher() i=0 2024-03-04T12:37:36.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.251+0000 7f2f7673b800 2 removed watcher, disabling cache 2024-03-04T12:37:36.257 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.252+0000 7f2f7673b800 20 remove_watcher() i=1 2024-03-04T12:37:36.258 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.253+0000 7f2f7673b800 20 remove_watcher() i=2 2024-03-04T12:37:36.259 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.254+0000 7f2f7673b800 20 remove_watcher() i=3 2024-03-04T12:37:36.260 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.255+0000 7f2f7673b800 20 remove_watcher() i=4 2024-03-04T12:37:36.261 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.256+0000 7f2f7673b800 20 remove_watcher() i=5 2024-03-04T12:37:36.262 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.257+0000 7f2f7673b800 20 remove_watcher() i=6 2024-03-04T12:37:36.263 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.258+0000 7f2f7673b800 20 remove_watcher() i=7 2024-03-04T12:37:36.275 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:36.275 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:36.309 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:36.310 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:36.395 INFO:tasks.workunit.client.0.smithi110.stderr:radosgw-admin bucket stats --bucket myver 2024-03-04T12:37:36.422 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:36.422 INFO:tasks.workunit.client.0.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:36.455 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.449+0000 7f6910830800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.457 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.451+0000 7f6910830800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:36.457 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.451+0000 7f6910830800 20 realm 2024-03-04T12:37:36.457 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.451+0000 7f6910830800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.458 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.451+0000 7f6910830800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:36.458 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.451+0000 7f6910830800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:36.458 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.451+0000 7f6910830800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.458 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.451+0000 7f6910830800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:36.458 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.451+0000 7f6910830800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.452+0000 7f6910830800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:36.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.452+0000 7f6910830800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.452+0000 7f6910830800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:36.459 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.452+0000 7f6910830800 20 searching for the correct realm 2024-03-04T12:37:36.461 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.455+0000 7f690c331640 0 -- 172.21.15.110:0/1556037121 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f68f401f070 msgr2=0x7f68f4010950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:36.465 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.459+0000 7f690bb30640 0 -- 172.21.15.110:0/1556037121 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f68f402c420 msgr2=0x7f68f402c880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:36.671 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:36.671 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:36.671 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:36.671 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:36.671 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:36.671 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:36.672 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.672 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:36.672 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.672 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:36.672 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:36.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 20 zone default found 2024-03-04T12:37:36.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 4 Realm: () 2024-03-04T12:37:36.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:36.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:36.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:36.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 20 zonegroup default 2024-03-04T12:37:36.673 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.665+0000 7f6910830800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.666+0000 7f6910830800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:36.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.666+0000 7f6910830800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.666+0000 7f6910830800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:36.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.666+0000 7f6910830800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.666+0000 7f6910830800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:36.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.666+0000 7f6910830800 20 started sync module instance, tier type = 2024-03-04T12:37:36.674 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.666+0000 7f6910830800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:36.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.675+0000 7f6910830800 20 add_watcher() i=0 2024-03-04T12:37:36.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.675+0000 7f6910830800 20 add_watcher() i=1 2024-03-04T12:37:36.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.675+0000 7f6910830800 20 add_watcher() i=2 2024-03-04T12:37:36.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.675+0000 7f6910830800 20 add_watcher() i=3 2024-03-04T12:37:36.681 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.675+0000 7f6910830800 20 add_watcher() i=4 2024-03-04T12:37:36.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.675+0000 7f6910830800 20 add_watcher() i=5 2024-03-04T12:37:36.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.675+0000 7f6910830800 20 add_watcher() i=6 2024-03-04T12:37:36.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.676+0000 7f6910830800 20 add_watcher() i=7 2024-03-04T12:37:36.682 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.676+0000 7f6910830800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:36.683 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.677+0000 7f67c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:36.684 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.678+0000 7f6910830800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:36.685 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.678+0000 7f6910830800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:36.685 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.678+0000 7f6910830800 5 note: GC not initialized 2024-03-04T12:37:36.685 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.678+0000 7f67c0fe1640 20 reqs_thread_entry: start 2024-03-04T12:37:36.685 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.678+0000 7f6910830800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:36.685 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.678+0000 7f6910830800 20 Filter name: none 2024-03-04T12:37:36.685 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.678+0000 7f673a7fc640 20 reqs_thread_entry: start 2024-03-04T12:37:36.685 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.678+0000 7f6910830800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.685 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.679+0000 7f6910830800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:37:36.685 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.679+0000 7f6910830800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.679+0000 7f6910830800 20 rados_obj.operate() r=0 bl.length=369 2024-03-04T12:37:36.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.679+0000 7f6910830800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:36.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.679+0000 7f6910830800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.679+0000 7f6910830800 20 rados_obj.operate() r=0 bl.length=197 2024-03-04T12:37:36.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.679+0000 7f6910830800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.686 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.680+0000 7f6910830800 20 rados_obj.operate() r=0 bl.length=369 2024-03-04T12:37:36.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.680+0000 7f6910830800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-04T12:37:36.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.681+0000 7f6910830800 20 rados->read ofs=0 len=0 2024-03-04T12:37:36.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.681+0000 7f6910830800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:36.687 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.682+0000 7f67c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:36.689 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.684+0000 7f6910830800 20 remove_watcher() i=0 2024-03-04T12:37:36.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.684+0000 7f6910830800 2 removed watcher, disabling cache 2024-03-04T12:37:36.690 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.685+0000 7f6910830800 20 remove_watcher() i=1 2024-03-04T12:37:36.691 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.685+0000 7f6910830800 20 remove_watcher() i=2 2024-03-04T12:37:36.692 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.686+0000 7f6910830800 20 remove_watcher() i=3 2024-03-04T12:37:36.693 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.687+0000 7f6910830800 20 remove_watcher() i=4 2024-03-04T12:37:36.694 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.688+0000 7f6910830800 20 remove_watcher() i=5 2024-03-04T12:37:36.695 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.689+0000 7f6910830800 20 remove_watcher() i=6 2024-03-04T12:37:36.696 INFO:tasks.workunit.client.0.smithi110.stderr:2024-03-04T12:37:36.690+0000 7f6910830800 20 remove_watcher() i=7 2024-03-04T12:37:36.705 INFO:tasks.workunit.client.0.smithi110.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-03-04T12:37:36.706 INFO:tasks.workunit.client.0.smithi110.stderr:Deleting bucket a-bucket 2024-03-04T12:37:36.707 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:36.707 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:36.728 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:36.728 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:36.776 INFO:tasks.workunit.client.0.smithi110.stderr:Deleting bucket myver 2024-03-04T12:37:36.776 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:36.777 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:36.847 INFO:tasks.workunit.client.0.smithi110.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T12:37:36.847 INFO:tasks.workunit.client.0.smithi110.stderr: warnings.warn( 2024-03-04T12:37:36.997 INFO:tasks.workunit.client.0.smithi110.stderr:Completed resharding tests 2024-03-04T12:37:36.997 INFO:tasks.workunit.client.0.smithi110.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-03-04T12:37:36.997 INFO:tasks.workunit.client.0.smithi110.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-03-04T12:37:36.997 INFO:tasks.workunit.client.0.smithi110.stdout:connected to https://localhost:443 2024-03-04T12:37:37.067 INFO:tasks.workunit.client.0.smithi110.stderr:+ deactivate 2024-03-04T12:37:37.067 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-03-04T12:37:37.067 INFO:tasks.workunit.client.0.smithi110.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-04T12:37:37.068 INFO:tasks.workunit.client.0.smithi110.stderr:+ export PATH 2024-03-04T12:37:37.068 INFO:tasks.workunit.client.0.smithi110.stderr:+ unset _OLD_VIRTUAL_PATH 2024-03-04T12:37:37.068 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' -n '' ']' 2024-03-04T12:37:37.068 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-04T12:37:37.068 INFO:tasks.workunit.client.0.smithi110.stderr:+ hash -r 2024-03-04T12:37:37.068 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' -n '' ']' 2024-03-04T12:37:37.068 INFO:tasks.workunit.client.0.smithi110.stderr:+ unset VIRTUAL_ENV 2024-03-04T12:37:37.068 INFO:tasks.workunit.client.0.smithi110.stderr:+ '[' '!' '' = nondestructive ']' 2024-03-04T12:37:37.068 INFO:tasks.workunit.client.0.smithi110.stderr:+ unset -f deactivate 2024-03-04T12:37:37.068 INFO:tasks.workunit.client.0.smithi110.stderr:+ echo OK. 2024-03-04T12:37:37.069 INFO:tasks.workunit.client.0.smithi110.stdout:OK. 2024-03-04T12:37:37.069 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-04T12:37:37.070 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-04T12:37:37.150 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-03-04T12:37:37.151 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-04T12:37:37.546 DEBUG:teuthology.parallel:result is None 2024-03-04T12:37:37.547 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:37:37.588 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:37:37.588 DEBUG:teuthology.orchestra.run.smithi110:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-04T12:37:37.655 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-04T12:37:37.655 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-03-04T12:37:37.669 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-03-04T12:37:37.670 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-03-04T12:37:37.670 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-03-04T12:37:37.670 DEBUG:teuthology.orchestra.run.smithi110:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-03-04T12:37:37.723 INFO:teuthology.orchestra.run.smithi110.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-03-04T12:37:44.461 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-03-04T12:37:44.462 DEBUG:teuthology.orchestra.run.smithi110:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-03-04T12:37:47.453 INFO:teuthology.orchestra.run.smithi110.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-03-04T12:37:48.013 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:20:39 ago on Mon 04 Mar 2024 12:17:09 PM UTC. 2024-03-04T12:37:48.191 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-03-04T12:37:48.192 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-03-04T12:37:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-03-04T12:37:48.192 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-03-04T12:37:48.192 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-03-04T12:37:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 424 k 2024-03-04T12:37:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 9.3 M 2024-03-04T12:37:48.192 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-03-04T12:37:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: java-1.8.0-openjdk-headless 2024-03-04T12:37:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 32 M 2024-03-04T12:37:48.193 INFO:teuthology.orchestra.run.smithi110.stdout:Installing weak dependencies: 2024-03-04T12:37:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: gtk2 x86_64 2.24.33-8.el9 CentOS-AppStream 3.5 M 2024-03-04T12:37:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 CentOS-AppStream 25 k 2024-03-04T12:37:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:37:48.193 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-03-04T12:37:48.193 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-03-04T12:37:48.193 INFO:teuthology.orchestra.run.smithi110.stdout:Install 5 Packages 2024-03-04T12:37:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:37:48.194 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 45 M 2024-03-04T12:37:48.194 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 166 M 2024-03-04T12:37:48.194 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-03-04T12:37:48.450 INFO:teuthology.orchestra.run.smithi110.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 1.6 MB/s | 424 kB 00:00 2024-03-04T12:37:48.633 INFO:teuthology.orchestra.run.smithi110.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 7.9 MB/s | 3.5 MB 00:00 2024-03-04T12:37:48.742 INFO:teuthology.orchestra.run.smithi110.stdout:(3/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 17 MB/s | 9.3 MB 00:00 2024-03-04T12:37:48.826 INFO:teuthology.orchestra.run.smithi110.stdout:(4/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 132 kB/s | 25 kB 00:00 2024-03-04T12:37:49.334 INFO:teuthology.orchestra.run.smithi110.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 37 MB/s | 32 MB 00:00 2024-03-04T12:37:49.337 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-03-04T12:37:49.337 INFO:teuthology.orchestra.run.smithi110.stdout:Total 40 MB/s | 45 MB 00:01 2024-03-04T12:37:49.337 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-03-04T12:37:49.355 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-03-04T12:37:49.355 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-03-04T12:37:49.727 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-03-04T12:37:49.727 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-03-04T12:37:50.157 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-03-04T12:37:50.296 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-03-04T12:37:50.486 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-03-04T12:37:51.096 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-03-04T12:37:51.145 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-03-04T12:37:51.381 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-03-04T12:37:51.412 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-03-04T12:37:51.645 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-03-04T12:37:51.683 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-03-04T12:37:51.690 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-03-04T12:37:51.698 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-03-04T12:37:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-03-04T12:37:54.524 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-03-04T12:37:54.524 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-03-04T12:37:54.524 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-03-04T12:37:54.525 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-03-04T12:37:54.525 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-03-04T12:37:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-03-04T12:37:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:37:54.894 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-03-04T12:37:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: gtk2-2.24.33-8.el9.x86_64 2024-03-04T12:37:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-03-04T12:37:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-03-04T12:37:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-03-04T12:37:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-03-04T12:37:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:37:54.895 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-03-04T12:37:55.333 INFO:teuthology.orchestra.run.smithi110.stdout: Gradle will be installed under /opt/gradle 2024-03-04T12:37:55.420 INFO:teuthology.orchestra.run.smithi110.stderr:--2024-03-04 12:37:55-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-03-04T12:37:55.551 INFO:teuthology.orchestra.run.smithi110.stderr:Resolving services.gradle.org (services.gradle.org)... 104.17.129.37, 104.17.128.37, 2606:4700::6811:8125, ... 2024-03-04T12:37:55.561 INFO:teuthology.orchestra.run.smithi110.stderr:Connecting to services.gradle.org (services.gradle.org)|104.17.129.37|:443... connected. 2024-03-04T12:37:55.652 INFO:teuthology.orchestra.run.smithi110.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-03-04T12:37:55.652 INFO:teuthology.orchestra.run.smithi110.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-03-04T12:37:55.652 INFO:teuthology.orchestra.run.smithi110.stderr:--2024-03-04 12:37:55-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-03-04T12:37:55.652 INFO:teuthology.orchestra.run.smithi110.stderr:Resolving github.com (github.com)... 140.82.112.3 2024-03-04T12:37:55.662 INFO:teuthology.orchestra.run.smithi110.stderr:Connecting to github.com (github.com)|140.82.112.3|:443... connected. 2024-03-04T12:37:55.807 INFO:teuthology.orchestra.run.smithi110.stderr:HTTP request sent, awaiting response... 302 Found 2024-03-04T12:37:55.807 INFO:teuthology.orchestra.run.smithi110.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240304%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240304T123755Z&X-Amz-Expires=300&X-Amz-Signature=8380de0fa27f904482093110bb97c54aa62c842172df936f34d9fbf46191b0c1&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-03-04T12:37:55.807 INFO:teuthology.orchestra.run.smithi110.stderr:--2024-03-04 12:37:55-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240304%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240304T123755Z&X-Amz-Expires=300&X-Amz-Signature=8380de0fa27f904482093110bb97c54aa62c842172df936f34d9fbf46191b0c1&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-03-04T12:37:55.808 INFO:teuthology.orchestra.run.smithi110.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.108.133, 185.199.110.133, ... 2024-03-04T12:37:55.824 INFO:teuthology.orchestra.run.smithi110.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2024-03-04T12:37:55.908 INFO:teuthology.orchestra.run.smithi110.stderr:HTTP request sent, awaiting response... 200 OK 2024-03-04T12:37:55.908 INFO:teuthology.orchestra.run.smithi110.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-03-04T12:37:55.908 INFO:teuthology.orchestra.run.smithi110.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-03-04T12:37:55.908 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-03-04T12:37:55.925 INFO:teuthology.orchestra.run.smithi110.stderr: 0K .......... .......... .......... .......... .......... 0% 2.68M 34s 2024-03-04T12:37:55.945 INFO:teuthology.orchestra.run.smithi110.stderr: 50K .......... .......... .......... .......... .......... 0% 2.51M 35s 2024-03-04T12:37:55.952 INFO:teuthology.orchestra.run.smithi110.stderr: 100K .......... .......... .......... .......... .......... 0% 7.15M 28s 2024-03-04T12:37:55.955 INFO:teuthology.orchestra.run.smithi110.stderr: 150K .......... .......... .......... .......... .......... 0% 16.6M 22s 2024-03-04T12:37:55.960 INFO:teuthology.orchestra.run.smithi110.stderr: 200K .......... .......... .......... .......... .......... 0% 9.21M 20s 2024-03-04T12:37:55.963 INFO:teuthology.orchestra.run.smithi110.stderr: 250K .......... .......... .......... .......... .......... 0% 15.1M 17s 2024-03-04T12:37:55.966 INFO:teuthology.orchestra.run.smithi110.stderr: 300K .......... .......... .......... .......... .......... 0% 15.0M 16s 2024-03-04T12:37:55.969 INFO:teuthology.orchestra.run.smithi110.stderr: 350K .......... .......... .......... .......... .......... 0% 21.8M 14s 2024-03-04T12:37:55.970 INFO:teuthology.orchestra.run.smithi110.stderr: 400K .......... .......... .......... .......... .......... 0% 44.8M 13s 2024-03-04T12:37:55.972 INFO:teuthology.orchestra.run.smithi110.stderr: 450K .......... .......... .......... .......... .......... 0% 25.1M 12s 2024-03-04T12:37:55.976 INFO:teuthology.orchestra.run.smithi110.stderr: 500K .......... .......... .......... .......... .......... 0% 12.6M 11s 2024-03-04T12:37:55.978 INFO:teuthology.orchestra.run.smithi110.stderr: 550K .......... .......... .......... .......... .......... 0% 20.9M 11s 2024-03-04T12:37:55.984 INFO:teuthology.orchestra.run.smithi110.stderr: 600K .......... .......... .......... .......... .......... 0% 7.78M 11s 2024-03-04T12:37:55.987 INFO:teuthology.orchestra.run.smithi110.stderr: 650K .......... .......... .......... .......... .......... 0% 20.4M 10s 2024-03-04T12:37:55.991 INFO:teuthology.orchestra.run.smithi110.stderr: 700K .......... .......... .......... .......... .......... 0% 10.6M 10s 2024-03-04T12:37:55.995 INFO:teuthology.orchestra.run.smithi110.stderr: 750K .......... .......... .......... .......... .......... 0% 14.8M 10s 2024-03-04T12:37:55.998 INFO:teuthology.orchestra.run.smithi110.stderr: 800K .......... .......... .......... .......... .......... 0% 14.3M 10s 2024-03-04T12:37:56.003 INFO:teuthology.orchestra.run.smithi110.stderr: 850K .......... .......... .......... .......... .......... 0% 11.7M 10s 2024-03-04T12:37:56.003 INFO:teuthology.orchestra.run.smithi110.stderr: 900K .......... .......... .......... .......... .......... 1% 140M 9s 2024-03-04T12:37:56.005 INFO:teuthology.orchestra.run.smithi110.stderr: 950K .......... .......... .......... .......... .......... 1% 30.3M 9s 2024-03-04T12:37:56.013 INFO:teuthology.orchestra.run.smithi110.stderr: 1000K .......... .......... .......... .......... .......... 1% 5.19M 9s 2024-03-04T12:37:56.018 INFO:teuthology.orchestra.run.smithi110.stderr: 1050K .......... .......... .......... .......... .......... 1% 10.8M 9s 2024-03-04T12:37:56.019 INFO:teuthology.orchestra.run.smithi110.stderr: 1100K .......... .......... .......... .......... .......... 1% 47.4M 9s 2024-03-04T12:37:56.021 INFO:teuthology.orchestra.run.smithi110.stderr: 1150K .......... .......... .......... .......... .......... 1% 38.0M 9s 2024-03-04T12:37:56.022 INFO:teuthology.orchestra.run.smithi110.stderr: 1200K .......... .......... .......... .......... .......... 1% 150M 8s 2024-03-04T12:37:56.031 INFO:teuthology.orchestra.run.smithi110.stderr: 1250K .......... .......... .......... .......... .......... 1% 24.4M 8s 2024-03-04T12:37:56.031 INFO:teuthology.orchestra.run.smithi110.stderr: 1300K .......... .......... .......... .......... .......... 1% 51.8M 8s 2024-03-04T12:37:56.032 INFO:teuthology.orchestra.run.smithi110.stderr: 1350K .......... .......... .......... .......... .......... 1% 111M 8s 2024-03-04T12:37:56.032 INFO:teuthology.orchestra.run.smithi110.stderr: 1400K .......... .......... .......... .......... .......... 1% 60.7M 7s 2024-03-04T12:37:56.032 INFO:teuthology.orchestra.run.smithi110.stderr: 1450K .......... .......... .......... .......... .......... 1% 121M 7s 2024-03-04T12:37:56.032 INFO:teuthology.orchestra.run.smithi110.stderr: 1500K .......... .......... .......... .......... .......... 1% 46.4M 7s 2024-03-04T12:37:56.032 INFO:teuthology.orchestra.run.smithi110.stderr: 1550K .......... .......... .......... .......... .......... 1% 115M 7s 2024-03-04T12:37:56.032 INFO:teuthology.orchestra.run.smithi110.stderr: 1600K .......... .......... .......... .......... .......... 1% 92.6M 7s 2024-03-04T12:37:56.034 INFO:teuthology.orchestra.run.smithi110.stderr: 1650K .......... .......... .......... .......... .......... 1% 7.86M 7s 2024-03-04T12:37:56.035 INFO:teuthology.orchestra.run.smithi110.stderr: 1700K .......... .......... .......... .......... .......... 1% 32.0M 7s 2024-03-04T12:37:56.046 INFO:teuthology.orchestra.run.smithi110.stderr: 1750K .......... .......... .......... .......... .......... 1% 6.37M 7s 2024-03-04T12:37:56.046 INFO:teuthology.orchestra.run.smithi110.stderr: 1800K .......... .......... .......... .......... .......... 1% 121M 7s 2024-03-04T12:37:56.047 INFO:teuthology.orchestra.run.smithi110.stderr: 1850K .......... .......... .......... .......... .......... 2% 96.7M 7s 2024-03-04T12:37:56.047 INFO:teuthology.orchestra.run.smithi110.stderr: 1900K .......... .......... .......... .......... .......... 2% 38.1M 6s 2024-03-04T12:37:56.047 INFO:teuthology.orchestra.run.smithi110.stderr: 1950K .......... .......... .......... .......... .......... 2% 77.5M 6s 2024-03-04T12:37:56.052 INFO:teuthology.orchestra.run.smithi110.stderr: 2000K .......... .......... .......... .......... .......... 2% 83.8M 6s 2024-03-04T12:37:56.052 INFO:teuthology.orchestra.run.smithi110.stderr: 2050K .......... .......... .......... .......... .......... 2% 8.46M 6s 2024-03-04T12:37:56.053 INFO:teuthology.orchestra.run.smithi110.stderr: 2100K .......... .......... .......... .......... .......... 2% 30.5M 6s 2024-03-04T12:37:56.057 INFO:teuthology.orchestra.run.smithi110.stderr: 2150K .......... .......... .......... .......... .......... 2% 13.0M 6s 2024-03-04T12:37:56.081 INFO:teuthology.orchestra.run.smithi110.stderr: 2200K .......... .......... .......... .......... .......... 2% 6.70M 6s 2024-03-04T12:37:56.081 INFO:teuthology.orchestra.run.smithi110.stderr: 2250K .......... .......... .......... .......... .......... 2% 87.8M 6s 2024-03-04T12:37:56.082 INFO:teuthology.orchestra.run.smithi110.stderr: 2300K .......... .......... .......... .......... .......... 2% 88.4M 6s 2024-03-04T12:37:56.082 INFO:teuthology.orchestra.run.smithi110.stderr: 2350K .......... .......... .......... .......... .......... 2% 69.4M 6s 2024-03-04T12:37:56.082 INFO:teuthology.orchestra.run.smithi110.stderr: 2400K .......... .......... .......... .......... .......... 2% 70.2M 6s 2024-03-04T12:37:56.082 INFO:teuthology.orchestra.run.smithi110.stderr: 2450K .......... .......... .......... .......... .......... 2% 56.6M 6s 2024-03-04T12:37:56.082 INFO:teuthology.orchestra.run.smithi110.stderr: 2500K .......... .......... .......... .......... .......... 2% 70.3M 6s 2024-03-04T12:37:56.082 INFO:teuthology.orchestra.run.smithi110.stderr: 2550K .......... .......... .......... .......... .......... 2% 115M 6s 2024-03-04T12:37:56.082 INFO:teuthology.orchestra.run.smithi110.stderr: 2600K .......... .......... .......... .......... .......... 2% 78.5M 6s 2024-03-04T12:37:56.082 INFO:teuthology.orchestra.run.smithi110.stderr: 2650K .......... .......... .......... .......... .......... 2% 84.2M 5s 2024-03-04T12:37:56.082 INFO:teuthology.orchestra.run.smithi110.stderr: 2700K .......... .......... .......... .......... .......... 2% 107M 5s 2024-03-04T12:37:56.082 INFO:teuthology.orchestra.run.smithi110.stderr: 2750K .......... .......... .......... .......... .......... 3% 112M 5s 2024-03-04T12:37:56.082 INFO:teuthology.orchestra.run.smithi110.stderr: 2800K .......... .......... .......... .......... .......... 3% 117M 5s 2024-03-04T12:37:56.082 INFO:teuthology.orchestra.run.smithi110.stderr: 2850K .......... .......... .......... .......... .......... 3% 88.0M 5s 2024-03-04T12:37:56.082 INFO:teuthology.orchestra.run.smithi110.stderr: 2900K .......... .......... .......... .......... .......... 3% 92.0M 5s 2024-03-04T12:37:56.082 INFO:teuthology.orchestra.run.smithi110.stderr: 2950K .......... .......... .......... .......... .......... 3% 78.0M 5s 2024-03-04T12:37:56.083 INFO:teuthology.orchestra.run.smithi110.stderr: 3000K .......... .......... .......... .......... .......... 3% 77.2M 5s 2024-03-04T12:37:56.083 INFO:teuthology.orchestra.run.smithi110.stderr: 3050K .......... .......... .......... .......... .......... 3% 23.8M 5s 2024-03-04T12:37:56.083 INFO:teuthology.orchestra.run.smithi110.stderr: 3100K .......... .......... .......... .......... .......... 3% 18.1M 5s 2024-03-04T12:37:56.090 INFO:teuthology.orchestra.run.smithi110.stderr: 3150K .......... .......... .......... .......... .......... 3% 4.12M 5s 2024-03-04T12:37:56.097 INFO:teuthology.orchestra.run.smithi110.stderr: 3200K .......... .......... .......... .......... .......... 3% 49.8M 5s 2024-03-04T12:37:56.098 INFO:teuthology.orchestra.run.smithi110.stderr: 3250K .......... .......... .......... .......... .......... 3% 73.1M 5s 2024-03-04T12:37:56.098 INFO:teuthology.orchestra.run.smithi110.stderr: 3300K .......... .......... .......... .......... .......... 3% 92.5M 5s 2024-03-04T12:37:56.098 INFO:teuthology.orchestra.run.smithi110.stderr: 3350K .......... .......... .......... .......... .......... 3% 113M 5s 2024-03-04T12:37:56.098 INFO:teuthology.orchestra.run.smithi110.stderr: 3400K .......... .......... .......... .......... .......... 3% 64.5M 5s 2024-03-04T12:37:56.098 INFO:teuthology.orchestra.run.smithi110.stderr: 3450K .......... .......... .......... .......... .......... 3% 108M 5s 2024-03-04T12:37:56.098 INFO:teuthology.orchestra.run.smithi110.stderr: 3500K .......... .......... .......... .......... .......... 3% 88.1M 5s 2024-03-04T12:37:56.098 INFO:teuthology.orchestra.run.smithi110.stderr: 3550K .......... .......... .......... .......... .......... 3% 104M 5s 2024-03-04T12:37:56.111 INFO:teuthology.orchestra.run.smithi110.stderr: 3600K .......... .......... .......... .......... .......... 3% 3.07M 5s 2024-03-04T12:37:56.113 INFO:teuthology.orchestra.run.smithi110.stderr: 3650K .......... .......... .......... .......... .......... 3% 33.8M 5s 2024-03-04T12:37:56.113 INFO:teuthology.orchestra.run.smithi110.stderr: 3700K .......... .......... .......... .......... .......... 4% 60.5M 5s 2024-03-04T12:37:56.122 INFO:teuthology.orchestra.run.smithi110.stderr: 3750K .......... .......... .......... .......... .......... 4% 40.7M 5s 2024-03-04T12:37:56.122 INFO:teuthology.orchestra.run.smithi110.stderr: 3800K .......... .......... .......... .......... .......... 4% 75.4M 5s 2024-03-04T12:37:56.122 INFO:teuthology.orchestra.run.smithi110.stderr: 3850K .......... .......... .......... .......... .......... 4% 55.6M 5s 2024-03-04T12:37:56.123 INFO:teuthology.orchestra.run.smithi110.stderr: 3900K .......... .......... .......... .......... .......... 4% 71.9M 5s 2024-03-04T12:37:56.123 INFO:teuthology.orchestra.run.smithi110.stderr: 3950K .......... .......... .......... .......... .......... 4% 65.4M 5s 2024-03-04T12:37:56.123 INFO:teuthology.orchestra.run.smithi110.stderr: 4000K .......... .......... .......... .......... .......... 4% 92.0M 5s 2024-03-04T12:37:56.123 INFO:teuthology.orchestra.run.smithi110.stderr: 4050K .......... .......... .......... .......... .......... 4% 60.2M 5s 2024-03-04T12:37:56.123 INFO:teuthology.orchestra.run.smithi110.stderr: 4100K .......... .......... .......... .......... .......... 4% 107M 5s 2024-03-04T12:37:56.123 INFO:teuthology.orchestra.run.smithi110.stderr: 4150K .......... .......... .......... .......... .......... 4% 120M 4s 2024-03-04T12:37:56.123 INFO:teuthology.orchestra.run.smithi110.stderr: 4200K .......... .......... .......... .......... .......... 4% 120M 4s 2024-03-04T12:37:56.123 INFO:teuthology.orchestra.run.smithi110.stderr: 4250K .......... .......... .......... .......... .......... 4% 91.6M 4s 2024-03-04T12:37:56.123 INFO:teuthology.orchestra.run.smithi110.stderr: 4300K .......... .......... .......... .......... .......... 4% 29.9M 4s 2024-03-04T12:37:56.126 INFO:teuthology.orchestra.run.smithi110.stderr: 4350K .......... .......... .......... .......... .......... 4% 32.8M 4s 2024-03-04T12:37:56.126 INFO:teuthology.orchestra.run.smithi110.stderr: 4400K .......... .......... .......... .......... .......... 4% 35.8M 4s 2024-03-04T12:37:56.127 INFO:teuthology.orchestra.run.smithi110.stderr: 4450K .......... .......... .......... .......... .......... 4% 37.8M 4s 2024-03-04T12:37:56.127 INFO:teuthology.orchestra.run.smithi110.stderr: 4500K .......... .......... .......... .......... .......... 4% 88.5M 4s 2024-03-04T12:37:56.144 INFO:teuthology.orchestra.run.smithi110.stderr: 4550K .......... .......... .......... .......... .......... 4% 52.0M 4s 2024-03-04T12:37:56.145 INFO:teuthology.orchestra.run.smithi110.stderr: 4600K .......... .......... .......... .......... .......... 5% 110M 4s 2024-03-04T12:37:56.145 INFO:teuthology.orchestra.run.smithi110.stderr: 4650K .......... .......... .......... .......... .......... 5% 93.0M 4s 2024-03-04T12:37:56.145 INFO:teuthology.orchestra.run.smithi110.stderr: 4700K .......... .......... .......... .......... .......... 5% 116M 4s 2024-03-04T12:37:56.145 INFO:teuthology.orchestra.run.smithi110.stderr: 4750K .......... .......... .......... .......... .......... 5% 91.6M 4s 2024-03-04T12:37:56.145 INFO:teuthology.orchestra.run.smithi110.stderr: 4800K .......... .......... .......... .......... .......... 5% 77.2M 4s 2024-03-04T12:37:56.145 INFO:teuthology.orchestra.run.smithi110.stderr: 4850K .......... .......... .......... .......... .......... 5% 104M 4s 2024-03-04T12:37:56.145 INFO:teuthology.orchestra.run.smithi110.stderr: 4900K .......... .......... .......... .......... .......... 5% 112M 4s 2024-03-04T12:37:56.145 INFO:teuthology.orchestra.run.smithi110.stderr: 4950K .......... .......... .......... .......... .......... 5% 93.3M 4s 2024-03-04T12:37:56.145 INFO:teuthology.orchestra.run.smithi110.stderr: 5000K .......... .......... .......... .......... .......... 5% 99.3M 4s 2024-03-04T12:37:56.145 INFO:teuthology.orchestra.run.smithi110.stderr: 5050K .......... .......... .......... .......... .......... 5% 45.7M 4s 2024-03-04T12:37:56.145 INFO:teuthology.orchestra.run.smithi110.stderr: 5100K .......... .......... .......... .......... .......... 5% 68.1M 4s 2024-03-04T12:37:56.145 INFO:teuthology.orchestra.run.smithi110.stderr: 5150K .......... .......... .......... .......... .......... 5% 97.7M 4s 2024-03-04T12:37:56.145 INFO:teuthology.orchestra.run.smithi110.stderr: 5200K .......... .......... .......... .......... .......... 5% 57.5M 4s 2024-03-04T12:37:56.145 INFO:teuthology.orchestra.run.smithi110.stderr: 5250K .......... .......... .......... .......... .......... 5% 74.2M 4s 2024-03-04T12:37:56.146 INFO:teuthology.orchestra.run.smithi110.stderr: 5300K .......... .......... .......... .......... .......... 5% 98.8M 4s 2024-03-04T12:37:56.146 INFO:teuthology.orchestra.run.smithi110.stderr: 5350K .......... .......... .......... .......... .......... 5% 69.4M 4s 2024-03-04T12:37:56.146 INFO:teuthology.orchestra.run.smithi110.stderr: 5400K .......... .......... .......... .......... .......... 5% 80.3M 4s 2024-03-04T12:37:56.146 INFO:teuthology.orchestra.run.smithi110.stderr: 5450K .......... .......... .......... .......... .......... 5% 59.7M 4s 2024-03-04T12:37:56.146 INFO:teuthology.orchestra.run.smithi110.stderr: 5500K .......... .......... .......... .......... .......... 5% 68.6M 4s 2024-03-04T12:37:56.146 INFO:teuthology.orchestra.run.smithi110.stderr: 5550K .......... .......... .......... .......... .......... 6% 68.6M 4s 2024-03-04T12:37:56.146 INFO:teuthology.orchestra.run.smithi110.stderr: 5600K .......... .......... .......... .......... .......... 6% 58.8M 4s 2024-03-04T12:37:56.146 INFO:teuthology.orchestra.run.smithi110.stderr: 5650K .......... .......... .......... .......... .......... 6% 99.4M 4s 2024-03-04T12:37:56.146 INFO:teuthology.orchestra.run.smithi110.stderr: 5700K .......... .......... .......... .......... .......... 6% 24.3M 4s 2024-03-04T12:37:56.149 INFO:teuthology.orchestra.run.smithi110.stderr: 5750K .......... .......... .......... .......... .......... 6% 11.6M 4s 2024-03-04T12:37:56.149 INFO:teuthology.orchestra.run.smithi110.stderr: 5800K .......... .......... .......... .......... .......... 6% 76.9M 4s 2024-03-04T12:37:56.153 INFO:teuthology.orchestra.run.smithi110.stderr: 5850K .......... .......... .......... .......... .......... 6% 71.3M 4s 2024-03-04T12:37:56.153 INFO:teuthology.orchestra.run.smithi110.stderr: 5900K .......... .......... .......... .......... .......... 6% 37.7M 4s 2024-03-04T12:37:56.154 INFO:teuthology.orchestra.run.smithi110.stderr: 5950K .......... .......... .......... .......... .......... 6% 42.6M 4s 2024-03-04T12:37:56.154 INFO:teuthology.orchestra.run.smithi110.stderr: 6000K .......... .......... .......... .......... .......... 6% 45.4M 4s 2024-03-04T12:37:56.154 INFO:teuthology.orchestra.run.smithi110.stderr: 6050K .......... .......... .......... .......... .......... 6% 85.7M 4s 2024-03-04T12:37:56.155 INFO:teuthology.orchestra.run.smithi110.stderr: 6100K .......... .......... .......... .......... .......... 6% 32.6M 3s 2024-03-04T12:37:56.156 INFO:teuthology.orchestra.run.smithi110.stderr: 6150K .......... .......... .......... .......... .......... 6% 39.0M 3s 2024-03-04T12:37:56.157 INFO:teuthology.orchestra.run.smithi110.stderr: 6200K .......... .......... .......... .......... .......... 6% 112M 3s 2024-03-04T12:37:56.174 INFO:teuthology.orchestra.run.smithi110.stderr: 6250K .......... .......... .......... .......... .......... 6% 48.6M 3s 2024-03-04T12:37:56.174 INFO:teuthology.orchestra.run.smithi110.stderr: 6300K .......... .......... .......... .......... .......... 6% 50.3M 3s 2024-03-04T12:37:56.174 INFO:teuthology.orchestra.run.smithi110.stderr: 6350K .......... .......... .......... .......... .......... 6% 64.3M 3s 2024-03-04T12:37:56.174 INFO:teuthology.orchestra.run.smithi110.stderr: 6400K .......... .......... .......... .......... .......... 6% 81.2M 3s 2024-03-04T12:37:56.174 INFO:teuthology.orchestra.run.smithi110.stderr: 6450K .......... .......... .......... .......... .......... 6% 106M 3s 2024-03-04T12:37:56.174 INFO:teuthology.orchestra.run.smithi110.stderr: 6500K .......... .......... .......... .......... .......... 7% 96.0M 3s 2024-03-04T12:37:56.174 INFO:teuthology.orchestra.run.smithi110.stderr: 6550K .......... .......... .......... .......... .......... 7% 116M 3s 2024-03-04T12:37:56.174 INFO:teuthology.orchestra.run.smithi110.stderr: 6600K .......... .......... .......... .......... .......... 7% 71.3M 3s 2024-03-04T12:37:56.174 INFO:teuthology.orchestra.run.smithi110.stderr: 6650K .......... .......... .......... .......... .......... 7% 79.3M 3s 2024-03-04T12:37:56.174 INFO:teuthology.orchestra.run.smithi110.stderr: 6700K .......... .......... .......... .......... .......... 7% 75.4M 3s 2024-03-04T12:37:56.174 INFO:teuthology.orchestra.run.smithi110.stderr: 6750K .......... .......... .......... .......... .......... 7% 116M 3s 2024-03-04T12:37:56.174 INFO:teuthology.orchestra.run.smithi110.stderr: 6800K .......... .......... .......... .......... .......... 7% 94.7M 3s 2024-03-04T12:37:56.175 INFO:teuthology.orchestra.run.smithi110.stderr: 6850K .......... .......... .......... .......... .......... 7% 58.7M 3s 2024-03-04T12:37:56.175 INFO:teuthology.orchestra.run.smithi110.stderr: 6900K .......... .......... .......... .......... .......... 7% 69.3M 3s 2024-03-04T12:37:56.175 INFO:teuthology.orchestra.run.smithi110.stderr: 6950K .......... .......... .......... .......... .......... 7% 107M 3s 2024-03-04T12:37:56.175 INFO:teuthology.orchestra.run.smithi110.stderr: 7000K .......... .......... .......... .......... .......... 7% 66.0M 3s 2024-03-04T12:37:56.175 INFO:teuthology.orchestra.run.smithi110.stderr: 7050K .......... .......... .......... .......... .......... 7% 81.2M 3s 2024-03-04T12:37:56.175 INFO:teuthology.orchestra.run.smithi110.stderr: 7100K .......... .......... .......... .......... .......... 7% 47.9M 3s 2024-03-04T12:37:56.175 INFO:teuthology.orchestra.run.smithi110.stderr: 7150K .......... .......... .......... .......... .......... 7% 89.5M 3s 2024-03-04T12:37:56.175 INFO:teuthology.orchestra.run.smithi110.stderr: 7200K .......... .......... .......... .......... .......... 7% 109M 3s 2024-03-04T12:37:56.175 INFO:teuthology.orchestra.run.smithi110.stderr: 7250K .......... .......... .......... .......... .......... 7% 53.8M 3s 2024-03-04T12:37:56.176 INFO:teuthology.orchestra.run.smithi110.stderr: 7300K .......... .......... .......... .......... .......... 7% 11.0M 3s 2024-03-04T12:37:56.179 INFO:teuthology.orchestra.run.smithi110.stderr: 7350K .......... .......... .......... .......... .......... 7% 12.6M 3s 2024-03-04T12:37:56.179 INFO:teuthology.orchestra.run.smithi110.stderr: 7400K .......... .......... .......... .......... .......... 8% 204M 3s 2024-03-04T12:37:56.182 INFO:teuthology.orchestra.run.smithi110.stderr: 7450K .......... .......... .......... .......... .......... 8% 15.1M 3s 2024-03-04T12:37:56.192 INFO:teuthology.orchestra.run.smithi110.stderr: 7500K .......... .......... .......... .......... .......... 8% 29.5M 3s 2024-03-04T12:37:56.192 INFO:teuthology.orchestra.run.smithi110.stderr: 7550K .......... .......... .......... .......... .......... 8% 55.4M 3s 2024-03-04T12:37:56.192 INFO:teuthology.orchestra.run.smithi110.stderr: 7600K .......... .......... .......... .......... .......... 8% 78.8M 3s 2024-03-04T12:37:56.193 INFO:teuthology.orchestra.run.smithi110.stderr: 7650K .......... .......... .......... .......... .......... 8% 114M 3s 2024-03-04T12:37:56.193 INFO:teuthology.orchestra.run.smithi110.stderr: 7700K .......... .......... .......... .......... .......... 8% 48.1M 3s 2024-03-04T12:37:56.193 INFO:teuthology.orchestra.run.smithi110.stderr: 7750K .......... .......... .......... .......... .......... 8% 35.4M 3s 2024-03-04T12:37:56.193 INFO:teuthology.orchestra.run.smithi110.stderr: 7800K .......... .......... .......... .......... .......... 8% 45.3M 3s 2024-03-04T12:37:56.193 INFO:teuthology.orchestra.run.smithi110.stderr: 7850K .......... .......... .......... .......... .......... 8% 130M 3s 2024-03-04T12:37:56.193 INFO:teuthology.orchestra.run.smithi110.stderr: 7900K .......... .......... .......... .......... .......... 8% 89.7M 3s 2024-03-04T12:37:56.193 INFO:teuthology.orchestra.run.smithi110.stderr: 7950K .......... .......... .......... .......... .......... 8% 38.8M 3s 2024-03-04T12:37:56.193 INFO:teuthology.orchestra.run.smithi110.stderr: 8000K .......... .......... .......... .......... .......... 8% 64.6M 3s 2024-03-04T12:37:56.208 INFO:teuthology.orchestra.run.smithi110.stderr: 8050K .......... .......... .......... .......... .......... 8% 44.4M 3s 2024-03-04T12:37:56.208 INFO:teuthology.orchestra.run.smithi110.stderr: 8100K .......... .......... .......... .......... .......... 8% 72.5M 3s 2024-03-04T12:37:56.208 INFO:teuthology.orchestra.run.smithi110.stderr: 8150K .......... .......... .......... .......... .......... 8% 101M 3s 2024-03-04T12:37:56.208 INFO:teuthology.orchestra.run.smithi110.stderr: 8200K .......... .......... .......... .......... .......... 8% 68.4M 3s 2024-03-04T12:37:56.208 INFO:teuthology.orchestra.run.smithi110.stderr: 8250K .......... .......... .......... .......... .......... 8% 47.3M 3s 2024-03-04T12:37:56.208 INFO:teuthology.orchestra.run.smithi110.stderr: 8300K .......... .......... .......... .......... .......... 8% 93.0M 3s 2024-03-04T12:37:56.208 INFO:teuthology.orchestra.run.smithi110.stderr: 8350K .......... .......... .......... .......... .......... 9% 68.8M 3s 2024-03-04T12:37:56.208 INFO:teuthology.orchestra.run.smithi110.stderr: 8400K .......... .......... .......... .......... .......... 9% 64.2M 3s 2024-03-04T12:37:56.208 INFO:teuthology.orchestra.run.smithi110.stderr: 8450K .......... .......... .......... .......... .......... 9% 63.9M 3s 2024-03-04T12:37:56.208 INFO:teuthology.orchestra.run.smithi110.stderr: 8500K .......... .......... .......... .......... .......... 9% 83.9M 3s 2024-03-04T12:37:56.209 INFO:teuthology.orchestra.run.smithi110.stderr: 8550K .......... .......... .......... .......... .......... 9% 109M 3s 2024-03-04T12:37:56.209 INFO:teuthology.orchestra.run.smithi110.stderr: 8600K .......... .......... .......... .......... .......... 9% 84.5M 3s 2024-03-04T12:37:56.209 INFO:teuthology.orchestra.run.smithi110.stderr: 8650K .......... .......... .......... .......... .......... 9% 73.3M 3s 2024-03-04T12:37:56.209 INFO:teuthology.orchestra.run.smithi110.stderr: 8700K .......... .......... .......... .......... .......... 9% 74.6M 3s 2024-03-04T12:37:56.209 INFO:teuthology.orchestra.run.smithi110.stderr: 8750K .......... .......... .......... .......... .......... 9% 81.2M 3s 2024-03-04T12:37:56.209 INFO:teuthology.orchestra.run.smithi110.stderr: 8800K .......... .......... .......... .......... .......... 9% 122M 3s 2024-03-04T12:37:56.209 INFO:teuthology.orchestra.run.smithi110.stderr: 8850K .......... .......... .......... .......... .......... 9% 100M 3s 2024-03-04T12:37:56.209 INFO:teuthology.orchestra.run.smithi110.stderr: 8900K .......... .......... .......... .......... .......... 9% 19.9M 3s 2024-03-04T12:37:56.217 INFO:teuthology.orchestra.run.smithi110.stderr: 8950K .......... .......... .......... .......... .......... 9% 4.79M 3s 2024-03-04T12:37:56.253 INFO:teuthology.orchestra.run.smithi110.stderr: 9000K .......... .......... .......... .......... .......... 9% 149M 3s 2024-03-04T12:37:56.253 INFO:teuthology.orchestra.run.smithi110.stderr: 9050K .......... .......... .......... .......... .......... 9% 20.1M 3s 2024-03-04T12:37:56.253 INFO:teuthology.orchestra.run.smithi110.stderr: 9100K .......... .......... .......... .......... .......... 9% 115M 3s 2024-03-04T12:37:56.253 INFO:teuthology.orchestra.run.smithi110.stderr: 9150K .......... .......... .......... .......... .......... 9% 45.6M 3s 2024-03-04T12:37:56.254 INFO:teuthology.orchestra.run.smithi110.stderr: 9200K .......... .......... .......... .......... .......... 9% 45.7M 3s 2024-03-04T12:37:56.254 INFO:teuthology.orchestra.run.smithi110.stderr: 9250K .......... .......... .......... .......... .......... 10% 76.6M 3s 2024-03-04T12:37:56.254 INFO:teuthology.orchestra.run.smithi110.stderr: 9300K .......... .......... .......... .......... .......... 10% 68.3M 3s 2024-03-04T12:37:56.254 INFO:teuthology.orchestra.run.smithi110.stderr: 9350K .......... .......... .......... .......... .......... 10% 49.1M 3s 2024-03-04T12:37:56.254 INFO:teuthology.orchestra.run.smithi110.stderr: 9400K .......... .......... .......... .......... .......... 10% 29.7M 3s 2024-03-04T12:37:56.254 INFO:teuthology.orchestra.run.smithi110.stderr: 9450K .......... .......... .......... .......... .......... 10% 35.1M 3s 2024-03-04T12:37:56.254 INFO:teuthology.orchestra.run.smithi110.stderr: 9500K .......... .......... .......... .......... .......... 10% 115M 3s 2024-03-04T12:37:56.254 INFO:teuthology.orchestra.run.smithi110.stderr: 9550K .......... .......... .......... .......... .......... 10% 105M 3s 2024-03-04T12:37:56.254 INFO:teuthology.orchestra.run.smithi110.stderr: 9600K .......... .......... .......... .......... .......... 10% 57.0M 3s 2024-03-04T12:37:56.254 INFO:teuthology.orchestra.run.smithi110.stderr: 9650K .......... .......... .......... .......... .......... 10% 43.3M 3s 2024-03-04T12:37:56.255 INFO:teuthology.orchestra.run.smithi110.stderr: 9700K .......... .......... .......... .......... .......... 10% 48.4M 3s 2024-03-04T12:37:56.255 INFO:teuthology.orchestra.run.smithi110.stderr: 9750K .......... .......... .......... .......... .......... 10% 81.2M 3s 2024-03-04T12:37:56.255 INFO:teuthology.orchestra.run.smithi110.stderr: 9800K .......... .......... .......... .......... .......... 10% 90.4M 3s 2024-03-04T12:37:56.255 INFO:teuthology.orchestra.run.smithi110.stderr: 9850K .......... .......... .......... .......... .......... 10% 50.5M 3s 2024-03-04T12:37:56.255 INFO:teuthology.orchestra.run.smithi110.stderr: 9900K .......... .......... .......... .......... .......... 10% 89.5M 3s 2024-03-04T12:37:56.255 INFO:teuthology.orchestra.run.smithi110.stderr: 9950K .......... .......... .......... .......... .......... 10% 85.2M 3s 2024-03-04T12:37:56.255 INFO:teuthology.orchestra.run.smithi110.stderr: 10000K .......... .......... .......... .......... .......... 10% 107M 3s 2024-03-04T12:37:56.255 INFO:teuthology.orchestra.run.smithi110.stderr: 10050K .......... .......... .......... .......... .......... 10% 40.2M 3s 2024-03-04T12:37:56.255 INFO:teuthology.orchestra.run.smithi110.stderr: 10100K .......... .......... .......... .......... .......... 10% 70.6M 3s 2024-03-04T12:37:56.255 INFO:teuthology.orchestra.run.smithi110.stderr: 10150K .......... .......... .......... .......... .......... 10% 54.5M 3s 2024-03-04T12:37:56.255 INFO:teuthology.orchestra.run.smithi110.stderr: 10200K .......... .......... .......... .......... .......... 11% 91.4M 3s 2024-03-04T12:37:56.255 INFO:teuthology.orchestra.run.smithi110.stderr: 10250K .......... .......... .......... .......... .......... 11% 76.9M 3s 2024-03-04T12:37:56.255 INFO:teuthology.orchestra.run.smithi110.stderr: 10300K .......... .......... .......... .......... .......... 11% 84.9M 3s 2024-03-04T12:37:56.255 INFO:teuthology.orchestra.run.smithi110.stderr: 10350K .......... .......... .......... .......... .......... 11% 88.0M 3s 2024-03-04T12:37:56.256 INFO:teuthology.orchestra.run.smithi110.stderr: 10400K .......... .......... .......... .......... .......... 11% 42.1M 3s 2024-03-04T12:37:56.256 INFO:teuthology.orchestra.run.smithi110.stderr: 10450K .......... .......... .......... .......... .......... 11% 127M 3s 2024-03-04T12:37:56.256 INFO:teuthology.orchestra.run.smithi110.stderr: 10500K .......... .......... .......... .......... .......... 11% 83.5M 3s 2024-03-04T12:37:56.256 INFO:teuthology.orchestra.run.smithi110.stderr: 10550K .......... .......... .......... .......... .......... 11% 79.4M 3s 2024-03-04T12:37:56.256 INFO:teuthology.orchestra.run.smithi110.stderr: 10600K .......... .......... .......... .......... .......... 11% 82.5M 3s 2024-03-04T12:37:56.257 INFO:teuthology.orchestra.run.smithi110.stderr: 10650K .......... .......... .......... .......... .......... 11% 3.57M 3s 2024-03-04T12:37:56.257 INFO:teuthology.orchestra.run.smithi110.stderr: 10700K .......... .......... .......... .......... .......... 11% 149M 3s 2024-03-04T12:37:56.259 INFO:teuthology.orchestra.run.smithi110.stderr: 10750K .......... .......... .......... .......... .......... 11% 25.3M 3s 2024-03-04T12:37:56.261 INFO:teuthology.orchestra.run.smithi110.stderr: 10800K .......... .......... .......... .......... .......... 11% 56.5M 3s 2024-03-04T12:37:56.261 INFO:teuthology.orchestra.run.smithi110.stderr: 10850K .......... .......... .......... .......... .......... 11% 49.4M 3s 2024-03-04T12:37:56.265 INFO:teuthology.orchestra.run.smithi110.stderr: 10900K .......... .......... .......... .......... .......... 11% 50.8M 3s 2024-03-04T12:37:56.265 INFO:teuthology.orchestra.run.smithi110.stderr: 10950K .......... .......... .......... .......... .......... 11% 117M 3s 2024-03-04T12:37:56.265 INFO:teuthology.orchestra.run.smithi110.stderr: 11000K .......... .......... .......... .......... .......... 11% 60.2M 3s 2024-03-04T12:37:56.265 INFO:teuthology.orchestra.run.smithi110.stderr: 11050K .......... .......... .......... .......... .......... 11% 46.6M 3s 2024-03-04T12:37:56.266 INFO:teuthology.orchestra.run.smithi110.stderr: 11100K .......... .......... .......... .......... .......... 12% 23.7M 3s 2024-03-04T12:37:56.266 INFO:teuthology.orchestra.run.smithi110.stderr: 11150K .......... .......... .......... .......... .......... 12% 82.9M 3s 2024-03-04T12:37:56.269 INFO:teuthology.orchestra.run.smithi110.stderr: 11200K .......... .......... .......... .......... .......... 12% 37.1M 3s 2024-03-04T12:37:56.269 INFO:teuthology.orchestra.run.smithi110.stderr: 11250K .......... .......... .......... .......... .......... 12% 67.4M 3s 2024-03-04T12:37:56.286 INFO:teuthology.orchestra.run.smithi110.stderr: 11300K .......... .......... .......... .......... .......... 12% 38.3M 3s 2024-03-04T12:37:56.286 INFO:teuthology.orchestra.run.smithi110.stderr: 11350K .......... .......... .......... .......... .......... 12% 87.6M 3s 2024-03-04T12:37:56.286 INFO:teuthology.orchestra.run.smithi110.stderr: 11400K .......... .......... .......... .......... .......... 12% 109M 3s 2024-03-04T12:37:56.286 INFO:teuthology.orchestra.run.smithi110.stderr: 11450K .......... .......... .......... .......... .......... 12% 73.1M 3s 2024-03-04T12:37:56.286 INFO:teuthology.orchestra.run.smithi110.stderr: 11500K .......... .......... .......... .......... .......... 12% 72.6M 3s 2024-03-04T12:37:56.286 INFO:teuthology.orchestra.run.smithi110.stderr: 11550K .......... .......... .......... .......... .......... 12% 93.4M 3s 2024-03-04T12:37:56.287 INFO:teuthology.orchestra.run.smithi110.stderr: 11600K .......... .......... .......... .......... .......... 12% 137M 3s 2024-03-04T12:37:56.287 INFO:teuthology.orchestra.run.smithi110.stderr: 11650K .......... .......... .......... .......... .......... 12% 64.6M 3s 2024-03-04T12:37:56.287 INFO:teuthology.orchestra.run.smithi110.stderr: 11700K .......... .......... .......... .......... .......... 12% 76.8M 3s 2024-03-04T12:37:56.287 INFO:teuthology.orchestra.run.smithi110.stderr: 11750K .......... .......... .......... .......... .......... 12% 90.7M 3s 2024-03-04T12:37:56.287 INFO:teuthology.orchestra.run.smithi110.stderr: 11800K .......... .......... .......... .......... .......... 12% 82.6M 3s 2024-03-04T12:37:56.287 INFO:teuthology.orchestra.run.smithi110.stderr: 11850K .......... .......... .......... .......... .......... 12% 110M 3s 2024-03-04T12:37:56.287 INFO:teuthology.orchestra.run.smithi110.stderr: 11900K .......... .......... .......... .......... .......... 12% 71.9M 3s 2024-03-04T12:37:56.287 INFO:teuthology.orchestra.run.smithi110.stderr: 11950K .......... .......... .......... .......... .......... 12% 91.1M 2s 2024-03-04T12:37:56.287 INFO:teuthology.orchestra.run.smithi110.stderr: 12000K .......... .......... .......... .......... .......... 12% 65.2M 2s 2024-03-04T12:37:56.287 INFO:teuthology.orchestra.run.smithi110.stderr: 12050K .......... .......... .......... .......... .......... 13% 48.5M 2s 2024-03-04T12:37:56.287 INFO:teuthology.orchestra.run.smithi110.stderr: 12100K .......... .......... .......... .......... .......... 13% 124M 2s 2024-03-04T12:37:56.287 INFO:teuthology.orchestra.run.smithi110.stderr: 12150K .......... .......... .......... .......... .......... 13% 98.2M 2s 2024-03-04T12:37:56.287 INFO:teuthology.orchestra.run.smithi110.stderr: 12200K .......... .......... .......... .......... .......... 13% 82.4M 2s 2024-03-04T12:37:56.287 INFO:teuthology.orchestra.run.smithi110.stderr: 12250K .......... .......... .......... .......... .......... 13% 111M 2s 2024-03-04T12:37:56.287 INFO:teuthology.orchestra.run.smithi110.stderr: 12300K .......... .......... .......... .......... .......... 13% 94.8M 2s 2024-03-04T12:37:56.287 INFO:teuthology.orchestra.run.smithi110.stderr: 12350K .......... .......... .......... .......... .......... 13% 116M 2s 2024-03-04T12:37:56.288 INFO:teuthology.orchestra.run.smithi110.stderr: 12400K .......... .......... .......... .......... .......... 13% 109M 2s 2024-03-04T12:37:56.291 INFO:teuthology.orchestra.run.smithi110.stderr: 12450K .......... .......... .......... .......... .......... 13% 9.72M 2s 2024-03-04T12:37:56.291 INFO:teuthology.orchestra.run.smithi110.stderr: 12500K .......... .......... .......... .......... .......... 13% 30.9M 2s 2024-03-04T12:37:56.291 INFO:teuthology.orchestra.run.smithi110.stderr: 12550K .......... .......... .......... .......... .......... 13% 136M 2s 2024-03-04T12:37:56.291 INFO:teuthology.orchestra.run.smithi110.stderr: 12600K .......... .......... .......... .......... .......... 13% 47.1M 2s 2024-03-04T12:37:56.292 INFO:teuthology.orchestra.run.smithi110.stderr: 12650K .......... .......... .......... .......... .......... 13% 78.3M 2s 2024-03-04T12:37:56.294 INFO:teuthology.orchestra.run.smithi110.stderr: 12700K .......... .......... .......... .......... .......... 13% 42.7M 2s 2024-03-04T12:37:56.294 INFO:teuthology.orchestra.run.smithi110.stderr: 12750K .......... .......... .......... .......... .......... 13% 58.3M 2s 2024-03-04T12:37:56.295 INFO:teuthology.orchestra.run.smithi110.stderr: 12800K .......... .......... .......... .......... .......... 13% 43.8M 2s 2024-03-04T12:37:56.295 INFO:teuthology.orchestra.run.smithi110.stderr: 12850K .......... .......... .......... .......... .......... 13% 103M 2s 2024-03-04T12:37:56.297 INFO:teuthology.orchestra.run.smithi110.stderr: 12900K .......... .......... .......... .......... .......... 13% 45.8M 2s 2024-03-04T12:37:56.297 INFO:teuthology.orchestra.run.smithi110.stderr: 12950K .......... .......... .......... .......... .......... 13% 51.1M 2s 2024-03-04T12:37:56.299 INFO:teuthology.orchestra.run.smithi110.stderr: 13000K .......... .......... .......... .......... .......... 14% 52.6M 2s 2024-03-04T12:37:56.299 INFO:teuthology.orchestra.run.smithi110.stderr: 13050K .......... .......... .......... .......... .......... 14% 64.0M 2s 2024-03-04T12:37:56.299 INFO:teuthology.orchestra.run.smithi110.stderr: 13100K .......... .......... .......... .......... .......... 14% 80.8M 2s 2024-03-04T12:37:56.301 INFO:teuthology.orchestra.run.smithi110.stderr: 13150K .......... .......... .......... .......... .......... 14% 58.2M 2s 2024-03-04T12:37:56.301 INFO:teuthology.orchestra.run.smithi110.stderr: 13200K .......... .......... .......... .......... .......... 14% 42.9M 2s 2024-03-04T12:37:56.316 INFO:teuthology.orchestra.run.smithi110.stderr: 13250K .......... .......... .......... .......... .......... 14% 61.4M 2s 2024-03-04T12:37:56.316 INFO:teuthology.orchestra.run.smithi110.stderr: 13300K .......... .......... .......... .......... .......... 14% 112M 2s 2024-03-04T12:37:56.316 INFO:teuthology.orchestra.run.smithi110.stderr: 13350K .......... .......... .......... .......... .......... 14% 108M 2s 2024-03-04T12:37:56.316 INFO:teuthology.orchestra.run.smithi110.stderr: 13400K .......... .......... .......... .......... .......... 14% 101M 2s 2024-03-04T12:37:56.316 INFO:teuthology.orchestra.run.smithi110.stderr: 13450K .......... .......... .......... .......... .......... 14% 119M 2s 2024-03-04T12:37:56.317 INFO:teuthology.orchestra.run.smithi110.stderr: 13500K .......... .......... .......... .......... .......... 14% 117M 2s 2024-03-04T12:37:56.317 INFO:teuthology.orchestra.run.smithi110.stderr: 13550K .......... .......... .......... .......... .......... 14% 109M 2s 2024-03-04T12:37:56.317 INFO:teuthology.orchestra.run.smithi110.stderr: 13600K .......... .......... .......... .......... .......... 14% 82.1M 2s 2024-03-04T12:37:56.317 INFO:teuthology.orchestra.run.smithi110.stderr: 13650K .......... .......... .......... .......... .......... 14% 111M 2s 2024-03-04T12:37:56.317 INFO:teuthology.orchestra.run.smithi110.stderr: 13700K .......... .......... .......... .......... .......... 14% 112M 2s 2024-03-04T12:37:56.317 INFO:teuthology.orchestra.run.smithi110.stderr: 13750K .......... .......... .......... .......... .......... 14% 118M 2s 2024-03-04T12:37:56.317 INFO:teuthology.orchestra.run.smithi110.stderr: 13800K .......... .......... .......... .......... .......... 14% 80.6M 2s 2024-03-04T12:37:56.317 INFO:teuthology.orchestra.run.smithi110.stderr: 13850K .......... .......... .......... .......... .......... 14% 114M 2s 2024-03-04T12:37:56.317 INFO:teuthology.orchestra.run.smithi110.stderr: 13900K .......... .......... .......... .......... .......... 15% 109M 2s 2024-03-04T12:37:56.317 INFO:teuthology.orchestra.run.smithi110.stderr: 13950K .......... .......... .......... .......... .......... 15% 84.0M 2s 2024-03-04T12:37:56.317 INFO:teuthology.orchestra.run.smithi110.stderr: 14000K .......... .......... .......... .......... .......... 15% 111M 2s 2024-03-04T12:37:56.317 INFO:teuthology.orchestra.run.smithi110.stderr: 14050K .......... .......... .......... .......... .......... 15% 113M 2s 2024-03-04T12:37:56.317 INFO:teuthology.orchestra.run.smithi110.stderr: 14100K .......... .......... .......... .......... .......... 15% 69.4M 2s 2024-03-04T12:37:56.317 INFO:teuthology.orchestra.run.smithi110.stderr: 14150K .......... .......... .......... .......... .......... 15% 49.1M 2s 2024-03-04T12:37:56.317 INFO:teuthology.orchestra.run.smithi110.stderr: 14200K .......... .......... .......... .......... .......... 15% 105M 2s 2024-03-04T12:37:56.318 INFO:teuthology.orchestra.run.smithi110.stderr: 14250K .......... .......... .......... .......... .......... 15% 62.8M 2s 2024-03-04T12:37:56.318 INFO:teuthology.orchestra.run.smithi110.stderr: 14300K .......... .......... .......... .......... .......... 15% 20.3M 2s 2024-03-04T12:37:56.319 INFO:teuthology.orchestra.run.smithi110.stderr: 14350K .......... .......... .......... .......... .......... 15% 17.5M 2s 2024-03-04T12:37:56.320 INFO:teuthology.orchestra.run.smithi110.stderr: 14400K .......... .......... .......... .......... .......... 15% 17.7M 2s 2024-03-04T12:37:56.320 INFO:teuthology.orchestra.run.smithi110.stderr: 14450K .......... .......... .......... .......... .......... 15% 63.5M 2s 2024-03-04T12:37:56.323 INFO:teuthology.orchestra.run.smithi110.stderr: 14500K .......... .......... .......... .......... .......... 15% 20.0M 2s 2024-03-04T12:37:56.325 INFO:teuthology.orchestra.run.smithi110.stderr: 14550K .......... .......... .......... .......... .......... 15% 19.8M 2s 2024-03-04T12:37:56.329 INFO:teuthology.orchestra.run.smithi110.stderr: 14600K .......... .......... .......... .......... .......... 15% 19.0M 2s 2024-03-04T12:37:56.329 INFO:teuthology.orchestra.run.smithi110.stderr: 14650K .......... .......... .......... .......... .......... 15% 75.9M 2s 2024-03-04T12:37:56.331 INFO:teuthology.orchestra.run.smithi110.stderr: 14700K .......... .......... .......... .......... .......... 15% 19.5M 2s 2024-03-04T12:37:56.335 INFO:teuthology.orchestra.run.smithi110.stderr: 14750K .......... .......... .......... .......... .......... 15% 17.3M 2s 2024-03-04T12:37:56.335 INFO:teuthology.orchestra.run.smithi110.stderr: 14800K .......... .......... .......... .......... .......... 15% 100M 2s 2024-03-04T12:37:56.336 INFO:teuthology.orchestra.run.smithi110.stderr: 14850K .......... .......... .......... .......... .......... 16% 49.5M 2s 2024-03-04T12:37:56.336 INFO:teuthology.orchestra.run.smithi110.stderr: 14900K .......... .......... .......... .......... .......... 16% 113M 2s 2024-03-04T12:37:56.340 INFO:teuthology.orchestra.run.smithi110.stderr: 14950K .......... .......... .......... .......... .......... 16% 32.8M 2s 2024-03-04T12:37:56.340 INFO:teuthology.orchestra.run.smithi110.stderr: 15000K .......... .......... .......... .......... .......... 16% 102M 2s 2024-03-04T12:37:56.340 INFO:teuthology.orchestra.run.smithi110.stderr: 15050K .......... .......... .......... .......... .......... 16% 48.7M 2s 2024-03-04T12:37:56.341 INFO:teuthology.orchestra.run.smithi110.stderr: 15100K .......... .......... .......... .......... .......... 16% 115M 2s 2024-03-04T12:37:56.341 INFO:teuthology.orchestra.run.smithi110.stderr: 15150K .......... .......... .......... .......... .......... 16% 34.0M 2s 2024-03-04T12:37:56.343 INFO:teuthology.orchestra.run.smithi110.stderr: 15200K .......... .......... .......... .......... .......... 16% 21.3M 2s 2024-03-04T12:37:56.345 INFO:teuthology.orchestra.run.smithi110.stderr: 15250K .......... .......... .......... .......... .......... 16% 55.1M 2s 2024-03-04T12:37:56.345 INFO:teuthology.orchestra.run.smithi110.stderr: 15300K .......... .......... .......... .......... .......... 16% 76.9M 2s 2024-03-04T12:37:56.345 INFO:teuthology.orchestra.run.smithi110.stderr: 15350K .......... .......... .......... .......... .......... 16% 65.9M 2s 2024-03-04T12:37:56.346 INFO:teuthology.orchestra.run.smithi110.stderr: 15400K .......... .......... .......... .......... .......... 16% 59.3M 2s 2024-03-04T12:37:57.631 INFO:teuthology.orchestra.run.smithi110.stderr: 15450K .......... .......... .......... .......... .......... 16% 39.6M 2s 2024-03-04T12:37:57.631 INFO:teuthology.orchestra.run.smithi110.stderr: 15500K .......... .......... .......... .......... .......... 16% 73.1M 2s 2024-03-04T12:37:57.631 INFO:teuthology.orchestra.run.smithi110.stderr: 15550K .......... .......... .......... .......... .......... 16% 49.1M 2s 2024-03-04T12:37:57.631 INFO:teuthology.orchestra.run.smithi110.stderr: 15600K .......... .......... .......... .......... .......... 16% 112M 2s 2024-03-04T12:37:57.631 INFO:teuthology.orchestra.run.smithi110.stderr: 15650K .......... .......... .......... .......... .......... 16% 47.9M 2s 2024-03-04T12:37:57.631 INFO:teuthology.orchestra.run.smithi110.stderr: 15700K .......... .......... .......... .......... .......... 16% 104M 2s 2024-03-04T12:37:57.631 INFO:teuthology.orchestra.run.smithi110.stderr: 15750K .......... .......... .......... .......... .......... 17% 46.0M 2s 2024-03-04T12:37:57.631 INFO:teuthology.orchestra.run.smithi110.stderr: 15800K .......... .......... .......... .......... .......... 17% 111M 2s 2024-03-04T12:37:57.631 INFO:teuthology.orchestra.run.smithi110.stderr: 15850K .......... .......... .......... .......... .......... 17% 93.6M 2s 2024-03-04T12:37:57.631 INFO:teuthology.orchestra.run.smithi110.stderr: 15900K .......... .......... .......... .......... .......... 17% 68.6M 2s 2024-03-04T12:37:57.632 INFO:teuthology.orchestra.run.smithi110.stderr: 15950K .......... .......... .......... .......... .......... 17% 103M 2s 2024-03-04T12:37:57.632 INFO:teuthology.orchestra.run.smithi110.stderr: 16000K .......... .......... .......... .......... .......... 17% 99.4M 2s 2024-03-04T12:37:57.632 INFO:teuthology.orchestra.run.smithi110.stderr: 16050K .......... .......... .......... .......... .......... 17% 113M 2s 2024-03-04T12:37:57.632 INFO:teuthology.orchestra.run.smithi110.stderr: 16100K .......... .......... .......... .......... .......... 17% 97.2M 2s 2024-03-04T12:37:57.632 INFO:teuthology.orchestra.run.smithi110.stderr: 16150K .......... .......... .......... .......... .......... 17% 108M 2s 2024-03-04T12:37:57.632 INFO:teuthology.orchestra.run.smithi110.stderr: 16200K .......... .......... .......... .......... .......... 17% 88.1M 2s 2024-03-04T12:37:57.632 INFO:teuthology.orchestra.run.smithi110.stderr: 16250K .......... .......... .......... .......... .......... 17% 78.9M 2s 2024-03-04T12:37:57.632 INFO:teuthology.orchestra.run.smithi110.stderr: 16300K .......... .......... .......... .......... .......... 17% 120M 2s 2024-03-04T12:37:57.632 INFO:teuthology.orchestra.run.smithi110.stderr: 16350K .......... .......... .......... .......... .......... 17% 71.5M 2s 2024-03-04T12:37:57.632 INFO:teuthology.orchestra.run.smithi110.stderr: 16400K .......... .......... .......... .......... .......... 17% 33.1M 2s 2024-03-04T12:37:57.632 INFO:teuthology.orchestra.run.smithi110.stderr: 16450K .......... .......... .......... .......... .......... 17% 80.4M 2s 2024-03-04T12:37:57.632 INFO:teuthology.orchestra.run.smithi110.stderr: 16500K .......... .......... .......... .......... .......... 17% 116M 2s 2024-03-04T12:37:57.632 INFO:teuthology.orchestra.run.smithi110.stderr: 16550K .......... .......... .......... .......... .......... 17% 74.4M 2s 2024-03-04T12:37:57.633 INFO:teuthology.orchestra.run.smithi110.stderr: 16600K .......... .......... .......... .......... .......... 17% 65.0M 2s 2024-03-04T12:37:57.633 INFO:teuthology.orchestra.run.smithi110.stderr: 16650K .......... .......... .......... .......... .......... 17% 49.0M 2s 2024-03-04T12:37:57.633 INFO:teuthology.orchestra.run.smithi110.stderr: 16700K .......... .......... .......... .......... .......... 18% 40.2M 2s 2024-03-04T12:37:57.633 INFO:teuthology.orchestra.run.smithi110.stderr: 16750K .......... .......... .......... .......... .......... 18% 70.5M 2s 2024-03-04T12:37:57.633 INFO:teuthology.orchestra.run.smithi110.stderr: 16800K .......... .......... .......... .......... .......... 18% 86.0M 2s 2024-03-04T12:37:57.633 INFO:teuthology.orchestra.run.smithi110.stderr: 16850K .......... .......... .......... .......... .......... 18% 74.0M 2s 2024-03-04T12:37:57.633 INFO:teuthology.orchestra.run.smithi110.stderr: 16900K .......... .......... .......... .......... .......... 18% 51.3M 2s 2024-03-04T12:37:57.633 INFO:teuthology.orchestra.run.smithi110.stderr: 16950K .......... .......... .......... .......... .......... 18% 114M 2s 2024-03-04T12:37:57.633 INFO:teuthology.orchestra.run.smithi110.stderr: 17000K .......... .......... .......... .......... .......... 18% 42.3M 2s 2024-03-04T12:37:57.633 INFO:teuthology.orchestra.run.smithi110.stderr: 17050K .......... .......... .......... .......... .......... 18% 94.8M 2s 2024-03-04T12:37:57.633 INFO:teuthology.orchestra.run.smithi110.stderr: 17100K .......... .......... .......... .......... .......... 18% 93.4M 2s 2024-03-04T12:37:57.633 INFO:teuthology.orchestra.run.smithi110.stderr: 17150K .......... .......... .......... .......... .......... 18% 90.0M 2s 2024-03-04T12:37:57.633 INFO:teuthology.orchestra.run.smithi110.stderr: 17200K .......... .......... .......... .......... .......... 18% 116M 2s 2024-03-04T12:37:57.633 INFO:teuthology.orchestra.run.smithi110.stderr: 17250K .......... .......... .......... .......... .......... 18% 55.9M 2s 2024-03-04T12:37:57.634 INFO:teuthology.orchestra.run.smithi110.stderr: 17300K .......... .......... .......... .......... .......... 18% 92.2M 2s 2024-03-04T12:37:57.634 INFO:teuthology.orchestra.run.smithi110.stderr: 17350K .......... .......... .......... .......... .......... 18% 75.9M 2s 2024-03-04T12:37:57.634 INFO:teuthology.orchestra.run.smithi110.stderr: 17400K .......... .......... .......... .......... .......... 18% 90.9M 2s 2024-03-04T12:37:57.634 INFO:teuthology.orchestra.run.smithi110.stderr: 17450K .......... .......... .......... .......... .......... 18% 75.4M 2s 2024-03-04T12:37:57.634 INFO:teuthology.orchestra.run.smithi110.stderr: 17500K .......... .......... .......... .......... .......... 18% 67.0M 2s 2024-03-04T12:37:57.634 INFO:teuthology.orchestra.run.smithi110.stderr: 17550K .......... .......... .......... .......... .......... 18% 75.3M 2s 2024-03-04T12:37:57.634 INFO:teuthology.orchestra.run.smithi110.stderr: 17600K .......... .......... .......... .......... .......... 18% 73.5M 2s 2024-03-04T12:37:57.634 INFO:teuthology.orchestra.run.smithi110.stderr: 17650K .......... .......... .......... .......... .......... 19% 77.3M 2s 2024-03-04T12:37:57.634 INFO:teuthology.orchestra.run.smithi110.stderr: 17700K .......... .......... .......... .......... .......... 19% 111M 2s 2024-03-04T12:37:57.634 INFO:teuthology.orchestra.run.smithi110.stderr: 17750K .......... .......... .......... .......... .......... 19% 61.0M 2s 2024-03-04T12:37:57.634 INFO:teuthology.orchestra.run.smithi110.stderr: 17800K .......... .......... .......... .......... .......... 19% 54.1M 2s 2024-03-04T12:37:57.634 INFO:teuthology.orchestra.run.smithi110.stderr: 17850K .......... .......... .......... .......... .......... 19% 91.7M 2s 2024-03-04T12:37:57.634 INFO:teuthology.orchestra.run.smithi110.stderr: 17900K .......... .......... .......... .......... .......... 19% 73.3M 2s 2024-03-04T12:37:57.634 INFO:teuthology.orchestra.run.smithi110.stderr: 17950K .......... .......... .......... .......... .......... 19% 103M 2s 2024-03-04T12:37:57.634 INFO:teuthology.orchestra.run.smithi110.stderr: 18000K .......... .......... .......... .......... .......... 19% 66.8M 2s 2024-03-04T12:37:57.635 INFO:teuthology.orchestra.run.smithi110.stderr: 18050K .......... .......... .......... .......... .......... 19% 65.9M 2s 2024-03-04T12:37:57.635 INFO:teuthology.orchestra.run.smithi110.stderr: 18100K .......... .......... .......... .......... .......... 19% 35.2M 2s 2024-03-04T12:37:57.635 INFO:teuthology.orchestra.run.smithi110.stderr: 18150K .......... .......... .......... .......... .......... 19% 121M 2s 2024-03-04T12:37:57.635 INFO:teuthology.orchestra.run.smithi110.stderr: 18200K .......... .......... .......... .......... .......... 19% 67.0M 2s 2024-03-04T12:37:57.635 INFO:teuthology.orchestra.run.smithi110.stderr: 18250K .......... .......... .......... .......... .......... 19% 66.9M 2s 2024-03-04T12:37:57.635 INFO:teuthology.orchestra.run.smithi110.stderr: 18300K .......... .......... .......... .......... .......... 19% 47.8M 2s 2024-03-04T12:37:57.635 INFO:teuthology.orchestra.run.smithi110.stderr: 18350K .......... .......... .......... .......... .......... 19% 56.0M 2s 2024-03-04T12:37:57.635 INFO:teuthology.orchestra.run.smithi110.stderr: 18400K .......... .......... .......... .......... .......... 19% 104M 2s 2024-03-04T12:37:57.635 INFO:teuthology.orchestra.run.smithi110.stderr: 18450K .......... .......... .......... .......... .......... 19% 62.0M 2s 2024-03-04T12:37:57.635 INFO:teuthology.orchestra.run.smithi110.stderr: 18500K .......... .......... .......... .......... .......... 19% 69.4M 2s 2024-03-04T12:37:57.635 INFO:teuthology.orchestra.run.smithi110.stderr: 18550K .......... .......... .......... .......... .......... 20% 53.1M 2s 2024-03-04T12:37:57.635 INFO:teuthology.orchestra.run.smithi110.stderr: 18600K .......... .......... .......... .......... .......... 20% 113M 2s 2024-03-04T12:37:57.635 INFO:teuthology.orchestra.run.smithi110.stderr: 18650K .......... .......... .......... .......... .......... 20% 68.8M 2s 2024-03-04T12:37:57.636 INFO:teuthology.orchestra.run.smithi110.stderr: 18700K .......... .......... .......... .......... .......... 20% 57.9M 2s 2024-03-04T12:37:57.636 INFO:teuthology.orchestra.run.smithi110.stderr: 18750K .......... .......... .......... .......... .......... 20% 69.0M 2s 2024-03-04T12:37:57.636 INFO:teuthology.orchestra.run.smithi110.stderr: 18800K .......... .......... .......... .......... .......... 20% 60.9M 2s 2024-03-04T12:37:57.636 INFO:teuthology.orchestra.run.smithi110.stderr: 18850K .......... .......... .......... .......... .......... 20% 111M 2s 2024-03-04T12:37:57.636 INFO:teuthology.orchestra.run.smithi110.stderr: 18900K .......... .......... .......... .......... .......... 20% 64.0M 2s 2024-03-04T12:37:57.636 INFO:teuthology.orchestra.run.smithi110.stderr: 18950K .......... .......... .......... .......... .......... 20% 68.7M 2s 2024-03-04T12:37:57.636 INFO:teuthology.orchestra.run.smithi110.stderr: 19000K .......... .......... .......... .......... .......... 20% 72.0M 2s 2024-03-04T12:37:57.636 INFO:teuthology.orchestra.run.smithi110.stderr: 19050K .......... .......... .......... .......... .......... 20% 58.4M 2s 2024-03-04T12:37:57.636 INFO:teuthology.orchestra.run.smithi110.stderr: 19100K .......... .......... .......... .......... .......... 20% 127M 2s 2024-03-04T12:37:57.636 INFO:teuthology.orchestra.run.smithi110.stderr: 19150K .......... .......... .......... .......... .......... 20% 99.1M 2s 2024-03-04T12:37:57.636 INFO:teuthology.orchestra.run.smithi110.stderr: 19200K .......... .......... .......... .......... .......... 20% 55.6M 2s 2024-03-04T12:37:57.636 INFO:teuthology.orchestra.run.smithi110.stderr: 19250K .......... .......... .......... .......... .......... 20% 71.5M 2s 2024-03-04T12:37:57.636 INFO:teuthology.orchestra.run.smithi110.stderr: 19300K .......... .......... .......... .......... .......... 20% 51.9M 2s 2024-03-04T12:37:57.636 INFO:teuthology.orchestra.run.smithi110.stderr: 19350K .......... .......... .......... .......... .......... 20% 105M 2s 2024-03-04T12:37:57.636 INFO:teuthology.orchestra.run.smithi110.stderr: 19400K .......... .......... .......... .......... .......... 20% 63.6M 2s 2024-03-04T12:37:57.637 INFO:teuthology.orchestra.run.smithi110.stderr: 19450K .......... .......... .......... .......... .......... 20% 111M 2s 2024-03-04T12:37:57.637 INFO:teuthology.orchestra.run.smithi110.stderr: 19500K .......... .......... .......... .......... .......... 21% 67.6M 2s 2024-03-04T12:37:57.637 INFO:teuthology.orchestra.run.smithi110.stderr: 19550K .......... .......... .......... .......... .......... 21% 120M 2s 2024-03-04T12:37:57.637 INFO:teuthology.orchestra.run.smithi110.stderr: 19600K .......... .......... .......... .......... .......... 21% 64.0M 2s 2024-03-04T12:37:57.637 INFO:teuthology.orchestra.run.smithi110.stderr: 19650K .......... .......... .......... .......... .......... 21% 62.2M 2s 2024-03-04T12:37:57.637 INFO:teuthology.orchestra.run.smithi110.stderr: 19700K .......... .......... .......... .......... .......... 21% 82.3M 2s 2024-03-04T12:37:57.637 INFO:teuthology.orchestra.run.smithi110.stderr: 19750K .......... .......... .......... .......... .......... 21% 65.7M 2s 2024-03-04T12:37:57.637 INFO:teuthology.orchestra.run.smithi110.stderr: 19800K .......... .......... .......... .......... .......... 21% 116M 2s 2024-03-04T12:37:57.637 INFO:teuthology.orchestra.run.smithi110.stderr: 19850K .......... .......... .......... .......... .......... 21% 99.3M 2s 2024-03-04T12:37:57.637 INFO:teuthology.orchestra.run.smithi110.stderr: 19900K .......... .......... .......... .......... .......... 21% 60.9M 2s 2024-03-04T12:37:57.637 INFO:teuthology.orchestra.run.smithi110.stderr: 19950K .......... .......... .......... .......... .......... 21% 78.7M 2s 2024-03-04T12:37:57.637 INFO:teuthology.orchestra.run.smithi110.stderr: 20000K .......... .......... .......... .......... .......... 21% 62.8M 2s 2024-03-04T12:37:57.637 INFO:teuthology.orchestra.run.smithi110.stderr: 20050K .......... .......... .......... .......... .......... 21% 120M 2s 2024-03-04T12:37:57.637 INFO:teuthology.orchestra.run.smithi110.stderr: 20100K .......... .......... .......... .......... .......... 21% 55.1M 2s 2024-03-04T12:37:57.637 INFO:teuthology.orchestra.run.smithi110.stderr: 20150K .......... .......... .......... .......... .......... 21% 82.6M 2s 2024-03-04T12:37:57.637 INFO:teuthology.orchestra.run.smithi110.stderr: 20200K .......... .......... .......... .......... .......... 21% 58.1M 2s 2024-03-04T12:37:57.638 INFO:teuthology.orchestra.run.smithi110.stderr: 20250K .......... .......... .......... .......... .......... 21% 116M 2s 2024-03-04T12:37:57.638 INFO:teuthology.orchestra.run.smithi110.stderr: 20300K .......... .......... .......... .......... .......... 21% 65.7M 2s 2024-03-04T12:37:57.638 INFO:teuthology.orchestra.run.smithi110.stderr: 20350K .......... .......... .......... .......... .......... 21% 78.0M 2s 2024-03-04T12:37:57.638 INFO:teuthology.orchestra.run.smithi110.stderr: 20400K .......... .......... .......... .......... .......... 22% 71.2M 2s 2024-03-04T12:37:57.638 INFO:teuthology.orchestra.run.smithi110.stderr: 20450K .......... .......... .......... .......... .......... 22% 74.9M 2s 2024-03-04T12:37:57.638 INFO:teuthology.orchestra.run.smithi110.stderr: 20500K .......... .......... .......... .......... .......... 22% 114M 2s 2024-03-04T12:37:57.638 INFO:teuthology.orchestra.run.smithi110.stderr: 20550K .......... .......... .......... .......... .......... 22% 65.3M 2s 2024-03-04T12:37:57.638 INFO:teuthology.orchestra.run.smithi110.stderr: 20600K .......... .......... .......... .......... .......... 22% 73.5M 2s 2024-03-04T12:37:57.638 INFO:teuthology.orchestra.run.smithi110.stderr: 20650K .......... .......... .......... .......... .......... 22% 88.6M 2s 2024-03-04T12:37:57.638 INFO:teuthology.orchestra.run.smithi110.stderr: 20700K .......... .......... .......... .......... .......... 22% 104M 2s 2024-03-04T12:37:57.638 INFO:teuthology.orchestra.run.smithi110.stderr: 20750K .......... .......... .......... .......... .......... 22% 41.1M 2s 2024-03-04T12:37:57.638 INFO:teuthology.orchestra.run.smithi110.stderr: 20800K .......... .......... .......... .......... .......... 22% 93.4M 2s 2024-03-04T12:37:57.638 INFO:teuthology.orchestra.run.smithi110.stderr: 20850K .......... .......... .......... .......... .......... 22% 57.7M 2s 2024-03-04T12:37:57.639 INFO:teuthology.orchestra.run.smithi110.stderr: 20900K .......... .......... .......... .......... .......... 22% 110M 2s 2024-03-04T12:37:57.639 INFO:teuthology.orchestra.run.smithi110.stderr: 20950K .......... .......... .......... .......... .......... 22% 100M 2s 2024-03-04T12:37:57.639 INFO:teuthology.orchestra.run.smithi110.stderr: 21000K .......... .......... .......... .......... .......... 22% 46.8M 2s 2024-03-04T12:37:57.639 INFO:teuthology.orchestra.run.smithi110.stderr: 21050K .......... .......... .......... .......... .......... 22% 71.1M 2s 2024-03-04T12:37:57.639 INFO:teuthology.orchestra.run.smithi110.stderr: 21100K .......... .......... .......... .......... .......... 22% 83.9M 2s 2024-03-04T12:37:57.639 INFO:teuthology.orchestra.run.smithi110.stderr: 21150K .......... .......... .......... .......... .......... 22% 64.3M 2s 2024-03-04T12:37:57.639 INFO:teuthology.orchestra.run.smithi110.stderr: 21200K .......... .......... .......... .......... .......... 22% 113M 2s 2024-03-04T12:37:57.639 INFO:teuthology.orchestra.run.smithi110.stderr: 21250K .......... .......... .......... .......... .......... 22% 64.1M 2s 2024-03-04T12:37:57.639 INFO:teuthology.orchestra.run.smithi110.stderr: 21300K .......... .......... .......... .......... .......... 22% 72.8M 2s 2024-03-04T12:37:57.639 INFO:teuthology.orchestra.run.smithi110.stderr: 21350K .......... .......... .......... .......... .......... 23% 113M 2s 2024-03-04T12:37:57.639 INFO:teuthology.orchestra.run.smithi110.stderr: 21400K .......... .......... .......... .......... .......... 23% 120M 2s 2024-03-04T12:37:57.639 INFO:teuthology.orchestra.run.smithi110.stderr: 21450K .......... .......... .......... .......... .......... 23% 66.2M 2s 2024-03-04T12:37:57.639 INFO:teuthology.orchestra.run.smithi110.stderr: 21500K .......... .......... .......... .......... .......... 23% 83.4M 2s 2024-03-04T12:37:57.639 INFO:teuthology.orchestra.run.smithi110.stderr: 21550K .......... .......... .......... .......... .......... 23% 75.5M 2s 2024-03-04T12:37:57.640 INFO:teuthology.orchestra.run.smithi110.stderr: 21600K .......... .......... .......... .......... .......... 23% 86.3M 2s 2024-03-04T12:37:57.640 INFO:teuthology.orchestra.run.smithi110.stderr: 21650K .......... .......... .......... .......... .......... 23% 112M 2s 2024-03-04T12:37:57.640 INFO:teuthology.orchestra.run.smithi110.stderr: 21700K .......... .......... .......... .......... .......... 23% 103M 2s 2024-03-04T12:37:57.640 INFO:teuthology.orchestra.run.smithi110.stderr: 21750K .......... .......... .......... .......... .......... 23% 94.3M 2s 2024-03-04T12:37:57.640 INFO:teuthology.orchestra.run.smithi110.stderr: 21800K .......... .......... .......... .......... .......... 23% 115M 2s 2024-03-04T12:37:57.640 INFO:teuthology.orchestra.run.smithi110.stderr: 21850K .......... .......... .......... .......... .......... 23% 77.0M 2s 2024-03-04T12:37:57.640 INFO:teuthology.orchestra.run.smithi110.stderr: 21900K .......... .......... .......... .......... .......... 23% 111M 2s 2024-03-04T12:37:57.640 INFO:teuthology.orchestra.run.smithi110.stderr: 21950K .......... .......... .......... .......... .......... 23% 99.3M 2s 2024-03-04T12:37:57.640 INFO:teuthology.orchestra.run.smithi110.stderr: 22000K .......... .......... .......... .......... .......... 23% 101M 2s 2024-03-04T12:37:57.640 INFO:teuthology.orchestra.run.smithi110.stderr: 22050K .......... .......... .......... .......... .......... 23% 84.9M 2s 2024-03-04T12:37:57.640 INFO:teuthology.orchestra.run.smithi110.stderr: 22100K .......... .......... .......... .......... .......... 23% 144M 2s 2024-03-04T12:37:57.640 INFO:teuthology.orchestra.run.smithi110.stderr: 22150K .......... .......... .......... .......... .......... 23% 87.7M 2s 2024-03-04T12:37:57.640 INFO:teuthology.orchestra.run.smithi110.stderr: 22200K .......... .......... .......... .......... .......... 23% 104M 2s 2024-03-04T12:37:57.640 INFO:teuthology.orchestra.run.smithi110.stderr: 22250K .......... .......... .......... .......... .......... 24% 76.1M 2s 2024-03-04T12:37:57.640 INFO:teuthology.orchestra.run.smithi110.stderr: 22300K .......... .......... .......... .......... .......... 24% 94.9M 2s 2024-03-04T12:37:57.641 INFO:teuthology.orchestra.run.smithi110.stderr: 22350K .......... .......... .......... .......... .......... 24% 88.9M 2s 2024-03-04T12:37:57.641 INFO:teuthology.orchestra.run.smithi110.stderr: 22400K .......... .......... .......... .......... .......... 24% 113M 2s 2024-03-04T12:37:57.641 INFO:teuthology.orchestra.run.smithi110.stderr: 22450K .......... .......... .......... .......... .......... 24% 111M 2s 2024-03-04T12:37:57.641 INFO:teuthology.orchestra.run.smithi110.stderr: 22500K .......... .......... .......... .......... .......... 24% 88.9M 2s 2024-03-04T12:37:57.641 INFO:teuthology.orchestra.run.smithi110.stderr: 22550K .......... .......... .......... .......... .......... 24% 111M 2s 2024-03-04T12:37:57.641 INFO:teuthology.orchestra.run.smithi110.stderr: 22600K .......... .......... .......... .......... .......... 24% 102M 2s 2024-03-04T12:37:57.641 INFO:teuthology.orchestra.run.smithi110.stderr: 22650K .......... .......... .......... .......... .......... 24% 80.0M 2s 2024-03-04T12:37:57.641 INFO:teuthology.orchestra.run.smithi110.stderr: 22700K .......... .......... .......... .......... .......... 24% 101M 2s 2024-03-04T12:37:57.641 INFO:teuthology.orchestra.run.smithi110.stderr: 22750K .......... .......... .......... .......... .......... 24% 88.8M 2s 2024-03-04T12:37:57.641 INFO:teuthology.orchestra.run.smithi110.stderr: 22800K .......... .......... .......... .......... .......... 24% 109M 2s 2024-03-04T12:37:57.641 INFO:teuthology.orchestra.run.smithi110.stderr: 22850K .......... .......... .......... .......... .......... 24% 116M 2s 2024-03-04T12:37:57.641 INFO:teuthology.orchestra.run.smithi110.stderr: 22900K .......... .......... .......... .......... .......... 24% 81.8M 2s 2024-03-04T12:37:57.641 INFO:teuthology.orchestra.run.smithi110.stderr: 22950K .......... .......... .......... .......... .......... 24% 96.8M 2s 2024-03-04T12:37:57.641 INFO:teuthology.orchestra.run.smithi110.stderr: 23000K .......... .......... .......... .......... .......... 24% 61.1M 2s 2024-03-04T12:37:57.641 INFO:teuthology.orchestra.run.smithi110.stderr: 23050K .......... .......... .......... .......... .......... 24% 85.2M 2s 2024-03-04T12:37:57.642 INFO:teuthology.orchestra.run.smithi110.stderr: 23100K .......... .......... .......... .......... .......... 24% 115M 2s 2024-03-04T12:37:57.642 INFO:teuthology.orchestra.run.smithi110.stderr: 23150K .......... .......... .......... .......... .......... 24% 96.4M 2s 2024-03-04T12:37:57.642 INFO:teuthology.orchestra.run.smithi110.stderr: 23200K .......... .......... .......... .......... .......... 25% 93.4M 2s 2024-03-04T12:37:57.642 INFO:teuthology.orchestra.run.smithi110.stderr: 23250K .......... .......... .......... .......... .......... 25% 85.5M 2s 2024-03-04T12:37:57.642 INFO:teuthology.orchestra.run.smithi110.stderr: 23300K .......... .......... .......... .......... .......... 25% 113M 2s 2024-03-04T12:37:57.642 INFO:teuthology.orchestra.run.smithi110.stderr: 23350K .......... .......... .......... .......... .......... 25% 55.1M 2s 2024-03-04T12:37:57.642 INFO:teuthology.orchestra.run.smithi110.stderr: 23400K .......... .......... .......... .......... .......... 25% 58.6M 2s 2024-03-04T12:37:57.642 INFO:teuthology.orchestra.run.smithi110.stderr: 23450K .......... .......... .......... .......... .......... 25% 46.3M 2s 2024-03-04T12:37:57.642 INFO:teuthology.orchestra.run.smithi110.stderr: 23500K .......... .......... .......... .......... .......... 25% 95.3M 2s 2024-03-04T12:37:57.642 INFO:teuthology.orchestra.run.smithi110.stderr: 23550K .......... .......... .......... .......... .......... 25% 118M 2s 2024-03-04T12:37:57.642 INFO:teuthology.orchestra.run.smithi110.stderr: 23600K .......... .......... .......... .......... .......... 25% 76.2M 2s 2024-03-04T12:37:57.642 INFO:teuthology.orchestra.run.smithi110.stderr: 23650K .......... .......... .......... .......... .......... 25% 93.7M 2s 2024-03-04T12:37:57.642 INFO:teuthology.orchestra.run.smithi110.stderr: 23700K .......... .......... .......... .......... .......... 25% 92.8M 2s 2024-03-04T12:37:57.642 INFO:teuthology.orchestra.run.smithi110.stderr: 23750K .......... .......... .......... .......... .......... 25% 120M 2s 2024-03-04T12:37:57.642 INFO:teuthology.orchestra.run.smithi110.stderr: 23800K .......... .......... .......... .......... .......... 25% 90.0M 2s 2024-03-04T12:37:57.643 INFO:teuthology.orchestra.run.smithi110.stderr: 23850K .......... .......... .......... .......... .......... 25% 102M 2s 2024-03-04T12:37:57.643 INFO:teuthology.orchestra.run.smithi110.stderr: 23900K .......... .......... .......... .......... .......... 25% 106M 2s 2024-03-04T12:37:57.643 INFO:teuthology.orchestra.run.smithi110.stderr: 23950K .......... .......... .......... .......... .......... 25% 93.4M 2s 2024-03-04T12:37:57.643 INFO:teuthology.orchestra.run.smithi110.stderr: 24000K .......... .......... .......... .......... .......... 25% 127M 2s 2024-03-04T12:37:57.643 INFO:teuthology.orchestra.run.smithi110.stderr: 24050K .......... .......... .......... .......... .......... 25% 105M 2s 2024-03-04T12:37:57.643 INFO:teuthology.orchestra.run.smithi110.stderr: 24100K .......... .......... .......... .......... .......... 25% 99.3M 2s 2024-03-04T12:37:57.643 INFO:teuthology.orchestra.run.smithi110.stderr: 24150K .......... .......... .......... .......... .......... 26% 99.0M 2s 2024-03-04T12:37:57.643 INFO:teuthology.orchestra.run.smithi110.stderr: 24200K .......... .......... .......... .......... .......... 26% 86.1M 2s 2024-03-04T12:37:57.643 INFO:teuthology.orchestra.run.smithi110.stderr: 24250K .......... .......... .......... .......... .......... 26% 121M 2s 2024-03-04T12:37:57.643 INFO:teuthology.orchestra.run.smithi110.stderr: 24300K .......... .......... .......... .......... .......... 26% 81.8M 2s 2024-03-04T12:37:57.643 INFO:teuthology.orchestra.run.smithi110.stderr: 24350K .......... .......... .......... .......... .......... 26% 99.1M 2s 2024-03-04T12:37:57.643 INFO:teuthology.orchestra.run.smithi110.stderr: 24400K .......... .......... .......... .......... .......... 26% 110M 2s 2024-03-04T12:37:57.643 INFO:teuthology.orchestra.run.smithi110.stderr: 24450K .......... .......... .......... .......... .......... 26% 103M 2s 2024-03-04T12:37:57.643 INFO:teuthology.orchestra.run.smithi110.stderr: 24500K .......... .......... .......... .......... .......... 26% 104M 2s 2024-03-04T12:37:57.644 INFO:teuthology.orchestra.run.smithi110.stderr: 24550K .......... .......... .......... .......... .......... 26% 118M 2s 2024-03-04T12:37:57.644 INFO:teuthology.orchestra.run.smithi110.stderr: 24600K .......... .......... .......... .......... .......... 26% 86.5M 2s 2024-03-04T12:37:57.644 INFO:teuthology.orchestra.run.smithi110.stderr: 24650K .......... .......... .......... .......... .......... 26% 98.2M 2s 2024-03-04T12:37:57.644 INFO:teuthology.orchestra.run.smithi110.stderr: 24700K .......... .......... .......... .......... .......... 26% 119M 2s 2024-03-04T12:37:57.644 INFO:teuthology.orchestra.run.smithi110.stderr: 24750K .......... .......... .......... .......... .......... 26% 91.3M 2s 2024-03-04T12:37:57.644 INFO:teuthology.orchestra.run.smithi110.stderr: 24800K .......... .......... .......... .......... .......... 26% 109M 2s 2024-03-04T12:37:57.644 INFO:teuthology.orchestra.run.smithi110.stderr: 24850K .......... .......... .......... .......... .......... 26% 94.2M 2s 2024-03-04T12:37:57.644 INFO:teuthology.orchestra.run.smithi110.stderr: 24900K .......... .......... .......... .......... .......... 26% 142M 2s 2024-03-04T12:37:57.644 INFO:teuthology.orchestra.run.smithi110.stderr: 24950K .......... .......... .......... .......... .......... 26% 113M 2s 2024-03-04T12:37:57.644 INFO:teuthology.orchestra.run.smithi110.stderr: 25000K .......... .......... .......... .......... .......... 26% 76.9M 2s 2024-03-04T12:37:57.644 INFO:teuthology.orchestra.run.smithi110.stderr: 25050K .......... .......... .......... .......... .......... 27% 101M 2s 2024-03-04T12:37:57.644 INFO:teuthology.orchestra.run.smithi110.stderr: 25100K .......... .......... .......... .......... .......... 27% 113M 2s 2024-03-04T12:37:57.644 INFO:teuthology.orchestra.run.smithi110.stderr: 25150K .......... .......... .......... .......... .......... 27% 108M 2s 2024-03-04T12:37:57.644 INFO:teuthology.orchestra.run.smithi110.stderr: 25200K .......... .......... .......... .......... .......... 27% 93.0M 1s 2024-03-04T12:37:57.645 INFO:teuthology.orchestra.run.smithi110.stderr: 25250K .......... .......... .......... .......... .......... 27% 106M 1s 2024-03-04T12:37:57.645 INFO:teuthology.orchestra.run.smithi110.stderr: 25300K .......... .......... .......... .......... .......... 27% 111M 1s 2024-03-04T12:37:57.645 INFO:teuthology.orchestra.run.smithi110.stderr: 25350K .......... .......... .......... .......... .......... 27% 118M 1s 2024-03-04T12:37:57.645 INFO:teuthology.orchestra.run.smithi110.stderr: 25400K .......... .......... .......... .......... .......... 27% 81.0M 1s 2024-03-04T12:37:57.645 INFO:teuthology.orchestra.run.smithi110.stderr: 25450K .......... .......... .......... .......... .......... 27% 109M 1s 2024-03-04T12:37:57.645 INFO:teuthology.orchestra.run.smithi110.stderr: 25500K .......... .......... .......... .......... .......... 27% 104M 1s 2024-03-04T12:37:57.645 INFO:teuthology.orchestra.run.smithi110.stderr: 25550K .......... .......... .......... .......... .......... 27% 112M 1s 2024-03-04T12:37:57.645 INFO:teuthology.orchestra.run.smithi110.stderr: 25600K .......... .......... .......... .......... .......... 27% 113M 1s 2024-03-04T12:37:57.645 INFO:teuthology.orchestra.run.smithi110.stderr: 25650K .......... .......... .......... .......... .......... 27% 103M 1s 2024-03-04T12:37:57.645 INFO:teuthology.orchestra.run.smithi110.stderr: 25700K .......... .......... .......... .......... .......... 27% 75.2M 1s 2024-03-04T12:37:57.645 INFO:teuthology.orchestra.run.smithi110.stderr: 25750K .......... .......... .......... .......... .......... 27% 120M 1s 2024-03-04T12:37:57.645 INFO:teuthology.orchestra.run.smithi110.stderr: 25800K .......... .......... .......... .......... .......... 27% 81.8M 1s 2024-03-04T12:37:57.645 INFO:teuthology.orchestra.run.smithi110.stderr: 25850K .......... .......... .......... .......... .......... 27% 99.2M 1s 2024-03-04T12:37:57.645 INFO:teuthology.orchestra.run.smithi110.stderr: 25900K .......... .......... .......... .......... .......... 27% 109M 1s 2024-03-04T12:37:57.645 INFO:teuthology.orchestra.run.smithi110.stderr: 25950K .......... .......... .......... .......... .......... 27% 94.3M 1s 2024-03-04T12:37:57.646 INFO:teuthology.orchestra.run.smithi110.stderr: 26000K .......... .......... .......... .......... .......... 28% 118M 1s 2024-03-04T12:37:57.646 INFO:teuthology.orchestra.run.smithi110.stderr: 26050K .......... .......... .......... .......... .......... 28% 101M 1s 2024-03-04T12:37:57.646 INFO:teuthology.orchestra.run.smithi110.stderr: 26100K .......... .......... .......... .......... .......... 28% 117M 1s 2024-03-04T12:37:57.646 INFO:teuthology.orchestra.run.smithi110.stderr: 26150K .......... .......... .......... .......... .......... 28% 98.1M 1s 2024-03-04T12:37:57.646 INFO:teuthology.orchestra.run.smithi110.stderr: 26200K .......... .......... .......... .......... .......... 28% 80.1M 1s 2024-03-04T12:37:57.646 INFO:teuthology.orchestra.run.smithi110.stderr: 26250K .......... .......... .......... .......... .......... 28% 97.9M 1s 2024-03-04T12:37:57.646 INFO:teuthology.orchestra.run.smithi110.stderr: 26300K .......... .......... .......... .......... .......... 28% 102M 1s 2024-03-04T12:37:57.646 INFO:teuthology.orchestra.run.smithi110.stderr: 26350K .......... .......... .......... .......... .......... 28% 112M 1s 2024-03-04T12:37:57.646 INFO:teuthology.orchestra.run.smithi110.stderr: 26400K .......... .......... .......... .......... .......... 28% 116M 1s 2024-03-04T12:37:57.646 INFO:teuthology.orchestra.run.smithi110.stderr: 26450K .......... .......... .......... .......... .......... 28% 100M 1s 2024-03-04T12:37:57.646 INFO:teuthology.orchestra.run.smithi110.stderr: 26500K .......... .......... .......... .......... .......... 28% 110M 1s 2024-03-04T12:37:57.646 INFO:teuthology.orchestra.run.smithi110.stderr: 26550K .......... .......... .......... .......... .......... 28% 123M 1s 2024-03-04T12:37:57.646 INFO:teuthology.orchestra.run.smithi110.stderr: 26600K .......... .......... .......... .......... .......... 28% 79.2M 1s 2024-03-04T12:37:57.646 INFO:teuthology.orchestra.run.smithi110.stderr: 26650K .......... .......... .......... .......... .......... 28% 104M 1s 2024-03-04T12:37:57.647 INFO:teuthology.orchestra.run.smithi110.stderr: 26700K .......... .......... .......... .......... .......... 28% 113M 1s 2024-03-04T12:37:57.647 INFO:teuthology.orchestra.run.smithi110.stderr: 26750K .......... .......... .......... .......... .......... 28% 96.0M 1s 2024-03-04T12:37:57.647 INFO:teuthology.orchestra.run.smithi110.stderr: 26800K .......... .......... .......... .......... .......... 28% 120M 1s 2024-03-04T12:37:57.647 INFO:teuthology.orchestra.run.smithi110.stderr: 26850K .......... .......... .......... .......... .......... 28% 104M 1s 2024-03-04T12:37:57.647 INFO:teuthology.orchestra.run.smithi110.stderr: 26900K .......... .......... .......... .......... .......... 29% 103M 1s 2024-03-04T12:37:57.647 INFO:teuthology.orchestra.run.smithi110.stderr: 26950K .......... .......... .......... .......... .......... 29% 85.4M 1s 2024-03-04T12:37:57.647 INFO:teuthology.orchestra.run.smithi110.stderr: 27000K .......... .......... .......... .......... .......... 29% 103M 1s 2024-03-04T12:37:57.647 INFO:teuthology.orchestra.run.smithi110.stderr: 27050K .......... .......... .......... .......... .......... 29% 112M 1s 2024-03-04T12:37:57.647 INFO:teuthology.orchestra.run.smithi110.stderr: 27100K .......... .......... .......... .......... .......... 29% 91.7M 1s 2024-03-04T12:37:57.647 INFO:teuthology.orchestra.run.smithi110.stderr: 27150K .......... .......... .......... .......... .......... 29% 132M 1s 2024-03-04T12:37:57.647 INFO:teuthology.orchestra.run.smithi110.stderr: 27200K .......... .......... .......... .......... .......... 29% 102M 1s 2024-03-04T12:37:57.647 INFO:teuthology.orchestra.run.smithi110.stderr: 27250K .......... .......... .......... .......... .......... 29% 116M 1s 2024-03-04T12:37:57.647 INFO:teuthology.orchestra.run.smithi110.stderr: 27300K .......... .......... .......... .......... .......... 29% 112M 1s 2024-03-04T12:37:57.647 INFO:teuthology.orchestra.run.smithi110.stderr: 27350K .......... .......... .......... .......... .......... 29% 62.4M 1s 2024-03-04T12:37:57.647 INFO:teuthology.orchestra.run.smithi110.stderr: 27400K .......... .......... .......... .......... .......... 29% 98.0M 1s 2024-03-04T12:37:57.648 INFO:teuthology.orchestra.run.smithi110.stderr: 27450K .......... .......... .......... .......... .......... 29% 115M 1s 2024-03-04T12:37:57.648 INFO:teuthology.orchestra.run.smithi110.stderr: 27500K .......... .......... .......... .......... .......... 29% 113M 1s 2024-03-04T12:37:57.648 INFO:teuthology.orchestra.run.smithi110.stderr: 27550K .......... .......... .......... .......... .......... 29% 87.3M 1s 2024-03-04T12:37:57.648 INFO:teuthology.orchestra.run.smithi110.stderr: 27600K .......... .......... .......... .......... .......... 29% 109M 1s 2024-03-04T12:37:57.648 INFO:teuthology.orchestra.run.smithi110.stderr: 27650K .......... .......... .......... .......... .......... 29% 101M 1s 2024-03-04T12:37:57.648 INFO:teuthology.orchestra.run.smithi110.stderr: 27700K .......... .......... .......... .......... .......... 29% 119M 1s 2024-03-04T12:37:57.648 INFO:teuthology.orchestra.run.smithi110.stderr: 27750K .......... .......... .......... .......... .......... 29% 71.0M 1s 2024-03-04T12:37:57.648 INFO:teuthology.orchestra.run.smithi110.stderr: 27800K .......... .......... .......... .......... .......... 29% 125M 1s 2024-03-04T12:37:57.648 INFO:teuthology.orchestra.run.smithi110.stderr: 27850K .......... .......... .......... .......... .......... 30% 80.6M 1s 2024-03-04T12:37:57.648 INFO:teuthology.orchestra.run.smithi110.stderr: 27900K .......... .......... .......... .......... .......... 30% 115M 1s 2024-03-04T12:37:57.648 INFO:teuthology.orchestra.run.smithi110.stderr: 27950K .......... .......... .......... .......... .......... 30% 98.6M 1s 2024-03-04T12:37:57.648 INFO:teuthology.orchestra.run.smithi110.stderr: 28000K .......... .......... .......... .......... .......... 30% 112M 1s 2024-03-04T12:37:57.648 INFO:teuthology.orchestra.run.smithi110.stderr: 28050K .......... .......... .......... .......... .......... 30% 104M 1s 2024-03-04T12:37:57.648 INFO:teuthology.orchestra.run.smithi110.stderr: 28100K .......... .......... .......... .......... .......... 30% 111M 1s 2024-03-04T12:37:57.649 INFO:teuthology.orchestra.run.smithi110.stderr: 28150K .......... .......... .......... .......... .......... 30% 81.6M 1s 2024-03-04T12:37:57.649 INFO:teuthology.orchestra.run.smithi110.stderr: 28200K .......... .......... .......... .......... .......... 30% 117M 1s 2024-03-04T12:37:57.649 INFO:teuthology.orchestra.run.smithi110.stderr: 28250K .......... .......... .......... .......... .......... 30% 112M 1s 2024-03-04T12:37:57.649 INFO:teuthology.orchestra.run.smithi110.stderr: 28300K .......... .......... .......... .......... .......... 30% 98.7M 1s 2024-03-04T12:37:57.649 INFO:teuthology.orchestra.run.smithi110.stderr: 28350K .......... .......... .......... .......... .......... 30% 101M 1s 2024-03-04T12:37:57.649 INFO:teuthology.orchestra.run.smithi110.stderr: 28400K .......... .......... .......... .......... .......... 30% 116M 1s 2024-03-04T12:37:57.649 INFO:teuthology.orchestra.run.smithi110.stderr: 28450K .......... .......... .......... .......... .......... 30% 94.9M 1s 2024-03-04T12:37:57.649 INFO:teuthology.orchestra.run.smithi110.stderr: 28500K .......... .......... .......... .......... .......... 30% 109M 1s 2024-03-04T12:37:57.649 INFO:teuthology.orchestra.run.smithi110.stderr: 28550K .......... .......... .......... .......... .......... 30% 93.7M 1s 2024-03-04T12:37:57.649 INFO:teuthology.orchestra.run.smithi110.stderr: 28600K .......... .......... .......... .......... .......... 30% 100M 1s 2024-03-04T12:37:57.649 INFO:teuthology.orchestra.run.smithi110.stderr: 28650K .......... .......... .......... .......... .......... 30% 100M 1s 2024-03-04T12:37:57.649 INFO:teuthology.orchestra.run.smithi110.stderr: 28700K .......... .......... .......... .......... .......... 30% 143M 1s 2024-03-04T12:37:57.649 INFO:teuthology.orchestra.run.smithi110.stderr: 28750K .......... .......... .......... .......... .......... 31% 89.3M 1s 2024-03-04T12:37:57.649 INFO:teuthology.orchestra.run.smithi110.stderr: 28800K .......... .......... .......... .......... .......... 31% 121M 1s 2024-03-04T12:37:57.650 INFO:teuthology.orchestra.run.smithi110.stderr: 28850K .......... .......... .......... .......... .......... 31% 86.7M 1s 2024-03-04T12:37:57.650 INFO:teuthology.orchestra.run.smithi110.stderr: 28900K .......... .......... .......... .......... .......... 31% 91.0M 1s 2024-03-04T12:37:57.650 INFO:teuthology.orchestra.run.smithi110.stderr: 28950K .......... .......... .......... .......... .......... 31% 119M 1s 2024-03-04T12:37:57.650 INFO:teuthology.orchestra.run.smithi110.stderr: 29000K .......... .......... .......... .......... .......... 31% 75.2M 1s 2024-03-04T12:37:57.650 INFO:teuthology.orchestra.run.smithi110.stderr: 29050K .......... .......... .......... .......... .......... 31% 84.0M 1s 2024-03-04T12:37:57.650 INFO:teuthology.orchestra.run.smithi110.stderr: 29100K .......... .......... .......... .......... .......... 31% 82.3M 1s 2024-03-04T12:37:57.650 INFO:teuthology.orchestra.run.smithi110.stderr: 29150K .......... .......... .......... .......... .......... 31% 131M 1s 2024-03-04T12:37:57.650 INFO:teuthology.orchestra.run.smithi110.stderr: 29200K .......... .......... .......... .......... .......... 31% 121M 1s 2024-03-04T12:37:57.650 INFO:teuthology.orchestra.run.smithi110.stderr: 29250K .......... .......... .......... .......... .......... 31% 70.6M 1s 2024-03-04T12:37:57.650 INFO:teuthology.orchestra.run.smithi110.stderr: 29300K .......... .......... .......... .......... .......... 31% 79.2M 1s 2024-03-04T12:37:57.650 INFO:teuthology.orchestra.run.smithi110.stderr: 29350K .......... .......... .......... .......... .......... 31% 90.9M 1s 2024-03-04T12:37:57.650 INFO:teuthology.orchestra.run.smithi110.stderr: 29400K .......... .......... .......... .......... .......... 31% 107M 1s 2024-03-04T12:37:57.650 INFO:teuthology.orchestra.run.smithi110.stderr: 29450K .......... .......... .......... .......... .......... 31% 79.1M 1s 2024-03-04T12:37:57.650 INFO:teuthology.orchestra.run.smithi110.stderr: 29500K .......... .......... .......... .......... .......... 31% 87.4M 1s 2024-03-04T12:37:57.651 INFO:teuthology.orchestra.run.smithi110.stderr: 29550K .......... .......... .......... .......... .......... 31% 68.6M 1s 2024-03-04T12:37:57.651 INFO:teuthology.orchestra.run.smithi110.stderr: 29600K .......... .......... .......... .......... .......... 31% 120M 1s 2024-03-04T12:37:57.651 INFO:teuthology.orchestra.run.smithi110.stderr: 29650K .......... .......... .......... .......... .......... 31% 67.5M 1s 2024-03-04T12:37:57.651 INFO:teuthology.orchestra.run.smithi110.stderr: 29700K .......... .......... .......... .......... .......... 32% 97.4M 1s 2024-03-04T12:37:57.651 INFO:teuthology.orchestra.run.smithi110.stderr: 29750K .......... .......... .......... .......... .......... 32% 51.3M 1s 2024-03-04T12:37:57.651 INFO:teuthology.orchestra.run.smithi110.stderr: 29800K .......... .......... .......... .......... .......... 32% 99.6M 1s 2024-03-04T12:37:57.651 INFO:teuthology.orchestra.run.smithi110.stderr: 29850K .......... .......... .......... .......... .......... 32% 102M 1s 2024-03-04T12:37:57.651 INFO:teuthology.orchestra.run.smithi110.stderr: 29900K .......... .......... .......... .......... .......... 32% 82.8M 1s 2024-03-04T12:37:57.651 INFO:teuthology.orchestra.run.smithi110.stderr: 29950K .......... .......... .......... .......... .......... 32% 79.0M 1s 2024-03-04T12:37:57.651 INFO:teuthology.orchestra.run.smithi110.stderr: 30000K .......... .......... .......... .......... .......... 32% 64.5M 1s 2024-03-04T12:37:57.651 INFO:teuthology.orchestra.run.smithi110.stderr: 30050K .......... .......... .......... .......... .......... 32% 78.2M 1s 2024-03-04T12:37:57.651 INFO:teuthology.orchestra.run.smithi110.stderr: 30100K .......... .......... .......... .......... .......... 32% 119M 1s 2024-03-04T12:37:57.651 INFO:teuthology.orchestra.run.smithi110.stderr: 30150K .......... .......... .......... .......... .......... 32% 84.5M 1s 2024-03-04T12:37:57.651 INFO:teuthology.orchestra.run.smithi110.stderr: 30200K .......... .......... .......... .......... .......... 32% 86.0M 1s 2024-03-04T12:37:57.652 INFO:teuthology.orchestra.run.smithi110.stderr: 30250K .......... .......... .......... .......... .......... 32% 69.4M 1s 2024-03-04T12:37:57.652 INFO:teuthology.orchestra.run.smithi110.stderr: 30300K .......... .......... .......... .......... .......... 32% 121M 1s 2024-03-04T12:37:57.652 INFO:teuthology.orchestra.run.smithi110.stderr: 30350K .......... .......... .......... .......... .......... 32% 70.5M 1s 2024-03-04T12:37:57.652 INFO:teuthology.orchestra.run.smithi110.stderr: 30400K .......... .......... .......... .......... .......... 32% 79.7M 1s 2024-03-04T12:37:57.652 INFO:teuthology.orchestra.run.smithi110.stderr: 30450K .......... .......... .......... .......... .......... 32% 84.4M 1s 2024-03-04T12:37:57.652 INFO:teuthology.orchestra.run.smithi110.stderr: 30500K .......... .......... .......... .......... .......... 32% 40.3M 1s 2024-03-04T12:37:57.652 INFO:teuthology.orchestra.run.smithi110.stderr: 30550K .......... .......... .......... .......... .......... 32% 123M 1s 2024-03-04T12:37:57.652 INFO:teuthology.orchestra.run.smithi110.stderr: 30600K .......... .......... .......... .......... .......... 32% 104M 1s 2024-03-04T12:37:57.652 INFO:teuthology.orchestra.run.smithi110.stderr: 30650K .......... .......... .......... .......... .......... 33% 101M 1s 2024-03-04T12:37:57.652 INFO:teuthology.orchestra.run.smithi110.stderr: 30700K .......... .......... .......... .......... .......... 33% 112M 1s 2024-03-04T12:37:57.652 INFO:teuthology.orchestra.run.smithi110.stderr: 30750K .......... .......... .......... .......... .......... 33% 113M 1s 2024-03-04T12:37:57.652 INFO:teuthology.orchestra.run.smithi110.stderr: 30800K .......... .......... .......... .......... .......... 33% 80.5M 1s 2024-03-04T12:37:57.652 INFO:teuthology.orchestra.run.smithi110.stderr: 30850K .......... .......... .......... .......... .......... 33% 109M 1s 2024-03-04T12:37:57.652 INFO:teuthology.orchestra.run.smithi110.stderr: 30900K .......... .......... .......... .......... .......... 33% 90.5M 1s 2024-03-04T12:37:57.652 INFO:teuthology.orchestra.run.smithi110.stderr: 30950K .......... .......... .......... .......... .......... 33% 94.1M 1s 2024-03-04T12:37:57.653 INFO:teuthology.orchestra.run.smithi110.stderr: 31000K .......... .......... .......... .......... .......... 33% 149M 1s 2024-03-04T12:37:57.653 INFO:teuthology.orchestra.run.smithi110.stderr: 31050K .......... .......... .......... .......... .......... 33% 94.7M 1s 2024-03-04T12:37:57.653 INFO:teuthology.orchestra.run.smithi110.stderr: 31100K .......... .......... .......... .......... .......... 33% 112M 1s 2024-03-04T12:37:57.653 INFO:teuthology.orchestra.run.smithi110.stderr: 31150K .......... .......... .......... .......... .......... 33% 75.3M 1s 2024-03-04T12:37:57.653 INFO:teuthology.orchestra.run.smithi110.stderr: 31200K .......... .......... .......... .......... .......... 33% 120M 1s 2024-03-04T12:37:57.653 INFO:teuthology.orchestra.run.smithi110.stderr: 31250K .......... .......... .......... .......... .......... 33% 122M 1s 2024-03-04T12:37:57.653 INFO:teuthology.orchestra.run.smithi110.stderr: 31300K .......... .......... .......... .......... .......... 33% 94.5M 1s 2024-03-04T12:37:57.653 INFO:teuthology.orchestra.run.smithi110.stderr: 31350K .......... .......... .......... .......... .......... 33% 110M 1s 2024-03-04T12:37:57.653 INFO:teuthology.orchestra.run.smithi110.stderr: 31400K .......... .......... .......... .......... .......... 33% 87.6M 1s 2024-03-04T12:37:57.653 INFO:teuthology.orchestra.run.smithi110.stderr: 31450K .......... .......... .......... .......... .......... 33% 117M 1s 2024-03-04T12:37:57.653 INFO:teuthology.orchestra.run.smithi110.stderr: 31500K .......... .......... .......... .......... .......... 33% 82.1M 1s 2024-03-04T12:37:57.653 INFO:teuthology.orchestra.run.smithi110.stderr: 31550K .......... .......... .......... .......... .......... 34% 118M 1s 2024-03-04T12:37:57.653 INFO:teuthology.orchestra.run.smithi110.stderr: 31600K .......... .......... .......... .......... .......... 34% 102M 1s 2024-03-04T12:37:57.653 INFO:teuthology.orchestra.run.smithi110.stderr: 31650K .......... .......... .......... .......... .......... 34% 90.5M 1s 2024-03-04T12:37:57.654 INFO:teuthology.orchestra.run.smithi110.stderr: 31700K .......... .......... .......... .......... .......... 34% 120M 1s 2024-03-04T12:37:57.654 INFO:teuthology.orchestra.run.smithi110.stderr: 31750K .......... .......... .......... .......... .......... 34% 112M 1s 2024-03-04T12:37:57.654 INFO:teuthology.orchestra.run.smithi110.stderr: 31800K .......... .......... .......... .......... .......... 34% 104M 1s 2024-03-04T12:37:57.654 INFO:teuthology.orchestra.run.smithi110.stderr: 31850K .......... .......... .......... .......... .......... 34% 95.6M 1s 2024-03-04T12:37:57.654 INFO:teuthology.orchestra.run.smithi110.stderr: 31900K .......... .......... .......... .......... .......... 34% 113M 1s 2024-03-04T12:37:57.654 INFO:teuthology.orchestra.run.smithi110.stderr: 31950K .......... .......... .......... .......... .......... 34% 93.8M 1s 2024-03-04T12:37:57.654 INFO:teuthology.orchestra.run.smithi110.stderr: 32000K .......... .......... .......... .......... .......... 34% 104M 1s 2024-03-04T12:37:57.654 INFO:teuthology.orchestra.run.smithi110.stderr: 32050K .......... .......... .......... .......... .......... 34% 106M 1s 2024-03-04T12:37:57.654 INFO:teuthology.orchestra.run.smithi110.stderr: 32100K .......... .......... .......... .......... .......... 34% 102M 1s 2024-03-04T12:37:57.654 INFO:teuthology.orchestra.run.smithi110.stderr: 32150K .......... .......... .......... .......... .......... 34% 115M 1s 2024-03-04T12:37:57.654 INFO:teuthology.orchestra.run.smithi110.stderr: 32200K .......... .......... .......... .......... .......... 34% 95.9M 1s 2024-03-04T12:37:57.654 INFO:teuthology.orchestra.run.smithi110.stderr: 32250K .......... .......... .......... .......... .......... 34% 102M 1s 2024-03-04T12:37:57.654 INFO:teuthology.orchestra.run.smithi110.stderr: 32300K .......... .......... .......... .......... .......... 34% 101M 1s 2024-03-04T12:37:57.654 INFO:teuthology.orchestra.run.smithi110.stderr: 32350K .......... .......... .......... .......... .......... 34% 75.0M 1s 2024-03-04T12:37:57.655 INFO:teuthology.orchestra.run.smithi110.stderr: 32400K .......... .......... .......... .......... .......... 34% 124M 1s 2024-03-04T12:37:57.655 INFO:teuthology.orchestra.run.smithi110.stderr: 32450K .......... .......... .......... .......... .......... 34% 107M 1s 2024-03-04T12:37:57.655 INFO:teuthology.orchestra.run.smithi110.stderr: 32500K .......... .......... .......... .......... .......... 35% 89.2M 1s 2024-03-04T12:37:57.655 INFO:teuthology.orchestra.run.smithi110.stderr: 32550K .......... .......... .......... .......... .......... 35% 98.8M 1s 2024-03-04T12:37:57.655 INFO:teuthology.orchestra.run.smithi110.stderr: 32600K .......... .......... .......... .......... .......... 35% 128M 1s 2024-03-04T12:37:57.655 INFO:teuthology.orchestra.run.smithi110.stderr: 32650K .......... .......... .......... .......... .......... 35% 102M 1s 2024-03-04T12:37:57.655 INFO:teuthology.orchestra.run.smithi110.stderr: 32700K .......... .......... .......... .......... .......... 35% 89.8M 1s 2024-03-04T12:37:57.655 INFO:teuthology.orchestra.run.smithi110.stderr: 32750K .......... .......... .......... .......... .......... 35% 46.9M 1s 2024-03-04T12:37:57.655 INFO:teuthology.orchestra.run.smithi110.stderr: 32800K .......... .......... .......... .......... .......... 35% 71.0M 1s 2024-03-04T12:37:57.655 INFO:teuthology.orchestra.run.smithi110.stderr: 32850K .......... .......... .......... .......... .......... 35% 112M 1s 2024-03-04T12:37:57.655 INFO:teuthology.orchestra.run.smithi110.stderr: 32900K .......... .......... .......... .......... .......... 35% 73.6M 1s 2024-03-04T12:37:57.655 INFO:teuthology.orchestra.run.smithi110.stderr: 32950K .......... .......... .......... .......... .......... 35% 74.0M 1s 2024-03-04T12:37:57.655 INFO:teuthology.orchestra.run.smithi110.stderr: 33000K .......... .......... .......... .......... .......... 35% 110M 1s 2024-03-04T12:37:57.655 INFO:teuthology.orchestra.run.smithi110.stderr: 33050K .......... .......... .......... .......... .......... 35% 97.1M 1s 2024-03-04T12:37:57.655 INFO:teuthology.orchestra.run.smithi110.stderr: 33100K .......... .......... .......... .......... .......... 35% 114M 1s 2024-03-04T12:37:57.656 INFO:teuthology.orchestra.run.smithi110.stderr: 33150K .......... .......... .......... .......... .......... 35% 73.7M 1s 2024-03-04T12:37:57.656 INFO:teuthology.orchestra.run.smithi110.stderr: 33200K .......... .......... .......... .......... .......... 35% 114M 1s 2024-03-04T12:37:57.656 INFO:teuthology.orchestra.run.smithi110.stderr: 33250K .......... .......... .......... .......... .......... 35% 98.3M 1s 2024-03-04T12:37:57.656 INFO:teuthology.orchestra.run.smithi110.stderr: 33300K .......... .......... .......... .......... .......... 35% 90.1M 1s 2024-03-04T12:37:57.656 INFO:teuthology.orchestra.run.smithi110.stderr: 33350K .......... .......... .......... .......... .......... 35% 109M 1s 2024-03-04T12:37:57.656 INFO:teuthology.orchestra.run.smithi110.stderr: 33400K .......... .......... .......... .......... .......... 36% 113M 1s 2024-03-04T12:37:57.656 INFO:teuthology.orchestra.run.smithi110.stderr: 33450K .......... .......... .......... .......... .......... 36% 95.3M 1s 2024-03-04T12:37:57.656 INFO:teuthology.orchestra.run.smithi110.stderr: 33500K .......... .......... .......... .......... .......... 36% 113M 1s 2024-03-04T12:37:57.656 INFO:teuthology.orchestra.run.smithi110.stderr: 33550K .......... .......... .......... .......... .......... 36% 82.3M 1s 2024-03-04T12:37:57.656 INFO:teuthology.orchestra.run.smithi110.stderr: 33600K .......... .......... .......... .......... .......... 36% 116M 1s 2024-03-04T12:37:57.656 INFO:teuthology.orchestra.run.smithi110.stderr: 33650K .......... .......... .......... .......... .......... 36% 103M 1s 2024-03-04T12:37:57.656 INFO:teuthology.orchestra.run.smithi110.stderr: 33700K .......... .......... .......... .......... .......... 36% 114M 1s 2024-03-04T12:37:57.656 INFO:teuthology.orchestra.run.smithi110.stderr: 33750K .......... .......... .......... .......... .......... 36% 97.8M 1s 2024-03-04T12:37:57.656 INFO:teuthology.orchestra.run.smithi110.stderr: 33800K .......... .......... .......... .......... .......... 36% 116M 1s 2024-03-04T12:37:57.656 INFO:teuthology.orchestra.run.smithi110.stderr: 33850K .......... .......... .......... .......... .......... 36% 87.5M 1s 2024-03-04T12:37:57.657 INFO:teuthology.orchestra.run.smithi110.stderr: 33900K .......... .......... .......... .......... .......... 36% 111M 1s 2024-03-04T12:37:57.657 INFO:teuthology.orchestra.run.smithi110.stderr: 33950K .......... .......... .......... .......... .......... 36% 76.1M 1s 2024-03-04T12:37:57.659 INFO:teuthology.orchestra.run.smithi110.stderr: 34000K .......... .......... .......... .......... .......... 36% 113M 1s 2024-03-04T12:37:57.659 INFO:teuthology.orchestra.run.smithi110.stderr: 34050K .......... .......... .......... .......... .......... 36% 102M 1s 2024-03-04T12:37:57.659 INFO:teuthology.orchestra.run.smithi110.stderr: 34100K .......... .......... .......... .......... .......... 36% 111M 1s 2024-03-04T12:37:57.659 INFO:teuthology.orchestra.run.smithi110.stderr: 34150K .......... .......... .......... .......... .......... 36% 97.7M 1s 2024-03-04T12:37:57.660 INFO:teuthology.orchestra.run.smithi110.stderr: 34200K .......... .......... .......... .......... .......... 36% 117M 1s 2024-03-04T12:37:57.660 INFO:teuthology.orchestra.run.smithi110.stderr: 34250K .......... .......... .......... .......... .......... 36% 113M 1s 2024-03-04T12:37:57.660 INFO:teuthology.orchestra.run.smithi110.stderr: 34300K .......... .......... .......... .......... .......... 36% 90.2M 1s 2024-03-04T12:37:57.660 INFO:teuthology.orchestra.run.smithi110.stderr: 34350K .......... .......... .......... .......... .......... 37% 95.4M 1s 2024-03-04T12:37:57.660 INFO:teuthology.orchestra.run.smithi110.stderr: 34400K .......... .......... .......... .......... .......... 37% 85.2M 1s 2024-03-04T12:37:57.660 INFO:teuthology.orchestra.run.smithi110.stderr: 34450K .......... .......... .......... .......... .......... 37% 104M 1s 2024-03-04T12:37:57.660 INFO:teuthology.orchestra.run.smithi110.stderr: 34500K .......... .......... .......... .......... .......... 37% 113M 1s 2024-03-04T12:37:57.660 INFO:teuthology.orchestra.run.smithi110.stderr: 34550K .......... .......... .......... .......... .......... 37% 114M 1s 2024-03-04T12:37:57.660 INFO:teuthology.orchestra.run.smithi110.stderr: 34600K .......... .......... .......... .......... .......... 37% 102M 1s 2024-03-04T12:37:57.660 INFO:teuthology.orchestra.run.smithi110.stderr: 34650K .......... .......... .......... .......... .......... 37% 83.6M 1s 2024-03-04T12:37:57.660 INFO:teuthology.orchestra.run.smithi110.stderr: 34700K .......... .......... .......... .......... .......... 37% 86.9M 1s 2024-03-04T12:37:57.660 INFO:teuthology.orchestra.run.smithi110.stderr: 34750K .......... .......... .......... .......... .......... 37% 119M 1s 2024-03-04T12:37:57.660 INFO:teuthology.orchestra.run.smithi110.stderr: 34800K .......... .......... .......... .......... .......... 37% 76.7M 1s 2024-03-04T12:37:57.660 INFO:teuthology.orchestra.run.smithi110.stderr: 34850K .......... .......... .......... .......... .......... 37% 69.8M 1s 2024-03-04T12:37:57.661 INFO:teuthology.orchestra.run.smithi110.stderr: 34900K .......... .......... .......... .......... .......... 37% 107M 1s 2024-03-04T12:37:57.661 INFO:teuthology.orchestra.run.smithi110.stderr: 34950K .......... .......... .......... .......... .......... 37% 113M 1s 2024-03-04T12:37:57.661 INFO:teuthology.orchestra.run.smithi110.stderr: 35000K .......... .......... .......... .......... .......... 37% 106M 1s 2024-03-04T12:37:57.661 INFO:teuthology.orchestra.run.smithi110.stderr: 35050K .......... .......... .......... .......... .......... 37% 83.4M 1s 2024-03-04T12:37:57.661 INFO:teuthology.orchestra.run.smithi110.stderr: 35100K .......... .......... .......... .......... .......... 37% 68.3M 1s 2024-03-04T12:37:57.661 INFO:teuthology.orchestra.run.smithi110.stderr: 35150K .......... .......... .......... .......... .......... 37% 122M 1s 2024-03-04T12:37:57.661 INFO:teuthology.orchestra.run.smithi110.stderr: 35200K .......... .......... .......... .......... .......... 37% 116M 1s 2024-03-04T12:37:57.661 INFO:teuthology.orchestra.run.smithi110.stderr: 35250K .......... .......... .......... .......... .......... 37% 47.7M 1s 2024-03-04T12:37:57.661 INFO:teuthology.orchestra.run.smithi110.stderr: 35300K .......... .......... .......... .......... .......... 38% 77.5M 1s 2024-03-04T12:37:57.661 INFO:teuthology.orchestra.run.smithi110.stderr: 35350K .......... .......... .......... .......... .......... 38% 118M 1s 2024-03-04T12:37:57.661 INFO:teuthology.orchestra.run.smithi110.stderr: 35400K .......... .......... .......... .......... .......... 38% 113M 1s 2024-03-04T12:37:57.661 INFO:teuthology.orchestra.run.smithi110.stderr: 35450K .......... .......... .......... .......... .......... 38% 73.6M 1s 2024-03-04T12:37:57.661 INFO:teuthology.orchestra.run.smithi110.stderr: 35500K .......... .......... .......... .......... .......... 38% 77.8M 1s 2024-03-04T12:37:57.661 INFO:teuthology.orchestra.run.smithi110.stderr: 35550K .......... .......... .......... .......... .......... 38% 87.3M 1s 2024-03-04T12:37:57.662 INFO:teuthology.orchestra.run.smithi110.stderr: 35600K .......... .......... .......... .......... .......... 38% 89.0M 1s 2024-03-04T12:37:57.662 INFO:teuthology.orchestra.run.smithi110.stderr: 35650K .......... .......... .......... .......... .......... 38% 118M 1s 2024-03-04T12:37:57.662 INFO:teuthology.orchestra.run.smithi110.stderr: 35700K .......... .......... .......... .......... .......... 38% 73.6M 1s 2024-03-04T12:37:57.662 INFO:teuthology.orchestra.run.smithi110.stderr: 35750K .......... .......... .......... .......... .......... 38% 101M 1s 2024-03-04T12:37:57.662 INFO:teuthology.orchestra.run.smithi110.stderr: 35800K .......... .......... .......... .......... .......... 38% 89.2M 1s 2024-03-04T12:37:57.662 INFO:teuthology.orchestra.run.smithi110.stderr: 35850K .......... .......... .......... .......... .......... 38% 70.5M 1s 2024-03-04T12:37:57.662 INFO:teuthology.orchestra.run.smithi110.stderr: 35900K .......... .......... .......... .......... .......... 38% 106M 1s 2024-03-04T12:37:57.662 INFO:teuthology.orchestra.run.smithi110.stderr: 35950K .......... .......... .......... .......... .......... 38% 71.2M 1s 2024-03-04T12:37:57.662 INFO:teuthology.orchestra.run.smithi110.stderr: 36000K .......... .......... .......... .......... .......... 38% 97.3M 1s 2024-03-04T12:37:57.662 INFO:teuthology.orchestra.run.smithi110.stderr: 36050K .......... .......... .......... .......... .......... 38% 94.5M 1s 2024-03-04T12:37:57.662 INFO:teuthology.orchestra.run.smithi110.stderr: 36100K .......... .......... .......... .......... .......... 38% 95.1M 1s 2024-03-04T12:37:57.662 INFO:teuthology.orchestra.run.smithi110.stderr: 36150K .......... .......... .......... .......... .......... 38% 113M 1s 2024-03-04T12:37:57.662 INFO:teuthology.orchestra.run.smithi110.stderr: 36200K .......... .......... .......... .......... .......... 39% 84.8M 1s 2024-03-04T12:37:57.662 INFO:teuthology.orchestra.run.smithi110.stderr: 36250K .......... .......... .......... .......... .......... 39% 69.7M 1s 2024-03-04T12:37:57.663 INFO:teuthology.orchestra.run.smithi110.stderr: 36300K .......... .......... .......... .......... .......... 39% 112M 1s 2024-03-04T12:37:57.663 INFO:teuthology.orchestra.run.smithi110.stderr: 36350K .......... .......... .......... .......... .......... 39% 75.5M 1s 2024-03-04T12:37:57.663 INFO:teuthology.orchestra.run.smithi110.stderr: 36400K .......... .......... .......... .......... .......... 39% 126M 1s 2024-03-04T12:37:57.663 INFO:teuthology.orchestra.run.smithi110.stderr: 36450K .......... .......... .......... .......... .......... 39% 106M 1s 2024-03-04T12:37:57.663 INFO:teuthology.orchestra.run.smithi110.stderr: 36500K .......... .......... .......... .......... .......... 39% 79.4M 1s 2024-03-04T12:37:57.663 INFO:teuthology.orchestra.run.smithi110.stderr: 36550K .......... .......... .......... .......... .......... 39% 116M 1s 2024-03-04T12:37:57.663 INFO:teuthology.orchestra.run.smithi110.stderr: 36600K .......... .......... .......... .......... .......... 39% 98.0M 1s 2024-03-04T12:37:57.663 INFO:teuthology.orchestra.run.smithi110.stderr: 36650K .......... .......... .......... .......... .......... 39% 93.9M 1s 2024-03-04T12:37:57.663 INFO:teuthology.orchestra.run.smithi110.stderr: 36700K .......... .......... .......... .......... .......... 39% 83.5M 1s 2024-03-04T12:37:57.663 INFO:teuthology.orchestra.run.smithi110.stderr: 36750K .......... .......... .......... .......... .......... 39% 75.1M 1s 2024-03-04T12:37:57.663 INFO:teuthology.orchestra.run.smithi110.stderr: 36800K .......... .......... .......... .......... .......... 39% 88.9M 1s 2024-03-04T12:37:57.663 INFO:teuthology.orchestra.run.smithi110.stderr: 36850K .......... .......... .......... .......... .......... 39% 120M 1s 2024-03-04T12:37:57.663 INFO:teuthology.orchestra.run.smithi110.stderr: 36900K .......... .......... .......... .......... .......... 39% 106M 1s 2024-03-04T12:37:57.663 INFO:teuthology.orchestra.run.smithi110.stderr: 36950K .......... .......... .......... .......... .......... 39% 82.9M 1s 2024-03-04T12:37:57.663 INFO:teuthology.orchestra.run.smithi110.stderr: 37000K .......... .......... .......... .......... .......... 39% 79.7M 1s 2024-03-04T12:37:57.664 INFO:teuthology.orchestra.run.smithi110.stderr: 37050K .......... .......... .......... .......... .......... 39% 96.3M 1s 2024-03-04T12:37:57.664 INFO:teuthology.orchestra.run.smithi110.stderr: 37100K .......... .......... .......... .......... .......... 39% 119M 1s 2024-03-04T12:37:57.664 INFO:teuthology.orchestra.run.smithi110.stderr: 37150K .......... .......... .......... .......... .......... 40% 71.6M 1s 2024-03-04T12:37:57.664 INFO:teuthology.orchestra.run.smithi110.stderr: 37200K .......... .......... .......... .......... .......... 40% 117M 1s 2024-03-04T12:37:57.664 INFO:teuthology.orchestra.run.smithi110.stderr: 37250K .......... .......... .......... .......... .......... 40% 79.1M 1s 2024-03-04T12:37:57.664 INFO:teuthology.orchestra.run.smithi110.stderr: 37300K .......... .......... .......... .......... .......... 40% 113M 1s 2024-03-04T12:37:57.664 INFO:teuthology.orchestra.run.smithi110.stderr: 37350K .......... .......... .......... .......... .......... 40% 89.8M 1s 2024-03-04T12:37:57.664 INFO:teuthology.orchestra.run.smithi110.stderr: 37400K .......... .......... .......... .......... .......... 40% 111M 1s 2024-03-04T12:37:57.664 INFO:teuthology.orchestra.run.smithi110.stderr: 37450K .......... .......... .......... .......... .......... 40% 90.6M 1s 2024-03-04T12:37:57.664 INFO:teuthology.orchestra.run.smithi110.stderr: 37500K .......... .......... .......... .......... .......... 40% 73.9M 1s 2024-03-04T12:37:57.664 INFO:teuthology.orchestra.run.smithi110.stderr: 37550K .......... .......... .......... .......... .......... 40% 107M 1s 2024-03-04T12:37:57.664 INFO:teuthology.orchestra.run.smithi110.stderr: 37600K .......... .......... .......... .......... .......... 40% 89.5M 1s 2024-03-04T12:37:57.664 INFO:teuthology.orchestra.run.smithi110.stderr: 37650K .......... .......... .......... .......... .......... 40% 95.3M 1s 2024-03-04T12:37:57.664 INFO:teuthology.orchestra.run.smithi110.stderr: 37700K .......... .......... .......... .......... .......... 40% 93.7M 1s 2024-03-04T12:37:57.665 INFO:teuthology.orchestra.run.smithi110.stderr: 37750K .......... .......... .......... .......... .......... 40% 71.5M 1s 2024-03-04T12:37:57.665 INFO:teuthology.orchestra.run.smithi110.stderr: 37800K .......... .......... .......... .......... .......... 40% 108M 1s 2024-03-04T12:37:57.665 INFO:teuthology.orchestra.run.smithi110.stderr: 37850K .......... .......... .......... .......... .......... 40% 62.0M 1s 2024-03-04T12:37:57.665 INFO:teuthology.orchestra.run.smithi110.stderr: 37900K .......... .......... .......... .......... .......... 40% 87.8M 1s 2024-03-04T12:37:57.665 INFO:teuthology.orchestra.run.smithi110.stderr: 37950K .......... .......... .......... .......... .......... 40% 98.2M 1s 2024-03-04T12:37:57.665 INFO:teuthology.orchestra.run.smithi110.stderr: 38000K .......... .......... .......... .......... .......... 40% 114M 1s 2024-03-04T12:37:57.665 INFO:teuthology.orchestra.run.smithi110.stderr: 38050K .......... .......... .......... .......... .......... 41% 86.8M 1s 2024-03-04T12:37:57.665 INFO:teuthology.orchestra.run.smithi110.stderr: 38100K .......... .......... .......... .......... .......... 41% 92.0M 1s 2024-03-04T12:37:57.665 INFO:teuthology.orchestra.run.smithi110.stderr: 38150K .......... .......... .......... .......... .......... 41% 89.1M 1s 2024-03-04T12:37:57.665 INFO:teuthology.orchestra.run.smithi110.stderr: 38200K .......... .......... .......... .......... .......... 41% 75.9M 1s 2024-03-04T12:37:57.665 INFO:teuthology.orchestra.run.smithi110.stderr: 38250K .......... .......... .......... .......... .......... 41% 122M 1s 2024-03-04T12:37:57.665 INFO:teuthology.orchestra.run.smithi110.stderr: 38300K .......... .......... .......... .......... .......... 41% 79.3M 1s 2024-03-04T12:37:57.665 INFO:teuthology.orchestra.run.smithi110.stderr: 38350K .......... .......... .......... .......... .......... 41% 105M 1s 2024-03-04T12:37:57.665 INFO:teuthology.orchestra.run.smithi110.stderr: 38400K .......... .......... .......... .......... .......... 41% 108M 1s 2024-03-04T12:37:57.665 INFO:teuthology.orchestra.run.smithi110.stderr: 38450K .......... .......... .......... .......... .......... 41% 120M 1s 2024-03-04T12:37:57.666 INFO:teuthology.orchestra.run.smithi110.stderr: 38500K .......... .......... .......... .......... .......... 41% 87.6M 1s 2024-03-04T12:37:57.666 INFO:teuthology.orchestra.run.smithi110.stderr: 38550K .......... .......... .......... .......... .......... 41% 73.4M 1s 2024-03-04T12:37:57.666 INFO:teuthology.orchestra.run.smithi110.stderr: 38600K .......... .......... .......... .......... .......... 41% 110M 1s 2024-03-04T12:37:57.666 INFO:teuthology.orchestra.run.smithi110.stderr: 38650K .......... .......... .......... .......... .......... 41% 86.5M 1s 2024-03-04T12:37:57.666 INFO:teuthology.orchestra.run.smithi110.stderr: 38700K .......... .......... .......... .......... .......... 41% 121M 1s 2024-03-04T12:37:57.666 INFO:teuthology.orchestra.run.smithi110.stderr: 38750K .......... .......... .......... .......... .......... 41% 92.7M 1s 2024-03-04T12:37:57.666 INFO:teuthology.orchestra.run.smithi110.stderr: 38800K .......... .......... .......... .......... .......... 41% 109M 1s 2024-03-04T12:37:57.666 INFO:teuthology.orchestra.run.smithi110.stderr: 38850K .......... .......... .......... .......... .......... 41% 101M 1s 2024-03-04T12:37:57.666 INFO:teuthology.orchestra.run.smithi110.stderr: 38900K .......... .......... .......... .......... .......... 41% 105M 1s 2024-03-04T12:37:57.666 INFO:teuthology.orchestra.run.smithi110.stderr: 38950K .......... .......... .......... .......... .......... 41% 84.7M 1s 2024-03-04T12:37:57.666 INFO:teuthology.orchestra.run.smithi110.stderr: 39000K .......... .......... .......... .......... .......... 42% 95.1M 1s 2024-03-04T12:37:57.666 INFO:teuthology.orchestra.run.smithi110.stderr: 39050K .......... .......... .......... .......... .......... 42% 118M 1s 2024-03-04T12:37:57.666 INFO:teuthology.orchestra.run.smithi110.stderr: 39100K .......... .......... .......... .......... .......... 42% 94.0M 1s 2024-03-04T12:37:57.666 INFO:teuthology.orchestra.run.smithi110.stderr: 39150K .......... .......... .......... .......... .......... 42% 102M 1s 2024-03-04T12:37:57.667 INFO:teuthology.orchestra.run.smithi110.stderr: 39200K .......... .......... .......... .......... .......... 42% 108M 1s 2024-03-04T12:37:57.667 INFO:teuthology.orchestra.run.smithi110.stderr: 39250K .......... .......... .......... .......... .......... 42% 115M 1s 2024-03-04T12:37:57.667 INFO:teuthology.orchestra.run.smithi110.stderr: 39300K .......... .......... .......... .......... .......... 42% 87.6M 1s 2024-03-04T12:37:57.667 INFO:teuthology.orchestra.run.smithi110.stderr: 39350K .......... .......... .......... .......... .......... 42% 91.7M 1s 2024-03-04T12:37:57.667 INFO:teuthology.orchestra.run.smithi110.stderr: 39400K .......... .......... .......... .......... .......... 42% 118M 1s 2024-03-04T12:37:57.667 INFO:teuthology.orchestra.run.smithi110.stderr: 39450K .......... .......... .......... .......... .......... 42% 92.0M 1s 2024-03-04T12:37:57.667 INFO:teuthology.orchestra.run.smithi110.stderr: 39500K .......... .......... .......... .......... .......... 42% 113M 1s 2024-03-04T12:37:57.667 INFO:teuthology.orchestra.run.smithi110.stderr: 39550K .......... .......... .......... .......... .......... 42% 92.1M 1s 2024-03-04T12:37:57.667 INFO:teuthology.orchestra.run.smithi110.stderr: 39600K .......... .......... .......... .......... .......... 42% 122M 1s 2024-03-04T12:37:57.667 INFO:teuthology.orchestra.run.smithi110.stderr: 39650K .......... .......... .......... .......... .......... 42% 107M 1s 2024-03-04T12:37:57.667 INFO:teuthology.orchestra.run.smithi110.stderr: 39700K .......... .......... .......... .......... .......... 42% 104M 1s 2024-03-04T12:37:57.667 INFO:teuthology.orchestra.run.smithi110.stderr: 39750K .......... .......... .......... .......... .......... 42% 85.5M 1s 2024-03-04T12:37:57.667 INFO:teuthology.orchestra.run.smithi110.stderr: 39800K .......... .......... .......... .......... .......... 42% 116M 1s 2024-03-04T12:37:57.667 INFO:teuthology.orchestra.run.smithi110.stderr: 39850K .......... .......... .......... .......... .......... 42% 89.3M 1s 2024-03-04T12:37:57.667 INFO:teuthology.orchestra.run.smithi110.stderr: 39900K .......... .......... .......... .......... .......... 43% 113M 1s 2024-03-04T12:37:57.668 INFO:teuthology.orchestra.run.smithi110.stderr: 39950K .......... .......... .......... .......... .......... 43% 109M 1s 2024-03-04T12:37:57.668 INFO:teuthology.orchestra.run.smithi110.stderr: 40000K .......... .......... .......... .......... .......... 43% 10.1M 1s 2024-03-04T12:37:57.668 INFO:teuthology.orchestra.run.smithi110.stderr: 40050K .......... .......... .......... .......... .......... 43% 227M 1s 2024-03-04T12:37:57.668 INFO:teuthology.orchestra.run.smithi110.stderr: 40100K .......... .......... .......... .......... .......... 43% 231M 1s 2024-03-04T12:37:57.668 INFO:teuthology.orchestra.run.smithi110.stderr: 40150K .......... .......... .......... .......... .......... 43% 226M 1s 2024-03-04T12:37:57.668 INFO:teuthology.orchestra.run.smithi110.stderr: 40200K .......... .......... .......... .......... .......... 43% 209M 1s 2024-03-04T12:37:57.668 INFO:teuthology.orchestra.run.smithi110.stderr: 40250K .......... .......... .......... .......... .......... 43% 233M 1s 2024-03-04T12:37:57.668 INFO:teuthology.orchestra.run.smithi110.stderr: 40300K .......... .......... .......... .......... .......... 43% 209M 1s 2024-03-04T12:37:57.668 INFO:teuthology.orchestra.run.smithi110.stderr: 40350K .......... .......... .......... .......... .......... 43% 329M 1s 2024-03-04T12:37:57.668 INFO:teuthology.orchestra.run.smithi110.stderr: 40400K .......... .......... .......... .......... .......... 43% 315M 1s 2024-03-04T12:37:57.668 INFO:teuthology.orchestra.run.smithi110.stderr: 40450K .......... .......... .......... .......... .......... 43% 272M 1s 2024-03-04T12:37:57.668 INFO:teuthology.orchestra.run.smithi110.stderr: 40500K .......... .......... .......... .......... .......... 43% 295M 1s 2024-03-04T12:37:57.668 INFO:teuthology.orchestra.run.smithi110.stderr: 40550K .......... .......... .......... .......... .......... 43% 99.3M 1s 2024-03-04T12:37:57.668 INFO:teuthology.orchestra.run.smithi110.stderr: 40600K .......... .......... .......... .......... .......... 43% 149M 1s 2024-03-04T12:37:57.669 INFO:teuthology.orchestra.run.smithi110.stderr: 40650K .......... .......... .......... .......... .......... 43% 187M 1s 2024-03-04T12:37:57.669 INFO:teuthology.orchestra.run.smithi110.stderr: 40700K .......... .......... .......... .......... .......... 43% 161M 1s 2024-03-04T12:37:57.669 INFO:teuthology.orchestra.run.smithi110.stderr: 40750K .......... .......... .......... .......... .......... 43% 244M 1s 2024-03-04T12:37:57.669 INFO:teuthology.orchestra.run.smithi110.stderr: 40800K .......... .......... .......... .......... .......... 43% 153M 1s 2024-03-04T12:37:57.669 INFO:teuthology.orchestra.run.smithi110.stderr: 40850K .......... .......... .......... .......... .......... 44% 145M 1s 2024-03-04T12:37:57.669 INFO:teuthology.orchestra.run.smithi110.stderr: 40900K .......... .......... .......... .......... .......... 44% 104M 1s 2024-03-04T12:37:57.669 INFO:teuthology.orchestra.run.smithi110.stderr: 40950K .......... .......... .......... .......... .......... 44% 70.2M 1s 2024-03-04T12:37:57.669 INFO:teuthology.orchestra.run.smithi110.stderr: 41000K .......... .......... .......... .......... .......... 44% 103M 1s 2024-03-04T12:37:57.669 INFO:teuthology.orchestra.run.smithi110.stderr: 41050K .......... .......... .......... .......... .......... 44% 110M 1s 2024-03-04T12:37:57.669 INFO:teuthology.orchestra.run.smithi110.stderr: 41100K .......... .......... .......... .......... .......... 44% 95.8M 1s 2024-03-04T12:37:57.669 INFO:teuthology.orchestra.run.smithi110.stderr: 41150K .......... .......... .......... .......... .......... 44% 99.9M 1s 2024-03-04T12:37:57.669 INFO:teuthology.orchestra.run.smithi110.stderr: 41200K .......... .......... .......... .......... .......... 44% 70.7M 1s 2024-03-04T12:37:57.669 INFO:teuthology.orchestra.run.smithi110.stderr: 41250K .......... .......... .......... .......... .......... 44% 76.8M 1s 2024-03-04T12:37:57.669 INFO:teuthology.orchestra.run.smithi110.stderr: 41300K .......... .......... .......... .......... .......... 44% 124M 1s 2024-03-04T12:37:57.670 INFO:teuthology.orchestra.run.smithi110.stderr: 41350K .......... .......... .......... .......... .......... 44% 99.2M 1s 2024-03-04T12:37:57.670 INFO:teuthology.orchestra.run.smithi110.stderr: 41400K .......... .......... .......... .......... .......... 44% 109M 1s 2024-03-04T12:37:57.670 INFO:teuthology.orchestra.run.smithi110.stderr: 41450K .......... .......... .......... .......... .......... 44% 81.9M 1s 2024-03-04T12:37:57.670 INFO:teuthology.orchestra.run.smithi110.stderr: 41500K .......... .......... .......... .......... .......... 44% 115M 1s 2024-03-04T12:37:57.670 INFO:teuthology.orchestra.run.smithi110.stderr: 41550K .......... .......... .......... .......... .......... 44% 98.4M 1s 2024-03-04T12:37:57.670 INFO:teuthology.orchestra.run.smithi110.stderr: 41600K .......... .......... .......... .......... .......... 44% 71.0M 1s 2024-03-04T12:37:57.670 INFO:teuthology.orchestra.run.smithi110.stderr: 41650K .......... .......... .......... .......... .......... 44% 97.7M 1s 2024-03-04T12:37:57.670 INFO:teuthology.orchestra.run.smithi110.stderr: 41700K .......... .......... .......... .......... .......... 44% 88.1M 1s 2024-03-04T12:37:57.670 INFO:teuthology.orchestra.run.smithi110.stderr: 41750K .......... .......... .......... .......... .......... 44% 122M 1s 2024-03-04T12:37:57.670 INFO:teuthology.orchestra.run.smithi110.stderr: 41800K .......... .......... .......... .......... .......... 45% 98.2M 1s 2024-03-04T12:37:57.670 INFO:teuthology.orchestra.run.smithi110.stderr: 41850K .......... .......... .......... .......... .......... 45% 97.2M 1s 2024-03-04T12:37:57.670 INFO:teuthology.orchestra.run.smithi110.stderr: 41900K .......... .......... .......... .......... .......... 45% 90.9M 1s 2024-03-04T12:37:57.670 INFO:teuthology.orchestra.run.smithi110.stderr: 41950K .......... .......... .......... .......... .......... 45% 62.0M 1s 2024-03-04T12:37:57.670 INFO:teuthology.orchestra.run.smithi110.stderr: 42000K .......... .......... .......... .......... .......... 45% 120M 1s 2024-03-04T12:37:57.670 INFO:teuthology.orchestra.run.smithi110.stderr: 42050K .......... .......... .......... .......... .......... 45% 101M 1s 2024-03-04T12:37:57.671 INFO:teuthology.orchestra.run.smithi110.stderr: 42100K .......... .......... .......... .......... .......... 45% 115M 1s 2024-03-04T12:37:57.671 INFO:teuthology.orchestra.run.smithi110.stderr: 42150K .......... .......... .......... .......... .......... 45% 93.7M 1s 2024-03-04T12:37:57.671 INFO:teuthology.orchestra.run.smithi110.stderr: 42200K .......... .......... .......... .......... .......... 45% 123M 1s 2024-03-04T12:37:57.671 INFO:teuthology.orchestra.run.smithi110.stderr: 42250K .......... .......... .......... .......... .......... 45% 96.4M 1s 2024-03-04T12:37:57.671 INFO:teuthology.orchestra.run.smithi110.stderr: 42300K .......... .......... .......... .......... .......... 45% 87.2M 1s 2024-03-04T12:37:57.671 INFO:teuthology.orchestra.run.smithi110.stderr: 42350K .......... .......... .......... .......... .......... 45% 86.1M 1s 2024-03-04T12:37:57.671 INFO:teuthology.orchestra.run.smithi110.stderr: 42400K .......... .......... .......... .......... .......... 45% 83.0M 1s 2024-03-04T12:37:57.671 INFO:teuthology.orchestra.run.smithi110.stderr: 42450K .......... .......... .......... .......... .......... 45% 121M 1s 2024-03-04T12:37:57.671 INFO:teuthology.orchestra.run.smithi110.stderr: 42500K .......... .......... .......... .......... .......... 45% 117M 1s 2024-03-04T12:37:57.671 INFO:teuthology.orchestra.run.smithi110.stderr: 42550K .......... .......... .......... .......... .......... 45% 81.2M 1s 2024-03-04T12:37:57.671 INFO:teuthology.orchestra.run.smithi110.stderr: 42600K .......... .......... .......... .......... .......... 45% 85.6M 1s 2024-03-04T12:37:57.671 INFO:teuthology.orchestra.run.smithi110.stderr: 42650K .......... .......... .......... .......... .......... 45% 64.4M 1s 2024-03-04T12:37:57.671 INFO:teuthology.orchestra.run.smithi110.stderr: 42700K .......... .......... .......... .......... .......... 46% 115M 1s 2024-03-04T12:37:57.671 INFO:teuthology.orchestra.run.smithi110.stderr: 42750K .......... .......... .......... .......... .......... 46% 90.8M 1s 2024-03-04T12:37:57.671 INFO:teuthology.orchestra.run.smithi110.stderr: 42800K .......... .......... .......... .......... .......... 46% 96.5M 1s 2024-03-04T12:37:57.672 INFO:teuthology.orchestra.run.smithi110.stderr: 42850K .......... .......... .......... .......... .......... 46% 98.9M 1s 2024-03-04T12:37:57.672 INFO:teuthology.orchestra.run.smithi110.stderr: 42900K .......... .......... .......... .......... .......... 46% 132M 1s 2024-03-04T12:37:57.672 INFO:teuthology.orchestra.run.smithi110.stderr: 42950K .......... .......... .......... .......... .......... 46% 93.3M 1s 2024-03-04T12:37:57.672 INFO:teuthology.orchestra.run.smithi110.stderr: 43000K .......... .......... .......... .......... .......... 46% 99.3M 1s 2024-03-04T12:37:57.672 INFO:teuthology.orchestra.run.smithi110.stderr: 43050K .......... .......... .......... .......... .......... 46% 88.7M 1s 2024-03-04T12:37:57.672 INFO:teuthology.orchestra.run.smithi110.stderr: 43100K .......... .......... .......... .......... .......... 46% 99.7M 1s 2024-03-04T12:37:57.672 INFO:teuthology.orchestra.run.smithi110.stderr: 43150K .......... .......... .......... .......... .......... 46% 119M 1s 2024-03-04T12:37:57.672 INFO:teuthology.orchestra.run.smithi110.stderr: 43200K .......... .......... .......... .......... .......... 46% 110M 1s 2024-03-04T12:37:57.672 INFO:teuthology.orchestra.run.smithi110.stderr: 43250K .......... .......... .......... .......... .......... 46% 20.2M 1s 2024-03-04T12:37:57.672 INFO:teuthology.orchestra.run.smithi110.stderr: 43300K .......... .......... .......... .......... .......... 46% 73.4M 1s 2024-03-04T12:37:57.672 INFO:teuthology.orchestra.run.smithi110.stderr: 43350K .......... .......... .......... .......... .......... 46% 117M 1s 2024-03-04T12:37:57.672 INFO:teuthology.orchestra.run.smithi110.stderr: 43400K .......... .......... .......... .......... .......... 46% 82.3M 1s 2024-03-04T12:37:57.672 INFO:teuthology.orchestra.run.smithi110.stderr: 43450K .......... .......... .......... .......... .......... 46% 97.1M 1s 2024-03-04T12:37:57.673 INFO:teuthology.orchestra.run.smithi110.stderr: 43500K .......... .......... .......... .......... .......... 46% 114M 1s 2024-03-04T12:37:57.673 INFO:teuthology.orchestra.run.smithi110.stderr: 43550K .......... .......... .......... .......... .......... 46% 79.5M 1s 2024-03-04T12:37:57.673 INFO:teuthology.orchestra.run.smithi110.stderr: 43600K .......... .......... .......... .......... .......... 46% 116M 1s 2024-03-04T12:37:57.673 INFO:teuthology.orchestra.run.smithi110.stderr: 43650K .......... .......... .......... .......... .......... 47% 77.0M 1s 2024-03-04T12:37:57.673 INFO:teuthology.orchestra.run.smithi110.stderr: 43700K .......... .......... .......... .......... .......... 47% 115M 1s 2024-03-04T12:37:57.673 INFO:teuthology.orchestra.run.smithi110.stderr: 43750K .......... .......... .......... .......... .......... 47% 89.3M 1s 2024-03-04T12:37:57.673 INFO:teuthology.orchestra.run.smithi110.stderr: 43800K .......... .......... .......... .......... .......... 47% 88.0M 1s 2024-03-04T12:37:57.673 INFO:teuthology.orchestra.run.smithi110.stderr: 43850K .......... .......... .......... .......... .......... 47% 118M 1s 2024-03-04T12:37:57.673 INFO:teuthology.orchestra.run.smithi110.stderr: 43900K .......... .......... .......... .......... .......... 47% 93.5M 1s 2024-03-04T12:37:57.673 INFO:teuthology.orchestra.run.smithi110.stderr: 43950K .......... .......... .......... .......... .......... 47% 94.1M 1s 2024-03-04T12:37:57.673 INFO:teuthology.orchestra.run.smithi110.stderr: 44000K .......... .......... .......... .......... .......... 47% 90.9M 1s 2024-03-04T12:37:57.673 INFO:teuthology.orchestra.run.smithi110.stderr: 44050K .......... .......... .......... .......... .......... 47% 125M 1s 2024-03-04T12:37:57.673 INFO:teuthology.orchestra.run.smithi110.stderr: 44100K .......... .......... .......... .......... .......... 47% 114M 1s 2024-03-04T12:37:57.673 INFO:teuthology.orchestra.run.smithi110.stderr: 44150K .......... .......... .......... .......... .......... 47% 64.9M 1s 2024-03-04T12:37:57.673 INFO:teuthology.orchestra.run.smithi110.stderr: 44200K .......... .......... .......... .......... .......... 47% 108M 1s 2024-03-04T12:37:57.674 INFO:teuthology.orchestra.run.smithi110.stderr: 44250K .......... .......... .......... .......... .......... 47% 78.5M 1s 2024-03-04T12:37:57.674 INFO:teuthology.orchestra.run.smithi110.stderr: 44300K .......... .......... .......... .......... .......... 47% 113M 1s 2024-03-04T12:37:57.674 INFO:teuthology.orchestra.run.smithi110.stderr: 44350K .......... .......... .......... .......... .......... 47% 56.1M 1s 2024-03-04T12:37:57.674 INFO:teuthology.orchestra.run.smithi110.stderr: 44400K .......... .......... .......... .......... .......... 47% 81.9M 1s 2024-03-04T12:37:57.674 INFO:teuthology.orchestra.run.smithi110.stderr: 44450K .......... .......... .......... .......... .......... 47% 102M 1s 2024-03-04T12:37:57.674 INFO:teuthology.orchestra.run.smithi110.stderr: 44500K .......... .......... .......... .......... .......... 47% 124M 1s 2024-03-04T12:37:57.674 INFO:teuthology.orchestra.run.smithi110.stderr: 44550K .......... .......... .......... .......... .......... 48% 72.2M 1s 2024-03-04T12:37:57.674 INFO:teuthology.orchestra.run.smithi110.stderr: 44600K .......... .......... .......... .......... .......... 48% 86.1M 1s 2024-03-04T12:37:57.674 INFO:teuthology.orchestra.run.smithi110.stderr: 44650K .......... .......... .......... .......... .......... 48% 114M 1s 2024-03-04T12:37:57.674 INFO:teuthology.orchestra.run.smithi110.stderr: 44700K .......... .......... .......... .......... .......... 48% 96.7M 1s 2024-03-04T12:37:57.674 INFO:teuthology.orchestra.run.smithi110.stderr: 44750K .......... .......... .......... .......... .......... 48% 111M 1s 2024-03-04T12:37:57.674 INFO:teuthology.orchestra.run.smithi110.stderr: 44800K .......... .......... .......... .......... .......... 48% 119M 1s 2024-03-04T12:37:57.674 INFO:teuthology.orchestra.run.smithi110.stderr: 44850K .......... .......... .......... .......... .......... 48% 99.2M 1s 2024-03-04T12:37:57.674 INFO:teuthology.orchestra.run.smithi110.stderr: 44900K .......... .......... .......... .......... .......... 48% 86.6M 1s 2024-03-04T12:37:57.674 INFO:teuthology.orchestra.run.smithi110.stderr: 44950K .......... .......... .......... .......... .......... 48% 72.5M 1s 2024-03-04T12:37:57.675 INFO:teuthology.orchestra.run.smithi110.stderr: 45000K .......... .......... .......... .......... .......... 48% 115M 1s 2024-03-04T12:37:57.675 INFO:teuthology.orchestra.run.smithi110.stderr: 45050K .......... .......... .......... .......... .......... 48% 114M 1s 2024-03-04T12:37:57.675 INFO:teuthology.orchestra.run.smithi110.stderr: 45100K .......... .......... .......... .......... .......... 48% 96.7M 1s 2024-03-04T12:37:57.675 INFO:teuthology.orchestra.run.smithi110.stderr: 45150K .......... .......... .......... .......... .......... 48% 95.2M 1s 2024-03-04T12:37:57.675 INFO:teuthology.orchestra.run.smithi110.stderr: 45200K .......... .......... .......... .......... .......... 48% 93.8M 1s 2024-03-04T12:37:57.675 INFO:teuthology.orchestra.run.smithi110.stderr: 45250K .......... .......... .......... .......... .......... 48% 116M 1s 2024-03-04T12:37:57.675 INFO:teuthology.orchestra.run.smithi110.stderr: 45300K .......... .......... .......... .......... .......... 48% 103M 1s 2024-03-04T12:37:57.675 INFO:teuthology.orchestra.run.smithi110.stderr: 45350K .......... .......... .......... .......... .......... 48% 78.5M 1s 2024-03-04T12:37:57.675 INFO:teuthology.orchestra.run.smithi110.stderr: 45400K .......... .......... .......... .......... .......... 48% 120M 1s 2024-03-04T12:37:57.675 INFO:teuthology.orchestra.run.smithi110.stderr: 45450K .......... .......... .......... .......... .......... 48% 107M 1s 2024-03-04T12:37:57.675 INFO:teuthology.orchestra.run.smithi110.stderr: 45500K .......... .......... .......... .......... .......... 49% 79.9M 1s 2024-03-04T12:37:57.675 INFO:teuthology.orchestra.run.smithi110.stderr: 45550K .......... .......... .......... .......... .......... 49% 75.5M 1s 2024-03-04T12:37:57.675 INFO:teuthology.orchestra.run.smithi110.stderr: 45600K .......... .......... .......... .......... .......... 49% 98.5M 1s 2024-03-04T12:37:57.675 INFO:teuthology.orchestra.run.smithi110.stderr: 45650K .......... .......... .......... .......... .......... 49% 78.4M 1s 2024-03-04T12:37:57.676 INFO:teuthology.orchestra.run.smithi110.stderr: 45700K .......... .......... .......... .......... .......... 49% 113M 1s 2024-03-04T12:37:57.676 INFO:teuthology.orchestra.run.smithi110.stderr: 45750K .......... .......... .......... .......... .......... 49% 119M 1s 2024-03-04T12:37:57.676 INFO:teuthology.orchestra.run.smithi110.stderr: 45800K .......... .......... .......... .......... .......... 49% 90.5M 1s 2024-03-04T12:37:57.676 INFO:teuthology.orchestra.run.smithi110.stderr: 45850K .......... .......... .......... .......... .......... 49% 108M 1s 2024-03-04T12:37:57.676 INFO:teuthology.orchestra.run.smithi110.stderr: 45900K .......... .......... .......... .......... .......... 49% 116M 1s 2024-03-04T12:37:57.676 INFO:teuthology.orchestra.run.smithi110.stderr: 45950K .......... .......... .......... .......... .......... 49% 113M 1s 2024-03-04T12:37:57.676 INFO:teuthology.orchestra.run.smithi110.stderr: 46000K .......... .......... .......... .......... .......... 49% 101M 1s 2024-03-04T12:37:57.676 INFO:teuthology.orchestra.run.smithi110.stderr: 46050K .......... .......... .......... .......... .......... 49% 76.4M 1s 2024-03-04T12:37:57.676 INFO:teuthology.orchestra.run.smithi110.stderr: 46100K .......... .......... .......... .......... .......... 49% 119M 1s 2024-03-04T12:37:57.676 INFO:teuthology.orchestra.run.smithi110.stderr: 46150K .......... .......... .......... .......... .......... 49% 94.6M 1s 2024-03-04T12:37:57.676 INFO:teuthology.orchestra.run.smithi110.stderr: 46200K .......... .......... .......... .......... .......... 49% 120M 1s 2024-03-04T12:37:57.676 INFO:teuthology.orchestra.run.smithi110.stderr: 46250K .......... .......... .......... .......... .......... 49% 102M 1s 2024-03-04T12:37:57.676 INFO:teuthology.orchestra.run.smithi110.stderr: 46300K .......... .......... .......... .......... .......... 49% 92.9M 1s 2024-03-04T12:37:57.676 INFO:teuthology.orchestra.run.smithi110.stderr: 46350K .......... .......... .......... .......... .......... 49% 112M 1s 2024-03-04T12:37:57.677 INFO:teuthology.orchestra.run.smithi110.stderr: 46400K .......... .......... .......... .......... .......... 49% 117M 1s 2024-03-04T12:37:57.677 INFO:teuthology.orchestra.run.smithi110.stderr: 46450K .......... .......... .......... .......... .......... 50% 70.2M 1s 2024-03-04T12:37:57.677 INFO:teuthology.orchestra.run.smithi110.stderr: 46500K .......... .......... .......... .......... .......... 50% 101M 1s 2024-03-04T12:37:57.677 INFO:teuthology.orchestra.run.smithi110.stderr: 46550K .......... .......... .......... .......... .......... 50% 84.4M 1s 2024-03-04T12:37:57.677 INFO:teuthology.orchestra.run.smithi110.stderr: 46600K .......... .......... .......... .......... .......... 50% 94.7M 1s 2024-03-04T12:37:57.677 INFO:teuthology.orchestra.run.smithi110.stderr: 46650K .......... .......... .......... .......... .......... 50% 115M 1s 2024-03-04T12:37:57.677 INFO:teuthology.orchestra.run.smithi110.stderr: 46700K .......... .......... .......... .......... .......... 50% 69.5M 1s 2024-03-04T12:37:57.677 INFO:teuthology.orchestra.run.smithi110.stderr: 46750K .......... .......... .......... .......... .......... 50% 95.5M 1s 2024-03-04T12:37:57.677 INFO:teuthology.orchestra.run.smithi110.stderr: 46800K .......... .......... .......... .......... .......... 50% 91.0M 1s 2024-03-04T12:37:57.677 INFO:teuthology.orchestra.run.smithi110.stderr: 46850K .......... .......... .......... .......... .......... 50% 77.1M 1s 2024-03-04T12:37:57.677 INFO:teuthology.orchestra.run.smithi110.stderr: 46900K .......... .......... .......... .......... .......... 50% 119M 1s 2024-03-04T12:37:57.677 INFO:teuthology.orchestra.run.smithi110.stderr: 46950K .......... .......... .......... .......... .......... 50% 114M 1s 2024-03-04T12:37:57.677 INFO:teuthology.orchestra.run.smithi110.stderr: 47000K .......... .......... .......... .......... .......... 50% 104M 1s 2024-03-04T12:37:57.677 INFO:teuthology.orchestra.run.smithi110.stderr: 47050K .......... .......... .......... .......... .......... 50% 98.5M 1s 2024-03-04T12:37:57.677 INFO:teuthology.orchestra.run.smithi110.stderr: 47100K .......... .......... .......... .......... .......... 50% 140M 1s 2024-03-04T12:37:57.678 INFO:teuthology.orchestra.run.smithi110.stderr: 47150K .......... .......... .......... .......... .......... 50% 95.9M 1s 2024-03-04T12:37:57.678 INFO:teuthology.orchestra.run.smithi110.stderr: 47200K .......... .......... .......... .......... .......... 50% 99.4M 1s 2024-03-04T12:37:57.678 INFO:teuthology.orchestra.run.smithi110.stderr: 47250K .......... .......... .......... .......... .......... 50% 91.0M 1s 2024-03-04T12:37:57.678 INFO:teuthology.orchestra.run.smithi110.stderr: 47300K .......... .......... .......... .......... .......... 50% 112M 1s 2024-03-04T12:37:57.678 INFO:teuthology.orchestra.run.smithi110.stderr: 47350K .......... .......... .......... .......... .......... 51% 106M 1s 2024-03-04T12:37:57.678 INFO:teuthology.orchestra.run.smithi110.stderr: 47400K .......... .......... .......... .......... .......... 51% 88.0M 1s 2024-03-04T12:37:57.678 INFO:teuthology.orchestra.run.smithi110.stderr: 47450K .......... .......... .......... .......... .......... 51% 126M 1s 2024-03-04T12:37:57.678 INFO:teuthology.orchestra.run.smithi110.stderr: 47500K .......... .......... .......... .......... .......... 51% 102M 1s 2024-03-04T12:37:57.678 INFO:teuthology.orchestra.run.smithi110.stderr: 47550K .......... .......... .......... .......... .......... 51% 122M 1s 2024-03-04T12:37:57.678 INFO:teuthology.orchestra.run.smithi110.stderr: 47600K .......... .......... .......... .......... .......... 51% 65.8M 1s 2024-03-04T12:37:57.678 INFO:teuthology.orchestra.run.smithi110.stderr: 47650K .......... .......... .......... .......... .......... 51% 82.9M 1s 2024-03-04T12:37:57.678 INFO:teuthology.orchestra.run.smithi110.stderr: 47700K .......... .......... .......... .......... .......... 51% 107M 1s 2024-03-04T12:37:57.678 INFO:teuthology.orchestra.run.smithi110.stderr: 47750K .......... .......... .......... .......... .......... 51% 105M 1s 2024-03-04T12:37:57.678 INFO:teuthology.orchestra.run.smithi110.stderr: 47800K .......... .......... .......... .......... .......... 51% 97.2M 1s 2024-03-04T12:37:57.679 INFO:teuthology.orchestra.run.smithi110.stderr: 47850K .......... .......... .......... .......... .......... 51% 121M 1s 2024-03-04T12:37:57.679 INFO:teuthology.orchestra.run.smithi110.stderr: 47900K .......... .......... .......... .......... .......... 51% 97.5M 1s 2024-03-04T12:37:57.679 INFO:teuthology.orchestra.run.smithi110.stderr: 47950K .......... .......... .......... .......... .......... 51% 85.0M 1s 2024-03-04T12:37:57.679 INFO:teuthology.orchestra.run.smithi110.stderr: 48000K .......... .......... .......... .......... .......... 51% 67.7M 1s 2024-03-04T12:37:57.679 INFO:teuthology.orchestra.run.smithi110.stderr: 48050K .......... .......... .......... .......... .......... 51% 115M 1s 2024-03-04T12:37:57.679 INFO:teuthology.orchestra.run.smithi110.stderr: 48100K .......... .......... .......... .......... .......... 51% 89.1M 1s 2024-03-04T12:37:57.679 INFO:teuthology.orchestra.run.smithi110.stderr: 48150K .......... .......... .......... .......... .......... 51% 113M 1s 2024-03-04T12:37:57.679 INFO:teuthology.orchestra.run.smithi110.stderr: 48200K .......... .......... .......... .......... .......... 51% 98.5M 1s 2024-03-04T12:37:57.679 INFO:teuthology.orchestra.run.smithi110.stderr: 48250K .......... .......... .......... .......... .......... 51% 79.5M 1s 2024-03-04T12:37:57.679 INFO:teuthology.orchestra.run.smithi110.stderr: 48300K .......... .......... .......... .......... .......... 52% 121M 1s 2024-03-04T12:37:57.679 INFO:teuthology.orchestra.run.smithi110.stderr: 48350K .......... .......... .......... .......... .......... 52% 89.7M 1s 2024-03-04T12:37:57.679 INFO:teuthology.orchestra.run.smithi110.stderr: 48400K .......... .......... .......... .......... .......... 52% 111M 1s 2024-03-04T12:37:57.679 INFO:teuthology.orchestra.run.smithi110.stderr: 48450K .......... .......... .......... .......... .......... 52% 90.7M 1s 2024-03-04T12:37:57.679 INFO:teuthology.orchestra.run.smithi110.stderr: 48500K .......... .......... .......... .......... .......... 52% 76.6M 1s 2024-03-04T12:37:57.679 INFO:teuthology.orchestra.run.smithi110.stderr: 48550K .......... .......... .......... .......... .......... 52% 134M 1s 2024-03-04T12:37:57.680 INFO:teuthology.orchestra.run.smithi110.stderr: 48600K .......... .......... .......... .......... .......... 52% 115M 1s 2024-03-04T12:37:57.680 INFO:teuthology.orchestra.run.smithi110.stderr: 48650K .......... .......... .......... .......... .......... 52% 58.0M 1s 2024-03-04T12:37:57.680 INFO:teuthology.orchestra.run.smithi110.stderr: 48700K .......... .......... .......... .......... .......... 52% 114M 1s 2024-03-04T12:37:57.680 INFO:teuthology.orchestra.run.smithi110.stderr: 48750K .......... .......... .......... .......... .......... 52% 88.1M 1s 2024-03-04T12:37:57.680 INFO:teuthology.orchestra.run.smithi110.stderr: 48800K .......... .......... .......... .......... .......... 52% 130M 1s 2024-03-04T12:37:57.680 INFO:teuthology.orchestra.run.smithi110.stderr: 48850K .......... .......... .......... .......... .......... 52% 75.4M 1s 2024-03-04T12:37:57.680 INFO:teuthology.orchestra.run.smithi110.stderr: 48900K .......... .......... .......... .......... .......... 52% 99.3M 1s 2024-03-04T12:37:57.680 INFO:teuthology.orchestra.run.smithi110.stderr: 48950K .......... .......... .......... .......... .......... 52% 120M 1s 2024-03-04T12:37:57.680 INFO:teuthology.orchestra.run.smithi110.stderr: 49000K .......... .......... .......... .......... .......... 52% 75.0M 1s 2024-03-04T12:37:57.680 INFO:teuthology.orchestra.run.smithi110.stderr: 49050K .......... .......... .......... .......... .......... 52% 95.8M 1s 2024-03-04T12:37:57.680 INFO:teuthology.orchestra.run.smithi110.stderr: 49100K .......... .......... .......... .......... .......... 52% 91.5M 1s 2024-03-04T12:37:57.680 INFO:teuthology.orchestra.run.smithi110.stderr: 49150K .......... .......... .......... .......... .......... 52% 94.8M 1s 2024-03-04T12:37:57.680 INFO:teuthology.orchestra.run.smithi110.stderr: 49200K .......... .......... .......... .......... .......... 53% 181M 1s 2024-03-04T12:37:57.681 INFO:teuthology.orchestra.run.smithi110.stderr: 49250K .......... .......... .......... .......... .......... 53% 71.9M 1s 2024-03-04T12:37:57.681 INFO:teuthology.orchestra.run.smithi110.stderr: 49300K .......... .......... .......... .......... .......... 53% 110M 1s 2024-03-04T12:37:57.681 INFO:teuthology.orchestra.run.smithi110.stderr: 49350K .......... .......... .......... .......... .......... 53% 109M 1s 2024-03-04T12:37:57.681 INFO:teuthology.orchestra.run.smithi110.stderr: 49400K .......... .......... .......... .......... .......... 53% 115M 1s 2024-03-04T12:37:57.681 INFO:teuthology.orchestra.run.smithi110.stderr: 49450K .......... .......... .......... .......... .......... 53% 65.4M 1s 2024-03-04T12:37:57.681 INFO:teuthology.orchestra.run.smithi110.stderr: 49500K .......... .......... .......... .......... .......... 53% 117M 1s 2024-03-04T12:37:57.681 INFO:teuthology.orchestra.run.smithi110.stderr: 49550K .......... .......... .......... .......... .......... 53% 74.9M 1s 2024-03-04T12:37:57.681 INFO:teuthology.orchestra.run.smithi110.stderr: 49600K .......... .......... .......... .......... .......... 53% 92.5M 1s 2024-03-04T12:37:57.681 INFO:teuthology.orchestra.run.smithi110.stderr: 49650K .......... .......... .......... .......... .......... 53% 97.4M 1s 2024-03-04T12:37:57.681 INFO:teuthology.orchestra.run.smithi110.stderr: 49700K .......... .......... .......... .......... .......... 53% 115M 1s 2024-03-04T12:37:57.681 INFO:teuthology.orchestra.run.smithi110.stderr: 49750K .......... .......... .......... .......... .......... 53% 87.0M 1s 2024-03-04T12:37:57.681 INFO:teuthology.orchestra.run.smithi110.stderr: 49800K .......... .......... .......... .......... .......... 53% 115M 1s 2024-03-04T12:37:57.681 INFO:teuthology.orchestra.run.smithi110.stderr: 49850K .......... .......... .......... .......... .......... 53% 52.7M 1s 2024-03-04T12:37:57.681 INFO:teuthology.orchestra.run.smithi110.stderr: 49900K .......... .......... .......... .......... .......... 53% 179M 1s 2024-03-04T12:37:57.682 INFO:teuthology.orchestra.run.smithi110.stderr: 49950K .......... .......... .......... .......... .......... 53% 105M 1s 2024-03-04T12:37:57.682 INFO:teuthology.orchestra.run.smithi110.stderr: 50000K .......... .......... .......... .......... .......... 53% 98.3M 1s 2024-03-04T12:37:57.682 INFO:teuthology.orchestra.run.smithi110.stderr: 50050K .......... .......... .......... .......... .......... 53% 88.3M 1s 2024-03-04T12:37:57.682 INFO:teuthology.orchestra.run.smithi110.stderr: 50100K .......... .......... .......... .......... .......... 53% 120M 1s 2024-03-04T12:37:57.682 INFO:teuthology.orchestra.run.smithi110.stderr: 50150K .......... .......... .......... .......... .......... 54% 78.3M 1s 2024-03-04T12:37:57.682 INFO:teuthology.orchestra.run.smithi110.stderr: 50200K .......... .......... .......... .......... .......... 54% 88.3M 1s 2024-03-04T12:37:57.682 INFO:teuthology.orchestra.run.smithi110.stderr: 50250K .......... .......... .......... .......... .......... 54% 115M 1s 2024-03-04T12:37:57.682 INFO:teuthology.orchestra.run.smithi110.stderr: 50300K .......... .......... .......... .......... .......... 54% 93.7M 1s 2024-03-04T12:37:57.682 INFO:teuthology.orchestra.run.smithi110.stderr: 50350K .......... .......... .......... .......... .......... 54% 120M 1s 2024-03-04T12:37:57.682 INFO:teuthology.orchestra.run.smithi110.stderr: 50400K .......... .......... .......... .......... .......... 54% 77.9M 1s 2024-03-04T12:37:57.682 INFO:teuthology.orchestra.run.smithi110.stderr: 50450K .......... .......... .......... .......... .......... 54% 80.9M 1s 2024-03-04T12:37:57.682 INFO:teuthology.orchestra.run.smithi110.stderr: 50500K .......... .......... .......... .......... .......... 54% 119M 1s 2024-03-04T12:37:57.682 INFO:teuthology.orchestra.run.smithi110.stderr: 50550K .......... .......... .......... .......... .......... 54% 89.3M 1s 2024-03-04T12:37:57.683 INFO:teuthology.orchestra.run.smithi110.stderr: 50600K .......... .......... .......... .......... .......... 54% 127M 1s 2024-03-04T12:37:57.683 INFO:teuthology.orchestra.run.smithi110.stderr: 50650K .......... .......... .......... .......... .......... 54% 88.3M 1s 2024-03-04T12:37:57.683 INFO:teuthology.orchestra.run.smithi110.stderr: 50700K .......... .......... .......... .......... .......... 54% 90.9M 1s 2024-03-04T12:37:57.683 INFO:teuthology.orchestra.run.smithi110.stderr: 50750K .......... .......... .......... .......... .......... 54% 103M 1s 2024-03-04T12:37:57.683 INFO:teuthology.orchestra.run.smithi110.stderr: 50800K .......... .......... .......... .......... .......... 54% 90.0M 1s 2024-03-04T12:37:57.683 INFO:teuthology.orchestra.run.smithi110.stderr: 50850K .......... .......... .......... .......... .......... 54% 114M 1s 2024-03-04T12:37:57.683 INFO:teuthology.orchestra.run.smithi110.stderr: 50900K .......... .......... .......... .......... .......... 54% 85.3M 1s 2024-03-04T12:37:57.683 INFO:teuthology.orchestra.run.smithi110.stderr: 50950K .......... .......... .......... .......... .......... 54% 89.1M 1s 2024-03-04T12:37:57.683 INFO:teuthology.orchestra.run.smithi110.stderr: 51000K .......... .......... .......... .......... .......... 54% 98.3M 1s 2024-03-04T12:37:57.683 INFO:teuthology.orchestra.run.smithi110.stderr: 51050K .......... .......... .......... .......... .......... 55% 115M 1s 2024-03-04T12:37:57.683 INFO:teuthology.orchestra.run.smithi110.stderr: 51100K .......... .......... .......... .......... .......... 55% 100M 1s 2024-03-04T12:37:57.683 INFO:teuthology.orchestra.run.smithi110.stderr: 51150K .......... .......... .......... .......... .......... 55% 63.4M 1s 2024-03-04T12:37:57.683 INFO:teuthology.orchestra.run.smithi110.stderr: 51200K .......... .......... .......... .......... .......... 55% 77.0M 1s 2024-03-04T12:37:57.683 INFO:teuthology.orchestra.run.smithi110.stderr: 51250K .......... .......... .......... .......... .......... 55% 120M 1s 2024-03-04T12:37:57.683 INFO:teuthology.orchestra.run.smithi110.stderr: 51300K .......... .......... .......... .......... .......... 55% 114M 1s 2024-03-04T12:37:57.684 INFO:teuthology.orchestra.run.smithi110.stderr: 51350K .......... .......... .......... .......... .......... 55% 87.1M 1s 2024-03-04T12:37:57.684 INFO:teuthology.orchestra.run.smithi110.stderr: 51400K .......... .......... .......... .......... .......... 55% 111M 1s 2024-03-04T12:37:57.684 INFO:teuthology.orchestra.run.smithi110.stderr: 51450K .......... .......... .......... .......... .......... 55% 107M 1s 2024-03-04T12:37:57.684 INFO:teuthology.orchestra.run.smithi110.stderr: 51500K .......... .......... .......... .......... .......... 55% 104M 1s 2024-03-04T12:37:57.684 INFO:teuthology.orchestra.run.smithi110.stderr: 51550K .......... .......... .......... .......... .......... 55% 107M 1s 2024-03-04T12:37:57.684 INFO:teuthology.orchestra.run.smithi110.stderr: 51600K .......... .......... .......... .......... .......... 55% 82.1M 1s 2024-03-04T12:37:57.684 INFO:teuthology.orchestra.run.smithi110.stderr: 51650K .......... .......... .......... .......... .......... 55% 102M 1s 2024-03-04T12:37:57.684 INFO:teuthology.orchestra.run.smithi110.stderr: 51700K .......... .......... .......... .......... .......... 55% 72.2M 1s 2024-03-04T12:37:57.684 INFO:teuthology.orchestra.run.smithi110.stderr: 51750K .......... .......... .......... .......... .......... 55% 96.9M 1s 2024-03-04T12:37:57.684 INFO:teuthology.orchestra.run.smithi110.stderr: 51800K .......... .......... .......... .......... .......... 55% 104M 1s 2024-03-04T12:37:57.684 INFO:teuthology.orchestra.run.smithi110.stderr: 51850K .......... .......... .......... .......... .......... 55% 122M 1s 2024-03-04T12:37:57.684 INFO:teuthology.orchestra.run.smithi110.stderr: 51900K .......... .......... .......... .......... .......... 55% 114M 1s 2024-03-04T12:37:57.684 INFO:teuthology.orchestra.run.smithi110.stderr: 51950K .......... .......... .......... .......... .......... 55% 86.7M 1s 2024-03-04T12:37:57.685 INFO:teuthology.orchestra.run.smithi110.stderr: 52000K .......... .......... .......... .......... .......... 56% 84.5M 1s 2024-03-04T12:37:57.685 INFO:teuthology.orchestra.run.smithi110.stderr: 52050K .......... .......... .......... .......... .......... 56% 119M 1s 2024-03-04T12:37:57.685 INFO:teuthology.orchestra.run.smithi110.stderr: 52100K .......... .......... .......... .......... .......... 56% 90.0M 1s 2024-03-04T12:37:57.685 INFO:teuthology.orchestra.run.smithi110.stderr: 52150K .......... .......... .......... .......... .......... 56% 115M 1s 2024-03-04T12:37:57.685 INFO:teuthology.orchestra.run.smithi110.stderr: 52200K .......... .......... .......... .......... .......... 56% 93.5M 1s 2024-03-04T12:37:57.685 INFO:teuthology.orchestra.run.smithi110.stderr: 52250K .......... .......... .......... .......... .......... 56% 114M 1s 2024-03-04T12:37:57.685 INFO:teuthology.orchestra.run.smithi110.stderr: 52300K .......... .......... .......... .......... .......... 56% 120M 1s 2024-03-04T12:37:57.685 INFO:teuthology.orchestra.run.smithi110.stderr: 52350K .......... .......... .......... .......... .......... 56% 78.4M 1s 2024-03-04T12:37:57.685 INFO:teuthology.orchestra.run.smithi110.stderr: 52400K .......... .......... .......... .......... .......... 56% 79.4M 1s 2024-03-04T12:37:57.685 INFO:teuthology.orchestra.run.smithi110.stderr: 52450K .......... .......... .......... .......... .......... 56% 115M 1s 2024-03-04T12:37:57.685 INFO:teuthology.orchestra.run.smithi110.stderr: 52500K .......... .......... .......... .......... .......... 56% 114M 1s 2024-03-04T12:37:57.685 INFO:teuthology.orchestra.run.smithi110.stderr: 52550K .......... .......... .......... .......... .......... 56% 83.8M 1s 2024-03-04T12:37:57.685 INFO:teuthology.orchestra.run.smithi110.stderr: 52600K .......... .......... .......... .......... .......... 56% 103M 1s 2024-03-04T12:37:57.685 INFO:teuthology.orchestra.run.smithi110.stderr: 52650K .......... .......... .......... .......... .......... 56% 101M 1s 2024-03-04T12:37:57.686 INFO:teuthology.orchestra.run.smithi110.stderr: 52700K .......... .......... .......... .......... .......... 56% 120M 1s 2024-03-04T12:37:57.686 INFO:teuthology.orchestra.run.smithi110.stderr: 52750K .......... .......... .......... .......... .......... 56% 111M 1s 2024-03-04T12:37:57.686 INFO:teuthology.orchestra.run.smithi110.stderr: 52800K .......... .......... .......... .......... .......... 56% 58.8M 1s 2024-03-04T12:37:57.686 INFO:teuthology.orchestra.run.smithi110.stderr: 52850K .......... .......... .......... .......... .......... 56% 95.0M 1s 2024-03-04T12:37:57.686 INFO:teuthology.orchestra.run.smithi110.stderr: 52900K .......... .......... .......... .......... .......... 56% 98.0M 1s 2024-03-04T12:37:57.686 INFO:teuthology.orchestra.run.smithi110.stderr: 52950K .......... .......... .......... .......... .......... 57% 120M 1s 2024-03-04T12:37:57.686 INFO:teuthology.orchestra.run.smithi110.stderr: 53000K .......... .......... .......... .......... .......... 57% 97.7M 1s 2024-03-04T12:37:57.686 INFO:teuthology.orchestra.run.smithi110.stderr: 53050K .......... .......... .......... .......... .......... 57% 107M 1s 2024-03-04T12:37:57.686 INFO:teuthology.orchestra.run.smithi110.stderr: 53100K .......... .......... .......... .......... .......... 57% 121M 1s 2024-03-04T12:37:57.686 INFO:teuthology.orchestra.run.smithi110.stderr: 53150K .......... .......... .......... .......... .......... 57% 108M 1s 2024-03-04T12:37:57.686 INFO:teuthology.orchestra.run.smithi110.stderr: 53200K .......... .......... .......... .......... .......... 57% 66.6M 1s 2024-03-04T12:37:57.686 INFO:teuthology.orchestra.run.smithi110.stderr: 53250K .......... .......... .......... .......... .......... 57% 94.3M 1s 2024-03-04T12:37:57.686 INFO:teuthology.orchestra.run.smithi110.stderr: 53300K .......... .......... .......... .......... .......... 57% 98.7M 1s 2024-03-04T12:37:57.686 INFO:teuthology.orchestra.run.smithi110.stderr: 53350K .......... .......... .......... .......... .......... 57% 98.7M 1s 2024-03-04T12:37:57.687 INFO:teuthology.orchestra.run.smithi110.stderr: 53400K .......... .......... .......... .......... .......... 57% 117M 1s 2024-03-04T12:37:57.687 INFO:teuthology.orchestra.run.smithi110.stderr: 53450K .......... .......... .......... .......... .......... 57% 104M 1s 2024-03-04T12:37:57.687 INFO:teuthology.orchestra.run.smithi110.stderr: 53500K .......... .......... .......... .......... .......... 57% 60.8M 1s 2024-03-04T12:37:57.687 INFO:teuthology.orchestra.run.smithi110.stderr: 53550K .......... .......... .......... .......... .......... 57% 113M 1s 2024-03-04T12:37:57.687 INFO:teuthology.orchestra.run.smithi110.stderr: 53600K .......... .......... .......... .......... .......... 57% 89.2M 1s 2024-03-04T12:37:57.687 INFO:teuthology.orchestra.run.smithi110.stderr: 53650K .......... .......... .......... .......... .......... 57% 118M 1s 2024-03-04T12:37:57.687 INFO:teuthology.orchestra.run.smithi110.stderr: 53700K .......... .......... .......... .......... .......... 57% 117M 1s 2024-03-04T12:37:57.687 INFO:teuthology.orchestra.run.smithi110.stderr: 53750K .......... .......... .......... .......... .......... 57% 95.6M 1s 2024-03-04T12:37:57.687 INFO:teuthology.orchestra.run.smithi110.stderr: 53800K .......... .......... .......... .......... .......... 57% 80.7M 1s 2024-03-04T12:37:57.687 INFO:teuthology.orchestra.run.smithi110.stderr: 53850K .......... .......... .......... .......... .......... 58% 114M 1s 2024-03-04T12:37:57.687 INFO:teuthology.orchestra.run.smithi110.stderr: 53900K .......... .......... .......... .......... .......... 58% 58.4M 1s 2024-03-04T12:37:57.687 INFO:teuthology.orchestra.run.smithi110.stderr: 53950K .......... .......... .......... .......... .......... 58% 80.4M 1s 2024-03-04T12:37:57.687 INFO:teuthology.orchestra.run.smithi110.stderr: 54000K .......... .......... .......... .......... .......... 58% 113M 1s 2024-03-04T12:37:57.687 INFO:teuthology.orchestra.run.smithi110.stderr: 54050K .......... .......... .......... .......... .......... 58% 87.5M 1s 2024-03-04T12:37:57.688 INFO:teuthology.orchestra.run.smithi110.stderr: 54100K .......... .......... .......... .......... .......... 58% 110M 1s 2024-03-04T12:37:57.688 INFO:teuthology.orchestra.run.smithi110.stderr: 54150K .......... .......... .......... .......... .......... 58% 113M 1s 2024-03-04T12:37:57.688 INFO:teuthology.orchestra.run.smithi110.stderr: 54200K .......... .......... .......... .......... .......... 58% 91.6M 1s 2024-03-04T12:37:57.688 INFO:teuthology.orchestra.run.smithi110.stderr: 54250K .......... .......... .......... .......... .......... 58% 88.5M 1s 2024-03-04T12:37:57.688 INFO:teuthology.orchestra.run.smithi110.stderr: 54300K .......... .......... .......... .......... .......... 58% 108M 1s 2024-03-04T12:37:57.688 INFO:teuthology.orchestra.run.smithi110.stderr: 54350K .......... .......... .......... .......... .......... 58% 121M 1s 2024-03-04T12:37:57.688 INFO:teuthology.orchestra.run.smithi110.stderr: 54400K .......... .......... .......... .......... .......... 58% 59.5M 1s 2024-03-04T12:37:57.688 INFO:teuthology.orchestra.run.smithi110.stderr: 54450K .......... .......... .......... .......... .......... 58% 69.3M 1s 2024-03-04T12:37:57.688 INFO:teuthology.orchestra.run.smithi110.stderr: 54500K .......... .......... .......... .......... .......... 58% 81.1M 1s 2024-03-04T12:37:57.688 INFO:teuthology.orchestra.run.smithi110.stderr: 54550K .......... .......... .......... .......... .......... 58% 108M 1s 2024-03-04T12:37:57.688 INFO:teuthology.orchestra.run.smithi110.stderr: 54600K .......... .......... .......... .......... .......... 58% 87.3M 1s 2024-03-04T12:37:57.688 INFO:teuthology.orchestra.run.smithi110.stderr: 54650K .......... .......... .......... .......... .......... 58% 60.5M 1s 2024-03-04T12:37:57.688 INFO:teuthology.orchestra.run.smithi110.stderr: 54700K .......... .......... .......... .......... .......... 58% 74.1M 1s 2024-03-04T12:37:57.688 INFO:teuthology.orchestra.run.smithi110.stderr: 54750K .......... .......... .......... .......... .......... 58% 75.6M 1s 2024-03-04T12:37:57.689 INFO:teuthology.orchestra.run.smithi110.stderr: 54800K .......... .......... .......... .......... .......... 59% 109M 1s 2024-03-04T12:37:57.689 INFO:teuthology.orchestra.run.smithi110.stderr: 54850K .......... .......... .......... .......... .......... 59% 68.6M 1s 2024-03-04T12:37:57.689 INFO:teuthology.orchestra.run.smithi110.stderr: 54900K .......... .......... .......... .......... .......... 59% 118M 1s 2024-03-04T12:37:57.689 INFO:teuthology.orchestra.run.smithi110.stderr: 54950K .......... .......... .......... .......... .......... 59% 106M 1s 2024-03-04T12:37:57.689 INFO:teuthology.orchestra.run.smithi110.stderr: 55000K .......... .......... .......... .......... .......... 59% 81.4M 1s 2024-03-04T12:37:57.689 INFO:teuthology.orchestra.run.smithi110.stderr: 55050K .......... .......... .......... .......... .......... 59% 89.9M 1s 2024-03-04T12:37:57.689 INFO:teuthology.orchestra.run.smithi110.stderr: 55100K .......... .......... .......... .......... .......... 59% 109M 1s 2024-03-04T12:37:57.689 INFO:teuthology.orchestra.run.smithi110.stderr: 55150K .......... .......... .......... .......... .......... 59% 99.1M 1s 2024-03-04T12:37:57.689 INFO:teuthology.orchestra.run.smithi110.stderr: 55200K .......... .......... .......... .......... .......... 59% 113M 1s 2024-03-04T12:37:57.689 INFO:teuthology.orchestra.run.smithi110.stderr: 55250K .......... .......... .......... .......... .......... 59% 96.3M 1s 2024-03-04T12:37:57.689 INFO:teuthology.orchestra.run.smithi110.stderr: 55300K .......... .......... .......... .......... .......... 59% 117M 1s 2024-03-04T12:37:57.689 INFO:teuthology.orchestra.run.smithi110.stderr: 55350K .......... .......... .......... .......... .......... 59% 111M 1s 2024-03-04T12:37:57.689 INFO:teuthology.orchestra.run.smithi110.stderr: 55400K .......... .......... .......... .......... .......... 59% 79.4M 1s 2024-03-04T12:37:57.689 INFO:teuthology.orchestra.run.smithi110.stderr: 55450K .......... .......... .......... .......... .......... 59% 73.7M 1s 2024-03-04T12:37:57.690 INFO:teuthology.orchestra.run.smithi110.stderr: 55500K .......... .......... .......... .......... .......... 59% 117M 1s 2024-03-04T12:37:57.690 INFO:teuthology.orchestra.run.smithi110.stderr: 55550K .......... .......... .......... .......... .......... 59% 112M 1s 2024-03-04T12:37:57.690 INFO:teuthology.orchestra.run.smithi110.stderr: 55600K .......... .......... .......... .......... .......... 59% 97.6M 1s 2024-03-04T12:37:57.690 INFO:teuthology.orchestra.run.smithi110.stderr: 55650K .......... .......... .......... .......... .......... 59% 107M 1s 2024-03-04T12:37:57.690 INFO:teuthology.orchestra.run.smithi110.stderr: 55700K .......... .......... .......... .......... .......... 60% 96.4M 1s 2024-03-04T12:37:57.690 INFO:teuthology.orchestra.run.smithi110.stderr: 55750K .......... .......... .......... .......... .......... 60% 112M 1s 2024-03-04T12:37:57.690 INFO:teuthology.orchestra.run.smithi110.stderr: 55800K .......... .......... .......... .......... .......... 60% 97.7M 1s 2024-03-04T12:37:57.690 INFO:teuthology.orchestra.run.smithi110.stderr: 55850K .......... .......... .......... .......... .......... 60% 93.0M 1s 2024-03-04T12:37:57.690 INFO:teuthology.orchestra.run.smithi110.stderr: 55900K .......... .......... .......... .......... .......... 60% 83.9M 1s 2024-03-04T12:37:57.690 INFO:teuthology.orchestra.run.smithi110.stderr: 55950K .......... .......... .......... .......... .......... 60% 84.2M 1s 2024-03-04T12:37:57.690 INFO:teuthology.orchestra.run.smithi110.stderr: 56000K .......... .......... .......... .......... .......... 60% 119M 1s 2024-03-04T12:37:57.690 INFO:teuthology.orchestra.run.smithi110.stderr: 56050K .......... .......... .......... .......... .......... 60% 109M 1s 2024-03-04T12:37:57.690 INFO:teuthology.orchestra.run.smithi110.stderr: 56100K .......... .......... .......... .......... .......... 60% 98.3M 1s 2024-03-04T12:37:57.690 INFO:teuthology.orchestra.run.smithi110.stderr: 56150K .......... .......... .......... .......... .......... 60% 82.3M 1s 2024-03-04T12:37:57.690 INFO:teuthology.orchestra.run.smithi110.stderr: 56200K .......... .......... .......... .......... .......... 60% 125M 1s 2024-03-04T12:37:57.691 INFO:teuthology.orchestra.run.smithi110.stderr: 56250K .......... .......... .......... .......... .......... 60% 68.7M 1s 2024-03-04T12:37:57.691 INFO:teuthology.orchestra.run.smithi110.stderr: 56300K .......... .......... .......... .......... .......... 60% 98.3M 1s 2024-03-04T12:37:57.691 INFO:teuthology.orchestra.run.smithi110.stderr: 56350K .......... .......... .......... .......... .......... 60% 117M 1s 2024-03-04T12:37:57.691 INFO:teuthology.orchestra.run.smithi110.stderr: 56400K .......... .......... .......... .......... .......... 60% 78.8M 1s 2024-03-04T12:37:57.691 INFO:teuthology.orchestra.run.smithi110.stderr: 56450K .......... .......... .......... .......... .......... 60% 111M 1s 2024-03-04T12:37:57.691 INFO:teuthology.orchestra.run.smithi110.stderr: 56500K .......... .......... .......... .......... .......... 60% 93.7M 1s 2024-03-04T12:37:57.691 INFO:teuthology.orchestra.run.smithi110.stderr: 56550K .......... .......... .......... .......... .......... 60% 82.3M 1s 2024-03-04T12:37:57.691 INFO:teuthology.orchestra.run.smithi110.stderr: 56600K .......... .......... .......... .......... .......... 60% 117M 1s 2024-03-04T12:37:57.691 INFO:teuthology.orchestra.run.smithi110.stderr: 56650K .......... .......... .......... .......... .......... 61% 81.3M 1s 2024-03-04T12:37:57.691 INFO:teuthology.orchestra.run.smithi110.stderr: 56700K .......... .......... .......... .......... .......... 61% 113M 1s 2024-03-04T12:37:57.691 INFO:teuthology.orchestra.run.smithi110.stderr: 56750K .......... .......... .......... .......... .......... 61% 111M 1s 2024-03-04T12:37:57.691 INFO:teuthology.orchestra.run.smithi110.stderr: 56800K .......... .......... .......... .......... .......... 61% 89.8M 1s 2024-03-04T12:37:57.691 INFO:teuthology.orchestra.run.smithi110.stderr: 56850K .......... .......... .......... .......... .......... 61% 90.3M 1s 2024-03-04T12:37:57.691 INFO:teuthology.orchestra.run.smithi110.stderr: 56900K .......... .......... .......... .......... .......... 61% 121M 1s 2024-03-04T12:37:57.691 INFO:teuthology.orchestra.run.smithi110.stderr: 56950K .......... .......... .......... .......... .......... 61% 73.4M 1s 2024-03-04T12:37:57.692 INFO:teuthology.orchestra.run.smithi110.stderr: 57000K .......... .......... .......... .......... .......... 61% 95.5M 1s 2024-03-04T12:37:57.692 INFO:teuthology.orchestra.run.smithi110.stderr: 57050K .......... .......... .......... .......... .......... 61% 82.1M 1s 2024-03-04T12:37:57.692 INFO:teuthology.orchestra.run.smithi110.stderr: 57100K .......... .......... .......... .......... .......... 61% 118M 1s 2024-03-04T12:37:57.692 INFO:teuthology.orchestra.run.smithi110.stderr: 57150K .......... .......... .......... .......... .......... 61% 117M 1s 2024-03-04T12:37:57.692 INFO:teuthology.orchestra.run.smithi110.stderr: 57200K .......... .......... .......... .......... .......... 61% 79.5M 1s 2024-03-04T12:37:57.692 INFO:teuthology.orchestra.run.smithi110.stderr: 57250K .......... .......... .......... .......... .......... 61% 89.0M 1s 2024-03-04T12:37:57.692 INFO:teuthology.orchestra.run.smithi110.stderr: 57300K .......... .......... .......... .......... .......... 61% 114M 1s 2024-03-04T12:37:57.692 INFO:teuthology.orchestra.run.smithi110.stderr: 57350K .......... .......... .......... .......... .......... 61% 114M 1s 2024-03-04T12:37:57.692 INFO:teuthology.orchestra.run.smithi110.stderr: 57400K .......... .......... .......... .......... .......... 61% 98.9M 1s 2024-03-04T12:37:57.692 INFO:teuthology.orchestra.run.smithi110.stderr: 57450K .......... .......... .......... .......... .......... 61% 88.1M 1s 2024-03-04T12:37:57.692 INFO:teuthology.orchestra.run.smithi110.stderr: 57500K .......... .......... .......... .......... .......... 61% 117M 1s 2024-03-04T12:37:57.692 INFO:teuthology.orchestra.run.smithi110.stderr: 57550K .......... .......... .......... .......... .......... 62% 111M 1s 2024-03-04T12:37:57.692 INFO:teuthology.orchestra.run.smithi110.stderr: 57600K .......... .......... .......... .......... .......... 62% 115M 1s 2024-03-04T12:37:57.693 INFO:teuthology.orchestra.run.smithi110.stderr: 57650K .......... .......... .......... .......... .......... 62% 95.9M 1s 2024-03-04T12:37:57.693 INFO:teuthology.orchestra.run.smithi110.stderr: 57700K .......... .......... .......... .......... .......... 62% 101M 1s 2024-03-04T12:37:57.693 INFO:teuthology.orchestra.run.smithi110.stderr: 57750K .......... .......... .......... .......... .......... 62% 112M 1s 2024-03-04T12:37:57.693 INFO:teuthology.orchestra.run.smithi110.stderr: 57800K .......... .......... .......... .......... .......... 62% 114M 1s 2024-03-04T12:37:57.693 INFO:teuthology.orchestra.run.smithi110.stderr: 57850K .......... .......... .......... .......... .......... 62% 75.9M 1s 2024-03-04T12:37:57.693 INFO:teuthology.orchestra.run.smithi110.stderr: 57900K .......... .......... .......... .......... .......... 62% 113M 1s 2024-03-04T12:37:57.693 INFO:teuthology.orchestra.run.smithi110.stderr: 57950K .......... .......... .......... .......... .......... 62% 119M 1s 2024-03-04T12:37:57.693 INFO:teuthology.orchestra.run.smithi110.stderr: 58000K .......... .......... .......... .......... .......... 62% 82.2M 1s 2024-03-04T12:37:57.693 INFO:teuthology.orchestra.run.smithi110.stderr: 58050K .......... .......... .......... .......... .......... 62% 86.7M 1s 2024-03-04T12:37:57.693 INFO:teuthology.orchestra.run.smithi110.stderr: 58100K .......... .......... .......... .......... .......... 62% 118M 1s 2024-03-04T12:37:57.693 INFO:teuthology.orchestra.run.smithi110.stderr: 58150K .......... .......... .......... .......... .......... 62% 94.4M 1s 2024-03-04T12:37:57.693 INFO:teuthology.orchestra.run.smithi110.stderr: 58200K .......... .......... .......... .......... .......... 62% 118M 1s 2024-03-04T12:37:57.693 INFO:teuthology.orchestra.run.smithi110.stderr: 58250K .......... .......... .......... .......... .......... 62% 90.8M 1s 2024-03-04T12:37:57.693 INFO:teuthology.orchestra.run.smithi110.stderr: 58300K .......... .......... .......... .......... .......... 62% 111M 1s 2024-03-04T12:37:57.693 INFO:teuthology.orchestra.run.smithi110.stderr: 58350K .......... .......... .......... .......... .......... 62% 119M 1s 2024-03-04T12:37:57.694 INFO:teuthology.orchestra.run.smithi110.stderr: 58400K .......... .......... .......... .......... .......... 62% 107M 1s 2024-03-04T12:37:57.694 INFO:teuthology.orchestra.run.smithi110.stderr: 58450K .......... .......... .......... .......... .......... 62% 87.7M 1s 2024-03-04T12:37:57.694 INFO:teuthology.orchestra.run.smithi110.stderr: 58500K .......... .......... .......... .......... .......... 63% 90.1M 1s 2024-03-04T12:37:57.694 INFO:teuthology.orchestra.run.smithi110.stderr: 58550K .......... .......... .......... .......... .......... 63% 116M 1s 2024-03-04T12:37:57.694 INFO:teuthology.orchestra.run.smithi110.stderr: 58600K .......... .......... .......... .......... .......... 63% 108M 1s 2024-03-04T12:37:57.694 INFO:teuthology.orchestra.run.smithi110.stderr: 58650K .......... .......... .......... .......... .......... 63% 81.8M 1s 2024-03-04T12:37:57.694 INFO:teuthology.orchestra.run.smithi110.stderr: 58700K .......... .......... .......... .......... .......... 63% 108M 1s 2024-03-04T12:37:57.694 INFO:teuthology.orchestra.run.smithi110.stderr: 58750K .......... .......... .......... .......... .......... 63% 92.0M 1s 2024-03-04T12:37:57.694 INFO:teuthology.orchestra.run.smithi110.stderr: 58800K .......... .......... .......... .......... .......... 63% 111M 1s 2024-03-04T12:37:57.694 INFO:teuthology.orchestra.run.smithi110.stderr: 58850K .......... .......... .......... .......... .......... 63% 98.8M 1s 2024-03-04T12:37:57.694 INFO:teuthology.orchestra.run.smithi110.stderr: 58900K .......... .......... .......... .......... .......... 63% 104M 1s 2024-03-04T12:37:57.694 INFO:teuthology.orchestra.run.smithi110.stderr: 58950K .......... .......... .......... .......... .......... 63% 83.1M 1s 2024-03-04T12:37:57.694 INFO:teuthology.orchestra.run.smithi110.stderr: 59000K .......... .......... .......... .......... .......... 63% 120M 1s 2024-03-04T12:37:57.694 INFO:teuthology.orchestra.run.smithi110.stderr: 59050K .......... .......... .......... .......... .......... 63% 87.3M 1s 2024-03-04T12:37:57.695 INFO:teuthology.orchestra.run.smithi110.stderr: 59100K .......... .......... .......... .......... .......... 63% 115M 1s 2024-03-04T12:37:57.695 INFO:teuthology.orchestra.run.smithi110.stderr: 59150K .......... .......... .......... .......... .......... 63% 98.4M 1s 2024-03-04T12:37:57.695 INFO:teuthology.orchestra.run.smithi110.stderr: 59200K .......... .......... .......... .......... .......... 63% 114M 1s 2024-03-04T12:37:57.695 INFO:teuthology.orchestra.run.smithi110.stderr: 59250K .......... .......... .......... .......... .......... 63% 108M 1s 2024-03-04T12:37:57.695 INFO:teuthology.orchestra.run.smithi110.stderr: 59300K .......... .......... .......... .......... .......... 63% 119M 1s 2024-03-04T12:37:57.695 INFO:teuthology.orchestra.run.smithi110.stderr: 59350K .......... .......... .......... .......... .......... 63% 107M 1s 2024-03-04T12:37:57.695 INFO:teuthology.orchestra.run.smithi110.stderr: 59400K .......... .......... .......... .......... .......... 63% 125M 1s 2024-03-04T12:37:57.695 INFO:teuthology.orchestra.run.smithi110.stderr: 59450K .......... .......... .......... .......... .......... 64% 72.4M 1s 2024-03-04T12:37:57.695 INFO:teuthology.orchestra.run.smithi110.stderr: 59500K .......... .......... .......... .......... .......... 64% 104M 1s 2024-03-04T12:37:57.695 INFO:teuthology.orchestra.run.smithi110.stderr: 59550K .......... .......... .......... .......... .......... 64% 97.4M 1s 2024-03-04T12:37:57.695 INFO:teuthology.orchestra.run.smithi110.stderr: 59600K .......... .......... .......... .......... .......... 64% 116M 1s 2024-03-04T12:37:57.695 INFO:teuthology.orchestra.run.smithi110.stderr: 59650K .......... .......... .......... .......... .......... 64% 101M 1s 2024-03-04T12:37:57.695 INFO:teuthology.orchestra.run.smithi110.stderr: 59700K .......... .......... .......... .......... .......... 64% 115M 1s 2024-03-04T12:37:57.695 INFO:teuthology.orchestra.run.smithi110.stderr: 59750K .......... .......... .......... .......... .......... 64% 99.8M 1s 2024-03-04T12:37:57.696 INFO:teuthology.orchestra.run.smithi110.stderr: 59800K .......... .......... .......... .......... .......... 64% 93.5M 1s 2024-03-04T12:37:57.696 INFO:teuthology.orchestra.run.smithi110.stderr: 59850K .......... .......... .......... .......... .......... 64% 86.4M 1s 2024-03-04T12:37:57.696 INFO:teuthology.orchestra.run.smithi110.stderr: 59900K .......... .......... .......... .......... .......... 64% 116M 1s 2024-03-04T12:37:57.696 INFO:teuthology.orchestra.run.smithi110.stderr: 59950K .......... .......... .......... .......... .......... 64% 111M 1s 2024-03-04T12:37:57.696 INFO:teuthology.orchestra.run.smithi110.stderr: 60000K .......... .......... .......... .......... .......... 64% 117M 1s 2024-03-04T12:37:57.696 INFO:teuthology.orchestra.run.smithi110.stderr: 60050K .......... .......... .......... .......... .......... 64% 105M 1s 2024-03-04T12:37:57.696 INFO:teuthology.orchestra.run.smithi110.stderr: 60100K .......... .......... .......... .......... .......... 64% 117M 0s 2024-03-04T12:37:57.696 INFO:teuthology.orchestra.run.smithi110.stderr: 60150K .......... .......... .......... .......... .......... 64% 121M 0s 2024-03-04T12:37:57.696 INFO:teuthology.orchestra.run.smithi110.stderr: 60200K .......... .......... .......... .......... .......... 64% 98.6M 0s 2024-03-04T12:37:57.696 INFO:teuthology.orchestra.run.smithi110.stderr: 60250K .......... .......... .......... .......... .......... 64% 89.2M 0s 2024-03-04T12:37:57.696 INFO:teuthology.orchestra.run.smithi110.stderr: 60300K .......... .......... .......... .......... .......... 64% 76.6M 0s 2024-03-04T12:37:57.696 INFO:teuthology.orchestra.run.smithi110.stderr: 60350K .......... .......... .......... .......... .......... 65% 103M 0s 2024-03-04T12:37:57.696 INFO:teuthology.orchestra.run.smithi110.stderr: 60400K .......... .......... .......... .......... .......... 65% 109M 0s 2024-03-04T12:37:57.696 INFO:teuthology.orchestra.run.smithi110.stderr: 60450K .......... .......... .......... .......... .......... 65% 111M 0s 2024-03-04T12:37:57.697 INFO:teuthology.orchestra.run.smithi110.stderr: 60500K .......... .......... .......... .......... .......... 65% 90.8M 0s 2024-03-04T12:37:57.697 INFO:teuthology.orchestra.run.smithi110.stderr: 60550K .......... .......... .......... .......... .......... 65% 114M 0s 2024-03-04T12:37:57.697 INFO:teuthology.orchestra.run.smithi110.stderr: 60600K .......... .......... .......... .......... .......... 65% 119M 0s 2024-03-04T12:37:57.697 INFO:teuthology.orchestra.run.smithi110.stderr: 60650K .......... .......... .......... .......... .......... 65% 74.7M 0s 2024-03-04T12:37:57.697 INFO:teuthology.orchestra.run.smithi110.stderr: 60700K .......... .......... .......... .......... .......... 65% 126M 0s 2024-03-04T12:37:57.697 INFO:teuthology.orchestra.run.smithi110.stderr: 60750K .......... .......... .......... .......... .......... 65% 110M 0s 2024-03-04T12:37:57.697 INFO:teuthology.orchestra.run.smithi110.stderr: 60800K .......... .......... .......... .......... .......... 65% 94.6M 0s 2024-03-04T12:37:57.697 INFO:teuthology.orchestra.run.smithi110.stderr: 60850K .......... .......... .......... .......... .......... 65% 87.7M 0s 2024-03-04T12:37:57.697 INFO:teuthology.orchestra.run.smithi110.stderr: 60900K .......... .......... .......... .......... .......... 65% 105M 0s 2024-03-04T12:37:57.697 INFO:teuthology.orchestra.run.smithi110.stderr: 60950K .......... .......... .......... .......... .......... 65% 52.3M 0s 2024-03-04T12:37:57.697 INFO:teuthology.orchestra.run.smithi110.stderr: 61000K .......... .......... .......... .......... .......... 65% 83.9M 0s 2024-03-04T12:37:57.697 INFO:teuthology.orchestra.run.smithi110.stderr: 61050K .......... .......... .......... .......... .......... 65% 65.4M 0s 2024-03-04T12:37:57.697 INFO:teuthology.orchestra.run.smithi110.stderr: 61100K .......... .......... .......... .......... .......... 65% 71.4M 0s 2024-03-04T12:37:57.697 INFO:teuthology.orchestra.run.smithi110.stderr: 61150K .......... .......... .......... .......... .......... 65% 118M 0s 2024-03-04T12:37:57.697 INFO:teuthology.orchestra.run.smithi110.stderr: 61200K .......... .......... .......... .......... .......... 65% 85.4M 0s 2024-03-04T12:37:57.698 INFO:teuthology.orchestra.run.smithi110.stderr: 61250K .......... .......... .......... .......... .......... 65% 115M 0s 2024-03-04T12:37:57.698 INFO:teuthology.orchestra.run.smithi110.stderr: 61300K .......... .......... .......... .......... .......... 66% 67.8M 0s 2024-03-04T12:37:57.698 INFO:teuthology.orchestra.run.smithi110.stderr: 61350K .......... .......... .......... .......... .......... 66% 107M 0s 2024-03-04T12:37:57.698 INFO:teuthology.orchestra.run.smithi110.stderr: 61400K .......... .......... .......... .......... .......... 66% 120M 0s 2024-03-04T12:37:57.698 INFO:teuthology.orchestra.run.smithi110.stderr: 61450K .......... .......... .......... .......... .......... 66% 88.3M 0s 2024-03-04T12:37:57.698 INFO:teuthology.orchestra.run.smithi110.stderr: 61500K .......... .......... .......... .......... .......... 66% 107M 0s 2024-03-04T12:37:57.698 INFO:teuthology.orchestra.run.smithi110.stderr: 61550K .......... .......... .......... .......... .......... 66% 118M 0s 2024-03-04T12:37:57.698 INFO:teuthology.orchestra.run.smithi110.stderr: 61600K .......... .......... .......... .......... .......... 66% 116M 0s 2024-03-04T12:37:57.698 INFO:teuthology.orchestra.run.smithi110.stderr: 61650K .......... .......... .......... .......... .......... 66% 105M 0s 2024-03-04T12:37:57.698 INFO:teuthology.orchestra.run.smithi110.stderr: 61700K .......... .......... .......... .......... .......... 66% 92.5M 0s 2024-03-04T12:37:57.698 INFO:teuthology.orchestra.run.smithi110.stderr: 61750K .......... .......... .......... .......... .......... 66% 118M 0s 2024-03-04T12:37:57.698 INFO:teuthology.orchestra.run.smithi110.stderr: 61800K .......... .......... .......... .......... .......... 66% 111M 0s 2024-03-04T12:37:57.698 INFO:teuthology.orchestra.run.smithi110.stderr: 61850K .......... .......... .......... .......... .......... 66% 89.2M 0s 2024-03-04T12:37:57.698 INFO:teuthology.orchestra.run.smithi110.stderr: 61900K .......... .......... .......... .......... .......... 66% 97.7M 0s 2024-03-04T12:37:57.698 INFO:teuthology.orchestra.run.smithi110.stderr: 61950K .......... .......... .......... .......... .......... 66% 116M 0s 2024-03-04T12:37:57.699 INFO:teuthology.orchestra.run.smithi110.stderr: 62000K .......... .......... .......... .......... .......... 66% 95.1M 0s 2024-03-04T12:37:57.699 INFO:teuthology.orchestra.run.smithi110.stderr: 62050K .......... .......... .......... .......... .......... 66% 113M 0s 2024-03-04T12:37:57.699 INFO:teuthology.orchestra.run.smithi110.stderr: 62100K .......... .......... .......... .......... .......... 66% 91.5M 0s 2024-03-04T12:37:57.699 INFO:teuthology.orchestra.run.smithi110.stderr: 62150K .......... .......... .......... .......... .......... 66% 127M 0s 2024-03-04T12:37:57.699 INFO:teuthology.orchestra.run.smithi110.stderr: 62200K .......... .......... .......... .......... .......... 67% 89.8M 0s 2024-03-04T12:37:57.699 INFO:teuthology.orchestra.run.smithi110.stderr: 62250K .......... .......... .......... .......... .......... 67% 114M 0s 2024-03-04T12:37:57.699 INFO:teuthology.orchestra.run.smithi110.stderr: 62300K .......... .......... .......... .......... .......... 67% 105M 0s 2024-03-04T12:37:57.699 INFO:teuthology.orchestra.run.smithi110.stderr: 62350K .......... .......... .......... .......... .......... 67% 93.4M 0s 2024-03-04T12:37:57.699 INFO:teuthology.orchestra.run.smithi110.stderr: 62400K .......... .......... .......... .......... .......... 67% 88.0M 0s 2024-03-04T12:37:57.699 INFO:teuthology.orchestra.run.smithi110.stderr: 62450K .......... .......... .......... .......... .......... 67% 97.5M 0s 2024-03-04T12:37:57.699 INFO:teuthology.orchestra.run.smithi110.stderr: 62500K .......... .......... .......... .......... .......... 67% 116M 0s 2024-03-04T12:37:57.699 INFO:teuthology.orchestra.run.smithi110.stderr: 62550K .......... .......... .......... .......... .......... 67% 115M 0s 2024-03-04T12:37:57.699 INFO:teuthology.orchestra.run.smithi110.stderr: 62600K .......... .......... .......... .......... .......... 67% 72.4M 0s 2024-03-04T12:37:57.699 INFO:teuthology.orchestra.run.smithi110.stderr: 62650K .......... .......... .......... .......... .......... 67% 110M 0s 2024-03-04T12:37:57.699 INFO:teuthology.orchestra.run.smithi110.stderr: 62700K .......... .......... .......... .......... .......... 67% 116M 0s 2024-03-04T12:37:57.699 INFO:teuthology.orchestra.run.smithi110.stderr: 62750K .......... .......... .......... .......... .......... 67% 120M 0s 2024-03-04T12:37:57.700 INFO:teuthology.orchestra.run.smithi110.stderr: 62800K .......... .......... .......... .......... .......... 67% 110M 0s 2024-03-04T12:37:57.700 INFO:teuthology.orchestra.run.smithi110.stderr: 62850K .......... .......... .......... .......... .......... 67% 110M 0s 2024-03-04T12:37:57.700 INFO:teuthology.orchestra.run.smithi110.stderr: 62900K .......... .......... .......... .......... .......... 67% 113M 0s 2024-03-04T12:37:57.700 INFO:teuthology.orchestra.run.smithi110.stderr: 62950K .......... .......... .......... .......... .......... 67% 115M 0s 2024-03-04T12:37:57.700 INFO:teuthology.orchestra.run.smithi110.stderr: 63000K .......... .......... .......... .......... .......... 67% 90.2M 0s 2024-03-04T12:37:57.700 INFO:teuthology.orchestra.run.smithi110.stderr: 63050K .......... .......... .......... .......... .......... 67% 122M 0s 2024-03-04T12:37:57.700 INFO:teuthology.orchestra.run.smithi110.stderr: 63100K .......... .......... .......... .......... .......... 67% 114M 0s 2024-03-04T12:37:57.700 INFO:teuthology.orchestra.run.smithi110.stderr: 63150K .......... .......... .......... .......... .......... 68% 111M 0s 2024-03-04T12:37:57.700 INFO:teuthology.orchestra.run.smithi110.stderr: 63200K .......... .......... .......... .......... .......... 68% 115M 0s 2024-03-04T12:37:57.700 INFO:teuthology.orchestra.run.smithi110.stderr: 63250K .......... .......... .......... .......... .......... 68% 66.4M 0s 2024-03-04T12:37:57.700 INFO:teuthology.orchestra.run.smithi110.stderr: 63300K .......... .......... .......... .......... .......... 68% 71.1M 0s 2024-03-04T12:37:57.700 INFO:teuthology.orchestra.run.smithi110.stderr: 63350K .......... .......... .......... .......... .......... 68% 62.7M 0s 2024-03-04T12:37:57.700 INFO:teuthology.orchestra.run.smithi110.stderr: 63400K .......... .......... .......... .......... .......... 68% 120M 0s 2024-03-04T12:37:57.701 INFO:teuthology.orchestra.run.smithi110.stderr: 63450K .......... .......... .......... .......... .......... 68% 108M 0s 2024-03-04T12:37:57.701 INFO:teuthology.orchestra.run.smithi110.stderr: 63500K .......... .......... .......... .......... .......... 68% 88.4M 0s 2024-03-04T12:37:57.701 INFO:teuthology.orchestra.run.smithi110.stderr: 63550K .......... .......... .......... .......... .......... 68% 133M 0s 2024-03-04T12:37:57.701 INFO:teuthology.orchestra.run.smithi110.stderr: 63600K .......... .......... .......... .......... .......... 68% 112M 0s 2024-03-04T12:37:57.701 INFO:teuthology.orchestra.run.smithi110.stderr: 63650K .......... .......... .......... .......... .......... 68% 116M 0s 2024-03-04T12:37:57.701 INFO:teuthology.orchestra.run.smithi110.stderr: 63700K .......... .......... .......... .......... .......... 68% 117M 0s 2024-03-04T12:37:57.701 INFO:teuthology.orchestra.run.smithi110.stderr: 63750K .......... .......... .......... .......... .......... 68% 86.5M 0s 2024-03-04T12:37:57.701 INFO:teuthology.orchestra.run.smithi110.stderr: 63800K .......... .......... .......... .......... .......... 68% 115M 0s 2024-03-04T12:37:57.701 INFO:teuthology.orchestra.run.smithi110.stderr: 63850K .......... .......... .......... .......... .......... 68% 118M 0s 2024-03-04T12:37:57.701 INFO:teuthology.orchestra.run.smithi110.stderr: 63900K .......... .......... .......... .......... .......... 68% 113M 0s 2024-03-04T12:37:57.701 INFO:teuthology.orchestra.run.smithi110.stderr: 63950K .......... .......... .......... .......... .......... 68% 113M 0s 2024-03-04T12:37:57.701 INFO:teuthology.orchestra.run.smithi110.stderr: 64000K .......... .......... .......... .......... .......... 68% 111M 0s 2024-03-04T12:37:57.701 INFO:teuthology.orchestra.run.smithi110.stderr: 64050K .......... .......... .......... .......... .......... 68% 112M 0s 2024-03-04T12:37:57.701 INFO:teuthology.orchestra.run.smithi110.stderr: 64100K .......... .......... .......... .......... .......... 69% 70.7M 0s 2024-03-04T12:37:57.702 INFO:teuthology.orchestra.run.smithi110.stderr: 64150K .......... .......... .......... .......... .......... 69% 122M 0s 2024-03-04T12:37:57.702 INFO:teuthology.orchestra.run.smithi110.stderr: 64200K .......... .......... .......... .......... .......... 69% 112M 0s 2024-03-04T12:37:57.702 INFO:teuthology.orchestra.run.smithi110.stderr: 64250K .......... .......... .......... .......... .......... 69% 117M 0s 2024-03-04T12:37:57.702 INFO:teuthology.orchestra.run.smithi110.stderr: 64300K .......... .......... .......... .......... .......... 69% 80.0M 0s 2024-03-04T12:37:57.702 INFO:teuthology.orchestra.run.smithi110.stderr: 64350K .......... .......... .......... .......... .......... 69% 119M 0s 2024-03-04T12:37:57.702 INFO:teuthology.orchestra.run.smithi110.stderr: 64400K .......... .......... .......... .......... .......... 69% 125M 0s 2024-03-04T12:37:57.702 INFO:teuthology.orchestra.run.smithi110.stderr: 64450K .......... .......... .......... .......... .......... 69% 110M 0s 2024-03-04T12:37:57.702 INFO:teuthology.orchestra.run.smithi110.stderr: 64500K .......... .......... .......... .......... .......... 69% 89.6M 0s 2024-03-04T12:37:57.702 INFO:teuthology.orchestra.run.smithi110.stderr: 64550K .......... .......... .......... .......... .......... 69% 113M 0s 2024-03-04T12:37:57.702 INFO:teuthology.orchestra.run.smithi110.stderr: 64600K .......... .......... .......... .......... .......... 69% 114M 0s 2024-03-04T12:37:57.702 INFO:teuthology.orchestra.run.smithi110.stderr: 64650K .......... .......... .......... .......... .......... 69% 97.1M 0s 2024-03-04T12:37:57.702 INFO:teuthology.orchestra.run.smithi110.stderr: 64700K .......... .......... .......... .......... .......... 69% 99.6M 0s 2024-03-04T12:37:57.702 INFO:teuthology.orchestra.run.smithi110.stderr: 64750K .......... .......... .......... .......... .......... 69% 69.1M 0s 2024-03-04T12:37:57.702 INFO:teuthology.orchestra.run.smithi110.stderr: 64800K .......... .......... .......... .......... .......... 69% 109M 0s 2024-03-04T12:37:57.702 INFO:teuthology.orchestra.run.smithi110.stderr: 64850K .......... .......... .......... .......... .......... 69% 122M 0s 2024-03-04T12:37:57.703 INFO:teuthology.orchestra.run.smithi110.stderr: 64900K .......... .......... .......... .......... .......... 69% 58.5M 0s 2024-03-04T12:37:57.703 INFO:teuthology.orchestra.run.smithi110.stderr: 64950K .......... .......... .......... .......... .......... 69% 89.1M 0s 2024-03-04T12:37:57.703 INFO:teuthology.orchestra.run.smithi110.stderr: 65000K .......... .......... .......... .......... .......... 70% 89.7M 0s 2024-03-04T12:37:57.703 INFO:teuthology.orchestra.run.smithi110.stderr: 65050K .......... .......... .......... .......... .......... 70% 122M 0s 2024-03-04T12:37:57.703 INFO:teuthology.orchestra.run.smithi110.stderr: 65100K .......... .......... .......... .......... .......... 70% 112M 0s 2024-03-04T12:37:57.703 INFO:teuthology.orchestra.run.smithi110.stderr: 65150K .......... .......... .......... .......... .......... 70% 81.0M 0s 2024-03-04T12:37:57.703 INFO:teuthology.orchestra.run.smithi110.stderr: 65200K .......... .......... .......... .......... .......... 70% 118M 0s 2024-03-04T12:37:57.703 INFO:teuthology.orchestra.run.smithi110.stderr: 65250K .......... .......... .......... .......... .......... 70% 75.7M 0s 2024-03-04T12:37:57.703 INFO:teuthology.orchestra.run.smithi110.stderr: 65300K .......... .......... .......... .......... .......... 70% 86.6M 0s 2024-03-04T12:37:57.703 INFO:teuthology.orchestra.run.smithi110.stderr: 65350K .......... .......... .......... .......... .......... 70% 133M 0s 2024-03-04T12:37:57.703 INFO:teuthology.orchestra.run.smithi110.stderr: 65400K .......... .......... .......... .......... .......... 70% 108M 0s 2024-03-04T12:37:57.703 INFO:teuthology.orchestra.run.smithi110.stderr: 65450K .......... .......... .......... .......... .......... 70% 86.3M 0s 2024-03-04T12:37:57.703 INFO:teuthology.orchestra.run.smithi110.stderr: 65500K .......... .......... .......... .......... .......... 70% 105M 0s 2024-03-04T12:37:57.703 INFO:teuthology.orchestra.run.smithi110.stderr: 65550K .......... .......... .......... .......... .......... 70% 118M 0s 2024-03-04T12:37:57.703 INFO:teuthology.orchestra.run.smithi110.stderr: 65600K .......... .......... .......... .......... .......... 70% 115M 0s 2024-03-04T12:37:57.704 INFO:teuthology.orchestra.run.smithi110.stderr: 65650K .......... .......... .......... .......... .......... 70% 90.4M 0s 2024-03-04T12:37:57.704 INFO:teuthology.orchestra.run.smithi110.stderr: 65700K .......... .......... .......... .......... .......... 70% 78.1M 0s 2024-03-04T12:37:57.704 INFO:teuthology.orchestra.run.smithi110.stderr: 65750K .......... .......... .......... .......... .......... 70% 111M 0s 2024-03-04T12:37:57.704 INFO:teuthology.orchestra.run.smithi110.stderr: 65800K .......... .......... .......... .......... .......... 70% 115M 0s 2024-03-04T12:37:57.704 INFO:teuthology.orchestra.run.smithi110.stderr: 65850K .......... .......... .......... .......... .......... 70% 105M 0s 2024-03-04T12:37:57.704 INFO:teuthology.orchestra.run.smithi110.stderr: 65900K .......... .......... .......... .......... .......... 70% 112M 0s 2024-03-04T12:37:57.704 INFO:teuthology.orchestra.run.smithi110.stderr: 65950K .......... .......... .......... .......... .......... 71% 84.4M 0s 2024-03-04T12:37:57.704 INFO:teuthology.orchestra.run.smithi110.stderr: 66000K .......... .......... .......... .......... .......... 71% 119M 0s 2024-03-04T12:37:57.704 INFO:teuthology.orchestra.run.smithi110.stderr: 66050K .......... .......... .......... .......... .......... 71% 94.4M 0s 2024-03-04T12:37:57.704 INFO:teuthology.orchestra.run.smithi110.stderr: 66100K .......... .......... .......... .......... .......... 71% 93.0M 0s 2024-03-04T12:37:57.704 INFO:teuthology.orchestra.run.smithi110.stderr: 66150K .......... .......... .......... .......... .......... 71% 85.5M 0s 2024-03-04T12:37:57.704 INFO:teuthology.orchestra.run.smithi110.stderr: 66200K .......... .......... .......... .......... .......... 71% 115M 0s 2024-03-04T12:37:57.704 INFO:teuthology.orchestra.run.smithi110.stderr: 66250K .......... .......... .......... .......... .......... 71% 102M 0s 2024-03-04T12:37:57.704 INFO:teuthology.orchestra.run.smithi110.stderr: 66300K .......... .......... .......... .......... .......... 71% 91.4M 0s 2024-03-04T12:37:57.705 INFO:teuthology.orchestra.run.smithi110.stderr: 66350K .......... .......... .......... .......... .......... 71% 97.4M 0s 2024-03-04T12:37:57.705 INFO:teuthology.orchestra.run.smithi110.stderr: 66400K .......... .......... .......... .......... .......... 71% 86.7M 0s 2024-03-04T12:37:57.705 INFO:teuthology.orchestra.run.smithi110.stderr: 66450K .......... .......... .......... .......... .......... 71% 143M 0s 2024-03-04T12:37:57.705 INFO:teuthology.orchestra.run.smithi110.stderr: 66500K .......... .......... .......... .......... .......... 71% 72.6M 0s 2024-03-04T12:37:57.705 INFO:teuthology.orchestra.run.smithi110.stderr: 66550K .......... .......... .......... .......... .......... 71% 141M 0s 2024-03-04T12:37:57.705 INFO:teuthology.orchestra.run.smithi110.stderr: 66600K .......... .......... .......... .......... .......... 71% 76.2M 0s 2024-03-04T12:37:57.705 INFO:teuthology.orchestra.run.smithi110.stderr: 66650K .......... .......... .......... .......... .......... 71% 89.5M 0s 2024-03-04T12:37:57.705 INFO:teuthology.orchestra.run.smithi110.stderr: 66700K .......... .......... .......... .......... .......... 71% 104M 0s 2024-03-04T12:37:57.705 INFO:teuthology.orchestra.run.smithi110.stderr: 66750K .......... .......... .......... .......... .......... 71% 65.9M 0s 2024-03-04T12:37:57.705 INFO:teuthology.orchestra.run.smithi110.stderr: 66800K .......... .......... .......... .......... .......... 71% 81.5M 0s 2024-03-04T12:37:57.705 INFO:teuthology.orchestra.run.smithi110.stderr: 66850K .......... .......... .......... .......... .......... 72% 78.2M 0s 2024-03-04T12:37:57.705 INFO:teuthology.orchestra.run.smithi110.stderr: 66900K .......... .......... .......... .......... .......... 72% 97.9M 0s 2024-03-04T12:37:57.705 INFO:teuthology.orchestra.run.smithi110.stderr: 66950K .......... .......... .......... .......... .......... 72% 116M 0s 2024-03-04T12:37:57.705 INFO:teuthology.orchestra.run.smithi110.stderr: 67000K .......... .......... .......... .......... .......... 72% 91.9M 0s 2024-03-04T12:37:57.705 INFO:teuthology.orchestra.run.smithi110.stderr: 67050K .......... .......... .......... .......... .......... 72% 108M 0s 2024-03-04T12:37:57.706 INFO:teuthology.orchestra.run.smithi110.stderr: 67100K .......... .......... .......... .......... .......... 72% 114M 0s 2024-03-04T12:37:57.706 INFO:teuthology.orchestra.run.smithi110.stderr: 67150K .......... .......... .......... .......... .......... 72% 118M 0s 2024-03-04T12:37:57.706 INFO:teuthology.orchestra.run.smithi110.stderr: 67200K .......... .......... .......... .......... .......... 72% 87.0M 0s 2024-03-04T12:37:57.706 INFO:teuthology.orchestra.run.smithi110.stderr: 67250K .......... .......... .......... .......... .......... 72% 64.3M 0s 2024-03-04T12:37:57.706 INFO:teuthology.orchestra.run.smithi110.stderr: 67300K .......... .......... .......... .......... .......... 72% 51.4M 0s 2024-03-04T12:37:57.706 INFO:teuthology.orchestra.run.smithi110.stderr: 67350K .......... .......... .......... .......... .......... 72% 126M 0s 2024-03-04T12:37:57.706 INFO:teuthology.orchestra.run.smithi110.stderr: 67400K .......... .......... .......... .......... .......... 72% 82.4M 0s 2024-03-04T12:37:57.706 INFO:teuthology.orchestra.run.smithi110.stderr: 67450K .......... .......... .......... .......... .......... 72% 103M 0s 2024-03-04T12:37:57.706 INFO:teuthology.orchestra.run.smithi110.stderr: 67500K .......... .......... .......... .......... .......... 72% 60.6M 0s 2024-03-04T12:37:57.706 INFO:teuthology.orchestra.run.smithi110.stderr: 67550K .......... .......... .......... .......... .......... 72% 54.7M 0s 2024-03-04T12:37:57.706 INFO:teuthology.orchestra.run.smithi110.stderr: 67600K .......... .......... .......... .......... .......... 72% 98.8M 0s 2024-03-04T12:37:57.706 INFO:teuthology.orchestra.run.smithi110.stderr: 67650K .......... .......... .......... .......... .......... 72% 86.3M 0s 2024-03-04T12:37:57.706 INFO:teuthology.orchestra.run.smithi110.stderr: 67700K .......... .......... .......... .......... .......... 72% 121M 0s 2024-03-04T12:37:57.706 INFO:teuthology.orchestra.run.smithi110.stderr: 67750K .......... .......... .......... .......... .......... 72% 114M 0s 2024-03-04T12:37:57.707 INFO:teuthology.orchestra.run.smithi110.stderr: 67800K .......... .......... .......... .......... .......... 73% 88.1M 0s 2024-03-04T12:37:57.707 INFO:teuthology.orchestra.run.smithi110.stderr: 67850K .......... .......... .......... .......... .......... 73% 109M 0s 2024-03-04T12:37:57.707 INFO:teuthology.orchestra.run.smithi110.stderr: 67900K .......... .......... .......... .......... .......... 73% 118M 0s 2024-03-04T12:37:57.707 INFO:teuthology.orchestra.run.smithi110.stderr: 67950K .......... .......... .......... .......... .......... 73% 104M 0s 2024-03-04T12:37:57.707 INFO:teuthology.orchestra.run.smithi110.stderr: 68000K .......... .......... .......... .......... .......... 73% 77.8M 0s 2024-03-04T12:37:57.707 INFO:teuthology.orchestra.run.smithi110.stderr: 68050K .......... .......... .......... .......... .......... 73% 105M 0s 2024-03-04T12:37:57.707 INFO:teuthology.orchestra.run.smithi110.stderr: 68100K .......... .......... .......... .......... .......... 73% 115M 0s 2024-03-04T12:37:57.707 INFO:teuthology.orchestra.run.smithi110.stderr: 68150K .......... .......... .......... .......... .......... 73% 115M 0s 2024-03-04T12:37:57.707 INFO:teuthology.orchestra.run.smithi110.stderr: 68200K .......... .......... .......... .......... .......... 73% 112M 0s 2024-03-04T12:37:57.707 INFO:teuthology.orchestra.run.smithi110.stderr: 68250K .......... .......... .......... .......... .......... 73% 102M 0s 2024-03-04T12:37:57.707 INFO:teuthology.orchestra.run.smithi110.stderr: 68300K .......... .......... .......... .......... .......... 73% 90.6M 0s 2024-03-04T12:37:57.707 INFO:teuthology.orchestra.run.smithi110.stderr: 68350K .......... .......... .......... .......... .......... 73% 109M 0s 2024-03-04T12:37:57.707 INFO:teuthology.orchestra.run.smithi110.stderr: 68400K .......... .......... .......... .......... .......... 73% 116M 0s 2024-03-04T12:37:57.707 INFO:teuthology.orchestra.run.smithi110.stderr: 68450K .......... .......... .......... .......... .......... 73% 116M 0s 2024-03-04T12:37:57.707 INFO:teuthology.orchestra.run.smithi110.stderr: 68500K .......... .......... .......... .......... .......... 73% 103M 0s 2024-03-04T12:37:57.708 INFO:teuthology.orchestra.run.smithi110.stderr: 68550K .......... .......... .......... .......... .......... 73% 93.5M 0s 2024-03-04T12:37:57.708 INFO:teuthology.orchestra.run.smithi110.stderr: 68600K .......... .......... .......... .......... .......... 73% 112M 0s 2024-03-04T12:37:57.708 INFO:teuthology.orchestra.run.smithi110.stderr: 68650K .......... .......... .......... .......... .......... 73% 116M 0s 2024-03-04T12:37:57.708 INFO:teuthology.orchestra.run.smithi110.stderr: 68700K .......... .......... .......... .......... .......... 74% 67.1M 0s 2024-03-04T12:37:57.708 INFO:teuthology.orchestra.run.smithi110.stderr: 68750K .......... .......... .......... .......... .......... 74% 132M 0s 2024-03-04T12:37:57.708 INFO:teuthology.orchestra.run.smithi110.stderr: 68800K .......... .......... .......... .......... .......... 74% 101M 0s 2024-03-04T12:37:57.708 INFO:teuthology.orchestra.run.smithi110.stderr: 68850K .......... .......... .......... .......... .......... 74% 117M 0s 2024-03-04T12:37:57.708 INFO:teuthology.orchestra.run.smithi110.stderr: 68900K .......... .......... .......... .......... .......... 74% 91.3M 0s 2024-03-04T12:37:57.708 INFO:teuthology.orchestra.run.smithi110.stderr: 68950K .......... .......... .......... .......... .......... 74% 118M 0s 2024-03-04T12:37:57.708 INFO:teuthology.orchestra.run.smithi110.stderr: 69000K .......... .......... .......... .......... .......... 74% 114M 0s 2024-03-04T12:37:57.708 INFO:teuthology.orchestra.run.smithi110.stderr: 69050K .......... .......... .......... .......... .......... 74% 121M 0s 2024-03-04T12:37:57.708 INFO:teuthology.orchestra.run.smithi110.stderr: 69100K .......... .......... .......... .......... .......... 74% 87.8M 0s 2024-03-04T12:37:57.708 INFO:teuthology.orchestra.run.smithi110.stderr: 69150K .......... .......... .......... .......... .......... 74% 107M 0s 2024-03-04T12:37:57.708 INFO:teuthology.orchestra.run.smithi110.stderr: 69200K .......... .......... .......... .......... .......... 74% 115M 0s 2024-03-04T12:37:57.709 INFO:teuthology.orchestra.run.smithi110.stderr: 69250K .......... .......... .......... .......... .......... 74% 111M 0s 2024-03-04T12:37:57.709 INFO:teuthology.orchestra.run.smithi110.stderr: 69300K .......... .......... .......... .......... .......... 74% 116M 0s 2024-03-04T12:37:57.709 INFO:teuthology.orchestra.run.smithi110.stderr: 69350K .......... .......... .......... .......... .......... 74% 109M 0s 2024-03-04T12:37:57.709 INFO:teuthology.orchestra.run.smithi110.stderr: 69400K .......... .......... .......... .......... .......... 74% 104M 0s 2024-03-04T12:37:57.709 INFO:teuthology.orchestra.run.smithi110.stderr: 69450K .......... .......... .......... .......... .......... 74% 114M 0s 2024-03-04T12:37:57.709 INFO:teuthology.orchestra.run.smithi110.stderr: 69500K .......... .......... .......... .......... .......... 74% 91.1M 0s 2024-03-04T12:37:57.709 INFO:teuthology.orchestra.run.smithi110.stderr: 69550K .......... .......... .......... .......... .......... 74% 114M 0s 2024-03-04T12:37:57.709 INFO:teuthology.orchestra.run.smithi110.stderr: 69600K .......... .......... .......... .......... .......... 74% 87.3M 0s 2024-03-04T12:37:57.709 INFO:teuthology.orchestra.run.smithi110.stderr: 69650K .......... .......... .......... .......... .......... 75% 89.8M 0s 2024-03-04T12:37:57.709 INFO:teuthology.orchestra.run.smithi110.stderr: 69700K .......... .......... .......... .......... .......... 75% 106M 0s 2024-03-04T12:37:57.709 INFO:teuthology.orchestra.run.smithi110.stderr: 69750K .......... .......... .......... .......... .......... 75% 115M 0s 2024-03-04T12:37:57.709 INFO:teuthology.orchestra.run.smithi110.stderr: 69800K .......... .......... .......... .......... .......... 75% 95.1M 0s 2024-03-04T12:37:57.709 INFO:teuthology.orchestra.run.smithi110.stderr: 69850K .......... .......... .......... .......... .......... 75% 107M 0s 2024-03-04T12:37:57.709 INFO:teuthology.orchestra.run.smithi110.stderr: 69900K .......... .......... .......... .......... .......... 75% 70.7M 0s 2024-03-04T12:37:57.709 INFO:teuthology.orchestra.run.smithi110.stderr: 69950K .......... .......... .......... .......... .......... 75% 94.8M 0s 2024-03-04T12:37:57.710 INFO:teuthology.orchestra.run.smithi110.stderr: 70000K .......... .......... .......... .......... .......... 75% 132M 0s 2024-03-04T12:37:57.710 INFO:teuthology.orchestra.run.smithi110.stderr: 70050K .......... .......... .......... .......... .......... 75% 95.6M 0s 2024-03-04T12:37:57.710 INFO:teuthology.orchestra.run.smithi110.stderr: 70100K .......... .......... .......... .......... .......... 75% 68.6M 0s 2024-03-04T12:37:57.710 INFO:teuthology.orchestra.run.smithi110.stderr: 70150K .......... .......... .......... .......... .......... 75% 92.9M 0s 2024-03-04T12:37:57.710 INFO:teuthology.orchestra.run.smithi110.stderr: 70200K .......... .......... .......... .......... .......... 75% 113M 0s 2024-03-04T12:37:57.710 INFO:teuthology.orchestra.run.smithi110.stderr: 70250K .......... .......... .......... .......... .......... 75% 61.5M 0s 2024-03-04T12:37:57.710 INFO:teuthology.orchestra.run.smithi110.stderr: 70300K .......... .......... .......... .......... .......... 75% 102M 0s 2024-03-04T12:37:57.710 INFO:teuthology.orchestra.run.smithi110.stderr: 70350K .......... .......... .......... .......... .......... 75% 114M 0s 2024-03-04T12:37:57.710 INFO:teuthology.orchestra.run.smithi110.stderr: 70400K .......... .......... .......... .......... .......... 75% 115M 0s 2024-03-04T12:37:57.710 INFO:teuthology.orchestra.run.smithi110.stderr: 70450K .......... .......... .......... .......... .......... 75% 111M 0s 2024-03-04T12:37:57.710 INFO:teuthology.orchestra.run.smithi110.stderr: 70500K .......... .......... .......... .......... .......... 75% 115M 0s 2024-03-04T12:37:57.710 INFO:teuthology.orchestra.run.smithi110.stderr: 70550K .......... .......... .......... .......... .......... 75% 82.6M 0s 2024-03-04T12:37:57.710 INFO:teuthology.orchestra.run.smithi110.stderr: 70600K .......... .......... .......... .......... .......... 76% 104M 0s 2024-03-04T12:37:57.710 INFO:teuthology.orchestra.run.smithi110.stderr: 70650K .......... .......... .......... .......... .......... 76% 73.7M 0s 2024-03-04T12:37:57.711 INFO:teuthology.orchestra.run.smithi110.stderr: 70700K .......... .......... .......... .......... .......... 76% 119M 0s 2024-03-04T12:37:57.711 INFO:teuthology.orchestra.run.smithi110.stderr: 70750K .......... .......... .......... .......... .......... 76% 92.1M 0s 2024-03-04T12:37:57.711 INFO:teuthology.orchestra.run.smithi110.stderr: 70800K .......... .......... .......... .......... .......... 76% 122M 0s 2024-03-04T12:37:57.711 INFO:teuthology.orchestra.run.smithi110.stderr: 70850K .......... .......... .......... .......... .......... 76% 105M 0s 2024-03-04T12:37:57.711 INFO:teuthology.orchestra.run.smithi110.stderr: 70900K .......... .......... .......... .......... .......... 76% 112M 0s 2024-03-04T12:37:57.711 INFO:teuthology.orchestra.run.smithi110.stderr: 70950K .......... .......... .......... .......... .......... 76% 98.5M 0s 2024-03-04T12:37:57.711 INFO:teuthology.orchestra.run.smithi110.stderr: 71000K .......... .......... .......... .......... .......... 76% 96.1M 0s 2024-03-04T12:37:57.711 INFO:teuthology.orchestra.run.smithi110.stderr: 71050K .......... .......... .......... .......... .......... 76% 86.9M 0s 2024-03-04T12:37:57.711 INFO:teuthology.orchestra.run.smithi110.stderr: 71100K .......... .......... .......... .......... .......... 76% 113M 0s 2024-03-04T12:37:57.711 INFO:teuthology.orchestra.run.smithi110.stderr: 71150K .......... .......... .......... .......... .......... 76% 120M 0s 2024-03-04T12:37:57.711 INFO:teuthology.orchestra.run.smithi110.stderr: 71200K .......... .......... .......... .......... .......... 76% 111M 0s 2024-03-04T12:37:57.711 INFO:teuthology.orchestra.run.smithi110.stderr: 71250K .......... .......... .......... .......... .......... 76% 91.1M 0s 2024-03-04T12:37:57.711 INFO:teuthology.orchestra.run.smithi110.stderr: 71300K .......... .......... .......... .......... .......... 76% 89.6M 0s 2024-03-04T12:37:57.711 INFO:teuthology.orchestra.run.smithi110.stderr: 71350K .......... .......... .......... .......... .......... 76% 93.1M 0s 2024-03-04T12:37:57.711 INFO:teuthology.orchestra.run.smithi110.stderr: 71400K .......... .......... .......... .......... .......... 76% 116M 0s 2024-03-04T12:37:57.712 INFO:teuthology.orchestra.run.smithi110.stderr: 71450K .......... .......... .......... .......... .......... 76% 113M 0s 2024-03-04T12:37:57.712 INFO:teuthology.orchestra.run.smithi110.stderr: 71500K .......... .......... .......... .......... .......... 77% 88.4M 0s 2024-03-04T12:37:57.712 INFO:teuthology.orchestra.run.smithi110.stderr: 71550K .......... .......... .......... .......... .......... 77% 108M 0s 2024-03-04T12:37:57.712 INFO:teuthology.orchestra.run.smithi110.stderr: 71600K .......... .......... .......... .......... .......... 77% 120M 0s 2024-03-04T12:37:57.712 INFO:teuthology.orchestra.run.smithi110.stderr: 71650K .......... .......... .......... .......... .......... 77% 75.8M 0s 2024-03-04T12:37:57.712 INFO:teuthology.orchestra.run.smithi110.stderr: 71700K .......... .......... .......... .......... .......... 77% 112M 0s 2024-03-04T12:37:57.712 INFO:teuthology.orchestra.run.smithi110.stderr: 71750K .......... .......... .......... .......... .......... 77% 71.3M 0s 2024-03-04T12:37:57.712 INFO:teuthology.orchestra.run.smithi110.stderr: 71800K .......... .......... .......... .......... .......... 77% 94.8M 0s 2024-03-04T12:37:57.712 INFO:teuthology.orchestra.run.smithi110.stderr: 71850K .......... .......... .......... .......... .......... 77% 115M 0s 2024-03-04T12:37:57.712 INFO:teuthology.orchestra.run.smithi110.stderr: 71900K .......... .......... .......... .......... .......... 77% 115M 0s 2024-03-04T12:37:57.712 INFO:teuthology.orchestra.run.smithi110.stderr: 71950K .......... .......... .......... .......... .......... 77% 118M 0s 2024-03-04T12:37:57.712 INFO:teuthology.orchestra.run.smithi110.stderr: 72000K .......... .......... .......... .......... .......... 77% 104M 0s 2024-03-04T12:37:57.712 INFO:teuthology.orchestra.run.smithi110.stderr: 72050K .......... .......... .......... .......... .......... 77% 115M 0s 2024-03-04T12:37:57.712 INFO:teuthology.orchestra.run.smithi110.stderr: 72100K .......... .......... .......... .......... .......... 77% 118M 0s 2024-03-04T12:37:57.713 INFO:teuthology.orchestra.run.smithi110.stderr: 72150K .......... .......... .......... .......... .......... 77% 86.9M 0s 2024-03-04T12:37:57.713 INFO:teuthology.orchestra.run.smithi110.stderr: 72200K .......... .......... .......... .......... .......... 77% 115M 0s 2024-03-04T12:37:57.713 INFO:teuthology.orchestra.run.smithi110.stderr: 72250K .......... .......... .......... .......... .......... 77% 92.3M 0s 2024-03-04T12:37:57.713 INFO:teuthology.orchestra.run.smithi110.stderr: 72300K .......... .......... .......... .......... .......... 77% 118M 0s 2024-03-04T12:37:57.713 INFO:teuthology.orchestra.run.smithi110.stderr: 72350K .......... .......... .......... .......... .......... 77% 112M 0s 2024-03-04T12:37:57.713 INFO:teuthology.orchestra.run.smithi110.stderr: 72400K .......... .......... .......... .......... .......... 77% 108M 0s 2024-03-04T12:37:57.713 INFO:teuthology.orchestra.run.smithi110.stderr: 72450K .......... .......... .......... .......... .......... 78% 117M 0s 2024-03-04T12:37:57.713 INFO:teuthology.orchestra.run.smithi110.stderr: 72500K .......... .......... .......... .......... .......... 78% 118M 0s 2024-03-04T12:37:57.713 INFO:teuthology.orchestra.run.smithi110.stderr: 72550K .......... .......... .......... .......... .......... 78% 89.7M 0s 2024-03-04T12:37:57.713 INFO:teuthology.orchestra.run.smithi110.stderr: 72600K .......... .......... .......... .......... .......... 78% 120M 0s 2024-03-04T12:37:57.713 INFO:teuthology.orchestra.run.smithi110.stderr: 72650K .......... .......... .......... .......... .......... 78% 106M 0s 2024-03-04T12:37:57.713 INFO:teuthology.orchestra.run.smithi110.stderr: 72700K .......... .......... .......... .......... .......... 78% 114M 0s 2024-03-04T12:37:57.713 INFO:teuthology.orchestra.run.smithi110.stderr: 72750K .......... .......... .......... .......... .......... 78% 106M 0s 2024-03-04T12:37:57.713 INFO:teuthology.orchestra.run.smithi110.stderr: 72800K .......... .......... .......... .......... .......... 78% 115M 0s 2024-03-04T12:37:57.713 INFO:teuthology.orchestra.run.smithi110.stderr: 72850K .......... .......... .......... .......... .......... 78% 115M 0s 2024-03-04T12:37:57.714 INFO:teuthology.orchestra.run.smithi110.stderr: 72900K .......... .......... .......... .......... .......... 78% 108M 0s 2024-03-04T12:37:57.714 INFO:teuthology.orchestra.run.smithi110.stderr: 72950K .......... .......... .......... .......... .......... 78% 93.5M 0s 2024-03-04T12:37:57.714 INFO:teuthology.orchestra.run.smithi110.stderr: 73000K .......... .......... .......... .......... .......... 78% 97.5M 0s 2024-03-04T12:37:57.714 INFO:teuthology.orchestra.run.smithi110.stderr: 73050K .......... .......... .......... .......... .......... 78% 122M 0s 2024-03-04T12:37:57.714 INFO:teuthology.orchestra.run.smithi110.stderr: 73100K .......... .......... .......... .......... .......... 78% 102M 0s 2024-03-04T12:37:57.714 INFO:teuthology.orchestra.run.smithi110.stderr: 73150K .......... .......... .......... .......... .......... 78% 105M 0s 2024-03-04T12:37:57.714 INFO:teuthology.orchestra.run.smithi110.stderr: 73200K .......... .......... .......... .......... .......... 78% 117M 0s 2024-03-04T12:37:57.714 INFO:teuthology.orchestra.run.smithi110.stderr: 73250K .......... .......... .......... .......... .......... 78% 111M 0s 2024-03-04T12:37:57.714 INFO:teuthology.orchestra.run.smithi110.stderr: 73300K .......... .......... .......... .......... .......... 78% 71.5M 0s 2024-03-04T12:37:57.714 INFO:teuthology.orchestra.run.smithi110.stderr: 73350K .......... .......... .......... .......... .......... 79% 48.8M 0s 2024-03-04T12:37:57.714 INFO:teuthology.orchestra.run.smithi110.stderr: 73400K .......... .......... .......... .......... .......... 79% 92.6M 0s 2024-03-04T12:37:57.714 INFO:teuthology.orchestra.run.smithi110.stderr: 73450K .......... .......... .......... .......... .......... 79% 74.7M 0s 2024-03-04T12:37:57.714 INFO:teuthology.orchestra.run.smithi110.stderr: 73500K .......... .......... .......... .......... .......... 79% 108M 0s 2024-03-04T12:37:57.714 INFO:teuthology.orchestra.run.smithi110.stderr: 73550K .......... .......... .......... .......... .......... 79% 75.2M 0s 2024-03-04T12:37:57.714 INFO:teuthology.orchestra.run.smithi110.stderr: 73600K .......... .......... .......... .......... .......... 79% 73.7M 0s 2024-03-04T12:37:57.715 INFO:teuthology.orchestra.run.smithi110.stderr: 73650K .......... .......... .......... .......... .......... 79% 87.4M 0s 2024-03-04T12:37:57.715 INFO:teuthology.orchestra.run.smithi110.stderr: 73700K .......... .......... .......... .......... .......... 79% 65.2M 0s 2024-03-04T12:37:57.715 INFO:teuthology.orchestra.run.smithi110.stderr: 73750K .......... .......... .......... .......... .......... 79% 101M 0s 2024-03-04T12:37:57.715 INFO:teuthology.orchestra.run.smithi110.stderr: 73800K .......... .......... .......... .......... .......... 79% 62.6M 0s 2024-03-04T12:37:57.715 INFO:teuthology.orchestra.run.smithi110.stderr: 73850K .......... .......... .......... .......... .......... 79% 49.5M 0s 2024-03-04T12:37:57.715 INFO:teuthology.orchestra.run.smithi110.stderr: 73900K .......... .......... .......... .......... .......... 79% 102M 0s 2024-03-04T12:37:57.715 INFO:teuthology.orchestra.run.smithi110.stderr: 73950K .......... .......... .......... .......... .......... 79% 114M 0s 2024-03-04T12:37:57.715 INFO:teuthology.orchestra.run.smithi110.stderr: 74000K .......... .......... .......... .......... .......... 79% 102M 0s 2024-03-04T12:37:57.715 INFO:teuthology.orchestra.run.smithi110.stderr: 74050K .......... .......... .......... .......... .......... 79% 86.3M 0s 2024-03-04T12:37:57.715 INFO:teuthology.orchestra.run.smithi110.stderr: 74100K .......... .......... .......... .......... .......... 79% 79.2M 0s 2024-03-04T12:37:57.715 INFO:teuthology.orchestra.run.smithi110.stderr: 74150K .......... .......... .......... .......... .......... 79% 99.9M 0s 2024-03-04T12:37:57.715 INFO:teuthology.orchestra.run.smithi110.stderr: 74200K .......... .......... .......... .......... .......... 79% 125M 0s 2024-03-04T12:37:57.715 INFO:teuthology.orchestra.run.smithi110.stderr: 74250K .......... .......... .......... .......... .......... 79% 113M 0s 2024-03-04T12:37:57.715 INFO:teuthology.orchestra.run.smithi110.stderr: 74300K .......... .......... .......... .......... .......... 80% 111M 0s 2024-03-04T12:37:57.715 INFO:teuthology.orchestra.run.smithi110.stderr: 74350K .......... .......... .......... .......... .......... 80% 115M 0s 2024-03-04T12:37:57.716 INFO:teuthology.orchestra.run.smithi110.stderr: 74400K .......... .......... .......... .......... .......... 80% 105M 0s 2024-03-04T12:37:57.716 INFO:teuthology.orchestra.run.smithi110.stderr: 74450K .......... .......... .......... .......... .......... 80% 72.9M 0s 2024-03-04T12:37:57.716 INFO:teuthology.orchestra.run.smithi110.stderr: 74500K .......... .......... .......... .......... .......... 80% 80.2M 0s 2024-03-04T12:37:57.716 INFO:teuthology.orchestra.run.smithi110.stderr: 74550K .......... .......... .......... .......... .......... 80% 113M 0s 2024-03-04T12:37:57.716 INFO:teuthology.orchestra.run.smithi110.stderr: 74600K .......... .......... .......... .......... .......... 80% 121M 0s 2024-03-04T12:37:57.716 INFO:teuthology.orchestra.run.smithi110.stderr: 74650K .......... .......... .......... .......... .......... 80% 110M 0s 2024-03-04T12:37:57.716 INFO:teuthology.orchestra.run.smithi110.stderr: 74700K .......... .......... .......... .......... .......... 80% 115M 0s 2024-03-04T12:37:57.716 INFO:teuthology.orchestra.run.smithi110.stderr: 74750K .......... .......... .......... .......... .......... 80% 119M 0s 2024-03-04T12:37:57.716 INFO:teuthology.orchestra.run.smithi110.stderr: 74800K .......... .......... .......... .......... .......... 80% 108M 0s 2024-03-04T12:37:57.716 INFO:teuthology.orchestra.run.smithi110.stderr: 74850K .......... .......... .......... .......... .......... 80% 81.7M 0s 2024-03-04T12:37:57.716 INFO:teuthology.orchestra.run.smithi110.stderr: 74900K .......... .......... .......... .......... .......... 80% 116M 0s 2024-03-04T12:37:57.716 INFO:teuthology.orchestra.run.smithi110.stderr: 74950K .......... .......... .......... .......... .......... 80% 89.1M 0s 2024-03-04T12:37:57.716 INFO:teuthology.orchestra.run.smithi110.stderr: 75000K .......... .......... .......... .......... .......... 80% 113M 0s 2024-03-04T12:37:57.716 INFO:teuthology.orchestra.run.smithi110.stderr: 75050K .......... .......... .......... .......... .......... 80% 60.1M 0s 2024-03-04T12:37:57.717 INFO:teuthology.orchestra.run.smithi110.stderr: 75100K .......... .......... .......... .......... .......... 80% 124M 0s 2024-03-04T12:37:57.717 INFO:teuthology.orchestra.run.smithi110.stderr: 75150K .......... .......... .......... .......... .......... 80% 116M 0s 2024-03-04T12:37:57.717 INFO:teuthology.orchestra.run.smithi110.stderr: 75200K .......... .......... .......... .......... .......... 81% 61.2M 0s 2024-03-04T12:37:57.717 INFO:teuthology.orchestra.run.smithi110.stderr: 75250K .......... .......... .......... .......... .......... 81% 90.4M 0s 2024-03-04T12:37:57.717 INFO:teuthology.orchestra.run.smithi110.stderr: 75300K .......... .......... .......... .......... .......... 81% 107M 0s 2024-03-04T12:37:57.717 INFO:teuthology.orchestra.run.smithi110.stderr: 75350K .......... .......... .......... .......... .......... 81% 133M 0s 2024-03-04T12:37:57.717 INFO:teuthology.orchestra.run.smithi110.stderr: 75400K .......... .......... .......... .......... .......... 81% 109M 0s 2024-03-04T12:37:57.717 INFO:teuthology.orchestra.run.smithi110.stderr: 75450K .......... .......... .......... .......... .......... 81% 81.2M 0s 2024-03-04T12:37:57.717 INFO:teuthology.orchestra.run.smithi110.stderr: 75500K .......... .......... .......... .......... .......... 81% 110M 0s 2024-03-04T12:37:57.717 INFO:teuthology.orchestra.run.smithi110.stderr: 75550K .......... .......... .......... .......... .......... 81% 114M 0s 2024-03-04T12:37:57.717 INFO:teuthology.orchestra.run.smithi110.stderr: 75600K .......... .......... .......... .......... .......... 81% 75.1M 0s 2024-03-04T12:37:57.717 INFO:teuthology.orchestra.run.smithi110.stderr: 75650K .......... .......... .......... .......... .......... 81% 117M 0s 2024-03-04T12:37:57.717 INFO:teuthology.orchestra.run.smithi110.stderr: 75700K .......... .......... .......... .......... .......... 81% 112M 0s 2024-03-04T12:37:57.717 INFO:teuthology.orchestra.run.smithi110.stderr: 75750K .......... .......... .......... .......... .......... 81% 108M 0s 2024-03-04T12:37:57.717 INFO:teuthology.orchestra.run.smithi110.stderr: 75800K .......... .......... .......... .......... .......... 81% 120M 0s 2024-03-04T12:37:57.718 INFO:teuthology.orchestra.run.smithi110.stderr: 75850K .......... .......... .......... .......... .......... 81% 114M 0s 2024-03-04T12:37:57.718 INFO:teuthology.orchestra.run.smithi110.stderr: 75900K .......... .......... .......... .......... .......... 81% 90.0M 0s 2024-03-04T12:37:57.718 INFO:teuthology.orchestra.run.smithi110.stderr: 75950K .......... .......... .......... .......... .......... 81% 106M 0s 2024-03-04T12:37:57.718 INFO:teuthology.orchestra.run.smithi110.stderr: 76000K .......... .......... .......... .......... .......... 81% 89.0M 0s 2024-03-04T12:37:57.718 INFO:teuthology.orchestra.run.smithi110.stderr: 76050K .......... .......... .......... .......... .......... 81% 93.3M 0s 2024-03-04T12:37:57.718 INFO:teuthology.orchestra.run.smithi110.stderr: 76100K .......... .......... .......... .......... .......... 81% 113M 0s 2024-03-04T12:37:57.718 INFO:teuthology.orchestra.run.smithi110.stderr: 76150K .......... .......... .......... .......... .......... 82% 115M 0s 2024-03-04T12:37:57.718 INFO:teuthology.orchestra.run.smithi110.stderr: 76200K .......... .......... .......... .......... .......... 82% 96.7M 0s 2024-03-04T12:37:57.718 INFO:teuthology.orchestra.run.smithi110.stderr: 76250K .......... .......... .......... .......... .......... 82% 89.3M 0s 2024-03-04T12:37:57.718 INFO:teuthology.orchestra.run.smithi110.stderr: 76300K .......... .......... .......... .......... .......... 82% 146M 0s 2024-03-04T12:37:57.718 INFO:teuthology.orchestra.run.smithi110.stderr: 76350K .......... .......... .......... .......... .......... 82% 81.8M 0s 2024-03-04T12:37:57.718 INFO:teuthology.orchestra.run.smithi110.stderr: 76400K .......... .......... .......... .......... .......... 82% 128M 0s 2024-03-04T12:37:57.718 INFO:teuthology.orchestra.run.smithi110.stderr: 76450K .......... .......... .......... .......... .......... 82% 114M 0s 2024-03-04T12:37:57.718 INFO:teuthology.orchestra.run.smithi110.stderr: 76500K .......... .......... .......... .......... .......... 82% 118M 0s 2024-03-04T12:37:57.718 INFO:teuthology.orchestra.run.smithi110.stderr: 76550K .......... .......... .......... .......... .......... 82% 107M 0s 2024-03-04T12:37:57.719 INFO:teuthology.orchestra.run.smithi110.stderr: 76600K .......... .......... .......... .......... .......... 82% 88.3M 0s 2024-03-04T12:37:57.719 INFO:teuthology.orchestra.run.smithi110.stderr: 76650K .......... .......... .......... .......... .......... 82% 96.2M 0s 2024-03-04T12:37:57.719 INFO:teuthology.orchestra.run.smithi110.stderr: 76700K .......... .......... .......... .......... .......... 82% 73.3M 0s 2024-03-04T12:37:57.719 INFO:teuthology.orchestra.run.smithi110.stderr: 76750K .......... .......... .......... .......... .......... 82% 74.3M 0s 2024-03-04T12:37:57.719 INFO:teuthology.orchestra.run.smithi110.stderr: 76800K .......... .......... .......... .......... .......... 82% 113M 0s 2024-03-04T12:37:57.719 INFO:teuthology.orchestra.run.smithi110.stderr: 76850K .......... .......... .......... .......... .......... 82% 116M 0s 2024-03-04T12:37:57.719 INFO:teuthology.orchestra.run.smithi110.stderr: 76900K .......... .......... .......... .......... .......... 82% 96.6M 0s 2024-03-04T12:37:57.719 INFO:teuthology.orchestra.run.smithi110.stderr: 76950K .......... .......... .......... .......... .......... 82% 92.7M 0s 2024-03-04T12:37:57.719 INFO:teuthology.orchestra.run.smithi110.stderr: 77000K .......... .......... .......... .......... .......... 82% 111M 0s 2024-03-04T12:37:57.719 INFO:teuthology.orchestra.run.smithi110.stderr: 77050K .......... .......... .......... .......... .......... 82% 105M 0s 2024-03-04T12:37:57.719 INFO:teuthology.orchestra.run.smithi110.stderr: 77100K .......... .......... .......... .......... .......... 83% 100M 0s 2024-03-04T12:37:57.719 INFO:teuthology.orchestra.run.smithi110.stderr: 77150K .......... .......... .......... .......... .......... 83% 88.2M 0s 2024-03-04T12:37:57.719 INFO:teuthology.orchestra.run.smithi110.stderr: 77200K .......... .......... .......... .......... .......... 83% 119M 0s 2024-03-04T12:37:57.719 INFO:teuthology.orchestra.run.smithi110.stderr: 77250K .......... .......... .......... .......... .......... 83% 117M 0s 2024-03-04T12:37:57.720 INFO:teuthology.orchestra.run.smithi110.stderr: 77300K .......... .......... .......... .......... .......... 83% 96.0M 0s 2024-03-04T12:37:57.720 INFO:teuthology.orchestra.run.smithi110.stderr: 77350K .......... .......... .......... .......... .......... 83% 82.4M 0s 2024-03-04T12:37:57.720 INFO:teuthology.orchestra.run.smithi110.stderr: 77400K .......... .......... .......... .......... .......... 83% 121M 0s 2024-03-04T12:37:57.720 INFO:teuthology.orchestra.run.smithi110.stderr: 77450K .......... .......... .......... .......... .......... 83% 115M 0s 2024-03-04T12:37:57.720 INFO:teuthology.orchestra.run.smithi110.stderr: 77500K .......... .......... .......... .......... .......... 83% 98.0M 0s 2024-03-04T12:37:57.720 INFO:teuthology.orchestra.run.smithi110.stderr: 77550K .......... .......... .......... .......... .......... 83% 66.8M 0s 2024-03-04T12:37:57.720 INFO:teuthology.orchestra.run.smithi110.stderr: 77600K .......... .......... .......... .......... .......... 83% 120M 0s 2024-03-04T12:37:57.720 INFO:teuthology.orchestra.run.smithi110.stderr: 77650K .......... .......... .......... .......... .......... 83% 117M 0s 2024-03-04T12:37:57.720 INFO:teuthology.orchestra.run.smithi110.stderr: 77700K .......... .......... .......... .......... .......... 83% 97.4M 0s 2024-03-04T12:37:57.720 INFO:teuthology.orchestra.run.smithi110.stderr: 77750K .......... .......... .......... .......... .......... 83% 113M 0s 2024-03-04T12:37:57.720 INFO:teuthology.orchestra.run.smithi110.stderr: 77800K .......... .......... .......... .......... .......... 83% 107M 0s 2024-03-04T12:37:57.720 INFO:teuthology.orchestra.run.smithi110.stderr: 77850K .......... .......... .......... .......... .......... 83% 96.3M 0s 2024-03-04T12:37:57.720 INFO:teuthology.orchestra.run.smithi110.stderr: 77900K .......... .......... .......... .......... .......... 83% 115M 0s 2024-03-04T12:37:57.720 INFO:teuthology.orchestra.run.smithi110.stderr: 77950K .......... .......... .......... .......... .......... 83% 86.6M 0s 2024-03-04T12:37:57.721 INFO:teuthology.orchestra.run.smithi110.stderr: 78000K .......... .......... .......... .......... .......... 84% 90.2M 0s 2024-03-04T12:37:57.721 INFO:teuthology.orchestra.run.smithi110.stderr: 78050K .......... .......... .......... .......... .......... 84% 85.7M 0s 2024-03-04T12:37:57.721 INFO:teuthology.orchestra.run.smithi110.stderr: 78100K .......... .......... .......... .......... .......... 84% 109M 0s 2024-03-04T12:37:57.721 INFO:teuthology.orchestra.run.smithi110.stderr: 78150K .......... .......... .......... .......... .......... 84% 120M 0s 2024-03-04T12:37:57.721 INFO:teuthology.orchestra.run.smithi110.stderr: 78200K .......... .......... .......... .......... .......... 84% 108M 0s 2024-03-04T12:37:57.721 INFO:teuthology.orchestra.run.smithi110.stderr: 78250K .......... .......... .......... .......... .......... 84% 98.4M 0s 2024-03-04T12:37:57.721 INFO:teuthology.orchestra.run.smithi110.stderr: 78300K .......... .......... .......... .......... .......... 84% 94.3M 0s 2024-03-04T12:37:57.721 INFO:teuthology.orchestra.run.smithi110.stderr: 78350K .......... .......... .......... .......... .......... 84% 89.9M 0s 2024-03-04T12:37:57.721 INFO:teuthology.orchestra.run.smithi110.stderr: 78400K .......... .......... .......... .......... .......... 84% 98.0M 0s 2024-03-04T12:37:57.721 INFO:teuthology.orchestra.run.smithi110.stderr: 78450K .......... .......... .......... .......... .......... 84% 115M 0s 2024-03-04T12:37:57.721 INFO:teuthology.orchestra.run.smithi110.stderr: 78500K .......... .......... .......... .......... .......... 84% 107M 0s 2024-03-04T12:37:57.721 INFO:teuthology.orchestra.run.smithi110.stderr: 78550K .......... .......... .......... .......... .......... 84% 117M 0s 2024-03-04T12:37:57.721 INFO:teuthology.orchestra.run.smithi110.stderr: 78600K .......... .......... .......... .......... .......... 84% 115M 0s 2024-03-04T12:37:57.721 INFO:teuthology.orchestra.run.smithi110.stderr: 78650K .......... .......... .......... .......... .......... 84% 122M 0s 2024-03-04T12:37:57.722 INFO:teuthology.orchestra.run.smithi110.stderr: 78700K .......... .......... .......... .......... .......... 84% 117M 0s 2024-03-04T12:37:57.722 INFO:teuthology.orchestra.run.smithi110.stderr: 78750K .......... .......... .......... .......... .......... 84% 84.2M 0s 2024-03-04T12:37:57.722 INFO:teuthology.orchestra.run.smithi110.stderr: 78800K .......... .......... .......... .......... .......... 84% 115M 0s 2024-03-04T12:37:57.722 INFO:teuthology.orchestra.run.smithi110.stderr: 78850K .......... .......... .......... .......... .......... 84% 95.6M 0s 2024-03-04T12:37:57.722 INFO:teuthology.orchestra.run.smithi110.stderr: 78900K .......... .......... .......... .......... .......... 84% 123M 0s 2024-03-04T12:37:57.722 INFO:teuthology.orchestra.run.smithi110.stderr: 78950K .......... .......... .......... .......... .......... 85% 99.2M 0s 2024-03-04T12:37:57.722 INFO:teuthology.orchestra.run.smithi110.stderr: 79000K .......... .......... .......... .......... .......... 85% 100M 0s 2024-03-04T12:37:57.722 INFO:teuthology.orchestra.run.smithi110.stderr: 79050K .......... .......... .......... .......... .......... 85% 114M 0s 2024-03-04T12:37:57.722 INFO:teuthology.orchestra.run.smithi110.stderr: 79100K .......... .......... .......... .......... .......... 85% 79.0M 0s 2024-03-04T12:37:57.722 INFO:teuthology.orchestra.run.smithi110.stderr: 79150K .......... .......... .......... .......... .......... 85% 98.5M 0s 2024-03-04T12:37:57.722 INFO:teuthology.orchestra.run.smithi110.stderr: 79200K .......... .......... .......... .......... .......... 85% 122M 0s 2024-03-04T12:37:57.722 INFO:teuthology.orchestra.run.smithi110.stderr: 79250K .......... .......... .......... .......... .......... 85% 115M 0s 2024-03-04T12:37:57.722 INFO:teuthology.orchestra.run.smithi110.stderr: 79300K .......... .......... .......... .......... .......... 85% 109M 0s 2024-03-04T12:37:57.722 INFO:teuthology.orchestra.run.smithi110.stderr: 79350K .......... .......... .......... .......... .......... 85% 112M 0s 2024-03-04T12:37:57.722 INFO:teuthology.orchestra.run.smithi110.stderr: 79400K .......... .......... .......... .......... .......... 85% 101M 0s 2024-03-04T12:37:57.723 INFO:teuthology.orchestra.run.smithi110.stderr: 79450K .......... .......... .......... .......... .......... 85% 87.8M 0s 2024-03-04T12:37:57.723 INFO:teuthology.orchestra.run.smithi110.stderr: 79500K .......... .......... .......... .......... .......... 85% 53.8M 0s 2024-03-04T12:37:57.723 INFO:teuthology.orchestra.run.smithi110.stderr: 79550K .......... .......... .......... .......... .......... 85% 61.1M 0s 2024-03-04T12:37:57.723 INFO:teuthology.orchestra.run.smithi110.stderr: 79600K .......... .......... .......... .......... .......... 85% 101M 0s 2024-03-04T12:37:57.723 INFO:teuthology.orchestra.run.smithi110.stderr: 79650K .......... .......... .......... .......... .......... 85% 94.5M 0s 2024-03-04T12:37:57.723 INFO:teuthology.orchestra.run.smithi110.stderr: 79700K .......... .......... .......... .......... .......... 85% 64.3M 0s 2024-03-04T12:37:57.723 INFO:teuthology.orchestra.run.smithi110.stderr: 79750K .......... .......... .......... .......... .......... 85% 168M 0s 2024-03-04T12:37:57.723 INFO:teuthology.orchestra.run.smithi110.stderr: 79800K .......... .......... .......... .......... .......... 85% 176M 0s 2024-03-04T12:37:57.723 INFO:teuthology.orchestra.run.smithi110.stderr: 79850K .......... .......... .......... .......... .......... 86% 113M 0s 2024-03-04T12:37:57.723 INFO:teuthology.orchestra.run.smithi110.stderr: 79900K .......... .......... .......... .......... .......... 86% 76.9M 0s 2024-03-04T12:37:57.723 INFO:teuthology.orchestra.run.smithi110.stderr: 79950K .......... .......... .......... .......... .......... 86% 73.9M 0s 2024-03-04T12:37:57.723 INFO:teuthology.orchestra.run.smithi110.stderr: 80000K .......... .......... .......... .......... .......... 86% 53.1M 0s 2024-03-04T12:37:57.723 INFO:teuthology.orchestra.run.smithi110.stderr: 80050K .......... .......... .......... .......... .......... 86% 160M 0s 2024-03-04T12:37:57.723 INFO:teuthology.orchestra.run.smithi110.stderr: 80100K .......... .......... .......... .......... .......... 86% 78.3M 0s 2024-03-04T12:37:57.723 INFO:teuthology.orchestra.run.smithi110.stderr: 80150K .......... .......... .......... .......... .......... 86% 83.7M 0s 2024-03-04T12:37:57.724 INFO:teuthology.orchestra.run.smithi110.stderr: 80200K .......... .......... .......... .......... .......... 86% 82.1M 0s 2024-03-04T12:37:57.724 INFO:teuthology.orchestra.run.smithi110.stderr: 80250K .......... .......... .......... .......... .......... 86% 84.9M 0s 2024-03-04T12:37:57.724 INFO:teuthology.orchestra.run.smithi110.stderr: 80300K .......... .......... .......... .......... .......... 86% 103M 0s 2024-03-04T12:37:57.724 INFO:teuthology.orchestra.run.smithi110.stderr: 80350K .......... .......... .......... .......... .......... 86% 111M 0s 2024-03-04T12:37:57.724 INFO:teuthology.orchestra.run.smithi110.stderr: 80400K .......... .......... .......... .......... .......... 86% 105M 0s 2024-03-04T12:37:57.724 INFO:teuthology.orchestra.run.smithi110.stderr: 80450K .......... .......... .......... .......... .......... 86% 105M 0s 2024-03-04T12:37:57.724 INFO:teuthology.orchestra.run.smithi110.stderr: 80500K .......... .......... .......... .......... .......... 86% 125M 0s 2024-03-04T12:37:57.724 INFO:teuthology.orchestra.run.smithi110.stderr: 80550K .......... .......... .......... .......... .......... 86% 113M 0s 2024-03-04T12:37:57.724 INFO:teuthology.orchestra.run.smithi110.stderr: 80600K .......... .......... .......... .......... .......... 86% 94.0M 0s 2024-03-04T12:37:57.724 INFO:teuthology.orchestra.run.smithi110.stderr: 80650K .......... .......... .......... .......... .......... 86% 71.9M 0s 2024-03-04T12:37:57.724 INFO:teuthology.orchestra.run.smithi110.stderr: 80700K .......... .......... .......... .......... .......... 86% 119M 0s 2024-03-04T12:37:57.724 INFO:teuthology.orchestra.run.smithi110.stderr: 80750K .......... .......... .......... .......... .......... 86% 112M 0s 2024-03-04T12:37:57.724 INFO:teuthology.orchestra.run.smithi110.stderr: 80800K .......... .......... .......... .......... .......... 87% 121M 0s 2024-03-04T12:37:57.725 INFO:teuthology.orchestra.run.smithi110.stderr: 80850K .......... .......... .......... .......... .......... 87% 111M 0s 2024-03-04T12:37:57.725 INFO:teuthology.orchestra.run.smithi110.stderr: 80900K .......... .......... .......... .......... .......... 87% 87.1M 0s 2024-03-04T12:37:57.725 INFO:teuthology.orchestra.run.smithi110.stderr: 80950K .......... .......... .......... .......... .......... 87% 103M 0s 2024-03-04T12:37:57.725 INFO:teuthology.orchestra.run.smithi110.stderr: 81000K .......... .......... .......... .......... .......... 87% 119M 0s 2024-03-04T12:37:57.725 INFO:teuthology.orchestra.run.smithi110.stderr: 81050K .......... .......... .......... .......... .......... 87% 83.4M 0s 2024-03-04T12:37:57.725 INFO:teuthology.orchestra.run.smithi110.stderr: 81100K .......... .......... .......... .......... .......... 87% 125M 0s 2024-03-04T12:37:57.725 INFO:teuthology.orchestra.run.smithi110.stderr: 81150K .......... .......... .......... .......... .......... 87% 112M 0s 2024-03-04T12:37:57.725 INFO:teuthology.orchestra.run.smithi110.stderr: 81200K .......... .......... .......... .......... .......... 87% 103M 0s 2024-03-04T12:37:57.725 INFO:teuthology.orchestra.run.smithi110.stderr: 81250K .......... .......... .......... .......... .......... 87% 95.8M 0s 2024-03-04T12:37:57.725 INFO:teuthology.orchestra.run.smithi110.stderr: 81300K .......... .......... .......... .......... .......... 87% 114M 0s 2024-03-04T12:37:57.725 INFO:teuthology.orchestra.run.smithi110.stderr: 81350K .......... .......... .......... .......... .......... 87% 103M 0s 2024-03-04T12:37:57.725 INFO:teuthology.orchestra.run.smithi110.stderr: 81400K .......... .......... .......... .......... .......... 87% 98.2M 0s 2024-03-04T12:37:57.725 INFO:teuthology.orchestra.run.smithi110.stderr: 81450K .......... .......... .......... .......... .......... 87% 67.7M 0s 2024-03-04T12:37:57.725 INFO:teuthology.orchestra.run.smithi110.stderr: 81500K .......... .......... .......... .......... .......... 87% 94.6M 0s 2024-03-04T12:37:57.725 INFO:teuthology.orchestra.run.smithi110.stderr: 81550K .......... .......... .......... .......... .......... 87% 114M 0s 2024-03-04T12:37:57.726 INFO:teuthology.orchestra.run.smithi110.stderr: 81600K .......... .......... .......... .......... .......... 87% 114M 0s 2024-03-04T12:37:57.726 INFO:teuthology.orchestra.run.smithi110.stderr: 81650K .......... .......... .......... .......... .......... 87% 112M 0s 2024-03-04T12:37:57.726 INFO:teuthology.orchestra.run.smithi110.stderr: 81700K .......... .......... .......... .......... .......... 87% 106M 0s 2024-03-04T12:37:57.726 INFO:teuthology.orchestra.run.smithi110.stderr: 81750K .......... .......... .......... .......... .......... 88% 112M 0s 2024-03-04T12:37:57.726 INFO:teuthology.orchestra.run.smithi110.stderr: 81800K .......... .......... .......... .......... .......... 88% 119M 0s 2024-03-04T12:37:57.726 INFO:teuthology.orchestra.run.smithi110.stderr: 81850K .......... .......... .......... .......... .......... 88% 87.0M 0s 2024-03-04T12:37:57.726 INFO:teuthology.orchestra.run.smithi110.stderr: 81900K .......... .......... .......... .......... .......... 88% 112M 0s 2024-03-04T12:37:57.726 INFO:teuthology.orchestra.run.smithi110.stderr: 81950K .......... .......... .......... .......... .......... 88% 118M 0s 2024-03-04T12:37:57.726 INFO:teuthology.orchestra.run.smithi110.stderr: 82000K .......... .......... .......... .......... .......... 88% 114M 0s 2024-03-04T12:37:57.726 INFO:teuthology.orchestra.run.smithi110.stderr: 82050K .......... .......... .......... .......... .......... 88% 110M 0s 2024-03-04T12:37:57.726 INFO:teuthology.orchestra.run.smithi110.stderr: 82100K .......... .......... .......... .......... .......... 88% 113M 0s 2024-03-04T12:37:57.726 INFO:teuthology.orchestra.run.smithi110.stderr: 82150K .......... .......... .......... .......... .......... 88% 113M 0s 2024-03-04T12:37:57.726 INFO:teuthology.orchestra.run.smithi110.stderr: 82200K .......... .......... .......... .......... .......... 88% 116M 0s 2024-03-04T12:37:57.726 INFO:teuthology.orchestra.run.smithi110.stderr: 82250K .......... .......... .......... .......... .......... 88% 92.4M 0s 2024-03-04T12:37:57.726 INFO:teuthology.orchestra.run.smithi110.stderr: 82300K .......... .......... .......... .......... .......... 88% 112M 0s 2024-03-04T12:37:57.727 INFO:teuthology.orchestra.run.smithi110.stderr: 82350K .......... .......... .......... .......... .......... 88% 116M 0s 2024-03-04T12:37:57.727 INFO:teuthology.orchestra.run.smithi110.stderr: 82400K .......... .......... .......... .......... .......... 88% 110M 0s 2024-03-04T12:37:57.727 INFO:teuthology.orchestra.run.smithi110.stderr: 82450K .......... .......... .......... .......... .......... 88% 107M 0s 2024-03-04T12:37:57.727 INFO:teuthology.orchestra.run.smithi110.stderr: 82500K .......... .......... .......... .......... .......... 88% 97.1M 0s 2024-03-04T12:37:57.727 INFO:teuthology.orchestra.run.smithi110.stderr: 82550K .......... .......... .......... .......... .......... 88% 91.9M 0s 2024-03-04T12:37:57.727 INFO:teuthology.orchestra.run.smithi110.stderr: 82600K .......... .......... .......... .......... .......... 88% 80.5M 0s 2024-03-04T12:37:57.727 INFO:teuthology.orchestra.run.smithi110.stderr: 82650K .......... .......... .......... .......... .......... 89% 112M 0s 2024-03-04T12:37:57.727 INFO:teuthology.orchestra.run.smithi110.stderr: 82700K .......... .......... .......... .......... .......... 89% 102M 0s 2024-03-04T12:37:57.727 INFO:teuthology.orchestra.run.smithi110.stderr: 82750K .......... .......... .......... .......... .......... 89% 108M 0s 2024-03-04T12:37:57.727 INFO:teuthology.orchestra.run.smithi110.stderr: 82800K .......... .......... .......... .......... .......... 89% 112M 0s 2024-03-04T12:37:57.727 INFO:teuthology.orchestra.run.smithi110.stderr: 82850K .......... .......... .......... .......... .......... 89% 118M 0s 2024-03-04T12:37:57.727 INFO:teuthology.orchestra.run.smithi110.stderr: 82900K .......... .......... .......... .......... .......... 89% 112M 0s 2024-03-04T12:37:57.727 INFO:teuthology.orchestra.run.smithi110.stderr: 82950K .......... .......... .......... .......... .......... 89% 117M 0s 2024-03-04T12:37:57.727 INFO:teuthology.orchestra.run.smithi110.stderr: 83000K .......... .......... .......... .......... .......... 89% 86.7M 0s 2024-03-04T12:37:57.727 INFO:teuthology.orchestra.run.smithi110.stderr: 83050K .......... .......... .......... .......... .......... 89% 110M 0s 2024-03-04T12:37:57.728 INFO:teuthology.orchestra.run.smithi110.stderr: 83100K .......... .......... .......... .......... .......... 89% 121M 0s 2024-03-04T12:37:57.728 INFO:teuthology.orchestra.run.smithi110.stderr: 83150K .......... .......... .......... .......... .......... 89% 113M 0s 2024-03-04T12:37:57.728 INFO:teuthology.orchestra.run.smithi110.stderr: 83200K .......... .......... .......... .......... .......... 89% 95.9M 0s 2024-03-04T12:37:57.728 INFO:teuthology.orchestra.run.smithi110.stderr: 83250K .......... .......... .......... .......... .......... 89% 116M 0s 2024-03-04T12:37:57.728 INFO:teuthology.orchestra.run.smithi110.stderr: 83300K .......... .......... .......... .......... .......... 89% 119M 0s 2024-03-04T12:37:57.728 INFO:teuthology.orchestra.run.smithi110.stderr: 83350K .......... .......... .......... .......... .......... 89% 112M 0s 2024-03-04T12:37:57.728 INFO:teuthology.orchestra.run.smithi110.stderr: 83400K .......... .......... .......... .......... .......... 89% 78.5M 0s 2024-03-04T12:37:57.728 INFO:teuthology.orchestra.run.smithi110.stderr: 83450K .......... .......... .......... .......... .......... 89% 98.2M 0s 2024-03-04T12:37:57.728 INFO:teuthology.orchestra.run.smithi110.stderr: 83500K .......... .......... .......... .......... .......... 89% 115M 0s 2024-03-04T12:37:57.728 INFO:teuthology.orchestra.run.smithi110.stderr: 83550K .......... .......... .......... .......... .......... 89% 113M 0s 2024-03-04T12:37:57.728 INFO:teuthology.orchestra.run.smithi110.stderr: 83600K .......... .......... .......... .......... .......... 90% 111M 0s 2024-03-04T12:37:57.728 INFO:teuthology.orchestra.run.smithi110.stderr: 83650K .......... .......... .......... .......... .......... 90% 101M 0s 2024-03-04T12:37:57.728 INFO:teuthology.orchestra.run.smithi110.stderr: 83700K .......... .......... .......... .......... .......... 90% 115M 0s 2024-03-04T12:37:57.728 INFO:teuthology.orchestra.run.smithi110.stderr: 83750K .......... .......... .......... .......... .......... 90% 118M 0s 2024-03-04T12:37:57.729 INFO:teuthology.orchestra.run.smithi110.stderr: 83800K .......... .......... .......... .......... .......... 90% 60.6M 0s 2024-03-04T12:37:57.729 INFO:teuthology.orchestra.run.smithi110.stderr: 83850K .......... .......... .......... .......... .......... 90% 115M 0s 2024-03-04T12:37:57.729 INFO:teuthology.orchestra.run.smithi110.stderr: 83900K .......... .......... .......... .......... .......... 90% 118M 0s 2024-03-04T12:37:57.729 INFO:teuthology.orchestra.run.smithi110.stderr: 83950K .......... .......... .......... .......... .......... 90% 103M 0s 2024-03-04T12:37:57.729 INFO:teuthology.orchestra.run.smithi110.stderr: 84000K .......... .......... .......... .......... .......... 90% 110M 0s 2024-03-04T12:37:57.729 INFO:teuthology.orchestra.run.smithi110.stderr: 84050K .......... .......... .......... .......... .......... 90% 92.8M 0s 2024-03-04T12:37:57.729 INFO:teuthology.orchestra.run.smithi110.stderr: 84100K .......... .......... .......... .......... .......... 90% 103M 0s 2024-03-04T12:37:57.729 INFO:teuthology.orchestra.run.smithi110.stderr: 84150K .......... .......... .......... .......... .......... 90% 107M 0s 2024-03-04T12:37:57.729 INFO:teuthology.orchestra.run.smithi110.stderr: 84200K .......... .......... .......... .......... .......... 90% 70.6M 0s 2024-03-04T12:37:57.729 INFO:teuthology.orchestra.run.smithi110.stderr: 84250K .......... .......... .......... .......... .......... 90% 117M 0s 2024-03-04T12:37:57.729 INFO:teuthology.orchestra.run.smithi110.stderr: 84300K .......... .......... .......... .......... .......... 90% 95.8M 0s 2024-03-04T12:37:57.729 INFO:teuthology.orchestra.run.smithi110.stderr: 84350K .......... .......... .......... .......... .......... 90% 115M 0s 2024-03-04T12:37:57.729 INFO:teuthology.orchestra.run.smithi110.stderr: 84400K .......... .......... .......... .......... .......... 90% 88.6M 0s 2024-03-04T12:37:57.729 INFO:teuthology.orchestra.run.smithi110.stderr: 84450K .......... .......... .......... .......... .......... 90% 117M 0s 2024-03-04T12:37:57.729 INFO:teuthology.orchestra.run.smithi110.stderr: 84500K .......... .......... .......... .......... .......... 91% 81.3M 0s 2024-03-04T12:37:57.730 INFO:teuthology.orchestra.run.smithi110.stderr: 84550K .......... .......... .......... .......... .......... 91% 117M 0s 2024-03-04T12:37:57.730 INFO:teuthology.orchestra.run.smithi110.stderr: 84600K .......... .......... .......... .......... .......... 91% 113M 0s 2024-03-04T12:37:57.730 INFO:teuthology.orchestra.run.smithi110.stderr: 84650K .......... .......... .......... .......... .......... 91% 83.7M 0s 2024-03-04T12:37:57.730 INFO:teuthology.orchestra.run.smithi110.stderr: 84700K .......... .......... .......... .......... .......... 91% 113M 0s 2024-03-04T12:37:57.730 INFO:teuthology.orchestra.run.smithi110.stderr: 84750K .......... .......... .......... .......... .......... 91% 113M 0s 2024-03-04T12:37:57.730 INFO:teuthology.orchestra.run.smithi110.stderr: 84800K .......... .......... .......... .......... .......... 91% 115M 0s 2024-03-04T12:37:57.730 INFO:teuthology.orchestra.run.smithi110.stderr: 84850K .......... .......... .......... .......... .......... 91% 87.2M 0s 2024-03-04T12:37:57.730 INFO:teuthology.orchestra.run.smithi110.stderr: 84900K .......... .......... .......... .......... .......... 91% 88.1M 0s 2024-03-04T12:37:57.730 INFO:teuthology.orchestra.run.smithi110.stderr: 84950K .......... .......... .......... .......... .......... 91% 118M 0s 2024-03-04T12:37:57.730 INFO:teuthology.orchestra.run.smithi110.stderr: 85000K .......... .......... .......... .......... .......... 91% 108M 0s 2024-03-04T12:37:57.730 INFO:teuthology.orchestra.run.smithi110.stderr: 85050K .......... .......... .......... .......... .......... 91% 108M 0s 2024-03-04T12:37:57.730 INFO:teuthology.orchestra.run.smithi110.stderr: 85100K .......... .......... .......... .......... .......... 91% 108M 0s 2024-03-04T12:37:57.730 INFO:teuthology.orchestra.run.smithi110.stderr: 85150K .......... .......... .......... .......... .......... 91% 119M 0s 2024-03-04T12:37:57.730 INFO:teuthology.orchestra.run.smithi110.stderr: 85200K .......... .......... .......... .......... .......... 91% 109M 0s 2024-03-04T12:37:57.730 INFO:teuthology.orchestra.run.smithi110.stderr: 85250K .......... .......... .......... .......... .......... 91% 125M 0s 2024-03-04T12:37:57.731 INFO:teuthology.orchestra.run.smithi110.stderr: 85300K .......... .......... .......... .......... .......... 91% 70.5M 0s 2024-03-04T12:37:57.731 INFO:teuthology.orchestra.run.smithi110.stderr: 85350K .......... .......... .......... .......... .......... 91% 89.3M 0s 2024-03-04T12:37:57.731 INFO:teuthology.orchestra.run.smithi110.stderr: 85400K .......... .......... .......... .......... .......... 91% 115M 0s 2024-03-04T12:37:57.731 INFO:teuthology.orchestra.run.smithi110.stderr: 85450K .......... .......... .......... .......... .......... 92% 114M 0s 2024-03-04T12:37:57.731 INFO:teuthology.orchestra.run.smithi110.stderr: 85500K .......... .......... .......... .......... .......... 92% 91.2M 0s 2024-03-04T12:37:57.731 INFO:teuthology.orchestra.run.smithi110.stderr: 85550K .......... .......... .......... .......... .......... 92% 68.3M 0s 2024-03-04T12:37:57.731 INFO:teuthology.orchestra.run.smithi110.stderr: 85600K .......... .......... .......... .......... .......... 92% 124M 0s 2024-03-04T12:37:57.731 INFO:teuthology.orchestra.run.smithi110.stderr: 85650K .......... .......... .......... .......... .......... 92% 54.6M 0s 2024-03-04T12:37:57.731 INFO:teuthology.orchestra.run.smithi110.stderr: 85700K .......... .......... .......... .......... .......... 92% 76.1M 0s 2024-03-04T12:37:57.731 INFO:teuthology.orchestra.run.smithi110.stderr: 85750K .......... .......... .......... .......... .......... 92% 64.5M 0s 2024-03-04T12:37:57.731 INFO:teuthology.orchestra.run.smithi110.stderr: 85800K .......... .......... .......... .......... .......... 92% 71.8M 0s 2024-03-04T12:37:57.731 INFO:teuthology.orchestra.run.smithi110.stderr: 85850K .......... .......... .......... .......... .......... 92% 60.8M 0s 2024-03-04T12:37:57.731 INFO:teuthology.orchestra.run.smithi110.stderr: 85900K .......... .......... .......... .......... .......... 92% 113M 0s 2024-03-04T12:37:57.731 INFO:teuthology.orchestra.run.smithi110.stderr: 85950K .......... .......... .......... .......... .......... 92% 112M 0s 2024-03-04T12:37:57.731 INFO:teuthology.orchestra.run.smithi110.stderr: 86000K .......... .......... .......... .......... .......... 92% 74.6M 0s 2024-03-04T12:37:57.732 INFO:teuthology.orchestra.run.smithi110.stderr: 86050K .......... .......... .......... .......... .......... 92% 85.8M 0s 2024-03-04T12:37:57.732 INFO:teuthology.orchestra.run.smithi110.stderr: 86100K .......... .......... .......... .......... .......... 92% 61.2M 0s 2024-03-04T12:37:57.732 INFO:teuthology.orchestra.run.smithi110.stderr: 86150K .......... .......... .......... .......... .......... 92% 112M 0s 2024-03-04T12:37:57.732 INFO:teuthology.orchestra.run.smithi110.stderr: 86200K .......... .......... .......... .......... .......... 92% 80.3M 0s 2024-03-04T12:37:57.732 INFO:teuthology.orchestra.run.smithi110.stderr: 86250K .......... .......... .......... .......... .......... 92% 79.1M 0s 2024-03-04T12:37:57.732 INFO:teuthology.orchestra.run.smithi110.stderr: 86300K .......... .......... .......... .......... .......... 92% 89.9M 0s 2024-03-04T12:37:57.732 INFO:teuthology.orchestra.run.smithi110.stderr: 86350K .......... .......... .......... .......... .......... 93% 122M 0s 2024-03-04T12:37:57.732 INFO:teuthology.orchestra.run.smithi110.stderr: 86400K .......... .......... .......... .......... .......... 93% 91.9M 0s 2024-03-04T12:37:57.732 INFO:teuthology.orchestra.run.smithi110.stderr: 86450K .......... .......... .......... .......... .......... 93% 82.4M 0s 2024-03-04T12:37:57.732 INFO:teuthology.orchestra.run.smithi110.stderr: 86500K .......... .......... .......... .......... .......... 93% 89.7M 0s 2024-03-04T12:37:57.732 INFO:teuthology.orchestra.run.smithi110.stderr: 86550K .......... .......... .......... .......... .......... 93% 111M 0s 2024-03-04T12:37:57.732 INFO:teuthology.orchestra.run.smithi110.stderr: 86600K .......... .......... .......... .......... .......... 93% 113M 0s 2024-03-04T12:37:57.732 INFO:teuthology.orchestra.run.smithi110.stderr: 86650K .......... .......... .......... .......... .......... 93% 88.0M 0s 2024-03-04T12:37:57.733 INFO:teuthology.orchestra.run.smithi110.stderr: 86700K .......... .......... .......... .......... .......... 93% 123M 0s 2024-03-04T12:37:57.733 INFO:teuthology.orchestra.run.smithi110.stderr: 86750K .......... .......... .......... .......... .......... 93% 70.1M 0s 2024-03-04T12:37:57.733 INFO:teuthology.orchestra.run.smithi110.stderr: 86800K .......... .......... .......... .......... .......... 93% 144M 0s 2024-03-04T12:37:57.733 INFO:teuthology.orchestra.run.smithi110.stderr: 86850K .......... .......... .......... .......... .......... 93% 119M 0s 2024-03-04T12:37:57.733 INFO:teuthology.orchestra.run.smithi110.stderr: 86900K .......... .......... .......... .......... .......... 93% 77.5M 0s 2024-03-04T12:37:57.733 INFO:teuthology.orchestra.run.smithi110.stderr: 86950K .......... .......... .......... .......... .......... 93% 103M 0s 2024-03-04T12:37:57.733 INFO:teuthology.orchestra.run.smithi110.stderr: 87000K .......... .......... .......... .......... .......... 93% 92.6M 0s 2024-03-04T12:37:57.733 INFO:teuthology.orchestra.run.smithi110.stderr: 87050K .......... .......... .......... .......... .......... 93% 148M 0s 2024-03-04T12:37:57.733 INFO:teuthology.orchestra.run.smithi110.stderr: 87100K .......... .......... .......... .......... .......... 93% 102M 0s 2024-03-04T12:37:57.733 INFO:teuthology.orchestra.run.smithi110.stderr: 87150K .......... .......... .......... .......... .......... 93% 107M 0s 2024-03-04T12:37:57.733 INFO:teuthology.orchestra.run.smithi110.stderr: 87200K .......... .......... .......... .......... .......... 93% 90.1M 0s 2024-03-04T12:37:57.733 INFO:teuthology.orchestra.run.smithi110.stderr: 87250K .......... .......... .......... .......... .......... 93% 112M 0s 2024-03-04T12:37:57.733 INFO:teuthology.orchestra.run.smithi110.stderr: 87300K .......... .......... .......... .......... .......... 94% 90.2M 0s 2024-03-04T12:37:57.733 INFO:teuthology.orchestra.run.smithi110.stderr: 87350K .......... .......... .......... .......... .......... 94% 114M 0s 2024-03-04T12:37:57.733 INFO:teuthology.orchestra.run.smithi110.stderr: 87400K .......... .......... .......... .......... .......... 94% 109M 0s 2024-03-04T12:37:57.734 INFO:teuthology.orchestra.run.smithi110.stderr: 87450K .......... .......... .......... .......... .......... 94% 118M 0s 2024-03-04T12:37:57.734 INFO:teuthology.orchestra.run.smithi110.stderr: 87500K .......... .......... .......... .......... .......... 94% 112M 0s 2024-03-04T12:37:57.734 INFO:teuthology.orchestra.run.smithi110.stderr: 87550K .......... .......... .......... .......... .......... 94% 104M 0s 2024-03-04T12:37:57.734 INFO:teuthology.orchestra.run.smithi110.stderr: 87600K .......... .......... .......... .......... .......... 94% 113M 0s 2024-03-04T12:37:57.734 INFO:teuthology.orchestra.run.smithi110.stderr: 87650K .......... .......... .......... .......... .......... 94% 93.3M 0s 2024-03-04T12:37:57.734 INFO:teuthology.orchestra.run.smithi110.stderr: 87700K .......... .......... .......... .......... .......... 94% 104M 0s 2024-03-04T12:37:57.734 INFO:teuthology.orchestra.run.smithi110.stderr: 87750K .......... .......... .......... .......... .......... 94% 114M 0s 2024-03-04T12:37:57.734 INFO:teuthology.orchestra.run.smithi110.stderr: 87800K .......... .......... .......... .......... .......... 94% 111M 0s 2024-03-04T12:37:57.734 INFO:teuthology.orchestra.run.smithi110.stderr: 87850K .......... .......... .......... .......... .......... 94% 93.1M 0s 2024-03-04T12:37:57.734 INFO:teuthology.orchestra.run.smithi110.stderr: 87900K .......... .......... .......... .......... .......... 94% 104M 0s 2024-03-04T12:37:57.734 INFO:teuthology.orchestra.run.smithi110.stderr: 87950K .......... .......... .......... .......... .......... 94% 111M 0s 2024-03-04T12:37:57.734 INFO:teuthology.orchestra.run.smithi110.stderr: 88000K .......... .......... .......... .......... .......... 94% 94.0M 0s 2024-03-04T12:37:57.734 INFO:teuthology.orchestra.run.smithi110.stderr: 88050K .......... .......... .......... .......... .......... 94% 113M 0s 2024-03-04T12:37:57.734 INFO:teuthology.orchestra.run.smithi110.stderr: 88100K .......... .......... .......... .......... .......... 94% 116M 0s 2024-03-04T12:37:57.734 INFO:teuthology.orchestra.run.smithi110.stderr: 88150K .......... .......... .......... .......... .......... 94% 88.6M 0s 2024-03-04T12:37:57.735 INFO:teuthology.orchestra.run.smithi110.stderr: 88200K .......... .......... .......... .......... .......... 94% 86.4M 0s 2024-03-04T12:37:57.735 INFO:teuthology.orchestra.run.smithi110.stderr: 88250K .......... .......... .......... .......... .......... 95% 148M 0s 2024-03-04T12:37:57.735 INFO:teuthology.orchestra.run.smithi110.stderr: 88300K .......... .......... .......... .......... .......... 95% 116M 0s 2024-03-04T12:37:57.735 INFO:teuthology.orchestra.run.smithi110.stderr: 88350K .......... .......... .......... .......... .......... 95% 82.5M 0s 2024-03-04T12:37:57.735 INFO:teuthology.orchestra.run.smithi110.stderr: 88400K .......... .......... .......... .......... .......... 95% 80.9M 0s 2024-03-04T12:37:57.735 INFO:teuthology.orchestra.run.smithi110.stderr: 88450K .......... .......... .......... .......... .......... 95% 130M 0s 2024-03-04T12:37:57.735 INFO:teuthology.orchestra.run.smithi110.stderr: 88500K .......... .......... .......... .......... .......... 95% 93.5M 0s 2024-03-04T12:37:57.735 INFO:teuthology.orchestra.run.smithi110.stderr: 88550K .......... .......... .......... .......... .......... 95% 112M 0s 2024-03-04T12:37:57.735 INFO:teuthology.orchestra.run.smithi110.stderr: 88600K .......... .......... .......... .......... .......... 95% 104M 0s 2024-03-04T12:37:57.735 INFO:teuthology.orchestra.run.smithi110.stderr: 88650K .......... .......... .......... .......... .......... 95% 114M 0s 2024-03-04T12:37:57.735 INFO:teuthology.orchestra.run.smithi110.stderr: 88700K .......... .......... .......... .......... .......... 95% 108M 0s 2024-03-04T12:37:57.735 INFO:teuthology.orchestra.run.smithi110.stderr: 88750K .......... .......... .......... .......... .......... 95% 125M 0s 2024-03-04T12:37:57.735 INFO:teuthology.orchestra.run.smithi110.stderr: 88800K .......... .......... .......... .......... .......... 95% 91.8M 0s 2024-03-04T12:37:57.735 INFO:teuthology.orchestra.run.smithi110.stderr: 88850K .......... .......... .......... .......... .......... 95% 70.2M 0s 2024-03-04T12:37:57.735 INFO:teuthology.orchestra.run.smithi110.stderr: 88900K .......... .......... .......... .......... .......... 95% 119M 0s 2024-03-04T12:37:57.736 INFO:teuthology.orchestra.run.smithi110.stderr: 88950K .......... .......... .......... .......... .......... 95% 110M 0s 2024-03-04T12:37:57.736 INFO:teuthology.orchestra.run.smithi110.stderr: 89000K .......... .......... .......... .......... .......... 95% 106M 0s 2024-03-04T12:37:57.736 INFO:teuthology.orchestra.run.smithi110.stderr: 89050K .......... .......... .......... .......... .......... 95% 113M 0s 2024-03-04T12:37:57.736 INFO:teuthology.orchestra.run.smithi110.stderr: 89100K .......... .......... .......... .......... .......... 95% 113M 0s 2024-03-04T12:37:57.736 INFO:teuthology.orchestra.run.smithi110.stderr: 89150K .......... .......... .......... .......... .......... 96% 111M 0s 2024-03-04T12:37:57.736 INFO:teuthology.orchestra.run.smithi110.stderr: 89200K .......... .......... .......... .......... .......... 96% 88.8M 0s 2024-03-04T12:37:57.736 INFO:teuthology.orchestra.run.smithi110.stderr: 89250K .......... .......... .......... .......... .......... 96% 110M 0s 2024-03-04T12:37:57.736 INFO:teuthology.orchestra.run.smithi110.stderr: 89300K .......... .......... .......... .......... .......... 96% 116M 0s 2024-03-04T12:37:57.736 INFO:teuthology.orchestra.run.smithi110.stderr: 89350K .......... .......... .......... .......... .......... 96% 108M 0s 2024-03-04T12:37:57.736 INFO:teuthology.orchestra.run.smithi110.stderr: 89400K .......... .......... .......... .......... .......... 96% 107M 0s 2024-03-04T12:37:57.736 INFO:teuthology.orchestra.run.smithi110.stderr: 89450K .......... .......... .......... .......... .......... 96% 105M 0s 2024-03-04T12:37:57.736 INFO:teuthology.orchestra.run.smithi110.stderr: 89500K .......... .......... .......... .......... .......... 96% 89.9M 0s 2024-03-04T12:37:57.736 INFO:teuthology.orchestra.run.smithi110.stderr: 89550K .......... .......... .......... .......... .......... 96% 112M 0s 2024-03-04T12:37:57.736 INFO:teuthology.orchestra.run.smithi110.stderr: 89600K .......... .......... .......... .......... .......... 96% 88.8M 0s 2024-03-04T12:37:57.737 INFO:teuthology.orchestra.run.smithi110.stderr: 89650K .......... .......... .......... .......... .......... 96% 112M 0s 2024-03-04T12:37:57.737 INFO:teuthology.orchestra.run.smithi110.stderr: 89700K .......... .......... .......... .......... .......... 96% 31.5M 0s 2024-03-04T12:37:57.737 INFO:teuthology.orchestra.run.smithi110.stderr: 89750K .......... .......... .......... .......... .......... 96% 219M 0s 2024-03-04T12:37:57.737 INFO:teuthology.orchestra.run.smithi110.stderr: 89800K .......... .......... .......... .......... .......... 96% 331M 0s 2024-03-04T12:37:57.737 INFO:teuthology.orchestra.run.smithi110.stderr: 89850K .......... .......... .......... .......... .......... 96% 369M 0s 2024-03-04T12:37:57.737 INFO:teuthology.orchestra.run.smithi110.stderr: 89900K .......... .......... .......... .......... .......... 96% 233M 0s 2024-03-04T12:37:57.737 INFO:teuthology.orchestra.run.smithi110.stderr: 89950K .......... .......... .......... .......... .......... 96% 77.4M 0s 2024-03-04T12:37:57.737 INFO:teuthology.orchestra.run.smithi110.stderr: 90000K .......... .......... .......... .......... .......... 96% 122M 0s 2024-03-04T12:37:57.737 INFO:teuthology.orchestra.run.smithi110.stderr: 90050K .......... .......... .......... .......... .......... 96% 108M 0s 2024-03-04T12:37:57.737 INFO:teuthology.orchestra.run.smithi110.stderr: 90100K .......... .......... .......... .......... .......... 97% 123M 0s 2024-03-04T12:37:57.737 INFO:teuthology.orchestra.run.smithi110.stderr: 90150K .......... .......... .......... .......... .......... 97% 87.2M 0s 2024-03-04T12:37:57.737 INFO:teuthology.orchestra.run.smithi110.stderr: 90200K .......... .......... .......... .......... .......... 97% 102M 0s 2024-03-04T12:37:57.737 INFO:teuthology.orchestra.run.smithi110.stderr: 90250K .......... .......... .......... .......... .......... 97% 118M 0s 2024-03-04T12:37:57.737 INFO:teuthology.orchestra.run.smithi110.stderr: 90300K .......... .......... .......... .......... .......... 97% 123M 0s 2024-03-04T12:37:57.737 INFO:teuthology.orchestra.run.smithi110.stderr: 90350K .......... .......... .......... .......... .......... 97% 63.2M 0s 2024-03-04T12:37:57.737 INFO:teuthology.orchestra.run.smithi110.stderr: 90400K .......... .......... .......... .......... .......... 97% 123M 0s 2024-03-04T12:37:57.738 INFO:teuthology.orchestra.run.smithi110.stderr: 90450K .......... .......... .......... .......... .......... 97% 101M 0s 2024-03-04T12:37:57.738 INFO:teuthology.orchestra.run.smithi110.stderr: 90500K .......... .......... .......... .......... .......... 97% 98.2M 0s 2024-03-04T12:37:57.738 INFO:teuthology.orchestra.run.smithi110.stderr: 90550K .......... .......... .......... .......... .......... 97% 113M 0s 2024-03-04T12:37:57.738 INFO:teuthology.orchestra.run.smithi110.stderr: 90600K .......... .......... .......... .......... .......... 97% 101M 0s 2024-03-04T12:37:57.738 INFO:teuthology.orchestra.run.smithi110.stderr: 90650K .......... .......... .......... .......... .......... 97% 115M 0s 2024-03-04T12:37:57.738 INFO:teuthology.orchestra.run.smithi110.stderr: 90700K .......... .......... .......... .......... .......... 97% 85.9M 0s 2024-03-04T12:37:57.738 INFO:teuthology.orchestra.run.smithi110.stderr: 90750K .......... .......... .......... .......... .......... 97% 115M 0s 2024-03-04T12:37:57.738 INFO:teuthology.orchestra.run.smithi110.stderr: 90800K .......... .......... .......... .......... .......... 97% 115M 0s 2024-03-04T12:37:57.738 INFO:teuthology.orchestra.run.smithi110.stderr: 90850K .......... .......... .......... .......... .......... 97% 86.7M 0s 2024-03-04T12:37:57.738 INFO:teuthology.orchestra.run.smithi110.stderr: 90900K .......... .......... .......... .......... .......... 97% 91.1M 0s 2024-03-04T12:37:57.738 INFO:teuthology.orchestra.run.smithi110.stderr: 90950K .......... .......... .......... .......... .......... 97% 108M 0s 2024-03-04T12:37:57.738 INFO:teuthology.orchestra.run.smithi110.stderr: 91000K .......... .......... .......... .......... .......... 98% 114M 0s 2024-03-04T12:37:57.738 INFO:teuthology.orchestra.run.smithi110.stderr: 91050K .......... .......... .......... .......... .......... 98% 109M 0s 2024-03-04T12:37:57.738 INFO:teuthology.orchestra.run.smithi110.stderr: 91100K .......... .......... .......... .......... .......... 98% 92.4M 0s 2024-03-04T12:37:57.738 INFO:teuthology.orchestra.run.smithi110.stderr: 91150K .......... .......... .......... .......... .......... 98% 77.7M 0s 2024-03-04T12:37:57.738 INFO:teuthology.orchestra.run.smithi110.stderr: 91200K .......... .......... .......... .......... .......... 98% 106M 0s 2024-03-04T12:37:57.739 INFO:teuthology.orchestra.run.smithi110.stderr: 91250K .......... .......... .......... .......... .......... 98% 123M 0s 2024-03-04T12:37:57.739 INFO:teuthology.orchestra.run.smithi110.stderr: 91300K .......... .......... .......... .......... .......... 98% 92.9M 0s 2024-03-04T12:37:57.739 INFO:teuthology.orchestra.run.smithi110.stderr: 91350K .......... .......... .......... .......... .......... 98% 92.7M 0s 2024-03-04T12:37:57.739 INFO:teuthology.orchestra.run.smithi110.stderr: 91400K .......... .......... .......... .......... .......... 98% 89.4M 0s 2024-03-04T12:37:57.739 INFO:teuthology.orchestra.run.smithi110.stderr: 91450K .......... .......... .......... .......... .......... 98% 112M 0s 2024-03-04T12:37:57.739 INFO:teuthology.orchestra.run.smithi110.stderr: 91500K .......... .......... .......... .......... .......... 98% 101M 0s 2024-03-04T12:37:57.739 INFO:teuthology.orchestra.run.smithi110.stderr: 91550K .......... .......... .......... .......... .......... 98% 100M 0s 2024-03-04T12:37:57.739 INFO:teuthology.orchestra.run.smithi110.stderr: 91600K .......... .......... .......... .......... .......... 98% 73.1M 0s 2024-03-04T12:37:57.739 INFO:teuthology.orchestra.run.smithi110.stderr: 91650K .......... .......... .......... .......... .......... 98% 74.6M 0s 2024-03-04T12:37:57.739 INFO:teuthology.orchestra.run.smithi110.stderr: 91700K .......... .......... .......... .......... .......... 98% 341M 0s 2024-03-04T12:37:57.739 INFO:teuthology.orchestra.run.smithi110.stderr: 91750K .......... .......... .......... .......... .......... 98% 78.1M 0s 2024-03-04T12:37:57.739 INFO:teuthology.orchestra.run.smithi110.stderr: 91800K .......... .......... .......... .......... .......... 98% 58.7M 0s 2024-03-04T12:37:57.739 INFO:teuthology.orchestra.run.smithi110.stderr: 91850K .......... .......... .......... .......... .......... 98% 116M 0s 2024-03-04T12:37:57.739 INFO:teuthology.orchestra.run.smithi110.stderr: 91900K .......... .......... .......... .......... .......... 98% 98.3M 0s 2024-03-04T12:37:57.739 INFO:teuthology.orchestra.run.smithi110.stderr: 91950K .......... .......... .......... .......... .......... 99% 129M 0s 2024-03-04T12:37:57.740 INFO:teuthology.orchestra.run.smithi110.stderr: 92000K .......... .......... .......... .......... .......... 99% 87.7M 0s 2024-03-04T12:37:57.740 INFO:teuthology.orchestra.run.smithi110.stderr: 92050K .......... .......... .......... .......... .......... 99% 76.3M 0s 2024-03-04T12:37:57.740 INFO:teuthology.orchestra.run.smithi110.stderr: 92100K .......... .......... .......... .......... .......... 99% 69.4M 0s 2024-03-04T12:37:57.740 INFO:teuthology.orchestra.run.smithi110.stderr: 92150K .......... .......... .......... .......... .......... 99% 104M 0s 2024-03-04T12:37:57.740 INFO:teuthology.orchestra.run.smithi110.stderr: 92200K .......... .......... .......... .......... .......... 99% 62.2M 0s 2024-03-04T12:37:57.740 INFO:teuthology.orchestra.run.smithi110.stderr: 92250K .......... .......... .......... .......... .......... 99% 96.5M 0s 2024-03-04T12:37:57.740 INFO:teuthology.orchestra.run.smithi110.stderr: 92300K .......... .......... .......... .......... .......... 99% 94.7M 0s 2024-03-04T12:37:57.740 INFO:teuthology.orchestra.run.smithi110.stderr: 92350K .......... .......... .......... .......... .......... 99% 103M 0s 2024-03-04T12:37:57.740 INFO:teuthology.orchestra.run.smithi110.stderr: 92400K .......... .......... .......... .......... .......... 99% 104M 0s 2024-03-04T12:37:57.740 INFO:teuthology.orchestra.run.smithi110.stderr: 92450K .......... .......... .......... .......... .......... 99% 85.6M 0s 2024-03-04T12:37:57.740 INFO:teuthology.orchestra.run.smithi110.stderr: 92500K .......... .......... .......... .......... .......... 99% 62.4M 0s 2024-03-04T12:37:57.740 INFO:teuthology.orchestra.run.smithi110.stderr: 92550K .......... .......... .......... .......... .......... 99% 110M 0s 2024-03-04T12:37:57.740 INFO:teuthology.orchestra.run.smithi110.stderr: 92600K .......... .......... .......... .......... .......... 99% 79.7M 0s 2024-03-04T12:37:57.740 INFO:teuthology.orchestra.run.smithi110.stderr: 92650K .......... .......... .......... .......... .......... 99% 113M 0s 2024-03-04T12:37:57.741 INFO:teuthology.orchestra.run.smithi110.stderr: 92700K .......... .......... .......... .......... .......... 99% 102M 0s 2024-03-04T12:37:57.741 INFO:teuthology.orchestra.run.smithi110.stderr: 92750K .......... .......... .......... .......... .......... 99% 110M 0s 2024-03-04T12:37:57.741 INFO:teuthology.orchestra.run.smithi110.stderr: 92800K .......... .......... .......... .......... .......... 99% 91.5M 0s 2024-03-04T12:37:57.741 INFO:teuthology.orchestra.run.smithi110.stderr: 92850K .......... .......... .......... .......... .......... 99% 136M 0s 2024-03-04T12:37:57.741 INFO:teuthology.orchestra.run.smithi110.stderr: 92900K 100% 134G=1.2s 2024-03-04T12:37:57.741 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-03-04T12:37:57.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04 12:37:57 (73.0 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-03-04T12:37:57.741 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-03-04T12:37:57.766 INFO:teuthology.orchestra.run.smithi110.stdout:Archive: gradle-6.0.1-bin.zip 2024-03-04T12:37:57.766 INFO:teuthology.orchestra.run.smithi110.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-03-04T12:37:57.766 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-03-04T12:37:57.767 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-03-04T12:37:57.767 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-03-04T12:37:57.767 INFO:teuthology.orchestra.run.smithi110.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-03-04T12:37:57.767 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-03-04T12:37:57.767 INFO:teuthology.orchestra.run.smithi110.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-03-04T12:37:57.767 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-03-04T12:37:57.767 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-03-04T12:37:57.767 INFO:teuthology.orchestra.run.smithi110.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-03-04T12:37:57.767 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-03-04T12:37:57.767 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-03-04T12:37:57.767 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-03-04T12:37:57.767 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-03-04T12:37:57.767 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-03-04T12:37:57.768 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-03-04T12:37:57.768 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-03-04T12:37:57.768 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-03-04T12:37:57.768 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-03-04T12:37:57.768 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-03-04T12:37:57.768 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-03-04T12:37:57.768 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-03-04T12:37:57.768 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-03-04T12:37:57.768 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-03-04T12:37:57.768 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-03-04T12:37:57.768 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-03-04T12:37:57.768 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-03-04T12:37:57.768 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-03-04T12:37:57.768 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-03-04T12:37:57.769 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-03-04T12:37:57.769 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-03-04T12:37:57.769 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-03-04T12:37:57.769 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-03-04T12:37:57.769 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-03-04T12:37:57.769 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-03-04T12:37:57.769 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-03-04T12:37:57.769 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-03-04T12:37:57.769 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-03-04T12:37:57.769 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-03-04T12:37:57.769 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-03-04T12:37:57.769 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-03-04T12:37:57.769 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-03-04T12:37:57.769 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-03-04T12:37:57.769 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-03-04T12:37:57.770 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-03-04T12:37:57.770 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-03-04T12:37:57.770 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-03-04T12:37:57.770 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-03-04T12:37:57.770 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-03-04T12:37:57.770 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-03-04T12:37:57.770 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-03-04T12:37:57.770 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-03-04T12:37:57.770 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-03-04T12:37:57.770 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-03-04T12:37:57.770 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-03-04T12:37:57.770 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-03-04T12:37:57.770 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-03-04T12:37:57.770 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-03-04T12:37:57.770 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-03-04T12:37:57.771 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-03-04T12:37:57.771 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-03-04T12:37:57.771 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-03-04T12:37:57.771 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-03-04T12:37:57.771 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-03-04T12:37:57.771 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-03-04T12:37:57.771 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-03-04T12:37:57.771 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-03-04T12:37:57.771 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-03-04T12:37:57.771 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-03-04T12:37:57.771 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-03-04T12:37:57.771 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-03-04T12:37:57.771 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-03-04T12:37:57.771 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-03-04T12:37:57.771 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-03-04T12:37:57.772 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-03-04T12:37:57.772 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-03-04T12:37:57.772 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-03-04T12:37:57.772 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-03-04T12:37:57.772 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-03-04T12:37:57.772 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-03-04T12:37:57.772 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-03-04T12:37:57.772 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-03-04T12:37:57.772 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-03-04T12:37:57.772 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-03-04T12:37:57.772 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-03-04T12:37:57.772 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-03-04T12:37:57.772 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-03-04T12:37:57.772 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-03-04T12:37:57.772 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-03-04T12:37:57.773 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-03-04T12:37:57.773 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-03-04T12:37:57.773 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-03-04T12:37:57.773 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-03-04T12:37:57.773 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-03-04T12:37:57.773 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-03-04T12:37:57.773 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-03-04T12:37:57.773 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-03-04T12:37:57.773 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-03-04T12:37:57.773 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-03-04T12:37:57.773 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-03-04T12:37:57.773 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-03-04T12:37:57.773 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-03-04T12:37:57.773 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-03-04T12:37:57.774 INFO:teuthology.orchestra.run.smithi110.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-03-04T12:37:57.774 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-03-04T12:37:57.774 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-03-04T12:37:57.774 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-03-04T12:37:57.774 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-03-04T12:37:57.774 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-03-04T12:37:57.774 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-03-04T12:37:57.774 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-03-04T12:37:57.774 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-03-04T12:37:57.774 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-03-04T12:37:57.774 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-03-04T12:37:57.774 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-03-04T12:37:57.774 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-03-04T12:37:57.774 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-03-04T12:37:57.774 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-03-04T12:37:57.775 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-03-04T12:37:57.775 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-03-04T12:37:57.775 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-03-04T12:37:57.775 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-03-04T12:37:57.775 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-03-04T12:37:57.775 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-03-04T12:37:57.775 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-03-04T12:37:57.775 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-03-04T12:37:57.775 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-03-04T12:37:57.775 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-03-04T12:37:57.775 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-03-04T12:37:57.775 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-03-04T12:37:57.775 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-03-04T12:37:57.775 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-03-04T12:37:57.775 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-03-04T12:37:57.776 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-03-04T12:37:57.776 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-03-04T12:37:57.776 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-03-04T12:37:57.776 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-03-04T12:37:57.776 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-03-04T12:37:57.776 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-03-04T12:37:57.776 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-03-04T12:37:57.776 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-03-04T12:37:57.776 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-03-04T12:37:57.776 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-03-04T12:37:57.776 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-03-04T12:37:57.776 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-03-04T12:37:57.776 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-03-04T12:37:57.776 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-03-04T12:37:57.777 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-03-04T12:37:57.777 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-03-04T12:37:57.777 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-03-04T12:37:57.777 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-03-04T12:37:57.777 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-03-04T12:37:57.777 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-03-04T12:37:57.777 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-03-04T12:37:57.777 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-03-04T12:37:57.777 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-03-04T12:37:57.777 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-03-04T12:37:57.777 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-03-04T12:37:57.777 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-03-04T12:37:57.777 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-03-04T12:37:57.777 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-03-04T12:37:57.777 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-03-04T12:37:57.778 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-03-04T12:37:57.778 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-03-04T12:37:57.778 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-03-04T12:37:57.778 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-03-04T12:37:57.778 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-03-04T12:37:57.778 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-03-04T12:37:57.778 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-03-04T12:37:57.778 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-03-04T12:37:57.778 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-03-04T12:37:57.778 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-03-04T12:37:57.778 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-03-04T12:37:57.778 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-03-04T12:37:57.778 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-03-04T12:37:57.778 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-03-04T12:37:57.778 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-03-04T12:37:57.779 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-03-04T12:37:57.779 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-03-04T12:37:57.779 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-03-04T12:37:57.779 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-03-04T12:37:57.779 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-03-04T12:37:57.779 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-03-04T12:37:57.779 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-03-04T12:37:57.779 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-03-04T12:37:57.780 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-03-04T12:37:57.780 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-03-04T12:37:57.780 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-03-04T12:37:57.780 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-03-04T12:37:57.785 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-03-04T12:37:57.785 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-03-04T12:37:57.794 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-03-04T12:37:57.796 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-03-04T12:37:57.796 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-03-04T12:37:57.800 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-03-04T12:37:57.806 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-03-04T12:37:57.834 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-03-04T12:37:57.836 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-03-04T12:37:57.836 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-03-04T12:37:57.837 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-03-04T12:37:57.838 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-03-04T12:37:57.838 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-03-04T12:37:57.839 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-03-04T12:37:57.839 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-03-04T12:37:57.841 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-03-04T12:37:57.842 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-03-04T12:37:57.842 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-03-04T12:37:57.843 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-03-04T12:37:57.844 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-03-04T12:37:57.845 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-03-04T12:37:57.845 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-03-04T12:37:57.845 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-03-04T12:37:57.846 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-03-04T12:37:57.847 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-03-04T12:37:57.847 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-03-04T12:37:57.847 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-03-04T12:37:57.847 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-03-04T12:37:57.847 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-03-04T12:37:57.847 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-03-04T12:37:57.849 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-03-04T12:37:57.850 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-03-04T12:37:57.853 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-03-04T12:37:57.854 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-03-04T12:37:57.855 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-03-04T12:37:57.855 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-03-04T12:37:57.855 INFO:teuthology.orchestra.run.smithi110.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-03-04T12:37:57.894 INFO:teuthology.orchestra.run.smithi110.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-03-04T12:37:58.246 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:37:58.246 INFO:teuthology.orchestra.run.smithi110.stdout:Welcome to Gradle 6.0.1! 2024-03-04T12:37:58.246 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:37:58.247 INFO:teuthology.orchestra.run.smithi110.stdout:Here are the highlights of this release: 2024-03-04T12:37:58.247 INFO:teuthology.orchestra.run.smithi110.stdout: - Substantial improvements in dependency management, including 2024-03-04T12:37:58.247 INFO:teuthology.orchestra.run.smithi110.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-03-04T12:37:58.247 INFO:teuthology.orchestra.run.smithi110.stdout: - Advanced control of transitive versions 2024-03-04T12:37:58.247 INFO:teuthology.orchestra.run.smithi110.stdout: - Support for optional features and dependencies 2024-03-04T12:37:58.247 INFO:teuthology.orchestra.run.smithi110.stdout: - Rules to tweak published metadata 2024-03-04T12:37:58.247 INFO:teuthology.orchestra.run.smithi110.stdout: - Support for Java 13 2024-03-04T12:37:58.248 INFO:teuthology.orchestra.run.smithi110.stdout: - Faster incremental Java and Groovy compilation 2024-03-04T12:37:58.248 INFO:teuthology.orchestra.run.smithi110.stdout: - New Zinc compiler for Scala 2024-03-04T12:37:58.248 INFO:teuthology.orchestra.run.smithi110.stdout: - VS2019 support 2024-03-04T12:37:58.248 INFO:teuthology.orchestra.run.smithi110.stdout: - Support for Gradle Enterprise plugin 3.0 2024-03-04T12:37:58.248 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:37:58.248 INFO:teuthology.orchestra.run.smithi110.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-03-04T12:37:58.248 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:37:58.248 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:37:58.248 INFO:teuthology.orchestra.run.smithi110.stdout:------------------------------------------------------------ 2024-03-04T12:37:58.248 INFO:teuthology.orchestra.run.smithi110.stdout:Gradle 6.0.1 2024-03-04T12:37:58.248 INFO:teuthology.orchestra.run.smithi110.stdout:------------------------------------------------------------ 2024-03-04T12:37:58.248 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:37:58.248 INFO:teuthology.orchestra.run.smithi110.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-03-04T12:37:58.248 INFO:teuthology.orchestra.run.smithi110.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-03-04T12:37:58.249 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:37:58.249 INFO:teuthology.orchestra.run.smithi110.stdout:Kotlin: 1.3.50 2024-03-04T12:37:58.249 INFO:teuthology.orchestra.run.smithi110.stdout:Groovy: 2.5.8 2024-03-04T12:37:58.249 INFO:teuthology.orchestra.run.smithi110.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-03-04T12:37:58.249 INFO:teuthology.orchestra.run.smithi110.stdout:JVM: 11.0.18 (Red Hat, Inc. 11.0.18+10-LTS) 2024-03-04T12:37:58.249 INFO:teuthology.orchestra.run.smithi110.stdout:OS: Linux 5.14.0-427.el9.x86_64 amd64 2024-03-04T12:37:58.249 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:37:58.249 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-03-04T12:37:58.249 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-03-04T12:37:58.249 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi110.front.sepia.ceph.com 2024-03-04T12:37:58.250 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-03-04T12:37:58.250 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi172.front.sepia.ceph.com 2024-03-04T12:37:58.250 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-03-04T12:37:58.486 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-03-04T12:37:58.486 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-03-04T12:37:58.487 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'FCENOISWEYTMQHERKROJ', 'access_secret': 'fOkZJhgtJo3XqHDeaxrxg5gmRmctwD1kPlWQbmkbVQhZ4NZLKRNxZA==', 'region': 'mexico', 'endpoint': 'smithi110.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi110.front.sepia.ceph.com'} 2024-03-04T12:37:58.487 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-03-04T12:37:58.487 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'FCENOISWEYTMQHERKROJ', '--secret', 'fOkZJhgtJo3XqHDeaxrxg5gmRmctwD1kPlWQbmkbVQhZ4NZLKRNxZA==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-03-04T12:37:58.487 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key FCENOISWEYTMQHERKROJ --secret fOkZJhgtJo3XqHDeaxrxg5gmRmctwD1kPlWQbmkbVQhZ4NZLKRNxZA== --email tester.client.0_test@test.test --cluster ceph 2024-03-04T12:37:58.548 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:58.548 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:58.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.572+0000 7f01a8911800 20 rados->read ofs=0 len=0 2024-03-04T12:37:58.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.573+0000 7f01a8911800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.573+0000 7f01a8911800 20 realm 2024-03-04T12:37:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.573+0000 7f01a8911800 20 rados->read ofs=0 len=0 2024-03-04T12:37:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.573+0000 7f01a8911800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.573+0000 7f01a8911800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.573+0000 7f01a8911800 20 rados->read ofs=0 len=0 2024-03-04T12:37:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.574+0000 7f01a8911800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.574+0000 7f01a8911800 20 rados->read ofs=0 len=0 2024-03-04T12:37:58.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.574+0000 7f01a8911800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:58.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.574+0000 7f01a8911800 20 rados->read ofs=0 len=0 2024-03-04T12:37:58.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.575+0000 7f01a8911800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:58.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.575+0000 7f01a8911800 20 searching for the correct realm 2024-03-04T12:37:58.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.577+0000 7f01a640d640 0 -- 172.21.15.110:0/2530552037 >> [v2:172.21.15.110:6800/2482344533,v1:172.21.15.110:6801/2482344533] conn(0x55932e011da0 msgr2=0x7f01a0053970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:58.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.782+0000 7f01a6c0e640 0 -- 172.21.15.110:0/2530552037 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f0190051030 msgr2=0x7f0190049030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:58.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.788+0000 7f01a8911800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:58.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.788+0000 7f01a8911800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:58.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.788+0000 7f01a8911800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:58.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.788+0000 7f01a8911800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:58.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.788+0000 7f01a8911800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:58.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.788+0000 7f01a8911800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:58.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.788+0000 7f01a8911800 20 rados->read ofs=0 len=0 2024-03-04T12:37:58.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.789+0000 7f01a8911800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:58.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.789+0000 7f01a8911800 20 rados->read ofs=0 len=0 2024-03-04T12:37:58.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.789+0000 7f01a8911800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:58.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.789+0000 7f01a8911800 20 rados->read ofs=0 len=0 2024-03-04T12:37:58.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.789+0000 7f01a8911800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:58.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.789+0000 7f01a8911800 20 zone default found 2024-03-04T12:37:58.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.789+0000 7f01a8911800 4 Realm: () 2024-03-04T12:37:58.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.789+0000 7f01a8911800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:58.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.789+0000 7f01a8911800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:58.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.789+0000 7f01a8911800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:58.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.789+0000 7f01a8911800 20 zonegroup default 2024-03-04T12:37:58.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.789+0000 7f01a8911800 20 rados->read ofs=0 len=0 2024-03-04T12:37:58.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.789+0000 7f01a8911800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:58.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.789+0000 7f01a8911800 20 rados->read ofs=0 len=0 2024-03-04T12:37:58.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.790+0000 7f01a8911800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:58.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.790+0000 7f01a8911800 20 rados->read ofs=0 len=0 2024-03-04T12:37:58.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.790+0000 7f01a8911800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:58.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.790+0000 7f01a8911800 20 started sync module instance, tier type = 2024-03-04T12:37:58.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.790+0000 7f01a8911800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:58.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.800+0000 7f01a8911800 20 add_watcher() i=0 2024-03-04T12:37:58.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.800+0000 7f01a8911800 20 add_watcher() i=1 2024-03-04T12:37:58.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.800+0000 7f01a8911800 20 add_watcher() i=2 2024-03-04T12:37:58.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.800+0000 7f01a8911800 20 add_watcher() i=3 2024-03-04T12:37:58.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.800+0000 7f01a8911800 20 add_watcher() i=4 2024-03-04T12:37:58.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.800+0000 7f01a8911800 20 add_watcher() i=5 2024-03-04T12:37:58.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.800+0000 7f01a8911800 20 add_watcher() i=6 2024-03-04T12:37:58.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.801+0000 7f01a8911800 20 add_watcher() i=7 2024-03-04T12:37:58.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.801+0000 7f01a8911800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:58.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.802+0000 7f005cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:58.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.802+0000 7f01a8911800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:58.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.802+0000 7f01a8911800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:58.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.802+0000 7f01a8911800 5 note: GC not initialized 2024-03-04T12:37:58.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.803+0000 7effd77fe640 20 reqs_thread_entry: start 2024-03-04T12:37:58.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.803+0000 7f01a8911800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:58.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.803+0000 7f01a8911800 20 Filter name: none 2024-03-04T12:37:58.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.803+0000 7effd57fa640 20 reqs_thread_entry: start 2024-03-04T12:37:58.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.803+0000 7f01a8911800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-03-04T12:37:58.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.803+0000 7f01a8911800 20 rados->read ofs=0 len=0 2024-03-04T12:37:58.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.803+0000 7f01a8911800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:58.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.803+0000 7f01a8911800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-03-04T12:37:58.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.803+0000 7f01a8911800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-04T12:37:58.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.803+0000 7f01a8911800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-03-04T12:37:58.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.803+0000 7f01a8911800 20 rados->read ofs=0 len=0 2024-03-04T12:37:58.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.804+0000 7f01a8911800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:58.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.804+0000 7f01a8911800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-03-04T12:37:58.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.804+0000 7f01a8911800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-03-04T12:37:58.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.804+0000 7f01a8911800 10 cache get: name=default.rgw.meta+users.keys+FCENOISWEYTMQHERKROJ : miss 2024-03-04T12:37:58.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.804+0000 7f01a8911800 20 rados->read ofs=0 len=0 2024-03-04T12:37:58.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.804+0000 7f01a8911800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:58.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.804+0000 7f01a8911800 10 cache put: name=default.rgw.meta+users.keys+FCENOISWEYTMQHERKROJ info.flags=0x0 2024-03-04T12:37:58.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.804+0000 7f01a8911800 10 adding default.rgw.meta+users.keys+FCENOISWEYTMQHERKROJ to cache LRU end 2024-03-04T12:37:58.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.804+0000 7f01a8911800 10 cache get: name=default.rgw.meta+users.keys+FCENOISWEYTMQHERKROJ : hit (negative entry) 2024-03-04T12:37:58.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.804+0000 7f01a8911800 10 cache get: name=default.rgw.meta+users.keys+FCENOISWEYTMQHERKROJ : hit (negative entry) 2024-03-04T12:37:58.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.806+0000 7f01a8911800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-03-04T12:37:58.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.806+0000 7f01a8911800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-04T12:37:58.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.806+0000 7f01a8911800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-03-04T12:37:58.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.806+0000 7f0089ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824049 cookie 94090621785776 notifier 6929 bl.length()=637 2024-03-04T12:37:58.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.806+0000 7f0089ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-03-04T12:37:58.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.806+0000 7f0089ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-04T12:37:58.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.809+0000 7f01a8911800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-03-04T12:37:58.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.809+0000 7f01a8911800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-03-04T12:37:58.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.809+0000 7f01a8911800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-03-04T12:37:58.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.809+0000 7f0089ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824044 cookie 94090621796176 notifier 6929 bl.length()=200 2024-03-04T12:37:58.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.809+0000 7f0089ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-03-04T12:37:58.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.809+0000 7f0089ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-03-04T12:37:58.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.811+0000 7f01a8911800 10 cache put: name=default.rgw.meta+users.keys+FCENOISWEYTMQHERKROJ info.flags=0x7 2024-03-04T12:37:58.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.811+0000 7f01a8911800 10 moving default.rgw.meta+users.keys+FCENOISWEYTMQHERKROJ to cache LRU end 2024-03-04T12:37:58.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.811+0000 7f01a8911800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:FCENOISWEYTMQHERKROJ, ofs0, ns] 2024-03-04T12:37:58.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.812+0000 7f00897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824122 cookie 94090621798864 notifier 6929 bl.length()=189 2024-03-04T12:37:58.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.812+0000 7f00897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FCENOISWEYTMQHERKROJ info.flags=0x7 2024-03-04T12:37:58.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.812+0000 7f00897fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FCENOISWEYTMQHERKROJ to cache LRU end 2024-03-04T12:37:58.819 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T12:37:58.819 INFO:teuthology.orchestra.run.smithi110.stdout: "user_id": "tester.client.0", 2024-03-04T12:37:58.819 INFO:teuthology.orchestra.run.smithi110.stdout: "display_name": "Ms. tester.client.0", 2024-03-04T12:37:58.820 INFO:teuthology.orchestra.run.smithi110.stdout: "email": "tester.client.0_test@test.test", 2024-03-04T12:37:58.820 INFO:teuthology.orchestra.run.smithi110.stdout: "suspended": 0, 2024-03-04T12:37:58.820 INFO:teuthology.orchestra.run.smithi110.stdout: "max_buckets": 1000, 2024-03-04T12:37:58.820 INFO:teuthology.orchestra.run.smithi110.stdout: "subusers": [], 2024-03-04T12:37:58.820 INFO:teuthology.orchestra.run.smithi110.stdout: "keys": [ 2024-03-04T12:37:58.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:37:58.820 INFO:teuthology.orchestra.run.smithi110.stdout: "user": "tester.client.0", 2024-03-04T12:37:58.820 INFO:teuthology.orchestra.run.smithi110.stdout: "access_key": "FCENOISWEYTMQHERKROJ", 2024-03-04T12:37:58.820 INFO:teuthology.orchestra.run.smithi110.stdout: "secret_key": "fOkZJhgtJo3XqHDeaxrxg5gmRmctwD1kPlWQbmkbVQhZ4NZLKRNxZA==", 2024-03-04T12:37:58.820 INFO:teuthology.orchestra.run.smithi110.stdout: "active": true 2024-03-04T12:37:58.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-03-04T12:37:58.820 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-03-04T12:37:58.820 INFO:teuthology.orchestra.run.smithi110.stdout: "swift_keys": [], 2024-03-04T12:37:58.820 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": [], 2024-03-04T12:37:58.821 INFO:teuthology.orchestra.run.smithi110.stdout: "op_mask": "read, write, delete", 2024-03-04T12:37:58.821 INFO:teuthology.orchestra.run.smithi110.stdout: "default_placement": "", 2024-03-04T12:37:58.821 INFO:teuthology.orchestra.run.smithi110.stdout: "default_storage_class": "", 2024-03-04T12:37:58.821 INFO:teuthology.orchestra.run.smithi110.stdout: "placement_tags": [], 2024-03-04T12:37:58.821 INFO:teuthology.orchestra.run.smithi110.stdout: "bucket_quota": { 2024-03-04T12:37:58.821 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:37:58.821 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:37:58.821 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:37:58.821 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:37:58.821 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:37:58.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:37:58.821 INFO:teuthology.orchestra.run.smithi110.stdout: "user_quota": { 2024-03-04T12:37:58.821 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:37:58.821 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:37:58.821 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:37:58.822 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:37:58.822 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:37:58.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:37:58.822 INFO:teuthology.orchestra.run.smithi110.stdout: "temp_url_keys": [], 2024-03-04T12:37:58.822 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "rgw", 2024-03-04T12:37:58.822 INFO:teuthology.orchestra.run.smithi110.stdout: "mfa_ids": [] 2024-03-04T12:37:58.822 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T12:37:58.822 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:37:58.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.814+0000 7f005cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:58.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.817+0000 7f01a8911800 20 remove_watcher() i=0 2024-03-04T12:37:58.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.817+0000 7f01a8911800 2 removed watcher, disabling cache 2024-03-04T12:37:58.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.818+0000 7f01a8911800 20 remove_watcher() i=1 2024-03-04T12:37:58.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.819+0000 7f01a8911800 20 remove_watcher() i=2 2024-03-04T12:37:58.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.820+0000 7f01a8911800 20 remove_watcher() i=3 2024-03-04T12:37:58.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.821+0000 7f01a8911800 20 remove_watcher() i=4 2024-03-04T12:37:58.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.822+0000 7f01a8911800 20 remove_watcher() i=5 2024-03-04T12:37:58.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.823+0000 7f01a8911800 20 remove_watcher() i=6 2024-03-04T12:37:58.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:58.824+0000 7f01a8911800 20 remove_watcher() i=7 2024-03-04T12:37:58.841 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:37:58.841 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-03-04T12:37:58.870 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-03-04T12:37:58.871 DEBUG:teuthology.orchestra.run.smithi110:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-03-04T12:37:58.935 DEBUG:teuthology.orchestra.run.smithi110:> radosgw-admin gc process --include-all 2024-03-04T12:37:59.025 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:59.026 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:59.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.053+0000 7f495e216800 20 rados->read ofs=0 len=0 2024-03-04T12:37:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.054+0000 7f495e216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.054+0000 7f495e216800 20 realm 2024-03-04T12:37:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.054+0000 7f495e216800 20 rados->read ofs=0 len=0 2024-03-04T12:37:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.055+0000 7f495e216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.055+0000 7f495e216800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.055+0000 7f495e216800 20 rados->read ofs=0 len=0 2024-03-04T12:37:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.055+0000 7f495e216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:59.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.055+0000 7f495e216800 20 rados->read ofs=0 len=0 2024-03-04T12:37:59.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.056+0000 7f495e216800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:59.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.056+0000 7f495e216800 20 rados->read ofs=0 len=0 2024-03-04T12:37:59.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.056+0000 7f495e216800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:59.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.056+0000 7f495e216800 20 searching for the correct realm 2024-03-04T12:37:59.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.059+0000 7f4951099640 0 -- 172.21.15.110:0/830227307 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f494c050bd0 msgr2=0x7f494c03c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:59.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.064+0000 7f495989a640 0 -- 172.21.15.110:0/830227307 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f4944060c00 msgr2=0x7f494405ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:37:59.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.270+0000 7f495e216800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:37:59.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.270+0000 7f495e216800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:37:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.270+0000 7f495e216800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:37:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.270+0000 7f495e216800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:37:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.270+0000 7f495e216800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:37:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.270+0000 7f495e216800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:37:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.270+0000 7f495e216800 20 rados->read ofs=0 len=0 2024-03-04T12:37:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.270+0000 7f495e216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.270+0000 7f495e216800 20 rados->read ofs=0 len=0 2024-03-04T12:37:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.271+0000 7f495e216800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.271+0000 7f495e216800 20 rados->read ofs=0 len=0 2024-03-04T12:37:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.271+0000 7f495e216800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:37:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.271+0000 7f495e216800 20 zone default found 2024-03-04T12:37:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.271+0000 7f495e216800 4 Realm: () 2024-03-04T12:37:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.271+0000 7f495e216800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:37:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.271+0000 7f495e216800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:37:59.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.271+0000 7f495e216800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:37:59.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.271+0000 7f495e216800 20 zonegroup default 2024-03-04T12:37:59.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.271+0000 7f495e216800 20 rados->read ofs=0 len=0 2024-03-04T12:37:59.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.271+0000 7f495e216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:59.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.271+0000 7f495e216800 20 rados->read ofs=0 len=0 2024-03-04T12:37:59.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.272+0000 7f495e216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:59.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.272+0000 7f495e216800 20 rados->read ofs=0 len=0 2024-03-04T12:37:59.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.272+0000 7f495e216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:59.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.272+0000 7f495e216800 20 started sync module instance, tier type = 2024-03-04T12:37:59.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.272+0000 7f495e216800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:37:59.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.282+0000 7f495e216800 20 add_watcher() i=0 2024-03-04T12:37:59.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.282+0000 7f495e216800 20 add_watcher() i=1 2024-03-04T12:37:59.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.282+0000 7f495e216800 20 add_watcher() i=2 2024-03-04T12:37:59.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.282+0000 7f495e216800 20 add_watcher() i=3 2024-03-04T12:37:59.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.282+0000 7f495e216800 20 add_watcher() i=4 2024-03-04T12:37:59.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.282+0000 7f495e216800 20 add_watcher() i=5 2024-03-04T12:37:59.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.282+0000 7f495e216800 20 add_watcher() i=6 2024-03-04T12:37:59.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.283+0000 7f495e216800 20 add_watcher() i=7 2024-03-04T12:37:59.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.283+0000 7f495e216800 2 all 8 watchers are set, enabling cache 2024-03-04T12:37:59.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.284+0000 7f480b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:59.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.285+0000 7f495e216800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:37:59.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.285+0000 7f495e216800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:37:59.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.322+0000 7f480a7fc640 20 reqs_thread_entry: start 2024-03-04T12:37:59.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.322+0000 7f495e216800 20 init_complete bucket index max shards: 11 2024-03-04T12:37:59.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.322+0000 7f495e216800 20 Filter name: none 2024-03-04T12:37:59.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.322+0000 7f477bfff640 20 reqs_thread_entry: start 2024-03-04T12:37:59.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.322+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:37:59.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.323+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.324+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.324+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:37:59.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.324+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='_PVZdviq26EgcO8AowFwMc-yH7MMZ9fa', time=2024-03-04T14:33:47.747983+0000, chain.objs.size()=1 2024-03-04T12:37:59.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.324+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.Rkvq6bD8mszaIwSLo4-cFwmwB129nNo_1 2024-03-04T12:37:59.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.324+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='_msq9eltZrEFxmajxJYO_6fJgsHk7hGe', time=2024-03-04T14:33:47.809670+0000, chain.objs.size()=2 2024-03-04T12:37:59.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.324+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.le1ZgQ4GF0W2O5jR7atTykVF7C9U7to_1 2024-03-04T12:37:59.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.324+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.le1ZgQ4GF0W2O5jR7atTykVF7C9U7to_2 2024-03-04T12:37:59.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.327+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.329+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:37:59.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.331+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.331+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.332+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.333+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:37:59.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.334+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.334+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.335+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.336+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:37:59.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.337+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.338+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.339+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:37:59.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.339+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9948899938861830815', time=2024-03-04T14:33:47.674665+0000, chain.objs.size()=4 2024-03-04T12:37:59.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.339+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13__multipart_foo.2~iRuDy7EzBXzWC9ELDof04xzKwovxAxS.1 2024-03-04T12:37:59.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.339+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13__multipart_foo.2~iRuDy7EzBXzWC9ELDof04xzKwovxAxS.2 2024-03-04T12:37:59.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.339+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13__multipart_foo.2~iRuDy7EzBXzWC9ELDof04xzKwovxAxS.3 2024-03-04T12:37:59.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.339+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13__multipart_foo.2~iRuDy7EzBXzWC9ELDof04xzKwovxAxS.4 2024-03-04T12:37:59.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.340+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.342+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:37:59.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.344+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.344+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.344+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.345+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:37:59.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.347+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.347+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.348+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:37:59.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.348+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15881263055245146626', time=2024-03-04T14:33:47.824624+0000, chain.objs.size()=3 2024-03-04T12:37:59.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.348+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.1 2024-03-04T12:37:59.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.348+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.2 2024-03-04T12:37:59.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.348+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.3 2024-03-04T12:37:59.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.349+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.352+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:37:59.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.353+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.354+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.354+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:37:59.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.354+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='_vfvDl0xHu7nKvCrOWur-8oG9W_NJWw4', time=2024-03-04T14:33:47.758665+0000, chain.objs.size()=1 2024-03-04T12:37:59.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.354+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.NnzEjxY_Mw66YxzqRe5SColZzUlQA0W_0 2024-03-04T12:37:59.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.354+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.3ZBfxUtboI38Q4ZEeaPUaHQ_Mjx7gA8_1_8cac4533320dfecc12563d67714d7787', time=2024-03-04T14:33:47.775824+0000, chain.objs.size()=1 2024-03-04T12:37:59.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.354+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.3ZBfxUtboI38Q4ZEeaPUaHQ_Mjx7gA8_0 2024-03-04T12:37:59.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.356+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.358+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:37:59.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.360+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.360+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.360+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:37:59.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.360+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3894301390893804782', time=2024-03-04T14:33:47.833847+0000, chain.objs.size()=3 2024-03-04T12:37:59.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.360+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.1 2024-03-04T12:37:59.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.360+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.2 2024-03-04T12:37:59.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.360+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.3 2024-03-04T12:37:59.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.362+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.364+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:37:59.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.365+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.365+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.366+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:37:59.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.366+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.2_59d48bbcb0855328f3bb3748052c9591', time=2024-03-04T14:33:47.837883+0000, chain.objs.size()=3 2024-03-04T12:37:59.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.366+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.1 2024-03-04T12:37:59.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.366+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.2 2024-03-04T12:37:59.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.366+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-STANDARD.2~1Yl7cdjc_JZ7YdnQNREUmL8tkCCys1D.3 2024-03-04T12:37:59.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.367+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.370+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:37:59.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.371+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.372+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.372+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.373+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:37:59.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.374+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.374+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.375+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.376+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:37:59.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.377+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.377+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.378+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:37:59.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.378+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.ulIvZXFBeaM7Vl39uLGUtCbEkEuyDWC_1_b7ceb4558202b7b2a852812a4f3a6214', time=2024-03-04T14:33:47.783076+0000, chain.objs.size()=1 2024-03-04T12:37:59.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.378+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.ulIvZXFBeaM7Vl39uLGUtCbEkEuyDWC_0 2024-03-04T12:37:59.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.379+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.381+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:37:59.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.382+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.382+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.383+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:37:59.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.383+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='_iG3jebUx1IwuhX1nj02b7IGDtzGuyND', time=2024-03-04T14:33:47.816887+0000, chain.objs.size()=2 2024-03-04T12:37:59.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.383+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.LR467a5h1_rRIC-ekIw5XSd9sfo8AfP_0 2024-03-04T12:37:59.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.383+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.LR467a5h1_rRIC-ekIw5XSd9sfo8AfP_1 2024-03-04T12:37:59.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.386+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.388+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:37:59.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.389+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.390+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.390+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T12:37:59.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.390+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='_AqXYMh9FRI-I4t4ym-qaT5g52N8Jv20', time=2024-03-04T14:33:47.779423+0000, chain.objs.size()=1 2024-03-04T12:37:59.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.390+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.RhXIZms4CTNq80ui8xoEJ6XVD1BIfMJ_0 2024-03-04T12:37:59.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.390+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='_bkNxiytPW7Nn1nXTD-f6m7j4BGY4twI', time=2024-03-04T14:33:47.820848+0000, chain.objs.size()=2 2024-03-04T12:37:59.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.390+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.zlV-H0VSpoVAF-QQDxZ84jcJjeLSwp7_0 2024-03-04T12:37:59.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.390+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.zlV-H0VSpoVAF-QQDxZ84jcJjeLSwp7_1 2024-03-04T12:37:59.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.390+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5631237834717135712', time=2024-03-04T14:33:47.870334+0000, chain.objs.size()=3 2024-03-04T12:37:59.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.390+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-FROZEN.2~jylk3oBQ-sOIU20tB4yH92bygMfbQDw.1 2024-03-04T12:37:59.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.390+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-FROZEN.2~jylk3oBQ-sOIU20tB4yH92bygMfbQDw.2 2024-03-04T12:37:59.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.390+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-FROZEN.2~jylk3oBQ-sOIU20tB4yH92bygMfbQDw.3 2024-03-04T12:37:59.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.393+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.395+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:37:59.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.397+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.397+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.397+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:37:59.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.397+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14582732577554803002', time=2024-03-04T14:33:47.721995+0000, chain.objs.size()=4 2024-03-04T12:37:59.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.397+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10__multipart_foo.2~Bss21gkejmmCddDFb5xkbdXV4zGzJX1.1 2024-03-04T12:37:59.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.397+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10__multipart_foo.2~Bss21gkejmmCddDFb5xkbdXV4zGzJX1.2 2024-03-04T12:37:59.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.397+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10__multipart_foo.2~Bss21gkejmmCddDFb5xkbdXV4zGzJX1.3 2024-03-04T12:37:59.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.397+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10__multipart_foo.2~Bss21gkejmmCddDFb5xkbdXV4zGzJX1.4 2024-03-04T12:37:59.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.400+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.402+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:37:59.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.403+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.404+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.404+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:37:59.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.404+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='_FnjWSPU_m5ApAjm-v-ZtcC742ymvMCm', time=2024-03-04T14:33:47.743112+0000, chain.objs.size()=1 2024-03-04T12:37:59.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.404+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.aBMKX0Jidmc5Nrv4IHYtUE1XETPDZFu_0 2024-03-04T12:37:59.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.404+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.6109182556982963453', time=2024-03-04T14:33:47.900107+0000, chain.objs.size()=2 2024-03-04T12:37:59.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.404+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14__shadow_.16PvOQdJmzZ2jI4Vic_6N45igmZ_CWu_0 2024-03-04T12:37:59.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.404+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14__shadow_.16PvOQdJmzZ2jI4Vic_6N45igmZ_CWu_1 2024-03-04T12:37:59.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.406+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.408+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:37:59.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.410+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.410+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.411+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:37:59.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.411+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='_vzZtoR7nU6qPxnvlUFEy_AX8tCxComE', time=2024-03-04T14:33:47.805345+0000, chain.objs.size()=1 2024-03-04T12:37:59.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.411+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.QrvUmsHCHjOS2vfO9x-pl3g6IWHNsMk_0 2024-03-04T12:37:59.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.411+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8542849956831905045', time=2024-03-04T14:33:47.873998+0000, chain.objs.size()=3 2024-03-04T12:37:59.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.411+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-STANDARD.2~VObEvtXm46ksiQ0x2_oQgDFZOc_NDQn.1 2024-03-04T12:37:59.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.411+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-STANDARD.2~VObEvtXm46ksiQ0x2_oQgDFZOc_NDQn.2 2024-03-04T12:37:59.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.411+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-STANDARD.2~VObEvtXm46ksiQ0x2_oQgDFZOc_NDQn.3 2024-03-04T12:37:59.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.412+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.414+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:37:59.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.415+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.416+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.416+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:37:59.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.416+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14660057757368240927', time=2024-03-04T14:33:47.652856+0000, chain.objs.size()=4 2024-03-04T12:37:59.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.416+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12__multipart_foo.2~i7fjol3Jrp0_BI3b7pE4TPxC_Kp5pFj.1 2024-03-04T12:37:59.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.416+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12__multipart_foo.2~i7fjol3Jrp0_BI3b7pE4TPxC_Kp5pFj.2 2024-03-04T12:37:59.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.416+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12__multipart_foo.2~i7fjol3Jrp0_BI3b7pE4TPxC_Kp5pFj.3 2024-03-04T12:37:59.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.416+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12__multipart_foo.2~i7fjol3Jrp0_BI3b7pE4TPxC_Kp5pFj.4 2024-03-04T12:37:59.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.416+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12440524166839900593', time=2024-03-04T14:33:47.751671+0000, chain.objs.size()=1 2024-03-04T12:37:59.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.416+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.ulIvZXFBeaM7Vl39uLGUtCbEkEuyDWC_0 2024-03-04T12:37:59.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.417+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.419+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:37:59.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.421+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.421+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.421+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.422+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:37:59.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.424+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.424+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.424+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:37:59.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.424+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.2_5b67ab283eeafbd784a5a86e39528262', time=2024-03-04T14:33:47.848400+0000, chain.objs.size()=3 2024-03-04T12:37:59.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.424+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.1 2024-03-04T12:37:59.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.424+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.2 2024-03-04T12:37:59.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.424+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.3 2024-03-04T12:37:59.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.426+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.428+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:37:59.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.429+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.429+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.430+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.431+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:37:59.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.432+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.432+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.433+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.434+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:37:59.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.435+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.435+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.436+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.436+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:37:59.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.437+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.438+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.438+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.439+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:37:59.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.440+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.441+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.441+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.442+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:37:59.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.444+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.444+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.444+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T12:37:59.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.444+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='_HJXNTRVUZNUFC3ULb2cXvHV8ZvChm-M', time=2024-03-04T14:33:47.765901+0000, chain.objs.size()=1 2024-03-04T12:37:59.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.444+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.C54OxcfB2-nLq0mogrE9ns-mcnBc45z_1 2024-03-04T12:37:59.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.444+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3063653365328619314', time=2024-03-04T14:33:47.769858+0000, chain.objs.size()=1 2024-03-04T12:37:59.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.444+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.3ZBfxUtboI38Q4ZEeaPUaHQ_Mjx7gA8_0 2024-03-04T12:37:59.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.444+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.783262820324221637', time=2024-03-04T14:33:47.813574+0000, chain.objs.size()=3 2024-03-04T12:37:59.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.444+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.1 2024-03-04T12:37:59.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.444+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.2 2024-03-04T12:37:59.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.444+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-FROZEN.2~Df9VgcUjmrKffW2bEA9m_Wm91p20bxi.3 2024-03-04T12:37:59.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.446+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.448+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:37:59.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.449+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.449+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.450+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T12:37:59.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.450+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15560268107241374403', time=2024-03-04T14:33:47.699027+0000, chain.objs.size()=4 2024-03-04T12:37:59.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.450+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11__multipart_foo.2~n3W9cnNfKEnql6nAWDtkRf4QOGXLUc8.1 2024-03-04T12:37:59.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.450+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11__multipart_foo.2~n3W9cnNfKEnql6nAWDtkRf4QOGXLUc8.2 2024-03-04T12:37:59.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.450+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11__multipart_foo.2~n3W9cnNfKEnql6nAWDtkRf4QOGXLUc8.3 2024-03-04T12:37:59.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.450+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11__multipart_foo.2~n3W9cnNfKEnql6nAWDtkRf4QOGXLUc8.4 2024-03-04T12:37:59.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.450+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='_InCt6E3Dh1fWoxqwVZt1ffOYrqfM2xJ', time=2024-03-04T14:33:47.844798+0000, chain.objs.size()=1 2024-03-04T12:37:59.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.450+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.sn4-JhWnhekO6lMbilTZUeyX6_FwHWT_0 2024-03-04T12:37:59.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.450+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7599931387119670362', time=2024-03-04T14:33:47.877595+0000, chain.objs.size()=3 2024-03-04T12:37:59.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.450+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-LUKEWARM.2~-N4cqKCaueLqoE4uP5PcQVBPU7Ulmsj.1 2024-03-04T12:37:59.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.450+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-LUKEWARM.2~-N4cqKCaueLqoE4uP5PcQVBPU7Ulmsj.2 2024-03-04T12:37:59.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.450+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15__multipart_foo-LUKEWARM.2~-N4cqKCaueLqoE4uP5PcQVBPU7Ulmsj.3 2024-03-04T12:37:59.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.452+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.454+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:37:59.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.456+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.456+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.457+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:37:59.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.457+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='_47ppJ2Fup8id6If-lmR87G75A16H1Qr', time=2024-03-04T14:33:47.755215+0000, chain.objs.size()=1 2024-03-04T12:37:59.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.457+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16__shadow_.98J3wI2r5bwU0M0dfd9peR4MRYhR2sq_0 2024-03-04T12:37:59.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.457+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='_rq3qpKTUecC0ZtGAiTrsjNkZnZOHWO8', time=2024-03-04T14:33:47.829501+0000, chain.objs.size()=2 2024-03-04T12:37:59.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.457+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.QecE8GjAsS214Q-fTR5JDMYvml9faIy_1 2024-03-04T12:37:59.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.457+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__shadow_.QecE8GjAsS214Q-fTR5JDMYvml9faIy_2 2024-03-04T12:37:59.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.459+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.461+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:37:59.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.463+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.463+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.463+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.465+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:37:59.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.466+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.466+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.466+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.467+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:37:59.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.469+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.469+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.469+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.470+0000 7f495e216800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:37:59.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.472+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:37:59.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.472+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:37:59.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.473+0000 7f495e216800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:37:59.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.473+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.2_f95312edadcc9975fda50a6c742a412e', time=2024-03-04T14:33:47.841314+0000, chain.objs.size()=3 2024-03-04T12:37:59.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.473+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.1 2024-03-04T12:37:59.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.473+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.2 2024-03-04T12:37:59.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.473+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17__multipart_foo-LUKEWARM.2~8Czln-TIMyGJVE1rpSJzLwE34VtxsOW.3 2024-03-04T12:37:59.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.473+0000 7f495e216800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2122818390751021899', time=2024-03-04T14:33:47.906474+0000, chain.objs.size()=2 2024-03-04T12:37:59.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.473+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14__shadow_.TAjDLqqNmPTi9Nn7QWcXT1MgXyFDbRK_0 2024-03-04T12:37:59.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.473+0000 7f495e216800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14__shadow_.TAjDLqqNmPTi9Nn7QWcXT1MgXyFDbRK_1 2024-03-04T12:37:59.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.475+0000 7f495e216800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:37:59.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.478+0000 7f480b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:37:59.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.480+0000 7f495e216800 20 remove_watcher() i=0 2024-03-04T12:37:59.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.480+0000 7f495e216800 2 removed watcher, disabling cache 2024-03-04T12:37:59.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.481+0000 7f495e216800 20 remove_watcher() i=1 2024-03-04T12:37:59.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.482+0000 7f495e216800 20 remove_watcher() i=2 2024-03-04T12:37:59.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.483+0000 7f495e216800 20 remove_watcher() i=3 2024-03-04T12:37:59.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.485+0000 7f495e216800 20 remove_watcher() i=4 2024-03-04T12:37:59.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.486+0000 7f495e216800 20 remove_watcher() i=5 2024-03-04T12:37:59.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.487+0000 7f495e216800 20 remove_watcher() i=6 2024-03-04T12:37:59.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.488+0000 7f495e216800 20 remove_watcher() i=7 2024-03-04T12:37:59.504 DEBUG:teuthology.orchestra.run.smithi110:> radosgw-admin gc process --include-all 2024-03-04T12:37:59.553 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:37:59.553 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:37:59.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.579+0000 7ff5f452f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:59.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.580+0000 7ff5f452f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:59.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.580+0000 7ff5f452f800 20 realm 2024-03-04T12:37:59.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.580+0000 7ff5f452f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:59.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.581+0000 7ff5f452f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:59.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.581+0000 7ff5f452f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:37:59.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.581+0000 7ff5f452f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:59.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.581+0000 7ff5f452f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:37:59.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.581+0000 7ff5f452f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:59.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.582+0000 7ff5f452f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:37:59.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.582+0000 7ff5f452f800 20 rados->read ofs=0 len=0 2024-03-04T12:37:59.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.582+0000 7ff5f452f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:37:59.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.582+0000 7ff5f452f800 20 searching for the correct realm 2024-03-04T12:37:59.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.584+0000 7ff5e79af640 0 -- 172.21.15.110:0/3151025180 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7ff5e008a0c0 msgr2=0x7ff5e00889e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:37:59.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:37:59.588+0000 7ff5f01b0640 0 -- 172.21.15.110:0/3151025180 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7ff5d80cab60 msgr2=0x7ff5d809f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:38:00.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.195+0000 7ff5f452f800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:38:00.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.195+0000 7ff5f452f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:38:00.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.195+0000 7ff5f452f800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:38:00.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.195+0000 7ff5f452f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:38:00.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.195+0000 7ff5f452f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:38:00.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.195+0000 7ff5f452f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:38:00.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.195+0000 7ff5f452f800 20 rados->read ofs=0 len=0 2024-03-04T12:38:00.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.195+0000 7ff5f452f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:38:00.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.195+0000 7ff5f452f800 20 rados->read ofs=0 len=0 2024-03-04T12:38:00.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.196+0000 7ff5f452f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:38:00.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.196+0000 7ff5f452f800 20 rados->read ofs=0 len=0 2024-03-04T12:38:00.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.196+0000 7ff5f452f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:38:00.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.196+0000 7ff5f452f800 20 zone default found 2024-03-04T12:38:00.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.196+0000 7ff5f452f800 4 Realm: () 2024-03-04T12:38:00.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.196+0000 7ff5f452f800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:38:00.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.196+0000 7ff5f452f800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:38:00.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.196+0000 7ff5f452f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:38:00.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.196+0000 7ff5f452f800 20 zonegroup default 2024-03-04T12:38:00.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.196+0000 7ff5f452f800 20 rados->read ofs=0 len=0 2024-03-04T12:38:00.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.197+0000 7ff5f452f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:38:00.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.197+0000 7ff5f452f800 20 rados->read ofs=0 len=0 2024-03-04T12:38:00.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.197+0000 7ff5f452f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:38:00.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.197+0000 7ff5f452f800 20 rados->read ofs=0 len=0 2024-03-04T12:38:00.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.197+0000 7ff5f452f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:38:00.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.197+0000 7ff5f452f800 20 started sync module instance, tier type = 2024-03-04T12:38:00.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.197+0000 7ff5f452f800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:38:00.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.207+0000 7ff5f452f800 20 add_watcher() i=0 2024-03-04T12:38:00.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.207+0000 7ff5f452f800 20 add_watcher() i=1 2024-03-04T12:38:00.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.207+0000 7ff5f452f800 20 add_watcher() i=2 2024-03-04T12:38:00.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.207+0000 7ff5f452f800 20 add_watcher() i=3 2024-03-04T12:38:00.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.207+0000 7ff5f452f800 20 add_watcher() i=4 2024-03-04T12:38:00.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.207+0000 7ff5f452f800 20 add_watcher() i=5 2024-03-04T12:38:00.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.207+0000 7ff5f452f800 20 add_watcher() i=6 2024-03-04T12:38:00.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.208+0000 7ff5f452f800 20 add_watcher() i=7 2024-03-04T12:38:00.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.208+0000 7ff5f452f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:38:00.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.210+0000 7ff4a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:38:00.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.210+0000 7ff5f452f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:38:00.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.210+0000 7ff5f452f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:38:00.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.245+0000 7ff4a5fdb640 20 reqs_thread_entry: start 2024-03-04T12:38:00.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.246+0000 7ff5f452f800 20 init_complete bucket index max shards: 11 2024-03-04T12:38:00.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.246+0000 7ff5f452f800 20 Filter name: none 2024-03-04T12:38:00.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.246+0000 7ff4177fe640 20 reqs_thread_entry: start 2024-03-04T12:38:00.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.246+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:38:00.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.247+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.248+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.248+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.254 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.249+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:38:00.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.250+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.252+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.252+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.253+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:38:00.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.254+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.255+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.255+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.256+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:38:00.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.257+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.257+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.258+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.259+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:38:00.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.260+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.260+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.260+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.261+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:38:00.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.263+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.263+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.263+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.264+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:38:00.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.266+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.266+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.266+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.267+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:38:00.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.269+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.269+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.270+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.271+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:38:00.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.272+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.273+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.273+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.274+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:38:00.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.275+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.276+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.276+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.277+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:38:00.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.278+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.279+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.279+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.280+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:38:00.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.281+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.282+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.282+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.283+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:38:00.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.284+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.285+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.285+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.286+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:38:00.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.287+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.288+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.288+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.289+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:38:00.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.290+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.291+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.291+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.292+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:38:00.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.293+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.294+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.294+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.295+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:38:00.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.296+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.296+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.297+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.298+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:38:00.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.299+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.299+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.300+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.301+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:38:00.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.302+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.302+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.303+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.304+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:38:00.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.305+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.305+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.306+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.306+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:38:00.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.308+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.308+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.308+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.309+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:38:00.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.311+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.311+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.311+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.312+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:38:00.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.314+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.314+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.314+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.315+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:38:00.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.316+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.317+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.317+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.318+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:38:00.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.319+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.320+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.320+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.321+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:38:00.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.322+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.323+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.323+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.324+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:38:00.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.326+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.326+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.326+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.327+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:38:00.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.329+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.329+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.329+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.330+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:38:00.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.331+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.332+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.332+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.333+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:38:00.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.334+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.335+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.335+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.336+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:38:00.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.337+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.337+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.338+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.339+0000 7ff5f452f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:38:00.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.340+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.340+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:38:00.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.341+0000 7ff5f452f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:38:00.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.342+0000 7ff4a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:38:00.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.345+0000 7ff5f452f800 20 remove_watcher() i=0 2024-03-04T12:38:00.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.345+0000 7ff5f452f800 2 removed watcher, disabling cache 2024-03-04T12:38:00.351 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.346+0000 7ff5f452f800 20 remove_watcher() i=1 2024-03-04T12:38:00.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.347+0000 7ff5f452f800 20 remove_watcher() i=2 2024-03-04T12:38:00.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.347+0000 7ff5f452f800 20 remove_watcher() i=3 2024-03-04T12:38:00.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.348+0000 7ff5f452f800 20 remove_watcher() i=4 2024-03-04T12:38:00.355 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.349+0000 7ff5f452f800 20 remove_watcher() i=5 2024-03-04T12:38:00.356 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.350+0000 7ff5f452f800 20 remove_watcher() i=6 2024-03-04T12:38:00.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:38:00.351+0000 7ff5f452f800 20 remove_watcher() i=7 2024-03-04T12:38:00.367 DEBUG:teuthology.orchestra.run.smithi110:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-03-04T12:38:00.846 INFO:teuthology.orchestra.run.smithi110.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-03-04T12:38:04.447 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :clean UP-TO-DATE 2024-03-04T12:38:22.946 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :compileJava 2024-03-04T12:38:22.946 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :processResources 2024-03-04T12:38:22.946 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :classes 2024-03-04T12:38:23.745 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:38:23.745 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :compileTestJava 2024-03-04T12:38:23.746 INFO:teuthology.orchestra.run.smithi110.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-03-04T12:38:23.746 INFO:teuthology.orchestra.run.smithi110.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-03-04T12:38:23.747 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:38:23.747 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :processTestResources NO-SOURCE 2024-03-04T12:38:23.747 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :testClasses 2024-03-04T12:38:29.745 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:38:29.746 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :test 2024-03-04T12:38:29.746 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:38:29.746 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-03-04T12:38:34.545 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:38:34.545 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-03-04T12:38:34.945 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:38:34.945 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-03-04T12:38:35.045 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:38:35.045 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-03-04T12:38:35.445 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:38:35.445 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-03-04T12:38:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:38:52.745 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-03-04T12:38:53.147 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:38:53.147 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-03-04T12:38:53.147 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:38:53.147 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-03-04T12:38:53.245 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:38:53.245 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-03-04T12:38:53.345 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:38:53.345 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-03-04T12:38:53.645 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:38:53.645 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-03-04T12:38:59.145 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:38:59.145 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-03-04T12:38:59.845 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:38:59.845 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-03-04T12:39:00.045 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:39:00.045 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-03-04T12:39:00.045 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04 12:38:59,976 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-03-04T12:39:32.045 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:39:32.046 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-03-04T12:39:32.745 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:39:32.745 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-03-04T12:39:32.746 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:39:32.746 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-03-04T12:39:33.145 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:39:33.145 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-03-04T12:39:33.245 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:39:33.245 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-03-04T12:39:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:39:33.845 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-03-04T12:39:39.045 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:39:39.046 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-03-04T12:39:39.445 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:39:39.445 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-03-04T12:39:39.545 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:39:39.545 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-03-04T12:39:39.645 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:39:39.645 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-03-04T12:39:47.145 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:39:47.145 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-03-04T12:39:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:39:48.545 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests STANDARD_OUT 2024-03-04T12:39:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04 12:39:48,494 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-03-04T12:39:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04 12:39:48,523 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-03-04T12:39:48.845 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:39:48.845 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-03-04T12:39:59.045 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:39:59.045 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-03-04T12:39:59.545 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:39:59.545 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-03-04T12:40:02.045 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:40:02.045 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-03-04T12:40:02.445 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:40:02.445 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-03-04T12:41:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:41:48.746 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-03-04T12:41:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:41:49.146 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-03-04T12:41:57.645 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:41:57.645 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-03-04T12:41:58.045 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:41:58.045 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-03-04T12:42:03.045 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:03.046 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-03-04T12:42:03.345 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:03.345 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-03-04T12:42:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:05.345 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-03-04T12:42:10.545 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:10.545 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-03-04T12:42:10.745 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:10.745 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-03-04T12:42:11.745 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:11.745 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-03-04T12:42:11.845 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:11.845 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-03-04T12:42:12.245 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:12.245 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-03-04T12:42:12.245 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:12.245 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-03-04T12:42:12.645 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:12.645 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-03-04T12:42:12.745 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:12.745 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-03-04T12:42:13.147 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:13.148 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-03-04T12:42:13.245 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:13.245 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-03-04T12:42:13.645 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:13.645 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-03-04T12:42:13.746 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:13.747 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-03-04T12:42:14.145 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:14.145 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-03-04T12:42:14.245 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:14.246 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-03-04T12:42:14.544 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:14.545 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-03-04T12:42:46.045 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:46.046 INFO:teuthology.orchestra.run.smithi110.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-03-04T12:42:46.445 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:46.445 INFO:teuthology.orchestra.run.smithi110.stdout:---------------------------------------------------------------------- 2024-03-04T12:42:46.445 INFO:teuthology.orchestra.run.smithi110.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-03-04T12:42:46.445 INFO:teuthology.orchestra.run.smithi110.stdout:---------------------------------------------------------------------- 2024-03-04T12:42:46.475 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:46.475 INFO:teuthology.orchestra.run.smithi110.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-03-04T12:42:46.475 INFO:teuthology.orchestra.run.smithi110.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-03-04T12:42:46.476 INFO:teuthology.orchestra.run.smithi110.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-03-04T12:42:46.476 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:46.476 INFO:teuthology.orchestra.run.smithi110.stdout:BUILD SUCCESSFUL in 4m 46s 2024-03-04T12:42:46.476 INFO:teuthology.orchestra.run.smithi110.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-03-04T12:42:46.793 DEBUG:teuthology.orchestra.run.smithi110:> radosgw-admin gc process --include-all 2024-03-04T12:42:46.844 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:42:46.844 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:42:46.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.872+0000 7fcfec931800 20 rados->read ofs=0 len=0 2024-03-04T12:42:46.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.874+0000 7fcfec931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:46.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.874+0000 7fcfec931800 20 realm 2024-03-04T12:42:46.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.874+0000 7fcfec931800 20 rados->read ofs=0 len=0 2024-03-04T12:42:46.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.874+0000 7fcfec931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:46.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.874+0000 7fcfec931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:42:46.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.874+0000 7fcfec931800 20 rados->read ofs=0 len=0 2024-03-04T12:42:46.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.874+0000 7fcfec931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:46.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.874+0000 7fcfec931800 20 rados->read ofs=0 len=0 2024-03-04T12:42:46.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.875+0000 7fcfec931800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:42:46.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.875+0000 7fcfec931800 20 rados->read ofs=0 len=0 2024-03-04T12:42:46.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.875+0000 7fcfec931800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:42:46.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.875+0000 7fcfec931800 20 searching for the correct realm 2024-03-04T12:42:46.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.879+0000 7fcfdfdd2640 0 -- 172.21.15.110:0/3070235800 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x555bc25e2f60 msgr2=0x555bc25e5420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:42:46.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.883+0000 7fcfe85d3640 0 -- 172.21.15.110:0/3070235800 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fcfd0059910 msgr2=0x7fcfd007c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:42:46.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.887+0000 7fcfec931800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:42:46.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.887+0000 7fcfec931800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:42:46.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.887+0000 7fcfec931800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:42:46.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.887+0000 7fcfec931800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:42:46.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.887+0000 7fcfec931800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:42:46.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.887+0000 7fcfec931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:42:46.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.887+0000 7fcfec931800 20 rados->read ofs=0 len=0 2024-03-04T12:42:46.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.887+0000 7fcfec931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:46.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.887+0000 7fcfec931800 20 rados->read ofs=0 len=0 2024-03-04T12:42:46.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.887+0000 7fcfec931800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:42:46.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.887+0000 7fcfec931800 20 rados->read ofs=0 len=0 2024-03-04T12:42:46.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.888+0000 7fcfec931800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:42:46.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.888+0000 7fcfec931800 20 zone default found 2024-03-04T12:42:46.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.888+0000 7fcfec931800 4 Realm: () 2024-03-04T12:42:46.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.888+0000 7fcfec931800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:42:46.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.888+0000 7fcfec931800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:42:46.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.888+0000 7fcfec931800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:42:46.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.888+0000 7fcfec931800 20 zonegroup default 2024-03-04T12:42:46.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.888+0000 7fcfec931800 20 rados->read ofs=0 len=0 2024-03-04T12:42:46.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.888+0000 7fcfec931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:46.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.888+0000 7fcfec931800 20 rados->read ofs=0 len=0 2024-03-04T12:42:46.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.888+0000 7fcfec931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:46.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.888+0000 7fcfec931800 20 rados->read ofs=0 len=0 2024-03-04T12:42:46.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.889+0000 7fcfec931800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:46.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.889+0000 7fcfec931800 20 started sync module instance, tier type = 2024-03-04T12:42:46.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.889+0000 7fcfec931800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:42:46.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.897+0000 7fcfec931800 20 add_watcher() i=0 2024-03-04T12:42:46.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.897+0000 7fcfec931800 20 add_watcher() i=1 2024-03-04T12:42:46.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.897+0000 7fcfec931800 20 add_watcher() i=2 2024-03-04T12:42:46.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.897+0000 7fcfec931800 20 add_watcher() i=3 2024-03-04T12:42:46.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.897+0000 7fcfec931800 20 add_watcher() i=4 2024-03-04T12:42:46.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.897+0000 7fcfec931800 20 add_watcher() i=5 2024-03-04T12:42:46.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.897+0000 7fcfec931800 20 add_watcher() i=6 2024-03-04T12:42:46.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.898+0000 7fcfec931800 20 add_watcher() i=7 2024-03-04T12:42:46.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.898+0000 7fcfec931800 2 all 8 watchers are set, enabling cache 2024-03-04T12:42:46.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.900+0000 7fce9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:42:46.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.900+0000 7fcfec931800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:42:46.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.900+0000 7fcfec931800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:42:46.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.936+0000 7fce9dfdb640 20 reqs_thread_entry: start 2024-03-04T12:42:46.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.936+0000 7fcfec931800 20 init_complete bucket index max shards: 11 2024-03-04T12:42:46.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.936+0000 7fcfec931800 20 Filter name: none 2024-03-04T12:42:46.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.936+0000 7fce0f7fe640 20 reqs_thread_entry: start 2024-03-04T12:42:46.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.936+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:42:46.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.937+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:46.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.938+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:46.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.938+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:46.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.939+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:42:46.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.941+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:46.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.942+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:46.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.942+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:46.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.943+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:42:46.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.945+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:46.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.946+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:46.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.946+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:42:46.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.946+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.1753407239718736945', time=2024-03-04T14:39:59.192005+0000, chain.objs.size()=5 2024-03-04T12:42:46.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.946+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.43__multipart_file2.mpg.2~LOLd9cspGSmj3HvzEjLgtoFkuyOyQYi.1 2024-03-04T12:42:46.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.946+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.43__multipart_file2.mpg.2~LOLd9cspGSmj3HvzEjLgtoFkuyOyQYi.2 2024-03-04T12:42:46.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.946+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.43__multipart_file2.mpg.2~LOLd9cspGSmj3HvzEjLgtoFkuyOyQYi.3 2024-03-04T12:42:46.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.947+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.43__multipart_file2.mpg.2~LOLd9cspGSmj3HvzEjLgtoFkuyOyQYi.4 2024-03-04T12:42:46.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.947+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.43__multipart_file2.mpg.2~LOLd9cspGSmj3HvzEjLgtoFkuyOyQYi.5 2024-03-04T12:42:46.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.949+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:46.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.952+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:42:46.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.953+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:46.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.954+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:46.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.954+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:42:46.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.954+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3674246111068724751', time=2024-03-04T14:39:20.604964+0000, chain.objs.size()=5 2024-03-04T12:42:46.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.954+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~WFq2jSCSFnP6mPNaENVa54JQbORcxY7.1 2024-03-04T12:42:46.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.954+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__shadow_key1.2~WFq2jSCSFnP6mPNaENVa54JQbORcxY7.1_1 2024-03-04T12:42:46.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.954+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~WFq2jSCSFnP6mPNaENVa54JQbORcxY7.2 2024-03-04T12:42:46.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.954+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__shadow_key1.2~WFq2jSCSFnP6mPNaENVa54JQbORcxY7.2_1 2024-03-04T12:42:46.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.954+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~WFq2jSCSFnP6mPNaENVa54JQbORcxY7.3 2024-03-04T12:42:46.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.957+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:46.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.959+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:42:46.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.961+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:46.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.961+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:46.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.962+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:42:46.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.962+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3705237403078017225', time=2024-03-04T14:39:48.348961+0000, chain.objs.size()=5 2024-03-04T12:42:46.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.962+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.42__multipart_key1.2~869spZYGWsz1NRFK_Ib-YlWvYFuJQY_.1 2024-03-04T12:42:46.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.962+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.42__multipart_key1.2~869spZYGWsz1NRFK_Ib-YlWvYFuJQY_.2 2024-03-04T12:42:46.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.962+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.42__multipart_key1.2~869spZYGWsz1NRFK_Ib-YlWvYFuJQY_.3 2024-03-04T12:42:46.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.962+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.42__multipart_key1.2~869spZYGWsz1NRFK_Ib-YlWvYFuJQY_.4 2024-03-04T12:42:46.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.962+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.42__multipart_key1.2~869spZYGWsz1NRFK_Ib-YlWvYFuJQY_.5 2024-03-04T12:42:46.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.962+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5953405442523339433', time=2024-03-04T14:41:07.516568+0000, chain.objs.size()=10 2024-03-04T12:42:46.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.962+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~Q-vAfmz5BzIXmPa2f3zL9Xd6MjPmGOx.1 2024-03-04T12:42:46.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.962+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~Q-vAfmz5BzIXmPa2f3zL9Xd6MjPmGOx.2 2024-03-04T12:42:46.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.962+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~Q-vAfmz5BzIXmPa2f3zL9Xd6MjPmGOx.3 2024-03-04T12:42:46.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.962+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~Q-vAfmz5BzIXmPa2f3zL9Xd6MjPmGOx.4 2024-03-04T12:42:46.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.962+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~Q-vAfmz5BzIXmPa2f3zL9Xd6MjPmGOx.5 2024-03-04T12:42:46.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.962+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~Q-vAfmz5BzIXmPa2f3zL9Xd6MjPmGOx.6 2024-03-04T12:42:46.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.962+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~Q-vAfmz5BzIXmPa2f3zL9Xd6MjPmGOx.7 2024-03-04T12:42:46.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.965+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~Q-vAfmz5BzIXmPa2f3zL9Xd6MjPmGOx.8 2024-03-04T12:42:46.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.965+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~Q-vAfmz5BzIXmPa2f3zL9Xd6MjPmGOx.9 2024-03-04T12:42:46.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.967+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~Q-vAfmz5BzIXmPa2f3zL9Xd6MjPmGOx.10 2024-03-04T12:42:46.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.970+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:46.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.972+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:42:46.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.973+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:46.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.974+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:46.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.974+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:46.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.975+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:42:46.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.976+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:46.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.977+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:46.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.977+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:42:46.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.977+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10857287296145333423', time=2024-03-04T14:39:31.886353+0000, chain.objs.size()=5 2024-03-04T12:42:46.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.977+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~dAO6gBHyiLwA23vcosGtIjdVDLj4_O-.1 2024-03-04T12:42:46.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.977+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__shadow_key1.2~dAO6gBHyiLwA23vcosGtIjdVDLj4_O-.1_1 2024-03-04T12:42:46.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.977+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~dAO6gBHyiLwA23vcosGtIjdVDLj4_O-.2 2024-03-04T12:42:46.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.977+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__shadow_key1.2~dAO6gBHyiLwA23vcosGtIjdVDLj4_O-.2_1 2024-03-04T12:42:46.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.977+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~dAO6gBHyiLwA23vcosGtIjdVDLj4_O-.3 2024-03-04T12:42:46.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.977+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.6298192255987299170', time=2024-03-04T14:40:25.038711+0000, chain.objs.size()=11 2024-03-04T12:42:46.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.977+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~2S3qBgxjTHgUuGZlhwJ-Yt2dC8lpoJ9.1 2024-03-04T12:42:46.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.977+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~2S3qBgxjTHgUuGZlhwJ-Yt2dC8lpoJ9.2 2024-03-04T12:42:46.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.977+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~2S3qBgxjTHgUuGZlhwJ-Yt2dC8lpoJ9.3 2024-03-04T12:42:46.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.977+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~2S3qBgxjTHgUuGZlhwJ-Yt2dC8lpoJ9.4 2024-03-04T12:42:46.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.977+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~2S3qBgxjTHgUuGZlhwJ-Yt2dC8lpoJ9.5 2024-03-04T12:42:46.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.977+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~2S3qBgxjTHgUuGZlhwJ-Yt2dC8lpoJ9.6 2024-03-04T12:42:46.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.977+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~2S3qBgxjTHgUuGZlhwJ-Yt2dC8lpoJ9.7 2024-03-04T12:42:46.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.981+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~2S3qBgxjTHgUuGZlhwJ-Yt2dC8lpoJ9.8 2024-03-04T12:42:46.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.981+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~2S3qBgxjTHgUuGZlhwJ-Yt2dC8lpoJ9.9 2024-03-04T12:42:46.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.981+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~2S3qBgxjTHgUuGZlhwJ-Yt2dC8lpoJ9.10 2024-03-04T12:42:46.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.982+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~2S3qBgxjTHgUuGZlhwJ-Yt2dC8lpoJ9.11 2024-03-04T12:42:46.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.986+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:46.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.988+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:42:46.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.990+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:46.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.990+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:46.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.990+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:46.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.991+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:42:46.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.993+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:46.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.993+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:46.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.994+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.995+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:42:47.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.996+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.997+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.997+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:42:47.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.997+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='2~mXja4iy3In6qSqkmYcEGrxXqNd08uwX', time=2024-03-04T14:38:34.511017+0000, chain.objs.size()=5 2024-03-04T12:42:47.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.997+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.30__multipart_key1.2~mXja4iy3In6qSqkmYcEGrxXqNd08uwX.1 2024-03-04T12:42:47.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.997+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.30__multipart_key1.2~mXja4iy3In6qSqkmYcEGrxXqNd08uwX.2 2024-03-04T12:42:47.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.997+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.30__multipart_key1.2~mXja4iy3In6qSqkmYcEGrxXqNd08uwX.3 2024-03-04T12:42:47.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.997+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.30__multipart_key1.2~mXja4iy3In6qSqkmYcEGrxXqNd08uwX.4 2024-03-04T12:42:47.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.997+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.30__multipart_key1.2~mXja4iy3In6qSqkmYcEGrxXqNd08uwX.5 2024-03-04T12:42:47.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.997+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11684908260906797003', time=2024-03-04T14:39:39.167146+0000, chain.objs.size()=5 2024-03-04T12:42:47.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.997+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.41__multipart_key1.2~_GtNSKv-I6_2yjRPxdXaGlf6q13AQYf.1 2024-03-04T12:42:47.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.997+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.41__multipart_key1.2~_GtNSKv-I6_2yjRPxdXaGlf6q13AQYf.2 2024-03-04T12:42:47.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.997+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.41__multipart_key1.2~_GtNSKv-I6_2yjRPxdXaGlf6q13AQYf.3 2024-03-04T12:42:47.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.998+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.41__multipart_key1.2~_GtNSKv-I6_2yjRPxdXaGlf6q13AQYf.4 2024-03-04T12:42:47.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:46.998+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.41__multipart_key1.2~_GtNSKv-I6_2yjRPxdXaGlf6q13AQYf.5 2024-03-04T12:42:47.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.002+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:47.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.004+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:42:47.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.005+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-04T12:42:47.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6', time=2024-03-04T14:42:09.325579+0000, chain.objs.size()=1 2024-03-04T12:42:47.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.16 2024-03-04T12:42:47.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6', time=2024-03-04T14:42:09.364344+0000, chain.objs.size()=1 2024-03-04T12:42:47.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.17 2024-03-04T12:42:47.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6', time=2024-03-04T14:42:09.409764+0000, chain.objs.size()=1 2024-03-04T12:42:47.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.18 2024-03-04T12:42:47.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6', time=2024-03-04T14:42:09.441785+0000, chain.objs.size()=1 2024-03-04T12:42:47.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.19 2024-03-04T12:42:47.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6', time=2024-03-04T14:42:09.485876+0000, chain.objs.size()=1 2024-03-04T12:42:47.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.20 2024-03-04T12:42:47.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6', time=2024-03-04T14:42:09.728079+0000, chain.objs.size()=46 2024-03-04T12:42:47.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.1 2024-03-04T12:42:47.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.2 2024-03-04T12:42:47.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.3 2024-03-04T12:42:47.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.4 2024-03-04T12:42:47.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.5 2024-03-04T12:42:47.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.6 2024-03-04T12:42:47.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.006+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.7 2024-03-04T12:42:47.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.009+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.8 2024-03-04T12:42:47.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.009+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.9 2024-03-04T12:42:47.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.009+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.10 2024-03-04T12:42:47.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.009+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.11 2024-03-04T12:42:47.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.009+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.12 2024-03-04T12:42:47.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.009+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.13 2024-03-04T12:42:47.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.009+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.14 2024-03-04T12:42:47.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.009+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.15 2024-03-04T12:42:47.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.009+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.U60NFK8hkwpMX0kunbb-jyPdNKMEl6Te.16 2024-03-04T12:42:47.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.009+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.ysi71pbUBUkB2xgzj1DYtQmsZag9djmV.17 2024-03-04T12:42:47.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.009+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.k7blVQwJbey9IRmJuDP7hBAg78z5VI8H.18 2024-03-04T12:42:47.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.011+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.6pY34KLpEg3HoUE2xSW0fqoqUGQaDkQp.19 2024-03-04T12:42:47.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.011+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.izraE6pt02ES28DokPBZBIwHGrUKN1Jp.20 2024-03-04T12:42:47.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.011+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.21 2024-03-04T12:42:47.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.011+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.22 2024-03-04T12:42:47.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.011+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.23 2024-03-04T12:42:47.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.011+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.24 2024-03-04T12:42:47.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.011+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.25 2024-03-04T12:42:47.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.011+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.26 2024-03-04T12:42:47.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.012+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.27 2024-03-04T12:42:47.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.012+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.28 2024-03-04T12:42:47.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.012+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.29 2024-03-04T12:42:47.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.013+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.30 2024-03-04T12:42:47.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.013+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.31 2024-03-04T12:42:47.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.013+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.32 2024-03-04T12:42:47.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.013+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.33 2024-03-04T12:42:47.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.013+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.34 2024-03-04T12:42:47.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.013+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.35 2024-03-04T12:42:47.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.013+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.36 2024-03-04T12:42:47.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.013+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.37 2024-03-04T12:42:47.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.013+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.38 2024-03-04T12:42:47.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.013+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.39 2024-03-04T12:42:47.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.013+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.40 2024-03-04T12:42:47.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.014+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.41 2024-03-04T12:42:47.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.015+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.42 2024-03-04T12:42:47.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.015+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.43 2024-03-04T12:42:47.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.015+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.44 2024-03-04T12:42:47.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.015+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.45 2024-03-04T12:42:47.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.015+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.48__multipart_key1.2~2LRJWgWEDmn98BmNcZvKAh9z61rh7N6.46 2024-03-04T12:42:47.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.015+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10808178672398209031', time=2024-03-04T14:42:46.111171+0000, chain.objs.size()=11 2024-03-04T12:42:47.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.015+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.56__multipart_key1.2~Y4knxCUfGuRGcv9uzbeMBGvruXQChuA.1 2024-03-04T12:42:47.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.015+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.56__multipart_key1.2~Y4knxCUfGuRGcv9uzbeMBGvruXQChuA.2 2024-03-04T12:42:47.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.015+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.56__multipart_key1.2~Y4knxCUfGuRGcv9uzbeMBGvruXQChuA.3 2024-03-04T12:42:47.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.016+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.56__multipart_key1.2~Y4knxCUfGuRGcv9uzbeMBGvruXQChuA.4 2024-03-04T12:42:47.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.016+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.56__multipart_key1.2~Y4knxCUfGuRGcv9uzbeMBGvruXQChuA.5 2024-03-04T12:42:47.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.022+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.56__multipart_key1.2~Y4knxCUfGuRGcv9uzbeMBGvruXQChuA.6 2024-03-04T12:42:47.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.023+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.56__multipart_key1.2~Y4knxCUfGuRGcv9uzbeMBGvruXQChuA.7 2024-03-04T12:42:47.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.023+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.56__multipart_key1.2~Y4knxCUfGuRGcv9uzbeMBGvruXQChuA.8 2024-03-04T12:42:47.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.023+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.56__multipart_key1.2~Y4knxCUfGuRGcv9uzbeMBGvruXQChuA.9 2024-03-04T12:42:47.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.023+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.56__multipart_key1.2~Y4knxCUfGuRGcv9uzbeMBGvruXQChuA.10 2024-03-04T12:42:47.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.023+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.56__multipart_key1.2~Y4knxCUfGuRGcv9uzbeMBGvruXQChuA.11 2024-03-04T12:42:47.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.026+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:47.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.028+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:42:47.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.029+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.029+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.030+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:42:47.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.030+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17736489899305725672', time=2024-03-04T14:41:48.643804+0000, chain.objs.size()=11 2024-03-04T12:42:47.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.030+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~CflEtobzSGPUDm1phgVaNoHKkoI6Xd3.1 2024-03-04T12:42:47.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.030+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__shadow_key1.2~CflEtobzSGPUDm1phgVaNoHKkoI6Xd3.1_1 2024-03-04T12:42:47.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.030+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~CflEtobzSGPUDm1phgVaNoHKkoI6Xd3.2 2024-03-04T12:42:47.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.030+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__shadow_key1.2~CflEtobzSGPUDm1phgVaNoHKkoI6Xd3.2_1 2024-03-04T12:42:47.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.030+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~CflEtobzSGPUDm1phgVaNoHKkoI6Xd3.3 2024-03-04T12:42:47.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.030+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__shadow_key1.2~CflEtobzSGPUDm1phgVaNoHKkoI6Xd3.3_1 2024-03-04T12:42:47.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.030+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~CflEtobzSGPUDm1phgVaNoHKkoI6Xd3.4 2024-03-04T12:42:47.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.030+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__shadow_key1.2~CflEtobzSGPUDm1phgVaNoHKkoI6Xd3.4_1 2024-03-04T12:42:47.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.030+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~CflEtobzSGPUDm1phgVaNoHKkoI6Xd3.5 2024-03-04T12:42:47.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.030+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__shadow_key1.2~CflEtobzSGPUDm1phgVaNoHKkoI6Xd3.5_1 2024-03-04T12:42:47.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.030+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~CflEtobzSGPUDm1phgVaNoHKkoI6Xd3.6 2024-03-04T12:42:47.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.034+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:47.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.036+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:42:47.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.038+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.038+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.038+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:42:47.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.038+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.885467510152345210', time=2024-03-04T14:39:59.130906+0000, chain.objs.size()=5 2024-03-04T12:42:47.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.038+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.43__multipart_file.mpg.2~QHhcAmW4DinJIhz60lTbRBrcxBIEV3Z.1 2024-03-04T12:42:47.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.038+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.43__multipart_file.mpg.2~QHhcAmW4DinJIhz60lTbRBrcxBIEV3Z.2 2024-03-04T12:42:47.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.038+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.43__multipart_file.mpg.2~QHhcAmW4DinJIhz60lTbRBrcxBIEV3Z.3 2024-03-04T12:42:47.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.038+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.43__multipart_file.mpg.2~QHhcAmW4DinJIhz60lTbRBrcxBIEV3Z.4 2024-03-04T12:42:47.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.038+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.43__multipart_file.mpg.2~QHhcAmW4DinJIhz60lTbRBrcxBIEV3Z.5 2024-03-04T12:42:47.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.041+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:47.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.043+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:42:47.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.044+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.045+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.045+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:42:47.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.045+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5784029573504331027', time=2024-03-04T14:39:17.726220+0000, chain.objs.size()=5 2024-03-04T12:42:47.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.045+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~LoP40drdiqsqNgcneP3rpKpUgHR4guW.1 2024-03-04T12:42:47.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.046+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~LoP40drdiqsqNgcneP3rpKpUgHR4guW.2 2024-03-04T12:42:47.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.046+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~LoP40drdiqsqNgcneP3rpKpUgHR4guW.3 2024-03-04T12:42:47.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.046+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~LoP40drdiqsqNgcneP3rpKpUgHR4guW.4 2024-03-04T12:42:47.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.046+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~LoP40drdiqsqNgcneP3rpKpUgHR4guW.5 2024-03-04T12:42:47.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.048+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:47.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.050+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:42:47.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.052+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.052+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.052+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.053+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:42:47.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.055+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.055+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.056+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:42:47.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.056+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12721007644085577900', time=2024-03-04T14:38:59.211844+0000, chain.objs.size()=5 2024-03-04T12:42:47.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.056+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.34__multipart_key1.2~R68QqYMv8_xRPtUO5gC11aY7JGTVqyU.1 2024-03-04T12:42:47.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.056+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.34__multipart_key1.2~R68QqYMv8_xRPtUO5gC11aY7JGTVqyU.2 2024-03-04T12:42:47.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.056+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.34__multipart_key1.2~R68QqYMv8_xRPtUO5gC11aY7JGTVqyU.3 2024-03-04T12:42:47.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.056+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.34__multipart_key1.2~R68QqYMv8_xRPtUO5gC11aY7JGTVqyU.4 2024-03-04T12:42:47.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.056+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.34__multipart_key1.2~R68QqYMv8_xRPtUO5gC11aY7JGTVqyU.5 2024-03-04T12:42:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.058+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:47.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.059+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:42:47.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.061+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.061+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.061+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:42:47.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.061+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.34__multipart_key1.2~R68QqYMv8_xRPtUO5gC11aY7JGTVqyU.2_a3c3e877435df176397da67b37d460f1', time=2024-03-04T14:38:59.496643+0000, chain.objs.size()=5 2024-03-04T12:42:47.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.061+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.34__multipart_key1.2~R68QqYMv8_xRPtUO5gC11aY7JGTVqyU.1 2024-03-04T12:42:47.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.061+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.34__multipart_key1.2~R68QqYMv8_xRPtUO5gC11aY7JGTVqyU.2 2024-03-04T12:42:47.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.061+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.34__multipart_key1.2~R68QqYMv8_xRPtUO5gC11aY7JGTVqyU.3 2024-03-04T12:42:47.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.061+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.34__multipart_key1.2~R68QqYMv8_xRPtUO5gC11aY7JGTVqyU.4 2024-03-04T12:42:47.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.061+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.34__multipart_key1.2~R68QqYMv8_xRPtUO5gC11aY7JGTVqyU.5 2024-03-04T12:42:47.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.061+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11567065648874023440', time=2024-03-04T14:39:11.462880+0000, chain.objs.size()=5 2024-03-04T12:42:47.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.061+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~EGidUVhyQ_Tl3W0tVyOPLqTez4ta4Sw.1 2024-03-04T12:42:47.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.061+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~EGidUVhyQ_Tl3W0tVyOPLqTez4ta4Sw.2 2024-03-04T12:42:47.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.061+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~EGidUVhyQ_Tl3W0tVyOPLqTez4ta4Sw.3 2024-03-04T12:42:47.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.061+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~EGidUVhyQ_Tl3W0tVyOPLqTez4ta4Sw.4 2024-03-04T12:42:47.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.061+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~EGidUVhyQ_Tl3W0tVyOPLqTez4ta4Sw.5 2024-03-04T12:42:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.065+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.067+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:42:47.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.068+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.068+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.069+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.070+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:42:47.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.071+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.071+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.071+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.072+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:42:47.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.074+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.074+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.075+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.076+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:42:47.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.077+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.077+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.078+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:42:47.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.078+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.6440053649115643298', time=2024-03-04T14:41:37.780172+0000, chain.objs.size()=11 2024-03-04T12:42:47.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.078+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~nt1dI25Q8THQ7sobolPa_YjAxnMbOUm.1 2024-03-04T12:42:47.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.078+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__shadow_key1.2~nt1dI25Q8THQ7sobolPa_YjAxnMbOUm.1_1 2024-03-04T12:42:47.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.078+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~nt1dI25Q8THQ7sobolPa_YjAxnMbOUm.2 2024-03-04T12:42:47.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.078+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__shadow_key1.2~nt1dI25Q8THQ7sobolPa_YjAxnMbOUm.2_1 2024-03-04T12:42:47.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.078+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~nt1dI25Q8THQ7sobolPa_YjAxnMbOUm.3 2024-03-04T12:42:47.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.078+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__shadow_key1.2~nt1dI25Q8THQ7sobolPa_YjAxnMbOUm.3_1 2024-03-04T12:42:47.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.078+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~nt1dI25Q8THQ7sobolPa_YjAxnMbOUm.4 2024-03-04T12:42:47.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.078+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__shadow_key1.2~nt1dI25Q8THQ7sobolPa_YjAxnMbOUm.4_1 2024-03-04T12:42:47.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.078+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~nt1dI25Q8THQ7sobolPa_YjAxnMbOUm.5 2024-03-04T12:42:47.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.078+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__shadow_key1.2~nt1dI25Q8THQ7sobolPa_YjAxnMbOUm.5_1 2024-03-04T12:42:47.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.078+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~nt1dI25Q8THQ7sobolPa_YjAxnMbOUm.6 2024-03-04T12:42:47.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.084+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:47.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.086+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:42:47.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.087+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.087+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.088+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:42:47.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.088+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5434822512612682528', time=2024-03-04T14:39:32.387680+0000, chain.objs.size()=4 2024-03-04T12:42:47.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.088+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.36__shadow_.p-4cF1HyKeqGiJX7pI_d90O4d6x7VFv_1 2024-03-04T12:42:47.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.088+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.36__shadow_.p-4cF1HyKeqGiJX7pI_d90O4d6x7VFv_2 2024-03-04T12:42:47.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.088+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.36__shadow_.p-4cF1HyKeqGiJX7pI_d90O4d6x7VFv_3 2024-03-04T12:42:47.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.088+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.36__shadow_.p-4cF1HyKeqGiJX7pI_d90O4d6x7VFv_4 2024-03-04T12:42:47.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.092+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:47.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.094+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:42:47.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.095+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.096+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.096+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:42:47.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.096+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11530197176409628478', time=2024-03-04T14:40:55.847151+0000, chain.objs.size()=11 2024-03-04T12:42:47.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.096+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~lAF0U0OK8EmbwfxE1zlHWY8nCi3oksj.1 2024-03-04T12:42:47.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.096+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~lAF0U0OK8EmbwfxE1zlHWY8nCi3oksj.2 2024-03-04T12:42:47.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.096+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~lAF0U0OK8EmbwfxE1zlHWY8nCi3oksj.3 2024-03-04T12:42:47.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.096+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~lAF0U0OK8EmbwfxE1zlHWY8nCi3oksj.4 2024-03-04T12:42:47.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.096+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~lAF0U0OK8EmbwfxE1zlHWY8nCi3oksj.5 2024-03-04T12:42:47.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.096+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~lAF0U0OK8EmbwfxE1zlHWY8nCi3oksj.6 2024-03-04T12:42:47.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.096+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~lAF0U0OK8EmbwfxE1zlHWY8nCi3oksj.7 2024-03-04T12:42:47.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.096+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~lAF0U0OK8EmbwfxE1zlHWY8nCi3oksj.8 2024-03-04T12:42:47.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.096+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~lAF0U0OK8EmbwfxE1zlHWY8nCi3oksj.9 2024-03-04T12:42:47.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.096+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~lAF0U0OK8EmbwfxE1zlHWY8nCi3oksj.10 2024-03-04T12:42:47.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.096+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~lAF0U0OK8EmbwfxE1zlHWY8nCi3oksj.11 2024-03-04T12:42:47.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.103+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:47.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.105+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:42:47.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.106+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.106+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.107+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:42:47.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.107+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14200596807727576824', time=2024-03-04T14:38:52.802619+0000, chain.objs.size()=5 2024-03-04T12:42:47.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.107+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.32__multipart_key1.2~E1s-fBLYoGIukWm8SEnMHLPxuvsSuXe.1 2024-03-04T12:42:47.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.107+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.32__multipart_key1.2~E1s-fBLYoGIukWm8SEnMHLPxuvsSuXe.2 2024-03-04T12:42:47.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.107+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.32__multipart_key1.2~E1s-fBLYoGIukWm8SEnMHLPxuvsSuXe.3 2024-03-04T12:42:47.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.107+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.32__multipart_key1.2~E1s-fBLYoGIukWm8SEnMHLPxuvsSuXe.4 2024-03-04T12:42:47.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.107+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.32__multipart_key1.2~E1s-fBLYoGIukWm8SEnMHLPxuvsSuXe.5 2024-03-04T12:42:47.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.110+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:47.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.112+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:42:47.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.113+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.114+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.114+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:42:47.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.114+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5064863785472356663', time=2024-03-04T14:42:03.088572+0000, chain.objs.size()=5 2024-03-04T12:42:47.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.114+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.47__multipart_key1.2~qf0-Ccsg7o79ipZqMT3TaNgCSmiBfL9.1 2024-03-04T12:42:47.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.114+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.47__multipart_key1.2~qf0-Ccsg7o79ipZqMT3TaNgCSmiBfL9.2 2024-03-04T12:42:47.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.114+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.47__multipart_key1.2~qf0-Ccsg7o79ipZqMT3TaNgCSmiBfL9.3 2024-03-04T12:42:47.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.114+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.47__multipart_key1.2~qf0-Ccsg7o79ipZqMT3TaNgCSmiBfL9.4 2024-03-04T12:42:47.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.114+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.47__multipart_key1.2~qf0-Ccsg7o79ipZqMT3TaNgCSmiBfL9.5 2024-03-04T12:42:47.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.117+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:47.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.119+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:42:47.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.120+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.121+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.121+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:42:47.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.121+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17505510901008192412', time=2024-03-04T14:41:48.854370+0000, chain.objs.size()=11 2024-03-04T12:42:47.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.121+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~e03SCEy0vxNNv9n9uQ2wk_uTs9ocmKt.1 2024-03-04T12:42:47.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.121+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__shadow_key1.2~e03SCEy0vxNNv9n9uQ2wk_uTs9ocmKt.1_1 2024-03-04T12:42:47.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.121+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~e03SCEy0vxNNv9n9uQ2wk_uTs9ocmKt.2 2024-03-04T12:42:47.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.121+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__shadow_key1.2~e03SCEy0vxNNv9n9uQ2wk_uTs9ocmKt.2_1 2024-03-04T12:42:47.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.121+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~e03SCEy0vxNNv9n9uQ2wk_uTs9ocmKt.3 2024-03-04T12:42:47.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.121+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__shadow_key1.2~e03SCEy0vxNNv9n9uQ2wk_uTs9ocmKt.3_1 2024-03-04T12:42:47.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.121+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~e03SCEy0vxNNv9n9uQ2wk_uTs9ocmKt.4 2024-03-04T12:42:47.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.121+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__shadow_key1.2~e03SCEy0vxNNv9n9uQ2wk_uTs9ocmKt.4_1 2024-03-04T12:42:47.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.121+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~e03SCEy0vxNNv9n9uQ2wk_uTs9ocmKt.5 2024-03-04T12:42:47.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.121+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__shadow_key1.2~e03SCEy0vxNNv9n9uQ2wk_uTs9ocmKt.5_1 2024-03-04T12:42:47.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.121+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.45__multipart_key1.2~e03SCEy0vxNNv9n9uQ2wk_uTs9ocmKt.6 2024-03-04T12:42:47.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.125+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:47.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.127+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:42:47.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.128+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.129+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.129+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.130+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:42:47.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.131+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.132+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.132+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:42:47.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.132+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13044584881926733922', time=2024-03-04T14:39:14.838031+0000, chain.objs.size()=5 2024-03-04T12:42:47.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.132+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~S9_Zx2piSz3hnEFBiFhcX-VZ_Y22F-Z.1 2024-03-04T12:42:47.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.132+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~S9_Zx2piSz3hnEFBiFhcX-VZ_Y22F-Z.2 2024-03-04T12:42:47.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.132+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~S9_Zx2piSz3hnEFBiFhcX-VZ_Y22F-Z.3 2024-03-04T12:42:47.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.132+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~S9_Zx2piSz3hnEFBiFhcX-VZ_Y22F-Z.4 2024-03-04T12:42:47.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.132+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~S9_Zx2piSz3hnEFBiFhcX-VZ_Y22F-Z.5 2024-03-04T12:42:47.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.136+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:47.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.138+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:42:47.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.140+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.140+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.141+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:42:47.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.141+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14039634330083817878', time=2024-03-04T14:39:32.097852+0000, chain.objs.size()=5 2024-03-04T12:42:47.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.141+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~ktFubiPU5jr3BqEs8dF_uWtsS-OlsPA.1 2024-03-04T12:42:47.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.141+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__shadow_key1.2~ktFubiPU5jr3BqEs8dF_uWtsS-OlsPA.1_1 2024-03-04T12:42:47.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.141+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~ktFubiPU5jr3BqEs8dF_uWtsS-OlsPA.2 2024-03-04T12:42:47.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.141+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__shadow_key1.2~ktFubiPU5jr3BqEs8dF_uWtsS-OlsPA.2_1 2024-03-04T12:42:47.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.141+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.37__multipart_key1.2~ktFubiPU5jr3BqEs8dF_uWtsS-OlsPA.3 2024-03-04T12:42:47.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.144+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:47.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.145+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:42:47.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.147+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.147+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.147+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.148+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:42:47.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.150+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.150+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.150+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.152+0000 7fcfec931800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:42:47.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.154+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.154+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.154+0000 7fcfec931800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:42:47.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.154+0000 7fcfec931800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3693062604529090297', time=2024-03-04T14:41:57.697988+0000, chain.objs.size()=5 2024-03-04T12:42:47.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.154+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.46__multipart_key1.2~KN9L4zNv8S5DszXxJWe9H3Wp6SA2u-R.1 2024-03-04T12:42:47.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.154+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.46__multipart_key1.2~KN9L4zNv8S5DszXxJWe9H3Wp6SA2u-R.2 2024-03-04T12:42:47.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.154+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.46__multipart_key1.2~KN9L4zNv8S5DszXxJWe9H3Wp6SA2u-R.3 2024-03-04T12:42:47.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.154+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.46__multipart_key1.2~KN9L4zNv8S5DszXxJWe9H3Wp6SA2u-R.4 2024-03-04T12:42:47.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.154+0000 7fcfec931800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.46__multipart_key1.2~KN9L4zNv8S5DszXxJWe9H3Wp6SA2u-R.5 2024-03-04T12:42:47.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.158+0000 7fcfec931800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:42:47.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.160+0000 7fce9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:42:47.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.162+0000 7fcfec931800 20 remove_watcher() i=0 2024-03-04T12:42:47.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.162+0000 7fcfec931800 2 removed watcher, disabling cache 2024-03-04T12:42:47.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.163+0000 7fcfec931800 20 remove_watcher() i=1 2024-03-04T12:42:47.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.164+0000 7fcfec931800 20 remove_watcher() i=2 2024-03-04T12:42:47.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.165+0000 7fcfec931800 20 remove_watcher() i=3 2024-03-04T12:42:47.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.166+0000 7fcfec931800 20 remove_watcher() i=4 2024-03-04T12:42:47.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.167+0000 7fcfec931800 20 remove_watcher() i=5 2024-03-04T12:42:47.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.168+0000 7fcfec931800 20 remove_watcher() i=6 2024-03-04T12:42:47.174 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.169+0000 7fcfec931800 20 remove_watcher() i=7 2024-03-04T12:42:47.185 DEBUG:teuthology.orchestra.run.smithi110:> radosgw-admin gc process --include-all 2024-03-04T12:42:47.234 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:42:47.234 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:42:47.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.262+0000 7fd55ac8c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.263+0000 7fd55ac8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:47.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.263+0000 7fd55ac8c800 20 realm 2024-03-04T12:42:47.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.263+0000 7fd55ac8c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.263+0000 7fd55ac8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:47.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.263+0000 7fd55ac8c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:42:47.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.263+0000 7fd55ac8c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.263+0000 7fd55ac8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:47.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.263+0000 7fd55ac8c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.264+0000 7fd55ac8c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:42:47.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.264+0000 7fd55ac8c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.264+0000 7fd55ac8c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:42:47.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.264+0000 7fd55ac8c800 20 searching for the correct realm 2024-03-04T12:42:47.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.267+0000 7fd558f89640 0 -- 172.21.15.110:0/240465125 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7fd5400a1cf0 msgr2=0x7fd5400989e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:42:47.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.271+0000 7fd558788640 0 -- 172.21.15.110:0/240465125 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fd5400a8860 msgr2=0x7fd5400b1740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:42:47.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.476+0000 7fd55ac8c800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:42:47.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.476+0000 7fd55ac8c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:42:47.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.476+0000 7fd55ac8c800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:42:47.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.476+0000 7fd55ac8c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:42:47.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.476+0000 7fd55ac8c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:42:47.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.476+0000 7fd55ac8c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:42:47.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.476+0000 7fd55ac8c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.476+0000 7fd55ac8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:47.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.476+0000 7fd55ac8c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.477+0000 7fd55ac8c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:42:47.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.477+0000 7fd55ac8c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.477+0000 7fd55ac8c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:42:47.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.477+0000 7fd55ac8c800 20 zone default found 2024-03-04T12:42:47.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.477+0000 7fd55ac8c800 4 Realm: () 2024-03-04T12:42:47.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.477+0000 7fd55ac8c800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:42:47.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.477+0000 7fd55ac8c800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:42:47.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.477+0000 7fd55ac8c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:42:47.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.477+0000 7fd55ac8c800 20 zonegroup default 2024-03-04T12:42:47.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.477+0000 7fd55ac8c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.477+0000 7fd55ac8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:47.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.477+0000 7fd55ac8c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.478+0000 7fd55ac8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:47.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.478+0000 7fd55ac8c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.478+0000 7fd55ac8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:47.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.478+0000 7fd55ac8c800 20 started sync module instance, tier type = 2024-03-04T12:42:47.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.478+0000 7fd55ac8c800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:42:47.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.486+0000 7fd55ac8c800 20 add_watcher() i=0 2024-03-04T12:42:47.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.486+0000 7fd55ac8c800 20 add_watcher() i=1 2024-03-04T12:42:47.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.486+0000 7fd55ac8c800 20 add_watcher() i=2 2024-03-04T12:42:47.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.486+0000 7fd55ac8c800 20 add_watcher() i=3 2024-03-04T12:42:47.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.486+0000 7fd55ac8c800 20 add_watcher() i=4 2024-03-04T12:42:47.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.486+0000 7fd55ac8c800 20 add_watcher() i=5 2024-03-04T12:42:47.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.486+0000 7fd55ac8c800 20 add_watcher() i=6 2024-03-04T12:42:47.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.487+0000 7fd55ac8c800 20 add_watcher() i=7 2024-03-04T12:42:47.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.487+0000 7fd55ac8c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:42:47.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.489+0000 7fd40efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:42:47.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.489+0000 7fd55ac8c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:42:47.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.489+0000 7fd55ac8c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:42:47.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.521+0000 7fd40dfdb640 20 reqs_thread_entry: start 2024-03-04T12:42:47.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.521+0000 7fd55ac8c800 20 init_complete bucket index max shards: 11 2024-03-04T12:42:47.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.521+0000 7fd55ac8c800 20 Filter name: none 2024-03-04T12:42:47.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.522+0000 7fd37f7fe640 20 reqs_thread_entry: start 2024-03-04T12:42:47.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.522+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:42:47.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.523+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.523+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.524+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.524+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:42:47.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.526+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.526+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.526+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.527+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:42:47.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.529+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.529+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.529+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.530+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:42:47.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.531+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.532+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.532+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.533+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:42:47.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.534+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.535+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.535+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.536+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:42:47.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.538+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.538+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.538+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.539+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:42:47.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.541+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.541+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.541+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.542+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:42:47.549 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.544+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.544+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.544+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.545+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:42:47.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.547+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.547+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.548+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.549+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:42:47.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.550+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.550+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.551+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.551+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:42:47.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.553+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.553+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.553+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.554+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:42:47.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.556+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.556+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.557+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.558+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:42:47.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.559+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.559+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.560+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.560+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:42:47.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.562+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.562+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.562+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.563+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:42:47.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.565+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.565+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.565+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.566+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:42:47.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.567+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.568+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.568+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.569+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:42:47.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.570+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.571+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.571+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.572+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:42:47.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.573+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.574+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.574+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.575+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:42:47.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.576+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.577+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.577+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.578+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:42:47.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.579+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.580+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.580+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.581+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:42:47.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.582+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.583+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.583+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.584+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:42:47.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.586+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.586+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.586+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.587+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:42:47.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.589+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.589+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.589+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.591+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:42:47.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.592+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.592+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.592+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.593+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:42:47.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.595+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.595+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.596+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.597+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:42:47.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.598+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.598+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.599+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.599+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:42:47.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.600+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.601+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.601+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.602+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:42:47.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.603+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.604+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.604+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.605+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:42:47.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.606+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.607+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.607+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.608+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:42:47.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.609+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.609+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.610+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.610+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:42:47.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.612+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.612+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.612+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.613+0000 7fd55ac8c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:42:47.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.615+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.615+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.615+0000 7fd55ac8c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.617+0000 7fd40efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:42:47.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.619+0000 7fd55ac8c800 20 remove_watcher() i=0 2024-03-04T12:42:47.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.619+0000 7fd55ac8c800 2 removed watcher, disabling cache 2024-03-04T12:42:47.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.620+0000 7fd55ac8c800 20 remove_watcher() i=1 2024-03-04T12:42:47.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.621+0000 7fd55ac8c800 20 remove_watcher() i=2 2024-03-04T12:42:47.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.622+0000 7fd55ac8c800 20 remove_watcher() i=3 2024-03-04T12:42:47.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.624+0000 7fd55ac8c800 20 remove_watcher() i=4 2024-03-04T12:42:47.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.624+0000 7fd55ac8c800 20 remove_watcher() i=5 2024-03-04T12:42:47.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.625+0000 7fd55ac8c800 20 remove_watcher() i=6 2024-03-04T12:42:47.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.626+0000 7fd55ac8c800 20 remove_watcher() i=7 2024-03-04T12:42:47.642 DEBUG:teuthology.orchestra.run.smithi110:> radosgw-admin gc process --include-all 2024-03-04T12:42:47.691 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:42:47.691 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:42:47.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.719+0000 7f1363d33800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.720+0000 7f1363d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:47.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.720+0000 7f1363d33800 20 realm 2024-03-04T12:42:47.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.720+0000 7f1363d33800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.720+0000 7f1363d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:47.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.720+0000 7f1363d33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:42:47.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.720+0000 7f1363d33800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.720+0000 7f1363d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:47.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.720+0000 7f1363d33800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.721+0000 7f1363d33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:42:47.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.721+0000 7f1363d33800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.721+0000 7f1363d33800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:42:47.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.721+0000 7f1363d33800 20 searching for the correct realm 2024-03-04T12:42:47.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.724+0000 7f1357fff640 0 -- 172.21.15.110:0/2461306963 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f1350081030 msgr2=0x7f1350071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:42:47.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.727+0000 7f135fa64640 0 -- 172.21.15.110:0/2461306963 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f13480099a0 msgr2=0x7f134805a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:42:47.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.933+0000 7f1363d33800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:42:47.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.933+0000 7f1363d33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:42:47.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.933+0000 7f1363d33800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:42:47.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.933+0000 7f1363d33800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:42:47.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.933+0000 7f1363d33800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:42:47.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.933+0000 7f1363d33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:42:47.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.933+0000 7f1363d33800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.934+0000 7f1363d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:47.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.934+0000 7f1363d33800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.934+0000 7f1363d33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:42:47.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.934+0000 7f1363d33800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.934+0000 7f1363d33800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:42:47.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.934+0000 7f1363d33800 20 zone default found 2024-03-04T12:42:47.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.934+0000 7f1363d33800 4 Realm: () 2024-03-04T12:42:47.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.934+0000 7f1363d33800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:42:47.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.934+0000 7f1363d33800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:42:47.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.934+0000 7f1363d33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:42:47.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.934+0000 7f1363d33800 20 zonegroup default 2024-03-04T12:42:47.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.934+0000 7f1363d33800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.935+0000 7f1363d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:47.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.935+0000 7f1363d33800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.935+0000 7f1363d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:47.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.935+0000 7f1363d33800 20 rados->read ofs=0 len=0 2024-03-04T12:42:47.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.935+0000 7f1363d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:47.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.935+0000 7f1363d33800 20 started sync module instance, tier type = 2024-03-04T12:42:47.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.935+0000 7f1363d33800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:42:47.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.944+0000 7f1363d33800 20 add_watcher() i=0 2024-03-04T12:42:47.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.944+0000 7f1363d33800 20 add_watcher() i=1 2024-03-04T12:42:47.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.944+0000 7f1363d33800 20 add_watcher() i=2 2024-03-04T12:42:47.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.944+0000 7f1363d33800 20 add_watcher() i=3 2024-03-04T12:42:47.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.944+0000 7f1363d33800 20 add_watcher() i=4 2024-03-04T12:42:47.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.944+0000 7f1363d33800 20 add_watcher() i=5 2024-03-04T12:42:47.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.944+0000 7f1363d33800 20 add_watcher() i=6 2024-03-04T12:42:47.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.945+0000 7f1363d33800 20 add_watcher() i=7 2024-03-04T12:42:47.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.945+0000 7f1363d33800 2 all 8 watchers are set, enabling cache 2024-03-04T12:42:47.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.947+0000 7f1215fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:42:47.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.948+0000 7f1363d33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:42:47.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.948+0000 7f1363d33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:42:47.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.983+0000 7f1214fe1640 20 reqs_thread_entry: start 2024-03-04T12:42:47.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.983+0000 7f1363d33800 20 init_complete bucket index max shards: 11 2024-03-04T12:42:47.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.983+0000 7f1363d33800 20 Filter name: none 2024-03-04T12:42:47.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.983+0000 7f118e7fc640 20 reqs_thread_entry: start 2024-03-04T12:42:47.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.983+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:42:47.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.985+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.985+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.985+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.986+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:42:47.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.987+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.988+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.988+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.989+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:42:47.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.991+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.991+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:47.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.991+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:47.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.992+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:42:47.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.994+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.994+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.994+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.995+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:42:48.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.997+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.997+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.997+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:47.999+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:42:48.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.000+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.000+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.001+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.002+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:42:48.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.003+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.003+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.004+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.005+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:42:48.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.006+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.006+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.007+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.008+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:42:48.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.009+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.009+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.010+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.010+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:42:48.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.012+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.013+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.013+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.014+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:42:48.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.016+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.016+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.016+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.018+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:42:48.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.019+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.019+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.020+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.020+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:42:48.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.022+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.023+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.023+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.024+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:42:48.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.025+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.026+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.026+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.027+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:42:48.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.028+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.029+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.029+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.030+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:42:48.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.031+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.031+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.031+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.032+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:42:48.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.034+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.034+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.034+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.035+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:42:48.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.036+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.037+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.037+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.038+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:42:48.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.040+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.040+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.040+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.042+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:42:48.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.043+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.043+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.043+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.044+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:42:48.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.045+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.046+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.046+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.047+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:42:48.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.048+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.048+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.049+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.050+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:42:48.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.051+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.051+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.051+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.052+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:42:48.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.054+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.054+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.054+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.056+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:42:48.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.057+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.057+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.057+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.058+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:42:48.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.060+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.060+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.060+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.062+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:42:48.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.063+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.063+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.063+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.064+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:42:48.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.066+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.066+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.066+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.067+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:42:48.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.069+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.069+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.069+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.070+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:42:48.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.071+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.072+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.072+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.073+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:42:48.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.074+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.074+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.075+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.076+0000 7f1363d33800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:42:48.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.077+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.077+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.077+0000 7f1363d33800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.079+0000 7f1215fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:42:48.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.081+0000 7f1363d33800 20 remove_watcher() i=0 2024-03-04T12:42:48.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.081+0000 7f1363d33800 2 removed watcher, disabling cache 2024-03-04T12:42:48.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.082+0000 7f1363d33800 20 remove_watcher() i=1 2024-03-04T12:42:48.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.083+0000 7f1363d33800 20 remove_watcher() i=2 2024-03-04T12:42:48.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.085+0000 7f1363d33800 20 remove_watcher() i=3 2024-03-04T12:42:48.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.086+0000 7f1363d33800 20 remove_watcher() i=4 2024-03-04T12:42:48.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.086+0000 7f1363d33800 20 remove_watcher() i=5 2024-03-04T12:42:48.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.087+0000 7f1363d33800 20 remove_watcher() i=6 2024-03-04T12:42:48.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.088+0000 7f1363d33800 20 remove_watcher() i=7 2024-03-04T12:42:48.104 DEBUG:teuthology.orchestra.run.smithi110:> radosgw-admin gc process --include-all 2024-03-04T12:42:48.153 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:42:48.153 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:42:48.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.180+0000 7f1f98a30800 20 rados->read ofs=0 len=0 2024-03-04T12:42:48.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.181+0000 7f1f98a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:48.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.181+0000 7f1f98a30800 20 realm 2024-03-04T12:42:48.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.181+0000 7f1f98a30800 20 rados->read ofs=0 len=0 2024-03-04T12:42:48.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.181+0000 7f1f98a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:48.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.181+0000 7f1f98a30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:42:48.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.181+0000 7f1f98a30800 20 rados->read ofs=0 len=0 2024-03-04T12:42:48.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.181+0000 7f1f98a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:48.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.181+0000 7f1f98a30800 20 rados->read ofs=0 len=0 2024-03-04T12:42:48.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.182+0000 7f1f98a30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:42:48.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.182+0000 7f1f98a30800 20 rados->read ofs=0 len=0 2024-03-04T12:42:48.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.182+0000 7f1f98a30800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:42:48.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.183+0000 7f1f98a30800 20 searching for the correct realm 2024-03-04T12:42:48.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.186+0000 7f1f94531640 0 -- 172.21.15.110:0/287476905 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7f1f8809e8f0 msgr2=0x7f1f880a4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:42:48.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.391+0000 7f1f93d30640 0 -- 172.21.15.110:0/287476905 >> [v2:172.21.15.172:6800/824320839,v1:172.21.15.172:6801/824320839] conn(0x55dca8d072c0 msgr2=0x55dca8d09710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:42:48.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.394+0000 7f1f98a30800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:42:48.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.394+0000 7f1f98a30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:42:48.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.394+0000 7f1f98a30800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:42:48.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.394+0000 7f1f98a30800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:42:48.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.394+0000 7f1f98a30800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:42:48.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.394+0000 7f1f98a30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:42:48.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.394+0000 7f1f98a30800 20 rados->read ofs=0 len=0 2024-03-04T12:42:48.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.394+0000 7f1f98a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:48.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.394+0000 7f1f98a30800 20 rados->read ofs=0 len=0 2024-03-04T12:42:48.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.394+0000 7f1f98a30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:42:48.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.394+0000 7f1f98a30800 20 rados->read ofs=0 len=0 2024-03-04T12:42:48.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.394+0000 7f1f98a30800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:42:48.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.394+0000 7f1f98a30800 20 zone default found 2024-03-04T12:42:48.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.395+0000 7f1f98a30800 4 Realm: () 2024-03-04T12:42:48.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.395+0000 7f1f98a30800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:42:48.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.395+0000 7f1f98a30800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:42:48.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.395+0000 7f1f98a30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:42:48.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.395+0000 7f1f98a30800 20 zonegroup default 2024-03-04T12:42:48.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.395+0000 7f1f98a30800 20 rados->read ofs=0 len=0 2024-03-04T12:42:48.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.395+0000 7f1f98a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:48.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.395+0000 7f1f98a30800 20 rados->read ofs=0 len=0 2024-03-04T12:42:48.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.395+0000 7f1f98a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:48.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.395+0000 7f1f98a30800 20 rados->read ofs=0 len=0 2024-03-04T12:42:48.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.395+0000 7f1f98a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:48.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.395+0000 7f1f98a30800 20 started sync module instance, tier type = 2024-03-04T12:42:48.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.395+0000 7f1f98a30800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:42:48.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.404+0000 7f1f98a30800 20 add_watcher() i=0 2024-03-04T12:42:48.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.404+0000 7f1f98a30800 20 add_watcher() i=1 2024-03-04T12:42:48.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.404+0000 7f1f98a30800 20 add_watcher() i=2 2024-03-04T12:42:48.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.404+0000 7f1f98a30800 20 add_watcher() i=3 2024-03-04T12:42:48.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.404+0000 7f1f98a30800 20 add_watcher() i=4 2024-03-04T12:42:48.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.404+0000 7f1f98a30800 20 add_watcher() i=5 2024-03-04T12:42:48.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.404+0000 7f1f98a30800 20 add_watcher() i=6 2024-03-04T12:42:48.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.405+0000 7f1f98a30800 20 add_watcher() i=7 2024-03-04T12:42:48.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.405+0000 7f1f98a30800 2 all 8 watchers are set, enabling cache 2024-03-04T12:42:48.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.406+0000 7f1e49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:42:48.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.407+0000 7f1f98a30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:42:48.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.407+0000 7f1f98a30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:42:48.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.441+0000 7f1e48fe1640 20 reqs_thread_entry: start 2024-03-04T12:42:48.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.441+0000 7f1f98a30800 20 init_complete bucket index max shards: 11 2024-03-04T12:42:48.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.441+0000 7f1f98a30800 20 Filter name: none 2024-03-04T12:42:48.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.441+0000 7f1dc27fc640 20 reqs_thread_entry: start 2024-03-04T12:42:48.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.441+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:42:48.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.443+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.443+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.444+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.445+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:42:48.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.446+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.447+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.447+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.448+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:42:48.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.449+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.449+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.450+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.451+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:42:48.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.452+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.452+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.452+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.453+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:42:48.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.455+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.455+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.455+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.457+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:42:48.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.458+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.459+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.459+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.460+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:42:48.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.461+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.462+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.462+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.463+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:42:48.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.464+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.465+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.465+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.466+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:42:48.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.467+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.468+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.468+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.469+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:42:48.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.470+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.471+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.471+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.472+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:42:48.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.473+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.473+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.474+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.474+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:42:48.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.476+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.476+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.476+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.477+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:42:48.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.478+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.479+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.479+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.480+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:42:48.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.481+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.482+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.482+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.483+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:42:48.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.484+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.484+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.485+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.486+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:42:48.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.487+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.487+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.488+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.489+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:42:48.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.490+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.491+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.491+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.492+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:42:48.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.493+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.494+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.494+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.495+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:42:48.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.496+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.496+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.497+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.498+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:42:48.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.499+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.499+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.500+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.500+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:42:48.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.502+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.502+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.502+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.503+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:42:48.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.505+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.505+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.506+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.507+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:42:48.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.508+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.508+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.509+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.509+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:42:48.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.511+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.511+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.511+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.512+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:42:48.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.513+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.514+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.514+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.515+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:42:48.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.516+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.517+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.517+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.518+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:42:48.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.519+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.520+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.520+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.521+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:42:48.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.523+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.523+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.524+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.525+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:42:48.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.526+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.526+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.527+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.528+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:42:48.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.529+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.529+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.529+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.531+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:42:48.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.532+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.532+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.532+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.533+0000 7f1f98a30800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:42:48.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.534+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.535+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:48.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.535+0000 7f1f98a30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:48.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.537+0000 7f1e49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:42:48.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.539+0000 7f1f98a30800 20 remove_watcher() i=0 2024-03-04T12:42:48.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.539+0000 7f1f98a30800 2 removed watcher, disabling cache 2024-03-04T12:42:48.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.540+0000 7f1f98a30800 20 remove_watcher() i=1 2024-03-04T12:42:48.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.541+0000 7f1f98a30800 20 remove_watcher() i=2 2024-03-04T12:42:48.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.542+0000 7f1f98a30800 20 remove_watcher() i=3 2024-03-04T12:42:48.549 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.543+0000 7f1f98a30800 20 remove_watcher() i=4 2024-03-04T12:42:48.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.544+0000 7f1f98a30800 20 remove_watcher() i=5 2024-03-04T12:42:48.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.545+0000 7f1f98a30800 20 remove_watcher() i=6 2024-03-04T12:42:48.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:48.546+0000 7f1f98a30800 20 remove_watcher() i=7 2024-03-04T12:42:48.562 DEBUG:teuthology.orchestra.run.smithi110:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-03-04T12:42:49.149 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :clean 2024-03-04T12:42:49.847 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :compileJava 2024-03-04T12:42:49.847 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :processResources 2024-03-04T12:42:49.848 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :classes 2024-03-04T12:42:50.547 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:50.548 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :compileTestJava 2024-03-04T12:42:50.548 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:50.548 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :processTestResources NO-SOURCE 2024-03-04T12:42:50.548 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :testClasses 2024-03-04T12:42:50.548 INFO:teuthology.orchestra.run.smithi110.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-03-04T12:42:50.548 INFO:teuthology.orchestra.run.smithi110.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-03-04T12:42:52.548 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:52.548 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :test 2024-03-04T12:42:52.549 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:52.549 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests STANDARD_OUT 2024-03-04T12:42:52.549 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04 12:42:51,792 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-03-04T12:42:52.549 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:52.549 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-03-04T12:42:52.549 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:52.549 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-03-04T12:42:52.549 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:52.549 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-03-04T12:42:52.549 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:52.549 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-03-04T12:42:52.947 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:52.947 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-03-04T12:42:52.947 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:52.947 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-03-04T12:42:53.346 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:53.347 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-03-04T12:42:53.547 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:53.547 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-03-04T12:42:53.646 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:53.647 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-03-04T12:42:53.747 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:53.747 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-03-04T12:42:54.147 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:54.147 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-03-04T12:42:54.247 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:54.247 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-03-04T12:42:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:54.347 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-03-04T12:42:54.447 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:54.447 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-03-04T12:42:55.147 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:55.147 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-03-04T12:42:55.247 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:55.247 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-03-04T12:42:55.547 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:55.547 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-03-04T12:42:55.547 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:55.547 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-03-04T12:42:55.711 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:55.711 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------- 2024-03-04T12:42:55.711 INFO:teuthology.orchestra.run.smithi110.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-03-04T12:42:55.711 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------- 2024-03-04T12:42:55.712 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:55.712 INFO:teuthology.orchestra.run.smithi110.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-03-04T12:42:55.712 INFO:teuthology.orchestra.run.smithi110.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-03-04T12:42:55.712 INFO:teuthology.orchestra.run.smithi110.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-03-04T12:42:55.712 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:55.712 INFO:teuthology.orchestra.run.smithi110.stdout:BUILD SUCCESSFUL in 7s 2024-03-04T12:42:55.712 INFO:teuthology.orchestra.run.smithi110.stdout:5 actionable tasks: 5 executed 2024-03-04T12:42:55.715 DEBUG:teuthology.orchestra.run.smithi110:> radosgw-admin gc process --include-all 2024-03-04T12:42:55.764 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:42:55.765 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:42:55.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.791+0000 7f3dce542800 20 rados->read ofs=0 len=0 2024-03-04T12:42:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.793+0000 7f3dce542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.793+0000 7f3dce542800 20 realm 2024-03-04T12:42:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.793+0000 7f3dce542800 20 rados->read ofs=0 len=0 2024-03-04T12:42:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.793+0000 7f3dce542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.793+0000 7f3dce542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:42:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.793+0000 7f3dce542800 20 rados->read ofs=0 len=0 2024-03-04T12:42:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.793+0000 7f3dce542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:55.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.793+0000 7f3dce542800 20 rados->read ofs=0 len=0 2024-03-04T12:42:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.794+0000 7f3dce542800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:42:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.794+0000 7f3dce542800 20 rados->read ofs=0 len=0 2024-03-04T12:42:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.794+0000 7f3dce542800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:42:55.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.794+0000 7f3dce542800 20 searching for the correct realm 2024-03-04T12:42:55.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.797+0000 7f3dcaa42640 0 -- 172.21.15.110:0/2681783402 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f3dc007b040 msgr2=0x7f3dc008a970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:42:55.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.801+0000 7f3dca241640 0 -- 172.21.15.110:0/2681783402 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f3dc0062430 msgr2=0x7f3dc0062890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:42:55.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.805+0000 7f3dce542800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:42:55.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.805+0000 7f3dce542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:42:55.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.805+0000 7f3dce542800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:42:55.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.805+0000 7f3dce542800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:42:55.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.805+0000 7f3dce542800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:42:55.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.805+0000 7f3dce542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:42:55.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.805+0000 7f3dce542800 20 rados->read ofs=0 len=0 2024-03-04T12:42:55.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.805+0000 7f3dce542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:55.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.805+0000 7f3dce542800 20 rados->read ofs=0 len=0 2024-03-04T12:42:55.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.805+0000 7f3dce542800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:42:55.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.805+0000 7f3dce542800 20 rados->read ofs=0 len=0 2024-03-04T12:42:55.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.806+0000 7f3dce542800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:42:55.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.806+0000 7f3dce542800 20 zone default found 2024-03-04T12:42:55.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.806+0000 7f3dce542800 4 Realm: () 2024-03-04T12:42:55.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.806+0000 7f3dce542800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:42:55.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.806+0000 7f3dce542800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:42:55.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.806+0000 7f3dce542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:42:55.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.806+0000 7f3dce542800 20 zonegroup default 2024-03-04T12:42:55.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.806+0000 7f3dce542800 20 rados->read ofs=0 len=0 2024-03-04T12:42:55.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.806+0000 7f3dce542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:55.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.806+0000 7f3dce542800 20 rados->read ofs=0 len=0 2024-03-04T12:42:55.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.806+0000 7f3dce542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:55.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.806+0000 7f3dce542800 20 rados->read ofs=0 len=0 2024-03-04T12:42:55.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.807+0000 7f3dce542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:55.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.807+0000 7f3dce542800 20 started sync module instance, tier type = 2024-03-04T12:42:55.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.807+0000 7f3dce542800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:42:55.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.816+0000 7f3dce542800 20 add_watcher() i=0 2024-03-04T12:42:55.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.816+0000 7f3dce542800 20 add_watcher() i=1 2024-03-04T12:42:55.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.816+0000 7f3dce542800 20 add_watcher() i=2 2024-03-04T12:42:55.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.816+0000 7f3dce542800 20 add_watcher() i=3 2024-03-04T12:42:55.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.816+0000 7f3dce542800 20 add_watcher() i=4 2024-03-04T12:42:55.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.816+0000 7f3dce542800 20 add_watcher() i=5 2024-03-04T12:42:55.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.816+0000 7f3dce542800 20 add_watcher() i=6 2024-03-04T12:42:55.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.817+0000 7f3dce542800 20 add_watcher() i=7 2024-03-04T12:42:55.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.817+0000 7f3dce542800 2 all 8 watchers are set, enabling cache 2024-03-04T12:42:55.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.819+0000 7f3c80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:42:55.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.819+0000 7f3dce542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:42:55.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.819+0000 7f3dce542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:42:55.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.853+0000 7f3bfb7fe640 20 reqs_thread_entry: start 2024-03-04T12:42:55.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.853+0000 7f3dce542800 20 init_complete bucket index max shards: 11 2024-03-04T12:42:55.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.853+0000 7f3dce542800 20 Filter name: none 2024-03-04T12:42:55.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.853+0000 7f3bf97fa640 20 reqs_thread_entry: start 2024-03-04T12:42:55.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.853+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:42:55.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.855+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.855+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.855+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.857+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:42:55.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.858+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.858+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.859+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.860+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:42:55.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.861+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.862+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.862+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.863+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:42:55.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.864+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.865+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.865+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.866+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:42:55.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.867+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.868+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.868+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.869+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:42:55.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.870+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.871+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.871+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.872+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:42:55.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.873+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.874+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.874+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.875+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:42:55.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.876+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.877+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.877+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.878+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:42:55.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.879+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.880+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.880+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.881+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:42:55.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.882+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.883+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.883+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.884+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:42:55.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.885+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.886+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.886+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.887+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:42:55.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.889+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.889+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.889+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.890+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:42:55.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.892+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.892+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.892+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.893+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:42:55.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.895+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.896+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.896+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.897+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:42:55.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.898+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.899+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.899+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.900+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:42:55.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.901+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.902+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.902+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.903+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:42:55.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.904+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.904+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.905+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.906+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:42:55.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.907+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.907+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.908+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.909+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:42:55.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.910+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.910+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.911+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.912+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:42:55.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.913+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.913+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.914+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.915+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:42:55.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.916+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.916+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.916+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.917+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:42:55.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.919+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.919+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.919+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.921+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:42:55.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.922+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.922+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.923+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.924+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:42:55.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.925+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.925+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.926+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.927+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:42:55.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.929+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.929+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.929+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.930+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:42:55.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.931+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.932+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.932+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.933+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:42:55.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.934+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.935+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.935+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.936+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:42:55.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.937+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.937+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.937+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.938+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:42:55.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.940+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.941+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.941+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.942+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:42:55.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.943+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.944+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.944+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.945+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:42:55.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.946+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.947+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.947+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.948+0000 7f3dce542800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:42:55.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.949+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.950+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:55.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.950+0000 7f3dce542800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:55.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.952+0000 7f3c80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:42:55.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.954+0000 7f3dce542800 20 remove_watcher() i=0 2024-03-04T12:42:55.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.954+0000 7f3dce542800 2 removed watcher, disabling cache 2024-03-04T12:42:55.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.954+0000 7f3dce542800 20 remove_watcher() i=1 2024-03-04T12:42:55.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.956+0000 7f3dce542800 20 remove_watcher() i=2 2024-03-04T12:42:55.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.958+0000 7f3dce542800 20 remove_watcher() i=3 2024-03-04T12:42:55.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.959+0000 7f3dce542800 20 remove_watcher() i=4 2024-03-04T12:42:55.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.960+0000 7f3dce542800 20 remove_watcher() i=5 2024-03-04T12:42:55.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.960+0000 7f3dce542800 20 remove_watcher() i=6 2024-03-04T12:42:55.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:55.961+0000 7f3dce542800 20 remove_watcher() i=7 2024-03-04T12:42:55.977 DEBUG:teuthology.orchestra.run.smithi110:> radosgw-admin gc process --include-all 2024-03-04T12:42:56.027 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:42:56.027 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:42:56.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.054+0000 7f73374be800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.055+0000 7f73374be800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.055+0000 7f73374be800 20 realm 2024-03-04T12:42:56.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.055+0000 7f73374be800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.055+0000 7f73374be800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.055+0000 7f73374be800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:42:56.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.055+0000 7f73374be800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.055+0000 7f73374be800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.055+0000 7f73374be800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.056+0000 7f73374be800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:42:56.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.056+0000 7f73374be800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.056+0000 7f73374be800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:42:56.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.056+0000 7f73374be800 20 searching for the correct realm 2024-03-04T12:42:56.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.060+0000 7f73357bb640 0 -- 172.21.15.110:0/1854127901 >> [v2:172.21.15.110:6824/3005097257,v1:172.21.15.110:6825/3005097257] conn(0x560f25fecf00 msgr2=0x560f25fef3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:42:56.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.063+0000 7f732ffff640 0 -- 172.21.15.110:0/1854127901 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f732805e470 msgr2=0x7f7328091040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:42:56.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.066+0000 7f73374be800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:42:56.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.066+0000 7f73374be800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:42:56.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.066+0000 7f73374be800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:42:56.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.066+0000 7f73374be800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:42:56.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.066+0000 7f73374be800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:42:56.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.066+0000 7f73374be800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:42:56.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.066+0000 7f73374be800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.066+0000 7f73374be800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.066+0000 7f73374be800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.067+0000 7f73374be800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:42:56.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.067+0000 7f73374be800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.067+0000 7f73374be800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:42:56.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.067+0000 7f73374be800 20 zone default found 2024-03-04T12:42:56.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.067+0000 7f73374be800 4 Realm: () 2024-03-04T12:42:56.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.067+0000 7f73374be800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:42:56.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.067+0000 7f73374be800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:42:56.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.067+0000 7f73374be800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:42:56.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.067+0000 7f73374be800 20 zonegroup default 2024-03-04T12:42:56.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.067+0000 7f73374be800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.067+0000 7f73374be800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.067+0000 7f73374be800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.068+0000 7f73374be800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.068+0000 7f73374be800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.068+0000 7f73374be800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.068+0000 7f73374be800 20 started sync module instance, tier type = 2024-03-04T12:42:56.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.068+0000 7f73374be800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:42:56.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.076+0000 7f73374be800 20 add_watcher() i=0 2024-03-04T12:42:56.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.076+0000 7f73374be800 20 add_watcher() i=1 2024-03-04T12:42:56.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.076+0000 7f73374be800 20 add_watcher() i=2 2024-03-04T12:42:56.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.076+0000 7f73374be800 20 add_watcher() i=3 2024-03-04T12:42:56.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.076+0000 7f73374be800 20 add_watcher() i=4 2024-03-04T12:42:56.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.076+0000 7f73374be800 20 add_watcher() i=5 2024-03-04T12:42:56.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.076+0000 7f73374be800 20 add_watcher() i=6 2024-03-04T12:42:56.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.077+0000 7f73374be800 20 add_watcher() i=7 2024-03-04T12:42:56.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.077+0000 7f73374be800 2 all 8 watchers are set, enabling cache 2024-03-04T12:42:56.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.079+0000 7f71eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:42:56.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.079+0000 7f73374be800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:42:56.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.079+0000 7f73374be800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:42:56.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.114+0000 7f71e9fe3640 20 reqs_thread_entry: start 2024-03-04T12:42:56.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.114+0000 7f73374be800 20 init_complete bucket index max shards: 11 2024-03-04T12:42:56.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.114+0000 7f73374be800 20 Filter name: none 2024-03-04T12:42:56.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.114+0000 7f715b7fe640 20 reqs_thread_entry: start 2024-03-04T12:42:56.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.114+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:42:56.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.115+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.116+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.116+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.117+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:42:56.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.118+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.119+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.119+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.120+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:42:56.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.121+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.122+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.122+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.123+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:42:56.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.124+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.125+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.125+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.126+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:42:56.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.127+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.127+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.128+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.129+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:42:56.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.130+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.130+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.130+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.132+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:42:56.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.134+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.134+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.135+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.136+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:42:56.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.137+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.137+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.137+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.138+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:42:56.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.140+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.140+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.140+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.141+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:42:56.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.142+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.143+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.143+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.144+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:42:56.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.145+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.146+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.146+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.147+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:42:56.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.148+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.149+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.149+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.150+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:42:56.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.151+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.152+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.152+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.153+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:42:56.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.154+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.155+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.155+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.156+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:42:56.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.157+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.157+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.158+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.158+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:42:56.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.160+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.160+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.160+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.161+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:42:56.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.163+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.163+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.163+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.165+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:42:56.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.167+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.167+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.168+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.174 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.168+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:42:56.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.170+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.170+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.170+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.171+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:42:56.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.172+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.173+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.173+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.174+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:42:56.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.175+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.175+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.176+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.177+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:42:56.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.178+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.178+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.179+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.180+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:42:56.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.181+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.182+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.182+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.183+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:42:56.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.184+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.185+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.185+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.186+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:42:56.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.187+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.188+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.188+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.189+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:42:56.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.190+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.191+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.191+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.192+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:42:56.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.193+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.194+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.194+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.195+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:42:56.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.196+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.197+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.197+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.198+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:42:56.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.199+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.200+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.200+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.201+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:42:56.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.203+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.204+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.204+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.205+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:42:56.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.206+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.206+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.207+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.207+0000 7f73374be800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:42:56.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.209+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.209+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.209+0000 7f73374be800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.211+0000 7f71eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:42:56.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.213+0000 7f73374be800 20 remove_watcher() i=0 2024-03-04T12:42:56.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.213+0000 7f73374be800 2 removed watcher, disabling cache 2024-03-04T12:42:56.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.214+0000 7f73374be800 20 remove_watcher() i=1 2024-03-04T12:42:56.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.215+0000 7f73374be800 20 remove_watcher() i=2 2024-03-04T12:42:56.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.216+0000 7f73374be800 20 remove_watcher() i=3 2024-03-04T12:42:56.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.217+0000 7f73374be800 20 remove_watcher() i=4 2024-03-04T12:42:56.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.219+0000 7f73374be800 20 remove_watcher() i=5 2024-03-04T12:42:56.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.221+0000 7f73374be800 20 remove_watcher() i=6 2024-03-04T12:42:56.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.222+0000 7f73374be800 20 remove_watcher() i=7 2024-03-04T12:42:56.237 DEBUG:teuthology.orchestra.run.smithi110:> radosgw-admin gc process --include-all 2024-03-04T12:42:56.287 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:42:56.287 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:42:56.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.314+0000 7fc34c92c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.315+0000 7fc34c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.315+0000 7fc34c92c800 20 realm 2024-03-04T12:42:56.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.315+0000 7fc34c92c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.315+0000 7fc34c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.315+0000 7fc34c92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:42:56.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.315+0000 7fc34c92c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.315+0000 7fc34c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.315+0000 7fc34c92c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.316+0000 7fc34c92c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:42:56.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.316+0000 7fc34c92c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.316+0000 7fc34c92c800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:42:56.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.316+0000 7fc34c92c800 20 searching for the correct realm 2024-03-04T12:42:56.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.320+0000 7fc348e62640 0 -- 172.21.15.110:0/1094576518 >> [v2:172.21.15.110:6824/3005097257,v1:172.21.15.110:6825/3005097257] conn(0x556293297800 msgr2=0x556293299ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:42:56.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.323+0000 7fc347e60640 0 -- 172.21.15.110:0/1094576518 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7fc3380d1070 msgr2=0x7fc3380ae0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:42:56.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.326+0000 7fc34c92c800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:42:56.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.326+0000 7fc34c92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:42:56.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.326+0000 7fc34c92c800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:42:56.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.326+0000 7fc34c92c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:42:56.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.326+0000 7fc34c92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:42:56.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.326+0000 7fc34c92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:42:56.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.327+0000 7fc34c92c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.327+0000 7fc34c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.327+0000 7fc34c92c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.327+0000 7fc34c92c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:42:56.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.327+0000 7fc34c92c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.327+0000 7fc34c92c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:42:56.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.327+0000 7fc34c92c800 20 zone default found 2024-03-04T12:42:56.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.327+0000 7fc34c92c800 4 Realm: () 2024-03-04T12:42:56.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.327+0000 7fc34c92c800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:42:56.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.327+0000 7fc34c92c800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:42:56.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.327+0000 7fc34c92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:42:56.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.327+0000 7fc34c92c800 20 zonegroup default 2024-03-04T12:42:56.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.327+0000 7fc34c92c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.327+0000 7fc34c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.328+0000 7fc34c92c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.328+0000 7fc34c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.328+0000 7fc34c92c800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.328+0000 7fc34c92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.328+0000 7fc34c92c800 20 started sync module instance, tier type = 2024-03-04T12:42:56.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.328+0000 7fc34c92c800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:42:56.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.336+0000 7fc34c92c800 20 add_watcher() i=0 2024-03-04T12:42:56.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.336+0000 7fc34c92c800 20 add_watcher() i=1 2024-03-04T12:42:56.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.336+0000 7fc34c92c800 20 add_watcher() i=2 2024-03-04T12:42:56.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.336+0000 7fc34c92c800 20 add_watcher() i=3 2024-03-04T12:42:56.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.336+0000 7fc34c92c800 20 add_watcher() i=4 2024-03-04T12:42:56.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.336+0000 7fc34c92c800 20 add_watcher() i=5 2024-03-04T12:42:56.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.336+0000 7fc34c92c800 20 add_watcher() i=6 2024-03-04T12:42:56.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.337+0000 7fc34c92c800 20 add_watcher() i=7 2024-03-04T12:42:56.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.337+0000 7fc34c92c800 2 all 8 watchers are set, enabling cache 2024-03-04T12:42:56.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.339+0000 7fc1fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:42:56.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.339+0000 7fc34c92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:42:56.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.339+0000 7fc34c92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:42:56.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.372+0000 7fc1fd7e2640 20 reqs_thread_entry: start 2024-03-04T12:42:56.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.372+0000 7fc34c92c800 20 init_complete bucket index max shards: 11 2024-03-04T12:42:56.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.372+0000 7fc34c92c800 20 Filter name: none 2024-03-04T12:42:56.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.372+0000 7fc16effd640 20 reqs_thread_entry: start 2024-03-04T12:42:56.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.372+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:42:56.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.374+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.374+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.375+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.376+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:42:56.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.377+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.378+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.378+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.379+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:42:56.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.381+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.382+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.382+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.383+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:42:56.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.384+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.385+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.385+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.386+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:42:56.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.387+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.387+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.388+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.389+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:42:56.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.390+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.390+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.390+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.391+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:42:56.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.393+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.394+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.394+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.395+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:42:56.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.396+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.397+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.397+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.398+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:42:56.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.399+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.400+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.400+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.401+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:42:56.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.402+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.403+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.403+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.404+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:42:56.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.406+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.407+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.407+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.408+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:42:56.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.409+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.410+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.410+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.411+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:42:56.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.412+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.412+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.413+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.413+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:42:56.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.415+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.416+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.416+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.417+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:42:56.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.418+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.419+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.419+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.420+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:42:56.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.421+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.422+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.422+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.423+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:42:56.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.424+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.425+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.425+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.426+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:42:56.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.428+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.428+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.428+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.429+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:42:56.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.431+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.431+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.431+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.432+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:42:56.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.433+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.434+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.434+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.435+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:42:56.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.436+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.437+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.437+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.438+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:42:56.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.439+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.439+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.439+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.440+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:42:56.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.442+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.443+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.443+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.444+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:42:56.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.445+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.446+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.446+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.447+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:42:56.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.448+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.449+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.449+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.450+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:42:56.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.451+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.452+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.452+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.453+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:42:56.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.454+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.455+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.455+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.456+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:42:56.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.457+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.458+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.458+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.459+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:42:56.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.460+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.461+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.461+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.462+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:42:56.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.463+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.463+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.464+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.465+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:42:56.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.466+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.467+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.467+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.468+0000 7fc34c92c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:42:56.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.470+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.470+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.470+0000 7fc34c92c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.472+0000 7fc1fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:42:56.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.474+0000 7fc34c92c800 20 remove_watcher() i=0 2024-03-04T12:42:56.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.474+0000 7fc34c92c800 2 removed watcher, disabling cache 2024-03-04T12:42:56.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.475+0000 7fc34c92c800 20 remove_watcher() i=1 2024-03-04T12:42:56.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.476+0000 7fc34c92c800 20 remove_watcher() i=2 2024-03-04T12:42:56.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.477+0000 7fc34c92c800 20 remove_watcher() i=3 2024-03-04T12:42:56.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.478+0000 7fc34c92c800 20 remove_watcher() i=4 2024-03-04T12:42:56.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.479+0000 7fc34c92c800 20 remove_watcher() i=5 2024-03-04T12:42:56.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.480+0000 7fc34c92c800 20 remove_watcher() i=6 2024-03-04T12:42:56.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.481+0000 7fc34c92c800 20 remove_watcher() i=7 2024-03-04T12:42:56.497 DEBUG:teuthology.orchestra.run.smithi110:> radosgw-admin gc process --include-all 2024-03-04T12:42:56.546 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:42:56.546 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:42:56.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.573+0000 7f5deea0f800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.574+0000 7f5deea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.574+0000 7f5deea0f800 20 realm 2024-03-04T12:42:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.574+0000 7f5deea0f800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.574+0000 7f5deea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.574+0000 7f5deea0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:42:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.574+0000 7f5deea0f800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.574+0000 7f5deea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.574+0000 7f5deea0f800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.575+0000 7f5deea0f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:42:56.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.575+0000 7f5deea0f800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.575+0000 7f5deea0f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:42:56.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.575+0000 7f5deea0f800 20 searching for the correct realm 2024-03-04T12:42:56.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.579+0000 7f5debd0a640 0 -- 172.21.15.110:0/2641431661 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f5ddc029060 msgr2=0x7f5ddc088aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:42:56.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.582+0000 7f5debd0a640 0 -- 172.21.15.110:0/2641431661 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f5cb4079c50 msgr2=0x7f5cb407c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:42:56.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.585+0000 7f5deea0f800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:42:56.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.585+0000 7f5deea0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:42:56.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.585+0000 7f5deea0f800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:42:56.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.585+0000 7f5deea0f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:42:56.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.585+0000 7f5deea0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:42:56.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.585+0000 7f5deea0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:42:56.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.585+0000 7f5deea0f800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.586+0000 7f5deea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.586+0000 7f5deea0f800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.586+0000 7f5deea0f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:42:56.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.586+0000 7f5deea0f800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.586+0000 7f5deea0f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:42:56.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.586+0000 7f5deea0f800 20 zone default found 2024-03-04T12:42:56.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.586+0000 7f5deea0f800 4 Realm: () 2024-03-04T12:42:56.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.586+0000 7f5deea0f800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:42:56.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.586+0000 7f5deea0f800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:42:56.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.586+0000 7f5deea0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:42:56.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.586+0000 7f5deea0f800 20 zonegroup default 2024-03-04T12:42:56.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.586+0000 7f5deea0f800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.586+0000 7f5deea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.586+0000 7f5deea0f800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.587+0000 7f5deea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.587+0000 7f5deea0f800 20 rados->read ofs=0 len=0 2024-03-04T12:42:56.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.587+0000 7f5deea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:42:56.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.587+0000 7f5deea0f800 20 started sync module instance, tier type = 2024-03-04T12:42:56.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.587+0000 7f5deea0f800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:42:56.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.595+0000 7f5deea0f800 20 add_watcher() i=0 2024-03-04T12:42:56.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.595+0000 7f5deea0f800 20 add_watcher() i=1 2024-03-04T12:42:56.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.595+0000 7f5deea0f800 20 add_watcher() i=2 2024-03-04T12:42:56.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.595+0000 7f5deea0f800 20 add_watcher() i=3 2024-03-04T12:42:56.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.595+0000 7f5deea0f800 20 add_watcher() i=4 2024-03-04T12:42:56.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.595+0000 7f5deea0f800 20 add_watcher() i=5 2024-03-04T12:42:56.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.595+0000 7f5deea0f800 20 add_watcher() i=6 2024-03-04T12:42:56.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.596+0000 7f5deea0f800 20 add_watcher() i=7 2024-03-04T12:42:56.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.596+0000 7f5deea0f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:42:56.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.597+0000 7f5ca2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:42:56.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.598+0000 7f5deea0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:42:56.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.598+0000 7f5deea0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:42:56.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.630+0000 7f5ca1fdb640 20 reqs_thread_entry: start 2024-03-04T12:42:56.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.630+0000 7f5deea0f800 20 init_complete bucket index max shards: 11 2024-03-04T12:42:56.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.630+0000 7f5deea0f800 20 Filter name: none 2024-03-04T12:42:56.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.630+0000 7f5c137fe640 20 reqs_thread_entry: start 2024-03-04T12:42:56.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.630+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:42:56.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.631+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.632+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.632+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.633+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:42:56.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.635+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.636+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.636+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.637+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:42:56.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.639+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.639+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.639+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.641+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:42:56.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.642+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.643+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.643+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.644+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:42:56.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.645+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.646+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.646+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.647+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:42:56.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.648+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.648+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.649+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.650+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:42:56.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.651+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.652+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.652+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.653+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:42:56.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.654+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.655+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.655+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.656+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:42:56.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.658+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.658+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.658+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.659+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:42:56.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.661+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.661+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.661+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.662+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:42:56.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.664+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.664+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.664+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.665+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:42:56.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.666+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.667+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.667+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.668+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:42:56.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.669+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.670+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.670+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.671+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:42:56.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.672+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.673+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.673+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.674+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:42:56.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.675+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.676+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.676+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.677+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:42:56.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.678+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.679+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.679+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.680+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:42:56.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.682+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.682+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.682+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.683+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:42:56.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.684+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.685+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.685+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.686+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:42:56.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.687+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.688+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.688+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.689+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:42:56.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.690+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.691+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.691+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.692+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:42:56.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.694+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.694+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.694+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.695+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:42:56.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.697+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.697+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.697+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.698+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:42:56.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.700+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.700+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.700+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.701+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:42:56.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.703+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.703+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.703+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.704+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:42:56.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.706+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.707+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.707+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.708+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:42:56.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.709+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.710+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.710+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.711+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:42:56.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.712+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.713+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.713+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.714+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:42:56.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.715+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.716+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.716+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.717+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:42:56.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.718+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.719+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.719+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.720+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:42:56.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.721+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.722+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.722+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.723+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:42:56.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.724+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.725+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.725+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.726+0000 7f5deea0f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:42:56.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.727+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.728+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:42:56.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.728+0000 7f5deea0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:42:56.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.730+0000 7f5ca2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:42:56.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.732+0000 7f5deea0f800 20 remove_watcher() i=0 2024-03-04T12:42:56.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.732+0000 7f5deea0f800 2 removed watcher, disabling cache 2024-03-04T12:42:56.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.733+0000 7f5deea0f800 20 remove_watcher() i=1 2024-03-04T12:42:56.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.734+0000 7f5deea0f800 20 remove_watcher() i=2 2024-03-04T12:42:56.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.735+0000 7f5deea0f800 20 remove_watcher() i=3 2024-03-04T12:42:56.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.736+0000 7f5deea0f800 20 remove_watcher() i=4 2024-03-04T12:42:56.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.737+0000 7f5deea0f800 20 remove_watcher() i=5 2024-03-04T12:42:56.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.737+0000 7f5deea0f800 20 remove_watcher() i=6 2024-03-04T12:42:56.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:42:56.738+0000 7f5deea0f800 20 remove_watcher() i=7 2024-03-04T12:42:56.754 DEBUG:teuthology.orchestra.run.smithi110:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-03-04T12:42:57.259 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :clean 2024-03-04T12:42:57.955 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :compileJava 2024-03-04T12:42:57.955 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :processResources 2024-03-04T12:42:57.955 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :classes 2024-03-04T12:42:58.455 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:58.456 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :compileTestJava 2024-03-04T12:42:58.456 INFO:teuthology.orchestra.run.smithi110.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-03-04T12:42:58.456 INFO:teuthology.orchestra.run.smithi110.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-03-04T12:42:58.457 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:42:58.457 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :processTestResources NO-SOURCE 2024-03-04T12:42:58.457 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :testClasses 2024-03-04T12:43:00.456 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:00.456 INFO:teuthology.orchestra.run.smithi110.stdout:> Task :test 2024-03-04T12:43:00.456 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:00.456 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests STANDARD_OUT 2024-03-04T12:43:00.456 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04 12:42:59,615 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-03-04T12:43:00.456 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:00.456 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-03-04T12:43:00.456 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:00.456 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-03-04T12:43:00.754 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:00.755 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-03-04T12:43:00.854 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:00.855 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-03-04T12:43:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:01.155 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-03-04T12:43:01.254 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:01.255 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-03-04T12:43:01.654 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:01.655 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-03-04T12:43:06.555 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:06.555 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-03-04T12:43:06.954 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:06.955 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-03-04T12:43:07.055 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:07.055 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-03-04T12:43:07.354 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:07.355 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-03-04T12:43:07.554 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:07.555 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-03-04T12:43:07.955 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:07.955 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-03-04T12:43:07.955 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:07.955 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-03-04T12:43:08.055 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:08.055 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-03-04T12:43:08.055 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:08.055 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-03-04T12:43:08.454 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:08.455 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-03-04T12:43:13.655 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:13.655 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-03-04T12:43:13.954 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:13.955 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-03-04T12:43:14.155 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:14.155 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-03-04T12:43:14.755 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:14.755 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-03-04T12:43:14.855 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:14.855 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-03-04T12:43:15.254 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:15.254 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-03-04T12:43:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:15.355 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-03-04T12:43:15.654 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:15.655 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-03-04T12:43:15.754 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:15.754 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-03-04T12:43:16.055 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:16.055 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-03-04T12:43:16.254 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:16.255 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-03-04T12:43:16.554 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:16.555 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-03-04T12:43:16.654 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:16.655 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-03-04T12:43:16.954 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:16.955 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-03-04T12:43:17.154 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:17.155 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-03-04T12:43:17.554 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:17.554 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-03-04T12:43:22.855 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:22.855 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-03-04T12:43:23.554 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:43:23.555 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-03-04T12:44:09.655 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:09.656 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-03-04T12:44:10.355 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:10.355 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-03-04T12:44:10.355 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:10.355 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-03-04T12:44:10.754 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:10.754 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-03-04T12:44:10.854 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:10.854 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-03-04T12:44:11.354 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:11.355 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-03-04T12:44:25.155 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:25.155 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-03-04T12:44:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:25.555 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-03-04T12:44:25.555 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:25.555 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-03-04T12:44:25.654 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:25.655 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-03-04T12:44:32.755 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:32.755 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-03-04T12:44:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:35.055 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests STANDARD_OUT 2024-03-04T12:44:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04 12:44:34,950 [s3-transfer-manager-worker-7] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-03-04T12:44:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04 12:44:34,959 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-03-04T12:44:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04 12:44:34,961 [s3-transfer-manager-worker-1] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-03-04T12:44:35.055 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04 12:44:34,970 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-03-04T12:44:35.254 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:35.255 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-03-04T12:44:45.655 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:45.655 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-03-04T12:44:46.054 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:46.054 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-03-04T12:44:50.855 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:50.855 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-03-04T12:44:51.254 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:44:51.255 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-03-04T12:45:20.355 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:20.355 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-03-04T12:45:20.755 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:20.755 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-03-04T12:45:28.555 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:28.555 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-03-04T12:45:28.855 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:28.855 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-03-04T12:45:34.254 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:34.255 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-03-04T12:45:34.654 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:34.655 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-03-04T12:45:37.254 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:37.255 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-03-04T12:45:44.454 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:44.455 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-03-04T12:45:44.554 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:44.555 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-03-04T12:45:44.655 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:44.655 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-03-04T12:45:44.855 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:44.855 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-03-04T12:45:46.755 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:46.755 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-03-04T12:45:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:46.855 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-03-04T12:45:47.154 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:47.155 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-03-04T12:45:47.254 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:47.255 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-03-04T12:45:47.654 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:47.655 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-03-04T12:45:47.655 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:47.655 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-03-04T12:45:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:48.055 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-03-04T12:45:48.154 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:48.154 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-03-04T12:45:48.454 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:48.455 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-03-04T12:45:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:48.555 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-03-04T12:45:48.954 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:48.955 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-03-04T12:45:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:49.156 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-03-04T12:45:49.554 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:49.555 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-03-04T12:45:49.754 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:49.754 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-03-04T12:45:50.154 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:50.155 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-03-04T12:45:50.355 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:50.355 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-03-04T12:45:50.854 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:50.855 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-03-04T12:45:51.054 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:51.055 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-03-04T12:45:51.454 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:51.454 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-03-04T12:45:51.654 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:51.654 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-03-04T12:45:52.054 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:52.055 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-03-04T12:45:52.255 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:52.255 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-03-04T12:45:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:52.755 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-03-04T12:45:52.954 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:52.955 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-03-04T12:45:53.354 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:53.354 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-03-04T12:45:53.554 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:53.554 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-03-04T12:45:53.954 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:53.955 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-03-04T12:45:54.155 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:54.155 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-03-04T12:45:54.654 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:54.655 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-03-04T12:45:54.854 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:54.855 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-03-04T12:45:55.254 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:55.255 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-03-04T12:45:55.454 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:55.455 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-03-04T12:45:55.855 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:55.855 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-03-04T12:45:56.055 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:56.055 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-03-04T12:45:56.454 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:56.454 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-03-04T12:45:56.654 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:56.654 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-03-04T12:45:57.054 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:57.055 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-03-04T12:45:57.255 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:57.255 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-03-04T12:45:57.654 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:57.655 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-03-04T12:45:57.854 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:57.854 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-03-04T12:45:58.354 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:58.354 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-03-04T12:45:58.555 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:58.555 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-03-04T12:45:58.954 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:58.954 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-03-04T12:45:59.154 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:59.155 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-03-04T12:45:59.555 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:59.555 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-03-04T12:45:59.754 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:45:59.754 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-03-04T12:46:00.254 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:00.254 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-03-04T12:46:00.354 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:00.354 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-03-04T12:46:00.754 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:00.755 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-03-04T12:46:00.954 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:00.955 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-03-04T12:46:01.355 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:01.355 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-03-04T12:46:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:01.555 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-03-04T12:46:01.954 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:01.954 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-03-04T12:46:02.154 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:02.155 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-03-04T12:46:02.554 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:02.555 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-03-04T12:46:02.655 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:02.655 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-03-04T12:46:02.954 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:02.955 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-03-04T12:46:03.055 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:03.055 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-03-04T12:46:03.454 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:03.455 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-03-04T12:46:03.455 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:03.455 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-03-04T12:46:03.854 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:03.855 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-03-04T12:46:03.955 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:03.955 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-03-04T12:46:04.354 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:04.355 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-03-04T12:46:04.654 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:04.654 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-03-04T12:46:04.955 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:04.955 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-03-04T12:46:04.955 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:04.955 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-03-04T12:46:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:05.054 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-03-04T12:46:05.254 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:05.254 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-03-04T12:46:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:05.555 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-03-04T12:46:05.655 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:05.655 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-03-04T12:46:06.054 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:06.055 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-03-04T12:46:06.454 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:06.455 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-03-04T12:46:06.855 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:06.855 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-03-04T12:46:06.954 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:06.954 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-03-04T12:46:07.254 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:07.255 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-03-04T12:46:12.454 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:12.455 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-03-04T12:46:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:12.855 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-03-04T12:46:18.055 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:18.055 INFO:teuthology.orchestra.run.smithi110.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-03-04T12:46:18.455 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:18.455 INFO:teuthology.orchestra.run.smithi110.stdout:---------------------------------------------------------------------- 2024-03-04T12:46:18.455 INFO:teuthology.orchestra.run.smithi110.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-03-04T12:46:18.455 INFO:teuthology.orchestra.run.smithi110.stdout:---------------------------------------------------------------------- 2024-03-04T12:46:18.466 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:18.466 INFO:teuthology.orchestra.run.smithi110.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-03-04T12:46:18.466 INFO:teuthology.orchestra.run.smithi110.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-03-04T12:46:18.466 INFO:teuthology.orchestra.run.smithi110.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-03-04T12:46:18.466 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:18.466 INFO:teuthology.orchestra.run.smithi110.stdout:BUILD SUCCESSFUL in 3m 21s 2024-03-04T12:46:18.466 INFO:teuthology.orchestra.run.smithi110.stdout:5 actionable tasks: 5 executed 2024-03-04T12:46:18.471 DEBUG:teuthology.orchestra.run.smithi110:> radosgw-admin gc process --include-all 2024-03-04T12:46:18.520 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:18.521 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:18.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.547+0000 7ffb21939800 20 rados->read ofs=0 len=0 2024-03-04T12:46:18.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.548+0000 7ffb21939800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:18.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.548+0000 7ffb21939800 20 realm 2024-03-04T12:46:18.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.548+0000 7ffb21939800 20 rados->read ofs=0 len=0 2024-03-04T12:46:18.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.548+0000 7ffb21939800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:18.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.548+0000 7ffb21939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:18.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.548+0000 7ffb21939800 20 rados->read ofs=0 len=0 2024-03-04T12:46:18.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.548+0000 7ffb21939800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:18.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.548+0000 7ffb21939800 20 rados->read ofs=0 len=0 2024-03-04T12:46:18.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.549+0000 7ffb21939800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:18.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.549+0000 7ffb21939800 20 rados->read ofs=0 len=0 2024-03-04T12:46:18.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.549+0000 7ffb21939800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:18.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.549+0000 7ffb21939800 20 searching for the correct realm 2024-03-04T12:46:18.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.552+0000 7ffb1dece640 0 -- 172.21.15.110:0/974768212 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7ffb080741f0 msgr2=0x7ffb080858c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:18.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.556+0000 7ffb1d6cd640 0 -- 172.21.15.110:0/974768212 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7ffb0805e070 msgr2=0x7ffb0804af40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:18.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.761+0000 7ffb21939800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:46:18.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.761+0000 7ffb21939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:18.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.761+0000 7ffb21939800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:46:18.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.761+0000 7ffb21939800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:18.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.761+0000 7ffb21939800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:18.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.761+0000 7ffb21939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:18.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.761+0000 7ffb21939800 20 rados->read ofs=0 len=0 2024-03-04T12:46:18.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.762+0000 7ffb21939800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:18.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.762+0000 7ffb21939800 20 rados->read ofs=0 len=0 2024-03-04T12:46:18.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.762+0000 7ffb21939800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:18.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.762+0000 7ffb21939800 20 rados->read ofs=0 len=0 2024-03-04T12:46:18.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.762+0000 7ffb21939800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:18.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.762+0000 7ffb21939800 20 zone default found 2024-03-04T12:46:18.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.762+0000 7ffb21939800 4 Realm: () 2024-03-04T12:46:18.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.762+0000 7ffb21939800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:46:18.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.762+0000 7ffb21939800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:46:18.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.762+0000 7ffb21939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:18.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.762+0000 7ffb21939800 20 zonegroup default 2024-03-04T12:46:18.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.762+0000 7ffb21939800 20 rados->read ofs=0 len=0 2024-03-04T12:46:18.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.762+0000 7ffb21939800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:18.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.763+0000 7ffb21939800 20 rados->read ofs=0 len=0 2024-03-04T12:46:18.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.763+0000 7ffb21939800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:18.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.763+0000 7ffb21939800 20 rados->read ofs=0 len=0 2024-03-04T12:46:18.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.763+0000 7ffb21939800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:18.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.763+0000 7ffb21939800 20 started sync module instance, tier type = 2024-03-04T12:46:18.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.763+0000 7ffb21939800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:46:18.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.772+0000 7ffb21939800 20 add_watcher() i=0 2024-03-04T12:46:18.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.772+0000 7ffb21939800 20 add_watcher() i=1 2024-03-04T12:46:18.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.772+0000 7ffb21939800 20 add_watcher() i=2 2024-03-04T12:46:18.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.772+0000 7ffb21939800 20 add_watcher() i=3 2024-03-04T12:46:18.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.772+0000 7ffb21939800 20 add_watcher() i=4 2024-03-04T12:46:18.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.772+0000 7ffb21939800 20 add_watcher() i=5 2024-03-04T12:46:18.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.772+0000 7ffb21939800 20 add_watcher() i=6 2024-03-04T12:46:18.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.773+0000 7ffb21939800 20 add_watcher() i=7 2024-03-04T12:46:18.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.773+0000 7ffb21939800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:18.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.775+0000 7ff9d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:18.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.776+0000 7ffb21939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:18.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.776+0000 7ffb21939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:18.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.812+0000 7ff9d27e4640 20 reqs_thread_entry: start 2024-03-04T12:46:18.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.812+0000 7ffb21939800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:18.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.812+0000 7ffb21939800 20 Filter name: none 2024-03-04T12:46:18.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.812+0000 7ff943fff640 20 reqs_thread_entry: start 2024-03-04T12:46:18.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.812+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:46:18.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.814+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.814+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.814+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.815+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:46:18.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.817+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.818+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.818+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:46:18.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.818+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11864969441487968390', time=2024-03-04T14:43:45.257370+0000, chain.objs.size()=5 2024-03-04T12:46:18.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.818+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~IGb24A5wlO2w0Ut-sB5JY4NiPy4Dt-I.1 2024-03-04T12:46:18.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.818+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~IGb24A5wlO2w0Ut-sB5JY4NiPy4Dt-I.2 2024-03-04T12:46:18.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.818+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~IGb24A5wlO2w0Ut-sB5JY4NiPy4Dt-I.3 2024-03-04T12:46:18.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.818+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~IGb24A5wlO2w0Ut-sB5JY4NiPy4Dt-I.4 2024-03-04T12:46:18.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.818+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~IGb24A5wlO2w0Ut-sB5JY4NiPy4Dt-I.5 2024-03-04T12:46:18.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.818+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11630298260693860117', time=2024-03-04T14:43:56.191346+0000, chain.objs.size()=5 2024-03-04T12:46:18.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.818+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~l8zfJH_xoApBlFFBkzp5ZMI_5FllApr.1 2024-03-04T12:46:18.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.818+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~l8zfJH_xoApBlFFBkzp5ZMI_5FllApr.2 2024-03-04T12:46:18.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.818+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~l8zfJH_xoApBlFFBkzp5ZMI_5FllApr.3 2024-03-04T12:46:18.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.818+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~l8zfJH_xoApBlFFBkzp5ZMI_5FllApr.4 2024-03-04T12:46:18.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.818+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~l8zfJH_xoApBlFFBkzp5ZMI_5FllApr.5 2024-03-04T12:46:18.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.823+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:18.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.826+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:46:18.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.827+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.827+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.828+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:46:18.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.828+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8154029441151658958', time=2024-03-04T14:44:09.741269+0000, chain.objs.size()=4 2024-03-04T12:46:18.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.828+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.83__shadow_.jGsRREPjhuNfLclaxOd08lu72piNJ-z_1 2024-03-04T12:46:18.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.828+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.83__shadow_.jGsRREPjhuNfLclaxOd08lu72piNJ-z_2 2024-03-04T12:46:18.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.828+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.83__shadow_.jGsRREPjhuNfLclaxOd08lu72piNJ-z_3 2024-03-04T12:46:18.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.828+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.83__shadow_.jGsRREPjhuNfLclaxOd08lu72piNJ-z_4 2024-03-04T12:46:18.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.828+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.6995534435739393564', time=2024-03-04T14:46:18.147797+0000, chain.objs.size()=5 2024-03-04T12:46:18.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.828+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.134__multipart_key1/data/file.mpg.2~cnTtmJI12pzxKDu4DpwYXDKCEeC7Jt0.1 2024-03-04T12:46:18.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.828+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.134__multipart_key1/data/file.mpg.2~cnTtmJI12pzxKDu4DpwYXDKCEeC7Jt0.2 2024-03-04T12:46:18.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.828+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.134__multipart_key1/data/file.mpg.2~cnTtmJI12pzxKDu4DpwYXDKCEeC7Jt0.3 2024-03-04T12:46:18.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.828+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.134__multipart_key1/data/file.mpg.2~cnTtmJI12pzxKDu4DpwYXDKCEeC7Jt0.4 2024-03-04T12:46:18.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.828+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.134__multipart_key1/data/file.mpg.2~cnTtmJI12pzxKDu4DpwYXDKCEeC7Jt0.5 2024-03-04T12:46:18.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.833+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:18.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.835+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:46:18.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.836+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.837+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.837+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:46:18.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.837+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14545623393912114917', time=2024-03-04T14:45:10.924564+0000, chain.objs.size()=5 2024-03-04T12:46:18.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.837+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~r6Ly-IXuCxU_uk3wKT0mXO0VA9KbqzV.1 2024-03-04T12:46:18.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.837+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~r6Ly-IXuCxU_uk3wKT0mXO0VA9KbqzV.2 2024-03-04T12:46:18.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.837+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~r6Ly-IXuCxU_uk3wKT0mXO0VA9KbqzV.3 2024-03-04T12:46:18.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.837+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~r6Ly-IXuCxU_uk3wKT0mXO0VA9KbqzV.4 2024-03-04T12:46:18.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.837+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~r6Ly-IXuCxU_uk3wKT0mXO0VA9KbqzV.5 2024-03-04T12:46:18.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.842+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:18.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.844+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:46:18.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.845+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.846+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.846+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:46:18.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.846+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16320351256502080207', time=2024-03-04T14:43:13.710154+0000, chain.objs.size()=2 2024-03-04T12:46:18.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.846+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.73__shadow_.pnr4vdzZ8vHP-SqlRBzOm43q3lZ-k-a_1 2024-03-04T12:46:18.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.846+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.73__shadow_.pnr4vdzZ8vHP-SqlRBzOm43q3lZ-k-a_2 2024-03-04T12:46:18.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.846+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7940210659410010534', time=2024-03-04T14:45:20.251746+0000, chain.objs.size()=5 2024-03-04T12:46:18.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.846+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~8_wEmR-Qslm8x0F8CNLR_lg4-s3-rRy.1 2024-03-04T12:46:18.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.846+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__shadow_key1.2~8_wEmR-Qslm8x0F8CNLR_lg4-s3-rRy.1_1 2024-03-04T12:46:18.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.846+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~8_wEmR-Qslm8x0F8CNLR_lg4-s3-rRy.2 2024-03-04T12:46:18.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.846+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__shadow_key1.2~8_wEmR-Qslm8x0F8CNLR_lg4-s3-rRy.2_1 2024-03-04T12:46:18.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.846+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~8_wEmR-Qslm8x0F8CNLR_lg4-s3-rRy.3 2024-03-04T12:46:18.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.851+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:18.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.853+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:46:18.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.854+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.855+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.855+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:46:18.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.855+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10824047180316533055', time=2024-03-04T14:44:10.020168+0000, chain.objs.size()=5 2024-03-04T12:46:18.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.855+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~WGNvOkhwwOHY9gHPTfE0cuE_bblnYn9.1 2024-03-04T12:46:18.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.855+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__shadow_key1.2~WGNvOkhwwOHY9gHPTfE0cuE_bblnYn9.1_1 2024-03-04T12:46:18.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.855+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~WGNvOkhwwOHY9gHPTfE0cuE_bblnYn9.2 2024-03-04T12:46:18.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.855+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__shadow_key1.2~WGNvOkhwwOHY9gHPTfE0cuE_bblnYn9.2_1 2024-03-04T12:46:18.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.855+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~WGNvOkhwwOHY9gHPTfE0cuE_bblnYn9.3 2024-03-04T12:46:18.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.858+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:18.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.860+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:46:18.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.861+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.862+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.862+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:46:18.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.862+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.222540610017010880', time=2024-03-04T14:44:25.224614+0000, chain.objs.size()=5 2024-03-04T12:46:18.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.862+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.88__multipart_key1.2~bNAJTzJ3zEGRVp-KswS7GNExgD9Zgg6.1 2024-03-04T12:46:18.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.862+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.88__multipart_key1.2~bNAJTzJ3zEGRVp-KswS7GNExgD9Zgg6.2 2024-03-04T12:46:18.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.862+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.88__multipart_key1.2~bNAJTzJ3zEGRVp-KswS7GNExgD9Zgg6.3 2024-03-04T12:46:18.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.862+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.88__multipart_key1.2~bNAJTzJ3zEGRVp-KswS7GNExgD9Zgg6.4 2024-03-04T12:46:18.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.862+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.88__multipart_key1.2~bNAJTzJ3zEGRVp-KswS7GNExgD9Zgg6.5 2024-03-04T12:46:18.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.865+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:18.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.867+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:46:18.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.868+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.869+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.869+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.870+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:46:18.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.871+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.872+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.872+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.873+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:46:18.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.874+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.874+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.875+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:46:18.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.875+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='2~oM_kSSVpHloGZCauRQJzcclcXksNDAy', time=2024-03-04T14:43:06.510950+0000, chain.objs.size()=5 2024-03-04T12:46:18.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.875+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.69__multipart_key1.2~oM_kSSVpHloGZCauRQJzcclcXksNDAy.1 2024-03-04T12:46:18.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.875+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.69__multipart_key1.2~oM_kSSVpHloGZCauRQJzcclcXksNDAy.2 2024-03-04T12:46:18.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.875+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.69__multipart_key1.2~oM_kSSVpHloGZCauRQJzcclcXksNDAy.3 2024-03-04T12:46:18.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.875+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.69__multipart_key1.2~oM_kSSVpHloGZCauRQJzcclcXksNDAy.4 2024-03-04T12:46:18.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.875+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.69__multipart_key1.2~oM_kSSVpHloGZCauRQJzcclcXksNDAy.5 2024-03-04T12:46:18.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.875+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.1545710386911335772', time=2024-03-04T14:46:12.538238+0000, chain.objs.size()=5 2024-03-04T12:46:18.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.875+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.133__multipart_key1.2~9uO2PKaxqZOVxC88knVvFRY5LRuCbT7.1 2024-03-04T12:46:18.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.875+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.133__multipart_key1.2~9uO2PKaxqZOVxC88knVvFRY5LRuCbT7.2 2024-03-04T12:46:18.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.875+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.133__multipart_key1.2~9uO2PKaxqZOVxC88knVvFRY5LRuCbT7.3 2024-03-04T12:46:18.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.875+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.133__multipart_key1.2~9uO2PKaxqZOVxC88knVvFRY5LRuCbT7.4 2024-03-04T12:46:18.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.875+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.133__multipart_key1.2~9uO2PKaxqZOVxC88knVvFRY5LRuCbT7.5 2024-03-04T12:46:18.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.879+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:18.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.882+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:46:18.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.884+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.884+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.885+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:46:18.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.885+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5877905713257585005', time=2024-03-04T14:45:01.349969+0000, chain.objs.size()=5 2024-03-04T12:46:18.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.885+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~90tIBeCIMmUhE_mO9aOpN_y8e1z2RwA.1 2024-03-04T12:46:18.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.885+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~90tIBeCIMmUhE_mO9aOpN_y8e1z2RwA.2 2024-03-04T12:46:18.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.885+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~90tIBeCIMmUhE_mO9aOpN_y8e1z2RwA.3 2024-03-04T12:46:18.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.885+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~90tIBeCIMmUhE_mO9aOpN_y8e1z2RwA.4 2024-03-04T12:46:18.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.885+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~90tIBeCIMmUhE_mO9aOpN_y8e1z2RwA.5 2024-03-04T12:46:18.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.888+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:18.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.890+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:46:18.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.891+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.892+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.892+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.893+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:46:18.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.894+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.895+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.895+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:46:18.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.895+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3462612161928085727', time=2024-03-04T14:44:07.154950+0000, chain.objs.size()=5 2024-03-04T12:46:18.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.895+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~pZZj7_jAWe1ytoesIWTVDSt_NskKrw1.1 2024-03-04T12:46:18.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.895+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__shadow_key1.2~pZZj7_jAWe1ytoesIWTVDSt_NskKrw1.1_1 2024-03-04T12:46:18.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.895+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~pZZj7_jAWe1ytoesIWTVDSt_NskKrw1.2 2024-03-04T12:46:18.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.895+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__shadow_key1.2~pZZj7_jAWe1ytoesIWTVDSt_NskKrw1.2_1 2024-03-04T12:46:18.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.895+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~pZZj7_jAWe1ytoesIWTVDSt_NskKrw1.3 2024-03-04T12:46:18.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.898+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:18.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.900+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:46:18.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.901+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.901+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.902+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:46:18.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.902+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11970211180144403948', time=2024-03-04T14:44:45.684329+0000, chain.objs.size()=5 2024-03-04T12:46:18.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.902+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.90__multipart_file.mpg.2~rmkb2izYFpnLQPJJ1bXvWdlL3jyzsso.1 2024-03-04T12:46:18.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.902+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.90__multipart_file.mpg.2~rmkb2izYFpnLQPJJ1bXvWdlL3jyzsso.2 2024-03-04T12:46:18.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.902+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.90__multipart_file.mpg.2~rmkb2izYFpnLQPJJ1bXvWdlL3jyzsso.3 2024-03-04T12:46:18.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.902+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.90__multipart_file.mpg.2~rmkb2izYFpnLQPJJ1bXvWdlL3jyzsso.4 2024-03-04T12:46:18.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.902+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.90__multipart_file.mpg.2~rmkb2izYFpnLQPJJ1bXvWdlL3jyzsso.5 2024-03-04T12:46:18.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.905+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:18.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.907+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:46:18.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.908+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.909+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.909+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.910+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:46:18.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.911+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.912+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.912+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.913+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:46:18.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.914+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.915+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.915+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:46:18.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.915+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.4167552889778510555', time=2024-03-04T14:44:34.697691+0000, chain.objs.size()=5 2024-03-04T12:46:18.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.915+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.89__multipart_key1.2~4bYpGEEM-S3bj8Fbqt2Hsd_blYqBNOo.1 2024-03-04T12:46:18.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.915+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.89__multipart_key1.2~4bYpGEEM-S3bj8Fbqt2Hsd_blYqBNOo.2 2024-03-04T12:46:18.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.915+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.89__multipart_key1.2~4bYpGEEM-S3bj8Fbqt2Hsd_blYqBNOo.3 2024-03-04T12:46:18.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.915+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.89__multipart_key1.2~4bYpGEEM-S3bj8Fbqt2Hsd_blYqBNOo.4 2024-03-04T12:46:18.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.915+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.89__multipart_key1.2~4bYpGEEM-S3bj8Fbqt2Hsd_blYqBNOo.5 2024-03-04T12:46:18.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.919+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:18.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.921+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:46:18.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.922+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.922+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.922+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:46:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.922+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.873117104048858307', time=2024-03-04T14:44:45.733868+0000, chain.objs.size()=5 2024-03-04T12:46:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.922+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.90__multipart_file2.mpg.2~CDBW3jg7IlRf2aYsZvKDJOd_IgYGBmo.1 2024-03-04T12:46:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.922+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.90__multipart_file2.mpg.2~CDBW3jg7IlRf2aYsZvKDJOd_IgYGBmo.2 2024-03-04T12:46:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.922+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.90__multipart_file2.mpg.2~CDBW3jg7IlRf2aYsZvKDJOd_IgYGBmo.3 2024-03-04T12:46:18.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.922+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.90__multipart_file2.mpg.2~CDBW3jg7IlRf2aYsZvKDJOd_IgYGBmo.4 2024-03-04T12:46:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.922+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.90__multipart_file2.mpg.2~CDBW3jg7IlRf2aYsZvKDJOd_IgYGBmo.5 2024-03-04T12:46:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.922+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3555599322393765407', time=2024-03-04T14:45:15.594267+0000, chain.objs.size()=5 2024-03-04T12:46:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.922+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~m4m_NYz1ohpRQ37mCn0EQoaFd2KipfV.1 2024-03-04T12:46:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.922+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__shadow_key1.2~m4m_NYz1ohpRQ37mCn0EQoaFd2KipfV.1_1 2024-03-04T12:46:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.922+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~m4m_NYz1ohpRQ37mCn0EQoaFd2KipfV.2 2024-03-04T12:46:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.922+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__shadow_key1.2~m4m_NYz1ohpRQ37mCn0EQoaFd2KipfV.2_1 2024-03-04T12:46:18.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.922+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~m4m_NYz1ohpRQ37mCn0EQoaFd2KipfV.3 2024-03-04T12:46:18.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.926+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:18.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.928+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:46:18.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.929+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.930+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.930+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.931+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:46:18.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.932+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.933+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.933+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.934+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:46:18.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.935+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.936+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.936+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:46:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.936+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5238017943166103570', time=2024-03-04T14:43:42.544271+0000, chain.objs.size()=5 2024-03-04T12:46:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.936+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~7rZ0OlEk-DnXT63M2CrnSHz46oeIMTd.1 2024-03-04T12:46:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.936+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~7rZ0OlEk-DnXT63M2CrnSHz46oeIMTd.2 2024-03-04T12:46:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.936+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~7rZ0OlEk-DnXT63M2CrnSHz46oeIMTd.3 2024-03-04T12:46:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.936+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~7rZ0OlEk-DnXT63M2CrnSHz46oeIMTd.4 2024-03-04T12:46:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.936+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~7rZ0OlEk-DnXT63M2CrnSHz46oeIMTd.5 2024-03-04T12:46:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.936+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17583101327192598985', time=2024-03-04T14:45:34.321543+0000, chain.objs.size()=5 2024-03-04T12:46:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.936+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.94__multipart_key1.2~xA2ViZptuMZDTXN14tlR8qOQscByh0H.1 2024-03-04T12:46:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.936+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.94__multipart_key1.2~xA2ViZptuMZDTXN14tlR8qOQscByh0H.2 2024-03-04T12:46:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.936+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.94__multipart_key1.2~xA2ViZptuMZDTXN14tlR8qOQscByh0H.3 2024-03-04T12:46:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.936+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.94__multipart_key1.2~xA2ViZptuMZDTXN14tlR8qOQscByh0H.4 2024-03-04T12:46:18.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.936+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.94__multipart_key1.2~xA2ViZptuMZDTXN14tlR8qOQscByh0H.5 2024-03-04T12:46:18.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.941+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:18.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.943+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:46:18.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.944+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.945+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.945+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.946+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:46:18.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.947+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.948+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.948+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.949+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:46:18.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.950+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.951+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.951+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.952+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:46:18.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.953+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.954+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.954+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:46:18.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.954+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16601929654033790412', time=2024-03-04T14:44:09.545086+0000, chain.objs.size()=5 2024-03-04T12:46:18.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.954+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~KOfTGQRh9ik1nKuY_bfQKifeIkvWtZk.1 2024-03-04T12:46:18.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.954+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__shadow_key1.2~KOfTGQRh9ik1nKuY_bfQKifeIkvWtZk.1_1 2024-03-04T12:46:18.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.954+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~KOfTGQRh9ik1nKuY_bfQKifeIkvWtZk.2 2024-03-04T12:46:18.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.954+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__shadow_key1.2~KOfTGQRh9ik1nKuY_bfQKifeIkvWtZk.2_1 2024-03-04T12:46:18.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.954+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.84__multipart_key1.2~KOfTGQRh9ik1nKuY_bfQKifeIkvWtZk.3 2024-03-04T12:46:18.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.957+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:18.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.959+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:46:18.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.962+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.963+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.963+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T12:46:18.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.963+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7219867549352121209', time=2024-03-04T14:45:20.443347+0000, chain.objs.size()=5 2024-03-04T12:46:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.963+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~u6FxJrXRkUzWKItPZEzoVGWDBATtKju.1 2024-03-04T12:46:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.963+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__shadow_key1.2~u6FxJrXRkUzWKItPZEzoVGWDBATtKju.1_1 2024-03-04T12:46:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.963+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~u6FxJrXRkUzWKItPZEzoVGWDBATtKju.2 2024-03-04T12:46:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.963+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__shadow_key1.2~u6FxJrXRkUzWKItPZEzoVGWDBATtKju.2_1 2024-03-04T12:46:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.963+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~u6FxJrXRkUzWKItPZEzoVGWDBATtKju.3 2024-03-04T12:46:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.963+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu', time=2024-03-04T14:45:42.451599+0000, chain.objs.size()=40 2024-03-04T12:46:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.963+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.1 2024-03-04T12:46:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.963+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.2 2024-03-04T12:46:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.963+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.3 2024-03-04T12:46:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.963+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.4 2024-03-04T12:46:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.963+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.5 2024-03-04T12:46:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.963+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.6 2024-03-04T12:46:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.963+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.7 2024-03-04T12:46:18.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.967+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.8 2024-03-04T12:46:18.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.967+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.9 2024-03-04T12:46:18.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.967+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.10 2024-03-04T12:46:18.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.967+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.11 2024-03-04T12:46:18.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.967+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.12 2024-03-04T12:46:18.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.967+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.13 2024-03-04T12:46:18.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.967+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.14 2024-03-04T12:46:18.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.967+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.15 2024-03-04T12:46:18.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.967+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.16 2024-03-04T12:46:18.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.967+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.17 2024-03-04T12:46:18.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.967+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.18 2024-03-04T12:46:18.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.968+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.19 2024-03-04T12:46:18.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.968+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.20 2024-03-04T12:46:18.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.969+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.21 2024-03-04T12:46:18.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.969+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.22 2024-03-04T12:46:18.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.969+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.23 2024-03-04T12:46:18.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.969+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.24 2024-03-04T12:46:18.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.969+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.25 2024-03-04T12:46:18.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.970+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.26 2024-03-04T12:46:18.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.970+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.27 2024-03-04T12:46:18.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.970+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.28 2024-03-04T12:46:18.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.970+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.29 2024-03-04T12:46:18.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.970+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.30 2024-03-04T12:46:18.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.970+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.31 2024-03-04T12:46:18.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.971+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.32 2024-03-04T12:46:18.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.972+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.33 2024-03-04T12:46:18.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.972+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.34 2024-03-04T12:46:18.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.972+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.35 2024-03-04T12:46:18.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.972+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.36 2024-03-04T12:46:18.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.972+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.37 2024-03-04T12:46:18.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.972+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.38 2024-03-04T12:46:18.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.972+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.39 2024-03-04T12:46:18.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.972+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.95__multipart_key1.2~GGSXKqnJVQGDZ4wMT3gfwom3PPoyDcu.40 2024-03-04T12:46:18.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.974+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:18.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.976+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:46:18.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.977+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.978+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.978+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:46:18.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.978+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13648370725545551451', time=2024-03-04T14:43:23.214456+0000, chain.objs.size()=5 2024-03-04T12:46:18.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.978+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.81__multipart_key1.2~-JuvVRqFcg_W3H_MjKY9zBr_Sr5zDzC.1 2024-03-04T12:46:18.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.978+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.81__multipart_key1.2~-JuvVRqFcg_W3H_MjKY9zBr_Sr5zDzC.2 2024-03-04T12:46:18.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.978+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.81__multipart_key1.2~-JuvVRqFcg_W3H_MjKY9zBr_Sr5zDzC.3 2024-03-04T12:46:18.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.978+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.81__multipart_key1.2~-JuvVRqFcg_W3H_MjKY9zBr_Sr5zDzC.4 2024-03-04T12:46:18.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.978+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.81__multipart_key1.2~-JuvVRqFcg_W3H_MjKY9zBr_Sr5zDzC.5 2024-03-04T12:46:18.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.980+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:18.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.982+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:46:18.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.983+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.984+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.984+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.985+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:46:18.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.986+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.986+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.987+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.987+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:46:18.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.989+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:18.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.989+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:18.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.989+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:46:18.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.989+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11691730470411313895', time=2024-03-04T14:45:06.269871+0000, chain.objs.size()=5 2024-03-04T12:46:18.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.989+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~TkZU2vouDbltsbepE6xJ8v-xOOzeu5z.1 2024-03-04T12:46:18.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.989+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~TkZU2vouDbltsbepE6xJ8v-xOOzeu5z.2 2024-03-04T12:46:18.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.989+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~TkZU2vouDbltsbepE6xJ8v-xOOzeu5z.3 2024-03-04T12:46:18.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.989+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~TkZU2vouDbltsbepE6xJ8v-xOOzeu5z.4 2024-03-04T12:46:18.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.989+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.92__multipart_key1.2~TkZU2vouDbltsbepE6xJ8v-xOOzeu5z.5 2024-03-04T12:46:18.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.992+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:19.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.994+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:46:19.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.995+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.996+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.996+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:46:19.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.996+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2673775259362714828', time=2024-03-04T14:45:28.575403+0000, chain.objs.size()=5 2024-03-04T12:46:19.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.996+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.93__multipart_key1.2~DhAMcYMkBTBi-tZQs3vJahfd7n_aQA4.1 2024-03-04T12:46:19.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.996+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.93__multipart_key1.2~DhAMcYMkBTBi-tZQs3vJahfd7n_aQA4.2 2024-03-04T12:46:19.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.996+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.93__multipart_key1.2~DhAMcYMkBTBi-tZQs3vJahfd7n_aQA4.3 2024-03-04T12:46:19.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.996+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.93__multipart_key1.2~DhAMcYMkBTBi-tZQs3vJahfd7n_aQA4.4 2024-03-04T12:46:19.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:18.996+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.93__multipart_key1.2~DhAMcYMkBTBi-tZQs3vJahfd7n_aQA4.5 2024-03-04T12:46:19.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.000+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:19.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.002+0000 7ffb21939800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:46:19.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.003+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.003+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.004+0000 7ffb21939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T12:46:19.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.004+0000 7ffb21939800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.81__multipart_key1.2~-JuvVRqFcg_W3H_MjKY9zBr_Sr5zDzC.2_130d55b3b453ee3eb68b5741405275b1', time=2024-03-04T14:43:22.955826+0000, chain.objs.size()=5 2024-03-04T12:46:19.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.004+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.81__multipart_key1.2~-JuvVRqFcg_W3H_MjKY9zBr_Sr5zDzC.1 2024-03-04T12:46:19.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.004+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.81__multipart_key1.2~-JuvVRqFcg_W3H_MjKY9zBr_Sr5zDzC.2 2024-03-04T12:46:19.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.004+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.81__multipart_key1.2~-JuvVRqFcg_W3H_MjKY9zBr_Sr5zDzC.3 2024-03-04T12:46:19.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.004+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.81__multipart_key1.2~-JuvVRqFcg_W3H_MjKY9zBr_Sr5zDzC.4 2024-03-04T12:46:19.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.004+0000 7ffb21939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.81__multipart_key1.2~-JuvVRqFcg_W3H_MjKY9zBr_Sr5zDzC.5 2024-03-04T12:46:19.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.005+0000 7ffb21939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T12:46:19.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.008+0000 7ff9d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:19.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.010+0000 7ffb21939800 20 remove_watcher() i=0 2024-03-04T12:46:19.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.010+0000 7ffb21939800 2 removed watcher, disabling cache 2024-03-04T12:46:19.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.010+0000 7ffb21939800 20 remove_watcher() i=1 2024-03-04T12:46:19.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.011+0000 7ffb21939800 20 remove_watcher() i=2 2024-03-04T12:46:19.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.012+0000 7ffb21939800 20 remove_watcher() i=3 2024-03-04T12:46:19.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.013+0000 7ffb21939800 20 remove_watcher() i=4 2024-03-04T12:46:19.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.014+0000 7ffb21939800 20 remove_watcher() i=5 2024-03-04T12:46:19.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.015+0000 7ffb21939800 20 remove_watcher() i=6 2024-03-04T12:46:19.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.016+0000 7ffb21939800 20 remove_watcher() i=7 2024-03-04T12:46:19.033 DEBUG:teuthology.orchestra.run.smithi110:> radosgw-admin gc process --include-all 2024-03-04T12:46:19.082 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:19.082 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:19.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.108+0000 7f3139a0f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:19.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.109+0000 7f3139a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:19.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.109+0000 7f3139a0f800 20 realm 2024-03-04T12:46:19.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.109+0000 7f3139a0f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:19.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.110+0000 7f3139a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:19.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.110+0000 7f3139a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:19.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.110+0000 7f3139a0f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:19.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.110+0000 7f3139a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:19.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.110+0000 7f3139a0f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:19.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.111+0000 7f3139a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:19.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.111+0000 7f3139a0f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:19.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.111+0000 7f3139a0f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:19.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.111+0000 7f3139a0f800 20 searching for the correct realm 2024-03-04T12:46:19.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.114+0000 7f3135882640 0 -- 172.21.15.110:0/997910172 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f312c0a5bf0 msgr2=0x7f312c0b3930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:19.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.117+0000 7f3135081640 0 -- 172.21.15.110:0/997910172 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f312c068b80 msgr2=0x7f312c009bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.323+0000 7f3139a0f800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:46:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.323+0000 7f3139a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.323+0000 7f3139a0f800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:46:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.323+0000 7f3139a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.323+0000 7f3139a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.323+0000 7f3139a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.323+0000 7f3139a0f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.323+0000 7f3139a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.323+0000 7f3139a0f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.323+0000 7f3139a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.323+0000 7f3139a0f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.324+0000 7f3139a0f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:19.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.324+0000 7f3139a0f800 20 zone default found 2024-03-04T12:46:19.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.324+0000 7f3139a0f800 4 Realm: () 2024-03-04T12:46:19.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.324+0000 7f3139a0f800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:46:19.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.324+0000 7f3139a0f800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:46:19.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.324+0000 7f3139a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:19.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.324+0000 7f3139a0f800 20 zonegroup default 2024-03-04T12:46:19.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.324+0000 7f3139a0f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:19.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.324+0000 7f3139a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:19.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.324+0000 7f3139a0f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.324+0000 7f3139a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.324+0000 7f3139a0f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.324+0000 7f3139a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.324+0000 7f3139a0f800 20 started sync module instance, tier type = 2024-03-04T12:46:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.325+0000 7f3139a0f800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:46:19.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.333+0000 7f3139a0f800 20 add_watcher() i=0 2024-03-04T12:46:19.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.333+0000 7f3139a0f800 20 add_watcher() i=1 2024-03-04T12:46:19.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.333+0000 7f3139a0f800 20 add_watcher() i=2 2024-03-04T12:46:19.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.333+0000 7f3139a0f800 20 add_watcher() i=3 2024-03-04T12:46:19.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.333+0000 7f3139a0f800 20 add_watcher() i=4 2024-03-04T12:46:19.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.333+0000 7f3139a0f800 20 add_watcher() i=5 2024-03-04T12:46:19.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.333+0000 7f3139a0f800 20 add_watcher() i=6 2024-03-04T12:46:19.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.334+0000 7f3139a0f800 20 add_watcher() i=7 2024-03-04T12:46:19.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.334+0000 7f3139a0f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:19.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.336+0000 7f2feb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:19.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.336+0000 7f3139a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:19.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.336+0000 7f3139a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:19.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.369+0000 7f2fea7e4640 20 reqs_thread_entry: start 2024-03-04T12:46:19.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.369+0000 7f3139a0f800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:19.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.369+0000 7f3139a0f800 20 Filter name: none 2024-03-04T12:46:19.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.369+0000 7f2f5bfff640 20 reqs_thread_entry: start 2024-03-04T12:46:19.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.370+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T12:46:19.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.371+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.372+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.372+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.373+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T12:46:19.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.375+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.375+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.375+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.376+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T12:46:19.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.378+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.379+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.379+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.380+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T12:46:19.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.381+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.382+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.382+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.383+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T12:46:19.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.384+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.385+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.385+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.386+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T12:46:19.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.387+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.387+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.388+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.389+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T12:46:19.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.390+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.390+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.391+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.392+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T12:46:19.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.393+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.393+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.394+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.395+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T12:46:19.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.396+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.396+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.396+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.397+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T12:46:19.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.398+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.399+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.399+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.400+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T12:46:19.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.401+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.401+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.402+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.402+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T12:46:19.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.404+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.404+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.405+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.405+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T12:46:19.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.407+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.407+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.407+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.408+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T12:46:19.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.410+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.410+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.410+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.411+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T12:46:19.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.413+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.413+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.413+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.414+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T12:46:19.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.415+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.416+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.416+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.417+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T12:46:19.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.419+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.419+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.419+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.420+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T12:46:19.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.422+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.422+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.422+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.423+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T12:46:19.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.425+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.425+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.426+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.427+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T12:46:19.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.428+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.428+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.429+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.429+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T12:46:19.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.431+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.431+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.432+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.432+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T12:46:19.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.434+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.434+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.435+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.436+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T12:46:19.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.437+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.437+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.437+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.438+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T12:46:19.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.440+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.441+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.441+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.442+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T12:46:19.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.443+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.444+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.444+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.445+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T12:46:19.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.446+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.446+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.446+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.448+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T12:46:19.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.449+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.449+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.449+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.450+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T12:46:19.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.452+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.452+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.452+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.453+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T12:46:19.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.455+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.455+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.456+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.457+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T12:46:19.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.458+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.458+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.459+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.460+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T12:46:19.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.462+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.462+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.463+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.464+0000 7f3139a0f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T12:46:19.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.465+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.465+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T12:46:19.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.465+0000 7f3139a0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T12:46:19.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.467+0000 7f2feb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:19.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.469+0000 7f3139a0f800 20 remove_watcher() i=0 2024-03-04T12:46:19.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.469+0000 7f3139a0f800 2 removed watcher, disabling cache 2024-03-04T12:46:19.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.470+0000 7f3139a0f800 20 remove_watcher() i=1 2024-03-04T12:46:19.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.471+0000 7f3139a0f800 20 remove_watcher() i=2 2024-03-04T12:46:19.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.472+0000 7f3139a0f800 20 remove_watcher() i=3 2024-03-04T12:46:19.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.472+0000 7f3139a0f800 20 remove_watcher() i=4 2024-03-04T12:46:19.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.473+0000 7f3139a0f800 20 remove_watcher() i=5 2024-03-04T12:46:19.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.474+0000 7f3139a0f800 20 remove_watcher() i=6 2024-03-04T12:46:19.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:19.475+0000 7f3139a0f800 20 remove_watcher() i=7 2024-03-04T12:46:19.492 INFO:teuthology.run_tasks:Running task s3tests... 2024-03-04T12:46:19.511 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-03-04T12:46:19.511 INFO:tasks.s3tests:Downloading s3-tests... 2024-03-04T12:46:19.511 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-03-04T12:46:19.511 DEBUG:teuthology.orchestra.run.smithi110:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-03-04T12:46:19.538 INFO:teuthology.orchestra.run.smithi110.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-03-04T12:46:20.226 INFO:tasks.s3tests:Creating rgw users... 2024-03-04T12:46:20.226 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-03-04T12:46:20.227 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --email foo.client.0+test@test.test --caps 'user-policy=*' --access-key EIXEUUBFKEJLHQONYNMQ --secret OFXvcXOryr6VvGmUFSxmKqGwjH6OQIitGD3pC08NCmYU5IGN7t8TUw== --cluster ceph 2024-03-04T12:46:20.330 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:20.330 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:20.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.352+0000 7fc6c3e81800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.354+0000 7fc6c3e81800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.354+0000 7fc6c3e81800 20 realm 2024-03-04T12:46:20.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.354+0000 7fc6c3e81800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.354+0000 7fc6c3e81800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.354+0000 7fc6c3e81800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:20.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.354+0000 7fc6c3e81800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.354+0000 7fc6c3e81800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.354+0000 7fc6c3e81800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.355+0000 7fc6c3e81800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:20.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.355+0000 7fc6c3e81800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.355+0000 7fc6c3e81800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:20.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.355+0000 7fc6c3e81800 20 searching for the correct realm 2024-03-04T12:46:20.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.357+0000 7fc6c197d640 0 -- 172.21.15.110:0/2567105045 >> [v2:172.21.15.110:6800/2482344533,v1:172.21.15.110:6801/2482344533] conn(0x7fc6bc01f040 msgr2=0x7fc6bc02d970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:20.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.562+0000 7fc6c217e640 0 -- 172.21.15.110:0/2567105045 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7fc6b805f070 msgr2=0x7fc6b80af0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:20.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.568+0000 7fc6c3e81800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:46:20.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.568+0000 7fc6c3e81800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:20.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.568+0000 7fc6c3e81800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:46:20.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.568+0000 7fc6c3e81800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:20.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.568+0000 7fc6c3e81800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:20.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.568+0000 7fc6c3e81800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:20.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.568+0000 7fc6c3e81800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.568+0000 7fc6c3e81800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.568+0000 7fc6c3e81800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.569+0000 7fc6c3e81800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:20.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.569+0000 7fc6c3e81800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.569+0000 7fc6c3e81800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:20.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.569+0000 7fc6c3e81800 20 zone default found 2024-03-04T12:46:20.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.569+0000 7fc6c3e81800 4 Realm: () 2024-03-04T12:46:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.569+0000 7fc6c3e81800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:46:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.569+0000 7fc6c3e81800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:46:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.569+0000 7fc6c3e81800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.569+0000 7fc6c3e81800 20 zonegroup default 2024-03-04T12:46:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.569+0000 7fc6c3e81800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.569+0000 7fc6c3e81800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.569+0000 7fc6c3e81800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.570+0000 7fc6c3e81800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.570+0000 7fc6c3e81800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.570+0000 7fc6c3e81800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.570+0000 7fc6c3e81800 20 started sync module instance, tier type = 2024-03-04T12:46:20.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.570+0000 7fc6c3e81800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:46:20.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.578+0000 7fc6c3e81800 20 add_watcher() i=0 2024-03-04T12:46:20.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.578+0000 7fc6c3e81800 20 add_watcher() i=1 2024-03-04T12:46:20.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.578+0000 7fc6c3e81800 20 add_watcher() i=2 2024-03-04T12:46:20.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.578+0000 7fc6c3e81800 20 add_watcher() i=3 2024-03-04T12:46:20.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.578+0000 7fc6c3e81800 20 add_watcher() i=4 2024-03-04T12:46:20.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.578+0000 7fc6c3e81800 20 add_watcher() i=5 2024-03-04T12:46:20.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.578+0000 7fc6c3e81800 20 add_watcher() i=6 2024-03-04T12:46:20.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.579+0000 7fc6c3e81800 20 add_watcher() i=7 2024-03-04T12:46:20.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.579+0000 7fc6c3e81800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:20.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.581+0000 7fc5737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:20.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.581+0000 7fc6c3e81800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:20.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.581+0000 7fc6c3e81800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:20.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.581+0000 7fc6c3e81800 5 note: GC not initialized 2024-03-04T12:46:20.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.581+0000 7fc5727fc640 20 reqs_thread_entry: start 2024-03-04T12:46:20.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.581+0000 7fc6c3e81800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:20.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.582+0000 7fc6c3e81800 20 Filter name: none 2024-03-04T12:46:20.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.582+0000 7fc4e3fff640 20 reqs_thread_entry: start 2024-03-04T12:46:20.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.582+0000 7fc6c3e81800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-03-04T12:46:20.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.582+0000 7fc6c3e81800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.582+0000 7fc6c3e81800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.582+0000 7fc6c3e81800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-03-04T12:46:20.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.582+0000 7fc6c3e81800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-04T12:46:20.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.582+0000 7fc6c3e81800 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2024-03-04T12:46:20.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.582+0000 7fc6c3e81800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.582+0000 7fc6c3e81800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.582+0000 7fc6c3e81800 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2024-03-04T12:46:20.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.582+0000 7fc6c3e81800 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2024-03-04T12:46:20.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.582+0000 7fc6c3e81800 10 cache get: name=default.rgw.meta+users.keys+EIXEUUBFKEJLHQONYNMQ : miss 2024-03-04T12:46:20.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.582+0000 7fc6c3e81800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.583+0000 7fc6c3e81800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.583+0000 7fc6c3e81800 10 cache put: name=default.rgw.meta+users.keys+EIXEUUBFKEJLHQONYNMQ info.flags=0x0 2024-03-04T12:46:20.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.583+0000 7fc6c3e81800 10 adding default.rgw.meta+users.keys+EIXEUUBFKEJLHQONYNMQ to cache LRU end 2024-03-04T12:46:20.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.583+0000 7fc6c3e81800 10 cache get: name=default.rgw.meta+users.keys+EIXEUUBFKEJLHQONYNMQ : hit (negative entry) 2024-03-04T12:46:20.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.583+0000 7fc6c3e81800 10 cache get: name=default.rgw.meta+users.keys+EIXEUUBFKEJLHQONYNMQ : hit (negative entry) 2024-03-04T12:46:20.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.584+0000 7fc6c3e81800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-04T12:46:20.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.584+0000 7fc6c3e81800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-04T12:46:20.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.584+0000 7fc6c3e81800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-03-04T12:46:20.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.584+0000 7fc5a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824251 cookie 94840632729520 notifier 7641 bl.length()=641 2024-03-04T12:46:20.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.584+0000 7fc5a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-04T12:46:20.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.584+0000 7fc5a57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-04T12:46:20.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.587+0000 7fc6c3e81800 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2024-03-04T12:46:20.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.587+0000 7fc6c3e81800 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2024-03-04T12:46:20.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.587+0000 7fc6c3e81800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.email:foo.client.0+test@test.test, ofs0, ns] 2024-03-04T12:46:20.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.587+0000 7fc5a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824144 cookie 94840632742176 notifier 7641 bl.length()=194 2024-03-04T12:46:20.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.587+0000 7fc5a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2024-03-04T12:46:20.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.587+0000 7fc5a57fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2024-03-04T12:46:20.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.590+0000 7fc6c3e81800 10 cache put: name=default.rgw.meta+users.keys+EIXEUUBFKEJLHQONYNMQ info.flags=0x7 2024-03-04T12:46:20.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.590+0000 7fc6c3e81800 10 moving default.rgw.meta+users.keys+EIXEUUBFKEJLHQONYNMQ to cache LRU end 2024-03-04T12:46:20.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.590+0000 7fc6c3e81800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:EIXEUUBFKEJLHQONYNMQ, ofs0, ns] 2024-03-04T12:46:20.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.590+0000 7fc5a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824119 cookie 94840632732352 notifier 7641 bl.length()=186 2024-03-04T12:46:20.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.590+0000 7fc5a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+EIXEUUBFKEJLHQONYNMQ info.flags=0x7 2024-03-04T12:46:20.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.590+0000 7fc5a57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+EIXEUUBFKEJLHQONYNMQ to cache LRU end 2024-03-04T12:46:20.598 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T12:46:20.599 INFO:teuthology.orchestra.run.smithi110.stdout: "user_id": "foo.client.0", 2024-03-04T12:46:20.599 INFO:teuthology.orchestra.run.smithi110.stdout: "display_name": "Mr. foo.client.0", 2024-03-04T12:46:20.599 INFO:teuthology.orchestra.run.smithi110.stdout: "email": "foo.client.0+test@test.test", 2024-03-04T12:46:20.599 INFO:teuthology.orchestra.run.smithi110.stdout: "suspended": 0, 2024-03-04T12:46:20.599 INFO:teuthology.orchestra.run.smithi110.stdout: "max_buckets": 1000, 2024-03-04T12:46:20.599 INFO:teuthology.orchestra.run.smithi110.stdout: "subusers": [], 2024-03-04T12:46:20.599 INFO:teuthology.orchestra.run.smithi110.stdout: "keys": [ 2024-03-04T12:46:20.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:46:20.599 INFO:teuthology.orchestra.run.smithi110.stdout: "user": "foo.client.0", 2024-03-04T12:46:20.599 INFO:teuthology.orchestra.run.smithi110.stdout: "access_key": "EIXEUUBFKEJLHQONYNMQ", 2024-03-04T12:46:20.599 INFO:teuthology.orchestra.run.smithi110.stdout: "secret_key": "OFXvcXOryr6VvGmUFSxmKqGwjH6OQIitGD3pC08NCmYU5IGN7t8TUw==", 2024-03-04T12:46:20.599 INFO:teuthology.orchestra.run.smithi110.stdout: "active": true 2024-03-04T12:46:20.599 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-03-04T12:46:20.599 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-03-04T12:46:20.600 INFO:teuthology.orchestra.run.smithi110.stdout: "swift_keys": [], 2024-03-04T12:46:20.600 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": [ 2024-03-04T12:46:20.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:46:20.600 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "user-policy", 2024-03-04T12:46:20.600 INFO:teuthology.orchestra.run.smithi110.stdout: "perm": "*" 2024-03-04T12:46:20.600 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-03-04T12:46:20.600 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-03-04T12:46:20.600 INFO:teuthology.orchestra.run.smithi110.stdout: "op_mask": "read, write, delete", 2024-03-04T12:46:20.600 INFO:teuthology.orchestra.run.smithi110.stdout: "default_placement": "", 2024-03-04T12:46:20.600 INFO:teuthology.orchestra.run.smithi110.stdout: "default_storage_class": "", 2024-03-04T12:46:20.600 INFO:teuthology.orchestra.run.smithi110.stdout: "placement_tags": [], 2024-03-04T12:46:20.600 INFO:teuthology.orchestra.run.smithi110.stdout: "bucket_quota": { 2024-03-04T12:46:20.600 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:46:20.600 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:46:20.601 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:46:20.601 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:46:20.601 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:46:20.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:46:20.601 INFO:teuthology.orchestra.run.smithi110.stdout: "user_quota": { 2024-03-04T12:46:20.601 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:46:20.601 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:46:20.601 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:46:20.601 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:46:20.601 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:46:20.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:46:20.601 INFO:teuthology.orchestra.run.smithi110.stdout: "temp_url_keys": [], 2024-03-04T12:46:20.601 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "rgw", 2024-03-04T12:46:20.601 INFO:teuthology.orchestra.run.smithi110.stdout: "mfa_ids": [] 2024-03-04T12:46:20.601 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T12:46:20.602 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:20.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.592+0000 7fc5737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:20.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.595+0000 7fc6c3e81800 20 remove_watcher() i=0 2024-03-04T12:46:20.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.595+0000 7fc6c3e81800 2 removed watcher, disabling cache 2024-03-04T12:46:20.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.596+0000 7fc6c3e81800 20 remove_watcher() i=1 2024-03-04T12:46:20.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.597+0000 7fc6c3e81800 20 remove_watcher() i=2 2024-03-04T12:46:20.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.598+0000 7fc6c3e81800 20 remove_watcher() i=3 2024-03-04T12:46:20.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.599+0000 7fc6c3e81800 20 remove_watcher() i=4 2024-03-04T12:46:20.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.600+0000 7fc6c3e81800 20 remove_watcher() i=5 2024-03-04T12:46:20.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.601+0000 7fc6c3e81800 20 remove_watcher() i=6 2024-03-04T12:46:20.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.602+0000 7fc6c3e81800 20 remove_watcher() i=7 2024-03-04T12:46:20.619 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 3909336895 --totp-seed NCALCOD5YQ74QWIIFUD2R764ZMH4V32OSMFLPNBXSA46RPJDQICTGJ5DNKXZ4R3K --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-04T12:46:20.681 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:20.681 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:20.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.704+0000 7f70d2814800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.705+0000 7f70d2814800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.705+0000 7f70d2814800 20 realm 2024-03-04T12:46:20.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.705+0000 7f70d2814800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.705+0000 7f70d2814800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.705+0000 7f70d2814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:20.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.705+0000 7f70d2814800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.706+0000 7f70d2814800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.706+0000 7f70d2814800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.706+0000 7f70d2814800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:20.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.706+0000 7f70d2814800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.707+0000 7f70d2814800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:20.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.707+0000 7f70d2814800 20 searching for the correct realm 2024-03-04T12:46:20.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.711+0000 7f70ce75f640 0 -- 172.21.15.110:0/3971584918 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7f70c4061960 msgr2=0x7f70c4039410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:20.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.917+0000 7f70cdf5e640 0 -- 172.21.15.110:0/3971584918 >> [v2:172.21.15.172:6800/824320839,v1:172.21.15.172:6801/824320839] conn(0x55e03196a7d0 msgr2=0x55e03196cc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:20.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.920+0000 7f70d2814800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:46:20.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.920+0000 7f70d2814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:20.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.920+0000 7f70d2814800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:46:20.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.920+0000 7f70d2814800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:20.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.920+0000 7f70d2814800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:20.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.920+0000 7f70d2814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:20.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.920+0000 7f70d2814800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.920+0000 7f70d2814800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.920+0000 7f70d2814800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.920+0000 7f70d2814800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:20.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.920+0000 7f70d2814800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.921+0000 7f70d2814800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:20.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.921+0000 7f70d2814800 20 zone default found 2024-03-04T12:46:20.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.921+0000 7f70d2814800 4 Realm: () 2024-03-04T12:46:20.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.921+0000 7f70d2814800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:46:20.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.921+0000 7f70d2814800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:46:20.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.921+0000 7f70d2814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:20.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.921+0000 7f70d2814800 20 zonegroup default 2024-03-04T12:46:20.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.921+0000 7f70d2814800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.921+0000 7f70d2814800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.921+0000 7f70d2814800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.921+0000 7f70d2814800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.921+0000 7f70d2814800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.922+0000 7f70d2814800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:20.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.922+0000 7f70d2814800 20 started sync module instance, tier type = 2024-03-04T12:46:20.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.922+0000 7f70d2814800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:46:20.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.931+0000 7f70d2814800 20 add_watcher() i=0 2024-03-04T12:46:20.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.931+0000 7f70d2814800 20 add_watcher() i=1 2024-03-04T12:46:20.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.931+0000 7f70d2814800 20 add_watcher() i=2 2024-03-04T12:46:20.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.931+0000 7f70d2814800 20 add_watcher() i=3 2024-03-04T12:46:20.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.931+0000 7f70d2814800 20 add_watcher() i=4 2024-03-04T12:46:20.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.931+0000 7f70d2814800 20 add_watcher() i=5 2024-03-04T12:46:20.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.931+0000 7f70d2814800 20 add_watcher() i=6 2024-03-04T12:46:20.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.932+0000 7f70d2814800 20 add_watcher() i=7 2024-03-04T12:46:20.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.932+0000 7f70d2814800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:20.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.934+0000 7f6f7f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:20.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.934+0000 7f70d2814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:20.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.934+0000 7f70d2814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:20.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.934+0000 7f70d2814800 5 note: GC not initialized 2024-03-04T12:46:20.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.934+0000 7f6f7e7fc640 20 reqs_thread_entry: start 2024-03-04T12:46:20.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.934+0000 7f70d2814800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:20.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.934+0000 7f70d2814800 20 Filter name: none 2024-03-04T12:46:20.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.934+0000 7f6eeffff640 20 reqs_thread_entry: start 2024-03-04T12:46:20.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.934+0000 7f70d2814800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-03-04T12:46:20.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.934+0000 7f70d2814800 20 rados->read ofs=0 len=0 2024-03-04T12:46:20.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.935+0000 7f70d2814800 20 rados_obj.operate() r=0 bl.length=456 2024-03-04T12:46:20.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.935+0000 7f70d2814800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-03-04T12:46:20.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.935+0000 7f70d2814800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-04T12:46:20.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:20.935+0000 7f70d2814800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:22.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.312+0000 7f70d2814800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-04T12:46:22.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.312+0000 7f70d2814800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-04T12:46:22.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.312+0000 7f70d2814800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-03-04T12:46:22.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.312+0000 7f6fb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758844 cookie 94421392999072 notifier 7172 bl.length()=655 2024-03-04T12:46:22.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.312+0000 7f6fb0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-04T12:46:22.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.312+0000 7f6fb0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-04T12:46:22.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.315+0000 7f6f7f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:22.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.318+0000 7f70d2814800 20 remove_watcher() i=0 2024-03-04T12:46:22.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.318+0000 7f70d2814800 2 removed watcher, disabling cache 2024-03-04T12:46:22.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.319+0000 7f70d2814800 20 remove_watcher() i=1 2024-03-04T12:46:22.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.320+0000 7f70d2814800 20 remove_watcher() i=2 2024-03-04T12:46:22.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.322+0000 7f70d2814800 20 remove_watcher() i=3 2024-03-04T12:46:22.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.323+0000 7f70d2814800 20 remove_watcher() i=4 2024-03-04T12:46:22.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.324+0000 7f70d2814800 20 remove_watcher() i=5 2024-03-04T12:46:22.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.325+0000 7f70d2814800 20 remove_watcher() i=6 2024-03-04T12:46:22.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.326+0000 7f70d2814800 20 remove_watcher() i=7 2024-03-04T12:46:22.345 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-03-04T12:46:22.345 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --email bar.client.0+test@test.test --caps 'user-policy=*' --access-key YFXTUDCTAIONMMKMJVUC --secret WIwjvgfw0ARLmAPJ1YbkxD/GBd6FpaAYJPDb65gXRSUYB4f0NCC/Jw== --cluster ceph 2024-03-04T12:46:22.410 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:22.410 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:22.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.434+0000 7f417371f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.435+0000 7f417371f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.435+0000 7f417371f800 20 realm 2024-03-04T12:46:22.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.435+0000 7f417371f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.435+0000 7f417371f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.435+0000 7f417371f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.435+0000 7f417371f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.435+0000 7f417371f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.435+0000 7f417371f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.436+0000 7f417371f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:22.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.436+0000 7f417371f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.437+0000 7f417371f800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:22.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.437+0000 7f417371f800 20 searching for the correct realm 2024-03-04T12:46:22.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.440+0000 7f416ece7640 0 -- 172.21.15.110:0/2480809147 >> [v2:172.21.15.110:6816/2308430566,v1:172.21.15.110:6817/2308430566] conn(0x559f93e41780 msgr2=0x559f93e43c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:22.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.444+0000 7f416f4e8640 0 -- 172.21.15.110:0/2480809147 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f416404f070 msgr2=0x7f4164059400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:22.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.449+0000 7f417371f800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:46:22.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.449+0000 7f417371f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:22.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.449+0000 7f417371f800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:46:22.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.449+0000 7f417371f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:22.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.449+0000 7f417371f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:22.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.449+0000 7f417371f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:22.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.449+0000 7f417371f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.449+0000 7f417371f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.449+0000 7f417371f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.449+0000 7f417371f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:22.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.449+0000 7f417371f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.450+0000 7f417371f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:22.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.450+0000 7f417371f800 20 zone default found 2024-03-04T12:46:22.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.450+0000 7f417371f800 4 Realm: () 2024-03-04T12:46:22.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.450+0000 7f417371f800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:46:22.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.450+0000 7f417371f800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:46:22.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.450+0000 7f417371f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:22.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.450+0000 7f417371f800 20 zonegroup default 2024-03-04T12:46:22.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.450+0000 7f417371f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.450+0000 7f417371f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.450+0000 7f417371f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.450+0000 7f417371f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.450+0000 7f417371f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.450+0000 7f417371f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.450+0000 7f417371f800 20 started sync module instance, tier type = 2024-03-04T12:46:22.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.450+0000 7f417371f800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:46:22.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.459+0000 7f417371f800 20 add_watcher() i=0 2024-03-04T12:46:22.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.459+0000 7f417371f800 20 add_watcher() i=1 2024-03-04T12:46:22.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.459+0000 7f417371f800 20 add_watcher() i=2 2024-03-04T12:46:22.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.459+0000 7f417371f800 20 add_watcher() i=3 2024-03-04T12:46:22.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.459+0000 7f417371f800 20 add_watcher() i=4 2024-03-04T12:46:22.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.459+0000 7f417371f800 20 add_watcher() i=5 2024-03-04T12:46:22.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.459+0000 7f417371f800 20 add_watcher() i=6 2024-03-04T12:46:22.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.460+0000 7f417371f800 20 add_watcher() i=7 2024-03-04T12:46:22.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.460+0000 7f417371f800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:22.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.462+0000 7f4025fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:22.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.462+0000 7f417371f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:22.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.462+0000 7f417371f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:22.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.462+0000 7f417371f800 5 note: GC not initialized 2024-03-04T12:46:22.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.462+0000 7f4024fe1640 20 reqs_thread_entry: start 2024-03-04T12:46:22.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.462+0000 7f417371f800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:22.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.462+0000 7f417371f800 20 Filter name: none 2024-03-04T12:46:22.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.462+0000 7f3f9e7fc640 20 reqs_thread_entry: start 2024-03-04T12:46:22.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.462+0000 7f417371f800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-03-04T12:46:22.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.462+0000 7f417371f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.463+0000 7f417371f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.463+0000 7f417371f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-03-04T12:46:22.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.463+0000 7f417371f800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-04T12:46:22.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.463+0000 7f417371f800 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2024-03-04T12:46:22.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.463+0000 7f417371f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.463+0000 7f417371f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.463+0000 7f417371f800 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2024-03-04T12:46:22.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.463+0000 7f417371f800 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2024-03-04T12:46:22.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.463+0000 7f417371f800 10 cache get: name=default.rgw.meta+users.keys+YFXTUDCTAIONMMKMJVUC : miss 2024-03-04T12:46:22.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.463+0000 7f417371f800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.463+0000 7f417371f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.463+0000 7f417371f800 10 cache put: name=default.rgw.meta+users.keys+YFXTUDCTAIONMMKMJVUC info.flags=0x0 2024-03-04T12:46:22.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.463+0000 7f417371f800 10 adding default.rgw.meta+users.keys+YFXTUDCTAIONMMKMJVUC to cache LRU end 2024-03-04T12:46:22.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.463+0000 7f417371f800 10 cache get: name=default.rgw.meta+users.keys+YFXTUDCTAIONMMKMJVUC : hit (negative entry) 2024-03-04T12:46:22.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.463+0000 7f417371f800 10 cache get: name=default.rgw.meta+users.keys+YFXTUDCTAIONMMKMJVUC : hit (negative entry) 2024-03-04T12:46:22.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.465+0000 7f417371f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-04T12:46:22.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.465+0000 7f417371f800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-04T12:46:22.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.465+0000 7f417371f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-03-04T12:46:22.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.465+0000 7f4052ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758712 cookie 94143869366128 notifier 7677 bl.length()=641 2024-03-04T12:46:22.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.465+0000 7f4052ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-04T12:46:22.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.465+0000 7f4052ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-04T12:46:22.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.468+0000 7f417371f800 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2024-03-04T12:46:22.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.468+0000 7f417371f800 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2024-03-04T12:46:22.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.468+0000 7f417371f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:bar.client.0+test@test.test, ofs0, ns] 2024-03-04T12:46:22.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.468+0000 7f4052ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758713 cookie 94143869366128 notifier 7677 bl.length()=194 2024-03-04T12:46:22.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.468+0000 7f4052ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2024-03-04T12:46:22.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.468+0000 7f4052ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2024-03-04T12:46:22.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.469+0000 7f4052ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758714 cookie 94143869366128 notifier 7677 bl.length()=194 2024-03-04T12:46:22.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.469+0000 7f4052ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2024-03-04T12:46:22.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.469+0000 7f4052ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2024-03-04T12:46:22.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.472+0000 7f417371f800 10 cache put: name=default.rgw.meta+users.keys+YFXTUDCTAIONMMKMJVUC info.flags=0x7 2024-03-04T12:46:22.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.472+0000 7f417371f800 10 moving default.rgw.meta+users.keys+YFXTUDCTAIONMMKMJVUC to cache LRU end 2024-03-04T12:46:22.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.472+0000 7f417371f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:YFXTUDCTAIONMMKMJVUC, ofs0, ns] 2024-03-04T12:46:22.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.472+0000 7f4052ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758654 cookie 94143869372624 notifier 7677 bl.length()=186 2024-03-04T12:46:22.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.472+0000 7f4052ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YFXTUDCTAIONMMKMJVUC info.flags=0x7 2024-03-04T12:46:22.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.472+0000 7f4052ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YFXTUDCTAIONMMKMJVUC to cache LRU end 2024-03-04T12:46:22.480 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T12:46:22.480 INFO:teuthology.orchestra.run.smithi110.stdout: "user_id": "bar.client.0", 2024-03-04T12:46:22.480 INFO:teuthology.orchestra.run.smithi110.stdout: "display_name": "Mr. bar.client.0", 2024-03-04T12:46:22.480 INFO:teuthology.orchestra.run.smithi110.stdout: "email": "bar.client.0+test@test.test", 2024-03-04T12:46:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "suspended": 0, 2024-03-04T12:46:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "max_buckets": 1000, 2024-03-04T12:46:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "subusers": [], 2024-03-04T12:46:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "keys": [ 2024-03-04T12:46:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:46:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "user": "bar.client.0", 2024-03-04T12:46:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "access_key": "YFXTUDCTAIONMMKMJVUC", 2024-03-04T12:46:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "secret_key": "WIwjvgfw0ARLmAPJ1YbkxD/GBd6FpaAYJPDb65gXRSUYB4f0NCC/Jw==", 2024-03-04T12:46:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "active": true 2024-03-04T12:46:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-03-04T12:46:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-03-04T12:46:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "swift_keys": [], 2024-03-04T12:46:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": [ 2024-03-04T12:46:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:46:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "user-policy", 2024-03-04T12:46:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "perm": "*" 2024-03-04T12:46:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-03-04T12:46:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-03-04T12:46:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "op_mask": "read, write, delete", 2024-03-04T12:46:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "default_placement": "", 2024-03-04T12:46:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "default_storage_class": "", 2024-03-04T12:46:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "placement_tags": [], 2024-03-04T12:46:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "bucket_quota": { 2024-03-04T12:46:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:46:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:46:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:46:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:46:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:46:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:46:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: "user_quota": { 2024-03-04T12:46:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:46:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:46:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:46:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:46:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:46:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:46:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: "temp_url_keys": [], 2024-03-04T12:46:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "rgw", 2024-03-04T12:46:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: "mfa_ids": [] 2024-03-04T12:46:22.483 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T12:46:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:22.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.474+0000 7f4025fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:22.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.477+0000 7f417371f800 20 remove_watcher() i=0 2024-03-04T12:46:22.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.477+0000 7f417371f800 2 removed watcher, disabling cache 2024-03-04T12:46:22.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.478+0000 7f417371f800 20 remove_watcher() i=1 2024-03-04T12:46:22.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.479+0000 7f417371f800 20 remove_watcher() i=2 2024-03-04T12:46:22.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.480+0000 7f417371f800 20 remove_watcher() i=3 2024-03-04T12:46:22.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.481+0000 7f417371f800 20 remove_watcher() i=4 2024-03-04T12:46:22.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.482+0000 7f417371f800 20 remove_watcher() i=5 2024-03-04T12:46:22.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.482+0000 7f417371f800 20 remove_watcher() i=6 2024-03-04T12:46:22.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.483+0000 7f417371f800 20 remove_watcher() i=7 2024-03-04T12:46:22.500 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 4830841076 --totp-seed 3QP4P7FDQGKBHII2CBW7AQUDPWUBW4IN4RGOP5M2LR5DGNOMHNK7AN5LJCPOVNJ7 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-04T12:46:22.563 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:22.563 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:22.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.587+0000 7fe22a424800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.588+0000 7fe22a424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.588+0000 7fe22a424800 20 realm 2024-03-04T12:46:22.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.588+0000 7fe22a424800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.588+0000 7fe22a424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.588+0000 7fe22a424800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:22.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.589+0000 7fe22a424800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.589+0000 7fe22a424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.589+0000 7fe22a424800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.590+0000 7fe22a424800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:22.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.590+0000 7fe22a424800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.590+0000 7fe22a424800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:22.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.590+0000 7fe22a424800 20 searching for the correct realm 2024-03-04T12:46:22.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.592+0000 7fe227f20640 0 -- 172.21.15.110:0/4243766620 >> [v2:172.21.15.110:6800/2482344533,v1:172.21.15.110:6801/2482344533] conn(0x559063cd0650 msgr2=0x7fe220059530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:22.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.596+0000 7fe228721640 0 -- 172.21.15.110:0/4243766620 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7fe21c05fa60 msgr2=0x7fe21c027ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:22.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.601+0000 7fe22a424800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:46:22.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.601+0000 7fe22a424800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:22.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.601+0000 7fe22a424800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:46:22.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.601+0000 7fe22a424800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:22.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.601+0000 7fe22a424800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:22.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.601+0000 7fe22a424800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:22.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.601+0000 7fe22a424800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.601+0000 7fe22a424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.601+0000 7fe22a424800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.602+0000 7fe22a424800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:22.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.602+0000 7fe22a424800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.602+0000 7fe22a424800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:22.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.602+0000 7fe22a424800 20 zone default found 2024-03-04T12:46:22.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.602+0000 7fe22a424800 4 Realm: () 2024-03-04T12:46:22.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.602+0000 7fe22a424800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:46:22.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.602+0000 7fe22a424800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:46:22.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.602+0000 7fe22a424800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:22.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.602+0000 7fe22a424800 20 zonegroup default 2024-03-04T12:46:22.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.602+0000 7fe22a424800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.602+0000 7fe22a424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.602+0000 7fe22a424800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.603+0000 7fe22a424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.603+0000 7fe22a424800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.603+0000 7fe22a424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.603+0000 7fe22a424800 20 started sync module instance, tier type = 2024-03-04T12:46:22.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.603+0000 7fe22a424800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:46:22.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.612+0000 7fe22a424800 20 add_watcher() i=0 2024-03-04T12:46:22.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.612+0000 7fe22a424800 20 add_watcher() i=1 2024-03-04T12:46:22.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.612+0000 7fe22a424800 20 add_watcher() i=2 2024-03-04T12:46:22.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.612+0000 7fe22a424800 20 add_watcher() i=3 2024-03-04T12:46:22.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.612+0000 7fe22a424800 20 add_watcher() i=4 2024-03-04T12:46:22.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.612+0000 7fe22a424800 20 add_watcher() i=5 2024-03-04T12:46:22.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.612+0000 7fe22a424800 20 add_watcher() i=6 2024-03-04T12:46:22.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.612+0000 7fe22a424800 20 add_watcher() i=7 2024-03-04T12:46:22.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.613+0000 7fe22a424800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:22.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.614+0000 7fe0ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:22.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.614+0000 7fe22a424800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:22.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.614+0000 7fe22a424800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:22.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.614+0000 7fe22a424800 5 note: GC not initialized 2024-03-04T12:46:22.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.614+0000 7fe0dcfe1640 20 reqs_thread_entry: start 2024-03-04T12:46:22.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.615+0000 7fe22a424800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:22.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.615+0000 7fe22a424800 20 Filter name: none 2024-03-04T12:46:22.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.615+0000 7fe0567fc640 20 reqs_thread_entry: start 2024-03-04T12:46:22.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.615+0000 7fe22a424800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-03-04T12:46:22.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.615+0000 7fe22a424800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.615+0000 7fe22a424800 20 rados_obj.operate() r=0 bl.length=456 2024-03-04T12:46:22.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.615+0000 7fe22a424800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-03-04T12:46:22.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.615+0000 7fe22a424800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-04T12:46:22.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.615+0000 7fe22a424800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:22.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.618+0000 7fe22a424800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-04T12:46:22.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.618+0000 7fe22a424800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-04T12:46:22.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.618+0000 7fe22a424800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-03-04T12:46:22.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.618+0000 7fe106ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758715 cookie 94078640010464 notifier 7202 bl.length()=655 2024-03-04T12:46:22.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.618+0000 7fe106ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-04T12:46:22.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.618+0000 7fe106ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-04T12:46:22.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.620+0000 7fe0ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:22.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.623+0000 7fe22a424800 20 remove_watcher() i=0 2024-03-04T12:46:22.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.623+0000 7fe22a424800 2 removed watcher, disabling cache 2024-03-04T12:46:22.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.624+0000 7fe22a424800 20 remove_watcher() i=1 2024-03-04T12:46:22.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.625+0000 7fe22a424800 20 remove_watcher() i=2 2024-03-04T12:46:22.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.626+0000 7fe22a424800 20 remove_watcher() i=3 2024-03-04T12:46:22.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.627+0000 7fe22a424800 20 remove_watcher() i=4 2024-03-04T12:46:22.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.628+0000 7fe22a424800 20 remove_watcher() i=5 2024-03-04T12:46:22.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.628+0000 7fe22a424800 20 remove_watcher() i=6 2024-03-04T12:46:22.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.629+0000 7fe22a424800 20 remove_watcher() i=7 2024-03-04T12:46:22.646 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-03-04T12:46:22.647 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --email 'testx$tenanteduser.client.0+test@test.test' --caps 'user-policy=*' --access-key XWJWIUZSUVUSWSSJMCZQ --secret Ue+9DVsc0fc7k7zavfy7ZL0TcFokVO2VO8/b048RhKOodYg5Gvgcng== --cluster ceph 2024-03-04T12:46:22.710 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:22.711 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:22.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.734+0000 7f7c1829d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.735+0000 7f7c1829d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.735+0000 7f7c1829d800 20 realm 2024-03-04T12:46:22.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.735+0000 7f7c1829d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.735+0000 7f7c1829d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.735+0000 7f7c1829d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:22.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.735+0000 7f7c1829d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.735+0000 7f7c1829d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.735+0000 7f7c1829d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.736+0000 7f7c1829d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:22.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.736+0000 7f7c1829d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.736+0000 7f7c1829d800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:22.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.736+0000 7f7c1829d800 20 searching for the correct realm 2024-03-04T12:46:22.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.740+0000 7f7c1659a640 0 -- 172.21.15.110:0/3964738243 >> [v2:172.21.15.172:6821/1928063852,v1:172.21.15.172:6823/1928063852] conn(0x7f7c00087040 msgr2=0x7f7c00003340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:22.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.946+0000 7f7c15d99640 0 -- 172.21.15.110:0/3964738243 >> [v2:172.21.15.172:6800/824320839,v1:172.21.15.172:6801/824320839] conn(0x5571b2679360 msgr2=0x5571b267b7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:22.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.949+0000 7f7c1829d800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:46:22.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.949+0000 7f7c1829d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:22.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.949+0000 7f7c1829d800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:46:22.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.949+0000 7f7c1829d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:22.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.949+0000 7f7c1829d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:22.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.949+0000 7f7c1829d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:22.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.949+0000 7f7c1829d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.949+0000 7f7c1829d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.949+0000 7f7c1829d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.950+0000 7f7c1829d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:22.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.950+0000 7f7c1829d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.950+0000 7f7c1829d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:22.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.950+0000 7f7c1829d800 20 zone default found 2024-03-04T12:46:22.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.950+0000 7f7c1829d800 4 Realm: () 2024-03-04T12:46:22.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.950+0000 7f7c1829d800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:46:22.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.950+0000 7f7c1829d800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:46:22.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.950+0000 7f7c1829d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:22.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.950+0000 7f7c1829d800 20 zonegroup default 2024-03-04T12:46:22.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.950+0000 7f7c1829d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.950+0000 7f7c1829d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.950+0000 7f7c1829d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.951+0000 7f7c1829d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.951+0000 7f7c1829d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.951+0000 7f7c1829d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.951+0000 7f7c1829d800 20 started sync module instance, tier type = 2024-03-04T12:46:22.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.951+0000 7f7c1829d800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:46:22.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.959+0000 7f7c1829d800 20 add_watcher() i=0 2024-03-04T12:46:22.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.959+0000 7f7c1829d800 20 add_watcher() i=1 2024-03-04T12:46:22.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.959+0000 7f7c1829d800 20 add_watcher() i=2 2024-03-04T12:46:22.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.959+0000 7f7c1829d800 20 add_watcher() i=3 2024-03-04T12:46:22.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.959+0000 7f7c1829d800 20 add_watcher() i=4 2024-03-04T12:46:22.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.959+0000 7f7c1829d800 20 add_watcher() i=5 2024-03-04T12:46:22.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.959+0000 7f7c1829d800 20 add_watcher() i=6 2024-03-04T12:46:22.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.960+0000 7f7c1829d800 20 add_watcher() i=7 2024-03-04T12:46:22.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.960+0000 7f7c1829d800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:22.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.962+0000 7f7abf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:22.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.962+0000 7f7c1829d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:22.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.962+0000 7f7c1829d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:22.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.962+0000 7f7c1829d800 5 note: GC not initialized 2024-03-04T12:46:22.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.962+0000 7f7abe7fc640 20 reqs_thread_entry: start 2024-03-04T12:46:22.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.962+0000 7f7c1829d800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:22.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.962+0000 7f7c1829d800 20 Filter name: none 2024-03-04T12:46:22.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.962+0000 7f7a37fff640 20 reqs_thread_entry: start 2024-03-04T12:46:22.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.962+0000 7f7c1829d800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-03-04T12:46:22.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.962+0000 7f7c1829d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.963+0000 7f7c1829d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.963+0000 7f7c1829d800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-03-04T12:46:22.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.963+0000 7f7c1829d800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-04T12:46:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.963+0000 7f7c1829d800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2024-03-04T12:46:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.963+0000 7f7c1829d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.963+0000 7f7c1829d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.963+0000 7f7c1829d800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2024-03-04T12:46:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.963+0000 7f7c1829d800 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2024-03-04T12:46:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.963+0000 7f7c1829d800 10 cache get: name=default.rgw.meta+users.keys+XWJWIUZSUVUSWSSJMCZQ : miss 2024-03-04T12:46:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.963+0000 7f7c1829d800 20 rados->read ofs=0 len=0 2024-03-04T12:46:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.963+0000 7f7c1829d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.963+0000 7f7c1829d800 10 cache put: name=default.rgw.meta+users.keys+XWJWIUZSUVUSWSSJMCZQ info.flags=0x0 2024-03-04T12:46:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.963+0000 7f7c1829d800 10 adding default.rgw.meta+users.keys+XWJWIUZSUVUSWSSJMCZQ to cache LRU end 2024-03-04T12:46:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.963+0000 7f7c1829d800 10 cache get: name=default.rgw.meta+users.keys+XWJWIUZSUVUSWSSJMCZQ : hit (negative entry) 2024-03-04T12:46:22.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.963+0000 7f7c1829d800 10 cache get: name=default.rgw.meta+users.keys+XWJWIUZSUVUSWSSJMCZQ : hit (negative entry) 2024-03-04T12:46:22.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.964+0000 7f7c1829d800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-04T12:46:22.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.964+0000 7f7c1829d800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-04T12:46:22.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.964+0000 7f7c1829d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-03-04T12:46:22.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.964+0000 7f7af97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758737 cookie 93946812844080 notifier 7713 bl.length()=715 2024-03-04T12:46:22.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.964+0000 7f7af97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-04T12:46:22.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.964+0000 7f7af97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-04T12:46:22.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.967+0000 7f7c1829d800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2024-03-04T12:46:22.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.967+0000 7f7c1829d800 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2024-03-04T12:46:22.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.967+0000 7f7c1829d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test, ofs0, ns] 2024-03-04T12:46:22.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.968+0000 7f7af97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758656 cookie 93946812850016 notifier 7713 bl.length()=224 2024-03-04T12:46:22.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.968+0000 7f7af97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2024-03-04T12:46:22.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.968+0000 7f7af97fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2024-03-04T12:46:22.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.970+0000 7f7c1829d800 10 cache put: name=default.rgw.meta+users.keys+XWJWIUZSUVUSWSSJMCZQ info.flags=0x7 2024-03-04T12:46:22.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.970+0000 7f7c1829d800 10 moving default.rgw.meta+users.keys+XWJWIUZSUVUSWSSJMCZQ to cache LRU end 2024-03-04T12:46:22.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.970+0000 7f7c1829d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:XWJWIUZSUVUSWSSJMCZQ, ofs0, ns] 2024-03-04T12:46:22.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.970+0000 7f7af8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758845 cookie 93946812839984 notifier 7713 bl.length()=201 2024-03-04T12:46:22.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.970+0000 7f7af8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XWJWIUZSUVUSWSSJMCZQ info.flags=0x7 2024-03-04T12:46:22.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.970+0000 7f7af8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XWJWIUZSUVUSWSSJMCZQ to cache LRU end 2024-03-04T12:46:22.978 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T12:46:22.978 INFO:teuthology.orchestra.run.smithi110.stdout: "user_id": "testx$tenanteduser.client.0", 2024-03-04T12:46:22.979 INFO:teuthology.orchestra.run.smithi110.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2024-03-04T12:46:22.979 INFO:teuthology.orchestra.run.smithi110.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2024-03-04T12:46:22.979 INFO:teuthology.orchestra.run.smithi110.stdout: "suspended": 0, 2024-03-04T12:46:22.979 INFO:teuthology.orchestra.run.smithi110.stdout: "max_buckets": 1000, 2024-03-04T12:46:22.979 INFO:teuthology.orchestra.run.smithi110.stdout: "subusers": [], 2024-03-04T12:46:22.979 INFO:teuthology.orchestra.run.smithi110.stdout: "keys": [ 2024-03-04T12:46:22.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:46:22.979 INFO:teuthology.orchestra.run.smithi110.stdout: "user": "testx$tenanteduser.client.0", 2024-03-04T12:46:22.979 INFO:teuthology.orchestra.run.smithi110.stdout: "access_key": "XWJWIUZSUVUSWSSJMCZQ", 2024-03-04T12:46:22.979 INFO:teuthology.orchestra.run.smithi110.stdout: "secret_key": "Ue+9DVsc0fc7k7zavfy7ZL0TcFokVO2VO8/b048RhKOodYg5Gvgcng==", 2024-03-04T12:46:22.979 INFO:teuthology.orchestra.run.smithi110.stdout: "active": true 2024-03-04T12:46:22.979 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-03-04T12:46:22.979 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-03-04T12:46:22.979 INFO:teuthology.orchestra.run.smithi110.stdout: "swift_keys": [], 2024-03-04T12:46:22.980 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": [ 2024-03-04T12:46:22.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:46:22.980 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "user-policy", 2024-03-04T12:46:22.980 INFO:teuthology.orchestra.run.smithi110.stdout: "perm": "*" 2024-03-04T12:46:22.980 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-03-04T12:46:22.980 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-03-04T12:46:22.980 INFO:teuthology.orchestra.run.smithi110.stdout: "op_mask": "read, write, delete", 2024-03-04T12:46:22.980 INFO:teuthology.orchestra.run.smithi110.stdout: "default_placement": "", 2024-03-04T12:46:22.980 INFO:teuthology.orchestra.run.smithi110.stdout: "default_storage_class": "", 2024-03-04T12:46:22.980 INFO:teuthology.orchestra.run.smithi110.stdout: "placement_tags": [], 2024-03-04T12:46:22.980 INFO:teuthology.orchestra.run.smithi110.stdout: "bucket_quota": { 2024-03-04T12:46:22.980 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:46:22.980 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:46:22.980 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:46:22.981 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:46:22.981 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:46:22.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:46:22.981 INFO:teuthology.orchestra.run.smithi110.stdout: "user_quota": { 2024-03-04T12:46:22.981 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:46:22.981 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:46:22.981 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:46:22.981 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:46:22.981 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:46:22.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:46:22.981 INFO:teuthology.orchestra.run.smithi110.stdout: "temp_url_keys": [], 2024-03-04T12:46:22.981 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "rgw", 2024-03-04T12:46:22.981 INFO:teuthology.orchestra.run.smithi110.stdout: "mfa_ids": [] 2024-03-04T12:46:22.981 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T12:46:22.982 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:22.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.972+0000 7f7abf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:22.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.975+0000 7f7c1829d800 20 remove_watcher() i=0 2024-03-04T12:46:22.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.975+0000 7f7c1829d800 2 removed watcher, disabling cache 2024-03-04T12:46:22.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.976+0000 7f7c1829d800 20 remove_watcher() i=1 2024-03-04T12:46:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.976+0000 7f7c1829d800 20 remove_watcher() i=2 2024-03-04T12:46:22.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.977+0000 7f7c1829d800 20 remove_watcher() i=3 2024-03-04T12:46:22.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.978+0000 7f7c1829d800 20 remove_watcher() i=4 2024-03-04T12:46:22.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.979+0000 7f7c1829d800 20 remove_watcher() i=5 2024-03-04T12:46:22.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.980+0000 7f7c1829d800 20 remove_watcher() i=6 2024-03-04T12:46:22.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:22.981+0000 7f7c1829d800 20 remove_watcher() i=7 2024-03-04T12:46:22.998 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 2774257005 --totp-seed XYPH36X66ETI7U4EXLR7JDU5T2AAGKYNDIQO3DTKPNCFXHL6HK4IQVTTE4W6LDAF --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-04T12:46:23.062 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:23.062 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:23.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.085+0000 7f5ba1224800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.086+0000 7f5ba1224800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.086+0000 7f5ba1224800 20 realm 2024-03-04T12:46:23.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.086+0000 7f5ba1224800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.086+0000 7f5ba1224800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.086+0000 7f5ba1224800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:23.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.086+0000 7f5ba1224800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.087+0000 7f5ba1224800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.087+0000 7f5ba1224800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.088+0000 7f5ba1224800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:23.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.088+0000 7f5ba1224800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.088+0000 7f5ba1224800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:23.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.088+0000 7f5ba1224800 20 searching for the correct realm 2024-03-04T12:46:23.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.091+0000 7f5b9f521640 0 -- 172.21.15.110:0/1247433053 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7f5b9406bc00 msgr2=0x7f5b94043020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:23.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.095+0000 7f5b9ed20640 0 -- 172.21.15.110:0/1247433053 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f5b94093b60 msgr2=0x7f5b94011330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:23.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.099+0000 7f5ba1224800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:46:23.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.099+0000 7f5ba1224800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:23.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.099+0000 7f5ba1224800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:46:23.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.099+0000 7f5ba1224800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:23.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.099+0000 7f5ba1224800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:23.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.099+0000 7f5ba1224800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:23.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.099+0000 7f5ba1224800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.100+0000 7f5ba1224800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.100+0000 7f5ba1224800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.100+0000 7f5ba1224800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:23.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.100+0000 7f5ba1224800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.100+0000 7f5ba1224800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:23.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.100+0000 7f5ba1224800 20 zone default found 2024-03-04T12:46:23.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.100+0000 7f5ba1224800 4 Realm: () 2024-03-04T12:46:23.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.100+0000 7f5ba1224800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:46:23.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.100+0000 7f5ba1224800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:46:23.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.100+0000 7f5ba1224800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:23.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.100+0000 7f5ba1224800 20 zonegroup default 2024-03-04T12:46:23.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.100+0000 7f5ba1224800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.100+0000 7f5ba1224800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.100+0000 7f5ba1224800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.101+0000 7f5ba1224800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.101+0000 7f5ba1224800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.101+0000 7f5ba1224800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.101+0000 7f5ba1224800 20 started sync module instance, tier type = 2024-03-04T12:46:23.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.101+0000 7f5ba1224800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:46:23.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.110+0000 7f5ba1224800 20 add_watcher() i=0 2024-03-04T12:46:23.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.110+0000 7f5ba1224800 20 add_watcher() i=1 2024-03-04T12:46:23.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.110+0000 7f5ba1224800 20 add_watcher() i=2 2024-03-04T12:46:23.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.110+0000 7f5ba1224800 20 add_watcher() i=3 2024-03-04T12:46:23.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.110+0000 7f5ba1224800 20 add_watcher() i=4 2024-03-04T12:46:23.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.110+0000 7f5ba1224800 20 add_watcher() i=5 2024-03-04T12:46:23.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.110+0000 7f5ba1224800 20 add_watcher() i=6 2024-03-04T12:46:23.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.111+0000 7f5ba1224800 20 add_watcher() i=7 2024-03-04T12:46:23.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.111+0000 7f5ba1224800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:23.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.113+0000 7f5a557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:23.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.113+0000 7f5ba1224800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:23.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.113+0000 7f5ba1224800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:23.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.113+0000 7f5ba1224800 5 note: GC not initialized 2024-03-04T12:46:23.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.113+0000 7f59cffff640 20 reqs_thread_entry: start 2024-03-04T12:46:23.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.113+0000 7f5ba1224800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:23.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.113+0000 7f5ba1224800 20 Filter name: none 2024-03-04T12:46:23.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.113+0000 7f59cdffb640 20 reqs_thread_entry: start 2024-03-04T12:46:23.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.113+0000 7f5ba1224800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-03-04T12:46:23.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.113+0000 7f5ba1224800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.113+0000 7f5ba1224800 20 rados_obj.operate() r=0 bl.length=515 2024-03-04T12:46:23.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.113+0000 7f5ba1224800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-03-04T12:46:23.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.113+0000 7f5ba1224800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-04T12:46:23.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.113+0000 7f5ba1224800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:23.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.116+0000 7f5ba1224800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-04T12:46:23.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.116+0000 7f5ba1224800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-04T12:46:23.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.116+0000 7f5ba1224800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-03-04T12:46:23.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.116+0000 7f5a81ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758738 cookie 93904581124688 notifier 7235 bl.length()=729 2024-03-04T12:46:23.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.116+0000 7f5a81ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-04T12:46:23.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.116+0000 7f5a81ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-04T12:46:23.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.118+0000 7f5a557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:23.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.121+0000 7f5ba1224800 20 remove_watcher() i=0 2024-03-04T12:46:23.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.121+0000 7f5ba1224800 2 removed watcher, disabling cache 2024-03-04T12:46:23.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.122+0000 7f5ba1224800 20 remove_watcher() i=1 2024-03-04T12:46:23.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.122+0000 7f5ba1224800 20 remove_watcher() i=2 2024-03-04T12:46:23.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.124+0000 7f5ba1224800 20 remove_watcher() i=3 2024-03-04T12:46:23.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.125+0000 7f5ba1224800 20 remove_watcher() i=4 2024-03-04T12:46:23.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.125+0000 7f5ba1224800 20 remove_watcher() i=5 2024-03-04T12:46:23.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.126+0000 7f5ba1224800 20 remove_watcher() i=6 2024-03-04T12:46:23.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.127+0000 7f5ba1224800 20 remove_watcher() i=7 2024-03-04T12:46:23.145 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-03-04T12:46:23.145 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name 'Mr. foobar.client.0' --email foobar.client.0+test@test.test --caps 'user-policy=*' --access-key WJYCOMGLNMIMCQLOGLYE --secret FNvTpYUWT+EKkcc2rmYA52okOkNTHR/7yqu/QMAuBHst4wi3moxSZg== --cluster ceph 2024-03-04T12:46:23.208 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:23.208 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:23.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.232+0000 7efee4da2800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.233+0000 7efee4da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.233+0000 7efee4da2800 20 realm 2024-03-04T12:46:23.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.233+0000 7efee4da2800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.233+0000 7efee4da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.233+0000 7efee4da2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:23.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.233+0000 7efee4da2800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.233+0000 7efee4da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.233+0000 7efee4da2800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.234+0000 7efee4da2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:23.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.234+0000 7efee4da2800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.234+0000 7efee4da2800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:23.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.234+0000 7efee4da2800 20 searching for the correct realm 2024-03-04T12:46:23.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.236+0000 7efee289e640 0 -- 172.21.15.110:0/3925088216 >> [v2:172.21.15.110:6800/2482344533,v1:172.21.15.110:6801/2482344533] conn(0x7efecc003bd0 msgr2=0x7efedc056d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:23.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.453+0000 7efee289e640 0 -- 172.21.15.110:0/3925088216 >> [v2:172.21.15.110:6800/2482344533,v1:172.21.15.110:6801/2482344533] conn(0x7efecc003bd0 msgr2=0x7efedc056d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:23.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.463+0000 7efee4da2800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:46:23.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.463+0000 7efee4da2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:23.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.463+0000 7efee4da2800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:46:23.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.463+0000 7efee4da2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:23.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.463+0000 7efee4da2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:23.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.463+0000 7efee4da2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:23.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.463+0000 7efee4da2800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.463+0000 7efee4da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.463+0000 7efee4da2800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.464+0000 7efee4da2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:23.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.464+0000 7efee4da2800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.464+0000 7efee4da2800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:23.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.464+0000 7efee4da2800 20 zone default found 2024-03-04T12:46:23.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.464+0000 7efee4da2800 4 Realm: () 2024-03-04T12:46:23.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.464+0000 7efee4da2800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:46:23.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.464+0000 7efee4da2800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:46:23.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.464+0000 7efee4da2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:23.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.464+0000 7efee4da2800 20 zonegroup default 2024-03-04T12:46:23.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.464+0000 7efee4da2800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.464+0000 7efee4da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.464+0000 7efee4da2800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.465+0000 7efee4da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.465+0000 7efee4da2800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.465+0000 7efee4da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.465+0000 7efee4da2800 20 started sync module instance, tier type = 2024-03-04T12:46:23.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.465+0000 7efee4da2800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:46:23.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.473+0000 7efee4da2800 20 add_watcher() i=0 2024-03-04T12:46:23.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.473+0000 7efee4da2800 20 add_watcher() i=1 2024-03-04T12:46:23.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.473+0000 7efee4da2800 20 add_watcher() i=2 2024-03-04T12:46:23.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.473+0000 7efee4da2800 20 add_watcher() i=3 2024-03-04T12:46:23.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.473+0000 7efee4da2800 20 add_watcher() i=4 2024-03-04T12:46:23.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.473+0000 7efee4da2800 20 add_watcher() i=5 2024-03-04T12:46:23.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.473+0000 7efee4da2800 20 add_watcher() i=6 2024-03-04T12:46:23.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.474+0000 7efee4da2800 20 add_watcher() i=7 2024-03-04T12:46:23.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.474+0000 7efee4da2800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:23.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.476+0000 7efd997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:23.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.476+0000 7efee4da2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:23.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.476+0000 7efee4da2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:23.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.476+0000 7efee4da2800 5 note: GC not initialized 2024-03-04T12:46:23.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.476+0000 7efd13fff640 20 reqs_thread_entry: start 2024-03-04T12:46:23.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.476+0000 7efee4da2800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:23.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.476+0000 7efee4da2800 20 Filter name: none 2024-03-04T12:46:23.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.476+0000 7efd11ffb640 20 reqs_thread_entry: start 2024-03-04T12:46:23.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.476+0000 7efee4da2800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-04T12:46:23.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.476+0000 7efee4da2800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.477+0000 7efee4da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.477+0000 7efee4da2800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-03-04T12:46:23.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.477+0000 7efee4da2800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:46:23.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.477+0000 7efee4da2800 10 cache get: name=default.rgw.meta+users.email+foobar.client.0+test@test.test : miss 2024-03-04T12:46:23.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.477+0000 7efee4da2800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.477+0000 7efee4da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.477+0000 7efee4da2800 10 cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x0 2024-03-04T12:46:23.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.477+0000 7efee4da2800 10 adding default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2024-03-04T12:46:23.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.477+0000 7efee4da2800 10 cache get: name=default.rgw.meta+users.keys+WJYCOMGLNMIMCQLOGLYE : miss 2024-03-04T12:46:23.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.477+0000 7efee4da2800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.477+0000 7efee4da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.477+0000 7efee4da2800 10 cache put: name=default.rgw.meta+users.keys+WJYCOMGLNMIMCQLOGLYE info.flags=0x0 2024-03-04T12:46:23.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.477+0000 7efee4da2800 10 adding default.rgw.meta+users.keys+WJYCOMGLNMIMCQLOGLYE to cache LRU end 2024-03-04T12:46:23.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.477+0000 7efee4da2800 10 cache get: name=default.rgw.meta+users.keys+WJYCOMGLNMIMCQLOGLYE : hit (negative entry) 2024-03-04T12:46:23.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.477+0000 7efee4da2800 10 cache get: name=default.rgw.meta+users.keys+WJYCOMGLNMIMCQLOGLYE : hit (negative entry) 2024-03-04T12:46:23.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.479+0000 7efee4da2800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-04T12:46:23.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.479+0000 7efee4da2800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:46:23.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.479+0000 7efee4da2800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-04T12:46:23.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.479+0000 7efdc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725953 cookie 93950239194032 notifier 7250 bl.length()=656 2024-03-04T12:46:23.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.479+0000 7efdc67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-04T12:46:23.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.479+0000 7efdc67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:46:23.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.482+0000 7efee4da2800 10 cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x7 2024-03-04T12:46:23.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.482+0000 7efee4da2800 10 moving default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2024-03-04T12:46:23.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.482+0000 7efee4da2800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:foobar.client.0+test@test.test, ofs0, ns] 2024-03-04T12:46:23.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.482+0000 7efdc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626726035 cookie 93950239176112 notifier 7250 bl.length()=200 2024-03-04T12:46:23.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.482+0000 7efdc67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x7 2024-03-04T12:46:23.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.482+0000 7efdc67fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2024-03-04T12:46:23.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.485+0000 7efee4da2800 10 cache put: name=default.rgw.meta+users.keys+WJYCOMGLNMIMCQLOGLYE info.flags=0x7 2024-03-04T12:46:23.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.485+0000 7efee4da2800 10 moving default.rgw.meta+users.keys+WJYCOMGLNMIMCQLOGLYE to cache LRU end 2024-03-04T12:46:23.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.485+0000 7efee4da2800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:WJYCOMGLNMIMCQLOGLYE, ofs0, ns] 2024-03-04T12:46:23.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.485+0000 7efdc5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725985 cookie 93950239181056 notifier 7250 bl.length()=189 2024-03-04T12:46:23.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.485+0000 7efdc5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WJYCOMGLNMIMCQLOGLYE info.flags=0x7 2024-03-04T12:46:23.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.485+0000 7efdc5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WJYCOMGLNMIMCQLOGLYE to cache LRU end 2024-03-04T12:46:23.493 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T12:46:23.493 INFO:teuthology.orchestra.run.smithi110.stdout: "user_id": "foobar.client.0", 2024-03-04T12:46:23.493 INFO:teuthology.orchestra.run.smithi110.stdout: "display_name": "Mr. foobar.client.0", 2024-03-04T12:46:23.493 INFO:teuthology.orchestra.run.smithi110.stdout: "email": "foobar.client.0+test@test.test", 2024-03-04T12:46:23.493 INFO:teuthology.orchestra.run.smithi110.stdout: "suspended": 0, 2024-03-04T12:46:23.493 INFO:teuthology.orchestra.run.smithi110.stdout: "max_buckets": 1000, 2024-03-04T12:46:23.493 INFO:teuthology.orchestra.run.smithi110.stdout: "subusers": [], 2024-03-04T12:46:23.493 INFO:teuthology.orchestra.run.smithi110.stdout: "keys": [ 2024-03-04T12:46:23.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:46:23.494 INFO:teuthology.orchestra.run.smithi110.stdout: "user": "foobar.client.0", 2024-03-04T12:46:23.494 INFO:teuthology.orchestra.run.smithi110.stdout: "access_key": "WJYCOMGLNMIMCQLOGLYE", 2024-03-04T12:46:23.494 INFO:teuthology.orchestra.run.smithi110.stdout: "secret_key": "FNvTpYUWT+EKkcc2rmYA52okOkNTHR/7yqu/QMAuBHst4wi3moxSZg==", 2024-03-04T12:46:23.494 INFO:teuthology.orchestra.run.smithi110.stdout: "active": true 2024-03-04T12:46:23.494 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-03-04T12:46:23.494 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-03-04T12:46:23.494 INFO:teuthology.orchestra.run.smithi110.stdout: "swift_keys": [], 2024-03-04T12:46:23.494 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": [ 2024-03-04T12:46:23.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:46:23.494 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "user-policy", 2024-03-04T12:46:23.494 INFO:teuthology.orchestra.run.smithi110.stdout: "perm": "*" 2024-03-04T12:46:23.494 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-03-04T12:46:23.494 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-03-04T12:46:23.494 INFO:teuthology.orchestra.run.smithi110.stdout: "op_mask": "read, write, delete", 2024-03-04T12:46:23.494 INFO:teuthology.orchestra.run.smithi110.stdout: "default_placement": "", 2024-03-04T12:46:23.495 INFO:teuthology.orchestra.run.smithi110.stdout: "default_storage_class": "", 2024-03-04T12:46:23.495 INFO:teuthology.orchestra.run.smithi110.stdout: "placement_tags": [], 2024-03-04T12:46:23.495 INFO:teuthology.orchestra.run.smithi110.stdout: "bucket_quota": { 2024-03-04T12:46:23.495 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:46:23.495 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:46:23.495 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:46:23.495 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:46:23.495 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:46:23.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:46:23.495 INFO:teuthology.orchestra.run.smithi110.stdout: "user_quota": { 2024-03-04T12:46:23.495 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:46:23.495 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:46:23.495 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:46:23.495 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:46:23.495 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:46:23.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:46:23.496 INFO:teuthology.orchestra.run.smithi110.stdout: "temp_url_keys": [], 2024-03-04T12:46:23.496 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "rgw", 2024-03-04T12:46:23.496 INFO:teuthology.orchestra.run.smithi110.stdout: "mfa_ids": [] 2024-03-04T12:46:23.496 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T12:46:23.496 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:23.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.487+0000 7efd997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:23.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.489+0000 7efee4da2800 20 remove_watcher() i=0 2024-03-04T12:46:23.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.489+0000 7efee4da2800 2 removed watcher, disabling cache 2024-03-04T12:46:23.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.490+0000 7efee4da2800 20 remove_watcher() i=1 2024-03-04T12:46:23.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.491+0000 7efee4da2800 20 remove_watcher() i=2 2024-03-04T12:46:23.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.492+0000 7efee4da2800 20 remove_watcher() i=3 2024-03-04T12:46:23.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.493+0000 7efee4da2800 20 remove_watcher() i=4 2024-03-04T12:46:23.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.494+0000 7efee4da2800 20 remove_watcher() i=5 2024-03-04T12:46:23.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.495+0000 7efee4da2800 20 remove_watcher() i=6 2024-03-04T12:46:23.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.496+0000 7efee4da2800 20 remove_watcher() i=7 2024-03-04T12:46:23.513 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 7044202251 --totp-seed ONMJ32CVM3DBZMH26BXUUMEYLMIBSOIR5OGG3BD4OAU4EURPDH4BC7O523CHRLSH --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-04T12:46:23.576 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:23.576 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:23.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.600+0000 7fb195211800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.601+0000 7fb195211800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.601+0000 7fb195211800 20 realm 2024-03-04T12:46:23.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.601+0000 7fb195211800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.601+0000 7fb195211800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.601+0000 7fb195211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:23.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.601+0000 7fb195211800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.601+0000 7fb195211800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:23.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.601+0000 7fb195211800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.602+0000 7fb195211800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:23.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.602+0000 7fb195211800 20 rados->read ofs=0 len=0 2024-03-04T12:46:23.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.602+0000 7fb195211800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:23.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.602+0000 7fb195211800 20 searching for the correct realm 2024-03-04T12:46:23.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.605+0000 7fb187fff640 0 -- 172.21.15.110:0/3283684538 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7fb18008f030 msgr2=0x7fb180091970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:46:23.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:23.810+0000 7fb1907de640 0 -- 172.21.15.110:0/3283684538 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fb1780606e0 msgr2=0x7fb1780763b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:46:24.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.017+0000 7fb195211800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:46:24.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.017+0000 7fb195211800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:24.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.017+0000 7fb195211800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:46:24.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.017+0000 7fb195211800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:24.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.017+0000 7fb195211800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:24.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.017+0000 7fb195211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:24.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.017+0000 7fb195211800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.017+0000 7fb195211800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.017+0000 7fb195211800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.017+0000 7fb195211800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:24.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.017+0000 7fb195211800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.018+0000 7fb195211800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:24.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.018+0000 7fb195211800 20 zone default found 2024-03-04T12:46:24.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.018+0000 7fb195211800 4 Realm: () 2024-03-04T12:46:24.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.018+0000 7fb195211800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:46:24.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.018+0000 7fb195211800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:46:24.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.018+0000 7fb195211800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:24.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.018+0000 7fb195211800 20 zonegroup default 2024-03-04T12:46:24.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.018+0000 7fb195211800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.018+0000 7fb195211800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.018+0000 7fb195211800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.019+0000 7fb195211800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.019+0000 7fb195211800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.019+0000 7fb195211800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.019+0000 7fb195211800 20 started sync module instance, tier type = 2024-03-04T12:46:24.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.019+0000 7fb195211800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:46:24.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.029+0000 7fb195211800 20 add_watcher() i=0 2024-03-04T12:46:24.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.029+0000 7fb195211800 20 add_watcher() i=1 2024-03-04T12:46:24.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.029+0000 7fb195211800 20 add_watcher() i=2 2024-03-04T12:46:24.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.029+0000 7fb195211800 20 add_watcher() i=3 2024-03-04T12:46:24.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.029+0000 7fb195211800 20 add_watcher() i=4 2024-03-04T12:46:24.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.029+0000 7fb195211800 20 add_watcher() i=5 2024-03-04T12:46:24.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.029+0000 7fb195211800 20 add_watcher() i=6 2024-03-04T12:46:24.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.031+0000 7fb195211800 20 add_watcher() i=7 2024-03-04T12:46:24.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.031+0000 7fb195211800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:24.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.033+0000 7fb046fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:24.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.033+0000 7fb195211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:24.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.033+0000 7fb195211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:24.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.033+0000 7fb195211800 5 note: GC not initialized 2024-03-04T12:46:24.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.033+0000 7fb045fdb640 20 reqs_thread_entry: start 2024-03-04T12:46:24.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.033+0000 7fb195211800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:24.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.033+0000 7fb195211800 20 Filter name: none 2024-03-04T12:46:24.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.033+0000 7fafb77fe640 20 reqs_thread_entry: start 2024-03-04T12:46:24.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.033+0000 7fb195211800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-04T12:46:24.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.033+0000 7fb195211800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.034+0000 7fb195211800 20 rados_obj.operate() r=0 bl.length=468 2024-03-04T12:46:24.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.034+0000 7fb195211800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-03-04T12:46:24.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.034+0000 7fb195211800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:46:24.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.034+0000 7fb195211800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:24.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.037+0000 7fb195211800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-04T12:46:24.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.037+0000 7fb195211800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:46:24.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.037+0000 7fb195211800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-04T12:46:24.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.037+0000 7fb0677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725954 cookie 94184877700544 notifier 7268 bl.length()=670 2024-03-04T12:46:24.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.037+0000 7fb0677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-04T12:46:24.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.037+0000 7fb0677fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:46:24.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.040+0000 7fb046fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:24.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.042+0000 7fb195211800 20 remove_watcher() i=0 2024-03-04T12:46:24.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.042+0000 7fb195211800 2 removed watcher, disabling cache 2024-03-04T12:46:24.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.043+0000 7fb195211800 20 remove_watcher() i=1 2024-03-04T12:46:24.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.044+0000 7fb195211800 20 remove_watcher() i=2 2024-03-04T12:46:24.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.045+0000 7fb195211800 20 remove_watcher() i=3 2024-03-04T12:46:24.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.046+0000 7fb195211800 20 remove_watcher() i=4 2024-03-04T12:46:24.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.047+0000 7fb195211800 20 remove_watcher() i=5 2024-03-04T12:46:24.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.049+0000 7fb195211800 20 remove_watcher() i=6 2024-03-04T12:46:24.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.050+0000 7fb195211800 20 remove_watcher() i=7 2024-03-04T12:46:24.068 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'roles=*' --cluster ceph 2024-03-04T12:46:24.127 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:24.127 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:24.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.151+0000 7fd8e3e2e800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.153+0000 7fd8e3e2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.153+0000 7fd8e3e2e800 20 realm 2024-03-04T12:46:24.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.153+0000 7fd8e3e2e800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.153+0000 7fd8e3e2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.153+0000 7fd8e3e2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:24.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.153+0000 7fd8e3e2e800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.153+0000 7fd8e3e2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.153+0000 7fd8e3e2e800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.154+0000 7fd8e3e2e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:24.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.154+0000 7fd8e3e2e800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.154+0000 7fd8e3e2e800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:24.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.154+0000 7fd8e3e2e800 20 searching for the correct realm 2024-03-04T12:46:24.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.157+0000 7fd8df890640 0 -- 172.21.15.110:0/2608646186 >> [v2:172.21.15.172:6816/486554607,v1:172.21.15.172:6817/486554607] conn(0x7fd8d4008430 msgr2=0x7fd8d4008850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-04T12:46:24.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.161+0000 7fd8df08f640 0 -- 172.21.15.110:0/2608646186 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7fd8d4038440 msgr2=0x7fd8d40388c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:24.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.367+0000 7fd8e3e2e800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:46:24.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.367+0000 7fd8e3e2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:24.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.367+0000 7fd8e3e2e800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:46:24.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.367+0000 7fd8e3e2e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:24.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.367+0000 7fd8e3e2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:24.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.367+0000 7fd8e3e2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:24.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.367+0000 7fd8e3e2e800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.368+0000 7fd8e3e2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.368+0000 7fd8e3e2e800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.368+0000 7fd8e3e2e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:24.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.368+0000 7fd8e3e2e800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.368+0000 7fd8e3e2e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:24.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.368+0000 7fd8e3e2e800 20 zone default found 2024-03-04T12:46:24.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.368+0000 7fd8e3e2e800 4 Realm: () 2024-03-04T12:46:24.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.368+0000 7fd8e3e2e800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:46:24.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.368+0000 7fd8e3e2e800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:46:24.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.368+0000 7fd8e3e2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:24.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.368+0000 7fd8e3e2e800 20 zonegroup default 2024-03-04T12:46:24.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.368+0000 7fd8e3e2e800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.369+0000 7fd8e3e2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.369+0000 7fd8e3e2e800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.369+0000 7fd8e3e2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.369+0000 7fd8e3e2e800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.369+0000 7fd8e3e2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.369+0000 7fd8e3e2e800 20 started sync module instance, tier type = 2024-03-04T12:46:24.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.369+0000 7fd8e3e2e800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:46:24.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.378+0000 7fd8e3e2e800 20 add_watcher() i=0 2024-03-04T12:46:24.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.378+0000 7fd8e3e2e800 20 add_watcher() i=1 2024-03-04T12:46:24.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.378+0000 7fd8e3e2e800 20 add_watcher() i=2 2024-03-04T12:46:24.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.378+0000 7fd8e3e2e800 20 add_watcher() i=3 2024-03-04T12:46:24.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.378+0000 7fd8e3e2e800 20 add_watcher() i=4 2024-03-04T12:46:24.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.378+0000 7fd8e3e2e800 20 add_watcher() i=5 2024-03-04T12:46:24.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.378+0000 7fd8e3e2e800 20 add_watcher() i=6 2024-03-04T12:46:24.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.379+0000 7fd8e3e2e800 20 add_watcher() i=7 2024-03-04T12:46:24.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.379+0000 7fd8e3e2e800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:24.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.381+0000 7fd795fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:24.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.381+0000 7fd8e3e2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:24.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.381+0000 7fd8e3e2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:24.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.381+0000 7fd8e3e2e800 5 note: GC not initialized 2024-03-04T12:46:24.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.381+0000 7fd794fe1640 20 reqs_thread_entry: start 2024-03-04T12:46:24.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.382+0000 7fd8e3e2e800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:24.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.382+0000 7fd8e3e2e800 20 Filter name: none 2024-03-04T12:46:24.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.382+0000 7fd70e7fc640 20 reqs_thread_entry: start 2024-03-04T12:46:24.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.382+0000 7fd8e3e2e800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-04T12:46:24.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.382+0000 7fd8e3e2e800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.382+0000 7fd8e3e2e800 20 rados_obj.operate() r=0 bl.length=482 2024-03-04T12:46:24.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.382+0000 7fd8e3e2e800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-03-04T12:46:24.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.382+0000 7fd8e3e2e800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:46:24.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.382+0000 7fd8e3e2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:24.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.383+0000 7fd8e3e2e800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-04T12:46:24.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.383+0000 7fd8e3e2e800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:46:24.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.383+0000 7fd8e3e2e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-04T12:46:24.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.384+0000 7fd7c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725955 cookie 94587445395696 notifier 7286 bl.length()=683 2024-03-04T12:46:24.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.384+0000 7fd7c2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-04T12:46:24.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.384+0000 7fd7c2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:46:24.392 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T12:46:24.392 INFO:teuthology.orchestra.run.smithi110.stdout: "user_id": "foobar.client.0", 2024-03-04T12:46:24.392 INFO:teuthology.orchestra.run.smithi110.stdout: "display_name": "Mr. foobar.client.0", 2024-03-04T12:46:24.392 INFO:teuthology.orchestra.run.smithi110.stdout: "email": "foobar.client.0+test@test.test", 2024-03-04T12:46:24.392 INFO:teuthology.orchestra.run.smithi110.stdout: "suspended": 0, 2024-03-04T12:46:24.392 INFO:teuthology.orchestra.run.smithi110.stdout: "max_buckets": 1000, 2024-03-04T12:46:24.392 INFO:teuthology.orchestra.run.smithi110.stdout: "subusers": [], 2024-03-04T12:46:24.392 INFO:teuthology.orchestra.run.smithi110.stdout: "keys": [ 2024-03-04T12:46:24.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:46:24.393 INFO:teuthology.orchestra.run.smithi110.stdout: "user": "foobar.client.0", 2024-03-04T12:46:24.393 INFO:teuthology.orchestra.run.smithi110.stdout: "access_key": "WJYCOMGLNMIMCQLOGLYE", 2024-03-04T12:46:24.393 INFO:teuthology.orchestra.run.smithi110.stdout: "secret_key": "FNvTpYUWT+EKkcc2rmYA52okOkNTHR/7yqu/QMAuBHst4wi3moxSZg==", 2024-03-04T12:46:24.393 INFO:teuthology.orchestra.run.smithi110.stdout: "active": true 2024-03-04T12:46:24.393 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-03-04T12:46:24.393 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-03-04T12:46:24.393 INFO:teuthology.orchestra.run.smithi110.stdout: "swift_keys": [], 2024-03-04T12:46:24.393 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": [ 2024-03-04T12:46:24.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:46:24.393 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "roles", 2024-03-04T12:46:24.393 INFO:teuthology.orchestra.run.smithi110.stdout: "perm": "*" 2024-03-04T12:46:24.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:46:24.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:46:24.393 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "user-policy", 2024-03-04T12:46:24.394 INFO:teuthology.orchestra.run.smithi110.stdout: "perm": "*" 2024-03-04T12:46:24.394 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-03-04T12:46:24.394 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-03-04T12:46:24.394 INFO:teuthology.orchestra.run.smithi110.stdout: "op_mask": "read, write, delete", 2024-03-04T12:46:24.394 INFO:teuthology.orchestra.run.smithi110.stdout: "default_placement": "", 2024-03-04T12:46:24.394 INFO:teuthology.orchestra.run.smithi110.stdout: "default_storage_class": "", 2024-03-04T12:46:24.394 INFO:teuthology.orchestra.run.smithi110.stdout: "placement_tags": [], 2024-03-04T12:46:24.394 INFO:teuthology.orchestra.run.smithi110.stdout: "bucket_quota": { 2024-03-04T12:46:24.394 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:46:24.394 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:46:24.394 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:46:24.394 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:46:24.394 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:46:24.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:46:24.394 INFO:teuthology.orchestra.run.smithi110.stdout: "user_quota": { 2024-03-04T12:46:24.394 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:46:24.395 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:46:24.395 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:46:24.395 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:46:24.395 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:46:24.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:46:24.395 INFO:teuthology.orchestra.run.smithi110.stdout: "temp_url_keys": [], 2024-03-04T12:46:24.395 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "rgw", 2024-03-04T12:46:24.395 INFO:teuthology.orchestra.run.smithi110.stdout: "mfa_ids": [ 2024-03-04T12:46:24.395 INFO:teuthology.orchestra.run.smithi110.stdout: "7044202251" 2024-03-04T12:46:24.395 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-03-04T12:46:24.395 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T12:46:24.395 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:24.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.386+0000 7fd795fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:24.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.389+0000 7fd8e3e2e800 20 remove_watcher() i=0 2024-03-04T12:46:24.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.389+0000 7fd8e3e2e800 2 removed watcher, disabling cache 2024-03-04T12:46:24.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.390+0000 7fd8e3e2e800 20 remove_watcher() i=1 2024-03-04T12:46:24.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.391+0000 7fd8e3e2e800 20 remove_watcher() i=2 2024-03-04T12:46:24.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.392+0000 7fd8e3e2e800 20 remove_watcher() i=3 2024-03-04T12:46:24.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.393+0000 7fd8e3e2e800 20 remove_watcher() i=4 2024-03-04T12:46:24.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.394+0000 7fd8e3e2e800 20 remove_watcher() i=5 2024-03-04T12:46:24.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.395+0000 7fd8e3e2e800 20 remove_watcher() i=6 2024-03-04T12:46:24.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.396+0000 7fd8e3e2e800 20 remove_watcher() i=7 2024-03-04T12:46:24.413 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*' --cluster ceph 2024-03-04T12:46:24.467 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T12:46:24.467 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T12:46:24.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.490+0000 7f26b6c15800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.491+0000 7f26b6c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.491+0000 7f26b6c15800 20 realm 2024-03-04T12:46:24.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.491+0000 7f26b6c15800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.491+0000 7f26b6c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.491+0000 7f26b6c15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T12:46:24.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.491+0000 7f26b6c15800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.491+0000 7f26b6c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.491+0000 7f26b6c15800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.492+0000 7f26b6c15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:24.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.492+0000 7f26b6c15800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.493+0000 7f26b6c15800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T12:46:24.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.493+0000 7f26b6c15800 20 searching for the correct realm 2024-03-04T12:46:24.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.697+0000 7f26b19dd640 0 -- 172.21.15.110:0/2061479193 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f269c06ebb0 msgr2=0x7f269c058510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:24.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.701+0000 7f26b21de640 0 -- 172.21.15.110:0/2061479193 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f26a4093400 msgr2=0x7f26a4082310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T12:46:24.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.908+0000 7f26b6c15800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T12:46:24.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.908+0000 7f26b6c15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T12:46:24.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.908+0000 7f26b6c15800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T12:46:24.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.908+0000 7f26b6c15800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T12:46:24.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.908+0000 7f26b6c15800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T12:46:24.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.908+0000 7f26b6c15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T12:46:24.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.908+0000 7f26b6c15800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.908+0000 7f26b6c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.908+0000 7f26b6c15800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.909+0000 7f26b6c15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T12:46:24.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.909+0000 7f26b6c15800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.909+0000 7f26b6c15800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T12:46:24.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.909+0000 7f26b6c15800 20 zone default found 2024-03-04T12:46:24.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.909+0000 7f26b6c15800 4 Realm: () 2024-03-04T12:46:24.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.909+0000 7f26b6c15800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T12:46:24.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.909+0000 7f26b6c15800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T12:46:24.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.909+0000 7f26b6c15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T12:46:24.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.909+0000 7f26b6c15800 20 zonegroup default 2024-03-04T12:46:24.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.909+0000 7f26b6c15800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.909+0000 7f26b6c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.909+0000 7f26b6c15800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.910+0000 7f26b6c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.910+0000 7f26b6c15800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.910+0000 7f26b6c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T12:46:24.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.910+0000 7f26b6c15800 20 started sync module instance, tier type = 2024-03-04T12:46:24.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.910+0000 7f26b6c15800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T12:46:24.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.920+0000 7f26b6c15800 20 add_watcher() i=0 2024-03-04T12:46:24.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.920+0000 7f26b6c15800 20 add_watcher() i=1 2024-03-04T12:46:24.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.920+0000 7f26b6c15800 20 add_watcher() i=2 2024-03-04T12:46:24.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.920+0000 7f26b6c15800 20 add_watcher() i=3 2024-03-04T12:46:24.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.920+0000 7f26b6c15800 20 add_watcher() i=4 2024-03-04T12:46:24.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.920+0000 7f26b6c15800 20 add_watcher() i=5 2024-03-04T12:46:24.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.920+0000 7f26b6c15800 20 add_watcher() i=6 2024-03-04T12:46:24.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.921+0000 7f26b6c15800 20 add_watcher() i=7 2024-03-04T12:46:24.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.921+0000 7f26b6c15800 2 all 8 watchers are set, enabling cache 2024-03-04T12:46:24.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.923+0000 7f2568fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:24.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.923+0000 7f26b6c15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T12:46:24.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.923+0000 7f26b6c15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T12:46:24.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.923+0000 7f26b6c15800 5 note: GC not initialized 2024-03-04T12:46:24.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.923+0000 7f24e37fe640 20 reqs_thread_entry: start 2024-03-04T12:46:24.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.923+0000 7f26b6c15800 20 init_complete bucket index max shards: 11 2024-03-04T12:46:24.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.923+0000 7f26b6c15800 20 Filter name: none 2024-03-04T12:46:24.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.923+0000 7f24e17fa640 20 reqs_thread_entry: start 2024-03-04T12:46:24.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.923+0000 7f26b6c15800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-04T12:46:24.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.923+0000 7f26b6c15800 20 rados->read ofs=0 len=0 2024-03-04T12:46:24.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.924+0000 7f26b6c15800 20 rados_obj.operate() r=0 bl.length=495 2024-03-04T12:46:24.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.924+0000 7f26b6c15800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-03-04T12:46:24.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.924+0000 7f26b6c15800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:46:24.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.924+0000 7f26b6c15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T12:46:24.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.925+0000 7f26b6c15800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-04T12:46:24.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.925+0000 7f26b6c15800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:46:24.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.925+0000 7f26b6c15800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-04T12:46:24.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.925+0000 7f2595ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725956 cookie 94526450871472 notifier 7806 bl.length()=704 2024-03-04T12:46:24.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.925+0000 7f2595ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-04T12:46:24.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.925+0000 7f2595ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-04T12:46:24.934 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T12:46:24.934 INFO:teuthology.orchestra.run.smithi110.stdout: "user_id": "foobar.client.0", 2024-03-04T12:46:24.934 INFO:teuthology.orchestra.run.smithi110.stdout: "display_name": "Mr. foobar.client.0", 2024-03-04T12:46:24.934 INFO:teuthology.orchestra.run.smithi110.stdout: "email": "foobar.client.0+test@test.test", 2024-03-04T12:46:24.934 INFO:teuthology.orchestra.run.smithi110.stdout: "suspended": 0, 2024-03-04T12:46:24.934 INFO:teuthology.orchestra.run.smithi110.stdout: "max_buckets": 1000, 2024-03-04T12:46:24.934 INFO:teuthology.orchestra.run.smithi110.stdout: "subusers": [], 2024-03-04T12:46:24.934 INFO:teuthology.orchestra.run.smithi110.stdout: "keys": [ 2024-03-04T12:46:24.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:46:24.934 INFO:teuthology.orchestra.run.smithi110.stdout: "user": "foobar.client.0", 2024-03-04T12:46:24.934 INFO:teuthology.orchestra.run.smithi110.stdout: "access_key": "WJYCOMGLNMIMCQLOGLYE", 2024-03-04T12:46:24.935 INFO:teuthology.orchestra.run.smithi110.stdout: "secret_key": "FNvTpYUWT+EKkcc2rmYA52okOkNTHR/7yqu/QMAuBHst4wi3moxSZg==", 2024-03-04T12:46:24.935 INFO:teuthology.orchestra.run.smithi110.stdout: "active": true 2024-03-04T12:46:24.935 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-03-04T12:46:24.935 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-03-04T12:46:24.935 INFO:teuthology.orchestra.run.smithi110.stdout: "swift_keys": [], 2024-03-04T12:46:24.935 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": [ 2024-03-04T12:46:24.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:46:24.935 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "oidc-provider", 2024-03-04T12:46:24.935 INFO:teuthology.orchestra.run.smithi110.stdout: "perm": "*" 2024-03-04T12:46:24.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:46:24.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:46:24.935 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "roles", 2024-03-04T12:46:24.936 INFO:teuthology.orchestra.run.smithi110.stdout: "perm": "*" 2024-03-04T12:46:24.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:46:24.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-03-04T12:46:24.936 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "user-policy", 2024-03-04T12:46:24.936 INFO:teuthology.orchestra.run.smithi110.stdout: "perm": "*" 2024-03-04T12:46:24.936 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-03-04T12:46:24.936 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-03-04T12:46:24.936 INFO:teuthology.orchestra.run.smithi110.stdout: "op_mask": "read, write, delete", 2024-03-04T12:46:24.936 INFO:teuthology.orchestra.run.smithi110.stdout: "default_placement": "", 2024-03-04T12:46:24.936 INFO:teuthology.orchestra.run.smithi110.stdout: "default_storage_class": "", 2024-03-04T12:46:24.936 INFO:teuthology.orchestra.run.smithi110.stdout: "placement_tags": [], 2024-03-04T12:46:24.936 INFO:teuthology.orchestra.run.smithi110.stdout: "bucket_quota": { 2024-03-04T12:46:24.937 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:46:24.937 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:46:24.937 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:46:24.937 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:46:24.937 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:46:24.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:46:24.937 INFO:teuthology.orchestra.run.smithi110.stdout: "user_quota": { 2024-03-04T12:46:24.937 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": false, 2024-03-04T12:46:24.937 INFO:teuthology.orchestra.run.smithi110.stdout: "check_on_raw": false, 2024-03-04T12:46:24.937 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size": -1, 2024-03-04T12:46:24.937 INFO:teuthology.orchestra.run.smithi110.stdout: "max_size_kb": 0, 2024-03-04T12:46:24.937 INFO:teuthology.orchestra.run.smithi110.stdout: "max_objects": -1 2024-03-04T12:46:24.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-03-04T12:46:24.938 INFO:teuthology.orchestra.run.smithi110.stdout: "temp_url_keys": [], 2024-03-04T12:46:24.938 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "rgw", 2024-03-04T12:46:24.938 INFO:teuthology.orchestra.run.smithi110.stdout: "mfa_ids": [ 2024-03-04T12:46:24.938 INFO:teuthology.orchestra.run.smithi110.stdout: "7044202251" 2024-03-04T12:46:24.938 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-03-04T12:46:24.938 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T12:46:24.938 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:46:24.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.928+0000 7f2568fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T12:46:24.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.930+0000 7f26b6c15800 20 remove_watcher() i=0 2024-03-04T12:46:24.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.930+0000 7f26b6c15800 2 removed watcher, disabling cache 2024-03-04T12:46:24.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.932+0000 7f26b6c15800 20 remove_watcher() i=1 2024-03-04T12:46:24.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.933+0000 7f26b6c15800 20 remove_watcher() i=2 2024-03-04T12:46:24.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.934+0000 7f26b6c15800 20 remove_watcher() i=3 2024-03-04T12:46:24.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.935+0000 7f26b6c15800 20 remove_watcher() i=4 2024-03-04T12:46:24.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.936+0000 7f26b6c15800 20 remove_watcher() i=5 2024-03-04T12:46:24.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.937+0000 7f26b6c15800 20 remove_watcher() i=6 2024-03-04T12:46:24.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T12:46:24.938+0000 7f26b6c15800 20 remove_watcher() i=7 2024-03-04T12:46:24.955 INFO:tasks.s3tests:Configuring s3-tests... 2024-03-04T12:46:24.956 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:46:24.956 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-03-04T12:46:24.983 INFO:tasks.s3tests:Configuring boto... 2024-03-04T12:46:24.984 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-04T12:46:24.984 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-03-04T12:46:25.051 DEBUG:teuthology.orchestra.run.smithi110:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-03-04T12:46:25.218 INFO:teuthology.orchestra.run.smithi110.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-03-04T12:46:25.394 INFO:teuthology.orchestra.run.smithi110.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-03-04T12:46:25.628 INFO:teuthology.orchestra.run.smithi110.stdout:py installdeps: -rrequirements.txt 2024-03-04T12:48:09.525 INFO:teuthology.orchestra.run.smithi110.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-03-04T12:48:11.184 INFO:teuthology.orchestra.run.smithi110.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.3.3,certifi==2024.2.2,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.0,filelock==3.13.1,gevent==24.2.1,greenlet==3.0.3,httplib2==0.22.0,idna==3.6,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.1.0,munch==4.0.0,packaging==23.2,platformdirs==4.2.0,pluggy==1.4.0,pyparsing==3.1.1,pyproject-api==1.6.1,pytest==8.1.0,python-dateutil==2.9.0.post0,pytz==2024.1,PyYAML==6.0.1,requests==2.31.0,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=b8f3610fb10c5301308bc650c246cbf02de16937dc4ce7d796e0010bfe18055c,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.13.0,urllib3==1.26.18,virtualenv==20.25.1,zope.event==5.0,zope.interface==6.2 2024-03-04T12:48:11.184 INFO:teuthology.orchestra.run.smithi110.stdout:py run-test-pre: PYTHONHASHSEED='1637854101' 2024-03-04T12:48:11.184 INFO:teuthology.orchestra.run.smithi110.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-03-04T12:48:11.330 INFO:teuthology.orchestra.run.smithi110.stdout:============================= test session starts ============================== 2024-03-04T12:48:11.330 INFO:teuthology.orchestra.run.smithi110.stdout:platform linux -- Python 3.9.17, pytest-8.1.0, pluggy-1.4.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-03-04T12:48:11.330 INFO:teuthology.orchestra.run.smithi110.stdout:cachedir: .tox/py/.pytest_cache 2024-03-04T12:48:11.330 INFO:teuthology.orchestra.run.smithi110.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-03-04T12:48:11.330 INFO:teuthology.orchestra.run.smithi110.stdout:configfile: pytest.ini 2024-03-04T12:48:12.890 INFO:teuthology.orchestra.run.smithi110.stdout:collecting ... collected 787 items / 124 deselected / 663 selected 2024-03-04T12:48:12.890 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T12:48:13.598 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none FAILED [ 0%] 2024-03-04T12:48:13.974 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty FAILED [ 0%] 2024-03-04T12:48:14.345 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-03-04T12:48:14.707 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-03-04T12:48:15.079 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none FAILED [ 0%] 2024-03-04T12:48:15.367 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-03-04T12:48:15.787 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 1%] 2024-03-04T12:48:16.076 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-03-04T12:48:16.376 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty FAILED [ 1%] 2024-03-04T12:48:16.671 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none FAILED [ 1%] 2024-03-04T12:48:17.049 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 FAILED [ 1%] 2024-03-04T12:48:17.423 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 FAILED [ 1%] 2024-03-04T12:48:17.797 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 FAILED [ 1%] 2024-03-04T12:48:18.175 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 FAILED [ 2%] 2024-03-04T12:48:18.476 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 FAILED [ 2%] 2024-03-04T12:48:18.796 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 FAILED [ 2%] 2024-03-04T12:48:18.874 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-03-04T12:48:18.951 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-03-04T12:48:19.028 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-03-04T12:48:19.107 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 3%] 2024-03-04T12:48:19.185 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 3%] 2024-03-04T12:48:19.263 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 3%] 2024-03-04T12:48:19.341 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-03-04T12:48:19.418 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-03-04T12:48:19.495 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-03-04T12:48:19.574 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-03-04T12:48:19.651 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 4%] 2024-03-04T12:48:19.730 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 4%] 2024-03-04T12:48:19.809 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 4%] 2024-03-04T12:48:19.887 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-03-04T12:48:19.965 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-03-04T12:48:20.044 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-03-04T12:48:20.124 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-03-04T12:48:20.202 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 5%] 2024-03-04T12:48:20.280 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 5%] 2024-03-04T12:48:20.358 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 5%] 2024-03-04T12:48:20.436 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 5%] 2024-03-04T12:48:20.515 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-03-04T12:48:20.593 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-03-04T12:48:20.676 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 6%] 2024-03-04T12:48:20.753 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 6%] 2024-03-04T12:48:20.835 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 6%] 2024-03-04T12:48:20.913 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 6%] 2024-03-04T12:48:20.991 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 6%] 2024-03-04T12:48:21.069 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-03-04T12:48:21.147 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-03-04T12:48:21.228 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 7%] 2024-03-04T12:48:21.306 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 7%] 2024-03-04T12:48:21.385 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 7%] 2024-03-04T12:48:21.464 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 7%] 2024-03-04T12:48:21.544 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 7%] 2024-03-04T12:48:21.624 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 7%] 2024-03-04T12:48:21.702 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-03-04T12:48:22.568 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 8%] 2024-03-04T12:48:30.957 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 8%] 2024-03-04T12:48:38.499 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 8%] 2024-03-04T12:48:54.197 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 8%] 2024-03-04T12:49:14.837 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 8%] 2024-03-04T12:49:21.182 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 8%] 2024-03-04T12:49:26.796 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 9%] 2024-03-04T12:49:28.420 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 9%] 2024-03-04T12:49:28.791 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 9%] 2024-03-04T12:49:29.734 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 9%] 2024-03-04T12:49:31.096 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 9%] 2024-03-04T12:49:32.348 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 9%] 2024-03-04T12:49:33.002 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 9%] 2024-03-04T12:49:33.660 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 10%] 2024-03-04T12:49:33.661 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 10%] 2024-03-04T12:49:33.662 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 10%] 2024-03-04T12:49:33.662 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 10%] 2024-03-04T12:49:33.663 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 10%] 2024-03-04T12:49:33.665 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 10%] 2024-03-04T12:49:33.666 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 11%] 2024-03-04T12:49:33.667 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 11%] 2024-03-04T12:49:33.668 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 11%] 2024-03-04T12:49:33.670 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 11%] 2024-03-04T12:49:33.671 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 11%] 2024-03-04T12:49:33.673 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 11%] 2024-03-04T12:49:33.674 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 11%] 2024-03-04T12:49:33.675 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 12%] 2024-03-04T12:49:33.677 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 12%] 2024-03-04T12:49:33.678 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 12%] 2024-03-04T12:49:33.679 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 12%] 2024-03-04T12:49:33.680 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 12%] 2024-03-04T12:49:33.682 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 12%] 2024-03-04T12:49:33.683 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 12%] 2024-03-04T12:49:33.684 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 13%] 2024-03-04T12:49:33.686 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 13%] 2024-03-04T12:49:33.688 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 13%] 2024-03-04T12:49:33.689 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 13%] 2024-03-04T12:49:33.690 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 13%] 2024-03-04T12:49:33.691 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 13%] 2024-03-04T12:49:33.693 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 14%] 2024-03-04T12:49:33.694 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 14%] 2024-03-04T12:49:33.765 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 14%] 2024-03-04T12:49:33.781 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 14%] 2024-03-04T12:49:34.948 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 14%] 2024-03-04T12:49:44.540 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 14%] 2024-03-04T12:49:45.285 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 14%] 2024-03-04T12:49:46.197 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 15%] 2024-03-04T12:49:47.131 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 15%] 2024-03-04T12:49:48.039 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 15%] 2024-03-04T12:49:48.955 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 15%] 2024-03-04T12:49:49.716 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 15%] 2024-03-04T12:49:50.665 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 15%] 2024-03-04T12:49:51.487 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 15%] 2024-03-04T12:49:52.309 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 16%] 2024-03-04T12:49:53.049 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 16%] 2024-03-04T12:49:53.702 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 16%] 2024-03-04T12:49:54.360 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 16%] 2024-03-04T12:49:54.826 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 16%] 2024-03-04T12:49:55.582 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 16%] 2024-03-04T12:49:56.409 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 17%] 2024-03-04T12:49:57.268 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 17%] 2024-03-04T12:49:58.024 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 17%] 2024-03-04T12:49:58.772 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 17%] 2024-03-04T12:49:59.536 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 17%] 2024-03-04T12:50:00.288 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 17%] 2024-03-04T12:50:01.041 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 17%] 2024-03-04T12:50:01.687 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 18%] 2024-03-04T12:50:02.358 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 18%] 2024-03-04T12:50:02.824 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 18%] 2024-03-04T12:50:03.337 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 18%] 2024-03-04T12:50:03.800 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 18%] 2024-03-04T12:50:04.264 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 18%] 2024-03-04T12:50:04.731 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 19%] 2024-03-04T12:50:05.588 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 19%] 2024-03-04T12:50:06.057 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 19%] 2024-03-04T12:50:06.558 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 19%] 2024-03-04T12:50:07.174 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 19%] 2024-03-04T12:50:07.785 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 19%] 2024-03-04T12:50:08.249 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 19%] 2024-03-04T12:50:08.885 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 20%] 2024-03-04T12:50:09.483 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 20%] 2024-03-04T12:50:10.228 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 20%] 2024-03-04T12:50:10.782 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 20%] 2024-03-04T12:50:11.378 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 20%] 2024-03-04T12:50:11.976 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 20%] 2024-03-04T12:50:12.893 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 20%] 2024-03-04T12:50:13.786 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 21%] 2024-03-04T12:50:14.591 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 21%] 2024-03-04T12:50:15.596 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 21%] 2024-03-04T12:50:16.602 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 21%] 2024-03-04T12:50:18.465 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 21%] 2024-03-04T12:50:20.303 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 21%] 2024-03-04T12:50:21.350 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 22%] 2024-03-04T12:50:22.363 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 22%] 2024-03-04T12:50:23.206 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 22%] 2024-03-04T12:50:24.251 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 22%] 2024-03-04T12:50:24.942 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 22%] 2024-03-04T12:50:25.960 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 22%] 2024-03-04T12:50:27.045 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 22%] 2024-03-04T12:50:28.012 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 23%] 2024-03-04T12:50:28.968 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 23%] 2024-03-04T12:50:29.878 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 23%] 2024-03-04T12:50:30.841 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 23%] 2024-03-04T12:50:31.782 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 23%] 2024-03-04T12:50:32.721 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 23%] 2024-03-04T12:50:33.659 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 23%] 2024-03-04T12:50:35.245 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 24%] 2024-03-04T12:50:36.901 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 24%] 2024-03-04T12:50:37.748 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 24%] 2024-03-04T12:50:38.588 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 24%] 2024-03-04T12:50:39.516 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 24%] 2024-03-04T12:50:40.449 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 24%] 2024-03-04T12:50:42.047 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 25%] 2024-03-04T12:50:43.697 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 25%] 2024-03-04T12:50:44.633 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 25%] 2024-03-04T12:50:45.558 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 25%] 2024-03-04T12:50:46.475 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 25%] 2024-03-04T12:50:47.410 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 25%] 2024-03-04T12:50:48.327 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 25%] 2024-03-04T12:50:49.297 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 26%] 2024-03-04T12:50:50.329 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 26%] 2024-03-04T12:50:51.327 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 26%] 2024-03-04T12:50:52.274 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 26%] 2024-03-04T12:50:53.222 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 26%] 2024-03-04T12:50:54.134 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 26%] 2024-03-04T12:50:55.073 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 26%] 2024-03-04T12:50:55.997 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 27%] 2024-03-04T12:50:56.879 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 27%] 2024-03-04T12:50:57.781 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 27%] 2024-03-04T12:50:58.702 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 27%] 2024-03-04T12:50:59.632 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 27%] 2024-03-04T12:51:38.239 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 27%] 2024-03-04T12:51:39.140 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 28%] 2024-03-04T12:51:40.034 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 28%] 2024-03-04T12:51:40.962 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 28%] 2024-03-04T12:51:41.872 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 28%] 2024-03-04T12:51:42.798 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 28%] 2024-03-04T12:51:43.690 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 28%] 2024-03-04T12:51:44.575 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 28%] 2024-03-04T12:51:45.475 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 29%] 2024-03-04T12:51:46.401 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 29%] 2024-03-04T12:51:47.318 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 29%] 2024-03-04T12:51:48.224 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 29%] 2024-03-04T12:51:49.111 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 29%] 2024-03-04T12:51:50.043 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 29%] 2024-03-04T12:51:50.973 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 30%] 2024-03-04T12:51:51.918 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 30%] 2024-03-04T12:51:52.895 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 30%] 2024-03-04T12:51:53.828 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 30%] 2024-03-04T12:51:54.752 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 30%] 2024-03-04T12:51:55.676 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 30%] 2024-03-04T12:51:56.597 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 30%] 2024-03-04T12:51:57.535 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 31%] 2024-03-04T12:51:58.508 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 31%] 2024-03-04T12:51:59.501 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 31%] 2024-03-04T12:52:00.489 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 31%] 2024-03-04T12:52:01.417 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 31%] 2024-03-04T12:52:02.356 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 31%] 2024-03-04T12:52:03.301 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 31%] 2024-03-04T12:52:04.218 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 32%] 2024-03-04T12:52:04.722 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 32%] 2024-03-04T12:52:05.560 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 32%] 2024-03-04T12:52:07.553 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 32%] 2024-03-04T12:52:09.550 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 32%] 2024-03-04T12:52:10.474 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 32%] 2024-03-04T12:52:11.399 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 33%] 2024-03-04T12:52:12.348 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 33%] 2024-03-04T12:52:13.323 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 33%] 2024-03-04T12:52:14.332 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 33%] 2024-03-04T12:52:15.319 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 33%] 2024-03-04T12:52:16.231 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 33%] 2024-03-04T12:52:17.159 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 33%] 2024-03-04T12:52:18.092 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 34%] 2024-03-04T12:52:19.063 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 34%] 2024-03-04T12:52:19.985 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 34%] 2024-03-04T12:52:20.916 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 34%] 2024-03-04T12:52:22.083 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 34%] 2024-03-04T12:52:23.619 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 34%] 2024-03-04T12:52:24.484 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 34%] 2024-03-04T12:52:25.325 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 35%] 2024-03-04T12:52:26.103 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 35%] 2024-03-04T12:52:26.862 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 35%] 2024-03-04T12:52:27.328 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 35%] 2024-03-04T12:52:27.800 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 35%] 2024-03-04T12:52:28.278 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 35%] 2024-03-04T12:52:29.115 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 36%] 2024-03-04T12:52:33.142 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 36%] 2024-03-04T12:52:33.614 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 36%] 2024-03-04T12:52:34.453 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 36%] 2024-03-04T12:52:35.144 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 36%] 2024-03-04T12:52:35.898 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 36%] 2024-03-04T12:52:36.649 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 36%] 2024-03-04T12:52:39.104 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 37%] 2024-03-04T12:52:40.187 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 37%] 2024-03-04T12:52:41.252 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 37%] 2024-03-04T12:53:20.549 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 37%] 2024-03-04T12:53:59.866 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 37%] 2024-03-04T12:54:00.690 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 37%] 2024-03-04T12:54:01.517 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 38%] 2024-03-04T12:54:02.385 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 38%] 2024-03-04T12:54:03.215 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 38%] 2024-03-04T12:54:04.154 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 38%] 2024-03-04T12:54:04.990 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 38%] 2024-03-04T12:54:05.834 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 38%] 2024-03-04T12:54:06.807 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 38%] 2024-03-04T12:54:07.679 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 39%] 2024-03-04T12:54:08.555 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 39%] 2024-03-04T12:54:09.498 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 39%] 2024-03-04T12:54:10.510 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 39%] 2024-03-04T12:54:11.353 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 39%] 2024-03-04T12:54:12.123 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 39%] 2024-03-04T12:54:12.947 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 39%] 2024-03-04T12:54:13.802 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 40%] 2024-03-04T12:54:15.753 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 40%] 2024-03-04T12:54:16.664 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 40%] 2024-03-04T12:54:17.487 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 40%] 2024-03-04T12:54:18.371 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 40%] 2024-03-04T12:54:19.303 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 40%] 2024-03-04T12:54:20.202 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 41%] 2024-03-04T12:54:20.973 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 41%] 2024-03-04T12:54:21.747 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 41%] 2024-03-04T12:54:22.525 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 41%] 2024-03-04T12:54:23.323 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 41%] 2024-03-04T12:54:24.092 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 41%] 2024-03-04T12:54:24.865 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 41%] 2024-03-04T12:54:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 42%] 2024-03-04T12:54:26.591 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 42%] 2024-03-04T12:54:27.374 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 42%] 2024-03-04T12:54:28.164 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 42%] 2024-03-04T12:54:28.936 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 42%] 2024-03-04T12:54:29.983 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 42%] 2024-03-04T12:54:30.754 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 42%] 2024-03-04T12:54:31.542 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 43%] 2024-03-04T12:54:32.314 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 43%] 2024-03-04T12:54:33.139 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 43%] 2024-03-04T12:54:33.917 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 43%] 2024-03-04T12:54:34.683 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 43%] 2024-03-04T12:54:35.451 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 43%] 2024-03-04T12:54:37.280 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 44%] 2024-03-04T12:54:38.052 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 44%] 2024-03-04T12:54:38.947 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 44%] 2024-03-04T12:54:39.827 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 44%] 2024-03-04T12:54:40.704 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 44%] 2024-03-04T12:54:41.603 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 44%] 2024-03-04T12:54:42.482 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 44%] 2024-03-04T12:54:44.405 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 45%] 2024-03-04T12:54:45.280 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 45%] 2024-03-04T12:54:46.159 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 45%] 2024-03-04T12:54:47.144 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 45%] 2024-03-04T12:54:48.152 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 45%] 2024-03-04T12:54:49.139 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 45%] 2024-03-04T12:54:50.020 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 46%] 2024-03-04T12:54:50.985 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 46%] 2024-03-04T12:54:51.984 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 46%] 2024-03-04T12:54:52.868 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 46%] 2024-03-04T12:54:53.855 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 46%] 2024-03-04T12:54:54.679 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 46%] 2024-03-04T12:54:55.490 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 46%] 2024-03-04T12:54:56.294 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 47%] 2024-03-04T12:54:57.217 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 47%] 2024-03-04T12:54:57.967 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 47%] 2024-03-04T12:54:58.434 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 47%] 2024-03-04T12:54:59.452 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 47%] 2024-03-04T12:55:00.280 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 47%] 2024-03-04T12:55:01.119 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 47%] 2024-03-04T12:55:04.449 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 48%] 2024-03-04T12:55:05.280 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 48%] 2024-03-04T12:55:06.158 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 48%] 2024-03-04T12:55:06.995 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 48%] 2024-03-04T12:55:07.852 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 48%] 2024-03-04T12:55:08.639 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 48%] 2024-03-04T12:55:09.478 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 49%] 2024-03-04T12:55:10.445 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 49%] 2024-03-04T12:55:11.428 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 49%] 2024-03-04T12:55:12.307 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 49%] 2024-03-04T12:55:13.204 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 49%] 2024-03-04T12:55:14.076 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 49%] 2024-03-04T12:55:14.969 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 49%] 2024-03-04T12:55:15.877 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 50%] 2024-03-04T12:55:16.704 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 50%] 2024-03-04T12:55:17.621 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 50%] 2024-03-04T12:55:18.086 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 50%] 2024-03-04T12:55:18.554 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 50%] 2024-03-04T12:55:19.020 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 50%] 2024-03-04T12:55:19.719 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 50%] 2024-03-04T12:55:20.388 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 51%] 2024-03-04T12:55:21.041 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 51%] 2024-03-04T12:55:21.698 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 51%] 2024-03-04T12:55:22.422 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 51%] 2024-03-04T12:55:22.894 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 51%] 2024-03-04T12:55:23.379 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 51%] 2024-03-04T12:55:24.055 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 52%] 2024-03-04T12:55:24.525 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 52%] 2024-03-04T12:55:24.992 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 52%] 2024-03-04T12:55:25.462 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 52%] 2024-03-04T12:55:25.932 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 52%] 2024-03-04T12:55:26.647 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 52%] 2024-03-04T12:55:27.355 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 52%] 2024-03-04T12:55:28.117 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 53%] 2024-03-04T12:55:28.847 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 53%] 2024-03-04T12:55:29.562 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 53%] 2024-03-04T12:55:30.350 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 53%] 2024-03-04T12:55:31.057 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 53%] 2024-03-04T12:55:31.841 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 53%] 2024-03-04T12:55:32.564 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 53%] 2024-03-04T12:55:33.491 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 54%] 2024-03-04T12:55:34.364 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 54%] 2024-03-04T12:55:35.242 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 54%] 2024-03-04T12:55:36.194 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 54%] 2024-03-04T12:55:37.084 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 54%] 2024-03-04T12:55:38.000 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 54%] 2024-03-04T12:55:38.926 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 55%] 2024-03-04T12:55:39.845 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 55%] 2024-03-04T12:55:40.807 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 55%] 2024-03-04T12:55:41.777 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 55%] 2024-03-04T12:55:42.542 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 55%] 2024-03-04T12:55:43.523 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 55%] 2024-03-04T12:55:44.481 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 55%] 2024-03-04T12:55:45.479 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 56%] 2024-03-04T12:55:46.443 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 56%] 2024-03-04T12:55:47.416 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 56%] 2024-03-04T12:55:48.857 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 56%] 2024-03-04T12:55:50.134 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 56%] 2024-03-04T12:55:51.409 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 56%] 2024-03-04T12:55:52.775 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 57%] 2024-03-04T12:55:54.067 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 57%] 2024-03-04T12:55:54.920 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 57%] 2024-03-04T12:55:56.071 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_no_grants PASSED [ 57%] 2024-03-04T12:55:56.943 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 57%] 2024-03-04T12:55:57.839 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 57%] 2024-03-04T12:55:58.778 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 57%] 2024-03-04T12:55:59.629 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 58%] 2024-03-04T12:56:00.599 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 58%] 2024-03-04T12:56:01.943 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 58%] 2024-03-04T12:56:03.285 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 58%] 2024-03-04T12:56:04.653 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 58%] 2024-03-04T12:56:06.033 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 58%] 2024-03-04T12:56:07.382 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 58%] 2024-03-04T12:56:08.751 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 59%] 2024-03-04T12:56:10.091 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 59%] 2024-03-04T12:56:11.431 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 59%] 2024-03-04T12:56:12.804 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 59%] 2024-03-04T12:56:14.037 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 59%] 2024-03-04T12:56:15.241 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 59%] 2024-03-04T12:56:16.446 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 60%] 2024-03-04T12:56:18.164 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 60%] 2024-03-04T12:56:19.806 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 60%] 2024-03-04T12:56:20.273 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 60%] 2024-03-04T12:56:20.753 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 60%] 2024-03-04T12:56:21.267 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 60%] 2024-03-04T12:56:22.106 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 60%] 2024-03-04T12:56:22.961 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 61%] 2024-03-04T12:56:23.613 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 61%] 2024-03-04T12:56:24.300 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 61%] 2024-03-04T12:56:25.364 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 61%] 2024-03-04T12:56:27.663 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 61%] 2024-03-04T12:56:28.770 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 61%] 2024-03-04T12:56:29.716 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 61%] 2024-03-04T12:56:33.337 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 62%] 2024-03-04T12:56:34.319 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 62%] 2024-03-04T12:56:35.291 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 62%] 2024-03-04T12:56:36.193 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 62%] 2024-03-04T12:56:37.118 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 62%] 2024-03-04T12:56:38.474 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 62%] 2024-03-04T12:56:39.530 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 63%] 2024-03-04T12:56:40.770 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 63%] 2024-03-04T12:56:41.887 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 63%] 2024-03-04T12:56:43.639 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 63%] 2024-03-04T12:56:45.316 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 63%] 2024-03-04T12:56:46.069 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 63%] 2024-03-04T12:56:46.862 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 63%] 2024-03-04T12:56:49.428 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 64%] 2024-03-04T12:56:50.536 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 64%] 2024-03-04T12:57:18.481 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 64%] 2024-03-04T12:57:19.357 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 64%] 2024-03-04T12:57:20.437 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 64%] 2024-03-04T12:57:23.791 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 64%] 2024-03-04T12:57:24.806 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-03-04T12:57:26.509 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-03-04T12:57:36.883 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 65%] 2024-03-04T12:57:57.139 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 65%] 2024-03-04T12:58:23.218 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 65%] 2024-03-04T13:00:24.207 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 65%] 2024-03-04T13:00:36.656 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 65%] 2024-03-04T13:00:59.061 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-03-04T13:01:00.353 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-03-04T13:01:06.804 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 66%] 2024-03-04T13:01:11.681 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 66%] 2024-03-04T13:01:15.318 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 66%] 2024-03-04T13:01:16.184 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 66%] 2024-03-04T13:01:20.987 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 66%] 2024-03-04T13:01:22.057 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-03-04T13:01:22.930 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-03-04T13:01:23.801 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-03-04T13:01:43.518 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 67%] 2024-03-04T13:01:44.498 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 67%] 2024-03-04T13:01:45.358 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 67%] 2024-03-04T13:01:46.295 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-03-04T13:01:53.821 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-03-04T13:01:57.840 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-03-04T13:02:01.744 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 68%] 2024-03-04T13:02:02.737 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 68%] 2024-03-04T13:02:03.733 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 68%] 2024-03-04T13:02:04.658 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 68%] 2024-03-04T13:02:06.389 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 69%] 2024-03-04T13:02:10.200 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 69%] 2024-03-04T13:02:15.926 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 69%] 2024-03-04T13:02:18.067 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 69%] 2024-03-04T13:02:22.963 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 69%] 2024-03-04T13:02:31.561 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 69%] 2024-03-04T13:02:33.346 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 69%] 2024-03-04T13:02:37.100 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 70%] 2024-03-04T13:02:44.113 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 70%] 2024-03-04T13:02:45.987 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 70%] 2024-03-04T13:02:47.013 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 70%] 2024-03-04T13:02:48.481 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 70%] 2024-03-04T13:02:49.360 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 70%] 2024-03-04T13:02:56.438 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-03-04T13:02:57.342 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-03-04T13:02:58.226 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 71%] 2024-03-04T13:02:59.114 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 71%] 2024-03-04T13:02:59.977 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 71%] 2024-03-04T13:03:01.335 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 71%] 2024-03-04T13:03:12.047 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 71%] 2024-03-04T13:03:13.418 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-03-04T13:03:14.577 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-03-04T13:03:15.958 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 72%] 2024-03-04T13:03:17.446 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 72%] 2024-03-04T13:03:22.274 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 72%] 2024-03-04T13:03:27.996 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 72%] 2024-03-04T13:03:48.068 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-03-04T13:04:24.103 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-03-04T13:04:26.533 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-03-04T13:04:29.014 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 73%] 2024-03-04T13:04:30.237 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 73%] 2024-03-04T13:04:31.552 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 73%] 2024-03-04T13:04:32.569 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 73%] 2024-03-04T13:04:34.043 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-03-04T13:04:35.385 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-03-04T13:04:38.029 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-03-04T13:04:38.831 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 74%] 2024-03-04T13:04:39.646 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 74%] 2024-03-04T13:04:40.455 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 74%] 2024-03-04T13:04:41.251 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 74%] 2024-03-04T13:04:42.004 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-03-04T13:04:42.875 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-03-04T13:04:43.656 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-03-04T13:04:44.409 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 75%] 2024-03-04T13:04:45.292 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 75%] 2024-03-04T13:04:46.049 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 75%] 2024-03-04T13:04:46.821 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-03-04T13:04:47.618 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-03-04T13:04:48.404 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-03-04T13:04:49.156 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-03-04T13:04:50.040 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-03-04T13:04:50.936 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 76%] 2024-03-04T13:04:52.224 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 76%] 2024-03-04T13:04:53.122 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-03-04T13:04:54.014 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-03-04T13:04:54.928 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-03-04T13:04:55.811 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-03-04T13:04:56.583 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-03-04T13:04:57.325 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 77%] 2024-03-04T13:04:58.071 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 77%] 2024-03-04T13:04:58.853 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-03-04T13:05:45.416 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-03-04T13:06:32.410 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-03-04T13:06:42.155 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-03-04T13:06:43.066 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-03-04T13:06:43.951 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 78%] 2024-03-04T13:06:44.870 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-03-04T13:06:45.639 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-03-04T13:06:46.390 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-03-04T13:07:16.488 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-03-04T13:07:25.261 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-03-04T13:07:34.035 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 79%] 2024-03-04T13:07:35.001 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 79%] 2024-03-04T13:07:35.888 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-03-04T13:07:36.752 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-03-04T13:07:38.034 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-03-04T13:07:38.902 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-03-04T13:07:39.788 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-03-04T13:07:40.741 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-03-04T13:07:41.726 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 80%] 2024-03-04T13:07:42.738 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-03-04T13:07:43.754 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-03-04T13:07:45.265 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-03-04T13:07:46.742 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-03-04T13:07:49.107 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 81%] 2024-03-04T13:07:51.899 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 81%] 2024-03-04T13:07:54.232 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-03-04T13:07:56.608 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-03-04T13:07:58.874 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-03-04T13:08:01.217 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-03-04T13:08:03.488 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-03-04T13:08:06.385 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-03-04T13:08:08.790 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 82%] 2024-03-04T13:08:09.692 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-03-04T13:08:10.641 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-03-04T13:08:11.641 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-03-04T13:08:14.031 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-03-04T13:08:16.443 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-03-04T13:08:18.779 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-03-04T13:08:20.707 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-03-04T13:08:47.106 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-03-04T13:08:48.383 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-03-04T13:08:49.670 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-03-04T13:08:50.907 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-03-04T13:08:52.547 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-03-04T13:08:54.013 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-03-04T13:08:54.987 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 85%] 2024-03-04T13:08:56.441 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-03-04T13:08:57.228 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-03-04T13:08:57.977 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-03-04T13:08:58.720 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-03-04T13:08:59.467 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-03-04T13:09:00.370 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-03-04T13:09:01.182 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 86%] 2024-03-04T13:09:02.529 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-03-04T13:09:03.313 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-03-04T13:09:04.022 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-03-04T13:09:04.737 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-03-04T13:09:05.466 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-03-04T13:09:06.184 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 87%] 2024-03-04T13:09:06.957 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 87%] 2024-03-04T13:09:07.674 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 87%] 2024-03-04T13:09:08.386 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-03-04T13:09:09.129 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-03-04T13:09:09.854 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-03-04T13:09:10.758 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-03-04T13:09:11.561 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 88%] 2024-03-04T13:09:12.473 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 88%] 2024-03-04T13:09:13.319 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 88%] 2024-03-04T13:09:14.141 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-03-04T13:09:14.932 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-03-04T13:09:15.880 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-03-04T13:09:16.751 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-03-04T13:09:17.661 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 89%] 2024-03-04T13:09:18.543 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 89%] 2024-03-04T13:09:19.419 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 89%] 2024-03-04T13:09:20.255 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-03-04T13:09:21.225 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-03-04T13:09:22.145 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-03-04T13:09:22.969 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 90%] 2024-03-04T13:09:23.773 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 90%] 2024-03-04T13:09:24.593 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 90%] 2024-03-04T13:09:25.542 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 90%] 2024-03-04T13:09:26.341 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-03-04T13:09:27.312 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-03-04T13:09:28.092 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-03-04T13:09:28.969 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 91%] 2024-03-04T13:09:29.779 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 91%] 2024-03-04T13:09:40.371 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 91%] 2024-03-04T13:09:41.193 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-03-04T13:09:51.517 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-03-04T13:09:52.486 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-03-04T13:09:53.430 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 92%] 2024-03-04T13:09:54.222 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 92%] 2024-03-04T13:09:55.026 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 92%] 2024-03-04T13:09:55.835 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 92%] 2024-03-04T13:09:56.662 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-03-04T13:09:57.533 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-03-04T13:09:58.373 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status PASSED [ 92%] 2024-03-04T13:09:59.121 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_default_public_block PASSED [ 93%] 2024-03-04T13:09:59.926 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 93%] 2024-03-04T13:10:00.906 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 93%] 2024-03-04T13:10:01.864 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-03-04T13:10:02.674 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-03-04T13:10:03.782 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-03-04T13:10:14.840 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-03-04T13:10:15.596 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 94%] 2024-03-04T13:10:16.432 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 94%] 2024-03-04T13:10:17.295 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 94%] 2024-03-04T13:10:18.231 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-03-04T13:10:20.428 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-03-04T13:10:30.870 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-03-04T13:10:40.772 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-03-04T13:10:41.569 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-03-04T13:10:42.731 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-03-04T13:10:59.360 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-03-04T13:11:16.764 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-03-04T13:11:19.738 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-03-04T13:11:21.782 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-03-04T13:11:25.935 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 96%] 2024-03-04T13:11:27.671 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-03-04T13:11:28.459 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-03-04T13:11:35.166 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-03-04T13:11:39.436 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-03-04T13:11:56.548 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-03-04T13:11:59.814 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-03-04T13:12:01.781 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 97%] 2024-03-04T13:12:03.986 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-03-04T13:12:04.950 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-03-04T13:12:08.112 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-03-04T13:12:11.291 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-03-04T13:12:12.573 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-03-04T13:12:13.913 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 98%] 2024-03-04T13:12:15.583 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 98%] 2024-03-04T13:12:17.886 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 98%] 2024-03-04T13:12:20.206 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-03-04T13:12:21.989 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-03-04T13:12:22.363 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-03-04T13:12:30.903 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-03-04T13:12:34.582 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 99%] 2024-03-04T13:12:36.778 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 99%] 2024-03-04T13:12:39.135 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 99%] 2024-03-04T13:12:40.420 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-03-04T13:13:12.770 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-03-04T13:13:13.137 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-03-04T13:13:13.163 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-03-04T13:13:13.163 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.163 INFO:teuthology.orchestra.run.smithi110.stdout:=================================== FAILURES =================================== 2024-03-04T13:13:13.163 INFO:teuthology.orchestra.run.smithi110.stdout:__________________ test_object_create_bad_contentlength_none ___________________ 2024-03-04T13:13:13.163 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.163 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.auth_common 2024-03-04T13:13:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:13:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: def test_object_create_bad_contentlength_none(): 2024-03-04T13:13:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: key = _setup_bad_object(remove=('Content-Length',)) 2024-03-04T13:13:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.164 INFO:teuthology.orchestra.run.smithi110.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-04T13:13:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.164 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py:180: 2024-03-04T13:13:13.164 INFO:teuthology.orchestra.run.smithi110.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:13:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.164 INFO:teuthology.orchestra.run.smithi110.stdout:excClass = 2024-03-04T13:13:13.164 INFO:teuthology.orchestra.run.smithi110.stdout:callableObj = > 2024-03-04T13:13:13.164 INFO:teuthology.orchestra.run.smithi110.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:13:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:13:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:13:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: try: 2024-03-04T13:13:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: callableObj(*args, **kwargs) 2024-03-04T13:13:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: except excClass as e: 2024-03-04T13:13:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: return e 2024-03-04T13:13:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:13:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: excName = excClass.__name__ 2024-03-04T13:13:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: excName = str(excClass) 2024-03-04T13:13:13.165 INFO:teuthology.orchestra.run.smithi110.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:13:13.166 INFO:teuthology.orchestra.run.smithi110.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:13:13.166 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.166 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:13:13.166 INFO:teuthology.orchestra.run.smithi110.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-04T13:13:13.166 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on main 2024-03-04T13:13:13.166 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection main prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.166 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on alt 2024-03-04T13:13:13.166 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection alt prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.166 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on tenant 2024-03-04T13:13:13.166 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.166 INFO:teuthology.orchestra.run.smithi110.stdout:Done with cleanup of test buckets. 2024-03-04T13:13:13.166 INFO:teuthology.orchestra.run.smithi110.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:13:13.166 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on main 2024-03-04T13:13:13.166 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection main prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.167 INFO:teuthology.orchestra.run.smithi110.stdout:prefix= test-client.0-wgnnt192egdfrfp- 2024-03-04T13:13:13.167 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket 2024-03-04T13:13:13.167 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket key 2024-03-04T13:13:13.167 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on alt 2024-03-04T13:13:13.167 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection alt prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.167 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on tenant 2024-03-04T13:13:13.167 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.167 INFO:teuthology.orchestra.run.smithi110.stdout:Done with cleanup of test buckets. 2024-03-04T13:13:13.167 INFO:teuthology.orchestra.run.smithi110.stdout:__________________ test_object_create_bad_authorization_empty __________________ 2024-03-04T13:13:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.auth_common 2024-03-04T13:13:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:13:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: def test_object_create_bad_authorization_empty(): 2024-03-04T13:13:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: key = _setup_bad_object({'Authorization': ''}) 2024-03-04T13:13:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.168 INFO:teuthology.orchestra.run.smithi110.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-04T13:13:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.168 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py:210: 2024-03-04T13:13:13.168 INFO:teuthology.orchestra.run.smithi110.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:13:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.168 INFO:teuthology.orchestra.run.smithi110.stdout:excClass = 2024-03-04T13:13:13.168 INFO:teuthology.orchestra.run.smithi110.stdout:callableObj = > 2024-03-04T13:13:13.168 INFO:teuthology.orchestra.run.smithi110.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:13:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:13:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:13:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: try: 2024-03-04T13:13:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: callableObj(*args, **kwargs) 2024-03-04T13:13:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: except excClass as e: 2024-03-04T13:13:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: return e 2024-03-04T13:13:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:13:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: excName = excClass.__name__ 2024-03-04T13:13:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: excName = str(excClass) 2024-03-04T13:13:13.169 INFO:teuthology.orchestra.run.smithi110.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:13:13.169 INFO:teuthology.orchestra.run.smithi110.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:13:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.169 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:13:13.170 INFO:teuthology.orchestra.run.smithi110.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:13:13.170 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on main 2024-03-04T13:13:13.170 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection main prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.170 INFO:teuthology.orchestra.run.smithi110.stdout:prefix= test-client.0-wgnnt192egdfrfp- 2024-03-04T13:13:13.170 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket 2024-03-04T13:13:13.170 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket key 2024-03-04T13:13:13.170 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on alt 2024-03-04T13:13:13.170 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection alt prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.170 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on tenant 2024-03-04T13:13:13.170 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.170 INFO:teuthology.orchestra.run.smithi110.stdout:Done with cleanup of test buckets. 2024-03-04T13:13:13.170 INFO:teuthology.orchestra.run.smithi110.stdout:__________________ test_object_create_bad_authorization_none ___________________ 2024-03-04T13:13:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.auth_common 2024-03-04T13:13:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:13:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: def test_object_create_bad_authorization_none(): 2024-03-04T13:13:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: key = _setup_bad_object(remove=('Authorization',)) 2024-03-04T13:13:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.171 INFO:teuthology.orchestra.run.smithi110.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-04T13:13:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.171 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py:236: 2024-03-04T13:13:13.171 INFO:teuthology.orchestra.run.smithi110.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:13:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.171 INFO:teuthology.orchestra.run.smithi110.stdout:excClass = 2024-03-04T13:13:13.171 INFO:teuthology.orchestra.run.smithi110.stdout:callableObj = > 2024-03-04T13:13:13.171 INFO:teuthology.orchestra.run.smithi110.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:13:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:13:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:13:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: try: 2024-03-04T13:13:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: callableObj(*args, **kwargs) 2024-03-04T13:13:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: except excClass as e: 2024-03-04T13:13:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: return e 2024-03-04T13:13:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:13:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: excName = excClass.__name__ 2024-03-04T13:13:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: excName = str(excClass) 2024-03-04T13:13:13.172 INFO:teuthology.orchestra.run.smithi110.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:13:13.172 INFO:teuthology.orchestra.run.smithi110.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:13:13.173 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.173 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:13:13.173 INFO:teuthology.orchestra.run.smithi110.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:13:13.173 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on main 2024-03-04T13:13:13.173 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection main prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.173 INFO:teuthology.orchestra.run.smithi110.stdout:prefix= test-client.0-wgnnt192egdfrfp- 2024-03-04T13:13:13.173 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket 2024-03-04T13:13:13.173 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket key 2024-03-04T13:13:13.173 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on alt 2024-03-04T13:13:13.173 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection alt prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.173 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on tenant 2024-03-04T13:13:13.173 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.173 INFO:teuthology.orchestra.run.smithi110.stdout:Done with cleanup of test buckets. 2024-03-04T13:13:13.173 INFO:teuthology.orchestra.run.smithi110.stdout:__________________ test_bucket_create_bad_authorization_empty __________________ 2024-03-04T13:13:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.auth_common 2024-03-04T13:13:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:13:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: def test_bucket_create_bad_authorization_empty(): 2024-03-04T13:13:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: _add_custom_headers({'Authorization': ''}) 2024-03-04T13:13:13.174 INFO:teuthology.orchestra.run.smithi110.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-04T13:13:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.174 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py:294: 2024-03-04T13:13:13.174 INFO:teuthology.orchestra.run.smithi110.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:13:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.174 INFO:teuthology.orchestra.run.smithi110.stdout:excClass = 2024-03-04T13:13:13.174 INFO:teuthology.orchestra.run.smithi110.stdout:callableObj = , args = () 2024-03-04T13:13:13.174 INFO:teuthology.orchestra.run.smithi110.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:13:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:13:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:13:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: try: 2024-03-04T13:13:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: callableObj(*args, **kwargs) 2024-03-04T13:13:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: except excClass as e: 2024-03-04T13:13:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: return e 2024-03-04T13:13:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:13:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: excName = excClass.__name__ 2024-03-04T13:13:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: excName = str(excClass) 2024-03-04T13:13:13.175 INFO:teuthology.orchestra.run.smithi110.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:13:13.175 INFO:teuthology.orchestra.run.smithi110.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:13:13.176 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.176 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:13:13.176 INFO:teuthology.orchestra.run.smithi110.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:13:13.176 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on main 2024-03-04T13:13:13.176 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection main prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.176 INFO:teuthology.orchestra.run.smithi110.stdout:prefix= test-client.0-wgnnt192egdfrfp- 2024-03-04T13:13:13.176 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket 2024-03-04T13:13:13.176 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on alt 2024-03-04T13:13:13.176 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection alt prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.176 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on tenant 2024-03-04T13:13:13.176 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.176 INFO:teuthology.orchestra.run.smithi110.stdout:Done with cleanup of test buckets. 2024-03-04T13:13:13.176 INFO:teuthology.orchestra.run.smithi110.stdout:__________________ test_bucket_create_bad_authorization_none ___________________ 2024-03-04T13:13:13.177 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.177 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.auth_common 2024-03-04T13:13:13.177 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:13:13.177 INFO:teuthology.orchestra.run.smithi110.stdout: def test_bucket_create_bad_authorization_none(): 2024-03-04T13:13:13.177 INFO:teuthology.orchestra.run.smithi110.stdout: _add_custom_headers(remove=('Authorization',)) 2024-03-04T13:13:13.178 INFO:teuthology.orchestra.run.smithi110.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-04T13:13:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.178 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py:305: 2024-03-04T13:13:13.178 INFO:teuthology.orchestra.run.smithi110.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:13:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.178 INFO:teuthology.orchestra.run.smithi110.stdout:excClass = 2024-03-04T13:13:13.178 INFO:teuthology.orchestra.run.smithi110.stdout:callableObj = , args = () 2024-03-04T13:13:13.178 INFO:teuthology.orchestra.run.smithi110.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:13:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:13:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:13:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: try: 2024-03-04T13:13:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: callableObj(*args, **kwargs) 2024-03-04T13:13:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: except excClass as e: 2024-03-04T13:13:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: return e 2024-03-04T13:13:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:13:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: excName = excClass.__name__ 2024-03-04T13:13:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: excName = str(excClass) 2024-03-04T13:13:13.179 INFO:teuthology.orchestra.run.smithi110.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:13:13.179 INFO:teuthology.orchestra.run.smithi110.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:13:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.179 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:13:13.179 INFO:teuthology.orchestra.run.smithi110.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:13:13.179 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on main 2024-03-04T13:13:13.179 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection main prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.180 INFO:teuthology.orchestra.run.smithi110.stdout:prefix= test-client.0-wgnnt192egdfrfp- 2024-03-04T13:13:13.180 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket 2024-03-04T13:13:13.180 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on alt 2024-03-04T13:13:13.180 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection alt prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.180 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on tenant 2024-03-04T13:13:13.180 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.180 INFO:teuthology.orchestra.run.smithi110.stdout:Done with cleanup of test buckets. 2024-03-04T13:13:13.180 INFO:teuthology.orchestra.run.smithi110.stdout:___________ test_object_create_bad_contentlength_mismatch_below_aws2 ___________ 2024-03-04T13:13:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.auth_aws2 2024-03-04T13:13:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:13:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: def test_object_create_bad_contentlength_mismatch_below_aws2(): 2024-03-04T13:13:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: check_aws2_support() 2024-03-04T13:13:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: content = 'bar' 2024-03-04T13:13:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: length = len(content) - 1 2024-03-04T13:13:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: key = _setup_bad_object({'Content-Length': length}) 2024-03-04T13:13:13.181 INFO:teuthology.orchestra.run.smithi110.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, content) 2024-03-04T13:13:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.181 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py:321: 2024-03-04T13:13:13.181 INFO:teuthology.orchestra.run.smithi110.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:13:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.181 INFO:teuthology.orchestra.run.smithi110.stdout:excClass = 2024-03-04T13:13:13.181 INFO:teuthology.orchestra.run.smithi110.stdout:callableObj = > 2024-03-04T13:13:13.181 INFO:teuthology.orchestra.run.smithi110.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:13:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:13:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:13:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: try: 2024-03-04T13:13:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: callableObj(*args, **kwargs) 2024-03-04T13:13:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: except excClass as e: 2024-03-04T13:13:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: return e 2024-03-04T13:13:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:13:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: excName = excClass.__name__ 2024-03-04T13:13:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: excName = str(excClass) 2024-03-04T13:13:13.182 INFO:teuthology.orchestra.run.smithi110.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:13:13.182 INFO:teuthology.orchestra.run.smithi110.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:13:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.182 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:13:13.182 INFO:teuthology.orchestra.run.smithi110.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:13:13.183 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on main 2024-03-04T13:13:13.183 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection main prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.183 INFO:teuthology.orchestra.run.smithi110.stdout:prefix= test-client.0-wgnnt192egdfrfp- 2024-03-04T13:13:13.183 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket 2024-03-04T13:13:13.183 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket key 2024-03-04T13:13:13.183 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on alt 2024-03-04T13:13:13.183 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection alt prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.183 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on tenant 2024-03-04T13:13:13.183 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.183 INFO:teuthology.orchestra.run.smithi110.stdout:Done with cleanup of test buckets. 2024-03-04T13:13:13.183 INFO:teuthology.orchestra.run.smithi110.stdout:_____________ test_object_create_bad_authorization_incorrect_aws2 ______________ 2024-03-04T13:13:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.auth_aws2 2024-03-04T13:13:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:13:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: def test_object_create_bad_authorization_incorrect_aws2(): 2024-03-04T13:13:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: check_aws2_support() 2024-03-04T13:13:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: key = _setup_bad_object({'Authorization': 'AWS AKIAIGR7ZNNBHC5BKSUB:FWeDfwojDSdS2Ztmpfeubhd9isU='}) 2024-03-04T13:13:13.184 INFO:teuthology.orchestra.run.smithi110.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-04T13:13:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.184 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py:332: 2024-03-04T13:13:13.184 INFO:teuthology.orchestra.run.smithi110.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:13:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.184 INFO:teuthology.orchestra.run.smithi110.stdout:excClass = 2024-03-04T13:13:13.184 INFO:teuthology.orchestra.run.smithi110.stdout:callableObj = > 2024-03-04T13:13:13.184 INFO:teuthology.orchestra.run.smithi110.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:13:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:13:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:13:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: try: 2024-03-04T13:13:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: callableObj(*args, **kwargs) 2024-03-04T13:13:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: except excClass as e: 2024-03-04T13:13:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: return e 2024-03-04T13:13:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:13:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: excName = excClass.__name__ 2024-03-04T13:13:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: excName = str(excClass) 2024-03-04T13:13:13.185 INFO:teuthology.orchestra.run.smithi110.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:13:13.185 INFO:teuthology.orchestra.run.smithi110.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:13:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.185 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:13:13.186 INFO:teuthology.orchestra.run.smithi110.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:13:13.186 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on main 2024-03-04T13:13:13.186 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection main prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.186 INFO:teuthology.orchestra.run.smithi110.stdout:prefix= test-client.0-wgnnt192egdfrfp- 2024-03-04T13:13:13.186 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket 2024-03-04T13:13:13.186 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket key 2024-03-04T13:13:13.186 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on alt 2024-03-04T13:13:13.186 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection alt prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.186 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on tenant 2024-03-04T13:13:13.186 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.186 INFO:teuthology.orchestra.run.smithi110.stdout:Done with cleanup of test buckets. 2024-03-04T13:13:13.186 INFO:teuthology.orchestra.run.smithi110.stdout:______________ test_object_create_bad_authorization_invalid_aws2 _______________ 2024-03-04T13:13:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.auth_aws2 2024-03-04T13:13:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:13:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: def test_object_create_bad_authorization_invalid_aws2(): 2024-03-04T13:13:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: check_aws2_support() 2024-03-04T13:13:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: key = _setup_bad_object({'Authorization': 'AWS HAHAHA'}) 2024-03-04T13:13:13.187 INFO:teuthology.orchestra.run.smithi110.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-04T13:13:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.187 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py:343: 2024-03-04T13:13:13.187 INFO:teuthology.orchestra.run.smithi110.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:13:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.187 INFO:teuthology.orchestra.run.smithi110.stdout:excClass = 2024-03-04T13:13:13.187 INFO:teuthology.orchestra.run.smithi110.stdout:callableObj = > 2024-03-04T13:13:13.187 INFO:teuthology.orchestra.run.smithi110.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:13:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:13:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:13:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: try: 2024-03-04T13:13:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: callableObj(*args, **kwargs) 2024-03-04T13:13:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: except excClass as e: 2024-03-04T13:13:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: return e 2024-03-04T13:13:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:13:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: excName = excClass.__name__ 2024-03-04T13:13:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: excName = str(excClass) 2024-03-04T13:13:13.189 INFO:teuthology.orchestra.run.smithi110.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:13:13.189 INFO:teuthology.orchestra.run.smithi110.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:13:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.189 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:13:13.189 INFO:teuthology.orchestra.run.smithi110.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:13:13.189 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on main 2024-03-04T13:13:13.189 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection main prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.189 INFO:teuthology.orchestra.run.smithi110.stdout:prefix= test-client.0-wgnnt192egdfrfp- 2024-03-04T13:13:13.189 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket 2024-03-04T13:13:13.189 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket key 2024-03-04T13:13:13.189 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on alt 2024-03-04T13:13:13.190 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection alt prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.190 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on tenant 2024-03-04T13:13:13.190 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.190 INFO:teuthology.orchestra.run.smithi110.stdout:Done with cleanup of test buckets. 2024-03-04T13:13:13.190 INFO:teuthology.orchestra.run.smithi110.stdout:____________________ test_object_create_bad_date_none_aws2 _____________________ 2024-03-04T13:13:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.auth_aws2 2024-03-04T13:13:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:13:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: def test_object_create_bad_date_none_aws2(): 2024-03-04T13:13:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: check_aws2_support() 2024-03-04T13:13:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: key = _setup_bad_object(remove=('Date',)) 2024-03-04T13:13:13.190 INFO:teuthology.orchestra.run.smithi110.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-04T13:13:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.191 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py:353: 2024-03-04T13:13:13.191 INFO:teuthology.orchestra.run.smithi110.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:13:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.191 INFO:teuthology.orchestra.run.smithi110.stdout:excClass = 2024-03-04T13:13:13.191 INFO:teuthology.orchestra.run.smithi110.stdout:callableObj = > 2024-03-04T13:13:13.191 INFO:teuthology.orchestra.run.smithi110.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:13:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:13:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:13:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: try: 2024-03-04T13:13:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: callableObj(*args, **kwargs) 2024-03-04T13:13:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: except excClass as e: 2024-03-04T13:13:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: return e 2024-03-04T13:13:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:13:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: excName = excClass.__name__ 2024-03-04T13:13:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: excName = str(excClass) 2024-03-04T13:13:13.192 INFO:teuthology.orchestra.run.smithi110.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:13:13.192 INFO:teuthology.orchestra.run.smithi110.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:13:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.192 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:13:13.192 INFO:teuthology.orchestra.run.smithi110.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:13:13.192 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on main 2024-03-04T13:13:13.192 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection main prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.192 INFO:teuthology.orchestra.run.smithi110.stdout:prefix= test-client.0-wgnnt192egdfrfp- 2024-03-04T13:13:13.193 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket 2024-03-04T13:13:13.193 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket key 2024-03-04T13:13:13.193 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on alt 2024-03-04T13:13:13.193 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection alt prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.193 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on tenant 2024-03-04T13:13:13.193 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.193 INFO:teuthology.orchestra.run.smithi110.stdout:Done with cleanup of test buckets. 2024-03-04T13:13:13.193 INFO:teuthology.orchestra.run.smithi110.stdout:______________ test_bucket_create_bad_authorization_invalid_aws2 _______________ 2024-03-04T13:13:13.193 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.193 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.auth_aws2 2024-03-04T13:13:13.193 INFO:teuthology.orchestra.run.smithi110.stdout: def test_bucket_create_bad_authorization_invalid_aws2(): 2024-03-04T13:13:13.193 INFO:teuthology.orchestra.run.smithi110.stdout: check_aws2_support() 2024-03-04T13:13:13.193 INFO:teuthology.orchestra.run.smithi110.stdout: _add_custom_headers({'Authorization': 'AWS HAHAHA'}) 2024-03-04T13:13:13.194 INFO:teuthology.orchestra.run.smithi110.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-04T13:13:13.194 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.194 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py:363: 2024-03-04T13:13:13.194 INFO:teuthology.orchestra.run.smithi110.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:13:13.194 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.194 INFO:teuthology.orchestra.run.smithi110.stdout:excClass = 2024-03-04T13:13:13.194 INFO:teuthology.orchestra.run.smithi110.stdout:callableObj = , args = () 2024-03-04T13:13:13.194 INFO:teuthology.orchestra.run.smithi110.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:13:13.194 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.194 INFO:teuthology.orchestra.run.smithi110.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:13:13.194 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.194 INFO:teuthology.orchestra.run.smithi110.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:13:13.194 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.195 INFO:teuthology.orchestra.run.smithi110.stdout: try: 2024-03-04T13:13:13.195 INFO:teuthology.orchestra.run.smithi110.stdout: callableObj(*args, **kwargs) 2024-03-04T13:13:13.195 INFO:teuthology.orchestra.run.smithi110.stdout: except excClass as e: 2024-03-04T13:13:13.195 INFO:teuthology.orchestra.run.smithi110.stdout: return e 2024-03-04T13:13:13.195 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.195 INFO:teuthology.orchestra.run.smithi110.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:13:13.195 INFO:teuthology.orchestra.run.smithi110.stdout: excName = excClass.__name__ 2024-03-04T13:13:13.195 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.195 INFO:teuthology.orchestra.run.smithi110.stdout: excName = str(excClass) 2024-03-04T13:13:13.195 INFO:teuthology.orchestra.run.smithi110.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:13:13.195 INFO:teuthology.orchestra.run.smithi110.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:13:13.195 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.195 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:13:13.195 INFO:teuthology.orchestra.run.smithi110.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:13:13.195 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on main 2024-03-04T13:13:13.196 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection main prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.196 INFO:teuthology.orchestra.run.smithi110.stdout:prefix= test-client.0-wgnnt192egdfrfp- 2024-03-04T13:13:13.196 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket 2024-03-04T13:13:13.196 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on alt 2024-03-04T13:13:13.196 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection alt prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.196 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on tenant 2024-03-04T13:13:13.196 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.196 INFO:teuthology.orchestra.run.smithi110.stdout:Done with cleanup of test buckets. 2024-03-04T13:13:13.196 INFO:teuthology.orchestra.run.smithi110.stdout:____________________ test_bucket_create_bad_date_none_aws2 _____________________ 2024-03-04T13:13:13.196 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.196 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.auth_aws2 2024-03-04T13:13:13.196 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.fails_on_dbstore 2024-03-04T13:13:13.196 INFO:teuthology.orchestra.run.smithi110.stdout: def test_bucket_create_bad_date_none_aws2(): 2024-03-04T13:13:13.197 INFO:teuthology.orchestra.run.smithi110.stdout: check_aws2_support() 2024-03-04T13:13:13.197 INFO:teuthology.orchestra.run.smithi110.stdout: _add_custom_headers(remove=('Date',)) 2024-03-04T13:13:13.197 INFO:teuthology.orchestra.run.smithi110.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-04T13:13:13.197 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.197 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py:373: 2024-03-04T13:13:13.197 INFO:teuthology.orchestra.run.smithi110.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-04T13:13:13.197 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.197 INFO:teuthology.orchestra.run.smithi110.stdout:excClass = 2024-03-04T13:13:13.197 INFO:teuthology.orchestra.run.smithi110.stdout:callableObj = , args = () 2024-03-04T13:13:13.197 INFO:teuthology.orchestra.run.smithi110.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-04T13:13:13.197 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.197 INFO:teuthology.orchestra.run.smithi110.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-04T13:13:13.197 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.198 INFO:teuthology.orchestra.run.smithi110.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-04T13:13:13.198 INFO:teuthology.orchestra.run.smithi110.stdout: """ 2024-03-04T13:13:13.198 INFO:teuthology.orchestra.run.smithi110.stdout: try: 2024-03-04T13:13:13.198 INFO:teuthology.orchestra.run.smithi110.stdout: callableObj(*args, **kwargs) 2024-03-04T13:13:13.198 INFO:teuthology.orchestra.run.smithi110.stdout: except excClass as e: 2024-03-04T13:13:13.198 INFO:teuthology.orchestra.run.smithi110.stdout: return e 2024-03-04T13:13:13.198 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.198 INFO:teuthology.orchestra.run.smithi110.stdout: if hasattr(excClass, '__name__'): 2024-03-04T13:13:13.198 INFO:teuthology.orchestra.run.smithi110.stdout: excName = excClass.__name__ 2024-03-04T13:13:13.198 INFO:teuthology.orchestra.run.smithi110.stdout: else: 2024-03-04T13:13:13.198 INFO:teuthology.orchestra.run.smithi110.stdout: excName = str(excClass) 2024-03-04T13:13:13.198 INFO:teuthology.orchestra.run.smithi110.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-04T13:13:13.198 INFO:teuthology.orchestra.run.smithi110.stdout:E AssertionError: S3ResponseError not raised 2024-03-04T13:13:13.198 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.198 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-04T13:13:13.199 INFO:teuthology.orchestra.run.smithi110.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-04T13:13:13.199 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on main 2024-03-04T13:13:13.199 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection main prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.199 INFO:teuthology.orchestra.run.smithi110.stdout:prefix= test-client.0-wgnnt192egdfrfp- 2024-03-04T13:13:13.199 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning bucket 2024-03-04T13:13:13.199 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on alt 2024-03-04T13:13:13.199 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection alt prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.199 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting buckets on tenant 2024-03-04T13:13:13.199 INFO:teuthology.orchestra.run.smithi110.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-wgnnt192egdfrfp-'. 2024-03-04T13:13:13.199 INFO:teuthology.orchestra.run.smithi110.stdout:Done with cleanup of test buckets. 2024-03-04T13:13:13.199 INFO:teuthology.orchestra.run.smithi110.stdout:=============================== warnings summary =============================== 2024-03-04T13:13:13.199 INFO:teuthology.orchestra.run.smithi110.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-03-04T13:13:13.199 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-03-04T13:13:13.199 INFO:teuthology.orchestra.run.smithi110.stdout: import imp 2024-03-04T13:13:13.199 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.200 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py:124 2024-03-04T13:13:13.200 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-03-04T13:13:13.200 INFO:teuthology.orchestra.run.smithi110.stdout: if boto_type is 'S3Connection': 2024-03-04T13:13:13.200 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.200 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_headers.py:129 2024-03-04T13:13:13.200 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:129: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-03-04T13:13:13.200 INFO:teuthology.orchestra.run.smithi110.stdout: elif boto_type is 'HTTPRequest': 2024-03-04T13:13:13.200 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.200 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3.py:359 2024-03-04T13:13:13.200 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-03-04T13:13:13.200 INFO:teuthology.orchestra.run.smithi110.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-03-04T13:13:13.200 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.201 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py:176 2024-03-04T13:13:13.201 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-03-04T13:13:13.201 INFO:teuthology.orchestra.run.smithi110.stdout: if k is 'BucketName': 2024-03-04T13:13:13.201 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.201 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py:253 2024-03-04T13:13:13.201 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-03-04T13:13:13.201 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.timeout(10) 2024-03-04T13:13:13.201 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.201 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests/functional/test_s3_website.py:1077 2024-03-04T13:13:13.201 INFO:teuthology.orchestra.run.smithi110.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-03-04T13:13:13.201 INFO:teuthology.orchestra.run.smithi110.stdout: @pytest.mark.s3website_routing_rules 2024-03-04T13:13:13.201 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.201 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py:2212 2024-03-04T13:13:13.201 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2212: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:13:13.202 INFO:teuthology.orchestra.run.smithi110.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-04T13:13:13.202 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.202 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py:2227 2024-03-04T13:13:13.202 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2227: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:13:13.202 INFO:teuthology.orchestra.run.smithi110.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-03-04T13:13:13.202 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.202 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py:2233 2024-03-04T13:13:13.202 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2233: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:13:13.202 INFO:teuthology.orchestra.run.smithi110.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-03-04T13:13:13.202 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.202 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py:2290 2024-03-04T13:13:13.202 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2290: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:13:13.202 INFO:teuthology.orchestra.run.smithi110.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-04T13:13:13.202 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.202 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py:2305 2024-03-04T13:13:13.203 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2305: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:13:13.203 INFO:teuthology.orchestra.run.smithi110.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-03-04T13:13:13.203 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.203 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py:2323 2024-03-04T13:13:13.203 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2323: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:13:13.203 INFO:teuthology.orchestra.run.smithi110.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-04T13:13:13.203 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.203 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py:2338 2024-03-04T13:13:13.203 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2338: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:13:13.203 INFO:teuthology.orchestra.run.smithi110.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-03-04T13:13:13.203 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.203 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py:2356 2024-03-04T13:13:13.203 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2356: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:13:13.203 INFO:teuthology.orchestra.run.smithi110.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-04T13:13:13.204 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.204 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py:2371 2024-03-04T13:13:13.204 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2371: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:13:13.204 INFO:teuthology.orchestra.run.smithi110.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-03-04T13:13:13.204 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.204 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py:2421 2024-03-04T13:13:13.204 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2421: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:13:13.204 INFO:teuthology.orchestra.run.smithi110.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-04T13:13:13.204 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.204 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py:2453 2024-03-04T13:13:13.204 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2453: DeprecationWarning: invalid escape sequence \$ 2024-03-04T13:13:13.204 INFO:teuthology.orchestra.run.smithi110.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-04T13:13:13.204 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.204 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-03-04T13:13:13.205 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_iam.py: 23 warnings 2024-03-04T13:13:13.205 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3.py: 477 warnings 2024-03-04T13:13:13.205 INFO:teuthology.orchestra.run.smithi110.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-03-04T13:13:13.205 INFO:teuthology.orchestra.run.smithi110.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi110.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-04T13:13:13.205 INFO:teuthology.orchestra.run.smithi110.stdout: warnings.warn( 2024-03-04T13:13:13.205 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:13.205 INFO:teuthology.orchestra.run.smithi110.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-03-04T13:13:13.205 INFO:teuthology.orchestra.run.smithi110.stdout:=========================== short test summary info ============================ 2024-03-04T13:13:13.205 INFO:teuthology.orchestra.run.smithi110.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none 2024-03-04T13:13:13.205 INFO:teuthology.orchestra.run.smithi110.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty 2024-03-04T13:13:13.205 INFO:teuthology.orchestra.run.smithi110.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_none 2024-03-04T13:13:13.205 INFO:teuthology.orchestra.run.smithi110.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty 2024-03-04T13:13:13.205 INFO:teuthology.orchestra.run.smithi110.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none 2024-03-04T13:13:13.205 INFO:teuthology.orchestra.run.smithi110.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 2024-03-04T13:13:13.205 INFO:teuthology.orchestra.run.smithi110.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 2024-03-04T13:13:13.205 INFO:teuthology.orchestra.run.smithi110.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 2024-03-04T13:13:13.206 INFO:teuthology.orchestra.run.smithi110.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 2024-03-04T13:13:13.206 INFO:teuthology.orchestra.run.smithi110.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 2024-03-04T13:13:13.206 INFO:teuthology.orchestra.run.smithi110.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 2024-03-04T13:13:13.206 INFO:teuthology.orchestra.run.smithi110.stdout:= 11 failed, 586 passed, 65 skipped, 124 deselected, 1 xfailed, 580 warnings in 1501.84s (0:25:01) = 2024-03-04T13:13:13.295 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: InvocationError for command /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' (exited with code 1) 2024-03-04T13:13:13.295 INFO:teuthology.orchestra.run.smithi110.stdout:___________________________________ summary ____________________________________ 2024-03-04T13:13:13.295 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: py: commands failed 2024-03-04T13:13:13.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T13:13:13.309 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 437, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 380, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi110 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-03-04T13:13:13.310 INFO:tasks.s3tests:Cleaning up boto... 2024-03-04T13:13:13.310 DEBUG:teuthology.orchestra.run.smithi110:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-03-04T13:13:13.338 INFO:tasks.s3tests:Removing s3-tests... 2024-03-04T13:13:13.338 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-03-04T13:13:13.525 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 703, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 61, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 437, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 380, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi110 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-03-04T13:13:13.721 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=bffc5a3f431949f8bfe3f93278ddb8e7 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 703, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 61, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 437, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_3aec390336fdfdc8f927818b718cfb0361bd47c8/qa/tasks/s3tests.py", line 380, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi110 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-03-04T13:13:13.725 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-03-04T13:13:13.737 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-03-04T13:13:13.746 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-03-04T13:13:13.746 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-03-04T13:13:13.746 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-03-04T13:13:13.811 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-03-04T13:13:13.811 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-03-04T13:13:13.865 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T13:13:13.865 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T13:13:13.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:13.895+0000 7f9479c24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:13.897+0000 7f9479c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:13:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:13.897+0000 7f9479c24800 20 realm 2024-03-04T13:13:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:13.897+0000 7f9479c24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:13.897+0000 7f9479c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:13:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:13.897+0000 7f9479c24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T13:13:13.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:13.897+0000 7f9479c24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:13.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:13.897+0000 7f9479c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:13:13.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:13.897+0000 7f9479c24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:13.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:13.898+0000 7f9479c24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T13:13:13.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:13.898+0000 7f9479c24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:13.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:13.898+0000 7f9479c24800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T13:13:13.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:13.898+0000 7f9479c24800 20 searching for the correct realm 2024-03-04T13:13:13.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:13.901+0000 7f946ef26640 0 -- 172.21.15.110:0/3356833471 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7f9468033060 msgr2=0x7f946805d810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T13:13:13.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:13.905+0000 7f9477727640 0 -- 172.21.15.110:0/3356833471 >> [v2:172.21.15.110:6808/3146826323,v1:172.21.15.110:6809/3146826323] conn(0x7f946005c2d0 msgr2=0x7f946006c8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T13:13:14.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.111+0000 7f9479c24800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T13:13:14.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.111+0000 7f9479c24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T13:13:14.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.111+0000 7f9479c24800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T13:13:14.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.111+0000 7f9479c24800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T13:13:14.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.111+0000 7f9479c24800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T13:13:14.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.111+0000 7f9479c24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T13:13:14.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.111+0000 7f9479c24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:14.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.111+0000 7f9479c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:13:14.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.111+0000 7f9479c24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:14.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.111+0000 7f9479c24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T13:13:14.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.111+0000 7f9479c24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:14.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.112+0000 7f9479c24800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T13:13:14.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.112+0000 7f9479c24800 20 zone default found 2024-03-04T13:13:14.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.112+0000 7f9479c24800 4 Realm: () 2024-03-04T13:13:14.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.112+0000 7f9479c24800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T13:13:14.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.112+0000 7f9479c24800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T13:13:14.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.112+0000 7f9479c24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T13:13:14.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.112+0000 7f9479c24800 20 zonegroup default 2024-03-04T13:13:14.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.112+0000 7f9479c24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:14.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.112+0000 7f9479c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:13:14.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.112+0000 7f9479c24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:14.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.112+0000 7f9479c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:13:14.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.112+0000 7f9479c24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:14.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.112+0000 7f9479c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:13:14.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.113+0000 7f9479c24800 20 started sync module instance, tier type = 2024-03-04T13:13:14.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.113+0000 7f9479c24800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T13:13:14.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.122+0000 7f9479c24800 20 add_watcher() i=0 2024-03-04T13:13:14.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.122+0000 7f9479c24800 20 add_watcher() i=1 2024-03-04T13:13:14.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.122+0000 7f9479c24800 20 add_watcher() i=2 2024-03-04T13:13:14.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.122+0000 7f9479c24800 20 add_watcher() i=3 2024-03-04T13:13:14.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.122+0000 7f9479c24800 20 add_watcher() i=4 2024-03-04T13:13:14.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.122+0000 7f9479c24800 20 add_watcher() i=5 2024-03-04T13:13:14.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.122+0000 7f9479c24800 20 add_watcher() i=6 2024-03-04T13:13:14.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.123+0000 7f9479c24800 20 add_watcher() i=7 2024-03-04T13:13:14.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.123+0000 7f9479c24800 2 all 8 watchers are set, enabling cache 2024-03-04T13:13:14.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.125+0000 7f932dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T13:13:14.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.125+0000 7f9479c24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T13:13:14.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.125+0000 7f9479c24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T13:13:14.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.162+0000 7f932cfe1640 20 reqs_thread_entry: start 2024-03-04T13:13:14.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.162+0000 7f9479c24800 20 init_complete bucket index max shards: 11 2024-03-04T13:13:14.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.162+0000 7f9479c24800 20 Filter name: none 2024-03-04T13:13:14.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.163+0000 7f92a67fc640 20 reqs_thread_entry: start 2024-03-04T13:13:14.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.163+0000 7f9479c24800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-03-04T13:13:14.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.163+0000 7f9479c24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:14.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.164+0000 7f9479c24800 20 rados_obj.operate() r=0 bl.length=449 2024-03-04T13:13:14.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.164+0000 7f9479c24800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-03-04T13:13:14.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.164+0000 7f9479c24800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-04T13:13:14.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.164+0000 7f9479c24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-04T13:13:14.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.165+0000 7f9479c24800 10 removing key index: FCENOISWEYTMQHERKROJ 2024-03-04T13:13:14.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.165+0000 7f9479c24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:FCENOISWEYTMQHERKROJ, ofs0, ns] 2024-03-04T13:13:14.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.166+0000 7f935affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216661751 cookie 94380202430944 notifier 7322 bl.length()=170 2024-03-04T13:13:14.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.167+0000 7f9479c24800 10 removing email index: tester.client.0_test@test.test 2024-03-04T13:13:14.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.168+0000 7f9479c24800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-03-04T13:13:14.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.168+0000 7f935a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660614 cookie 94380202428256 notifier 7322 bl.length()=181 2024-03-04T13:13:14.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.170+0000 7f9479c24800 10 removing user buckets index 2024-03-04T13:13:14.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.171+0000 7f9479c24800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-03-04T13:13:14.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.171+0000 7f935a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660615 cookie 94380202438576 notifier 7322 bl.length()=172 2024-03-04T13:13:14.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.172+0000 7f9479c24800 10 removing user index: tester.client.0 2024-03-04T13:13:14.174 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.174+0000 7f9479c24800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-03-04T13:13:14.174 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.174+0000 7f9479c24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-03-04T13:13:14.174 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.174+0000 7f935affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660930 cookie 94380202435936 notifier 7322 bl.length()=164 2024-03-04T13:13:14.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.176+0000 7f932dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T13:13:14.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.178+0000 7f9479c24800 20 remove_watcher() i=0 2024-03-04T13:13:14.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.178+0000 7f9479c24800 2 removed watcher, disabling cache 2024-03-04T13:13:14.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.180+0000 7f9479c24800 20 remove_watcher() i=1 2024-03-04T13:13:14.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.181+0000 7f9479c24800 20 remove_watcher() i=2 2024-03-04T13:13:14.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.182+0000 7f9479c24800 20 remove_watcher() i=3 2024-03-04T13:13:14.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.183+0000 7f9479c24800 20 remove_watcher() i=4 2024-03-04T13:13:14.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.184+0000 7f9479c24800 20 remove_watcher() i=5 2024-03-04T13:13:14.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.185+0000 7f9479c24800 20 remove_watcher() i=6 2024-03-04T13:13:14.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:14.186+0000 7f9479c24800 20 remove_watcher() i=7 2024-03-04T13:13:14.197 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-03-04T13:13:14.244 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-03-04T13:13:14.254 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-03-04T13:13:14.307 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-03-04T13:13:14.317 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-03-04T13:13:14.317 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:13:14.324 INFO:tasks.rgw.client.0.smithi110.stdout:2024-03-04T13:13:14.322+0000 f6f1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 45654) UID: 0 2024-03-04T13:13:14.326 INFO:tasks.rgw.client.0.smithi110.stdout:2024-03-04T13:13:14.325+0000 a03b0c0 -1 shutting down 2024-03-04T13:13:18.383 INFO:tasks.rgw.client.0.smithi110.stderr:==00:00:52:50.964 45657== could not unlink /tmp/vgdb-pipe-from-vgdb-to-45657-by-root-on-??? 2024-03-04T13:13:18.383 INFO:tasks.rgw.client.0.smithi110.stderr:==00:00:52:50.964 45657== could not unlink /tmp/vgdb-pipe-to-vgdb-from-45657-by-root-on-??? 2024-03-04T13:13:18.383 INFO:tasks.rgw.client.0.smithi110.stderr:==00:00:52:50.964 45657== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-45657-by-root-on-??? 2024-03-04T13:13:19.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-03-04T13:13:20.420 INFO:tasks.rgw.client.0:Stopped 2024-03-04T13:13:20.421 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-03-04T13:13:20.454 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f /etc/ceph/vault-root-token 2024-03-04T13:13:20.540 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-03-04T13:13:20.582 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-03-04T13:13:20.582 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-03-04T13:13:20.583 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-03-04T13:13:20.680 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setuser ceph since I am not root 2024-03-04T13:13:20.680 INFO:teuthology.orchestra.run.smithi110.stderr:ignoring --setgroup ceph since I am not root 2024-03-04T13:13:20.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.710+0000 7fd627e24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:20.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.711+0000 7fd627e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:13:20.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.711+0000 7fd627e24800 20 realm 2024-03-04T13:13:20.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.711+0000 7fd627e24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:20.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.711+0000 7fd627e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:13:20.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.711+0000 7fd627e24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-04T13:13:20.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.711+0000 7fd627e24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:20.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.711+0000 7fd627e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:13:20.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.711+0000 7fd627e24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:20.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.712+0000 7fd627e24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T13:13:20.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.712+0000 7fd627e24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:20.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.713+0000 7fd627e24800 20 rados_obj.operate() r=0 bl.length=1021 2024-03-04T13:13:20.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.713+0000 7fd627e24800 20 searching for the correct realm 2024-03-04T13:13:20.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.716+0000 7fd62511f640 0 -- 172.21.15.110:0/365732665 >> [v2:172.21.15.172:6808/3873506104,v1:172.21.15.172:6809/3873506104] conn(0x7fd610056070 msgr2=0x7fd61008e480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T13:13:20.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.719+0000 7fd625920640 0 -- 172.21.15.110:0/365732665 >> [v2:172.21.15.172:6800/824320839,v1:172.21.15.172:6801/824320839] conn(0x7fd610056070 msgr2=0x7fd4f007f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-04T13:13:20.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.927+0000 7fd627e24800 20 RGWRados::pool_iterate: got zonegroup_info.6af1f166-1cd1-4a8d-a04d-71bf22680742 2024-03-04T13:13:20.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.927+0000 7fd627e24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-04T13:13:20.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.927+0000 7fd627e24800 20 RGWRados::pool_iterate: got zone_info.82bf9204-52b3-42fc-9db8-0f1135c09e01 2024-03-04T13:13:20.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.927+0000 7fd627e24800 20 RGWRados::pool_iterate: got default.zone. 2024-03-04T13:13:20.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.927+0000 7fd627e24800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-04T13:13:20.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.927+0000 7fd627e24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-04T13:13:20.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.927+0000 7fd627e24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:20.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.927+0000 7fd627e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:13:20.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.927+0000 7fd627e24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:20.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.927+0000 7fd627e24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-04T13:13:20.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.927+0000 7fd627e24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:20.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.928+0000 7fd627e24800 20 rados_obj.operate() r=0 bl.length=432 2024-03-04T13:13:20.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.928+0000 7fd627e24800 20 zone default found 2024-03-04T13:13:20.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.928+0000 7fd627e24800 4 Realm: () 2024-03-04T13:13:20.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.928+0000 7fd627e24800 4 ZoneGroup: default (6af1f166-1cd1-4a8d-a04d-71bf22680742) 2024-03-04T13:13:20.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.928+0000 7fd627e24800 4 Zone: default (82bf9204-52b3-42fc-9db8-0f1135c09e01) 2024-03-04T13:13:20.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.928+0000 7fd627e24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-04T13:13:20.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.928+0000 7fd627e24800 20 zonegroup default 2024-03-04T13:13:20.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.928+0000 7fd627e24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:20.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.928+0000 7fd627e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:13:20.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.928+0000 7fd627e24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:20.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.928+0000 7fd627e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:13:20.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.928+0000 7fd627e24800 20 rados->read ofs=0 len=0 2024-03-04T13:13:20.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.929+0000 7fd627e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-04T13:13:20.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.929+0000 7fd627e24800 20 started sync module instance, tier type = 2024-03-04T13:13:20.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.929+0000 7fd627e24800 20 started zone id=82bf9204-52b3-42fc-9db8-0f1135c09e01 (name=default) with tier type = 2024-03-04T13:13:20.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.938+0000 7fd627e24800 20 add_watcher() i=0 2024-03-04T13:13:20.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.938+0000 7fd627e24800 20 add_watcher() i=1 2024-03-04T13:13:20.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.938+0000 7fd627e24800 20 add_watcher() i=2 2024-03-04T13:13:20.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.938+0000 7fd627e24800 20 add_watcher() i=3 2024-03-04T13:13:20.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.938+0000 7fd627e24800 20 add_watcher() i=4 2024-03-04T13:13:20.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.938+0000 7fd627e24800 20 add_watcher() i=5 2024-03-04T13:13:20.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.938+0000 7fd627e24800 20 add_watcher() i=6 2024-03-04T13:13:20.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.939+0000 7fd627e24800 20 add_watcher() i=7 2024-03-04T13:13:20.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.939+0000 7fd627e24800 2 all 8 watchers are set, enabling cache 2024-03-04T13:13:20.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.940+0000 7fd4d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T13:13:20.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.940+0000 7fd627e24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-04T13:13:20.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.940+0000 7fd627e24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-04T13:13:20.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.979+0000 7fd4d67fc640 20 reqs_thread_entry: start 2024-03-04T13:13:20.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.979+0000 7fd627e24800 20 init_complete bucket index max shards: 11 2024-03-04T13:13:20.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.979+0000 7fd627e24800 20 Filter name: none 2024-03-04T13:13:20.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.979+0000 7fd447fff640 20 reqs_thread_entry: start 2024-03-04T13:13:20.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.979+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-04T13:13:20.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.981+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:20.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.982+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:20.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.982+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T13:13:20.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.982+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='_Z9x2igmZmIe5phmof1AX9pBtjmKxIE-', time=2024-03-04T14:49:06.406065+0000, chain.objs.size()=2 2024-03-04T13:13:20.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.982+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__shadow_.mjnZ2D8tm3O0Hn1-QTy_SOiT8FH0SYZ_1 2024-03-04T13:13:20.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.982+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__shadow_.mjnZ2D8tm3O0Hn1-QTy_SOiT8FH0SYZ_2 2024-03-04T13:13:20.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.982+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~koSJObGit26fGj3ncIKLGlV4_V7wPKP', time=2024-03-04T15:01:20.406464+0000, chain.objs.size()=1 2024-03-04T13:13:20.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.982+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.504__multipart_mymultipart2.2~koSJObGit26fGj3ncIKLGlV4_V7wPKP.1 2024-03-04T13:13:20.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.986+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:20.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.990+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-04T13:13:20.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.991+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:20.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.992+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:20.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.992+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T13:13:20.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.992+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='_EZA9zehS0p2Ym3yJGnKYGdS7_dZcqLX', time=2024-03-04T14:49:14.661888+0000, chain.objs.size()=2 2024-03-04T13:13:20.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.992+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__shadow_.IFnokRjwEAVyaCjcFwLh6haseLRvoth_0 2024-03-04T13:13:20.993 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.992+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__shadow_.IFnokRjwEAVyaCjcFwLh6haseLRvoth_1 2024-03-04T13:13:20.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.992+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='_6iBwUUIqDOxTW6esCqOOjdBHynn4ULs', time=2024-03-04T14:49:21.005830+0000, chain.objs.size()=1 2024-03-04T13:13:20.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.992+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.157__shadow_.ardxvGQUu2PkIGv4XjptiKySZoNo0aY_0 2024-03-04T13:13:20.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.993+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3408388984529263178', time=2024-03-04T14:57:33.350491+0000, chain.objs.size()=1 2024-03-04T13:13:20.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.993+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.491__multipart_mymultipart.2~0CvLweXIrHjYmDly6kYHZ1vHDZMnmbf.1 2024-03-04T13:13:20.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.993+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17559959903112167888', time=2024-03-04T15:04:23.524631+0000, chain.objs.size()=4 2024-03-04T13:13:20.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.993+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.545__multipart_testobj.2~Wk6yMyEwu7uKISEvi-VKnzIPtfpKyFs.1 2024-03-04T13:13:20.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.993+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.545__multipart_testobj.2~Wk6yMyEwu7uKISEvi-VKnzIPtfpKyFs.2 2024-03-04T13:13:20.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.993+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.545__multipart_testobj.2~Wk6yMyEwu7uKISEvi-VKnzIPtfpKyFs.3 2024-03-04T13:13:20.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.993+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.545__multipart_testobj.2~Wk6yMyEwu7uKISEvi-VKnzIPtfpKyFs.4 2024-03-04T13:13:20.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.996+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:20.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:20.998+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-04T13:13:21.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.000+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.001+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-03-04T13:13:21.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8917049649472101420', time=2024-03-04T14:48:51.456906+0000, chain.objs.size()=2 2024-03-04T13:13:21.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.154__shadow_.6EwbG75eXyrXxe3zL57n0bQRuc8Nced_0 2024-03-04T13:13:21.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.154__shadow_.6EwbG75eXyrXxe3zL57n0bQRuc8Nced_1 2024-03-04T13:13:21.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~7mLMUz9Jqg9M6-GfFpURAIfSZ6E1XJ4', time=2024-03-04T15:00:10.161815+0000, chain.objs.size()=1 2024-03-04T13:13:21.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~7mLMUz9Jqg9M6-GfFpURAIfSZ6E1XJ4.1 2024-03-04T13:13:21.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~7mLMUz9Jqg9M6-GfFpURAIfSZ6E1XJ4', time=2024-03-04T15:00:10.165587+0000, chain.objs.size()=1 2024-03-04T13:13:21.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~7mLMUz9Jqg9M6-GfFpURAIfSZ6E1XJ4.2 2024-03-04T13:13:21.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~7mLMUz9Jqg9M6-GfFpURAIfSZ6E1XJ4', time=2024-03-04T15:00:10.169197+0000, chain.objs.size()=1 2024-03-04T13:13:21.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~7mLMUz9Jqg9M6-GfFpURAIfSZ6E1XJ4.3 2024-03-04T13:13:21.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~7mLMUz9Jqg9M6-GfFpURAIfSZ6E1XJ4', time=2024-03-04T15:00:10.172751+0000, chain.objs.size()=1 2024-03-04T13:13:21.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~7mLMUz9Jqg9M6-GfFpURAIfSZ6E1XJ4.4 2024-03-04T13:13:21.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~7mLMUz9Jqg9M6-GfFpURAIfSZ6E1XJ4', time=2024-03-04T15:00:10.176617+0000, chain.objs.size()=1 2024-03-04T13:13:21.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~7mLMUz9Jqg9M6-GfFpURAIfSZ6E1XJ4.5 2024-03-04T13:13:21.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~7mLMUz9Jqg9M6-GfFpURAIfSZ6E1XJ4', time=2024-03-04T15:00:10.180415+0000, chain.objs.size()=1 2024-03-04T13:13:21.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~7mLMUz9Jqg9M6-GfFpURAIfSZ6E1XJ4.6 2024-03-04T13:13:21.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.352817251820911166', time=2024-03-04T15:01:43.098802+0000, chain.objs.size()=4 2024-03-04T13:13:21.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.508__multipart_mymultipart.2~PEA2iTWpcL0qBDKfC5UJ9rE9jnsA3r0.1 2024-03-04T13:13:21.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.508__multipart_mymultipart.2~PEA2iTWpcL0qBDKfC5UJ9rE9jnsA3r0.2 2024-03-04T13:13:21.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.508__multipart_mymultipart.USVoAfohd7icflFhJLWhz9a65Oo4AIJr.3 2024-03-04T13:13:21.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.002+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.508__multipart_mymultipart.2~PEA2iTWpcL0qBDKfC5UJ9rE9jnsA3r0.4 2024-03-04T13:13:21.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.006+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.008+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-04T13:13:21.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.009+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.010+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.010+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T13:13:21.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.010+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12533927566580916610', time=2024-03-04T14:48:38.348233+0000, chain.objs.size()=3 2024-03-04T13:13:21.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.010+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.153__multipart_mymultipart-STANDARD.2~YFrf46hfjWciU3i3PkphSX_H62wg4q-.1 2024-03-04T13:13:21.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.010+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.153__multipart_mymultipart-STANDARD.2~YFrf46hfjWciU3i3PkphSX_H62wg4q-.2 2024-03-04T13:13:21.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.010+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.153__multipart_mymultipart-STANDARD.2~YFrf46hfjWciU3i3PkphSX_H62wg4q-.3 2024-03-04T13:13:21.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.010+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9376816353784812723', time=2024-03-04T14:57:36.238315+0000, chain.objs.size()=1 2024-03-04T13:13:21.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.010+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.490__shadow_.VnI_vJmuR9S4r_Y5Mx3v0OTVocB0ktW_1 2024-03-04T13:13:21.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.010+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2985773947860735272', time=2024-03-04T15:02:47.410939+0000, chain.objs.size()=1 2024-03-04T13:13:21.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.010+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.529__multipart_mymultipart.2~ZREpfuDyAKLvlMT_Uy07mwMJGfDVpt0.1 2024-03-04T13:13:21.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.012+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.014+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-04T13:13:21.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.015+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.016+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.016+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-04T13:13:21.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.016+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='__hYcJAvIvmGEFKHWhqJpHCpqfobNJ8d', time=2024-03-04T14:48:47.527886+0000, chain.objs.size()=1 2024-03-04T13:13:21.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.016+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.154__shadow_.xrCuJ3WTW_eFa33cEYE_KLpHjUOQagA_1 2024-03-04T13:13:21.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.016+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.2_4b12778f5815b125a6c1d73bc311e5f5', time=2024-03-04T14:57:17.814129+0000, chain.objs.size()=6 2024-03-04T13:13:21.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.016+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.1 2024-03-04T13:13:21.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.016+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.2 2024-03-04T13:13:21.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.016+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.3 2024-03-04T13:13:21.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.016+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.4 2024-03-04T13:13:21.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.016+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.5 2024-03-04T13:13:21.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.016+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.6 2024-03-04T13:13:21.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.016+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.6032910225774183703', time=2024-03-04T14:57:19.987298+0000, chain.objs.size()=1 2024-03-04T13:13:21.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.016+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.484__multipart_mymultipart.2~Akfi1quIYlMZNU5N32NMJl3KDGXCnYA.1 2024-03-04T13:13:21.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.016+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16803950113383443691', time=2024-03-04T14:58:22.784863+0000, chain.objs.size()=3 2024-03-04T13:13:21.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.016+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.494__multipart_mymultipart.2~yJAVN6v3BUC4AF89GxrqON0KuqdaMpG.1 2024-03-04T13:13:21.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.016+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.494__multipart_mymultipart.2~yJAVN6v3BUC4AF89GxrqON0KuqdaMpG.2 2024-03-04T13:13:21.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.017+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.494__multipart_mymultipart.2~yJAVN6v3BUC4AF89GxrqON0KuqdaMpG.3 2024-03-04T13:13:21.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.017+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2178398638111192768', time=2024-03-04T15:00:47.393187+0000, chain.objs.size()=2 2024-03-04T13:13:21.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.017+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.498__multipart_mymultipart.2~LmtLLFwxvN72TzeouvxpI5JnzzKksSD.1 2024-03-04T13:13:21.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.020+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.498__multipart_mymultipart.2~LmtLLFwxvN72TzeouvxpI5JnzzKksSD.2 2024-03-04T13:13:21.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.020+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.9115739969131583662', time=2024-03-04T15:05:44.984495+0000, chain.objs.size()=6 2024-03-04T13:13:21.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.020+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.580__multipart_multipart_enc.2~xmDyO2RhA_SEWXDrye2Zc-o2Y1u3s3K.1 2024-03-04T13:13:21.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.020+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.580__multipart_multipart_enc.2~xmDyO2RhA_SEWXDrye2Zc-o2Y1u3s3K.2 2024-03-04T13:13:21.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.020+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.580__multipart_multipart_enc.2~xmDyO2RhA_SEWXDrye2Zc-o2Y1u3s3K.3 2024-03-04T13:13:21.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.020+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.580__multipart_multipart_enc.2~xmDyO2RhA_SEWXDrye2Zc-o2Y1u3s3K.4 2024-03-04T13:13:21.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.020+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.580__multipart_multipart_enc.2~xmDyO2RhA_SEWXDrye2Zc-o2Y1u3s3K.5 2024-03-04T13:13:21.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.020+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.580__multipart_multipart_enc.2~xmDyO2RhA_SEWXDrye2Zc-o2Y1u3s3K.6 2024-03-04T13:13:21.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.025+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.027+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-04T13:13:21.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.028+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T13:13:21.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='_SSBRw6WdBkmPDDsil3jHPEJ8ikYxF1J', time=2024-03-04T14:49:21.031029+0000, chain.objs.size()=1 2024-03-04T13:13:21.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.157__shadow_.laGuZ72yHM3mrfvlQXiLDUwi3xL20zr_0 2024-03-04T13:13:21.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.2_1bbef00fa57faf86f1c4e9d4ac9ae7bf', time=2024-03-04T14:57:17.537688+0000, chain.objs.size()=6 2024-03-04T13:13:21.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.1 2024-03-04T13:13:21.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.2 2024-03-04T13:13:21.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.3 2024-03-04T13:13:21.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.4 2024-03-04T13:13:21.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.5 2024-03-04T13:13:21.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.6 2024-03-04T13:13:21.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3298605830027062433', time=2024-03-04T14:58:18.175047+0000, chain.objs.size()=3 2024-03-04T13:13:21.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.494__multipart_mymultipart.2~Wpfg9vPD4Ttf2TY_rcTFlwJ3l2uoeCv.1 2024-03-04T13:13:21.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.494__multipart_mymultipart.2~Wpfg9vPD4Ttf2TY_rcTFlwJ3l2uoeCv.2 2024-03-04T13:13:21.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.494__multipart_mymultipart.2~Wpfg9vPD4Ttf2TY_rcTFlwJ3l2uoeCv.3 2024-03-04T13:13:21.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~PEA2iTWpcL0qBDKfC5UJ9rE9jnsA3r0', time=2024-03-04T15:01:28.503116+0000, chain.objs.size()=1 2024-03-04T13:13:21.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.029+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.508__multipart_mymultipart.2~PEA2iTWpcL0qBDKfC5UJ9rE9jnsA3r0.3 2024-03-04T13:13:21.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.032+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.034+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-04T13:13:21.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.035+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.036+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.036+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-04T13:13:21.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.036+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15649492739538140149', time=2024-03-04T14:48:30.789068+0000, chain.objs.size()=2 2024-03-04T13:13:21.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.036+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.152__shadow_.wNUN8I7ff1hxjIrppZDIKUJ-XApDsK4_0 2024-03-04T13:13:21.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.036+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.152__shadow_.wNUN8I7ff1hxjIrppZDIKUJ-XApDsK4_1 2024-03-04T13:13:21.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.036+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3429437899200676604', time=2024-03-04T14:57:26.079299+0000, chain.objs.size()=1 2024-03-04T13:13:21.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.036+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.489__multipart_mymultipartcopy.2~arUy2p13g7Kplcmxgt60ATTr01-MVa3.1 2024-03-04T13:13:21.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.036+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.4347343781657632844', time=2024-03-04T15:00:27.025190+0000, chain.objs.size()=1 2024-03-04T13:13:21.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.036+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.496__multipart_mymultipart.2~8X3xJwejRy01CHL5SwvWylCRG4DRCmV.1 2024-03-04T13:13:21.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.036+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8676858262928225555', time=2024-03-04T15:00:36.019691+0000, chain.objs.size()=3 2024-03-04T13:13:21.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.036+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.496__multipart_mymultipart.2~KwYHzVZJxV4dtdinmD_sPHwMcdx66Kl.1 2024-03-04T13:13:21.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.036+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.496__multipart_mymultipart.2~KwYHzVZJxV4dtdinmD_sPHwMcdx66Kl.2 2024-03-04T13:13:21.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.036+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.496__multipart_mymultipart.2~KwYHzVZJxV4dtdinmD_sPHwMcdx66Kl.3 2024-03-04T13:13:21.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.036+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8509615806759363111', time=2024-03-04T15:04:13.586818+0000, chain.objs.size()=4 2024-03-04T13:13:21.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.036+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.545__multipart_testobj.2~VBSK4g65ETXCpdoeGjJ79NZSGw9uh-Z.1 2024-03-04T13:13:21.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.037+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.545__multipart_testobj.2~VBSK4g65ETXCpdoeGjJ79NZSGw9uh-Z.2 2024-03-04T13:13:21.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.037+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.545__multipart_testobj.2~VBSK4g65ETXCpdoeGjJ79NZSGw9uh-Z.3 2024-03-04T13:13:21.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.037+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.545__multipart_testobj.2~VBSK4g65ETXCpdoeGjJ79NZSGw9uh-Z.4 2024-03-04T13:13:21.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.042+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.044+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-04T13:13:21.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.046+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.046+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.047+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T13:13:21.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.047+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17285082342654355115', time=2024-03-04T15:10:14.428858+0000, chain.objs.size()=10 2024-03-04T13:13:21.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.047+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.693__multipart_foo.2~7xPK4e58hfbc6Gs_QnaOUU5ryXzDFVq.1 2024-03-04T13:13:21.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.047+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.693__multipart_foo.2~7xPK4e58hfbc6Gs_QnaOUU5ryXzDFVq.2 2024-03-04T13:13:21.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.047+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.693__multipart_foo.2~7xPK4e58hfbc6Gs_QnaOUU5ryXzDFVq.3 2024-03-04T13:13:21.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.047+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.693__multipart_foo.2~7xPK4e58hfbc6Gs_QnaOUU5ryXzDFVq.4 2024-03-04T13:13:21.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.047+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.693__multipart_foo.2~7xPK4e58hfbc6Gs_QnaOUU5ryXzDFVq.5 2024-03-04T13:13:21.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.047+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.693__multipart_foo.2~7xPK4e58hfbc6Gs_QnaOUU5ryXzDFVq.6 2024-03-04T13:13:21.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.047+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.693__multipart_foo.2~7xPK4e58hfbc6Gs_QnaOUU5ryXzDFVq.7 2024-03-04T13:13:21.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.047+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.693__multipart_foo.2~7xPK4e58hfbc6Gs_QnaOUU5ryXzDFVq.8 2024-03-04T13:13:21.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.047+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.693__multipart_foo.2~7xPK4e58hfbc6Gs_QnaOUU5ryXzDFVq.9 2024-03-04T13:13:21.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.047+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.693__multipart_foo.2~7xPK4e58hfbc6Gs_QnaOUU5ryXzDFVq.10 2024-03-04T13:13:21.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.051+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.054+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-04T13:13:21.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.055+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.056+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.056+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T13:13:21.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.056+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11110526251192308076', time=2024-03-04T14:49:26.422628+0000, chain.objs.size()=2 2024-03-04T13:13:21.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.056+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.158__multipart_foo.2~NPGva0eikJBuOV3BPA4ra1P9-BssZHg.1 2024-03-04T13:13:21.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.056+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.158__multipart_foo.2~NPGva0eikJBuOV3BPA4ra1P9-BssZHg.2 2024-03-04T13:13:21.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.056+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~3fmQj9BF-g_2n8-SHDK1iBmvG5FhOXu', time=2024-03-04T14:58:32.906050+0000, chain.objs.size()=1 2024-03-04T13:13:21.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.056+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~3fmQj9BF-g_2n8-SHDK1iBmvG5FhOXu.1 2024-03-04T13:13:21.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.056+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.138505326665204022', time=2024-03-04T15:00:44.354584+0000, chain.objs.size()=2 2024-03-04T13:13:21.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.056+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.498__multipart_mymultipart.2~g3svNKiAJAfnDsR-fwIgvhvcPmPHiZA.1 2024-03-04T13:13:21.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.056+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.498__multipart_mymultipart.2~g3svNKiAJAfnDsR-fwIgvhvcPmPHiZA.2 2024-03-04T13:13:21.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.056+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8007944253937083314', time=2024-03-04T15:00:55.536481+0000, chain.objs.size()=3 2024-03-04T13:13:21.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.056+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.498__multipart_mymultipart.2~uiV0s7V2jrb19n-RSYFpwQVX1dIkBeb.1 2024-03-04T13:13:21.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.056+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.498__multipart_mymultipart.2~uiV0s7V2jrb19n-RSYFpwQVX1dIkBeb.2 2024-03-04T13:13:21.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.056+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.498__multipart_mymultipart.2~uiV0s7V2jrb19n-RSYFpwQVX1dIkBeb.3 2024-03-04T13:13:21.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.058+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.060+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-04T13:13:21.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.062+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.062+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.062+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-04T13:13:21.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.062+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~Lz0gA8J4fB_TIn-qTF-9v_5dSD7ScaY', time=2024-03-04T14:50:17.907892+0000, chain.objs.size()=1 2024-03-04T13:13:21.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.062+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.195__multipart_mymultipart.2~Lz0gA8J4fB_TIn-qTF-9v_5dSD7ScaY.1 2024-03-04T13:13:21.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.062+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~5KFqSx1CbUOHAdFLxt9hCSg5uMdRA4G', time=2024-03-04T14:59:43.695401+0000, chain.objs.size()=1 2024-03-04T13:13:21.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.062+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~5KFqSx1CbUOHAdFLxt9hCSg5uMdRA4G.2 2024-03-04T13:13:21.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.062+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~5KFqSx1CbUOHAdFLxt9hCSg5uMdRA4G', time=2024-03-04T14:59:43.699224+0000, chain.objs.size()=1 2024-03-04T13:13:21.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.062+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~5KFqSx1CbUOHAdFLxt9hCSg5uMdRA4G.3 2024-03-04T13:13:21.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.062+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15752278448498859202', time=2024-03-04T15:00:10.198639+0000, chain.objs.size()=6 2024-03-04T13:13:21.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.062+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~5KFqSx1CbUOHAdFLxt9hCSg5uMdRA4G.1 2024-03-04T13:13:21.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.062+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.cMFVs8GeaY1wnI-AqND8-_esM2y2rMtw.2 2024-03-04T13:13:21.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.062+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.rgGglHqHvOdE2ZptSL1g2SiQmC5vGPsd.3 2024-03-04T13:13:21.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.062+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~5KFqSx1CbUOHAdFLxt9hCSg5uMdRA4G.4 2024-03-04T13:13:21.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.062+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~5KFqSx1CbUOHAdFLxt9hCSg5uMdRA4G.5 2024-03-04T13:13:21.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.062+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~5KFqSx1CbUOHAdFLxt9hCSg5uMdRA4G.6 2024-03-04T13:13:21.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.063+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16065311776945196834', time=2024-03-04T15:00:58.388417+0000, chain.objs.size()=2 2024-03-04T13:13:21.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.063+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.497__shadow_.hRAvwmKbWTHiWFuWBQwwWCicov7kJC9_1 2024-03-04T13:13:21.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.063+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.497__shadow_.hRAvwmKbWTHiWFuWBQwwWCicov7kJC9_2 2024-03-04T13:13:21.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.066+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.068+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-04T13:13:21.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.069+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.070+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.070+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T13:13:21.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.070+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~32LWKQWTBraR32nw-tKDOIVxx1YjkM2', time=2024-03-04T14:58:55.026837+0000, chain.objs.size()=1 2024-03-04T13:13:21.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.070+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~32LWKQWTBraR32nw-tKDOIVxx1YjkM2.2 2024-03-04T13:13:21.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.071+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.074+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-04T13:13:21.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.075+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.075+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-04T13:13:21.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12081132366004231566', time=2024-03-04T14:48:58.212359+0000, chain.objs.size()=3 2024-03-04T13:13:21.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__multipart_foo-STANDARD.2~ht4IsbSJ-V7EpsRKYubvaBnRvepSERQ.1 2024-03-04T13:13:21.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__multipart_foo-STANDARD.2~ht4IsbSJ-V7EpsRKYubvaBnRvepSERQ.2 2024-03-04T13:13:21.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__multipart_foo-STANDARD.2~ht4IsbSJ-V7EpsRKYubvaBnRvepSERQ.3 2024-03-04T13:13:21.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~dck546SEo37-23YCI9h7STOIPsmNQtJ', time=2024-03-04T14:50:19.827171+0000, chain.objs.size()=1 2024-03-04T13:13:21.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.196__multipart_mymultipart.2~dck546SEo37-23YCI9h7STOIPsmNQtJ.1 2024-03-04T13:13:21.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.6616205399611896027', time=2024-03-04T15:00:33.921374+0000, chain.objs.size()=3 2024-03-04T13:13:21.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.496__multipart_mymultipart.2~7Qxgwp7Hp0mTuNLq8BLaRH-M5IDjQ7m.1 2024-03-04T13:13:21.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.496__multipart_mymultipart.2~7Qxgwp7Hp0mTuNLq8BLaRH-M5IDjQ7m.2 2024-03-04T13:13:21.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.496__multipart_mymultipart.2~7Qxgwp7Hp0mTuNLq8BLaRH-M5IDjQ7m.3 2024-03-04T13:13:21.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~azE6xIa5esxBPnfp_Am_WWiE6up_dJz', time=2024-03-04T15:02:47.645531+0000, chain.objs.size()=1 2024-03-04T13:13:21.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.529__multipart_mymultipart.2~azE6xIa5esxBPnfp_Am_WWiE6up_dJz.1 2024-03-04T13:13:21.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~ITZLNJ6uhlrqfTNWUG123YjM2r9mAh6', time=2024-03-04T15:07:24.919744+0000, chain.objs.size()=6 2024-03-04T13:13:21.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.589__multipart_multipart_enc.2~ITZLNJ6uhlrqfTNWUG123YjM2r9mAh6.1 2024-03-04T13:13:21.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.589__multipart_multipart_enc.2~ITZLNJ6uhlrqfTNWUG123YjM2r9mAh6.2 2024-03-04T13:13:21.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.589__multipart_multipart_enc.2~ITZLNJ6uhlrqfTNWUG123YjM2r9mAh6.3 2024-03-04T13:13:21.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.076+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.589__multipart_multipart_enc.2~ITZLNJ6uhlrqfTNWUG123YjM2r9mAh6.4 2024-03-04T13:13:21.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.080+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.589__multipart_multipart_enc.2~ITZLNJ6uhlrqfTNWUG123YjM2r9mAh6.5 2024-03-04T13:13:21.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.080+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.589__multipart_multipart_enc.2~ITZLNJ6uhlrqfTNWUG123YjM2r9mAh6.6 2024-03-04T13:13:21.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.080+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2839123411824369689', time=2024-03-04T15:08:00.803872+0000, chain.objs.size()=1 2024-03-04T13:13:21.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.080+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.610__shadow_.OVcJpUOVsdtr5M5asrulUdD9ZSfP6iD_1 2024-03-04T13:13:21.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.083+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.086+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-04T13:13:21.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.087+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.088+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.088+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T13:13:21.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.088+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='_1gPqfbxxd_FitvBOOSSRotXsEcn_s8i', time=2024-03-04T14:48:52.804398+0000, chain.objs.size()=1 2024-03-04T13:13:21.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.088+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.154__shadow_.gn9JrZyi9IQxc8k63Oi_6P5XEFZXB_W_1 2024-03-04T13:13:21.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.090+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.092+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-04T13:13:21.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.093+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-04T13:13:21.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17864238325333682311', time=2024-03-04T14:57:36.460875+0000, chain.objs.size()=1 2024-03-04T13:13:21.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.491__multipart_mymultipart.2~H8XY7dTul9_60bYCveVbRu_H8chuByc.1 2024-03-04T13:13:21.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5214100687301965839', time=2024-03-04T15:00:30.926525+0000, chain.objs.size()=2 2024-03-04T13:13:21.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.496__multipart_mymultipart.2~oBOApyeLmXcVnIDOR0hDzeS_eNuLpyI.1 2024-03-04T13:13:21.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.496__multipart_mymultipart.2~oBOApyeLmXcVnIDOR0hDzeS_eNuLpyI.2 2024-03-04T13:13:21.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~aZfB5HW7aj4uqMe_C195LyMPt9YHLea', time=2024-03-04T15:01:14.665133+0000, chain.objs.size()=2 2024-03-04T13:13:21.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.502__multipart_mymultipart.2~aZfB5HW7aj4uqMe_C195LyMPt9YHLea.1 2024-03-04T13:13:21.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.502__multipart_mymultipart.2~aZfB5HW7aj4uqMe_C195LyMPt9YHLea.2 2024-03-04T13:13:21.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13549702880916235589', time=2024-03-04T15:06:31.976802+0000, chain.objs.size()=6 2024-03-04T13:13:21.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.581__multipart_multipart_enc.2~f9XHvjXScnI_flJNrf33oBv-zve0dTk.1 2024-03-04T13:13:21.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.581__multipart_multipart_enc.2~f9XHvjXScnI_flJNrf33oBv-zve0dTk.2 2024-03-04T13:13:21.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.581__multipart_multipart_enc.2~f9XHvjXScnI_flJNrf33oBv-zve0dTk.3 2024-03-04T13:13:21.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.581__multipart_multipart_enc.2~f9XHvjXScnI_flJNrf33oBv-zve0dTk.4 2024-03-04T13:13:21.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.581__multipart_multipart_enc.2~f9XHvjXScnI_flJNrf33oBv-zve0dTk.5 2024-03-04T13:13:21.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.581__multipart_multipart_enc.2~f9XHvjXScnI_flJNrf33oBv-zve0dTk.6 2024-03-04T13:13:21.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.14342893952320356441', time=2024-03-04T15:07:16.064035+0000, chain.objs.size()=6 2024-03-04T13:13:21.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.094+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.588__multipart_multipart_enc.2~Frp22mbmYkdR6FVkgn-3qS6I1UzK24c.1 2024-03-04T13:13:21.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.096+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.588__multipart_multipart_enc.2~Frp22mbmYkdR6FVkgn-3qS6I1UzK24c.2 2024-03-04T13:13:21.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.097+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.588__multipart_multipart_enc.2~Frp22mbmYkdR6FVkgn-3qS6I1UzK24c.3 2024-03-04T13:13:21.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.097+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.588__multipart_multipart_enc.2~Frp22mbmYkdR6FVkgn-3qS6I1UzK24c.4 2024-03-04T13:13:21.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.097+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.588__multipart_multipart_enc.2~Frp22mbmYkdR6FVkgn-3qS6I1UzK24c.5 2024-03-04T13:13:21.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.097+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.588__multipart_multipart_enc.2~Frp22mbmYkdR6FVkgn-3qS6I1UzK24c.6 2024-03-04T13:13:21.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.097+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.281688506322453680', time=2024-03-04T15:08:13.606540+0000, chain.objs.size()=1 2024-03-04T13:13:21.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.097+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.617__shadow_.LhhSV-q7S1Qs_S1Uj3hbc1oRNT5Lm99_1 2024-03-04T13:13:21.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.097+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8345523600610225253', time=2024-03-04T15:08:46.690918+0000, chain.objs.size()=6 2024-03-04T13:13:21.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.097+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.625__multipart_foo.2~RcKC4r1A1Jg-N_XOtla8QA_Ux8a9XR4.1 2024-03-04T13:13:21.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.100+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.625__multipart_foo.2~RcKC4r1A1Jg-N_XOtla8QA_Ux8a9XR4.2 2024-03-04T13:13:21.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.100+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.625__multipart_foo.2~RcKC4r1A1Jg-N_XOtla8QA_Ux8a9XR4.3 2024-03-04T13:13:21.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.100+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.625__multipart_foo.2~RcKC4r1A1Jg-N_XOtla8QA_Ux8a9XR4.4 2024-03-04T13:13:21.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.100+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.625__multipart_foo.2~RcKC4r1A1Jg-N_XOtla8QA_Ux8a9XR4.5 2024-03-04T13:13:21.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.101+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.625__multipart_foo.2~RcKC4r1A1Jg-N_XOtla8QA_Ux8a9XR4.6 2024-03-04T13:13:21.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.102+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.104+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-04T13:13:21.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.105+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.106+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.106+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T13:13:21.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.106+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2102174561237591928', time=2024-03-04T14:48:38.322950+0000, chain.objs.size()=3 2024-03-04T13:13:21.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.106+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.153__multipart_mymultipart-LUKEWARM.2~1vGLMtOqe_a5hGTQwPzzyOzUoNLkRFt.1 2024-03-04T13:13:21.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.106+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.153__multipart_mymultipart-LUKEWARM.2~1vGLMtOqe_a5hGTQwPzzyOzUoNLkRFt.2 2024-03-04T13:13:21.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.106+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.153__multipart_mymultipart-LUKEWARM.2~1vGLMtOqe_a5hGTQwPzzyOzUoNLkRFt.3 2024-03-04T13:13:21.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.108+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.110+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-04T13:13:21.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.112+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.112+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.113+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T13:13:21.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.113+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='_6H2t_zaj1YPtrXKmUG10sr5VYrZjxIx', time=2024-03-04T14:49:14.632509+0000, chain.objs.size()=2 2024-03-04T13:13:21.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.113+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__shadow_.ctq_idaStcyDYhPrbhbI1QvRU59R3vm_0 2024-03-04T13:13:21.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.113+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__shadow_.ctq_idaStcyDYhPrbhbI1QvRU59R3vm_1 2024-03-04T13:13:21.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.113+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~L010OOryTg4FrjL9SIeMKPIt8yRcMZD', time=2024-03-04T14:59:18.084200+0000, chain.objs.size()=1 2024-03-04T13:13:21.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.113+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~L010OOryTg4FrjL9SIeMKPIt8yRcMZD.3 2024-03-04T13:13:21.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.116+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.117+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-04T13:13:21.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.119+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.119+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.119+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T13:13:21.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.119+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5685258618788248017', time=2024-03-04T14:59:18.102522+0000, chain.objs.size()=6 2024-03-04T13:13:21.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.119+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~32LWKQWTBraR32nw-tKDOIVxx1YjkM2.1 2024-03-04T13:13:21.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.119+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2K0PhJK95Q3tG7AQ2UbaHB6xZ__7lxpH.2 2024-03-04T13:13:21.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.119+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~32LWKQWTBraR32nw-tKDOIVxx1YjkM2.3 2024-03-04T13:13:21.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.119+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~32LWKQWTBraR32nw-tKDOIVxx1YjkM2.4 2024-03-04T13:13:21.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.119+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~32LWKQWTBraR32nw-tKDOIVxx1YjkM2.5 2024-03-04T13:13:21.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.119+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~32LWKQWTBraR32nw-tKDOIVxx1YjkM2.6 2024-03-04T13:13:21.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.119+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16798693412381760558', time=2024-03-04T15:08:08.372825+0000, chain.objs.size()=1 2024-03-04T13:13:21.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.119+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.613__shadow_.6d9t-eRiNewlKLiLyCA6MaghkFpywWr_1 2024-03-04T13:13:21.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.122+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.124+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-04T13:13:21.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.125+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.126+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.126+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T13:13:21.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.126+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='_51Pbzb3CC0v1iWxuEjjcmxXE1otMmKF', time=2024-03-04T14:48:59.682723+0000, chain.objs.size()=2 2024-03-04T13:13:21.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.126+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__shadow_.EOS9-ViQE9f9cf5vBg2hVHUo-yNvOBi_0 2024-03-04T13:13:21.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.126+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__shadow_.EOS9-ViQE9f9cf5vBg2hVHUo-yNvOBi_1 2024-03-04T13:13:21.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.126+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~cBZ2PuW1ogF0vWmyToWx8IchIr18_1y', time=2024-03-04T15:01:20.342037+0000, chain.objs.size()=1 2024-03-04T13:13:21.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.126+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.504__multipart_mymultipart.2~cBZ2PuW1ogF0vWmyToWx8IchIr18_1y.1 2024-03-04T13:13:21.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.129+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.132+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-04T13:13:21.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.133+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.133+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-04T13:13:21.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='_fk6MJCnKX6s8GfZSuBYZMcTJD0C_F_t', time=2024-03-04T14:48:53.995270+0000, chain.objs.size()=2 2024-03-04T13:13:21.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.154__shadow_.MWb4eWS-0GxaaU7NmUhV05znL5WpN5E_0 2024-03-04T13:13:21.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.154__shadow_.MWb4eWS-0GxaaU7NmUhV05znL5WpN5E_1 2024-03-04T13:13:21.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='_VIXris-aloRRetbj_mrar33_3IwRTJt', time=2024-03-04T14:49:13.203017+0000, chain.objs.size()=2 2024-03-04T13:13:21.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__shadow_.aJQiT_FG9p4xZIBuuVX5JHnuXGJxXIh_1 2024-03-04T13:13:21.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__shadow_.aJQiT_FG9p4xZIBuuVX5JHnuXGJxXIh_2 2024-03-04T13:13:21.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.4289232584753424853', time=2024-03-04T14:57:30.651473+0000, chain.objs.size()=1 2024-03-04T13:13:21.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.491__multipart_mymultipart.2~j6ePDZi0Fjjahg0Q6KNqFpK2hl6Ci_H.1 2024-03-04T13:13:21.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.18004848561075519626', time=2024-03-04T15:00:51.572649+0000, chain.objs.size()=3 2024-03-04T13:13:21.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.498__multipart_mymultipart.2~To9OiGfBzzsBDeE7vSNcO0jAQlUBq7l.1 2024-03-04T13:13:21.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.498__multipart_mymultipart.2~To9OiGfBzzsBDeE7vSNcO0jAQlUBq7l.2 2024-03-04T13:13:21.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.498__multipart_mymultipart.2~To9OiGfBzzsBDeE7vSNcO0jAQlUBq7l.3 2024-03-04T13:13:21.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.595896981376747384', time=2024-03-04T15:04:19.474120+0000, chain.objs.size()=4 2024-03-04T13:13:21.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.545__multipart_testobj.2~hdK5elHUHF9uNOWGCCNG6QeOG5eO4WZ.1 2024-03-04T13:13:21.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.545__multipart_testobj.2~hdK5elHUHF9uNOWGCCNG6QeOG5eO4WZ.2 2024-03-04T13:13:21.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.545__multipart_testobj.2~hdK5elHUHF9uNOWGCCNG6QeOG5eO4WZ.3 2024-03-04T13:13:21.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.134+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.545__multipart_testobj.2~hdK5elHUHF9uNOWGCCNG6QeOG5eO4WZ.4 2024-03-04T13:13:21.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.138+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.17508316367682653783', time=2024-03-04T15:08:16.017904+0000, chain.objs.size()=1 2024-03-04T13:13:21.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.138+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.618__shadow_.Zo3wqgbd402bQhctma_IMgfEat78xhO_1 2024-03-04T13:13:21.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.139+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.141+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-04T13:13:21.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.143+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.143+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.144+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T13:13:21.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.144+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.1257731244019030355', time=2024-03-04T14:57:17.556502+0000, chain.objs.size()=6 2024-03-04T13:13:21.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.144+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.1 2024-03-04T13:13:21.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.144+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.2 2024-03-04T13:13:21.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.144+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.3 2024-03-04T13:13:21.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.144+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.4 2024-03-04T13:13:21.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.144+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.5 2024-03-04T13:13:21.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.144+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.6 2024-03-04T13:13:21.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.144+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.2_19665e9429244f4df2b4810845dc1a51', time=2024-03-04T14:57:18.058859+0000, chain.objs.size()=6 2024-03-04T13:13:21.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.144+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.1 2024-03-04T13:13:21.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.144+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.2 2024-03-04T13:13:21.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.144+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.3 2024-03-04T13:13:21.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.144+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.4 2024-03-04T13:13:21.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.144+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.5 2024-03-04T13:13:21.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.144+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.6 2024-03-04T13:13:21.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.146+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2220525164502556253', time=2024-03-04T14:57:35.630236+0000, chain.objs.size()=1 2024-03-04T13:13:21.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.146+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.491__multipart_mymultipart.2~9Iwgp0pUOLak2_dDtPd3Irb9MFDIG2v.1 2024-03-04T13:13:21.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.147+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.149+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-04T13:13:21.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.151+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.151+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.151+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T13:13:21.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.151+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.6248942678900424864', time=2024-03-04T15:00:28.755704+0000, chain.objs.size()=2 2024-03-04T13:13:21.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.151+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.496__multipart_mymultipart.2~uXyVasS6Y0SPXORdCtlHgKtg4VUzypg.1 2024-03-04T13:13:21.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.151+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.496__multipart_mymultipart.2~uXyVasS6Y0SPXORdCtlHgKtg4VUzypg.2 2024-03-04T13:13:21.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.151+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2566021821356286034', time=2024-03-04T15:00:42.071710+0000, chain.objs.size()=1 2024-03-04T13:13:21.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.151+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.498__multipart_mymultipart.2~3d67jEQFqu3sgUzjztSwyjH0ck0eYji.1 2024-03-04T13:13:21.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.151+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8405460660382203717', time=2024-03-04T15:08:46.192642+0000, chain.objs.size()=6 2024-03-04T13:13:21.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.151+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.623__multipart_bar.2~lgb1Ba-HEmMqj3P845iFl6uzB56joH-.1 2024-03-04T13:13:21.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.151+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.623__multipart_bar.2~lgb1Ba-HEmMqj3P845iFl6uzB56joH-.2 2024-03-04T13:13:21.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.151+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.623__multipart_bar.2~lgb1Ba-HEmMqj3P845iFl6uzB56joH-.3 2024-03-04T13:13:21.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.151+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.623__multipart_bar.2~lgb1Ba-HEmMqj3P845iFl6uzB56joH-.4 2024-03-04T13:13:21.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.152+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.623__multipart_bar.2~lgb1Ba-HEmMqj3P845iFl6uzB56joH-.5 2024-03-04T13:13:21.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.152+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.623__multipart_bar.2~lgb1Ba-HEmMqj3P845iFl6uzB56joH-.6 2024-03-04T13:13:21.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.155+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.157+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-04T13:13:21.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.158+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.158+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T13:13:21.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2454656876002816884', time=2024-03-04T14:48:38.298050+0000, chain.objs.size()=3 2024-03-04T13:13:21.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.153__multipart_mymultipart-FROZEN.2~JnHmj9PybUmw0tJy7JSwNTTCElYXFNz.1 2024-03-04T13:13:21.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.153__multipart_mymultipart-FROZEN.2~JnHmj9PybUmw0tJy7JSwNTTCElYXFNz.2 2024-03-04T13:13:21.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.153__multipart_mymultipart-FROZEN.2~JnHmj9PybUmw0tJy7JSwNTTCElYXFNz.3 2024-03-04T13:13:21.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='_y6aeWYHubHR-a9ZUyaMDTpble1sP3kX', time=2024-03-04T14:48:54.020959+0000, chain.objs.size()=2 2024-03-04T13:13:21.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.154__shadow_.llqRaBCe2uP5H8sJHh5TMr_CHRIEA2Y_0 2024-03-04T13:13:21.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.154__shadow_.llqRaBCe2uP5H8sJHh5TMr_CHRIEA2Y_1 2024-03-04T13:13:21.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.4351627555431533456', time=2024-03-04T14:58:55.045990+0000, chain.objs.size()=6 2024-03-04T13:13:21.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.E4oldmutzkWkKccPjRC3CEmWaqjCmVi2.1 2024-03-04T13:13:21.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~3fmQj9BF-g_2n8-SHDK1iBmvG5FhOXu.2 2024-03-04T13:13:21.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~3fmQj9BF-g_2n8-SHDK1iBmvG5FhOXu.3 2024-03-04T13:13:21.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~3fmQj9BF-g_2n8-SHDK1iBmvG5FhOXu.4 2024-03-04T13:13:21.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~3fmQj9BF-g_2n8-SHDK1iBmvG5FhOXu.5 2024-03-04T13:13:21.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~3fmQj9BF-g_2n8-SHDK1iBmvG5FhOXu.6 2024-03-04T13:13:21.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12030373044558803358', time=2024-03-04T14:59:43.717495+0000, chain.objs.size()=6 2024-03-04T13:13:21.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.159+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~L010OOryTg4FrjL9SIeMKPIt8yRcMZD.1 2024-03-04T13:13:21.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.162+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~L010OOryTg4FrjL9SIeMKPIt8yRcMZD.2 2024-03-04T13:13:21.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.162+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.hwS_gumqZjBaEA--ib_b9HhLPM4kwadg.3 2024-03-04T13:13:21.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.162+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~L010OOryTg4FrjL9SIeMKPIt8yRcMZD.4 2024-03-04T13:13:21.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.163+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~L010OOryTg4FrjL9SIeMKPIt8yRcMZD.5 2024-03-04T13:13:21.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.163+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.2~L010OOryTg4FrjL9SIeMKPIt8yRcMZD.6 2024-03-04T13:13:21.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.164+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.167+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-04T13:13:21.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.168+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.168 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-04T13:13:21.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2191023902797675947', time=2024-03-04T14:57:23.364369+0000, chain.objs.size()=1 2024-03-04T13:13:21.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.486__multipart_mymultipart.2~-75pAj_GZ668kRhqV9xjnwb7tXtQixY.1 2024-03-04T13:13:21.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2258641472170257237', time=2024-03-04T14:58:12.803794+0000, chain.objs.size()=3 2024-03-04T13:13:21.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.494__multipart_mymultipart.2~p4ScECnHjkEQhcxBEwamx-5X_ophhdp.1 2024-03-04T13:13:21.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.494__multipart_mymultipart.2~p4ScECnHjkEQhcxBEwamx-5X_ophhdp.2 2024-03-04T13:13:21.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.494__multipart_mymultipart.2~p4ScECnHjkEQhcxBEwamx-5X_ophhdp.3 2024-03-04T13:13:21.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.7249925230571907880', time=2024-03-04T15:02:42.538185+0000, chain.objs.size()=1 2024-03-04T13:13:21.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.526__shadow_.IW_1AE78PpCMrRXozHOfK9PEhFKpIFe_1 2024-03-04T13:13:21.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11477065397396095907', time=2024-03-04T15:02:48.057251+0000, chain.objs.size()=1 2024-03-04T13:13:21.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.529__multipart_mymultipart.aGaYTFRPjbc83aSsBxFj7T-W7G2bewWg.1 2024-03-04T13:13:21.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~jaALgkTlaOLPewjI7-sLypB0cexJlc1', time=2024-03-04T15:07:33.642799+0000, chain.objs.size()=6 2024-03-04T13:13:21.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.590__multipart_multipart_enc.2~jaALgkTlaOLPewjI7-sLypB0cexJlc1.1 2024-03-04T13:13:21.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.590__multipart_multipart_enc.2~jaALgkTlaOLPewjI7-sLypB0cexJlc1.2 2024-03-04T13:13:21.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.590__multipart_multipart_enc.2~jaALgkTlaOLPewjI7-sLypB0cexJlc1.3 2024-03-04T13:13:21.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.590__multipart_multipart_enc.2~jaALgkTlaOLPewjI7-sLypB0cexJlc1.4 2024-03-04T13:13:21.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.590__multipart_multipart_enc.2~jaALgkTlaOLPewjI7-sLypB0cexJlc1.5 2024-03-04T13:13:21.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.169+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.590__multipart_multipart_enc.2~jaALgkTlaOLPewjI7-sLypB0cexJlc1.6 2024-03-04T13:13:21.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.173+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.175+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-04T13:13:21.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.177+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.177+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.177+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T13:13:21.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.177+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.16205662218819715668', time=2024-03-04T14:48:30.764355+0000, chain.objs.size()=2 2024-03-04T13:13:21.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.177+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.152__shadow_.nzDlWX9iHEFs0zhK1tqapsO7iI-Ie17_0 2024-03-04T13:13:21.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.178+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.152__shadow_.nzDlWX9iHEFs0zhK1tqapsO7iI-Ie17_1 2024-03-04T13:13:21.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.178+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.8486910007440857582', time=2024-03-04T14:48:46.140161+0000, chain.objs.size()=2 2024-03-04T13:13:21.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.178+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.154__shadow_.pEgUw2axLCnZcnTGbDRCZ2AHqjy8xLP_0 2024-03-04T13:13:21.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.178+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.154__shadow_.pEgUw2axLCnZcnTGbDRCZ2AHqjy8xLP_1 2024-03-04T13:13:21.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.178+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.2_7ec2a7e8b5aa62eb233d736a74818070', time=2024-03-04T14:57:17.550252+0000, chain.objs.size()=6 2024-03-04T13:13:21.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.178+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.1 2024-03-04T13:13:21.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.178+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.2 2024-03-04T13:13:21.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.178+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.3 2024-03-04T13:13:21.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.178+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.4 2024-03-04T13:13:21.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.178+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.5 2024-03-04T13:13:21.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.178+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.6 2024-03-04T13:13:21.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.178+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.10215461967392520079', time=2024-03-04T15:01:06.385563+0000, chain.objs.size()=4 2024-03-04T13:13:21.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.178+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.500__multipart_mymultipart.2~hT0vmQpO75flQJqsIY7Sm7_MeUXPyb-.1 2024-03-04T13:13:21.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.178+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.500__multipart_mymultipart.2~hT0vmQpO75flQJqsIY7Sm7_MeUXPyb-.2 2024-03-04T13:13:21.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.180+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.500__multipart_mymultipart.2~hT0vmQpO75flQJqsIY7Sm7_MeUXPyb-.3 2024-03-04T13:13:21.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.180+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.500__multipart_mymultipart.2~hT0vmQpO75flQJqsIY7Sm7_MeUXPyb-.4 2024-03-04T13:13:21.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.183+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.185+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-04T13:13:21.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.186+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.187+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.187+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T13:13:21.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.187+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11613976572197424056', time=2024-03-04T14:49:04.815333+0000, chain.objs.size()=3 2024-03-04T13:13:21.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.187+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__multipart_foo-LUKEWARM.2~xRqsiZ0bOmWJ8kJml9f5dqCHC7hRa0W.1 2024-03-04T13:13:21.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.187+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__multipart_foo-LUKEWARM.2~xRqsiZ0bOmWJ8kJml9f5dqCHC7hRa0W.2 2024-03-04T13:13:21.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.187+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__multipart_foo-LUKEWARM.2~xRqsiZ0bOmWJ8kJml9f5dqCHC7hRa0W.3 2024-03-04T13:13:21.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.187+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.6969802685874900348', time=2024-03-04T15:01:11.233117+0000, chain.objs.size()=2 2024-03-04T13:13:21.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.187+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.501__multipart_mymultipart.2~xZgzQa-fB4DFdXCHRTO798ylBnah2Qv.1 2024-03-04T13:13:21.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.187+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.501__multipart_mymultipart.2~xZgzQa-fB4DFdXCHRTO798ylBnah2Qv.2 2024-03-04T13:13:21.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.189+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.191+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-04T13:13:21.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.193+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.193+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.193+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T13:13:21.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.193+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='_WybmYpVVWKBzwWcKYg152FVtthpx6r1', time=2024-03-04T14:48:54.048556+0000, chain.objs.size()=1 2024-03-04T13:13:21.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.193+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.154__shadow_.ZBCXe7zuQgquvwTVRz82L3Mn8I21L_R_0 2024-03-04T13:13:21.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.193+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15645162631294465609', time=2024-03-04T15:00:36.229928+0000, chain.objs.size()=2 2024-03-04T13:13:21.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.193+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.496__multipart_mymultipart.2~_fEvlQBhJGJ6BnFRiaHPq896c6X_Fnj.1 2024-03-04T13:13:21.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.193+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.496__multipart_mymultipart.2~_fEvlQBhJGJ6BnFRiaHPq896c6X_Fnj.2 2024-03-04T13:13:21.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.195+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.197+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-04T13:13:21.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.198+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.198+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.199+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T13:13:21.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.199+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='_JkcMQiILqmRzcmZ5r919kHuNCqYw-1h', time=2024-03-04T14:49:26.649277+0000, chain.objs.size()=1 2024-03-04T13:13:21.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.199+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.159__shadow_.0Bjy0otJgQjR5axCAcK8bRQoBmxsp8a_0 2024-03-04T13:13:21.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.200+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.202+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-04T13:13:21.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.203+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.204+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.204+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T13:13:21.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.204+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='_5S5aCFpN5LR7VSF3zqpettCDD0CTttC', time=2024-03-04T14:49:26.624052+0000, chain.objs.size()=1 2024-03-04T13:13:21.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.204+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.159__shadow_.16dulI9diKo0qlbeeN2XLAH-XzRODaX_0 2024-03-04T13:13:21.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.204+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5707195902857107089', time=2024-03-04T14:57:23.125109+0000, chain.objs.size()=1 2024-03-04T13:13:21.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.204+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.485__shadow_.IMgqIQdqhyfDkfFomxAbBEGGsGrLVvU_1 2024-03-04T13:13:21.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.204+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.11286355810048079956', time=2024-03-04T15:00:58.622307+0000, chain.objs.size()=2 2024-03-04T13:13:21.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.204+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.498__multipart_mymultipart.2~5Xoq7iZRvXQutr5sipLkF0s3udUaM5D.1 2024-03-04T13:13:21.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.204+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.498__multipart_mymultipart.2~5Xoq7iZRvXQutr5sipLkF0s3udUaM5D.2 2024-03-04T13:13:21.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.204+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.5799614493250317330', time=2024-03-04T15:08:46.421695+0000, chain.objs.size()=6 2024-03-04T13:13:21.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.204+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.624__multipart_baz.2~JEzHudLHRREUZpNkSr3Ui7n6-i6MKc8.1 2024-03-04T13:13:21.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.204+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.624__multipart_baz.2~JEzHudLHRREUZpNkSr3Ui7n6-i6MKc8.2 2024-03-04T13:13:21.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.204+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.624__multipart_baz.2~JEzHudLHRREUZpNkSr3Ui7n6-i6MKc8.3 2024-03-04T13:13:21.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.204+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.624__multipart_baz.2~JEzHudLHRREUZpNkSr3Ui7n6-i6MKc8.4 2024-03-04T13:13:21.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.204+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.624__multipart_baz.2~JEzHudLHRREUZpNkSr3Ui7n6-i6MKc8.5 2024-03-04T13:13:21.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.204+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.624__multipart_baz.2~JEzHudLHRREUZpNkSr3Ui7n6-i6MKc8.6 2024-03-04T13:13:21.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.206+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.208+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-04T13:13:21.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.209+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.210+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.210+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-04T13:13:21.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.210+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='_6QzNYfNZYR7hH3XZ3DsfTf7NQZNMwNA', time=2024-03-04T14:48:42.209270+0000, chain.objs.size()=1 2024-03-04T13:13:21.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.210+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.154__shadow_.BltaDEPFu7yjQYgu6_3c4J4_WFZgSId_0 2024-03-04T13:13:21.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.211+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.213+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-04T13:13:21.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.214+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.215+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.215+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-04T13:13:21.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.215+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.13447000641003123740', time=2024-03-04T14:49:11.560550+0000, chain.objs.size()=3 2024-03-04T13:13:21.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.215+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__multipart_foo-FROZEN.2~Be-lUKDF4AIzuiQL1Z8wdp0lpfIfOUK.1 2024-03-04T13:13:21.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.215+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__multipart_foo-FROZEN.2~Be-lUKDF4AIzuiQL1Z8wdp0lpfIfOUK.2 2024-03-04T13:13:21.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.215+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__multipart_foo-FROZEN.2~Be-lUKDF4AIzuiQL1Z8wdp0lpfIfOUK.3 2024-03-04T13:13:21.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.215+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.1160579513234611993', time=2024-03-04T15:02:56.012656+0000, chain.objs.size()=1 2024-03-04T13:13:21.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.215+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.531__shadow_.eYREp8AKQkcGZQDFsamXVBW8CzF50ZZ_1 2024-03-04T13:13:21.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.215+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.12631593570036350759', time=2024-03-04T15:06:41.691244+0000, chain.objs.size()=6 2024-03-04T13:13:21.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.215+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.582__multipart_multipart_enc.2~KzYNmk1jTubL0wNF9rlTk4hGmooc0AG.1 2024-03-04T13:13:21.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.215+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.582__multipart_multipart_enc.2~KzYNmk1jTubL0wNF9rlTk4hGmooc0AG.2 2024-03-04T13:13:21.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.215+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.582__multipart_multipart_enc.2~KzYNmk1jTubL0wNF9rlTk4hGmooc0AG.3 2024-03-04T13:13:21.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.215+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.582__multipart_multipart_enc.2~KzYNmk1jTubL0wNF9rlTk4hGmooc0AG.4 2024-03-04T13:13:21.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.215+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.582__multipart_multipart_enc.2~KzYNmk1jTubL0wNF9rlTk4hGmooc0AG.5 2024-03-04T13:13:21.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.215+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.582__multipart_multipart_enc.2~KzYNmk1jTubL0wNF9rlTk4hGmooc0AG.6 2024-03-04T13:13:21.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.221+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.224+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-04T13:13:21.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.225+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.225+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.226+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-04T13:13:21.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.226+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.2_93bfa27e469b0f75c52b764b4fc38979', time=2024-03-04T14:57:18.058846+0000, chain.objs.size()=6 2024-03-04T13:13:21.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.226+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.1 2024-03-04T13:13:21.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.226+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.2 2024-03-04T13:13:21.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.226+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.3 2024-03-04T13:13:21.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.226+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.4 2024-03-04T13:13:21.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.226+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.5 2024-03-04T13:13:21.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.226+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.480__multipart_srcmultipart.2~cChebyO-9kwwG3fq8WaGrQQWBJ6C700.6 2024-03-04T13:13:21.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.226+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='2~e9VZ0Oa0nEZO9hV58lWMlfXOotiem81', time=2024-03-04T15:01:20.373732+0000, chain.objs.size()=2 2024-03-04T13:13:21.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.226+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.504__multipart_mymultipart.2~e9VZ0Oa0nEZO9hV58lWMlfXOotiem81.1 2024-03-04T13:13:21.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.226+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.504__multipart_mymultipart.2~e9VZ0Oa0nEZO9hV58lWMlfXOotiem81.2 2024-03-04T13:13:21.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.227+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.229+0000 7fd627e24800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-04T13:13:21.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.231+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-04T13:13:21.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.231+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-04T13:13:21.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.231+0000 7fd627e24800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-04T13:13:21.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.231+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='_NO_70bR7-FBmeXkaanmctOklruyNp4o', time=2024-03-04T14:49:14.687381+0000, chain.objs.size()=2 2024-03-04T13:13:21.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.231+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__shadow_.Xnx2CF0YkJ8mz8yJiRFBnmmTV4zynm5_0 2024-03-04T13:13:21.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.231+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.155__shadow_.Xnx2CF0YkJ8mz8yJiRFBnmmTV4zynm5_1 2024-03-04T13:13:21.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.232+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.3889189366997640259', time=2024-03-04T14:57:36.234326+0000, chain.objs.size()=1 2024-03-04T13:13:21.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.232+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.490__shadow_.kC2fN87CLj9jcvwCAA_isb62STl79Gp_1 2024-03-04T13:13:21.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.232+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.2467177497287226279', time=2024-03-04T14:57:56.709245+0000, chain.objs.size()=6 2024-03-04T13:13:21.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.232+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.492__multipart_mymultipart.2~EltiyNynhg4Q2k7RqT24FumlC7UqTTc.1 2024-03-04T13:13:21.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.232+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.492__multipart_mymultipart.2~EltiyNynhg4Q2k7RqT24FumlC7UqTTc.2 2024-03-04T13:13:21.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.232+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.492__multipart_mymultipart.2~EltiyNynhg4Q2k7RqT24FumlC7UqTTc.3 2024-03-04T13:13:21.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.232+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.492__multipart_mymultipart.2~EltiyNynhg4Q2k7RqT24FumlC7UqTTc.4 2024-03-04T13:13:21.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.232+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.492__multipart_mymultipart.2~EltiyNynhg4Q2k7RqT24FumlC7UqTTc.5 2024-03-04T13:13:21.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.232+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.492__multipart_mymultipart.2~EltiyNynhg4Q2k7RqT24FumlC7UqTTc.6 2024-03-04T13:13:21.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.232+0000 7fd627e24800 20 garbage collection: RGWGC::process iterating over entry tag='82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.15550192967130473183', time=2024-03-04T15:00:23.783053+0000, chain.objs.size()=6 2024-03-04T13:13:21.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.232+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.Mfs2UrtvSA9ALET1J2nHPvkU2TjxL_P8.1 2024-03-04T13:13:21.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.232+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.003A--mdj0MJIiqlIdiqhxMeXWXTzMY7.2 2024-03-04T13:13:21.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.232+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.10CKaLprveAQwG-qsA-bZwPaBSW_V-z0.3 2024-03-04T13:13:21.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.235+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.IkSBKTO2UTqqKP16UDl2C-kWEa4IowlH.4 2024-03-04T13:13:21.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.235+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.J7Rg2JXnNLuyKeTE-jGNDgF5OLep0TwH.5 2024-03-04T13:13:21.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.235+0000 7fd627e24800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:82bf9204-52b3-42fc-9db8-0f1135c09e01.4502.495__multipart_mymultipart.1WrRoJHfgzNbBRg4-VvPNmO6KkQSqiJq.6 2024-03-04T13:13:21.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.236+0000 7fd627e24800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-04T13:13:21.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.239+0000 7fd4d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-04T13:13:21.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.241+0000 7fd627e24800 20 remove_watcher() i=0 2024-03-04T13:13:21.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.241+0000 7fd627e24800 2 removed watcher, disabling cache 2024-03-04T13:13:21.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.242+0000 7fd627e24800 20 remove_watcher() i=1 2024-03-04T13:13:21.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.243+0000 7fd627e24800 20 remove_watcher() i=2 2024-03-04T13:13:21.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.244+0000 7fd627e24800 20 remove_watcher() i=3 2024-03-04T13:13:21.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.245+0000 7fd627e24800 20 remove_watcher() i=4 2024-03-04T13:13:21.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.246+0000 7fd627e24800 20 remove_watcher() i=5 2024-03-04T13:13:21.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.247+0000 7fd627e24800 20 remove_watcher() i=6 2024-03-04T13:13:21.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-04T13:13:21.248+0000 7fd627e24800 20 remove_watcher() i=7 2024-03-04T13:13:21.258 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-03-04T13:13:21.272 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-03-04T13:13:21.300 DEBUG:teuthology.orchestra.run.smithi110:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-03-04T13:13:21.367 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-03-04T13:13:21.434 DEBUG:teuthology.orchestra.run.smithi110:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-03-04T13:13:21.501 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm /usr/share/pki/ca-trust-source/anchors/root.crt 2024-03-04T13:13:21.580 DEBUG:teuthology.orchestra.run.smithi110:> sudo update-ca-trust 2024-03-04T13:13:22.360 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-04T13:13:22.372 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-04T13:13:22.372 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T13:13:22.707 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:22.720 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-03-04T13:13:22.724 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":1850,"stamp":"2024-03-04T13:13:22.552736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":277125608,"num_objects":674,"num_object_clones":0,"num_object_copies":1348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":674,"num_whiteouts":0,"num_read":244835,"num_read_kb":2733524,"num_write":142224,"num_write_kb":2439956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14195,"ondisk_log_size":14195,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1763868,"kb_used_data":571572,"kb_used_omap":12,"kb_used_meta":1191859,"kb_avail":753210852,"statfs":{"total":773094113280,"available":771287912448,"internally_reserved":0,"allocated":585289728,"data_stored":572096195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1220464178},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-477632227,"num_objects":-234,"num_object_clones":0,"num_object_copies":-468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-234,"num_whiteouts":0,"num_read":555,"num_read_kb":12938,"num_write":359,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004349"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.484480+0000","last_change":"2024-03-04T12:46:22.249796+0000","last_active":"2024-03-04T13:08:52.484480+0000","last_peered":"2024-03-04T13:08:52.484480+0000","last_clean":"2024-03-04T13:08:52.484480+0000","last_became_active":"2024-03-04T12:46:22.248352+0000","last_became_peered":"2024-03-04T12:46:22.248352+0000","last_unstale":"2024-03-04T13:08:52.484480+0000","last_undegraded":"2024-03-04T13:08:52.484480+0000","last_fullsized":"2024-03-04T13:08:52.484480+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:06:29.651006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.542968+0000","last_change":"2024-03-04T12:32:46.051455+0000","last_active":"2024-03-04T13:10:17.542968+0000","last_peered":"2024-03-04T13:10:17.542968+0000","last_clean":"2024-03-04T13:10:17.542968+0000","last_became_active":"2024-03-04T12:32:46.051177+0000","last_became_peered":"2024-03-04T12:32:46.051177+0000","last_unstale":"2024-03-04T13:10:17.542968+0000","last_undegraded":"2024-03-04T13:10:17.542968+0000","last_fullsized":"2024-03-04T13:10:17.542968+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:41:49.996314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"255'2","reported_seq":51,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.456404+0000","last_change":"2024-03-04T12:32:42.034412+0000","last_active":"2024-03-04T13:12:47.456404+0000","last_peered":"2024-03-04T13:12:47.456404+0000","last_clean":"2024-03-04T13:12:47.456404+0000","last_became_active":"2024-03-04T12:32:42.034142+0000","last_became_peered":"2024-03-04T12:32:42.034142+0000","last_unstale":"2024-03-04T13:12:47.456404+0000","last_undegraded":"2024-03-04T13:12:47.456404+0000","last_fullsized":"2024-03-04T13:12:47.456404+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:44.538526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"255'17","reported_seq":90,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.448801+0000","last_change":"2024-03-04T12:29:01.703199+0000","last_active":"2024-03-04T13:10:42.448801+0000","last_peered":"2024-03-04T13:10:42.448801+0000","last_clean":"2024-03-04T13:10:42.448801+0000","last_became_active":"2024-03-04T12:29:01.702925+0000","last_became_peered":"2024-03-04T12:29:01.702925+0000","last_unstale":"2024-03-04T13:10:42.448801+0000","last_undegraded":"2024-03-04T13:10:42.448801+0000","last_fullsized":"2024-03-04T13:10:42.448801+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:00:11.470237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":40,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.343248+0000","last_change":"2024-03-04T12:46:22.258654+0000","last_active":"2024-03-04T13:08:52.343248+0000","last_peered":"2024-03-04T13:08:52.343248+0000","last_clean":"2024-03-04T13:08:52.343248+0000","last_became_active":"2024-03-04T12:46:22.258268+0000","last_became_peered":"2024-03-04T12:46:22.258268+0000","last_unstale":"2024-03-04T13:08:52.343248+0000","last_undegraded":"2024-03-04T13:08:52.343248+0000","last_fullsized":"2024-03-04T13:08:52.343248+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:28:49.843503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"255'11","reported_seq":67,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.130583+0000","last_change":"2024-03-04T12:32:46.052063+0000","last_active":"2024-03-04T13:13:21.130583+0000","last_peered":"2024-03-04T13:13:21.130583+0000","last_clean":"2024-03-04T13:13:21.130583+0000","last_became_active":"2024-03-04T12:32:46.051799+0000","last_became_peered":"2024-03-04T12:32:46.051799+0000","last_unstale":"2024-03-04T13:13:21.130583+0000","last_undegraded":"2024-03-04T13:13:21.130583+0000","last_fullsized":"2024-03-04T13:13:21.130583+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:10:51.455925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":43010,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"255'9","reported_seq":64,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.006034+0000","last_change":"2024-03-04T12:32:42.038130+0000","last_active":"2024-03-04T13:13:21.006034+0000","last_peered":"2024-03-04T13:13:21.006034+0000","last_clean":"2024-03-04T13:13:21.006034+0000","last_became_active":"2024-03-04T12:32:42.037701+0000","last_became_peered":"2024-03-04T12:32:42.037701+0000","last_unstale":"2024-03-04T13:13:21.006034+0000","last_undegraded":"2024-03-04T13:13:21.006034+0000","last_fullsized":"2024-03-04T13:13:21.006034+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:21:40.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"255'28","reported_seq":119,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.451341+0000","last_change":"2024-03-04T12:29:01.701298+0000","last_active":"2024-03-04T13:11:07.451341+0000","last_peered":"2024-03-04T13:11:07.451341+0000","last_clean":"2024-03-04T13:11:07.451341+0000","last_became_active":"2024-03-04T12:29:01.701003+0000","last_became_peered":"2024-03-04T12:29:01.701003+0000","last_unstale":"2024-03-04T13:11:07.451341+0000","last_undegraded":"2024-03-04T13:11:07.451341+0000","last_fullsized":"2024-03-04T13:11:07.451341+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:24.902315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":75,"num_write":51,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.454100+0000","last_change":"2024-03-04T12:46:22.308264+0000","last_active":"2024-03-04T13:10:27.454100+0000","last_peered":"2024-03-04T13:10:27.454100+0000","last_clean":"2024-03-04T13:10:27.454100+0000","last_became_active":"2024-03-04T12:46:22.307955+0000","last_became_peered":"2024-03-04T12:46:22.307955+0000","last_unstale":"2024-03-04T13:10:27.454100+0000","last_undegraded":"2024-03-04T13:10:27.454100+0000","last_fullsized":"2024-03-04T13:10:27.454100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:02:47.868860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":41,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498796+0000","last_change":"2024-03-04T12:32:46.053816+0000","last_active":"2024-03-04T13:10:17.498796+0000","last_peered":"2024-03-04T13:10:17.498796+0000","last_clean":"2024-03-04T13:10:17.498796+0000","last_became_active":"2024-03-04T12:32:46.053497+0000","last_became_peered":"2024-03-04T12:32:46.053497+0000","last_unstale":"2024-03-04T13:10:17.498796+0000","last_undegraded":"2024-03-04T13:10:17.498796+0000","last_fullsized":"2024-03-04T13:10:17.498796+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:27:00.581234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"255'3","reported_seq":51,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:42.468735+0000","last_change":"2024-03-04T12:32:42.037134+0000","last_active":"2024-03-04T13:12:42.468735+0000","last_peered":"2024-03-04T13:12:42.468735+0000","last_clean":"2024-03-04T13:12:42.468735+0000","last_became_active":"2024-03-04T12:32:42.036801+0000","last_became_peered":"2024-03-04T12:32:42.036801+0000","last_unstale":"2024-03-04T13:12:42.468735+0000","last_undegraded":"2024-03-04T13:12:42.468735+0000","last_fullsized":"2024-03-04T13:12:42.468735+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:11.992223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"255'24","reported_seq":108,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.486375+0000","last_change":"2024-03-04T12:29:01.707999+0000","last_active":"2024-03-04T13:09:02.486375+0000","last_peered":"2024-03-04T13:09:02.486375+0000","last_clean":"2024-03-04T13:09:02.486375+0000","last_became_active":"2024-03-04T12:29:01.707589+0000","last_became_peered":"2024-03-04T12:29:01.707589+0000","last_unstale":"2024-03-04T13:09:02.486375+0000","last_undegraded":"2024-03-04T13:09:02.486375+0000","last_fullsized":"2024-03-04T13:09:02.486375+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:51.454986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":71,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:17.438941+0000","last_change":"2024-03-04T12:46:22.310150+0000","last_active":"2024-03-04T13:09:17.438941+0000","last_peered":"2024-03-04T13:09:17.438941+0000","last_clean":"2024-03-04T13:09:17.438941+0000","last_became_active":"2024-03-04T12:46:22.309869+0000","last_became_peered":"2024-03-04T12:46:22.309869+0000","last_unstale":"2024-03-04T13:09:17.438941+0000","last_undegraded":"2024-03-04T13:09:17.438941+0000","last_fullsized":"2024-03-04T13:09:17.438941+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:17:23.605967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"255'3","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:52.456967+0000","last_change":"2024-03-04T12:32:46.057930+0000","last_active":"2024-03-04T13:12:52.456967+0000","last_peered":"2024-03-04T13:12:52.456967+0000","last_clean":"2024-03-04T13:12:52.456967+0000","last_became_active":"2024-03-04T12:32:46.057603+0000","last_became_peered":"2024-03-04T12:32:46.057603+0000","last_unstale":"2024-03-04T13:12:52.456967+0000","last_undegraded":"2024-03-04T13:12:52.456967+0000","last_fullsized":"2024-03-04T13:12:52.456967+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:31:09.275711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"250'3","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.445413+0000","last_change":"2024-03-04T12:32:42.032501+0000","last_active":"2024-03-04T13:10:12.445413+0000","last_peered":"2024-03-04T13:10:12.445413+0000","last_clean":"2024-03-04T13:10:12.445413+0000","last_became_active":"2024-03-04T12:32:42.032231+0000","last_became_peered":"2024-03-04T12:32:42.032231+0000","last_unstale":"2024-03-04T13:10:12.445413+0000","last_undegraded":"2024-03-04T13:10:12.445413+0000","last_fullsized":"2024-03-04T13:10:12.445413+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:57:04.660301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"255'27","reported_seq":111,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.534374+0000","last_change":"2024-03-04T12:29:01.704816+0000","last_active":"2024-03-04T13:09:02.534374+0000","last_peered":"2024-03-04T13:09:02.534374+0000","last_clean":"2024-03-04T13:09:02.534374+0000","last_became_active":"2024-03-04T12:29:01.704548+0000","last_became_peered":"2024-03-04T12:29:01.704548+0000","last_unstale":"2024-03-04T13:09:02.534374+0000","last_undegraded":"2024-03-04T13:09:02.534374+0000","last_fullsized":"2024-03-04T13:09:02.534374+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:15:47.833044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":73,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.481590+0000","last_change":"2024-03-04T12:46:22.258204+0000","last_active":"2024-03-04T13:10:32.481590+0000","last_peered":"2024-03-04T13:10:32.481590+0000","last_clean":"2024-03-04T13:10:32.481590+0000","last_became_active":"2024-03-04T12:46:22.257894+0000","last_became_peered":"2024-03-04T12:46:22.257894+0000","last_unstale":"2024-03-04T13:10:32.481590+0000","last_undegraded":"2024-03-04T13:10:32.481590+0000","last_fullsized":"2024-03-04T13:10:32.481590+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:54:40.739780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:07.487245+0000","last_change":"2024-03-04T12:32:46.054248+0000","last_active":"2024-03-04T13:09:07.487245+0000","last_peered":"2024-03-04T13:09:07.487245+0000","last_clean":"2024-03-04T13:09:07.487245+0000","last_became_active":"2024-03-04T12:32:46.053946+0000","last_became_peered":"2024-03-04T12:32:46.053946+0000","last_unstale":"2024-03-04T13:09:07.487245+0000","last_undegraded":"2024-03-04T13:09:07.487245+0000","last_fullsized":"2024-03-04T13:09:07.487245+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:49.837502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"255'11","reported_seq":68,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:42.499521+0000","last_change":"2024-03-04T12:32:42.037699+0000","last_active":"2024-03-04T13:12:42.499521+0000","last_peered":"2024-03-04T13:12:42.499521+0000","last_clean":"2024-03-04T13:12:42.499521+0000","last_became_active":"2024-03-04T12:32:42.037387+0000","last_became_peered":"2024-03-04T12:32:42.037387+0000","last_unstale":"2024-03-04T13:12:42.499521+0000","last_undegraded":"2024-03-04T13:12:42.499521+0000","last_fullsized":"2024-03-04T13:12:42.499521+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:05.876966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":15,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"255'50","reported_seq":162,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.534333+0000","last_change":"2024-03-04T12:29:01.704333+0000","last_active":"2024-03-04T13:09:02.534333+0000","last_peered":"2024-03-04T13:09:02.534333+0000","last_clean":"2024-03-04T13:09:02.534333+0000","last_became_active":"2024-03-04T12:29:01.703815+0000","last_became_peered":"2024-03-04T12:29:01.703815+0000","last_unstale":"2024-03-04T13:09:02.534333+0000","last_undegraded":"2024-03-04T13:09:02.534333+0000","last_fullsized":"2024-03-04T13:09:02.534333+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:15:13.058945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":130,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:37.357774+0000","last_change":"2024-03-04T12:46:22.260813+0000","last_active":"2024-03-04T13:10:37.357774+0000","last_peered":"2024-03-04T13:10:37.357774+0000","last_clean":"2024-03-04T13:10:37.357774+0000","last_became_active":"2024-03-04T12:46:22.260529+0000","last_became_peered":"2024-03-04T12:46:22.260529+0000","last_unstale":"2024-03-04T13:10:37.357774+0000","last_undegraded":"2024-03-04T13:10:37.357774+0000","last_fullsized":"2024-03-04T13:10:37.357774+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:25:58.359881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"255'5","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.453596+0000","last_change":"2024-03-04T12:32:46.052656+0000","last_active":"2024-03-04T13:11:27.453596+0000","last_peered":"2024-03-04T13:11:27.453596+0000","last_clean":"2024-03-04T13:11:27.453596+0000","last_became_active":"2024-03-04T12:32:46.052388+0000","last_became_peered":"2024-03-04T12:32:46.052388+0000","last_unstale":"2024-03-04T13:11:27.453596+0000","last_undegraded":"2024-03-04T13:11:27.453596+0000","last_fullsized":"2024-03-04T13:11:27.453596+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:32.283432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5160,"num_write":5,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"0'0","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.452400+0000","last_change":"2024-03-04T12:32:42.031111+0000","last_active":"2024-03-04T13:10:12.452400+0000","last_peered":"2024-03-04T13:10:12.452400+0000","last_clean":"2024-03-04T13:10:12.452400+0000","last_became_active":"2024-03-04T12:32:42.030804+0000","last_became_peered":"2024-03-04T12:32:42.030804+0000","last_unstale":"2024-03-04T13:10:12.452400+0000","last_undegraded":"2024-03-04T13:10:12.452400+0000","last_fullsized":"2024-03-04T13:10:12.452400+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:18:47.403222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"255'35","reported_seq":128,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.486308+0000","last_change":"2024-03-04T12:29:01.703915+0000","last_active":"2024-03-04T13:09:02.486308+0000","last_peered":"2024-03-04T13:09:02.486308+0000","last_clean":"2024-03-04T13:09:02.486308+0000","last_became_active":"2024-03-04T12:29:01.703369+0000","last_became_peered":"2024-03-04T12:29:01.703369+0000","last_unstale":"2024-03-04T13:09:02.486308+0000","last_undegraded":"2024-03-04T13:09:02.486308+0000","last_fullsized":"2024-03-04T13:09:02.486308+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:00:37.472429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":90,"num_write":62,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.443264+0000","last_change":"2024-03-04T12:46:22.256005+0000","last_active":"2024-03-04T13:08:52.443264+0000","last_peered":"2024-03-04T13:08:52.443264+0000","last_clean":"2024-03-04T13:08:52.443264+0000","last_became_active":"2024-03-04T12:46:22.255588+0000","last_became_peered":"2024-03-04T12:46:22.255588+0000","last_unstale":"2024-03-04T13:08:52.443264+0000","last_undegraded":"2024-03-04T13:08:52.443264+0000","last_fullsized":"2024-03-04T13:08:52.443264+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:06:23.252303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"255'6","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.462864+0000","last_change":"2024-03-04T12:32:46.057798+0000","last_active":"2024-03-04T13:12:47.462864+0000","last_peered":"2024-03-04T13:12:47.462864+0000","last_clean":"2024-03-04T13:12:47.462864+0000","last_became_active":"2024-03-04T12:32:46.057413+0000","last_became_peered":"2024-03-04T12:32:46.057413+0000","last_unstale":"2024-03-04T13:12:47.462864+0000","last_undegraded":"2024-03-04T13:12:47.462864+0000","last_fullsized":"2024-03-04T13:12:47.462864+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:42.088318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"255'6","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:57.533622+0000","last_change":"2024-03-04T12:32:42.031365+0000","last_active":"2024-03-04T13:08:57.533622+0000","last_peered":"2024-03-04T13:08:57.533622+0000","last_clean":"2024-03-04T13:08:57.533622+0000","last_became_active":"2024-03-04T12:32:42.031099+0000","last_became_peered":"2024-03-04T12:32:42.031099+0000","last_unstale":"2024-03-04T13:08:57.533622+0000","last_undegraded":"2024-03-04T13:08:57.533622+0000","last_fullsized":"2024-03-04T13:08:57.533622+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:05.270417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"255'41","reported_seq":139,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.452360+0000","last_change":"2024-03-04T12:29:01.701202+0000","last_active":"2024-03-04T13:10:12.452360+0000","last_peered":"2024-03-04T13:10:12.452360+0000","last_clean":"2024-03-04T13:10:12.452360+0000","last_became_active":"2024-03-04T12:29:01.700917+0000","last_became_peered":"2024-03-04T12:29:01.700917+0000","last_unstale":"2024-03-04T13:10:12.452360+0000","last_undegraded":"2024-03-04T13:10:12.452360+0000","last_fullsized":"2024-03-04T13:10:12.452360+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:02.058404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":100,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.468177+0000","last_change":"2024-03-04T12:46:22.256121+0000","last_active":"2024-03-04T13:08:52.468177+0000","last_peered":"2024-03-04T13:08:52.468177+0000","last_clean":"2024-03-04T13:08:52.468177+0000","last_became_active":"2024-03-04T12:46:22.255812+0000","last_became_peered":"2024-03-04T12:46:22.255812+0000","last_unstale":"2024-03-04T13:08:52.468177+0000","last_undegraded":"2024-03-04T13:08:52.468177+0000","last_fullsized":"2024-03-04T13:08:52.468177+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:10:20.330661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498622+0000","last_change":"2024-03-04T12:32:46.053933+0000","last_active":"2024-03-04T13:10:17.498622+0000","last_peered":"2024-03-04T13:10:17.498622+0000","last_clean":"2024-03-04T13:10:17.498622+0000","last_became_active":"2024-03-04T12:32:46.053172+0000","last_became_peered":"2024-03-04T12:32:46.053172+0000","last_unstale":"2024-03-04T13:10:17.498622+0000","last_undegraded":"2024-03-04T13:10:17.498622+0000","last_fullsized":"2024-03-04T13:10:17.498622+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:58:29.044468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"255'5","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.453640+0000","last_change":"2024-03-04T12:32:42.037511+0000","last_active":"2024-03-04T13:11:27.453640+0000","last_peered":"2024-03-04T13:11:27.453640+0000","last_clean":"2024-03-04T13:11:27.453640+0000","last_became_active":"2024-03-04T12:32:42.033315+0000","last_became_peered":"2024-03-04T12:32:42.033315+0000","last_unstale":"2024-03-04T13:11:27.453640+0000","last_undegraded":"2024-03-04T13:11:27.453640+0000","last_fullsized":"2024-03-04T13:11:27.453640+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:57:22.224861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5136,"num_write":5,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"255'18","reported_seq":96,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.353304+0000","last_change":"2024-03-04T12:29:01.707001+0000","last_active":"2024-03-04T13:10:07.353304+0000","last_peered":"2024-03-04T13:10:07.353304+0000","last_clean":"2024-03-04T13:10:07.353304+0000","last_became_active":"2024-03-04T12:29:01.706695+0000","last_became_peered":"2024-03-04T12:29:01.706695+0000","last_unstale":"2024-03-04T13:10:07.353304+0000","last_undegraded":"2024-03-04T13:10:07.353304+0000","last_fullsized":"2024-03-04T13:10:07.353304+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:25:41.776852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":54,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"252'1","reported_seq":25,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.445978+0000","last_change":"2024-03-04T12:46:51.979336+0000","last_active":"2024-03-04T13:10:17.445978+0000","last_peered":"2024-03-04T13:10:17.445978+0000","last_clean":"2024-03-04T13:10:17.445978+0000","last_became_active":"2024-03-04T12:46:51.977076+0000","last_became_peered":"2024-03-04T12:46:51.977076+0000","last_unstale":"2024-03-04T13:10:17.445978+0000","last_undegraded":"2024-03-04T13:10:17.445978+0000","last_fullsized":"2024-03-04T13:10:17.445978+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:24.892234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.486407+0000","last_change":"2024-03-04T12:32:46.056068+0000","last_active":"2024-03-04T13:09:02.486407+0000","last_peered":"2024-03-04T13:09:02.486407+0000","last_clean":"2024-03-04T13:09:02.486407+0000","last_became_active":"2024-03-04T12:32:46.055692+0000","last_became_peered":"2024-03-04T12:32:46.055692+0000","last_unstale":"2024-03-04T13:09:02.486407+0000","last_undegraded":"2024-03-04T13:09:02.486407+0000","last_fullsized":"2024-03-04T13:09:02.486407+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:41:41.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"0'0","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:57.443861+0000","last_change":"2024-03-04T12:32:42.030205+0000","last_active":"2024-03-04T13:08:57.443861+0000","last_peered":"2024-03-04T13:08:57.443861+0000","last_clean":"2024-03-04T13:08:57.443861+0000","last_became_active":"2024-03-04T12:32:42.029940+0000","last_became_peered":"2024-03-04T12:32:42.029940+0000","last_unstale":"2024-03-04T13:08:57.443861+0000","last_undegraded":"2024-03-04T13:08:57.443861+0000","last_fullsized":"2024-03-04T13:08:57.443861+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:36.549896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"255'31","reported_seq":118,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.478216+0000","last_change":"2024-03-04T12:29:01.701660+0000","last_active":"2024-03-04T13:10:07.478216+0000","last_peered":"2024-03-04T13:10:07.478216+0000","last_clean":"2024-03-04T13:10:07.478216+0000","last_became_active":"2024-03-04T12:29:01.701379+0000","last_became_peered":"2024-03-04T12:29:01.701379+0000","last_unstale":"2024-03-04T13:10:07.478216+0000","last_undegraded":"2024-03-04T13:10:07.478216+0000","last_fullsized":"2024-03-04T13:10:07.478216+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:12:36.501891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":79,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.454754+0000","last_change":"2024-03-04T12:46:22.309007+0000","last_active":"2024-03-04T13:10:32.454754+0000","last_peered":"2024-03-04T13:10:32.454754+0000","last_clean":"2024-03-04T13:10:32.454754+0000","last_became_active":"2024-03-04T12:46:22.308714+0000","last_became_peered":"2024-03-04T12:46:22.308714+0000","last_unstale":"2024-03-04T13:10:32.454754+0000","last_undegraded":"2024-03-04T13:10:32.454754+0000","last_fullsized":"2024-03-04T13:10:32.454754+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:10.983835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"255'6","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:37.375099+0000","last_change":"2024-03-04T12:32:46.052223+0000","last_active":"2024-03-04T13:12:37.375099+0000","last_peered":"2024-03-04T13:12:37.375099+0000","last_clean":"2024-03-04T13:12:37.375099+0000","last_became_active":"2024-03-04T12:32:46.051926+0000","last_became_peered":"2024-03-04T12:32:46.051926+0000","last_unstale":"2024-03-04T13:12:37.375099+0000","last_undegraded":"2024-03-04T13:12:37.375099+0000","last_fullsized":"2024-03-04T13:12:37.375099+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:13:09.671991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"0'0","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:57.436868+0000","last_change":"2024-03-04T12:32:42.034599+0000","last_active":"2024-03-04T13:08:57.436868+0000","last_peered":"2024-03-04T13:08:57.436868+0000","last_clean":"2024-03-04T13:08:57.436868+0000","last_became_active":"2024-03-04T12:32:42.034301+0000","last_became_peered":"2024-03-04T12:32:42.034301+0000","last_unstale":"2024-03-04T13:08:57.436868+0000","last_undegraded":"2024-03-04T13:08:57.436868+0000","last_fullsized":"2024-03-04T13:08:57.436868+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:14:58.871710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"255'132","reported_seq":425,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.541907+0000","last_change":"2024-03-04T12:29:01.703498+0000","last_active":"2024-03-04T13:10:07.541907+0000","last_peered":"2024-03-04T13:10:07.541907+0000","last_clean":"2024-03-04T13:10:07.541907+0000","last_became_active":"2024-03-04T12:29:01.703239+0000","last_became_peered":"2024-03-04T12:29:01.703239+0000","last_unstale":"2024-03-04T13:10:07.541907+0000","last_undegraded":"2024-03-04T13:10:07.541907+0000","last_fullsized":"2024-03-04T13:10:07.541907+0000","mapping_epoch":242,"log_start":"255'100","ondisk_log_start":"255'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:42:59.963681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":704,"num_read_kb":496,"num_write":192,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.501311+0000","last_change":"2024-03-04T12:46:22.259911+0000","last_active":"2024-03-04T13:10:32.501311+0000","last_peered":"2024-03-04T13:10:32.501311+0000","last_clean":"2024-03-04T13:10:32.501311+0000","last_became_active":"2024-03-04T12:46:22.259424+0000","last_became_peered":"2024-03-04T12:46:22.259424+0000","last_unstale":"2024-03-04T13:10:32.501311+0000","last_undegraded":"2024-03-04T13:10:32.501311+0000","last_fullsized":"2024-03-04T13:10:32.501311+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:44:30.252593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"250'5","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.437423+0000","last_change":"2024-03-04T12:32:46.057250+0000","last_active":"2024-03-04T13:09:02.437423+0000","last_peered":"2024-03-04T13:09:02.437423+0000","last_clean":"2024-03-04T13:09:02.437423+0000","last_became_active":"2024-03-04T12:32:46.056976+0000","last_became_peered":"2024-03-04T12:32:46.056976+0000","last_unstale":"2024-03-04T13:09:02.437423+0000","last_undegraded":"2024-03-04T13:09:02.437423+0000","last_fullsized":"2024-03-04T13:09:02.437423+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:22.480400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497894+0000","last_change":"2024-03-04T12:32:42.037353+0000","last_active":"2024-03-04T13:10:12.497894+0000","last_peered":"2024-03-04T13:10:12.497894+0000","last_clean":"2024-03-04T13:10:12.497894+0000","last_became_active":"2024-03-04T12:32:42.036694+0000","last_became_peered":"2024-03-04T12:32:42.036694+0000","last_unstale":"2024-03-04T13:10:12.497894+0000","last_undegraded":"2024-03-04T13:10:12.497894+0000","last_fullsized":"2024-03-04T13:10:12.497894+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:57:01.079244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"255'13","reported_seq":77,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.439473+0000","last_change":"2024-03-04T12:29:01.706751+0000","last_active":"2024-03-04T13:10:07.439473+0000","last_peered":"2024-03-04T13:10:07.439473+0000","last_clean":"2024-03-04T13:10:07.439473+0000","last_became_active":"2024-03-04T12:29:01.706467+0000","last_became_peered":"2024-03-04T12:29:01.706467+0000","last_unstale":"2024-03-04T13:10:07.439473+0000","last_undegraded":"2024-03-04T13:10:07.439473+0000","last_fullsized":"2024-03-04T13:10:07.439473+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:29:39.335950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.454804+0000","last_change":"2024-03-04T12:46:22.311206+0000","last_active":"2024-03-04T13:10:32.454804+0000","last_peered":"2024-03-04T13:10:32.454804+0000","last_clean":"2024-03-04T13:10:32.454804+0000","last_became_active":"2024-03-04T12:46:22.310952+0000","last_became_peered":"2024-03-04T12:46:22.310952+0000","last_unstale":"2024-03-04T13:10:32.454804+0000","last_undegraded":"2024-03-04T13:10:32.454804+0000","last_fullsized":"2024-03-04T13:10:32.454804+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:16:54.485327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"250'3","reported_seq":43,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.432359+0000","last_change":"2024-03-04T12:32:46.055077+0000","last_active":"2024-03-04T13:09:02.432359+0000","last_peered":"2024-03-04T13:09:02.432359+0000","last_clean":"2024-03-04T13:09:02.432359+0000","last_became_active":"2024-03-04T12:32:46.054752+0000","last_became_peered":"2024-03-04T12:32:46.054752+0000","last_unstale":"2024-03-04T13:09:02.432359+0000","last_undegraded":"2024-03-04T13:09:02.432359+0000","last_fullsized":"2024-03-04T13:09:02.432359+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:35:26.379046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"255'2","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:22.447389+0000","last_change":"2024-03-04T12:32:42.034215+0000","last_active":"2024-03-04T13:11:22.447389+0000","last_peered":"2024-03-04T13:11:22.447389+0000","last_clean":"2024-03-04T13:11:22.447389+0000","last_became_active":"2024-03-04T12:32:42.033898+0000","last_became_peered":"2024-03-04T12:32:42.033898+0000","last_unstale":"2024-03-04T13:11:22.447389+0000","last_undegraded":"2024-03-04T13:11:22.447389+0000","last_fullsized":"2024-03-04T13:11:22.447389+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:12:35.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"255'43","reported_seq":147,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:47.532685+0000","last_change":"2024-03-04T12:29:01.705464+0000","last_active":"2024-03-04T13:08:47.532685+0000","last_peered":"2024-03-04T13:08:47.532685+0000","last_clean":"2024-03-04T13:08:47.532685+0000","last_became_active":"2024-03-04T12:29:01.705183+0000","last_became_peered":"2024-03-04T12:29:01.705183+0000","last_unstale":"2024-03-04T13:08:47.532685+0000","last_undegraded":"2024-03-04T13:08:47.532685+0000","last_fullsized":"2024-03-04T13:08:47.532685+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:25.877488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":113,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.538980+0000","last_change":"2024-03-04T12:46:22.246381+0000","last_active":"2024-03-04T13:09:42.538980+0000","last_peered":"2024-03-04T13:09:42.538980+0000","last_clean":"2024-03-04T13:09:42.538980+0000","last_became_active":"2024-03-04T12:46:22.245967+0000","last_became_peered":"2024-03-04T12:46:22.245967+0000","last_unstale":"2024-03-04T13:09:42.538980+0000","last_undegraded":"2024-03-04T13:09:42.538980+0000","last_fullsized":"2024-03-04T13:09:42.538980+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:34:41.879387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.451813+0000","last_change":"2024-03-04T12:32:46.051614+0000","last_active":"2024-03-04T13:10:07.451813+0000","last_peered":"2024-03-04T13:10:07.451813+0000","last_clean":"2024-03-04T13:10:07.451813+0000","last_became_active":"2024-03-04T12:32:46.051360+0000","last_became_peered":"2024-03-04T12:32:46.051360+0000","last_unstale":"2024-03-04T13:10:07.451813+0000","last_undegraded":"2024-03-04T13:10:07.451813+0000","last_fullsized":"2024-03-04T13:10:07.451813+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:55.771101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"0'0","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:02.444339+0000","last_change":"2024-03-04T12:32:42.029927+0000","last_active":"2024-03-04T13:10:02.444339+0000","last_peered":"2024-03-04T13:10:02.444339+0000","last_clean":"2024-03-04T13:10:02.444339+0000","last_became_active":"2024-03-04T12:32:42.029559+0000","last_became_peered":"2024-03-04T12:32:42.029559+0000","last_unstale":"2024-03-04T13:10:02.444339+0000","last_undegraded":"2024-03-04T13:10:02.444339+0000","last_fullsized":"2024-03-04T13:10:02.444339+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:35.578821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"250'28","reported_seq":116,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.445115+0000","last_change":"2024-03-04T12:29:01.707645+0000","last_active":"2024-03-04T13:11:02.445115+0000","last_peered":"2024-03-04T13:11:02.445115+0000","last_clean":"2024-03-04T13:11:02.445115+0000","last_became_active":"2024-03-04T12:29:01.705726+0000","last_became_peered":"2024-03-04T12:29:01.705726+0000","last_unstale":"2024-03-04T13:11:02.445115+0000","last_undegraded":"2024-03-04T13:11:02.445115+0000","last_fullsized":"2024-03-04T13:11:02.445115+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:13:42.259053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":49,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.539021+0000","last_change":"2024-03-04T12:46:22.259972+0000","last_active":"2024-03-04T13:09:42.539021+0000","last_peered":"2024-03-04T13:09:42.539021+0000","last_clean":"2024-03-04T13:09:42.539021+0000","last_became_active":"2024-03-04T12:46:22.259134+0000","last_became_peered":"2024-03-04T12:46:22.259134+0000","last_unstale":"2024-03-04T13:09:42.539021+0000","last_undegraded":"2024-03-04T13:09:42.539021+0000","last_fullsized":"2024-03-04T13:09:42.539021+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:01:20.186301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.496892+0000","last_change":"2024-03-04T12:32:46.053557+0000","last_active":"2024-03-04T13:10:07.496892+0000","last_peered":"2024-03-04T13:10:07.496892+0000","last_clean":"2024-03-04T13:10:07.496892+0000","last_became_active":"2024-03-04T12:32:46.053156+0000","last_became_peered":"2024-03-04T12:32:46.053156+0000","last_unstale":"2024-03-04T13:10:07.496892+0000","last_undegraded":"2024-03-04T13:10:07.496892+0000","last_fullsized":"2024-03-04T13:10:07.496892+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:39.367675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"255'10","reported_seq":69,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520454+0000","last_change":"2024-03-04T12:32:42.036924+0000","last_active":"2024-03-04T13:12:22.520454+0000","last_peered":"2024-03-04T13:12:22.520454+0000","last_clean":"2024-03-04T13:12:22.520454+0000","last_became_active":"2024-03-04T12:32:42.036617+0000","last_became_peered":"2024-03-04T12:32:42.036617+0000","last_unstale":"2024-03-04T13:12:22.520454+0000","last_undegraded":"2024-03-04T13:12:22.520454+0000","last_fullsized":"2024-03-04T13:12:22.520454+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:10:49.987113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":29698,"num_write":14,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"255'17","reported_seq":94,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.361248+0000","last_change":"2024-03-04T12:29:01.701993+0000","last_active":"2024-03-04T13:11:02.361248+0000","last_peered":"2024-03-04T13:11:02.361248+0000","last_clean":"2024-03-04T13:11:02.361248+0000","last_became_active":"2024-03-04T12:29:01.701712+0000","last_became_peered":"2024-03-04T12:29:01.701712+0000","last_unstale":"2024-03-04T13:11:02.361248+0000","last_undegraded":"2024-03-04T13:11:02.361248+0000","last_fullsized":"2024-03-04T13:11:02.361248+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:53.885309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":51,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.474805+0000","last_change":"2024-03-04T12:46:22.257008+0000","last_active":"2024-03-04T13:09:42.474805+0000","last_peered":"2024-03-04T13:09:42.474805+0000","last_clean":"2024-03-04T13:09:42.474805+0000","last_became_active":"2024-03-04T12:46:22.256617+0000","last_became_peered":"2024-03-04T12:46:22.256617+0000","last_unstale":"2024-03-04T13:09:42.474805+0000","last_undegraded":"2024-03-04T13:09:42.474805+0000","last_fullsized":"2024-03-04T13:09:42.474805+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:25.255969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.353352+0000","last_change":"2024-03-04T12:32:46.053973+0000","last_active":"2024-03-04T13:10:07.353352+0000","last_peered":"2024-03-04T13:10:07.353352+0000","last_clean":"2024-03-04T13:10:07.353352+0000","last_became_active":"2024-03-04T12:32:46.053272+0000","last_became_peered":"2024-03-04T12:32:46.053272+0000","last_unstale":"2024-03-04T13:10:07.353352+0000","last_undegraded":"2024-03-04T13:10:07.353352+0000","last_fullsized":"2024-03-04T13:10:07.353352+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:51:06.764174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"0'0","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:02.451255+0000","last_change":"2024-03-04T12:32:42.036193+0000","last_active":"2024-03-04T13:10:02.451255+0000","last_peered":"2024-03-04T13:10:02.451255+0000","last_clean":"2024-03-04T13:10:02.451255+0000","last_became_active":"2024-03-04T12:32:42.035923+0000","last_became_peered":"2024-03-04T12:32:42.035923+0000","last_unstale":"2024-03-04T13:10:02.451255+0000","last_undegraded":"2024-03-04T13:10:02.451255+0000","last_fullsized":"2024-03-04T13:10:02.451255+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:56:49.994031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"255'34","reported_seq":131,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.506332+0000","last_change":"2024-03-04T12:29:01.703208+0000","last_active":"2024-03-04T13:11:02.506332+0000","last_peered":"2024-03-04T13:11:02.506332+0000","last_clean":"2024-03-04T13:11:02.506332+0000","last_became_active":"2024-03-04T12:29:01.702327+0000","last_became_peered":"2024-03-04T12:29:01.702327+0000","last_unstale":"2024-03-04T13:11:02.506332+0000","last_undegraded":"2024-03-04T13:11:02.506332+0000","last_fullsized":"2024-03-04T13:11:02.506332+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:05.157615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"252'1","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.448820+0000","last_change":"2024-03-04T12:46:22.258104+0000","last_active":"2024-03-04T13:09:42.448820+0000","last_peered":"2024-03-04T13:09:42.448820+0000","last_clean":"2024-03-04T13:09:42.448820+0000","last_became_active":"2024-03-04T12:46:22.257651+0000","last_became_peered":"2024-03-04T12:46:22.257651+0000","last_unstale":"2024-03-04T13:09:42.448820+0000","last_undegraded":"2024-03-04T13:09:42.448820+0000","last_fullsized":"2024-03-04T13:09:42.448820+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:10:20.836802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"250'7","reported_seq":58,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.478111+0000","last_change":"2024-03-04T12:32:46.049805+0000","last_active":"2024-03-04T13:10:07.478111+0000","last_peered":"2024-03-04T13:10:07.478111+0000","last_clean":"2024-03-04T13:10:07.478111+0000","last_became_active":"2024-03-04T12:32:46.049512+0000","last_became_peered":"2024-03-04T12:32:46.049512+0000","last_unstale":"2024-03-04T13:10:07.478111+0000","last_undegraded":"2024-03-04T13:10:07.478111+0000","last_fullsized":"2024-03-04T13:10:07.478111+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:41:47.962697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":11,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"0'0","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:02.496141+0000","last_change":"2024-03-04T12:32:42.032301+0000","last_active":"2024-03-04T13:10:02.496141+0000","last_peered":"2024-03-04T13:10:02.496141+0000","last_clean":"2024-03-04T13:10:02.496141+0000","last_became_active":"2024-03-04T12:32:42.032034+0000","last_became_peered":"2024-03-04T12:32:42.032034+0000","last_unstale":"2024-03-04T13:10:02.496141+0000","last_undegraded":"2024-03-04T13:10:02.496141+0000","last_fullsized":"2024-03-04T13:10:02.496141+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:46:46.488545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"255'51","reported_seq":170,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.457681+0000","last_change":"2024-03-04T12:29:01.703695+0000","last_active":"2024-03-04T13:11:02.457681+0000","last_peered":"2024-03-04T13:11:02.457681+0000","last_clean":"2024-03-04T13:11:02.457681+0000","last_became_active":"2024-03-04T12:29:01.703361+0000","last_became_peered":"2024-03-04T12:29:01.703361+0000","last_unstale":"2024-03-04T13:11:02.457681+0000","last_undegraded":"2024-03-04T13:11:02.457681+0000","last_fullsized":"2024-03-04T13:11:02.457681+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:51:42.885870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":146,"num_write":83,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"253'1","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.458334+0000","last_change":"2024-03-04T12:46:22.255919+0000","last_active":"2024-03-04T13:11:07.458334+0000","last_peered":"2024-03-04T13:11:07.458334+0000","last_clean":"2024-03-04T13:11:07.458334+0000","last_became_active":"2024-03-04T12:46:22.255498+0000","last_became_peered":"2024-03-04T12:46:22.255498+0000","last_unstale":"2024-03-04T13:11:07.458334+0000","last_undegraded":"2024-03-04T13:11:07.458334+0000","last_fullsized":"2024-03-04T13:11:07.458334+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:36:32.059020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"255'2","reported_seq":43,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:17.459427+0000","last_change":"2024-03-04T12:32:46.059035+0000","last_active":"2024-03-04T13:13:17.459427+0000","last_peered":"2024-03-04T13:13:17.459427+0000","last_clean":"2024-03-04T13:13:17.459427+0000","last_became_active":"2024-03-04T12:32:46.058792+0000","last_became_peered":"2024-03-04T12:32:46.058792+0000","last_unstale":"2024-03-04T13:13:17.459427+0000","last_undegraded":"2024-03-04T13:13:17.459427+0000","last_fullsized":"2024-03-04T13:13:17.459427+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:04:32.439128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:57.360698+0000","last_change":"2024-03-04T12:32:42.036922+0000","last_active":"2024-03-04T13:10:57.360698+0000","last_peered":"2024-03-04T13:10:57.360698+0000","last_clean":"2024-03-04T13:10:57.360698+0000","last_became_active":"2024-03-04T12:32:42.036427+0000","last_became_peered":"2024-03-04T12:32:42.036427+0000","last_unstale":"2024-03-04T13:10:57.360698+0000","last_undegraded":"2024-03-04T13:10:57.360698+0000","last_fullsized":"2024-03-04T13:10:57.360698+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:03:27.512996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"255'56","reported_seq":177,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.349999+0000","last_change":"2024-03-04T12:29:01.706989+0000","last_active":"2024-03-04T13:09:42.349999+0000","last_peered":"2024-03-04T13:09:42.349999+0000","last_clean":"2024-03-04T13:09:42.349999+0000","last_became_active":"2024-03-04T12:29:01.706666+0000","last_became_peered":"2024-03-04T12:29:01.706666+0000","last_unstale":"2024-03-04T13:09:42.349999+0000","last_undegraded":"2024-03-04T13:09:42.349999+0000","last_fullsized":"2024-03-04T13:09:42.349999+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:53:35.119335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":151,"num_write":99,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.458356+0000","last_change":"2024-03-04T12:46:22.257205+0000","last_active":"2024-03-04T13:11:07.458356+0000","last_peered":"2024-03-04T13:11:07.458356+0000","last_clean":"2024-03-04T13:11:07.458356+0000","last_became_active":"2024-03-04T12:46:22.256882+0000","last_became_peered":"2024-03-04T12:46:22.256882+0000","last_unstale":"2024-03-04T13:11:07.458356+0000","last_undegraded":"2024-03-04T13:11:07.458356+0000","last_fullsized":"2024-03-04T13:11:07.458356+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:56.552546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":40,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.506364+0000","last_change":"2024-03-04T12:32:46.057344+0000","last_active":"2024-03-04T13:11:02.506364+0000","last_peered":"2024-03-04T13:11:02.506364+0000","last_clean":"2024-03-04T13:11:02.506364+0000","last_became_active":"2024-03-04T12:32:46.057079+0000","last_became_peered":"2024-03-04T12:32:46.057079+0000","last_unstale":"2024-03-04T13:11:02.506364+0000","last_undegraded":"2024-03-04T13:11:02.506364+0000","last_fullsized":"2024-03-04T13:11:02.506364+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:12:31.155909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"255'8","reported_seq":66,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:17.472607+0000","last_change":"2024-03-04T12:32:42.035815+0000","last_active":"2024-03-04T13:13:17.472607+0000","last_peered":"2024-03-04T13:13:17.472607+0000","last_clean":"2024-03-04T13:13:17.472607+0000","last_became_active":"2024-03-04T12:32:42.035488+0000","last_became_peered":"2024-03-04T12:32:42.035488+0000","last_unstale":"2024-03-04T13:13:17.472607+0000","last_undegraded":"2024-03-04T13:13:17.472607+0000","last_fullsized":"2024-03-04T13:13:17.472607+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:01.448566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"255'14","reported_seq":79,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.473534+0000","last_change":"2024-03-04T12:29:01.707068+0000","last_active":"2024-03-04T13:09:32.473534+0000","last_peered":"2024-03-04T13:09:32.473534+0000","last_clean":"2024-03-04T13:09:32.473534+0000","last_became_active":"2024-03-04T12:29:01.706786+0000","last_became_peered":"2024-03-04T12:29:01.706786+0000","last_unstale":"2024-03-04T13:09:32.473534+0000","last_undegraded":"2024-03-04T13:09:32.473534+0000","last_fullsized":"2024-03-04T13:09:32.473534+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:37.249442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.458370+0000","last_change":"2024-03-04T12:46:22.259694+0000","last_active":"2024-03-04T13:11:07.458370+0000","last_peered":"2024-03-04T13:11:07.458370+0000","last_clean":"2024-03-04T13:11:07.458370+0000","last_became_active":"2024-03-04T12:46:22.259400+0000","last_became_peered":"2024-03-04T12:46:22.259400+0000","last_unstale":"2024-03-04T13:11:07.458370+0000","last_undegraded":"2024-03-04T13:11:07.458370+0000","last_fullsized":"2024-03-04T13:11:07.458370+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:17:32.594215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.533195+0000","last_change":"2024-03-04T12:32:46.051598+0000","last_active":"2024-03-04T13:08:52.533195+0000","last_peered":"2024-03-04T13:08:52.533195+0000","last_clean":"2024-03-04T13:08:52.533195+0000","last_became_active":"2024-03-04T12:32:46.051318+0000","last_became_peered":"2024-03-04T12:32:46.051318+0000","last_unstale":"2024-03-04T13:08:52.533195+0000","last_undegraded":"2024-03-04T13:08:52.533195+0000","last_fullsized":"2024-03-04T13:08:52.533195+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:16.567127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"255'10","reported_seq":63,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.458916+0000","last_change":"2024-03-04T12:32:42.036135+0000","last_active":"2024-03-04T13:13:12.458916+0000","last_peered":"2024-03-04T13:13:12.458916+0000","last_clean":"2024-03-04T13:13:12.458916+0000","last_became_active":"2024-03-04T12:32:42.035743+0000","last_became_peered":"2024-03-04T12:32:42.035743+0000","last_unstale":"2024-03-04T13:13:12.458916+0000","last_undegraded":"2024-03-04T13:13:12.458916+0000","last_fullsized":"2024-03-04T13:13:12.458916+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:11:55.738398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9243,"num_write":20,"num_write_kb":10267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"255'55","reported_seq":187,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.491385+0000","last_change":"2024-03-04T12:29:01.702750+0000","last_active":"2024-03-04T13:09:32.491385+0000","last_peered":"2024-03-04T13:09:32.491385+0000","last_clean":"2024-03-04T13:09:32.491385+0000","last_became_active":"2024-03-04T12:29:01.700933+0000","last_became_peered":"2024-03-04T12:29:01.700933+0000","last_unstale":"2024-03-04T13:09:32.491385+0000","last_undegraded":"2024-03-04T13:09:32.491385+0000","last_fullsized":"2024-03-04T13:09:32.491385+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:59:22.963300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":175,"num_write":86,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:57.533702+0000","last_change":"2024-03-04T12:46:22.310324+0000","last_active":"2024-03-04T13:08:57.533702+0000","last_peered":"2024-03-04T13:08:57.533702+0000","last_clean":"2024-03-04T13:08:57.533702+0000","last_became_active":"2024-03-04T12:46:22.310043+0000","last_became_peered":"2024-03-04T12:46:22.310043+0000","last_unstale":"2024-03-04T13:08:57.533702+0000","last_undegraded":"2024-03-04T13:08:57.533702+0000","last_fullsized":"2024-03-04T13:08:57.533702+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:12:22.140057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"250'3","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.450776+0000","last_change":"2024-03-04T12:32:46.056965+0000","last_active":"2024-03-04T13:11:02.450776+0000","last_peered":"2024-03-04T13:11:02.450776+0000","last_clean":"2024-03-04T13:11:02.450776+0000","last_became_active":"2024-03-04T12:32:46.056687+0000","last_became_peered":"2024-03-04T12:32:46.056687+0000","last_unstale":"2024-03-04T13:11:02.450776+0000","last_undegraded":"2024-03-04T13:11:02.450776+0000","last_fullsized":"2024-03-04T13:11:02.450776+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:06.808040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:57.484624+0000","last_change":"2024-03-04T12:32:42.036985+0000","last_active":"2024-03-04T13:10:57.484624+0000","last_peered":"2024-03-04T13:10:57.484624+0000","last_clean":"2024-03-04T13:10:57.484624+0000","last_became_active":"2024-03-04T12:32:42.036690+0000","last_became_peered":"2024-03-04T12:32:42.036690+0000","last_unstale":"2024-03-04T13:10:57.484624+0000","last_undegraded":"2024-03-04T13:10:57.484624+0000","last_fullsized":"2024-03-04T13:10:57.484624+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:33:40.882885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"0'0","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.348453+0000","last_change":"2024-03-04T12:29:01.701088+0000","last_active":"2024-03-04T13:09:32.348453+0000","last_peered":"2024-03-04T13:09:32.348453+0000","last_clean":"2024-03-04T13:09:32.348453+0000","last_became_active":"2024-03-04T12:29:01.700739+0000","last_became_peered":"2024-03-04T12:29:01.700739+0000","last_unstale":"2024-03-04T13:09:32.348453+0000","last_undegraded":"2024-03-04T13:09:32.348453+0000","last_fullsized":"2024-03-04T13:09:32.348453+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:24:34.666643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497750+0000","last_change":"2024-03-04T12:46:22.308562+0000","last_active":"2024-03-04T13:10:12.497750+0000","last_peered":"2024-03-04T13:10:12.497750+0000","last_clean":"2024-03-04T13:10:12.497750+0000","last_became_active":"2024-03-04T12:46:22.308300+0000","last_became_peered":"2024-03-04T12:46:22.308300+0000","last_unstale":"2024-03-04T13:10:12.497750+0000","last_undegraded":"2024-03-04T13:10:12.497750+0000","last_fullsized":"2024-03-04T13:10:12.497750+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:44:03.273585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":40,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:37.538309+0000","last_change":"2024-03-04T12:32:46.051902+0000","last_active":"2024-03-04T13:09:37.538309+0000","last_peered":"2024-03-04T13:09:37.538309+0000","last_clean":"2024-03-04T13:09:37.538309+0000","last_became_active":"2024-03-04T12:32:46.051614+0000","last_became_peered":"2024-03-04T12:32:46.051614+0000","last_unstale":"2024-03-04T13:09:37.538309+0000","last_undegraded":"2024-03-04T13:09:37.538309+0000","last_fullsized":"2024-03-04T13:09:37.538309+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:43:57.663077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.492975+0000","last_change":"2024-03-04T12:32:42.033609+0000","last_active":"2024-03-04T13:09:42.492975+0000","last_peered":"2024-03-04T13:09:42.492975+0000","last_clean":"2024-03-04T13:09:42.492975+0000","last_became_active":"2024-03-04T12:32:42.033182+0000","last_became_peered":"2024-03-04T12:32:42.033182+0000","last_unstale":"2024-03-04T13:09:42.492975+0000","last_undegraded":"2024-03-04T13:09:42.492975+0000","last_fullsized":"2024-03-04T13:09:42.492975+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:21.548201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"250'41","reported_seq":160,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.537725+0000","last_change":"2024-03-04T12:29:01.709192+0000","last_active":"2024-03-04T13:09:32.537725+0000","last_peered":"2024-03-04T13:09:32.537725+0000","last_clean":"2024-03-04T13:09:32.537725+0000","last_became_active":"2024-03-04T12:29:01.708876+0000","last_became_peered":"2024-03-04T12:29:01.708876+0000","last_unstale":"2024-03-04T13:09:32.537725+0000","last_undegraded":"2024-03-04T13:09:32.537725+0000","last_fullsized":"2024-03-04T13:09:32.537725+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:14:35.685901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":148,"num_write":55,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497742+0000","last_change":"2024-03-04T12:46:22.256922+0000","last_active":"2024-03-04T13:10:12.497742+0000","last_peered":"2024-03-04T13:10:12.497742+0000","last_clean":"2024-03-04T13:10:12.497742+0000","last_became_active":"2024-03-04T12:46:22.256617+0000","last_became_peered":"2024-03-04T12:46:22.256617+0000","last_unstale":"2024-03-04T13:10:12.497742+0000","last_undegraded":"2024-03-04T13:10:12.497742+0000","last_fullsized":"2024-03-04T13:10:12.497742+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:16:12.469482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"250'2","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:37.441469+0000","last_change":"2024-03-04T12:32:46.055551+0000","last_active":"2024-03-04T13:09:37.441469+0000","last_peered":"2024-03-04T13:09:37.441469+0000","last_clean":"2024-03-04T13:09:37.441469+0000","last_became_active":"2024-03-04T12:32:46.055321+0000","last_became_peered":"2024-03-04T12:32:46.055321+0000","last_unstale":"2024-03-04T13:09:37.441469+0000","last_undegraded":"2024-03-04T13:09:37.441469+0000","last_fullsized":"2024-03-04T13:09:37.441469+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:16.410422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"250'5","reported_seq":57,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:57.450237+0000","last_change":"2024-03-04T12:32:42.030944+0000","last_active":"2024-03-04T13:10:57.450237+0000","last_peered":"2024-03-04T13:10:57.450237+0000","last_clean":"2024-03-04T13:10:57.450237+0000","last_became_active":"2024-03-04T12:32:42.030512+0000","last_became_peered":"2024-03-04T12:32:42.030512+0000","last_unstale":"2024-03-04T13:10:57.450237+0000","last_undegraded":"2024-03-04T13:10:57.450237+0000","last_fullsized":"2024-03-04T13:10:57.450237+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:20.706121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"255'57","reported_seq":188,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.440412+0000","last_change":"2024-03-04T12:29:01.699812+0000","last_active":"2024-03-04T13:10:17.440412+0000","last_peered":"2024-03-04T13:10:17.440412+0000","last_clean":"2024-03-04T13:10:17.440412+0000","last_became_active":"2024-03-04T12:29:01.699507+0000","last_became_peered":"2024-03-04T12:29:01.699507+0000","last_unstale":"2024-03-04T13:10:17.440412+0000","last_undegraded":"2024-03-04T13:10:17.440412+0000","last_fullsized":"2024-03-04T13:10:17.440412+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:16:54.424195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":165,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498707+0000","last_change":"2024-03-04T12:46:22.256492+0000","last_active":"2024-03-04T13:10:17.498707+0000","last_peered":"2024-03-04T13:10:17.498707+0000","last_clean":"2024-03-04T13:10:17.498707+0000","last_became_active":"2024-03-04T12:46:22.256181+0000","last_became_peered":"2024-03-04T12:46:22.256181+0000","last_unstale":"2024-03-04T13:10:17.498707+0000","last_undegraded":"2024-03-04T13:10:17.498707+0000","last_fullsized":"2024-03-04T13:10:17.498707+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:08:40.855920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"255'8","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:17.530463+0000","last_change":"2024-03-04T12:32:46.045905+0000","last_active":"2024-03-04T13:13:17.530463+0000","last_peered":"2024-03-04T13:13:17.530463+0000","last_clean":"2024-03-04T13:13:17.530463+0000","last_became_active":"2024-03-04T12:32:46.045552+0000","last_became_peered":"2024-03-04T12:32:46.045552+0000","last_unstale":"2024-03-04T13:13:17.530463+0000","last_undegraded":"2024-03-04T13:13:17.530463+0000","last_fullsized":"2024-03-04T13:13:17.530463+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:26:04.913934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.473463+0000","last_change":"2024-03-04T12:32:42.036672+0000","last_active":"2024-03-04T13:09:32.473463+0000","last_peered":"2024-03-04T13:09:32.473463+0000","last_clean":"2024-03-04T13:09:32.473463+0000","last_became_active":"2024-03-04T12:32:42.035436+0000","last_became_peered":"2024-03-04T12:32:42.035436+0000","last_unstale":"2024-03-04T13:09:32.473463+0000","last_undegraded":"2024-03-04T13:09:32.473463+0000","last_fullsized":"2024-03-04T13:09:32.473463+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:12.296339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"255'54","reported_seq":179,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.439926+0000","last_change":"2024-03-04T12:29:01.705876+0000","last_active":"2024-03-04T13:10:12.439926+0000","last_peered":"2024-03-04T13:10:12.439926+0000","last_clean":"2024-03-04T13:10:12.439926+0000","last_became_active":"2024-03-04T12:29:01.704434+0000","last_became_peered":"2024-03-04T12:29:01.704434+0000","last_unstale":"2024-03-04T13:10:12.439926+0000","last_undegraded":"2024-03-04T13:10:12.439926+0000","last_fullsized":"2024-03-04T13:10:12.439926+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:09:02.530451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":154,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.533144+0000","last_change":"2024-03-04T12:46:22.257771+0000","last_active":"2024-03-04T13:08:52.533144+0000","last_peered":"2024-03-04T13:08:52.533144+0000","last_clean":"2024-03-04T13:08:52.533144+0000","last_became_active":"2024-03-04T12:46:22.257495+0000","last_became_peered":"2024-03-04T12:46:22.257495+0000","last_unstale":"2024-03-04T13:08:52.533144+0000","last_undegraded":"2024-03-04T13:08:52.533144+0000","last_fullsized":"2024-03-04T13:08:52.533144+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:35:28.573364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"255'3","reported_seq":43,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:52.456356+0000","last_change":"2024-03-04T12:32:46.057285+0000","last_active":"2024-03-04T13:11:52.456356+0000","last_peered":"2024-03-04T13:11:52.456356+0000","last_clean":"2024-03-04T13:11:52.456356+0000","last_became_active":"2024-03-04T12:32:46.056737+0000","last_became_peered":"2024-03-04T12:32:46.056737+0000","last_unstale":"2024-03-04T13:11:52.456356+0000","last_undegraded":"2024-03-04T13:11:52.456356+0000","last_fullsized":"2024-03-04T13:11:52.456356+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:23:08.710392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.447462+0000","last_change":"2024-03-04T12:32:42.029327+0000","last_active":"2024-03-04T13:09:32.447462+0000","last_peered":"2024-03-04T13:09:32.447462+0000","last_clean":"2024-03-04T13:09:32.447462+0000","last_became_active":"2024-03-04T12:32:42.029043+0000","last_became_peered":"2024-03-04T12:32:42.029043+0000","last_unstale":"2024-03-04T13:09:32.447462+0000","last_undegraded":"2024-03-04T13:09:32.447462+0000","last_fullsized":"2024-03-04T13:09:32.447462+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:27:12.022258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"255'45","reported_seq":156,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.478783+0000","last_change":"2024-03-04T12:29:01.702439+0000","last_active":"2024-03-04T13:10:12.478783+0000","last_peered":"2024-03-04T13:10:12.478783+0000","last_clean":"2024-03-04T13:10:12.478783+0000","last_became_active":"2024-03-04T12:29:01.702146+0000","last_became_peered":"2024-03-04T12:29:01.702146+0000","last_unstale":"2024-03-04T13:10:12.478783+0000","last_undegraded":"2024-03-04T13:10:12.478783+0000","last_fullsized":"2024-03-04T13:10:12.478783+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:16:58.177901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":123,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:17.438909+0000","last_change":"2024-03-04T12:46:22.311207+0000","last_active":"2024-03-04T13:09:17.438909+0000","last_peered":"2024-03-04T13:09:17.438909+0000","last_clean":"2024-03-04T13:09:17.438909+0000","last_became_active":"2024-03-04T12:46:22.310830+0000","last_became_peered":"2024-03-04T12:46:22.310830+0000","last_unstale":"2024-03-04T13:09:17.438909+0000","last_undegraded":"2024-03-04T13:09:17.438909+0000","last_fullsized":"2024-03-04T13:09:17.438909+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:24:30.083017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"255'2","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.454246+0000","last_change":"2024-03-04T12:32:46.058735+0000","last_active":"2024-03-04T13:12:27.454246+0000","last_peered":"2024-03-04T13:12:27.454246+0000","last_clean":"2024-03-04T13:12:27.454246+0000","last_became_active":"2024-03-04T12:32:46.058306+0000","last_became_peered":"2024-03-04T12:32:46.058306+0000","last_unstale":"2024-03-04T13:12:27.454246+0000","last_undegraded":"2024-03-04T13:12:27.454246+0000","last_fullsized":"2024-03-04T13:12:27.454246+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:23.146488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"255'5","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.995332+0000","last_change":"2024-03-04T12:32:42.035623+0000","last_active":"2024-03-04T13:13:20.995332+0000","last_peered":"2024-03-04T13:13:20.995332+0000","last_clean":"2024-03-04T13:13:20.995332+0000","last_became_active":"2024-03-04T12:32:42.035302+0000","last_became_peered":"2024-03-04T12:32:42.035302+0000","last_unstale":"2024-03-04T13:13:20.995332+0000","last_undegraded":"2024-03-04T13:13:20.995332+0000","last_fullsized":"2024-03-04T13:13:20.995332+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:30:11.132509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6192,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"255'41","reported_seq":154,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.439984+0000","last_change":"2024-03-04T12:29:01.707171+0000","last_active":"2024-03-04T13:10:12.439984+0000","last_peered":"2024-03-04T13:10:12.439984+0000","last_clean":"2024-03-04T13:10:12.439984+0000","last_became_active":"2024-03-04T12:29:01.706897+0000","last_became_peered":"2024-03-04T12:29:01.706897+0000","last_unstale":"2024-03-04T13:10:12.439984+0000","last_undegraded":"2024-03-04T13:10:12.439984+0000","last_fullsized":"2024-03-04T13:10:12.439984+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:46:21.234572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":127,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.439467+0000","last_change":"2024-03-04T12:46:22.253306+0000","last_active":"2024-03-04T13:09:22.439467+0000","last_peered":"2024-03-04T13:09:22.439467+0000","last_clean":"2024-03-04T13:09:22.439467+0000","last_became_active":"2024-03-04T12:46:22.252955+0000","last_became_peered":"2024-03-04T12:46:22.252955+0000","last_unstale":"2024-03-04T13:09:22.439467+0000","last_undegraded":"2024-03-04T13:09:22.439467+0000","last_fullsized":"2024-03-04T13:09:22.439467+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:46:23.427621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"255'11","reported_seq":63,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.183394+0000","last_change":"2024-03-04T12:32:46.056590+0000","last_active":"2024-03-04T13:13:21.183394+0000","last_peered":"2024-03-04T13:13:21.183394+0000","last_clean":"2024-03-04T13:13:21.183394+0000","last_became_active":"2024-03-04T12:32:46.056219+0000","last_became_peered":"2024-03-04T12:32:46.056219+0000","last_unstale":"2024-03-04T13:13:21.183394+0000","last_undegraded":"2024-03-04T13:13:21.183394+0000","last_fullsized":"2024-03-04T13:13:21.183394+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:43.098655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25600,"num_write":16,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"255'8","reported_seq":60,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.996709+0000","last_change":"2024-03-04T12:32:42.034819+0000","last_active":"2024-03-04T13:13:20.996709+0000","last_peered":"2024-03-04T13:13:20.996709+0000","last_clean":"2024-03-04T13:13:20.996709+0000","last_became_active":"2024-03-04T12:32:42.034556+0000","last_became_peered":"2024-03-04T12:32:42.034556+0000","last_unstale":"2024-03-04T13:13:20.996709+0000","last_undegraded":"2024-03-04T13:13:20.996709+0000","last_fullsized":"2024-03-04T13:13:20.996709+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:27.683103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12328,"num_write":8,"num_write_kb":12328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"255'42","reported_seq":147,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497950+0000","last_change":"2024-03-04T12:29:01.706878+0000","last_active":"2024-03-04T13:10:12.497950+0000","last_peered":"2024-03-04T13:10:12.497950+0000","last_clean":"2024-03-04T13:10:12.497950+0000","last_became_active":"2024-03-04T12:29:01.706549+0000","last_became_peered":"2024-03-04T12:29:01.706549+0000","last_unstale":"2024-03-04T13:10:12.497950+0000","last_undegraded":"2024-03-04T13:10:12.497950+0000","last_fullsized":"2024-03-04T13:10:12.497950+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:52:21.965189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":111,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"252'1","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497886+0000","last_change":"2024-03-04T12:46:22.254600+0000","last_active":"2024-03-04T13:10:12.497886+0000","last_peered":"2024-03-04T13:10:12.497886+0000","last_clean":"2024-03-04T13:10:12.497886+0000","last_became_active":"2024-03-04T12:46:22.254303+0000","last_became_peered":"2024-03-04T12:46:22.254303+0000","last_unstale":"2024-03-04T13:10:12.497886+0000","last_undegraded":"2024-03-04T13:10:12.497886+0000","last_fullsized":"2024-03-04T13:10:12.497886+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:56:13.243949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"255'3","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:47.514375+0000","last_change":"2024-03-04T12:32:46.055817+0000","last_active":"2024-03-04T13:11:47.514375+0000","last_peered":"2024-03-04T13:11:47.514375+0000","last_clean":"2024-03-04T13:11:47.514375+0000","last_became_active":"2024-03-04T12:32:46.055497+0000","last_became_peered":"2024-03-04T12:32:46.055497+0000","last_unstale":"2024-03-04T13:11:47.514375+0000","last_undegraded":"2024-03-04T13:11:47.514375+0000","last_fullsized":"2024-03-04T13:11:47.514375+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:51:26.771686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.542388+0000","last_change":"2024-03-04T12:32:42.036436+0000","last_active":"2024-03-04T13:10:12.542388+0000","last_peered":"2024-03-04T13:10:12.542388+0000","last_clean":"2024-03-04T13:10:12.542388+0000","last_became_active":"2024-03-04T12:32:42.036150+0000","last_became_peered":"2024-03-04T12:32:42.036150+0000","last_unstale":"2024-03-04T13:10:12.542388+0000","last_undegraded":"2024-03-04T13:10:12.542388+0000","last_fullsized":"2024-03-04T13:10:12.542388+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:31:48.514077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"255'68","reported_seq":270,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:52.360028+0000","last_change":"2024-03-04T12:29:01.700959+0000","last_active":"2024-03-04T13:10:52.360028+0000","last_peered":"2024-03-04T13:10:52.360028+0000","last_clean":"2024-03-04T13:10:52.360028+0000","last_became_active":"2024-03-04T12:29:01.700624+0000","last_became_peered":"2024-03-04T12:29:01.700624+0000","last_unstale":"2024-03-04T13:10:52.360028+0000","last_undegraded":"2024-03-04T13:10:52.360028+0000","last_fullsized":"2024-03-04T13:10:52.360028+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:04.670734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":295,"num_write":88,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497975+0000","last_change":"2024-03-04T12:46:22.309757+0000","last_active":"2024-03-04T13:10:12.497975+0000","last_peered":"2024-03-04T13:10:12.497975+0000","last_clean":"2024-03-04T13:10:12.497975+0000","last_became_active":"2024-03-04T12:46:22.309493+0000","last_became_peered":"2024-03-04T12:46:22.309493+0000","last_unstale":"2024-03-04T13:10:12.497975+0000","last_undegraded":"2024-03-04T13:10:12.497975+0000","last_fullsized":"2024-03-04T13:10:12.497975+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:56.850351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"255'10","reported_seq":61,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.190787+0000","last_change":"2024-03-04T12:32:46.054533+0000","last_active":"2024-03-04T13:13:21.190787+0000","last_peered":"2024-03-04T13:13:21.190787+0000","last_clean":"2024-03-04T13:13:21.190787+0000","last_became_active":"2024-03-04T12:32:46.054256+0000","last_became_peered":"2024-03-04T12:32:46.054256+0000","last_unstale":"2024-03-04T13:13:21.190787+0000","last_undegraded":"2024-03-04T13:13:21.190787+0000","last_fullsized":"2024-03-04T13:13:21.190787+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:56:03.550607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":16480,"num_write":15,"num_write_kb":11320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499619+0000","last_change":"2024-03-04T12:32:42.035988+0000","last_active":"2024-03-04T13:10:22.499619+0000","last_peered":"2024-03-04T13:10:22.499619+0000","last_clean":"2024-03-04T13:10:22.499619+0000","last_became_active":"2024-03-04T12:32:42.035683+0000","last_became_peered":"2024-03-04T12:32:42.035683+0000","last_unstale":"2024-03-04T13:10:22.499619+0000","last_undegraded":"2024-03-04T13:10:22.499619+0000","last_fullsized":"2024-03-04T13:10:22.499619+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:02:00.359791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"255'43","reported_seq":144,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.503035+0000","last_change":"2024-03-04T12:29:01.701803+0000","last_active":"2024-03-04T13:10:42.503035+0000","last_peered":"2024-03-04T13:10:42.503035+0000","last_clean":"2024-03-04T13:10:42.503035+0000","last_became_active":"2024-03-04T12:29:01.701396+0000","last_became_peered":"2024-03-04T12:29:01.701396+0000","last_unstale":"2024-03-04T13:10:42.503035+0000","last_undegraded":"2024-03-04T13:10:42.503035+0000","last_fullsized":"2024-03-04T13:10:42.503035+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:53:53.242346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.356344+0000","last_change":"2024-03-04T12:46:22.260088+0000","last_active":"2024-03-04T13:10:27.356344+0000","last_peered":"2024-03-04T13:10:27.356344+0000","last_clean":"2024-03-04T13:10:27.356344+0000","last_became_active":"2024-03-04T12:46:22.259763+0000","last_became_peered":"2024-03-04T12:46:22.259763+0000","last_unstale":"2024-03-04T13:10:27.356344+0000","last_undegraded":"2024-03-04T13:10:27.356344+0000","last_fullsized":"2024-03-04T13:10:27.356344+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:33.450477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"255'5","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.032505+0000","last_change":"2024-03-04T12:32:46.057881+0000","last_active":"2024-03-04T13:13:21.032505+0000","last_peered":"2024-03-04T13:13:21.032505+0000","last_clean":"2024-03-04T13:13:21.032505+0000","last_became_active":"2024-03-04T12:32:46.057646+0000","last_became_peered":"2024-03-04T12:32:46.057646+0000","last_unstale":"2024-03-04T13:13:21.032505+0000","last_undegraded":"2024-03-04T13:13:21.032505+0000","last_fullsized":"2024-03-04T13:13:21.032505+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:26:52.859284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5168,"num_write":5,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"255'2","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:17.519439+0000","last_change":"2024-03-04T12:32:42.027057+0000","last_active":"2024-03-04T13:12:17.519439+0000","last_peered":"2024-03-04T13:12:17.519439+0000","last_clean":"2024-03-04T13:12:17.519439+0000","last_became_active":"2024-03-04T12:32:42.026771+0000","last_became_peered":"2024-03-04T12:32:42.026771+0000","last_unstale":"2024-03-04T13:12:17.519439+0000","last_undegraded":"2024-03-04T13:12:17.519439+0000","last_fullsized":"2024-03-04T13:12:17.519439+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:49:21.026487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"255'43","reported_seq":153,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.455774+0000","last_change":"2024-03-04T12:29:01.702097+0000","last_active":"2024-03-04T13:10:42.455774+0000","last_peered":"2024-03-04T13:10:42.455774+0000","last_clean":"2024-03-04T13:10:42.455774+0000","last_became_active":"2024-03-04T12:29:01.701812+0000","last_became_peered":"2024-03-04T12:29:01.701812+0000","last_unstale":"2024-03-04T13:10:42.455774+0000","last_undegraded":"2024-03-04T13:10:42.455774+0000","last_fullsized":"2024-03-04T13:10:42.455774+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:59:24.881817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":121,"num_write":82,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:17.535979+0000","last_change":"2024-03-04T12:46:22.247949+0000","last_active":"2024-03-04T13:09:17.535979+0000","last_peered":"2024-03-04T13:09:17.535979+0000","last_clean":"2024-03-04T13:09:17.535979+0000","last_became_active":"2024-03-04T12:46:22.247655+0000","last_became_peered":"2024-03-04T12:46:22.247655+0000","last_unstale":"2024-03-04T13:09:17.535979+0000","last_undegraded":"2024-03-04T13:09:17.535979+0000","last_fullsized":"2024-03-04T13:09:17.535979+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:28.814124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"255'3","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.526860+0000","last_change":"2024-03-04T12:32:46.058700+0000","last_active":"2024-03-04T13:12:57.526860+0000","last_peered":"2024-03-04T13:12:57.526860+0000","last_clean":"2024-03-04T13:12:57.526860+0000","last_became_active":"2024-03-04T12:32:46.058466+0000","last_became_peered":"2024-03-04T12:32:46.058466+0000","last_unstale":"2024-03-04T13:12:57.526860+0000","last_undegraded":"2024-03-04T13:12:57.526860+0000","last_fullsized":"2024-03-04T13:12:57.526860+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:45:44.721969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.354089+0000","last_change":"2024-03-04T12:32:42.031684+0000","last_active":"2024-03-04T13:10:12.354089+0000","last_peered":"2024-03-04T13:10:12.354089+0000","last_clean":"2024-03-04T13:10:12.354089+0000","last_became_active":"2024-03-04T12:32:42.031410+0000","last_became_peered":"2024-03-04T12:32:42.031410+0000","last_unstale":"2024-03-04T13:10:12.354089+0000","last_undegraded":"2024-03-04T13:10:12.354089+0000","last_fullsized":"2024-03-04T13:10:12.354089+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:20:00.365398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"255'27","reported_seq":115,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.482916+0000","last_change":"2024-03-04T12:29:01.703669+0000","last_active":"2024-03-04T13:10:42.482916+0000","last_peered":"2024-03-04T13:10:42.482916+0000","last_clean":"2024-03-04T13:10:42.482916+0000","last_became_active":"2024-03-04T12:29:01.703420+0000","last_became_peered":"2024-03-04T12:29:01.703420+0000","last_unstale":"2024-03-04T13:10:42.482916+0000","last_undegraded":"2024-03-04T13:10:42.482916+0000","last_fullsized":"2024-03-04T13:10:42.482916+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:31:39.634520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":74,"num_write":42,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:17.489139+0000","last_change":"2024-03-04T12:46:22.250162+0000","last_active":"2024-03-04T13:09:17.489139+0000","last_peered":"2024-03-04T13:09:17.489139+0000","last_clean":"2024-03-04T13:09:17.489139+0000","last_became_active":"2024-03-04T12:46:22.249854+0000","last_became_peered":"2024-03-04T12:46:22.249854+0000","last_unstale":"2024-03-04T13:09:17.489139+0000","last_undegraded":"2024-03-04T13:09:17.489139+0000","last_fullsized":"2024-03-04T13:09:17.489139+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:41:19.298108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":41,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.479555+0000","last_change":"2024-03-04T12:32:46.051913+0000","last_active":"2024-03-04T13:10:17.479555+0000","last_peered":"2024-03-04T13:10:17.479555+0000","last_clean":"2024-03-04T13:10:17.479555+0000","last_became_active":"2024-03-04T12:32:46.051498+0000","last_became_peered":"2024-03-04T12:32:46.051498+0000","last_unstale":"2024-03-04T13:10:17.479555+0000","last_undegraded":"2024-03-04T13:10:17.479555+0000","last_fullsized":"2024-03-04T13:10:17.479555+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:31:49.935678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"255'6","reported_seq":61,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:52.525983+0000","last_change":"2024-03-04T12:32:42.038655+0000","last_active":"2024-03-04T13:12:52.525983+0000","last_peered":"2024-03-04T13:12:52.525983+0000","last_clean":"2024-03-04T13:12:52.525983+0000","last_became_active":"2024-03-04T12:32:42.038349+0000","last_became_peered":"2024-03-04T12:32:42.038349+0000","last_unstale":"2024-03-04T13:12:52.525983+0000","last_undegraded":"2024-03-04T13:12:52.525983+0000","last_fullsized":"2024-03-04T13:12:52.525983+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:35:57.593667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"255'90","reported_seq":258,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.358360+0000","last_change":"2024-03-04T12:29:01.701552+0000","last_active":"2024-03-04T13:10:42.358360+0000","last_peered":"2024-03-04T13:10:42.358360+0000","last_clean":"2024-03-04T13:10:42.358360+0000","last_became_active":"2024-03-04T12:29:01.701282+0000","last_became_peered":"2024-03-04T12:29:01.701282+0000","last_unstale":"2024-03-04T13:10:42.358360+0000","last_undegraded":"2024-03-04T13:10:42.358360+0000","last_fullsized":"2024-03-04T13:10:42.358360+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:31:15.249708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":354,"num_read_kb":252,"num_write":156,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:17.471339+0000","last_change":"2024-03-04T12:46:22.259364+0000","last_active":"2024-03-04T13:09:17.471339+0000","last_peered":"2024-03-04T13:09:17.471339+0000","last_clean":"2024-03-04T13:09:17.471339+0000","last_became_active":"2024-03-04T12:46:22.258936+0000","last_became_peered":"2024-03-04T12:46:22.258936+0000","last_unstale":"2024-03-04T13:09:17.471339+0000","last_undegraded":"2024-03-04T13:09:17.471339+0000","last_fullsized":"2024-03-04T13:09:17.471339+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:15:52.268943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":41,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.542901+0000","last_change":"2024-03-04T12:32:46.053786+0000","last_active":"2024-03-04T13:10:17.542901+0000","last_peered":"2024-03-04T13:10:17.542901+0000","last_clean":"2024-03-04T13:10:17.542901+0000","last_became_active":"2024-03-04T12:32:46.053456+0000","last_became_peered":"2024-03-04T12:32:46.053456+0000","last_unstale":"2024-03-04T13:10:17.542901+0000","last_undegraded":"2024-03-04T13:10:17.542901+0000","last_fullsized":"2024-03-04T13:10:17.542901+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:10.231648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.478815+0000","last_change":"2024-03-04T12:32:42.035705+0000","last_active":"2024-03-04T13:10:12.478815+0000","last_peered":"2024-03-04T13:10:12.478815+0000","last_clean":"2024-03-04T13:10:12.478815+0000","last_became_active":"2024-03-04T12:32:42.035413+0000","last_became_peered":"2024-03-04T12:32:42.035413+0000","last_unstale":"2024-03-04T13:10:12.478815+0000","last_undegraded":"2024-03-04T13:10:12.478815+0000","last_fullsized":"2024-03-04T13:10:12.478815+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:30:04.933989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"255'17","reported_seq":94,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.445657+0000","last_change":"2024-03-04T12:29:01.702839+0000","last_active":"2024-03-04T13:11:07.445657+0000","last_peered":"2024-03-04T13:11:07.445657+0000","last_clean":"2024-03-04T13:11:07.445657+0000","last_became_active":"2024-03-04T12:29:01.702555+0000","last_became_peered":"2024-03-04T12:29:01.702555+0000","last_unstale":"2024-03-04T13:11:07.445657+0000","last_undegraded":"2024-03-04T13:11:07.445657+0000","last_fullsized":"2024-03-04T13:11:07.445657+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:55:13.316774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":47,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"255'178","reported_seq":782,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.182995+0000","last_change":"2024-03-04T12:20:14.820927+0000","last_active":"2024-03-04T13:13:21.182995+0000","last_peered":"2024-03-04T13:13:21.182995+0000","last_clean":"2024-03-04T13:13:21.182995+0000","last_became_active":"2024-03-04T12:20:14.820595+0000","last_became_peered":"2024-03-04T12:20:14.820595+0000","last_unstale":"2024-03-04T13:13:21.182995+0000","last_undegraded":"2024-03-04T13:13:21.182995+0000","last_fullsized":"2024-03-04T13:13:21.182995+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:07:18.920479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":457,"num_write":1012,"num_write_kb":11218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"255'475","reported_seq":1778,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.976981+0000","last_change":"2024-03-04T12:20:16.828823+0000","last_active":"2024-03-04T13:12:36.976981+0000","last_peered":"2024-03-04T13:12:36.976981+0000","last_clean":"2024-03-04T13:12:36.976981+0000","last_became_active":"2024-03-04T12:20:16.828539+0000","last_became_peered":"2024-03-04T12:20:16.828539+0000","last_unstale":"2024-03-04T13:12:36.976981+0000","last_undegraded":"2024-03-04T13:12:36.976981+0000","last_fullsized":"2024-03-04T13:12:36.976981+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:22:24.173643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2301,"num_read_kb":2121,"num_write":643,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"255'219","reported_seq":869,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:35.776295+0000","last_change":"2024-03-04T12:20:14.815583+0000","last_active":"2024-03-04T13:12:35.776295+0000","last_peered":"2024-03-04T13:12:35.776295+0000","last_clean":"2024-03-04T13:12:35.776295+0000","last_became_active":"2024-03-04T12:20:14.814863+0000","last_became_peered":"2024-03-04T12:20:14.814863+0000","last_unstale":"2024-03-04T13:12:35.776295+0000","last_undegraded":"2024-03-04T13:12:35.776295+0000","last_fullsized":"2024-03-04T13:12:35.776295+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:13:54.813411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9034256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":516,"num_read_kb":15449,"num_write":1322,"num_write_kb":40818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"255'559","reported_seq":1909,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573307+0000","last_change":"2024-03-04T12:20:16.837515+0000","last_active":"2024-03-04T13:12:50.573307+0000","last_peered":"2024-03-04T13:12:50.573307+0000","last_clean":"2024-03-04T13:12:50.573307+0000","last_became_active":"2024-03-04T12:20:16.837200+0000","last_became_peered":"2024-03-04T12:20:16.837200+0000","last_unstale":"2024-03-04T13:12:50.573307+0000","last_undegraded":"2024-03-04T13:12:50.573307+0000","last_fullsized":"2024-03-04T13:12:50.573307+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:27.972671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2594,"num_read_kb":2289,"num_write":764,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"255'155","reported_seq":747,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.163314+0000","last_change":"2024-03-04T12:20:14.816919+0000","last_active":"2024-03-04T13:13:21.163314+0000","last_peered":"2024-03-04T13:13:21.163314+0000","last_clean":"2024-03-04T13:13:21.163314+0000","last_became_active":"2024-03-04T12:20:14.816597+0000","last_became_peered":"2024-03-04T12:20:14.816597+0000","last_unstale":"2024-03-04T13:13:21.163314+0000","last_undegraded":"2024-03-04T13:13:21.163314+0000","last_fullsized":"2024-03-04T13:13:21.163314+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:22:06.737898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":326,"num_read_kb":1168,"num_write":917,"num_write_kb":5749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"255'452","reported_seq":1950,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:08.259447+0000","last_change":"2024-03-04T12:20:16.821071+0000","last_active":"2024-03-04T13:12:08.259447+0000","last_peered":"2024-03-04T13:12:08.259447+0000","last_clean":"2024-03-04T13:12:08.259447+0000","last_became_active":"2024-03-04T12:20:16.820419+0000","last_became_peered":"2024-03-04T12:20:16.820419+0000","last_unstale":"2024-03-04T13:12:08.259447+0000","last_undegraded":"2024-03-04T13:12:08.259447+0000","last_fullsized":"2024-03-04T13:12:08.259447+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:43.521050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2318,"num_read_kb":2161,"num_write":537,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"255'245","reported_seq":882,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.373607+0000","last_change":"2024-03-04T12:20:14.826502+0000","last_active":"2024-03-04T13:12:27.373607+0000","last_peered":"2024-03-04T13:12:27.373607+0000","last_clean":"2024-03-04T13:12:27.373607+0000","last_became_active":"2024-03-04T12:20:14.824779+0000","last_became_peered":"2024-03-04T12:20:14.824779+0000","last_unstale":"2024-03-04T13:12:27.373607+0000","last_undegraded":"2024-03-04T13:12:27.373607+0000","last_fullsized":"2024-03-04T13:12:27.373607+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:29.747512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4160401,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":13558,"num_write":1376,"num_write_kb":36455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"255'351","reported_seq":1793,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.327892+0000","last_change":"2024-03-04T12:20:16.828116+0000","last_active":"2024-03-04T13:12:39.327892+0000","last_peered":"2024-03-04T13:12:39.327892+0000","last_clean":"2024-03-04T13:12:39.327892+0000","last_became_active":"2024-03-04T12:20:16.827613+0000","last_became_peered":"2024-03-04T12:20:16.827613+0000","last_unstale":"2024-03-04T13:12:39.327892+0000","last_undegraded":"2024-03-04T13:12:39.327892+0000","last_fullsized":"2024-03-04T13:12:39.327892+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:56:19.430664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1915,"num_read_kb":1843,"num_write":383,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"255'195","reported_seq":834,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.096823+0000","last_change":"2024-03-04T12:20:14.816830+0000","last_active":"2024-03-04T13:13:21.096823+0000","last_peered":"2024-03-04T13:13:21.096823+0000","last_clean":"2024-03-04T13:13:21.096823+0000","last_became_active":"2024-03-04T12:20:14.816532+0000","last_became_peered":"2024-03-04T12:20:14.816532+0000","last_unstale":"2024-03-04T13:13:21.096823+0000","last_undegraded":"2024-03-04T13:13:21.096823+0000","last_fullsized":"2024-03-04T13:13:21.096823+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:37:37.790276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5789792,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":440,"num_read_kb":58154,"num_write":1069,"num_write_kb":58795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"255'405","reported_seq":2045,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.099180+0000","last_change":"2024-03-04T12:20:16.816980+0000","last_active":"2024-03-04T13:12:31.099180+0000","last_peered":"2024-03-04T13:12:31.099180+0000","last_clean":"2024-03-04T13:12:31.099180+0000","last_became_active":"2024-03-04T12:20:16.816688+0000","last_became_peered":"2024-03-04T12:20:16.816688+0000","last_unstale":"2024-03-04T13:12:31.099180+0000","last_undegraded":"2024-03-04T13:12:31.099180+0000","last_fullsized":"2024-03-04T13:12:31.099180+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:36:29.402179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2407,"num_read_kb":2304,"num_write":479,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"255'170","reported_seq":750,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.063180+0000","last_change":"2024-03-04T12:20:51.031065+0000","last_active":"2024-03-04T13:12:12.063180+0000","last_peered":"2024-03-04T13:12:12.063180+0000","last_clean":"2024-03-04T13:12:12.063180+0000","last_became_active":"2024-03-04T12:20:51.030709+0000","last_became_peered":"2024-03-04T12:20:51.030709+0000","last_unstale":"2024-03-04T13:12:12.063180+0000","last_undegraded":"2024-03-04T13:12:12.063180+0000","last_fullsized":"2024-03-04T13:12:12.063180+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:16:42.363646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13826798,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":359,"num_read_kb":29477,"num_write":994,"num_write_kb":29693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"255'775","reported_seq":2153,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.309100+0000","last_change":"2024-03-04T12:20:16.825330+0000","last_active":"2024-03-04T13:12:39.309100+0000","last_peered":"2024-03-04T13:12:39.309100+0000","last_clean":"2024-03-04T13:12:39.309100+0000","last_became_active":"2024-03-04T12:20:16.822282+0000","last_became_peered":"2024-03-04T12:20:16.822282+0000","last_unstale":"2024-03-04T13:12:39.309100+0000","last_undegraded":"2024-03-04T13:12:39.309100+0000","last_fullsized":"2024-03-04T13:12:39.309100+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:56:51.893473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3372,"num_read_kb":2974,"num_write":1065,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"255'195","reported_seq":826,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.101704+0000","last_change":"2024-03-04T12:20:14.815689+0000","last_active":"2024-03-04T13:13:21.101704+0000","last_peered":"2024-03-04T13:13:21.101704+0000","last_clean":"2024-03-04T13:13:21.101704+0000","last_became_active":"2024-03-04T12:20:14.815388+0000","last_became_peered":"2024-03-04T12:20:14.815388+0000","last_unstale":"2024-03-04T13:13:21.101704+0000","last_undegraded":"2024-03-04T13:13:21.101704+0000","last_fullsized":"2024-03-04T13:13:21.101704+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:43:25.448300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262238,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":61923,"num_write":1063,"num_write_kb":47041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"255'684","reported_seq":2154,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.557057+0000","last_change":"2024-03-04T12:20:16.833569+0000","last_active":"2024-03-04T13:12:22.557057+0000","last_peered":"2024-03-04T13:12:22.557057+0000","last_clean":"2024-03-04T13:12:22.557057+0000","last_became_active":"2024-03-04T12:20:16.833268+0000","last_became_peered":"2024-03-04T12:20:16.833268+0000","last_unstale":"2024-03-04T13:12:22.557057+0000","last_undegraded":"2024-03-04T13:12:22.557057+0000","last_fullsized":"2024-03-04T13:12:22.557057+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:17.714462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3214,"num_read_kb":2906,"num_write":892,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"255'232","reported_seq":873,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.181027+0000","last_change":"2024-03-04T12:20:14.828265+0000","last_active":"2024-03-04T13:13:21.181027+0000","last_peered":"2024-03-04T13:13:21.181027+0000","last_clean":"2024-03-04T13:13:21.181027+0000","last_became_active":"2024-03-04T12:20:14.827948+0000","last_became_peered":"2024-03-04T12:20:14.827948+0000","last_unstale":"2024-03-04T13:13:21.181027+0000","last_undegraded":"2024-03-04T13:13:21.181027+0000","last_fullsized":"2024-03-04T13:13:21.181027+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:04:36.496722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2119867,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":498,"num_read_kb":35496,"num_write":1177,"num_write_kb":50438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"255'329","reported_seq":1701,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.953895+0000","last_change":"2024-03-04T12:20:16.831041+0000","last_active":"2024-03-04T13:12:36.953895+0000","last_peered":"2024-03-04T13:12:36.953895+0000","last_clean":"2024-03-04T13:12:36.953895+0000","last_became_active":"2024-03-04T12:20:16.830773+0000","last_became_peered":"2024-03-04T12:20:16.830773+0000","last_unstale":"2024-03-04T13:12:36.953895+0000","last_undegraded":"2024-03-04T13:12:36.953895+0000","last_fullsized":"2024-03-04T13:12:36.953895+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:29:14.244772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1823,"num_read_kb":1743,"num_write":376,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"255'403","reported_seq":1977,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.059106+0000","last_change":"2024-03-04T12:20:16.820827+0000","last_active":"2024-03-04T13:12:18.059106+0000","last_peered":"2024-03-04T13:12:18.059106+0000","last_clean":"2024-03-04T13:12:18.059106+0000","last_became_active":"2024-03-04T12:20:16.820533+0000","last_became_peered":"2024-03-04T12:20:16.820533+0000","last_unstale":"2024-03-04T13:12:18.059106+0000","last_undegraded":"2024-03-04T13:12:18.059106+0000","last_fullsized":"2024-03-04T13:12:18.059106+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:23:30.720165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2265,"num_read_kb":2155,"num_write":466,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"255'193","reported_seq":823,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:12.508125+0000","last_change":"2024-03-04T12:20:14.820881+0000","last_active":"2024-03-04T13:11:12.508125+0000","last_peered":"2024-03-04T13:11:12.508125+0000","last_clean":"2024-03-04T13:11:12.508125+0000","last_became_active":"2024-03-04T12:20:14.820248+0000","last_became_peered":"2024-03-04T12:20:14.820248+0000","last_unstale":"2024-03-04T13:11:12.508125+0000","last_undegraded":"2024-03-04T13:11:12.508125+0000","last_fullsized":"2024-03-04T13:11:12.508125+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:59:02.821081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847147,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":428,"num_read_kb":15441,"num_write":1092,"num_write_kb":31882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"255'1140","reported_seq":2690,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573468+0000","last_change":"2024-03-04T12:20:16.837314+0000","last_active":"2024-03-04T13:12:50.573468+0000","last_peered":"2024-03-04T13:12:50.573468+0000","last_clean":"2024-03-04T13:12:50.573468+0000","last_became_active":"2024-03-04T12:20:16.837126+0000","last_became_peered":"2024-03-04T12:20:16.837126+0000","last_unstale":"2024-03-04T13:12:50.573468+0000","last_undegraded":"2024-03-04T13:12:50.573468+0000","last_fullsized":"2024-03-04T13:12:50.573468+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:39:46.380503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4770,"num_read_kb":4178,"num_write":1557,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"255'198","reported_seq":813,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.115479+0000","last_change":"2024-03-04T12:20:14.824468+0000","last_active":"2024-03-04T13:13:21.115479+0000","last_peered":"2024-03-04T13:13:21.115479+0000","last_clean":"2024-03-04T13:13:21.115479+0000","last_became_active":"2024-03-04T12:20:14.824133+0000","last_became_peered":"2024-03-04T12:20:14.824133+0000","last_unstale":"2024-03-04T13:13:21.115479+0000","last_undegraded":"2024-03-04T13:13:21.115479+0000","last_fullsized":"2024-03-04T13:13:21.115479+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:58:01.156356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399138,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":430,"num_read_kb":9751,"num_write":1008,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"255'738","reported_seq":2185,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.777698+0000","last_change":"2024-03-04T12:20:16.825766+0000","last_active":"2024-03-04T13:12:34.777698+0000","last_peered":"2024-03-04T13:12:34.777698+0000","last_clean":"2024-03-04T13:12:34.777698+0000","last_became_active":"2024-03-04T12:20:16.825499+0000","last_became_peered":"2024-03-04T12:20:16.825499+0000","last_unstale":"2024-03-04T13:12:34.777698+0000","last_undegraded":"2024-03-04T13:12:34.777698+0000","last_fullsized":"2024-03-04T13:12:34.777698+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:43:04.157793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3318,"num_read_kb":2969,"num_write":989,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"255'240","reported_seq":871,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.228733+0000","last_change":"2024-03-04T12:20:14.828323+0000","last_active":"2024-03-04T13:13:21.228733+0000","last_peered":"2024-03-04T13:13:21.228733+0000","last_clean":"2024-03-04T13:13:21.228733+0000","last_became_active":"2024-03-04T12:20:14.827979+0000","last_became_peered":"2024-03-04T12:20:14.827979+0000","last_unstale":"2024-03-04T13:13:21.228733+0000","last_undegraded":"2024-03-04T13:13:21.228733+0000","last_fullsized":"2024-03-04T13:13:21.228733+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:12:15.676059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":577599,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":7999,"num_write":1192,"num_write_kb":30331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"255'777","reported_seq":2213,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:20.376868+0000","last_change":"2024-03-04T12:20:16.826162+0000","last_active":"2024-03-04T13:12:20.376868+0000","last_peered":"2024-03-04T13:12:20.376868+0000","last_clean":"2024-03-04T13:12:20.376868+0000","last_became_active":"2024-03-04T12:20:16.825897+0000","last_became_peered":"2024-03-04T12:20:16.825897+0000","last_unstale":"2024-03-04T13:12:20.376868+0000","last_undegraded":"2024-03-04T13:12:20.376868+0000","last_fullsized":"2024-03-04T13:12:20.376868+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:45:52.489712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3571,"num_read_kb":3184,"num_write":1054,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"255'154","reported_seq":753,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.180904+0000","last_change":"2024-03-04T12:20:14.824375+0000","last_active":"2024-03-04T13:13:21.180904+0000","last_peered":"2024-03-04T13:13:21.180904+0000","last_clean":"2024-03-04T13:13:21.180904+0000","last_became_active":"2024-03-04T12:20:14.823430+0000","last_became_peered":"2024-03-04T12:20:14.823430+0000","last_unstale":"2024-03-04T13:13:21.180904+0000","last_undegraded":"2024-03-04T13:13:21.180904+0000","last_fullsized":"2024-03-04T13:13:21.180904+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:00:47.840698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1683023,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":325,"num_read_kb":32856,"num_write":784,"num_write_kb":22354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"255'556","reported_seq":2086,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:37.308042+0000","last_change":"2024-03-04T12:20:16.830040+0000","last_active":"2024-03-04T13:12:37.308042+0000","last_peered":"2024-03-04T13:12:37.308042+0000","last_clean":"2024-03-04T13:12:37.308042+0000","last_became_active":"2024-03-04T12:20:16.829685+0000","last_became_peered":"2024-03-04T12:20:16.829685+0000","last_unstale":"2024-03-04T13:12:37.308042+0000","last_undegraded":"2024-03-04T13:12:37.308042+0000","last_fullsized":"2024-03-04T13:12:37.308042+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:39:48.525836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2792,"num_read_kb":2527,"num_write":750,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"255'193","reported_seq":775,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:19.681138+0000","last_change":"2024-03-04T12:20:14.822181+0000","last_active":"2024-03-04T13:09:19.681138+0000","last_peered":"2024-03-04T13:09:19.681138+0000","last_clean":"2024-03-04T13:09:19.681138+0000","last_became_active":"2024-03-04T12:20:14.821923+0000","last_became_peered":"2024-03-04T12:20:14.821923+0000","last_unstale":"2024-03-04T13:09:19.681138+0000","last_undegraded":"2024-03-04T13:09:19.681138+0000","last_fullsized":"2024-03-04T13:09:19.681138+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:23:35.278346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":428,"num_write":1012,"num_write_kb":16985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"255'373","reported_seq":1788,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.098146+0000","last_change":"2024-03-04T12:20:16.826907+0000","last_active":"2024-03-04T13:12:31.098146+0000","last_peered":"2024-03-04T13:12:31.098146+0000","last_clean":"2024-03-04T13:12:31.098146+0000","last_became_active":"2024-03-04T12:20:16.826208+0000","last_became_peered":"2024-03-04T12:20:16.826208+0000","last_unstale":"2024-03-04T13:12:31.098146+0000","last_undegraded":"2024-03-04T13:12:31.098146+0000","last_fullsized":"2024-03-04T13:12:31.098146+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:48:38.580682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1988,"num_read_kb":1881,"num_write":441,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"255'173","reported_seq":777,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.206884+0000","last_change":"2024-03-04T12:20:14.812110+0000","last_active":"2024-03-04T13:13:21.206884+0000","last_peered":"2024-03-04T13:13:21.206884+0000","last_clean":"2024-03-04T13:13:21.206884+0000","last_became_active":"2024-03-04T12:20:14.811813+0000","last_became_peered":"2024-03-04T12:20:14.811813+0000","last_unstale":"2024-03-04T13:13:21.206884+0000","last_undegraded":"2024-03-04T13:13:21.206884+0000","last_fullsized":"2024-03-04T13:13:21.206884+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:16:22.043018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":397,"num_read_kb":4485,"num_write":973,"num_write_kb":10922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"255'93","reported_seq":579,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:15.761317+0000","last_change":"2024-03-04T12:20:24.871376+0000","last_active":"2024-03-04T13:12:15.761317+0000","last_peered":"2024-03-04T13:12:15.761317+0000","last_clean":"2024-03-04T13:12:15.761317+0000","last_became_active":"2024-03-04T12:20:24.871089+0000","last_became_peered":"2024-03-04T12:20:24.871089+0000","last_unstale":"2024-03-04T13:12:15.761317+0000","last_undegraded":"2024-03-04T13:12:15.761317+0000","last_fullsized":"2024-03-04T13:12:15.761317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:35.987784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":97,"num_write":227,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"255'790","reported_seq":2212,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.056199+0000","last_change":"2024-03-04T12:20:16.829280+0000","last_active":"2024-03-04T13:12:18.056199+0000","last_peered":"2024-03-04T13:12:18.056199+0000","last_clean":"2024-03-04T13:12:18.056199+0000","last_became_active":"2024-03-04T12:20:16.828977+0000","last_became_peered":"2024-03-04T12:20:16.828977+0000","last_unstale":"2024-03-04T13:12:18.056199+0000","last_undegraded":"2024-03-04T13:12:18.056199+0000","last_fullsized":"2024-03-04T13:12:18.056199+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:08:11.691344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3439,"num_read_kb":3056,"num_write":1047,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"255'219","reported_seq":869,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.154310+0000","last_change":"2024-03-04T12:20:14.817012+0000","last_active":"2024-03-04T13:13:21.154310+0000","last_peered":"2024-03-04T13:13:21.154310+0000","last_clean":"2024-03-04T13:13:21.154310+0000","last_became_active":"2024-03-04T12:20:14.816722+0000","last_became_peered":"2024-03-04T12:20:14.816722+0000","last_unstale":"2024-03-04T13:13:21.154310+0000","last_undegraded":"2024-03-04T13:13:21.154310+0000","last_fullsized":"2024-03-04T13:13:21.154310+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:03:31.043930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1705735,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":471,"num_read_kb":103623,"num_write":1220,"num_write_kb":57222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.341660+0000","last_change":"2024-03-04T12:20:18.835916+0000","last_active":"2024-03-04T13:08:42.341660+0000","last_peered":"2024-03-04T13:08:42.341660+0000","last_clean":"2024-03-04T13:08:42.341660+0000","last_became_active":"2024-03-04T12:20:18.835597+0000","last_became_peered":"2024-03-04T12:20:18.835597+0000","last_unstale":"2024-03-04T13:08:42.341660+0000","last_undegraded":"2024-03-04T13:08:42.341660+0000","last_fullsized":"2024-03-04T13:08:42.341660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:45:01.355651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"255'185","reported_seq":768,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.068220+0000","last_change":"2024-03-04T12:20:20.837358+0000","last_active":"2024-03-04T13:13:21.068220+0000","last_peered":"2024-03-04T13:13:21.068220+0000","last_clean":"2024-03-04T13:13:21.068220+0000","last_became_active":"2024-03-04T12:20:20.837048+0000","last_became_peered":"2024-03-04T12:20:20.837048+0000","last_unstale":"2024-03-04T13:13:21.068220+0000","last_undegraded":"2024-03-04T13:13:21.068220+0000","last_fullsized":"2024-03-04T13:13:21.068220+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:43:04.505643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":254,"num_read_kb":315,"num_write":146,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.483022+0000","last_change":"2024-03-04T12:20:22.852800+0000","last_active":"2024-03-04T13:08:42.483022+0000","last_peered":"2024-03-04T13:08:42.483022+0000","last_clean":"2024-03-04T13:08:42.483022+0000","last_became_active":"2024-03-04T12:20:22.852461+0000","last_became_peered":"2024-03-04T12:20:22.852461+0000","last_unstale":"2024-03-04T13:08:42.483022+0000","last_undegraded":"2024-03-04T13:08:42.483022+0000","last_fullsized":"2024-03-04T13:08:42.483022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:03:51.860258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"255'2372","reported_seq":4166,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.462461+0000","last_change":"2024-03-04T12:20:24.869696+0000","last_active":"2024-03-04T13:13:12.462461+0000","last_peered":"2024-03-04T13:13:12.462461+0000","last_clean":"2024-03-04T13:13:12.462461+0000","last_became_active":"2024-03-04T12:20:24.869395+0000","last_became_peered":"2024-03-04T12:20:24.869395+0000","last_unstale":"2024-03-04T13:13:12.462461+0000","last_undegraded":"2024-03-04T13:13:12.462461+0000","last_fullsized":"2024-03-04T13:13:12.462461+0000","mapping_epoch":30,"log_start":"255'2300","ondisk_log_start":"255'2300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":2300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:18:14.602967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5943,"num_read_kb":5935,"num_write":4730,"num_write_kb":1746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"255'345","reported_seq":1811,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.571922+0000","last_change":"2024-03-04T12:20:16.829693+0000","last_active":"2024-03-04T13:12:50.571922+0000","last_peered":"2024-03-04T13:12:50.571922+0000","last_clean":"2024-03-04T13:12:50.571922+0000","last_became_active":"2024-03-04T12:20:16.829441+0000","last_became_peered":"2024-03-04T12:20:16.829441+0000","last_unstale":"2024-03-04T13:12:50.571922+0000","last_undegraded":"2024-03-04T13:12:50.571922+0000","last_fullsized":"2024-03-04T13:12:50.571922+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:15:29.713063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2107,"num_read_kb":2006,"num_write":408,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"255'161","reported_seq":724,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.007166+0000","last_change":"2024-03-04T12:20:14.819912+0000","last_active":"2024-03-04T13:13:21.007166+0000","last_peered":"2024-03-04T13:13:21.007166+0000","last_clean":"2024-03-04T13:13:21.007166+0000","last_became_active":"2024-03-04T12:20:14.819559+0000","last_became_peered":"2024-03-04T12:20:14.819559+0000","last_unstale":"2024-03-04T13:13:21.007166+0000","last_undegraded":"2024-03-04T13:13:21.007166+0000","last_fullsized":"2024-03-04T13:13:21.007166+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:48:45.189022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":323,"num_read_kb":7587,"num_write":849,"num_write_kb":22276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:27.446912+0000","last_change":"2024-03-04T12:20:18.834062+0000","last_active":"2024-03-04T13:09:27.446912+0000","last_peered":"2024-03-04T13:09:27.446912+0000","last_clean":"2024-03-04T13:09:27.446912+0000","last_became_active":"2024-03-04T12:20:18.833470+0000","last_became_peered":"2024-03-04T12:20:18.833470+0000","last_unstale":"2024-03-04T13:09:27.446912+0000","last_undegraded":"2024-03-04T13:09:27.446912+0000","last_fullsized":"2024-03-04T13:09:27.446912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:12.993503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"255'77","reported_seq":593,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.519703+0000","last_change":"2024-03-04T12:20:20.838187+0000","last_active":"2024-03-04T13:10:53.519703+0000","last_peered":"2024-03-04T13:10:53.519703+0000","last_clean":"2024-03-04T13:10:53.519703+0000","last_became_active":"2024-03-04T12:20:20.837905+0000","last_became_peered":"2024-03-04T12:20:20.837905+0000","last_unstale":"2024-03-04T13:10:53.519703+0000","last_undegraded":"2024-03-04T13:10:53.519703+0000","last_fullsized":"2024-03-04T13:10:53.519703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:44:38.381403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.482996+0000","last_change":"2024-03-04T12:20:22.849051+0000","last_active":"2024-03-04T13:08:42.482996+0000","last_peered":"2024-03-04T13:08:42.482996+0000","last_clean":"2024-03-04T13:08:42.482996+0000","last_became_active":"2024-03-04T12:20:22.848773+0000","last_became_peered":"2024-03-04T12:20:22.848773+0000","last_unstale":"2024-03-04T13:08:42.482996+0000","last_undegraded":"2024-03-04T13:08:42.482996+0000","last_fullsized":"2024-03-04T13:08:42.482996+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:55:51.999361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"255'116","reported_seq":607,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:28.660007+0000","last_change":"2024-03-04T12:20:24.869138+0000","last_active":"2024-03-04T13:11:28.660007+0000","last_peered":"2024-03-04T13:11:28.660007+0000","last_clean":"2024-03-04T13:11:28.660007+0000","last_became_active":"2024-03-04T12:20:24.868746+0000","last_became_peered":"2024-03-04T12:20:24.868746+0000","last_unstale":"2024-03-04T13:11:28.660007+0000","last_undegraded":"2024-03-04T13:11:28.660007+0000","last_fullsized":"2024-03-04T13:11:28.660007+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:03:02.799287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"255'390","reported_seq":1881,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573222+0000","last_change":"2024-03-04T12:20:16.829905+0000","last_active":"2024-03-04T13:12:50.573222+0000","last_peered":"2024-03-04T13:12:50.573222+0000","last_clean":"2024-03-04T13:12:50.573222+0000","last_became_active":"2024-03-04T12:20:16.829641+0000","last_became_peered":"2024-03-04T12:20:16.829641+0000","last_unstale":"2024-03-04T13:12:50.573222+0000","last_undegraded":"2024-03-04T13:12:50.573222+0000","last_fullsized":"2024-03-04T13:12:50.573222+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:38:20.140291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2147,"num_read_kb":2039,"num_write":462,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"255'144","reported_seq":758,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:37.512605+0000","last_change":"2024-03-04T12:20:14.817840+0000","last_active":"2024-03-04T13:11:37.512605+0000","last_peered":"2024-03-04T13:11:37.512605+0000","last_clean":"2024-03-04T13:11:37.512605+0000","last_became_active":"2024-03-04T12:20:14.817556+0000","last_became_peered":"2024-03-04T12:20:14.817556+0000","last_unstale":"2024-03-04T13:11:37.512605+0000","last_undegraded":"2024-03-04T13:11:37.512605+0000","last_fullsized":"2024-03-04T13:11:37.512605+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:38.563036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524480,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":366,"num_read_kb":1564,"num_write":822,"num_write_kb":17292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.442244+0000","last_change":"2024-03-04T12:20:18.836217+0000","last_active":"2024-03-04T13:08:42.442244+0000","last_peered":"2024-03-04T13:08:42.442244+0000","last_clean":"2024-03-04T13:08:42.442244+0000","last_became_active":"2024-03-04T12:20:18.835760+0000","last_became_peered":"2024-03-04T12:20:18.835760+0000","last_unstale":"2024-03-04T13:08:42.442244+0000","last_undegraded":"2024-03-04T13:08:42.442244+0000","last_fullsized":"2024-03-04T13:08:42.442244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:42:21.998349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"255'113","reported_seq":638,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.692750+0000","last_change":"2024-03-04T12:20:20.838715+0000","last_active":"2024-03-04T13:10:53.692750+0000","last_peered":"2024-03-04T13:10:53.692750+0000","last_clean":"2024-03-04T13:10:53.692750+0000","last_became_active":"2024-03-04T12:20:20.838094+0000","last_became_peered":"2024-03-04T12:20:20.838094+0000","last_unstale":"2024-03-04T13:10:53.692750+0000","last_undegraded":"2024-03-04T13:10:53.692750+0000","last_fullsized":"2024-03-04T13:10:53.692750+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:31.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":129,"num_write":92,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"255'502","reported_seq":1929,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.004248+0000","last_change":"2024-03-04T12:20:22.851329+0000","last_active":"2024-03-04T13:13:21.004248+0000","last_peered":"2024-03-04T13:13:21.004248+0000","last_clean":"2024-03-04T13:13:21.004248+0000","last_became_active":"2024-03-04T12:20:22.851062+0000","last_became_peered":"2024-03-04T12:20:22.851062+0000","last_unstale":"2024-03-04T13:13:21.004248+0000","last_undegraded":"2024-03-04T13:13:21.004248+0000","last_fullsized":"2024-03-04T13:13:21.004248+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:10.088059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"255'137","reported_seq":615,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:20.402198+0000","last_change":"2024-03-04T12:20:24.912322+0000","last_active":"2024-03-04T13:12:20.402198+0000","last_peered":"2024-03-04T13:12:20.402198+0000","last_clean":"2024-03-04T13:12:20.402198+0000","last_became_active":"2024-03-04T12:20:24.912068+0000","last_became_peered":"2024-03-04T12:20:24.912068+0000","last_unstale":"2024-03-04T13:12:20.402198+0000","last_undegraded":"2024-03-04T13:12:20.402198+0000","last_fullsized":"2024-03-04T13:12:20.402198+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:30:34.171289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":66,"num_write":291,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"255'856","reported_seq":2536,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.954099+0000","last_change":"2024-03-04T12:20:16.831420+0000","last_active":"2024-03-04T13:12:36.954099+0000","last_peered":"2024-03-04T13:12:36.954099+0000","last_clean":"2024-03-04T13:12:36.954099+0000","last_became_active":"2024-03-04T12:20:16.831039+0000","last_became_peered":"2024-03-04T12:20:16.831039+0000","last_unstale":"2024-03-04T13:12:36.954099+0000","last_undegraded":"2024-03-04T13:12:36.954099+0000","last_fullsized":"2024-03-04T13:12:36.954099+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:45:56.296756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4009,"num_read_kb":3592,"num_write":1144,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"255'195","reported_seq":798,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.172515+0000","last_change":"2024-03-04T12:20:14.818137+0000","last_active":"2024-03-04T13:13:21.172515+0000","last_peered":"2024-03-04T13:13:21.172515+0000","last_clean":"2024-03-04T13:13:21.172515+0000","last_became_active":"2024-03-04T12:20:14.817863+0000","last_became_peered":"2024-03-04T12:20:14.817863+0000","last_unstale":"2024-03-04T13:13:21.172515+0000","last_undegraded":"2024-03-04T13:13:21.172515+0000","last_fullsized":"2024-03-04T13:13:21.172515+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:33:32.762020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9161812,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":19635,"num_write":1198,"num_write_kb":36958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"32'4","reported_seq":792,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.703405+0000","last_change":"2024-03-04T12:20:18.838746+0000","last_active":"2024-03-04T13:13:20.703405+0000","last_peered":"2024-03-04T13:13:20.703405+0000","last_clean":"2024-03-04T13:13:20.703405+0000","last_became_active":"2024-03-04T12:20:18.838266+0000","last_became_peered":"2024-03-04T12:20:18.838266+0000","last_unstale":"2024-03-04T13:13:20.703405+0000","last_undegraded":"2024-03-04T13:13:20.703405+0000","last_fullsized":"2024-03-04T13:13:20.703405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:40:00.829417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":466,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"255'129","reported_seq":693,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.027522+0000","last_change":"2024-03-04T12:20:21.643825+0000","last_active":"2024-03-04T13:13:21.027522+0000","last_peered":"2024-03-04T13:13:21.027522+0000","last_clean":"2024-03-04T13:13:21.027522+0000","last_became_active":"2024-03-04T12:20:21.643542+0000","last_became_peered":"2024-03-04T12:20:21.643542+0000","last_unstale":"2024-03-04T13:13:21.027522+0000","last_undegraded":"2024-03-04T13:13:21.027522+0000","last_fullsized":"2024-03-04T13:13:21.027522+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:37.997080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9148,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":181,"num_read_kb":265,"num_write":100,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"255'530","reported_seq":1912,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.939056+0000","last_change":"2024-03-04T12:20:22.858901+0000","last_active":"2024-03-04T13:13:20.939056+0000","last_peered":"2024-03-04T13:13:20.939056+0000","last_clean":"2024-03-04T13:13:20.939056+0000","last_became_active":"2024-03-04T12:20:22.858575+0000","last_became_peered":"2024-03-04T12:20:22.858575+0000","last_unstale":"2024-03-04T13:13:20.939056+0000","last_undegraded":"2024-03-04T13:13:20.939056+0000","last_fullsized":"2024-03-04T13:13:20.939056+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:54:58.667292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"255'391","reported_seq":1796,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:40.169266+0000","last_change":"2024-03-04T12:20:16.830920+0000","last_active":"2024-03-04T13:11:40.169266+0000","last_peered":"2024-03-04T13:11:40.169266+0000","last_clean":"2024-03-04T13:11:40.169266+0000","last_became_active":"2024-03-04T12:20:16.830531+0000","last_became_peered":"2024-03-04T12:20:16.830531+0000","last_unstale":"2024-03-04T13:11:40.169266+0000","last_undegraded":"2024-03-04T13:11:40.169266+0000","last_fullsized":"2024-03-04T13:11:40.169266+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:40:48.153427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2065,"num_write":498,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"255'174","reported_seq":849,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.101751+0000","last_change":"2024-03-04T12:20:14.818724+0000","last_active":"2024-03-04T13:13:21.101751+0000","last_peered":"2024-03-04T13:13:21.101751+0000","last_clean":"2024-03-04T13:13:21.101751+0000","last_became_active":"2024-03-04T12:20:14.818441+0000","last_became_peered":"2024-03-04T12:20:14.818441+0000","last_unstale":"2024-03-04T13:13:21.101751+0000","last_undegraded":"2024-03-04T13:13:21.101751+0000","last_fullsized":"2024-03-04T13:13:21.101751+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:15.961414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10526962,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":524,"num_read_kb":158242,"num_write":986,"num_write_kb":38243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":492,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497846+0000","last_change":"2024-03-04T12:20:18.832672+0000","last_active":"2024-03-04T13:10:12.497846+0000","last_peered":"2024-03-04T13:10:12.497846+0000","last_clean":"2024-03-04T13:10:12.497846+0000","last_became_active":"2024-03-04T12:20:18.832349+0000","last_became_peered":"2024-03-04T12:20:18.832349+0000","last_unstale":"2024-03-04T13:10:12.497846+0000","last_undegraded":"2024-03-04T13:10:12.497846+0000","last_fullsized":"2024-03-04T13:10:12.497846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:17.354349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"255'217","reported_seq":821,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.104550+0000","last_change":"2024-03-04T12:20:21.642137+0000","last_active":"2024-03-04T13:13:21.104550+0000","last_peered":"2024-03-04T13:13:21.104550+0000","last_clean":"2024-03-04T13:13:21.104550+0000","last_became_active":"2024-03-04T12:20:21.641749+0000","last_became_peered":"2024-03-04T12:20:21.641749+0000","last_unstale":"2024-03-04T13:13:21.104550+0000","last_undegraded":"2024-03-04T13:13:21.104550+0000","last_fullsized":"2024-03-04T13:13:21.104550+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:33:09.469358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6571,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":304,"num_read_kb":381,"num_write":178,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":477,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.540203+0000","last_change":"2024-03-04T12:20:22.852908+0000","last_active":"2024-03-04T13:09:52.540203+0000","last_peered":"2024-03-04T13:09:52.540203+0000","last_clean":"2024-03-04T13:09:52.540203+0000","last_became_active":"2024-03-04T12:20:22.852612+0000","last_became_peered":"2024-03-04T12:20:22.852612+0000","last_unstale":"2024-03-04T13:09:52.540203+0000","last_undegraded":"2024-03-04T13:09:52.540203+0000","last_fullsized":"2024-03-04T13:09:52.540203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:41:53.817861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"255'523","reported_seq":1316,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.165868+0000","last_change":"2024-03-04T12:20:24.869764+0000","last_active":"2024-03-04T13:13:14.165868+0000","last_peered":"2024-03-04T13:13:14.165868+0000","last_clean":"2024-03-04T13:13:14.165868+0000","last_became_active":"2024-03-04T12:20:24.869409+0000","last_became_peered":"2024-03-04T12:20:24.869409+0000","last_unstale":"2024-03-04T13:13:14.165868+0000","last_undegraded":"2024-03-04T13:13:14.165868+0000","last_fullsized":"2024-03-04T13:13:14.165868+0000","mapping_epoch":30,"log_start":"255'500","ondisk_log_start":"255'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:47:48.263171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1237,"num_read_kb":1237,"num_write":1069,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"255'315","reported_seq":1782,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573805+0000","last_change":"2024-03-04T12:20:16.826445+0000","last_active":"2024-03-04T13:12:50.573805+0000","last_peered":"2024-03-04T13:12:50.573805+0000","last_clean":"2024-03-04T13:12:50.573805+0000","last_became_active":"2024-03-04T12:20:16.826183+0000","last_became_peered":"2024-03-04T12:20:16.826183+0000","last_unstale":"2024-03-04T13:12:50.573805+0000","last_undegraded":"2024-03-04T13:12:50.573805+0000","last_fullsized":"2024-03-04T13:12:50.573805+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:57:50.116407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2023,"num_read_kb":1945,"num_write":353,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"255'180","reported_seq":810,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.137408+0000","last_change":"2024-03-04T12:20:14.819684+0000","last_active":"2024-03-04T13:13:21.137408+0000","last_peered":"2024-03-04T13:13:21.137408+0000","last_clean":"2024-03-04T13:13:21.137408+0000","last_became_active":"2024-03-04T12:20:14.819389+0000","last_became_peered":"2024-03-04T12:20:14.819389+0000","last_unstale":"2024-03-04T13:13:21.137408+0000","last_undegraded":"2024-03-04T13:13:21.137408+0000","last_fullsized":"2024-03-04T13:13:21.137408+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:30:11.677107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":382,"num_read_kb":37991,"num_write":1066,"num_write_kb":16641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":486,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.439917+0000","last_change":"2024-03-04T12:20:18.834899+0000","last_active":"2024-03-04T13:10:12.439917+0000","last_peered":"2024-03-04T13:10:12.439917+0000","last_clean":"2024-03-04T13:10:12.439917+0000","last_became_active":"2024-03-04T12:20:18.834619+0000","last_became_peered":"2024-03-04T12:20:18.834619+0000","last_unstale":"2024-03-04T13:10:12.439917+0000","last_undegraded":"2024-03-04T13:10:12.439917+0000","last_fullsized":"2024-03-04T13:10:12.439917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:42:40.542910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"255'129","reported_seq":684,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.202231+0000","last_change":"2024-03-04T12:20:20.843676+0000","last_active":"2024-03-04T13:13:21.202231+0000","last_peered":"2024-03-04T13:13:21.202231+0000","last_clean":"2024-03-04T13:13:21.202231+0000","last_became_active":"2024-03-04T12:20:20.843195+0000","last_became_peered":"2024-03-04T12:20:20.843195+0000","last_unstale":"2024-03-04T13:13:21.202231+0000","last_undegraded":"2024-03-04T13:13:21.202231+0000","last_fullsized":"2024-03-04T13:13:21.202231+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:56:20.314287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":216,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":474,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.452976+0000","last_change":"2024-03-04T12:20:22.859027+0000","last_active":"2024-03-04T13:10:17.452976+0000","last_peered":"2024-03-04T13:10:17.452976+0000","last_clean":"2024-03-04T13:10:17.452976+0000","last_became_active":"2024-03-04T12:20:22.858722+0000","last_became_peered":"2024-03-04T12:20:22.858722+0000","last_unstale":"2024-03-04T13:10:17.452976+0000","last_undegraded":"2024-03-04T13:10:17.452976+0000","last_fullsized":"2024-03-04T13:10:17.452976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:18:20.285059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"255'182","reported_seq":703,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:17.325728+0000","last_change":"2024-03-04T12:20:24.869476+0000","last_active":"2024-03-04T13:11:17.325728+0000","last_peered":"2024-03-04T13:11:17.325728+0000","last_clean":"2024-03-04T13:11:17.325728+0000","last_became_active":"2024-03-04T12:20:24.869152+0000","last_became_peered":"2024-03-04T12:20:24.869152+0000","last_unstale":"2024-03-04T13:11:17.325728+0000","last_undegraded":"2024-03-04T13:11:17.325728+0000","last_fullsized":"2024-03-04T13:11:17.325728+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:21.486498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":286,"num_read_kb":243,"num_write":358,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"255'1227","reported_seq":2769,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.767503+0000","last_change":"2024-03-04T12:20:16.826525+0000","last_active":"2024-03-04T13:12:12.767503+0000","last_peered":"2024-03-04T13:12:12.767503+0000","last_clean":"2024-03-04T13:12:12.767503+0000","last_became_active":"2024-03-04T12:20:16.826172+0000","last_became_peered":"2024-03-04T12:20:16.826172+0000","last_unstale":"2024-03-04T13:12:12.767503+0000","last_undegraded":"2024-03-04T13:12:12.767503+0000","last_fullsized":"2024-03-04T13:12:12.767503+0000","mapping_epoch":22,"log_start":"255'1200","ondisk_log_start":"255'1200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:12:29.317623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5093,"num_read_kb":4391,"num_write":1710,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"255'179","reported_seq":838,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.059570+0000","last_change":"2024-03-04T12:20:14.828602+0000","last_active":"2024-03-04T13:13:21.059570+0000","last_peered":"2024-03-04T13:13:21.059570+0000","last_clean":"2024-03-04T13:13:21.059570+0000","last_became_active":"2024-03-04T12:20:14.828250+0000","last_became_peered":"2024-03-04T12:20:14.828250+0000","last_unstale":"2024-03-04T13:13:21.059570+0000","last_undegraded":"2024-03-04T13:13:21.059570+0000","last_fullsized":"2024-03-04T13:13:21.059570+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:46.934324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22063,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":10895,"num_write":937,"num_write_kb":21474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.437970+0000","last_change":"2024-03-04T12:20:18.835161+0000","last_active":"2024-03-04T13:09:52.437970+0000","last_peered":"2024-03-04T13:09:52.437970+0000","last_clean":"2024-03-04T13:09:52.437970+0000","last_became_active":"2024-03-04T12:20:18.834897+0000","last_became_peered":"2024-03-04T12:20:18.834897+0000","last_unstale":"2024-03-04T13:09:52.437970+0000","last_undegraded":"2024-03-04T13:09:52.437970+0000","last_fullsized":"2024-03-04T13:09:52.437970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:23:32.729578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"255'162","reported_seq":746,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.117978+0000","last_change":"2024-03-04T12:20:20.839989+0000","last_active":"2024-03-04T13:13:21.117978+0000","last_peered":"2024-03-04T13:13:21.117978+0000","last_clean":"2024-03-04T13:13:21.117978+0000","last_became_active":"2024-03-04T12:20:20.839295+0000","last_became_peered":"2024-03-04T12:20:20.839295+0000","last_unstale":"2024-03-04T13:13:21.117978+0000","last_undegraded":"2024-03-04T13:13:21.117978+0000","last_fullsized":"2024-03-04T13:13:21.117978+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:08:54.656704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":221,"num_read_kb":283,"num_write":122,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"255'515","reported_seq":1896,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.939978+0000","last_change":"2024-03-04T12:20:22.852803+0000","last_active":"2024-03-04T13:13:20.939978+0000","last_peered":"2024-03-04T13:13:20.939978+0000","last_clean":"2024-03-04T13:13:20.939978+0000","last_became_active":"2024-03-04T12:20:22.852529+0000","last_became_peered":"2024-03-04T12:20:22.852529+0000","last_unstale":"2024-03-04T13:13:20.939978+0000","last_undegraded":"2024-03-04T13:13:20.939978+0000","last_fullsized":"2024-03-04T13:13:20.939978+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:41:17.465191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"255'110","reported_seq":578,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:26.130806+0000","last_change":"2024-03-04T12:20:24.868355+0000","last_active":"2024-03-04T13:11:26.130806+0000","last_peered":"2024-03-04T13:11:26.130806+0000","last_clean":"2024-03-04T13:11:26.130806+0000","last_became_active":"2024-03-04T12:20:24.868076+0000","last_became_peered":"2024-03-04T12:20:24.868076+0000","last_unstale":"2024-03-04T13:11:26.130806+0000","last_undegraded":"2024-03-04T13:11:26.130806+0000","last_fullsized":"2024-03-04T13:11:26.130806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:52.616216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"255'360","reported_seq":1757,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.430573+0000","last_change":"2024-03-04T12:20:16.829010+0000","last_active":"2024-03-04T13:12:39.430573+0000","last_peered":"2024-03-04T13:12:39.430573+0000","last_clean":"2024-03-04T13:12:39.430573+0000","last_became_active":"2024-03-04T12:20:16.828738+0000","last_became_peered":"2024-03-04T12:20:16.828738+0000","last_unstale":"2024-03-04T13:12:39.430573+0000","last_undegraded":"2024-03-04T13:12:39.430573+0000","last_fullsized":"2024-03-04T13:12:39.430573+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:50:10.406480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1878,"num_read_kb":1794,"num_write":404,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"255'280","reported_seq":1007,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.196031+0000","last_change":"2024-03-04T12:20:14.824611+0000","last_active":"2024-03-04T13:13:21.196031+0000","last_peered":"2024-03-04T13:13:21.196031+0000","last_clean":"2024-03-04T13:13:21.196031+0000","last_became_active":"2024-03-04T12:20:14.824192+0000","last_became_peered":"2024-03-04T12:20:14.824192+0000","last_unstale":"2024-03-04T13:13:21.196031+0000","last_undegraded":"2024-03-04T13:13:21.196031+0000","last_fullsized":"2024-03-04T13:13:21.196031+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:58:08.994156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":790,"num_read_kb":21513,"num_write":1394,"num_write_kb":41658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":486,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.440425+0000","last_change":"2024-03-04T12:20:18.832777+0000","last_active":"2024-03-04T13:10:17.440425+0000","last_peered":"2024-03-04T13:10:17.440425+0000","last_clean":"2024-03-04T13:10:17.440425+0000","last_became_active":"2024-03-04T12:20:18.832483+0000","last_became_peered":"2024-03-04T12:20:18.832483+0000","last_unstale":"2024-03-04T13:10:17.440425+0000","last_undegraded":"2024-03-04T13:10:17.440425+0000","last_fullsized":"2024-03-04T13:10:17.440425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:14.119980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"255'190","reported_seq":804,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.224040+0000","last_change":"2024-03-04T12:20:20.838146+0000","last_active":"2024-03-04T13:13:21.224040+0000","last_peered":"2024-03-04T13:13:21.224040+0000","last_clean":"2024-03-04T13:13:21.224040+0000","last_became_active":"2024-03-04T12:20:20.837748+0000","last_became_peered":"2024-03-04T12:20:20.837748+0000","last_unstale":"2024-03-04T13:13:21.224040+0000","last_undegraded":"2024-03-04T13:13:21.224040+0000","last_fullsized":"2024-03-04T13:13:21.224040+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:22:00.778993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13702,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":270,"num_read_kb":346,"num_write":130,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":478,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.439897+0000","last_change":"2024-03-04T12:20:22.850065+0000","last_active":"2024-03-04T13:10:12.439897+0000","last_peered":"2024-03-04T13:10:12.439897+0000","last_clean":"2024-03-04T13:10:12.439897+0000","last_became_active":"2024-03-04T12:20:22.849784+0000","last_became_peered":"2024-03-04T12:20:22.849784+0000","last_unstale":"2024-03-04T13:10:12.439897+0000","last_undegraded":"2024-03-04T13:10:12.439897+0000","last_fullsized":"2024-03-04T13:10:12.439897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:29:20.336237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"255'99","reported_seq":608,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.080830+0000","last_change":"2024-03-04T12:20:24.865119+0000","last_active":"2024-03-04T13:12:18.080830+0000","last_peered":"2024-03-04T13:12:18.080830+0000","last_clean":"2024-03-04T13:12:18.080830+0000","last_became_active":"2024-03-04T12:20:24.864820+0000","last_became_peered":"2024-03-04T12:20:24.864820+0000","last_unstale":"2024-03-04T13:12:18.080830+0000","last_undegraded":"2024-03-04T13:12:18.080830+0000","last_fullsized":"2024-03-04T13:12:18.080830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:32:18.059621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":165,"num_write":238,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"255'1121","reported_seq":2623,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:15.756787+0000","last_change":"2024-03-04T12:20:16.828787+0000","last_active":"2024-03-04T13:12:15.756787+0000","last_peered":"2024-03-04T13:12:15.756787+0000","last_clean":"2024-03-04T13:12:15.756787+0000","last_became_active":"2024-03-04T12:20:16.828486+0000","last_became_peered":"2024-03-04T12:20:16.828486+0000","last_unstale":"2024-03-04T13:12:15.756787+0000","last_undegraded":"2024-03-04T13:12:15.756787+0000","last_fullsized":"2024-03-04T13:12:15.756787+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:11:58.117667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4686,"num_read_kb":4085,"num_write":1549,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"255'242","reported_seq":877,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.005697+0000","last_change":"2024-03-04T12:20:14.817073+0000","last_active":"2024-03-04T13:13:21.005697+0000","last_peered":"2024-03-04T13:13:21.005697+0000","last_clean":"2024-03-04T13:13:21.005697+0000","last_became_active":"2024-03-04T12:20:14.816412+0000","last_became_peered":"2024-03-04T12:20:14.816412+0000","last_unstale":"2024-03-04T13:13:21.005697+0000","last_undegraded":"2024-03-04T13:13:21.005697+0000","last_fullsized":"2024-03-04T13:13:21.005697+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:58:05.576367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399147,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":515,"num_read_kb":1880,"num_write":1395,"num_write_kb":20590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.437990+0000","last_change":"2024-03-04T12:20:18.831057+0000","last_active":"2024-03-04T13:09:52.437990+0000","last_peered":"2024-03-04T13:09:52.437990+0000","last_clean":"2024-03-04T13:09:52.437990+0000","last_became_active":"2024-03-04T12:20:18.830763+0000","last_became_peered":"2024-03-04T12:20:18.830763+0000","last_unstale":"2024-03-04T13:09:52.437990+0000","last_undegraded":"2024-03-04T13:09:52.437990+0000","last_fullsized":"2024-03-04T13:09:52.437990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:07:14.625882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"255'156","reported_seq":725,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.229852+0000","last_change":"2024-03-04T12:20:20.842557+0000","last_active":"2024-03-04T13:13:21.229852+0000","last_peered":"2024-03-04T13:13:21.229852+0000","last_clean":"2024-03-04T13:13:21.229852+0000","last_became_active":"2024-03-04T12:20:20.842216+0000","last_became_peered":"2024-03-04T12:20:20.842216+0000","last_unstale":"2024-03-04T13:13:21.229852+0000","last_undegraded":"2024-03-04T13:13:21.229852+0000","last_fullsized":"2024-03-04T13:13:21.229852+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:02:08.824556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7566,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":219,"num_read_kb":283,"num_write":166,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":471,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:57.443894+0000","last_change":"2024-03-04T12:20:22.855807+0000","last_active":"2024-03-04T13:09:57.443894+0000","last_peered":"2024-03-04T13:09:57.443894+0000","last_clean":"2024-03-04T13:09:57.443894+0000","last_became_active":"2024-03-04T12:20:22.855480+0000","last_became_peered":"2024-03-04T12:20:22.855480+0000","last_unstale":"2024-03-04T13:09:57.443894+0000","last_undegraded":"2024-03-04T13:09:57.443894+0000","last_fullsized":"2024-03-04T13:09:57.443894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:21:14.052483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"255'88","reported_seq":562,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.454648+0000","last_change":"2024-03-04T12:20:24.865258+0000","last_active":"2024-03-04T13:10:32.454648+0000","last_peered":"2024-03-04T13:10:32.454648+0000","last_clean":"2024-03-04T13:10:32.454648+0000","last_became_active":"2024-03-04T12:20:24.864982+0000","last_became_peered":"2024-03-04T12:20:24.864982+0000","last_unstale":"2024-03-04T13:10:32.454648+0000","last_undegraded":"2024-03-04T13:10:32.454648+0000","last_fullsized":"2024-03-04T13:10:32.454648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:45:57.341191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":209,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"255'386","reported_seq":1736,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573507+0000","last_change":"2024-03-04T12:20:16.826836+0000","last_active":"2024-03-04T13:12:50.573507+0000","last_peered":"2024-03-04T13:12:50.573507+0000","last_clean":"2024-03-04T13:12:50.573507+0000","last_became_active":"2024-03-04T12:20:16.824033+0000","last_became_peered":"2024-03-04T12:20:16.824033+0000","last_unstale":"2024-03-04T13:12:50.573507+0000","last_undegraded":"2024-03-04T13:12:50.573507+0000","last_fullsized":"2024-03-04T13:12:50.573507+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:20:02.860419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1899,"num_read_kb":1781,"num_write":448,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"255'222","reported_seq":837,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.173651+0000","last_change":"2024-03-04T12:20:14.818954+0000","last_active":"2024-03-04T13:13:21.173651+0000","last_peered":"2024-03-04T13:13:21.173651+0000","last_clean":"2024-03-04T13:13:21.173651+0000","last_became_active":"2024-03-04T12:20:14.818461+0000","last_became_peered":"2024-03-04T12:20:14.818461+0000","last_unstale":"2024-03-04T13:13:21.173651+0000","last_undegraded":"2024-03-04T13:13:21.173651+0000","last_fullsized":"2024-03-04T13:13:21.173651+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:54:12.327719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":446,"num_read_kb":17082,"num_write":1054,"num_write_kb":47848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.540225+0000","last_change":"2024-03-04T12:20:18.837780+0000","last_active":"2024-03-04T13:09:52.540225+0000","last_peered":"2024-03-04T13:09:52.540225+0000","last_clean":"2024-03-04T13:09:52.540225+0000","last_became_active":"2024-03-04T12:20:18.837494+0000","last_became_peered":"2024-03-04T12:20:18.837494+0000","last_unstale":"2024-03-04T13:09:52.540225+0000","last_undegraded":"2024-03-04T13:09:52.540225+0000","last_fullsized":"2024-03-04T13:09:52.540225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:44:36.195379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"255'172","reported_seq":749,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.185293+0000","last_change":"2024-03-04T12:20:20.842124+0000","last_active":"2024-03-04T13:13:21.185293+0000","last_peered":"2024-03-04T13:13:21.185293+0000","last_clean":"2024-03-04T13:13:21.185293+0000","last_became_active":"2024-03-04T12:20:20.841801+0000","last_became_peered":"2024-03-04T12:20:20.841801+0000","last_unstale":"2024-03-04T13:13:21.185293+0000","last_undegraded":"2024-03-04T13:13:21.185293+0000","last_fullsized":"2024-03-04T13:13:21.185293+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:24.485585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7601,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":303,"num_write":134,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"255'492","reported_seq":1885,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.936078+0000","last_change":"2024-03-04T12:20:22.857881+0000","last_active":"2024-03-04T13:13:20.936078+0000","last_peered":"2024-03-04T13:13:20.936078+0000","last_clean":"2024-03-04T13:13:20.936078+0000","last_became_active":"2024-03-04T12:20:22.857578+0000","last_became_peered":"2024-03-04T12:20:22.857578+0000","last_unstale":"2024-03-04T13:13:20.936078+0000","last_undegraded":"2024-03-04T13:13:20.936078+0000","last_fullsized":"2024-03-04T13:13:20.936078+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:27:44.703793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"255'108","reported_seq":590,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.581000+0000","last_change":"2024-03-04T12:20:24.867786+0000","last_active":"2024-03-04T13:12:22.581000+0000","last_peered":"2024-03-04T13:12:22.581000+0000","last_clean":"2024-03-04T13:12:22.581000+0000","last_became_active":"2024-03-04T12:20:24.867482+0000","last_became_peered":"2024-03-04T12:20:24.867482+0000","last_unstale":"2024-03-04T13:12:22.581000+0000","last_undegraded":"2024-03-04T13:12:22.581000+0000","last_fullsized":"2024-03-04T13:12:22.581000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:09:06.813366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":731,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":256,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"255'343","reported_seq":1943,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.059046+0000","last_change":"2024-03-04T12:20:16.819106+0000","last_active":"2024-03-04T13:12:18.059046+0000","last_peered":"2024-03-04T13:12:18.059046+0000","last_clean":"2024-03-04T13:12:18.059046+0000","last_became_active":"2024-03-04T12:20:16.818795+0000","last_became_peered":"2024-03-04T12:20:16.818795+0000","last_unstale":"2024-03-04T13:12:18.059046+0000","last_undegraded":"2024-03-04T13:12:18.059046+0000","last_fullsized":"2024-03-04T13:12:18.059046+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:29.845769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2162,"num_read_kb":2105,"num_write":376,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"255'220","reported_seq":839,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.207201+0000","last_change":"2024-03-04T12:20:14.818157+0000","last_active":"2024-03-04T13:13:21.207201+0000","last_peered":"2024-03-04T13:13:21.207201+0000","last_clean":"2024-03-04T13:13:21.207201+0000","last_became_active":"2024-03-04T12:20:14.817859+0000","last_became_peered":"2024-03-04T12:20:14.817859+0000","last_unstale":"2024-03-04T13:13:21.207201+0000","last_undegraded":"2024-03-04T13:13:21.207201+0000","last_fullsized":"2024-03-04T13:13:21.207201+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:00.268672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":387,"num_read_kb":14098,"num_write":1105,"num_write_kb":34013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":1101,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.713803+0000","last_change":"2024-03-04T12:20:18.839281+0000","last_active":"2024-03-04T13:13:20.713803+0000","last_peered":"2024-03-04T13:13:20.713803+0000","last_clean":"2024-03-04T13:13:20.713803+0000","last_became_active":"2024-03-04T12:20:18.838389+0000","last_became_peered":"2024-03-04T12:20:18.838389+0000","last_unstale":"2024-03-04T13:13:20.713803+0000","last_undegraded":"2024-03-04T13:13:20.713803+0000","last_fullsized":"2024-03-04T13:13:20.713803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:57.735142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":615,"num_read_kb":615,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"255'101","reported_seq":608,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.392687+0000","last_change":"2024-03-04T12:20:21.642158+0000","last_active":"2024-03-04T13:10:53.392687+0000","last_peered":"2024-03-04T13:10:53.392687+0000","last_clean":"2024-03-04T13:10:53.392687+0000","last_became_active":"2024-03-04T12:20:21.641809+0000","last_became_peered":"2024-03-04T12:20:21.641809+0000","last_unstale":"2024-03-04T13:10:53.392687+0000","last_undegraded":"2024-03-04T13:10:53.392687+0000","last_fullsized":"2024-03-04T13:10:53.392687+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:46:54.198373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":103,"num_read_kb":92,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"255'498","reported_seq":2278,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.937077+0000","last_change":"2024-03-04T12:20:22.849616+0000","last_active":"2024-03-04T13:13:20.937077+0000","last_peered":"2024-03-04T13:13:20.937077+0000","last_clean":"2024-03-04T13:13:20.937077+0000","last_became_active":"2024-03-04T12:20:22.849288+0000","last_became_peered":"2024-03-04T12:20:22.849288+0000","last_unstale":"2024-03-04T13:13:20.937077+0000","last_undegraded":"2024-03-04T13:13:20.937077+0000","last_fullsized":"2024-03-04T13:13:20.937077+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:38:12.869906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"255'87","reported_seq":571,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:30.968772+0000","last_change":"2024-03-04T12:20:24.870938+0000","last_active":"2024-03-04T13:10:30.968772+0000","last_peered":"2024-03-04T13:10:30.968772+0000","last_clean":"2024-03-04T13:10:30.968772+0000","last_became_active":"2024-03-04T12:20:24.870568+0000","last_became_peered":"2024-03-04T12:20:24.870568+0000","last_unstale":"2024-03-04T13:10:30.968772+0000","last_undegraded":"2024-03-04T13:10:30.968772+0000","last_fullsized":"2024-03-04T13:10:30.968772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:41:06.369980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":82,"num_read_kb":81,"num_write":219,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"255'297","reported_seq":1655,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.745392+0000","last_change":"2024-03-04T12:20:16.831299+0000","last_active":"2024-03-04T13:12:12.745392+0000","last_peered":"2024-03-04T13:12:12.745392+0000","last_clean":"2024-03-04T13:12:12.745392+0000","last_became_active":"2024-03-04T12:20:16.831001+0000","last_became_peered":"2024-03-04T12:20:16.831001+0000","last_unstale":"2024-03-04T13:12:12.745392+0000","last_undegraded":"2024-03-04T13:12:12.745392+0000","last_fullsized":"2024-03-04T13:12:12.745392+0000","mapping_epoch":22,"log_start":"255'200","ondisk_log_start":"255'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:17:15.203257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1692,"num_read_kb":1639,"num_write":326,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"255'199","reported_seq":821,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.172765+0000","last_change":"2024-03-04T12:20:14.813162+0000","last_active":"2024-03-04T13:13:21.172765+0000","last_peered":"2024-03-04T13:13:21.172765+0000","last_clean":"2024-03-04T13:13:21.172765+0000","last_became_active":"2024-03-04T12:20:14.812881+0000","last_became_peered":"2024-03-04T12:20:14.812881+0000","last_unstale":"2024-03-04T13:13:21.172765+0000","last_undegraded":"2024-03-04T13:13:21.172765+0000","last_fullsized":"2024-03-04T13:13:21.172765+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:50:49.495670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6401060,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":24185,"num_write":1082,"num_write_kb":42346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.494731+0000","last_change":"2024-03-04T12:20:18.836790+0000","last_active":"2024-03-04T13:09:52.494731+0000","last_peered":"2024-03-04T13:09:52.494731+0000","last_clean":"2024-03-04T13:09:52.494731+0000","last_became_active":"2024-03-04T12:20:18.836493+0000","last_became_peered":"2024-03-04T12:20:18.836493+0000","last_unstale":"2024-03-04T13:09:52.494731+0000","last_undegraded":"2024-03-04T13:09:52.494731+0000","last_fullsized":"2024-03-04T13:09:52.494731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:56.713786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"255'249","reported_seq":846,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.074245+0000","last_change":"2024-03-04T12:20:20.839419+0000","last_active":"2024-03-04T13:13:21.074245+0000","last_peered":"2024-03-04T13:13:21.074245+0000","last_clean":"2024-03-04T13:13:21.074245+0000","last_became_active":"2024-03-04T12:20:20.839079+0000","last_became_peered":"2024-03-04T12:20:20.839079+0000","last_unstale":"2024-03-04T13:13:21.074245+0000","last_undegraded":"2024-03-04T13:13:21.074245+0000","last_fullsized":"2024-03-04T13:13:21.074245+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:59:03.433466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7172,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":931,"num_read_kb":985,"num_write":1462,"num_write_kb":1319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.476116+0000","last_change":"2024-03-04T12:20:22.855248+0000","last_active":"2024-03-04T13:09:52.476116+0000","last_peered":"2024-03-04T13:09:52.476116+0000","last_clean":"2024-03-04T13:09:52.476116+0000","last_became_active":"2024-03-04T12:20:22.854860+0000","last_became_peered":"2024-03-04T12:20:22.854860+0000","last_unstale":"2024-03-04T13:09:52.476116+0000","last_undegraded":"2024-03-04T13:09:52.476116+0000","last_fullsized":"2024-03-04T13:09:52.476116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:11.625286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"255'104","reported_seq":584,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.544052+0000","last_change":"2024-03-04T12:20:24.866168+0000","last_active":"2024-03-04T13:10:27.544052+0000","last_peered":"2024-03-04T13:10:27.544052+0000","last_clean":"2024-03-04T13:10:27.544052+0000","last_became_active":"2024-03-04T12:20:24.865830+0000","last_became_peered":"2024-03-04T12:20:24.865830+0000","last_unstale":"2024-03-04T13:10:27.544052+0000","last_undegraded":"2024-03-04T13:10:27.544052+0000","last_fullsized":"2024-03-04T13:10:27.544052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:29.311908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":242,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"255'318","reported_seq":1695,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.078010+0000","last_change":"2024-03-04T12:20:16.821797+0000","last_active":"2024-03-04T13:12:18.078010+0000","last_peered":"2024-03-04T13:12:18.078010+0000","last_clean":"2024-03-04T13:12:18.078010+0000","last_became_active":"2024-03-04T12:20:16.821495+0000","last_became_peered":"2024-03-04T12:20:16.821495+0000","last_unstale":"2024-03-04T13:12:18.078010+0000","last_undegraded":"2024-03-04T13:12:18.078010+0000","last_fullsized":"2024-03-04T13:12:18.078010+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:21:21.722236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1811,"num_read_kb":1736,"num_write":364,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":664,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497781+0000","last_change":"2024-03-04T12:19:58.807747+0000","last_active":"2024-03-04T13:10:12.497781+0000","last_peered":"2024-03-04T13:10:12.497781+0000","last_clean":"2024-03-04T13:10:12.497781+0000","last_became_active":"2024-03-04T12:19:58.806723+0000","last_became_peered":"2024-03-04T12:19:58.806723+0000","last_unstale":"2024-03-04T13:10:12.497781+0000","last_undegraded":"2024-03-04T13:10:12.497781+0000","last_fullsized":"2024-03-04T13:10:12.497781+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:19:57.750293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:19:57.750293+0000","last_clean_scrub_stamp":"2024-03-04T12:19:57.750293+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:53:17.368805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":500,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.353364+0000","last_change":"2024-03-04T12:20:05.783212+0000","last_active":"2024-03-04T13:10:07.353364+0000","last_peered":"2024-03-04T13:10:07.353364+0000","last_clean":"2024-03-04T13:10:07.353364+0000","last_became_active":"2024-03-04T12:20:05.782921+0000","last_became_peered":"2024-03-04T12:20:05.782921+0000","last_unstale":"2024-03-04T13:10:07.353364+0000","last_undegraded":"2024-03-04T13:10:07.353364+0000","last_fullsized":"2024-03-04T13:10:07.353364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:47.241725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"255'172","reported_seq":785,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.103293+0000","last_change":"2024-03-04T12:20:51.032035+0000","last_active":"2024-03-04T13:13:21.103293+0000","last_peered":"2024-03-04T13:13:21.103293+0000","last_clean":"2024-03-04T13:13:21.103293+0000","last_became_active":"2024-03-04T12:20:51.031720+0000","last_became_peered":"2024-03-04T12:20:51.031720+0000","last_unstale":"2024-03-04T13:13:21.103293+0000","last_undegraded":"2024-03-04T13:13:21.103293+0000","last_fullsized":"2024-03-04T13:13:21.103293+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:35:26.492810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263538,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":417,"num_read_kb":68206,"num_write":949,"num_write_kb":44048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":493,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499605+0000","last_change":"2024-03-04T12:20:18.830022+0000","last_active":"2024-03-04T13:10:22.499605+0000","last_peered":"2024-03-04T13:10:22.499605+0000","last_clean":"2024-03-04T13:10:22.499605+0000","last_became_active":"2024-03-04T12:20:18.829703+0000","last_became_peered":"2024-03-04T12:20:18.829703+0000","last_unstale":"2024-03-04T13:10:22.499605+0000","last_undegraded":"2024-03-04T13:10:22.499605+0000","last_fullsized":"2024-03-04T13:10:22.499605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:01:37.596430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"255'312","reported_seq":1000,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.167644+0000","last_change":"2024-03-04T12:20:20.842756+0000","last_active":"2024-03-04T13:13:21.167644+0000","last_peered":"2024-03-04T13:13:21.167644+0000","last_clean":"2024-03-04T13:13:21.167644+0000","last_became_active":"2024-03-04T12:20:20.842433+0000","last_became_peered":"2024-03-04T12:20:20.842433+0000","last_unstale":"2024-03-04T13:13:21.167644+0000","last_undegraded":"2024-03-04T13:13:21.167644+0000","last_fullsized":"2024-03-04T13:13:21.167644+0000","mapping_epoch":26,"log_start":"255'300","ondisk_log_start":"255'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:13:17.760985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34072,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":590,"num_read_kb":823,"num_write":540,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":472,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.445437+0000","last_change":"2024-03-04T12:20:22.849592+0000","last_active":"2024-03-04T13:10:12.445437+0000","last_peered":"2024-03-04T13:10:12.445437+0000","last_clean":"2024-03-04T13:10:12.445437+0000","last_became_active":"2024-03-04T12:20:22.849274+0000","last_became_peered":"2024-03-04T12:20:22.849274+0000","last_unstale":"2024-03-04T13:10:12.445437+0000","last_undegraded":"2024-03-04T13:10:12.445437+0000","last_fullsized":"2024-03-04T13:10:12.445437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:45.671251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"255'108","reported_seq":598,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.765516+0000","last_change":"2024-03-04T12:20:24.865055+0000","last_active":"2024-03-04T13:11:27.765516+0000","last_peered":"2024-03-04T13:11:27.765516+0000","last_clean":"2024-03-04T13:11:27.765516+0000","last_became_active":"2024-03-04T12:20:24.864796+0000","last_became_peered":"2024-03-04T12:20:24.864796+0000","last_unstale":"2024-03-04T13:11:27.765516+0000","last_undegraded":"2024-03-04T13:11:27.765516+0000","last_fullsized":"2024-03-04T13:11:27.765516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:46:49.314439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":748,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":267,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"255'391","reported_seq":1914,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.309517+0000","last_change":"2024-03-04T12:20:16.836409+0000","last_active":"2024-03-04T13:12:39.309517+0000","last_peered":"2024-03-04T13:12:39.309517+0000","last_clean":"2024-03-04T13:12:39.309517+0000","last_became_active":"2024-03-04T12:20:16.836050+0000","last_became_peered":"2024-03-04T12:20:16.836050+0000","last_unstale":"2024-03-04T13:12:39.309517+0000","last_undegraded":"2024-03-04T13:12:39.309517+0000","last_fullsized":"2024-03-04T13:12:39.309517+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:34:01.964185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2110,"num_read_kb":2020,"num_write":444,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":508,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498621+0000","last_change":"2024-03-04T12:20:05.781479+0000","last_active":"2024-03-04T13:10:17.498621+0000","last_peered":"2024-03-04T13:10:17.498621+0000","last_clean":"2024-03-04T13:10:17.498621+0000","last_became_active":"2024-03-04T12:20:05.781199+0000","last_became_peered":"2024-03-04T12:20:05.781199+0000","last_unstale":"2024-03-04T13:10:17.498621+0000","last_undegraded":"2024-03-04T13:10:17.498621+0000","last_fullsized":"2024-03-04T13:10:17.498621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:44.684083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"255'204","reported_seq":828,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.101882+0000","last_change":"2024-03-04T12:20:14.821799+0000","last_active":"2024-03-04T13:13:21.101882+0000","last_peered":"2024-03-04T13:13:21.101882+0000","last_clean":"2024-03-04T13:13:21.101882+0000","last_became_active":"2024-03-04T12:20:14.821540+0000","last_became_peered":"2024-03-04T12:20:14.821540+0000","last_unstale":"2024-03-04T13:13:21.101882+0000","last_undegraded":"2024-03-04T13:13:21.101882+0000","last_fullsized":"2024-03-04T13:13:21.101882+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:53.300740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":43110,"num_write":1111,"num_write_kb":41335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.354153+0000","last_change":"2024-03-04T12:20:18.836025+0000","last_active":"2024-03-04T13:10:12.354153+0000","last_peered":"2024-03-04T13:10:12.354153+0000","last_clean":"2024-03-04T13:10:12.354153+0000","last_became_active":"2024-03-04T12:20:18.835509+0000","last_became_peered":"2024-03-04T12:20:18.835509+0000","last_unstale":"2024-03-04T13:10:12.354153+0000","last_undegraded":"2024-03-04T13:10:12.354153+0000","last_fullsized":"2024-03-04T13:10:12.354153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:20.235577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"255'693","reported_seq":2154,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:17.045647+0000","last_change":"2024-03-04T12:20:20.838876+0000","last_active":"2024-03-04T13:13:17.045647+0000","last_peered":"2024-03-04T13:13:17.045647+0000","last_clean":"2024-03-04T13:13:17.045647+0000","last_became_active":"2024-03-04T12:20:20.838633+0000","last_became_peered":"2024-03-04T12:20:20.838633+0000","last_unstale":"2024-03-04T13:13:17.045647+0000","last_undegraded":"2024-03-04T13:13:17.045647+0000","last_fullsized":"2024-03-04T13:13:17.045647+0000","mapping_epoch":26,"log_start":"255'600","ondisk_log_start":"255'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:41.132219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35283,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":944,"num_read_kb":1133,"num_write":338,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.501338+0000","last_change":"2024-03-04T12:20:22.848790+0000","last_active":"2024-03-04T13:10:32.501338+0000","last_peered":"2024-03-04T13:10:32.501338+0000","last_clean":"2024-03-04T13:10:32.501338+0000","last_became_active":"2024-03-04T12:20:22.848403+0000","last_became_peered":"2024-03-04T12:20:22.848403+0000","last_unstale":"2024-03-04T13:10:32.501338+0000","last_undegraded":"2024-03-04T13:10:32.501338+0000","last_fullsized":"2024-03-04T13:10:32.501338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:12:33.606788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"255'84","reported_seq":571,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.786585+0000","last_change":"2024-03-04T12:20:24.911878+0000","last_active":"2024-03-04T13:12:34.786585+0000","last_peered":"2024-03-04T13:12:34.786585+0000","last_clean":"2024-03-04T13:12:34.786585+0000","last_became_active":"2024-03-04T12:20:24.911303+0000","last_became_peered":"2024-03-04T12:20:24.911303+0000","last_unstale":"2024-03-04T13:12:34.786585+0000","last_undegraded":"2024-03-04T13:12:34.786585+0000","last_fullsized":"2024-03-04T13:12:34.786585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:38:09.768192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":85,"num_write":192,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"255'417","reported_seq":2050,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573274+0000","last_change":"2024-03-04T12:20:16.828170+0000","last_active":"2024-03-04T13:12:50.573274+0000","last_peered":"2024-03-04T13:12:50.573274+0000","last_clean":"2024-03-04T13:12:50.573274+0000","last_became_active":"2024-03-04T12:20:16.827513+0000","last_became_peered":"2024-03-04T12:20:16.827513+0000","last_unstale":"2024-03-04T13:12:50.573274+0000","last_undegraded":"2024-03-04T13:12:50.573274+0000","last_fullsized":"2024-03-04T13:12:50.573274+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:45:19.736683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2343,"num_read_kb":2241,"num_write":475,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":501,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.439427+0000","last_change":"2024-03-04T12:20:05.864062+0000","last_active":"2024-03-04T13:10:07.439427+0000","last_peered":"2024-03-04T13:10:07.439427+0000","last_clean":"2024-03-04T13:10:07.439427+0000","last_became_active":"2024-03-04T12:20:05.863125+0000","last_became_peered":"2024-03-04T12:20:05.863125+0000","last_unstale":"2024-03-04T13:10:07.439427+0000","last_undegraded":"2024-03-04T13:10:07.439427+0000","last_fullsized":"2024-03-04T13:10:07.439427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:25.960438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"255'165","reported_seq":746,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.449594+0000","last_change":"2024-03-04T12:20:14.813050+0000","last_active":"2024-03-04T13:12:07.449594+0000","last_peered":"2024-03-04T13:12:07.449594+0000","last_clean":"2024-03-04T13:12:07.449594+0000","last_became_active":"2024-03-04T12:20:14.812722+0000","last_became_peered":"2024-03-04T12:20:14.812722+0000","last_unstale":"2024-03-04T13:12:07.449594+0000","last_undegraded":"2024-03-04T13:12:07.449594+0000","last_fullsized":"2024-03-04T13:12:07.449594+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:14.492385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7550492,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":307,"num_read_kb":18084,"num_write":973,"num_write_kb":46336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.439970+0000","last_change":"2024-03-04T12:20:18.839341+0000","last_active":"2024-03-04T13:10:12.439970+0000","last_peered":"2024-03-04T13:10:12.439970+0000","last_clean":"2024-03-04T13:10:12.439970+0000","last_became_active":"2024-03-04T12:20:18.839038+0000","last_became_peered":"2024-03-04T12:20:18.839038+0000","last_unstale":"2024-03-04T13:10:12.439970+0000","last_undegraded":"2024-03-04T13:10:12.439970+0000","last_fullsized":"2024-03-04T13:10:12.439970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:51.813750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"255'245","reported_seq":1416,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.332033+0000","last_change":"2024-03-04T12:20:21.643795+0000","last_active":"2024-03-04T13:13:14.332033+0000","last_peered":"2024-03-04T13:13:14.332033+0000","last_clean":"2024-03-04T13:13:14.332033+0000","last_became_active":"2024-03-04T12:20:21.643475+0000","last_became_peered":"2024-03-04T12:20:21.643475+0000","last_unstale":"2024-03-04T13:13:14.332033+0000","last_undegraded":"2024-03-04T13:13:14.332033+0000","last_fullsized":"2024-03-04T13:13:14.332033+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:03:47.701687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":203,"num_write":195,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":473,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.446723+0000","last_change":"2024-03-04T12:20:22.854718+0000","last_active":"2024-03-04T13:10:22.446723+0000","last_peered":"2024-03-04T13:10:22.446723+0000","last_clean":"2024-03-04T13:10:22.446723+0000","last_became_active":"2024-03-04T12:20:22.854343+0000","last_became_peered":"2024-03-04T12:20:22.854343+0000","last_unstale":"2024-03-04T13:10:22.446723+0000","last_undegraded":"2024-03-04T13:10:22.446723+0000","last_fullsized":"2024-03-04T13:10:22.446723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:03:53.997420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"255'188","reported_seq":699,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:56.712390+0000","last_change":"2024-03-04T12:20:24.871310+0000","last_active":"2024-03-04T13:11:56.712390+0000","last_peered":"2024-03-04T13:11:56.712390+0000","last_clean":"2024-03-04T13:11:56.712390+0000","last_became_active":"2024-03-04T12:20:24.871020+0000","last_became_peered":"2024-03-04T12:20:24.871020+0000","last_unstale":"2024-03-04T13:11:56.712390+0000","last_undegraded":"2024-03-04T13:11:56.712390+0000","last_fullsized":"2024-03-04T13:11:56.712390+0000","mapping_epoch":30,"log_start":"250'100","ondisk_log_start":"250'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:50:33.268463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":353,"num_read_kb":362,"num_write":419,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"255'387","reported_seq":1852,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.953201+0000","last_change":"2024-03-04T12:20:16.825718+0000","last_active":"2024-03-04T13:12:36.953201+0000","last_peered":"2024-03-04T13:12:36.953201+0000","last_clean":"2024-03-04T13:12:36.953201+0000","last_became_active":"2024-03-04T12:20:16.825006+0000","last_became_peered":"2024-03-04T12:20:16.825006+0000","last_unstale":"2024-03-04T13:12:36.953201+0000","last_undegraded":"2024-03-04T13:12:36.953201+0000","last_fullsized":"2024-03-04T13:12:36.953201+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:46.542834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2027,"num_read_kb":1928,"num_write":438,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":500,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.353341+0000","last_change":"2024-03-04T12:20:05.783217+0000","last_active":"2024-03-04T13:10:07.353341+0000","last_peered":"2024-03-04T13:10:07.353341+0000","last_clean":"2024-03-04T13:10:07.353341+0000","last_became_active":"2024-03-04T12:20:05.782897+0000","last_became_peered":"2024-03-04T12:20:05.782897+0000","last_unstale":"2024-03-04T13:10:07.353341+0000","last_undegraded":"2024-03-04T13:10:07.353341+0000","last_fullsized":"2024-03-04T13:10:07.353341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:51:54.079894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"255'200","reported_seq":874,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.137782+0000","last_change":"2024-03-04T12:20:14.825079+0000","last_active":"2024-03-04T13:13:21.137782+0000","last_peered":"2024-03-04T13:13:21.137782+0000","last_clean":"2024-03-04T13:13:21.137782+0000","last_became_active":"2024-03-04T12:20:14.824810+0000","last_became_peered":"2024-03-04T12:20:14.824810+0000","last_unstale":"2024-03-04T13:13:21.137782+0000","last_undegraded":"2024-03-04T13:13:21.137782+0000","last_fullsized":"2024-03-04T13:13:21.137782+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:26:24.671565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3544974,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":19088,"num_write":1144,"num_write_kb":38256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.447280+0000","last_change":"2024-03-04T12:20:18.833327+0000","last_active":"2024-03-04T13:10:27.447280+0000","last_peered":"2024-03-04T13:10:27.447280+0000","last_clean":"2024-03-04T13:10:27.447280+0000","last_became_active":"2024-03-04T12:20:18.833051+0000","last_became_peered":"2024-03-04T12:20:18.833051+0000","last_unstale":"2024-03-04T13:10:27.447280+0000","last_undegraded":"2024-03-04T13:10:27.447280+0000","last_fullsized":"2024-03-04T13:10:27.447280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:42:25.419408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"255'125","reported_seq":654,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.300078+0000","last_change":"2024-03-04T12:20:20.845424+0000","last_active":"2024-03-04T13:10:53.300078+0000","last_peered":"2024-03-04T13:10:53.300078+0000","last_clean":"2024-03-04T13:10:53.300078+0000","last_became_active":"2024-03-04T12:20:20.845192+0000","last_became_peered":"2024-03-04T12:20:20.845192+0000","last_unstale":"2024-03-04T13:10:53.300078+0000","last_undegraded":"2024-03-04T13:10:53.300078+0000","last_fullsized":"2024-03-04T13:10:53.300078+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:32:04.776537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":155,"num_read_kb":149,"num_write":110,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.478882+0000","last_change":"2024-03-04T12:20:22.853030+0000","last_active":"2024-03-04T13:10:12.478882+0000","last_peered":"2024-03-04T13:10:12.478882+0000","last_clean":"2024-03-04T13:10:12.478882+0000","last_became_active":"2024-03-04T12:20:22.852745+0000","last_became_peered":"2024-03-04T12:20:22.852745+0000","last_unstale":"2024-03-04T13:10:12.478882+0000","last_undegraded":"2024-03-04T13:10:12.478882+0000","last_fullsized":"2024-03-04T13:10:12.478882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:47:11.374457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"255'85","reported_seq":579,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.354798+0000","last_change":"2024-03-04T12:20:24.865098+0000","last_active":"2024-03-04T13:10:17.354798+0000","last_peered":"2024-03-04T13:10:17.354798+0000","last_clean":"2024-03-04T13:10:17.354798+0000","last_became_active":"2024-03-04T12:20:24.864783+0000","last_became_peered":"2024-03-04T12:20:24.864783+0000","last_unstale":"2024-03-04T13:10:17.354798+0000","last_undegraded":"2024-03-04T13:10:17.354798+0000","last_fullsized":"2024-03-04T13:10:17.354798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:20:08.408598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":204,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"255'443","reported_seq":1900,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.307923+0000","last_change":"2024-03-04T12:20:16.827086+0000","last_active":"2024-03-04T13:12:39.307923+0000","last_peered":"2024-03-04T13:12:39.307923+0000","last_clean":"2024-03-04T13:12:39.307923+0000","last_became_active":"2024-03-04T12:20:16.826823+0000","last_became_peered":"2024-03-04T12:20:16.826823+0000","last_unstale":"2024-03-04T13:12:39.307923+0000","last_undegraded":"2024-03-04T13:12:39.307923+0000","last_fullsized":"2024-03-04T13:12:39.307923+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:21:23.072626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2302,"num_read_kb":2131,"num_write":558,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"255'158","reported_seq":753,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:09.809682+0000","last_change":"2024-03-04T12:20:14.819761+0000","last_active":"2024-03-04T13:13:09.809682+0000","last_peered":"2024-03-04T13:13:09.809682+0000","last_clean":"2024-03-04T13:13:09.809682+0000","last_became_active":"2024-03-04T12:20:14.819483+0000","last_became_peered":"2024-03-04T12:20:14.819483+0000","last_unstale":"2024-03-04T13:13:09.809682+0000","last_undegraded":"2024-03-04T13:13:09.809682+0000","last_fullsized":"2024-03-04T13:13:09.809682+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:40.255499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553728,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":336,"num_read_kb":12779,"num_write":962,"num_write_kb":35384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":501,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.541882+0000","last_change":"2024-03-04T12:20:05.863592+0000","last_active":"2024-03-04T13:10:07.541882+0000","last_peered":"2024-03-04T13:10:07.541882+0000","last_clean":"2024-03-04T13:10:07.541882+0000","last_became_active":"2024-03-04T12:20:05.863311+0000","last_became_peered":"2024-03-04T12:20:05.863311+0000","last_unstale":"2024-03-04T13:10:07.541882+0000","last_undegraded":"2024-03-04T13:10:07.541882+0000","last_fullsized":"2024-03-04T13:10:07.541882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:19:53.481187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.446710+0000","last_change":"2024-03-04T12:20:18.832677+0000","last_active":"2024-03-04T13:10:22.446710+0000","last_peered":"2024-03-04T13:10:22.446710+0000","last_clean":"2024-03-04T13:10:22.446710+0000","last_became_active":"2024-03-04T12:20:18.832355+0000","last_became_peered":"2024-03-04T12:20:18.832355+0000","last_unstale":"2024-03-04T13:10:22.446710+0000","last_undegraded":"2024-03-04T13:10:22.446710+0000","last_fullsized":"2024-03-04T13:10:22.446710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:45.490990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"255'260","reported_seq":909,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.175827+0000","last_change":"2024-03-04T12:20:20.842632+0000","last_active":"2024-03-04T13:13:21.175827+0000","last_peered":"2024-03-04T13:13:21.175827+0000","last_clean":"2024-03-04T13:13:21.175827+0000","last_became_active":"2024-03-04T12:20:20.842330+0000","last_became_peered":"2024-03-04T12:20:20.842330+0000","last_unstale":"2024-03-04T13:13:21.175827+0000","last_undegraded":"2024-03-04T13:13:21.175827+0000","last_fullsized":"2024-03-04T13:13:21.175827+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:06:51.329907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11717,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":373,"num_read_kb":489,"num_write":198,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":483,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499455+0000","last_change":"2024-03-04T12:20:22.854985+0000","last_active":"2024-03-04T13:10:22.499455+0000","last_peered":"2024-03-04T13:10:22.499455+0000","last_clean":"2024-03-04T13:10:22.499455+0000","last_became_active":"2024-03-04T12:20:22.854507+0000","last_became_peered":"2024-03-04T12:20:22.854507+0000","last_unstale":"2024-03-04T13:10:22.499455+0000","last_undegraded":"2024-03-04T13:10:22.499455+0000","last_fullsized":"2024-03-04T13:10:22.499455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:46:38.735735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"255'106","reported_seq":591,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:17.346925+0000","last_change":"2024-03-04T12:20:24.912422+0000","last_active":"2024-03-04T13:11:17.346925+0000","last_peered":"2024-03-04T13:11:17.346925+0000","last_clean":"2024-03-04T13:11:17.346925+0000","last_became_active":"2024-03-04T12:20:24.911970+0000","last_became_peered":"2024-03-04T12:20:24.911970+0000","last_unstale":"2024-03-04T13:11:17.346925+0000","last_undegraded":"2024-03-04T13:11:17.346925+0000","last_fullsized":"2024-03-04T13:11:17.346925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:21:27.924509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":120,"num_write":241,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"255'321","reported_seq":1676,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.075729+0000","last_change":"2024-03-04T12:20:16.825499+0000","last_active":"2024-03-04T13:12:18.075729+0000","last_peered":"2024-03-04T13:12:18.075729+0000","last_clean":"2024-03-04T13:12:18.075729+0000","last_became_active":"2024-03-04T12:20:16.825241+0000","last_became_peered":"2024-03-04T12:20:16.825241+0000","last_unstale":"2024-03-04T13:12:18.075729+0000","last_undegraded":"2024-03-04T13:12:18.075729+0000","last_fullsized":"2024-03-04T13:12:18.075729+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:35:19.260142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1925,"num_read_kb":1835,"num_write":376,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"255'162","reported_seq":753,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:19.640793+0000","last_change":"2024-03-04T12:20:14.816111+0000","last_active":"2024-03-04T13:12:19.640793+0000","last_peered":"2024-03-04T13:12:19.640793+0000","last_clean":"2024-03-04T13:12:19.640793+0000","last_became_active":"2024-03-04T12:20:14.815589+0000","last_became_peered":"2024-03-04T12:20:14.815589+0000","last_unstale":"2024-03-04T13:12:19.640793+0000","last_undegraded":"2024-03-04T13:12:19.640793+0000","last_fullsized":"2024-03-04T13:12:19.640793+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:18:53.206330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11384047,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":367,"num_read_kb":3319,"num_write":965,"num_write_kb":11696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":507,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498811+0000","last_change":"2024-03-04T12:20:05.863980+0000","last_active":"2024-03-04T13:10:17.498811+0000","last_peered":"2024-03-04T13:10:17.498811+0000","last_clean":"2024-03-04T13:10:17.498811+0000","last_became_active":"2024-03-04T12:20:05.863682+0000","last_became_peered":"2024-03-04T12:20:05.863682+0000","last_unstale":"2024-03-04T13:10:17.498811+0000","last_undegraded":"2024-03-04T13:10:17.498811+0000","last_fullsized":"2024-03-04T13:10:17.498811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:13.302689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.480354+0000","last_change":"2024-03-04T12:20:18.834213+0000","last_active":"2024-03-04T13:10:22.480354+0000","last_peered":"2024-03-04T13:10:22.480354+0000","last_clean":"2024-03-04T13:10:22.480354+0000","last_became_active":"2024-03-04T12:20:18.833896+0000","last_became_peered":"2024-03-04T12:20:18.833896+0000","last_unstale":"2024-03-04T13:10:22.480354+0000","last_undegraded":"2024-03-04T13:10:22.480354+0000","last_fullsized":"2024-03-04T13:10:22.480354+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:39:33.270747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"255'200","reported_seq":755,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:53.809580+0000","last_change":"2024-03-04T12:20:21.642318+0000","last_active":"2024-03-04T13:12:53.809580+0000","last_peered":"2024-03-04T13:12:53.809580+0000","last_clean":"2024-03-04T13:12:53.809580+0000","last_became_active":"2024-03-04T12:20:21.641826+0000","last_became_peered":"2024-03-04T12:20:21.641826+0000","last_unstale":"2024-03-04T13:12:53.809580+0000","last_undegraded":"2024-03-04T13:12:53.809580+0000","last_fullsized":"2024-03-04T13:12:53.809580+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:07:56.018494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":255,"num_read_kb":248,"num_write":230,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"255'535","reported_seq":4185,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.933669+0000","last_change":"2024-03-04T12:20:22.853803+0000","last_active":"2024-03-04T13:13:20.933669+0000","last_peered":"2024-03-04T13:13:20.933669+0000","last_clean":"2024-03-04T13:13:20.933669+0000","last_became_active":"2024-03-04T12:20:22.853588+0000","last_became_peered":"2024-03-04T12:20:22.853588+0000","last_unstale":"2024-03-04T13:13:20.933669+0000","last_undegraded":"2024-03-04T13:13:20.933669+0000","last_fullsized":"2024-03-04T13:13:20.933669+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:04:32.122406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"255'115","reported_seq":592,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:17.465945+0000","last_change":"2024-03-04T12:20:24.911411+0000","last_active":"2024-03-04T13:12:17.465945+0000","last_peered":"2024-03-04T13:12:17.465945+0000","last_clean":"2024-03-04T13:12:17.465945+0000","last_became_active":"2024-03-04T12:20:24.911103+0000","last_became_peered":"2024-03-04T12:20:24.911103+0000","last_unstale":"2024-03-04T13:12:17.465945+0000","last_undegraded":"2024-03-04T13:12:17.465945+0000","last_fullsized":"2024-03-04T13:12:17.465945+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:46.488236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":105,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"255'1398","reported_seq":3054,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.328335+0000","last_change":"2024-03-04T12:20:16.834067+0000","last_active":"2024-03-04T13:12:39.328335+0000","last_peered":"2024-03-04T13:12:39.328335+0000","last_clean":"2024-03-04T13:12:39.328335+0000","last_became_active":"2024-03-04T12:20:16.833689+0000","last_became_peered":"2024-03-04T12:20:16.833689+0000","last_unstale":"2024-03-04T13:12:39.328335+0000","last_undegraded":"2024-03-04T13:12:39.328335+0000","last_fullsized":"2024-03-04T13:12:39.328335+0000","mapping_epoch":22,"log_start":"255'1300","ondisk_log_start":"255'1300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":1300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:28:45.636854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5949,"num_read_kb":5124,"num_write":2086,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"255'143","reported_seq":823,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:17.465937+0000","last_change":"2024-03-04T12:20:14.814534+0000","last_active":"2024-03-04T13:12:17.465937+0000","last_peered":"2024-03-04T13:12:17.465937+0000","last_clean":"2024-03-04T13:12:17.465937+0000","last_became_active":"2024-03-04T12:20:14.814220+0000","last_became_peered":"2024-03-04T12:20:14.814220+0000","last_unstale":"2024-03-04T13:12:17.465937+0000","last_undegraded":"2024-03-04T13:12:17.465937+0000","last_fullsized":"2024-03-04T13:12:17.465937+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:53.600042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262328,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":11189,"num_write":841,"num_write_kb":14687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":500,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:57.540873+0000","last_change":"2024-03-04T12:20:05.784418+0000","last_active":"2024-03-04T13:09:57.540873+0000","last_peered":"2024-03-04T13:09:57.540873+0000","last_clean":"2024-03-04T13:09:57.540873+0000","last_became_active":"2024-03-04T12:20:05.784145+0000","last_became_peered":"2024-03-04T12:20:05.784145+0000","last_unstale":"2024-03-04T13:09:57.540873+0000","last_undegraded":"2024-03-04T13:09:57.540873+0000","last_fullsized":"2024-03-04T13:09:57.540873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:41.291467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499426+0000","last_change":"2024-03-04T12:20:18.833379+0000","last_active":"2024-03-04T13:10:22.499426+0000","last_peered":"2024-03-04T13:10:22.499426+0000","last_clean":"2024-03-04T13:10:22.499426+0000","last_became_active":"2024-03-04T12:20:18.832932+0000","last_became_peered":"2024-03-04T12:20:18.832932+0000","last_unstale":"2024-03-04T13:10:22.499426+0000","last_undegraded":"2024-03-04T13:10:22.499426+0000","last_fullsized":"2024-03-04T13:10:22.499426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:38:57.403504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"255'109","reported_seq":641,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.740133+0000","last_change":"2024-03-04T12:20:20.841516+0000","last_active":"2024-03-04T13:10:53.740133+0000","last_peered":"2024-03-04T13:10:53.740133+0000","last_clean":"2024-03-04T13:10:53.740133+0000","last_became_active":"2024-03-04T12:20:20.841108+0000","last_became_peered":"2024-03-04T12:20:20.841108+0000","last_unstale":"2024-03-04T13:10:53.740133+0000","last_undegraded":"2024-03-04T13:10:53.740133+0000","last_fullsized":"2024-03-04T13:10:53.740133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:56:40.136670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":86,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"255'530","reported_seq":2283,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.937891+0000","last_change":"2024-03-04T12:20:22.859649+0000","last_active":"2024-03-04T13:13:20.937891+0000","last_peered":"2024-03-04T13:13:20.937891+0000","last_clean":"2024-03-04T13:13:20.937891+0000","last_became_active":"2024-03-04T12:20:22.859306+0000","last_became_peered":"2024-03-04T12:20:22.859306+0000","last_unstale":"2024-03-04T13:13:20.937891+0000","last_undegraded":"2024-03-04T13:13:20.937891+0000","last_fullsized":"2024-03-04T13:13:20.937891+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:16:12.502466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"255'153","reported_seq":634,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:02.370689+0000","last_change":"2024-03-04T12:20:24.866096+0000","last_active":"2024-03-04T13:10:02.370689+0000","last_peered":"2024-03-04T13:10:02.370689+0000","last_clean":"2024-03-04T13:10:02.370689+0000","last_became_active":"2024-03-04T12:20:24.865816+0000","last_became_peered":"2024-03-04T12:20:24.865816+0000","last_unstale":"2024-03-04T13:10:02.370689+0000","last_undegraded":"2024-03-04T13:10:02.370689+0000","last_fullsized":"2024-03-04T13:10:02.370689+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:36:25.465085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":201,"num_read_kb":201,"num_write":359,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"255'653","reported_seq":2055,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.558225+0000","last_change":"2024-03-04T12:20:16.825715+0000","last_active":"2024-03-04T13:12:22.558225+0000","last_peered":"2024-03-04T13:12:22.558225+0000","last_clean":"2024-03-04T13:12:22.558225+0000","last_became_active":"2024-03-04T12:20:16.825377+0000","last_became_peered":"2024-03-04T12:20:16.825377+0000","last_unstale":"2024-03-04T13:12:22.558225+0000","last_undegraded":"2024-03-04T13:12:22.558225+0000","last_fullsized":"2024-03-04T13:12:22.558225+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:08.216187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2990,"num_read_kb":2698,"num_write":869,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"255'180","reported_seq":872,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.021737+0000","last_change":"2024-03-04T12:20:14.812062+0000","last_active":"2024-03-04T13:13:21.021737+0000","last_peered":"2024-03-04T13:13:21.021737+0000","last_clean":"2024-03-04T13:13:21.021737+0000","last_became_active":"2024-03-04T12:20:14.811756+0000","last_became_peered":"2024-03-04T12:20:14.811756+0000","last_unstale":"2024-03-04T13:13:21.021737+0000","last_undegraded":"2024-03-04T13:13:21.021737+0000","last_fullsized":"2024-03-04T13:13:21.021737+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:10:50.920801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104383,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":578,"num_read_kb":172500,"num_write":1029,"num_write_kb":54165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":502,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:57.476776+0000","last_change":"2024-03-04T12:20:05.779688+0000","last_active":"2024-03-04T13:09:57.476776+0000","last_peered":"2024-03-04T13:09:57.476776+0000","last_clean":"2024-03-04T13:09:57.476776+0000","last_became_active":"2024-03-04T12:20:05.779370+0000","last_became_peered":"2024-03-04T12:20:05.779370+0000","last_unstale":"2024-03-04T13:09:57.476776+0000","last_undegraded":"2024-03-04T13:09:57.476776+0000","last_fullsized":"2024-03-04T13:09:57.476776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:52.901612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"32'3","reported_seq":795,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.704335+0000","last_change":"2024-03-04T12:20:18.833572+0000","last_active":"2024-03-04T13:13:20.704335+0000","last_peered":"2024-03-04T13:13:20.704335+0000","last_clean":"2024-03-04T13:13:20.704335+0000","last_became_active":"2024-03-04T12:20:18.833273+0000","last_became_peered":"2024-03-04T12:20:18.833273+0000","last_unstale":"2024-03-04T13:13:20.704335+0000","last_undegraded":"2024-03-04T13:13:20.704335+0000","last_fullsized":"2024-03-04T13:13:20.704335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:15.952949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":470,"num_read_kb":468,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"255'322","reported_seq":1037,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.213330+0000","last_change":"2024-03-04T12:20:21.643470+0000","last_active":"2024-03-04T13:13:21.213330+0000","last_peered":"2024-03-04T13:13:21.213330+0000","last_clean":"2024-03-04T13:13:21.213330+0000","last_became_active":"2024-03-04T12:20:21.642696+0000","last_became_peered":"2024-03-04T12:20:21.642696+0000","last_unstale":"2024-03-04T13:13:21.213330+0000","last_undegraded":"2024-03-04T13:13:21.213330+0000","last_fullsized":"2024-03-04T13:13:21.213330+0000","mapping_epoch":26,"log_start":"255'300","ondisk_log_start":"255'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:21:06.437125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17780,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":637,"num_write":242,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":475,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.453513+0000","last_change":"2024-03-04T12:20:22.853586+0000","last_active":"2024-03-04T13:10:22.453513+0000","last_peered":"2024-03-04T13:10:22.453513+0000","last_clean":"2024-03-04T13:10:22.453513+0000","last_became_active":"2024-03-04T12:20:22.853272+0000","last_became_peered":"2024-03-04T12:20:22.853272+0000","last_unstale":"2024-03-04T13:10:22.453513+0000","last_undegraded":"2024-03-04T13:10:22.453513+0000","last_fullsized":"2024-03-04T13:10:22.453513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:01.588693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"255'108","reported_seq":582,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:03.491177+0000","last_change":"2024-03-04T12:20:24.864478+0000","last_active":"2024-03-04T13:10:03.491177+0000","last_peered":"2024-03-04T13:10:03.491177+0000","last_clean":"2024-03-04T13:10:03.491177+0000","last_became_active":"2024-03-04T12:20:24.863996+0000","last_became_peered":"2024-03-04T12:20:24.863996+0000","last_unstale":"2024-03-04T13:10:03.491177+0000","last_undegraded":"2024-03-04T13:10:03.491177+0000","last_fullsized":"2024-03-04T13:10:03.491177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:25:42.964622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":275,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"255'114","reported_seq":602,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:08.265674+0000","last_change":"2024-03-04T12:20:24.868945+0000","last_active":"2024-03-04T13:12:08.265674+0000","last_peered":"2024-03-04T13:12:08.265674+0000","last_clean":"2024-03-04T13:12:08.265674+0000","last_became_active":"2024-03-04T12:20:24.868636+0000","last_became_peered":"2024-03-04T12:20:24.868636+0000","last_unstale":"2024-03-04T13:12:08.265674+0000","last_undegraded":"2024-03-04T13:12:08.265674+0000","last_fullsized":"2024-03-04T13:12:08.265674+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:22:02.061168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":141,"num_write":275,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"255'387","reported_seq":1862,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573873+0000","last_change":"2024-03-04T12:20:16.823240+0000","last_active":"2024-03-04T13:12:50.573873+0000","last_peered":"2024-03-04T13:12:50.573873+0000","last_clean":"2024-03-04T13:12:50.573873+0000","last_became_active":"2024-03-04T12:20:16.822887+0000","last_became_peered":"2024-03-04T12:20:16.822887+0000","last_unstale":"2024-03-04T13:12:50.573873+0000","last_undegraded":"2024-03-04T13:12:50.573873+0000","last_fullsized":"2024-03-04T13:12:50.573873+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:22:42.786549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2100,"num_read_kb":1986,"num_write":448,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"255'173","reported_seq":777,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.066553+0000","last_change":"2024-03-04T12:20:14.824134+0000","last_active":"2024-03-04T13:13:21.066553+0000","last_peered":"2024-03-04T13:13:21.066553+0000","last_clean":"2024-03-04T13:13:21.066553+0000","last_became_active":"2024-03-04T12:20:14.823661+0000","last_became_peered":"2024-03-04T12:20:14.823661+0000","last_unstale":"2024-03-04T13:13:21.066553+0000","last_undegraded":"2024-03-04T13:13:21.066553+0000","last_fullsized":"2024-03-04T13:13:21.066553+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:36:15.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":384,"num_read_kb":10388,"num_write":1049,"num_write_kb":6576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":484,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.536495+0000","last_change":"2024-03-04T12:20:18.836980+0000","last_active":"2024-03-04T13:09:22.536495+0000","last_peered":"2024-03-04T13:09:22.536495+0000","last_clean":"2024-03-04T13:09:22.536495+0000","last_became_active":"2024-03-04T12:20:18.836487+0000","last_became_peered":"2024-03-04T12:20:18.836487+0000","last_unstale":"2024-03-04T13:09:22.536495+0000","last_undegraded":"2024-03-04T13:09:22.536495+0000","last_fullsized":"2024-03-04T13:09:22.536495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:57.938086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"255'141","reported_seq":701,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.110626+0000","last_change":"2024-03-04T12:20:20.841992+0000","last_active":"2024-03-04T13:13:21.110626+0000","last_peered":"2024-03-04T13:13:21.110626+0000","last_clean":"2024-03-04T13:13:21.110626+0000","last_became_active":"2024-03-04T12:20:20.841696+0000","last_became_peered":"2024-03-04T12:20:20.841696+0000","last_unstale":"2024-03-04T13:13:21.110626+0000","last_undegraded":"2024-03-04T13:13:21.110626+0000","last_fullsized":"2024-03-04T13:13:21.110626+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:29.714761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11864,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":271,"num_write":104,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":472,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.446298+0000","last_change":"2024-03-04T12:20:22.857779+0000","last_active":"2024-03-04T13:09:22.446298+0000","last_peered":"2024-03-04T13:09:22.446298+0000","last_clean":"2024-03-04T13:09:22.446298+0000","last_became_active":"2024-03-04T12:20:22.857513+0000","last_became_peered":"2024-03-04T12:20:22.857513+0000","last_unstale":"2024-03-04T13:09:22.446298+0000","last_undegraded":"2024-03-04T13:09:22.446298+0000","last_fullsized":"2024-03-04T13:09:22.446298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:18.804581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"255'97","reported_seq":578,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.454779+0000","last_change":"2024-03-04T12:20:24.863622+0000","last_active":"2024-03-04T13:10:32.454779+0000","last_peered":"2024-03-04T13:10:32.454779+0000","last_clean":"2024-03-04T13:10:32.454779+0000","last_became_active":"2024-03-04T12:20:24.863346+0000","last_became_peered":"2024-03-04T12:20:24.863346+0000","last_unstale":"2024-03-04T13:10:32.454779+0000","last_undegraded":"2024-03-04T13:10:32.454779+0000","last_fullsized":"2024-03-04T13:10:32.454779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:44:24.783559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":222,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"255'705","reported_seq":2061,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.916714+0000","last_change":"2024-03-04T12:20:16.834338+0000","last_active":"2024-03-04T13:12:57.916714+0000","last_peered":"2024-03-04T13:12:57.916714+0000","last_clean":"2024-03-04T13:12:57.916714+0000","last_became_active":"2024-03-04T12:20:16.834080+0000","last_became_peered":"2024-03-04T12:20:16.834080+0000","last_unstale":"2024-03-04T13:12:57.916714+0000","last_undegraded":"2024-03-04T13:12:57.916714+0000","last_fullsized":"2024-03-04T13:12:57.916714+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":600,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:22.194726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3097,"num_read_kb":2763,"num_write":935,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"255'233","reported_seq":908,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.052555+0000","last_change":"2024-03-04T12:20:14.816239+0000","last_active":"2024-03-04T13:13:21.052555+0000","last_peered":"2024-03-04T13:13:21.052555+0000","last_clean":"2024-03-04T13:13:21.052555+0000","last_became_active":"2024-03-04T12:20:14.814738+0000","last_became_peered":"2024-03-04T12:20:14.814738+0000","last_unstale":"2024-03-04T13:13:21.052555+0000","last_undegraded":"2024-03-04T13:13:21.052555+0000","last_fullsized":"2024-03-04T13:13:21.052555+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:21:09.377678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5787887,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":617,"num_read_kb":16203,"num_write":1488,"num_write_kb":37968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.446358+0000","last_change":"2024-03-04T12:20:18.835129+0000","last_active":"2024-03-04T13:09:22.446358+0000","last_peered":"2024-03-04T13:09:22.446358+0000","last_clean":"2024-03-04T13:09:22.446358+0000","last_became_active":"2024-03-04T12:20:18.834793+0000","last_became_peered":"2024-03-04T12:20:18.834793+0000","last_unstale":"2024-03-04T13:09:22.446358+0000","last_undegraded":"2024-03-04T13:09:22.446358+0000","last_fullsized":"2024-03-04T13:09:22.446358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:21:52.556360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"255'57","reported_seq":543,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:52.173344+0000","last_change":"2024-03-04T12:20:20.832322+0000","last_active":"2024-03-04T13:10:52.173344+0000","last_peered":"2024-03-04T13:10:52.173344+0000","last_clean":"2024-03-04T13:10:52.173344+0000","last_became_active":"2024-03-04T12:20:20.832034+0000","last_became_peered":"2024-03-04T12:20:20.832034+0000","last_unstale":"2024-03-04T13:10:52.173344+0000","last_undegraded":"2024-03-04T13:10:52.173344+0000","last_fullsized":"2024-03-04T13:10:52.173344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:23:22.034376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":40,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.489906+0000","last_change":"2024-03-04T12:20:22.855900+0000","last_active":"2024-03-04T13:09:22.489906+0000","last_peered":"2024-03-04T13:09:22.489906+0000","last_clean":"2024-03-04T13:09:22.489906+0000","last_became_active":"2024-03-04T12:20:22.855477+0000","last_became_peered":"2024-03-04T12:20:22.855477+0000","last_unstale":"2024-03-04T13:09:22.489906+0000","last_undegraded":"2024-03-04T13:09:22.489906+0000","last_fullsized":"2024-03-04T13:09:22.489906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:25:54.549022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"255'84","reported_seq":558,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.447271+0000","last_change":"2024-03-04T12:20:24.865842+0000","last_active":"2024-03-04T13:10:27.447271+0000","last_peered":"2024-03-04T13:10:27.447271+0000","last_clean":"2024-03-04T13:10:27.447271+0000","last_became_active":"2024-03-04T12:20:24.865534+0000","last_became_peered":"2024-03-04T12:20:24.865534+0000","last_unstale":"2024-03-04T13:10:27.447271+0000","last_undegraded":"2024-03-04T13:10:27.447271+0000","last_fullsized":"2024-03-04T13:10:27.447271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:17:39.700895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":78,"num_write":202,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"255'718","reported_seq":2253,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:04.176061+0000","last_change":"2024-03-04T12:20:16.830393+0000","last_active":"2024-03-04T13:12:04.176061+0000","last_peered":"2024-03-04T13:12:04.176061+0000","last_clean":"2024-03-04T13:12:04.176061+0000","last_became_active":"2024-03-04T12:20:16.829012+0000","last_became_peered":"2024-03-04T12:20:16.829012+0000","last_unstale":"2024-03-04T13:12:04.176061+0000","last_undegraded":"2024-03-04T13:12:04.176061+0000","last_fullsized":"2024-03-04T13:12:04.176061+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:21:58.770726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3304,"num_read_kb":2912,"num_write":1016,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"255'175","reported_seq":859,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.066968+0000","last_change":"2024-03-04T12:20:14.822487+0000","last_active":"2024-03-04T13:13:21.066968+0000","last_peered":"2024-03-04T13:13:21.066968+0000","last_clean":"2024-03-04T13:13:21.066968+0000","last_became_active":"2024-03-04T12:20:14.822127+0000","last_became_peered":"2024-03-04T12:20:14.822127+0000","last_unstale":"2024-03-04T13:13:21.066968+0000","last_undegraded":"2024-03-04T13:13:21.066968+0000","last_fullsized":"2024-03-04T13:13:21.066968+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:19.430639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947361,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":518,"num_read_kb":182821,"num_write":997,"num_write_kb":40014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.489870+0000","last_change":"2024-03-04T12:20:18.831317+0000","last_active":"2024-03-04T13:09:22.489870+0000","last_peered":"2024-03-04T13:09:22.489870+0000","last_clean":"2024-03-04T13:09:22.489870+0000","last_became_active":"2024-03-04T12:20:18.830818+0000","last_became_peered":"2024-03-04T12:20:18.830818+0000","last_unstale":"2024-03-04T13:09:22.489870+0000","last_undegraded":"2024-03-04T13:09:22.489870+0000","last_fullsized":"2024-03-04T13:09:22.489870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:02.931088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"255'164","reported_seq":739,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.014265+0000","last_change":"2024-03-04T12:20:20.841367+0000","last_active":"2024-03-04T13:13:21.014265+0000","last_peered":"2024-03-04T13:13:21.014265+0000","last_clean":"2024-03-04T13:13:21.014265+0000","last_became_active":"2024-03-04T12:20:20.840999+0000","last_became_peered":"2024-03-04T12:20:20.840999+0000","last_unstale":"2024-03-04T13:13:21.014265+0000","last_undegraded":"2024-03-04T13:13:21.014265+0000","last_fullsized":"2024-03-04T13:13:21.014265+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:44:25.478712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8097,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":284,"num_write":124,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.472066+0000","last_change":"2024-03-04T12:20:22.849190+0000","last_active":"2024-03-04T13:09:22.472066+0000","last_peered":"2024-03-04T13:09:22.472066+0000","last_clean":"2024-03-04T13:09:22.472066+0000","last_became_active":"2024-03-04T12:20:22.848877+0000","last_became_peered":"2024-03-04T12:20:22.848877+0000","last_unstale":"2024-03-04T13:09:22.472066+0000","last_undegraded":"2024-03-04T13:09:22.472066+0000","last_fullsized":"2024-03-04T13:09:22.472066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:55:22.244587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"255'99","reported_seq":570,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:14.114497+0000","last_change":"2024-03-04T12:20:24.864100+0000","last_active":"2024-03-04T13:12:14.114497+0000","last_peered":"2024-03-04T13:12:14.114497+0000","last_clean":"2024-03-04T13:12:14.114497+0000","last_became_active":"2024-03-04T12:20:24.863810+0000","last_became_peered":"2024-03-04T12:20:24.863810+0000","last_unstale":"2024-03-04T13:12:14.114497+0000","last_undegraded":"2024-03-04T13:12:14.114497+0000","last_fullsized":"2024-03-04T13:12:14.114497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:00:35.223823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":234,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"255'782","reported_seq":2313,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.954531+0000","last_change":"2024-03-04T12:20:51.031767+0000","last_active":"2024-03-04T13:12:36.954531+0000","last_peered":"2024-03-04T13:12:36.954531+0000","last_clean":"2024-03-04T13:12:36.954531+0000","last_became_active":"2024-03-04T12:20:51.031448+0000","last_became_peered":"2024-03-04T12:20:51.031448+0000","last_unstale":"2024-03-04T13:12:36.954531+0000","last_undegraded":"2024-03-04T13:12:36.954531+0000","last_fullsized":"2024-03-04T13:12:36.954531+0000","mapping_epoch":33,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:52.075573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3519,"num_read_kb":3144,"num_write":1038,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"255'186","reported_seq":815,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.195707+0000","last_change":"2024-03-04T12:20:14.824465+0000","last_active":"2024-03-04T13:13:21.195707+0000","last_peered":"2024-03-04T13:13:21.195707+0000","last_clean":"2024-03-04T13:13:21.195707+0000","last_became_active":"2024-03-04T12:20:14.824152+0000","last_became_peered":"2024-03-04T12:20:14.824152+0000","last_unstale":"2024-03-04T13:13:21.195707+0000","last_undegraded":"2024-03-04T13:13:21.195707+0000","last_fullsized":"2024-03-04T13:13:21.195707+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:16:58.677646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259657,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":396,"num_read_kb":84164,"num_write":1039,"num_write_kb":34071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":486,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.472038+0000","last_change":"2024-03-04T12:20:18.839090+0000","last_active":"2024-03-04T13:09:22.472038+0000","last_peered":"2024-03-04T13:09:22.472038+0000","last_clean":"2024-03-04T13:09:22.472038+0000","last_became_active":"2024-03-04T12:20:18.838749+0000","last_became_peered":"2024-03-04T12:20:18.838749+0000","last_unstale":"2024-03-04T13:09:22.472038+0000","last_undegraded":"2024-03-04T13:09:22.472038+0000","last_fullsized":"2024-03-04T13:09:22.472038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:30:49.140805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"255'125","reported_seq":689,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.989916+0000","last_change":"2024-03-04T12:20:20.839637+0000","last_active":"2024-03-04T13:13:20.989916+0000","last_peered":"2024-03-04T13:13:20.989916+0000","last_clean":"2024-03-04T13:13:20.989916+0000","last_became_active":"2024-03-04T12:20:20.839286+0000","last_became_peered":"2024-03-04T12:20:20.839286+0000","last_unstale":"2024-03-04T13:13:20.989916+0000","last_undegraded":"2024-03-04T13:13:20.989916+0000","last_fullsized":"2024-03-04T13:13:20.989916+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:46.347069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":210,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":470,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.439439+0000","last_change":"2024-03-04T12:20:22.849602+0000","last_active":"2024-03-04T13:09:22.439439+0000","last_peered":"2024-03-04T13:09:22.439439+0000","last_clean":"2024-03-04T13:09:22.439439+0000","last_became_active":"2024-03-04T12:20:22.849340+0000","last_became_peered":"2024-03-04T12:20:22.849340+0000","last_unstale":"2024-03-04T13:09:22.439439+0000","last_undegraded":"2024-03-04T13:09:22.439439+0000","last_fullsized":"2024-03-04T13:09:22.439439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:54:45.340993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"255'412","reported_seq":1874,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.782213+0000","last_change":"2024-03-04T12:20:16.821743+0000","last_active":"2024-03-04T13:12:34.782213+0000","last_peered":"2024-03-04T13:12:34.782213+0000","last_clean":"2024-03-04T13:12:34.782213+0000","last_became_active":"2024-03-04T12:20:16.821451+0000","last_became_peered":"2024-03-04T12:20:16.821451+0000","last_unstale":"2024-03-04T13:12:34.782213+0000","last_undegraded":"2024-03-04T13:12:34.782213+0000","last_fullsized":"2024-03-04T13:12:34.782213+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:11:35.448538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2212,"num_read_kb":2069,"num_write":499,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"255'211","reported_seq":801,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.050793+0000","last_change":"2024-03-04T12:20:14.810574+0000","last_active":"2024-03-04T13:13:21.050793+0000","last_peered":"2024-03-04T13:13:21.050793+0000","last_clean":"2024-03-04T13:13:21.050793+0000","last_became_active":"2024-03-04T12:20:14.810309+0000","last_became_peered":"2024-03-04T12:20:14.810309+0000","last_unstale":"2024-03-04T13:13:21.050793+0000","last_undegraded":"2024-03-04T13:13:21.050793+0000","last_fullsized":"2024-03-04T13:13:21.050793+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:00:53.380209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195451,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":442,"num_read_kb":8634,"num_write":1082,"num_write_kb":36368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.447299+0000","last_change":"2024-03-04T12:20:18.833581+0000","last_active":"2024-03-04T13:10:27.447299+0000","last_peered":"2024-03-04T13:10:27.447299+0000","last_clean":"2024-03-04T13:10:27.447299+0000","last_became_active":"2024-03-04T12:20:18.833300+0000","last_became_peered":"2024-03-04T12:20:18.833300+0000","last_unstale":"2024-03-04T13:10:27.447299+0000","last_undegraded":"2024-03-04T13:10:27.447299+0000","last_fullsized":"2024-03-04T13:10:27.447299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:18.547510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"255'193","reported_seq":801,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.135599+0000","last_change":"2024-03-04T12:20:20.838878+0000","last_active":"2024-03-04T13:13:14.135599+0000","last_peered":"2024-03-04T13:13:14.135599+0000","last_clean":"2024-03-04T13:13:14.135599+0000","last_became_active":"2024-03-04T12:20:20.838600+0000","last_became_peered":"2024-03-04T12:20:20.838600+0000","last_unstale":"2024-03-04T13:13:14.135599+0000","last_undegraded":"2024-03-04T13:13:14.135599+0000","last_fullsized":"2024-03-04T13:13:14.135599+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:23:04.099319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23990,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":269,"num_read_kb":389,"num_write":134,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":474,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.355538+0000","last_change":"2024-03-04T12:20:22.855745+0000","last_active":"2024-03-04T13:10:22.355538+0000","last_peered":"2024-03-04T13:10:22.355538+0000","last_clean":"2024-03-04T13:10:22.355538+0000","last_became_active":"2024-03-04T12:20:22.855464+0000","last_became_peered":"2024-03-04T12:20:22.855464+0000","last_unstale":"2024-03-04T13:10:22.355538+0000","last_undegraded":"2024-03-04T13:10:22.355538+0000","last_fullsized":"2024-03-04T13:10:22.355538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:30:46.542674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"255'170","reported_seq":663,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:47.462606+0000","last_change":"2024-03-04T12:20:24.912595+0000","last_active":"2024-03-04T13:11:47.462606+0000","last_peered":"2024-03-04T13:11:47.462606+0000","last_clean":"2024-03-04T13:11:47.462606+0000","last_became_active":"2024-03-04T12:20:24.912118+0000","last_became_peered":"2024-03-04T12:20:24.912118+0000","last_unstale":"2024-03-04T13:11:47.462606+0000","last_undegraded":"2024-03-04T13:11:47.462606+0000","last_fullsized":"2024-03-04T13:11:47.462606+0000","mapping_epoch":30,"log_start":"250'100","ondisk_log_start":"250'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:40:35.111451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":221,"num_read_kb":223,"num_write":386,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"255'445","reported_seq":1784,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.557491+0000","last_change":"2024-03-04T12:20:16.828841+0000","last_active":"2024-03-04T13:12:22.557491+0000","last_peered":"2024-03-04T13:12:22.557491+0000","last_clean":"2024-03-04T13:12:22.557491+0000","last_became_active":"2024-03-04T12:20:16.828550+0000","last_became_peered":"2024-03-04T12:20:16.828550+0000","last_unstale":"2024-03-04T13:12:22.557491+0000","last_undegraded":"2024-03-04T13:12:22.557491+0000","last_fullsized":"2024-03-04T13:12:22.557491+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:57:14.787116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2172,"num_read_kb":1979,"num_write":576,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"255'149","reported_seq":720,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:00.902037+0000","last_change":"2024-03-04T12:20:14.811751+0000","last_active":"2024-03-04T13:12:00.902037+0000","last_peered":"2024-03-04T13:12:00.902037+0000","last_clean":"2024-03-04T13:12:00.902037+0000","last_became_active":"2024-03-04T12:20:14.811474+0000","last_became_peered":"2024-03-04T12:20:14.811474+0000","last_unstale":"2024-03-04T13:12:00.902037+0000","last_undegraded":"2024-03-04T13:12:00.902037+0000","last_fullsized":"2024-03-04T13:12:00.902037+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:47:39.651078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2020301,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":290,"num_read_kb":3660,"num_write":930,"num_write_kb":16669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.480432+0000","last_change":"2024-03-04T12:20:18.836323+0000","last_active":"2024-03-04T13:10:22.480432+0000","last_peered":"2024-03-04T13:10:22.480432+0000","last_clean":"2024-03-04T13:10:22.480432+0000","last_became_active":"2024-03-04T12:20:18.836021+0000","last_became_peered":"2024-03-04T12:20:18.836021+0000","last_unstale":"2024-03-04T13:10:22.480432+0000","last_undegraded":"2024-03-04T13:10:22.480432+0000","last_fullsized":"2024-03-04T13:10:22.480432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:21:06.430437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"255'166","reported_seq":747,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.998533+0000","last_change":"2024-03-04T12:20:20.838524+0000","last_active":"2024-03-04T13:13:20.998533+0000","last_peered":"2024-03-04T13:13:20.998533+0000","last_clean":"2024-03-04T13:13:20.998533+0000","last_became_active":"2024-03-04T12:20:20.838216+0000","last_became_peered":"2024-03-04T12:20:20.838216+0000","last_unstale":"2024-03-04T13:13:20.998533+0000","last_undegraded":"2024-03-04T13:13:20.998533+0000","last_fullsized":"2024-03-04T13:13:20.998533+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:42:52.068202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12653,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":241,"num_read_kb":319,"num_write":160,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":475,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.543497+0000","last_change":"2024-03-04T12:20:22.856748+0000","last_active":"2024-03-04T13:10:22.543497+0000","last_peered":"2024-03-04T13:10:22.543497+0000","last_clean":"2024-03-04T13:10:22.543497+0000","last_became_active":"2024-03-04T12:20:22.856471+0000","last_became_peered":"2024-03-04T12:20:22.856471+0000","last_unstale":"2024-03-04T13:10:22.543497+0000","last_undegraded":"2024-03-04T13:10:22.543497+0000","last_fullsized":"2024-03-04T13:10:22.543497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:11:44.331825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"255'161","reported_seq":1004,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.643094+0000","last_change":"2024-03-04T12:20:24.863580+0000","last_active":"2024-03-04T13:13:12.643094+0000","last_peered":"2024-03-04T13:13:12.643094+0000","last_clean":"2024-03-04T13:13:12.643094+0000","last_became_active":"2024-03-04T12:20:24.863291+0000","last_became_peered":"2024-03-04T12:20:24.863291+0000","last_unstale":"2024-03-04T13:13:12.643094+0000","last_undegraded":"2024-03-04T13:13:12.643094+0000","last_fullsized":"2024-03-04T13:13:12.643094+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:12:00.193269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1530,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":567,"num_read_kb":564,"num_write":466,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"255'445","reported_seq":1849,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.328231+0000","last_change":"2024-03-04T12:20:50.906133+0000","last_active":"2024-03-04T13:12:39.328231+0000","last_peered":"2024-03-04T13:12:39.328231+0000","last_clean":"2024-03-04T13:12:39.328231+0000","last_became_active":"2024-03-04T12:20:50.905894+0000","last_became_peered":"2024-03-04T12:20:50.905894+0000","last_unstale":"2024-03-04T13:12:39.328231+0000","last_undegraded":"2024-03-04T13:12:39.328231+0000","last_fullsized":"2024-03-04T13:12:39.328231+0000","mapping_epoch":33,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:28:12.350446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2307,"num_read_kb":2145,"num_write":589,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"255'290","reported_seq":1044,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.184377+0000","last_change":"2024-03-04T12:20:14.816872+0000","last_active":"2024-03-04T13:13:21.184377+0000","last_peered":"2024-03-04T13:13:21.184377+0000","last_clean":"2024-03-04T13:13:21.184377+0000","last_became_active":"2024-03-04T12:20:14.816522+0000","last_became_peered":"2024-03-04T12:20:14.816522+0000","last_unstale":"2024-03-04T13:13:21.184377+0000","last_undegraded":"2024-03-04T13:13:21.184377+0000","last_fullsized":"2024-03-04T13:13:21.184377+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:29:45.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291510,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":856,"num_read_kb":55073,"num_write":1469,"num_write_kb":53223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499567+0000","last_change":"2024-03-04T12:20:18.831825+0000","last_active":"2024-03-04T13:10:22.499567+0000","last_peered":"2024-03-04T13:10:22.499567+0000","last_clean":"2024-03-04T13:10:22.499567+0000","last_became_active":"2024-03-04T12:20:18.831535+0000","last_became_peered":"2024-03-04T12:20:18.831535+0000","last_unstale":"2024-03-04T13:10:22.499567+0000","last_undegraded":"2024-03-04T13:10:22.499567+0000","last_fullsized":"2024-03-04T13:10:22.499567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:34:27.137812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"255'148","reported_seq":711,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.141793+0000","last_change":"2024-03-04T12:20:21.642237+0000","last_active":"2024-03-04T13:13:21.141793+0000","last_peered":"2024-03-04T13:13:21.141793+0000","last_clean":"2024-03-04T13:13:21.141793+0000","last_became_active":"2024-03-04T12:20:21.641872+0000","last_became_peered":"2024-03-04T12:20:21.641872+0000","last_unstale":"2024-03-04T13:13:21.141793+0000","last_undegraded":"2024-03-04T13:13:21.141793+0000","last_fullsized":"2024-03-04T13:13:21.141793+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:56.543890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6408,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":262,"num_write":108,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.544084+0000","last_change":"2024-03-04T12:20:22.854770+0000","last_active":"2024-03-04T13:10:27.544084+0000","last_peered":"2024-03-04T13:10:27.544084+0000","last_clean":"2024-03-04T13:10:27.544084+0000","last_became_active":"2024-03-04T12:20:22.854454+0000","last_became_peered":"2024-03-04T12:20:22.854454+0000","last_unstale":"2024-03-04T13:10:27.544084+0000","last_undegraded":"2024-03-04T13:10:27.544084+0000","last_fullsized":"2024-03-04T13:10:27.544084+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:43:50.254636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"255'101","reported_seq":576,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.164834+0000","last_change":"2024-03-04T12:20:24.862523+0000","last_active":"2024-03-04T13:13:14.164834+0000","last_peered":"2024-03-04T13:13:14.164834+0000","last_clean":"2024-03-04T13:13:14.164834+0000","last_became_active":"2024-03-04T12:20:24.862179+0000","last_became_peered":"2024-03-04T12:20:24.862179+0000","last_unstale":"2024-03-04T13:13:14.164834+0000","last_undegraded":"2024-03-04T13:13:14.164834+0000","last_fullsized":"2024-03-04T13:13:14.164834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:35:13.449840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":249,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"255'454","reported_seq":1906,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.593396+0000","last_change":"2024-03-04T12:20:16.836521+0000","last_active":"2024-03-04T13:12:50.593396+0000","last_peered":"2024-03-04T13:12:50.593396+0000","last_clean":"2024-03-04T13:12:50.593396+0000","last_became_active":"2024-03-04T12:20:16.836224+0000","last_became_peered":"2024-03-04T12:20:16.836224+0000","last_unstale":"2024-03-04T13:12:50.593396+0000","last_undegraded":"2024-03-04T13:12:50.593396+0000","last_fullsized":"2024-03-04T13:12:50.593396+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:20.664502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2418,"num_read_kb":2273,"num_write":600,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"255'189","reported_seq":779,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.462885+0000","last_change":"2024-03-04T12:20:14.821178+0000","last_active":"2024-03-04T13:12:47.462885+0000","last_peered":"2024-03-04T13:12:47.462885+0000","last_clean":"2024-03-04T13:12:47.462885+0000","last_became_active":"2024-03-04T12:20:14.820789+0000","last_became_peered":"2024-03-04T12:20:14.820789+0000","last_unstale":"2024-03-04T13:12:47.462885+0000","last_undegraded":"2024-03-04T13:12:47.462885+0000","last_fullsized":"2024-03-04T13:12:47.462885+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:09:03.198251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":398,"num_read_kb":8887,"num_write":907,"num_write_kb":18227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":483,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.543490+0000","last_change":"2024-03-04T12:20:18.838301+0000","last_active":"2024-03-04T13:10:22.543490+0000","last_peered":"2024-03-04T13:10:22.543490+0000","last_clean":"2024-03-04T13:10:22.543490+0000","last_became_active":"2024-03-04T12:20:18.837949+0000","last_became_peered":"2024-03-04T12:20:18.837949+0000","last_unstale":"2024-03-04T13:10:22.543490+0000","last_undegraded":"2024-03-04T13:10:22.543490+0000","last_fullsized":"2024-03-04T13:10:22.543490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:48:00.814962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"255'84","reported_seq":602,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.838249+0000","last_change":"2024-03-04T12:20:21.642153+0000","last_active":"2024-03-04T13:10:53.838249+0000","last_peered":"2024-03-04T13:10:53.838249+0000","last_clean":"2024-03-04T13:10:53.838249+0000","last_became_active":"2024-03-04T12:20:21.641757+0000","last_became_peered":"2024-03-04T12:20:21.641757+0000","last_unstale":"2024-03-04T13:10:53.838249+0000","last_undegraded":"2024-03-04T13:10:53.838249+0000","last_fullsized":"2024-03-04T13:10:53.838249+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:33:04.943209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":90,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"255'498","reported_seq":3564,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.932748+0000","last_change":"2024-03-04T12:20:22.850624+0000","last_active":"2024-03-04T13:13:20.932748+0000","last_peered":"2024-03-04T13:13:20.932748+0000","last_clean":"2024-03-04T13:13:20.932748+0000","last_became_active":"2024-03-04T12:20:22.849630+0000","last_became_peered":"2024-03-04T12:20:22.849630+0000","last_unstale":"2024-03-04T13:13:20.932748+0000","last_undegraded":"2024-03-04T13:13:20.932748+0000","last_fullsized":"2024-03-04T13:13:20.932748+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:05.162543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"255'140","reported_seq":628,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:11.369454+0000","last_change":"2024-03-04T12:20:24.863651+0000","last_active":"2024-03-04T13:12:11.369454+0000","last_peered":"2024-03-04T13:12:11.369454+0000","last_clean":"2024-03-04T13:12:11.369454+0000","last_became_active":"2024-03-04T12:20:24.863312+0000","last_became_peered":"2024-03-04T12:20:24.863312+0000","last_unstale":"2024-03-04T13:12:11.369454+0000","last_undegraded":"2024-03-04T13:12:11.369454+0000","last_fullsized":"2024-03-04T13:12:11.369454+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:10.861121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":307,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"255'558","reported_seq":2206,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.971775+0000","last_change":"2024-03-04T12:20:16.828351+0000","last_active":"2024-03-04T13:12:36.971775+0000","last_peered":"2024-03-04T13:12:36.971775+0000","last_clean":"2024-03-04T13:12:36.971775+0000","last_became_active":"2024-03-04T12:20:16.828102+0000","last_became_peered":"2024-03-04T12:20:16.828102+0000","last_unstale":"2024-03-04T13:12:36.971775+0000","last_undegraded":"2024-03-04T13:12:36.971775+0000","last_fullsized":"2024-03-04T13:12:36.971775+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:35:22.025393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2984,"num_read_kb":2771,"num_write":760,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"255'207","reported_seq":841,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.182107+0000","last_change":"2024-03-04T12:20:14.827443+0000","last_active":"2024-03-04T13:13:21.182107+0000","last_peered":"2024-03-04T13:13:21.182107+0000","last_clean":"2024-03-04T13:13:21.182107+0000","last_became_active":"2024-03-04T12:20:14.826522+0000","last_became_peered":"2024-03-04T12:20:14.826522+0000","last_unstale":"2024-03-04T13:13:21.182107+0000","last_undegraded":"2024-03-04T13:13:21.182107+0000","last_fullsized":"2024-03-04T13:13:21.182107+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:32:50.275769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27217,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":463,"num_read_kb":10394,"num_write":1165,"num_write_kb":28391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499523+0000","last_change":"2024-03-04T12:20:18.832929+0000","last_active":"2024-03-04T13:10:22.499523+0000","last_peered":"2024-03-04T13:10:22.499523+0000","last_clean":"2024-03-04T13:10:22.499523+0000","last_became_active":"2024-03-04T12:20:18.832607+0000","last_became_peered":"2024-03-04T12:20:18.832607+0000","last_unstale":"2024-03-04T13:10:22.499523+0000","last_undegraded":"2024-03-04T13:10:22.499523+0000","last_fullsized":"2024-03-04T13:10:22.499523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:37:17.213186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"255'174","reported_seq":748,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.191936+0000","last_change":"2024-03-04T12:20:20.838476+0000","last_active":"2024-03-04T13:13:21.191936+0000","last_peered":"2024-03-04T13:13:21.191936+0000","last_clean":"2024-03-04T13:13:21.191936+0000","last_became_active":"2024-03-04T12:20:20.838062+0000","last_became_peered":"2024-03-04T12:20:20.838062+0000","last_unstale":"2024-03-04T13:13:21.191936+0000","last_undegraded":"2024-03-04T13:13:21.191936+0000","last_fullsized":"2024-03-04T13:13:21.191936+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:55.057171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8941,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":239,"num_read_kb":314,"num_write":142,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":469,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.435067+0000","last_change":"2024-03-04T12:20:22.856843+0000","last_active":"2024-03-04T13:08:42.435067+0000","last_peered":"2024-03-04T13:08:42.435067+0000","last_clean":"2024-03-04T13:08:42.435067+0000","last_became_active":"2024-03-04T12:20:22.856540+0000","last_became_peered":"2024-03-04T12:20:22.856540+0000","last_unstale":"2024-03-04T13:08:42.435067+0000","last_undegraded":"2024-03-04T13:08:42.435067+0000","last_fullsized":"2024-03-04T13:08:42.435067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:57:43.229611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"255'88","reported_seq":574,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:15.292251+0000","last_change":"2024-03-04T12:20:24.867999+0000","last_active":"2024-03-04T13:10:15.292251+0000","last_peered":"2024-03-04T13:10:15.292251+0000","last_clean":"2024-03-04T13:10:15.292251+0000","last_became_active":"2024-03-04T12:20:24.866984+0000","last_became_peered":"2024-03-04T12:20:24.866984+0000","last_unstale":"2024-03-04T13:10:15.292251+0000","last_undegraded":"2024-03-04T13:10:15.292251+0000","last_fullsized":"2024-03-04T13:10:15.292251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:35.692000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":81,"num_write":221,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"255'841","reported_seq":2368,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.800189+0000","last_change":"2024-03-04T12:20:16.827865+0000","last_active":"2024-03-04T13:12:34.800189+0000","last_peered":"2024-03-04T13:12:34.800189+0000","last_clean":"2024-03-04T13:12:34.800189+0000","last_became_active":"2024-03-04T12:20:16.827592+0000","last_became_peered":"2024-03-04T12:20:16.827592+0000","last_unstale":"2024-03-04T13:12:34.800189+0000","last_undegraded":"2024-03-04T13:12:34.800189+0000","last_fullsized":"2024-03-04T13:12:34.800189+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:28.558695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3846,"num_read_kb":3408,"num_write":1191,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"255'226","reported_seq":858,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.026297+0000","last_change":"2024-03-04T12:20:14.827317+0000","last_active":"2024-03-04T13:13:21.026297+0000","last_peered":"2024-03-04T13:13:21.026297+0000","last_clean":"2024-03-04T13:13:21.026297+0000","last_became_active":"2024-03-04T12:20:14.827034+0000","last_became_peered":"2024-03-04T12:20:14.827034+0000","last_unstale":"2024-03-04T13:13:21.026297+0000","last_undegraded":"2024-03-04T13:13:21.026297+0000","last_fullsized":"2024-03-04T13:13:21.026297+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:46:52.185291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":510,"num_read_kb":74328,"num_write":1121,"num_write_kb":53240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.355518+0000","last_change":"2024-03-04T12:20:18.836142+0000","last_active":"2024-03-04T13:10:22.355518+0000","last_peered":"2024-03-04T13:10:22.355518+0000","last_clean":"2024-03-04T13:10:22.355518+0000","last_became_active":"2024-03-04T12:20:18.835852+0000","last_became_peered":"2024-03-04T12:20:18.835852+0000","last_unstale":"2024-03-04T13:10:22.355518+0000","last_undegraded":"2024-03-04T13:10:22.355518+0000","last_fullsized":"2024-03-04T13:10:22.355518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:46.704265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"255'135","reported_seq":686,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.196987+0000","last_change":"2024-03-04T12:20:20.837534+0000","last_active":"2024-03-04T13:13:21.196987+0000","last_peered":"2024-03-04T13:13:21.196987+0000","last_clean":"2024-03-04T13:13:21.196987+0000","last_became_active":"2024-03-04T12:20:20.837239+0000","last_became_peered":"2024-03-04T12:20:20.837239+0000","last_unstale":"2024-03-04T13:13:21.196987+0000","last_undegraded":"2024-03-04T13:13:21.196987+0000","last_fullsized":"2024-03-04T13:13:21.196987+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:10:30.624161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7816,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":230,"num_write":86,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":477,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.468138+0000","last_change":"2024-03-04T12:20:22.850044+0000","last_active":"2024-03-04T13:08:52.468138+0000","last_peered":"2024-03-04T13:08:52.468138+0000","last_clean":"2024-03-04T13:08:52.468138+0000","last_became_active":"2024-03-04T12:20:22.849731+0000","last_became_peered":"2024-03-04T12:20:22.849731+0000","last_unstale":"2024-03-04T13:08:52.468138+0000","last_undegraded":"2024-03-04T13:08:52.468138+0000","last_fullsized":"2024-03-04T13:08:52.468138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:28.076705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"255'119","reported_seq":617,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.314222+0000","last_change":"2024-03-04T12:20:24.912999+0000","last_active":"2024-03-04T13:12:39.314222+0000","last_peered":"2024-03-04T13:12:39.314222+0000","last_clean":"2024-03-04T13:12:39.314222+0000","last_became_active":"2024-03-04T12:20:24.912599+0000","last_became_peered":"2024-03-04T12:20:24.912599+0000","last_unstale":"2024-03-04T13:12:39.314222+0000","last_undegraded":"2024-03-04T13:12:39.314222+0000","last_fullsized":"2024-03-04T13:12:39.314222+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:16.458774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":888,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":157,"num_write":287,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"255'1175","reported_seq":2747,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.308261+0000","last_change":"2024-03-04T12:20:16.828068+0000","last_active":"2024-03-04T13:12:39.308261+0000","last_peered":"2024-03-04T13:12:39.308261+0000","last_clean":"2024-03-04T13:12:39.308261+0000","last_became_active":"2024-03-04T12:20:16.827448+0000","last_became_peered":"2024-03-04T12:20:16.827448+0000","last_unstale":"2024-03-04T13:12:39.308261+0000","last_undegraded":"2024-03-04T13:12:39.308261+0000","last_fullsized":"2024-03-04T13:12:39.308261+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":1100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:16:26.503650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5284,"num_read_kb":4621,"num_write":1652,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"255'215","reported_seq":845,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.165611+0000","last_change":"2024-03-04T12:20:14.822903+0000","last_active":"2024-03-04T13:13:21.165611+0000","last_peered":"2024-03-04T13:13:21.165611+0000","last_clean":"2024-03-04T13:13:21.165611+0000","last_became_active":"2024-03-04T12:20:14.822619+0000","last_became_peered":"2024-03-04T12:20:14.822619+0000","last_unstale":"2024-03-04T13:13:21.165611+0000","last_undegraded":"2024-03-04T13:13:21.165611+0000","last_fullsized":"2024-03-04T13:13:21.165611+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:39:36.460713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9035448,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":16616,"num_write":1088,"num_write_kb":32501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.482846+0000","last_change":"2024-03-04T12:20:18.831493+0000","last_active":"2024-03-04T13:08:42.482846+0000","last_peered":"2024-03-04T13:08:42.482846+0000","last_clean":"2024-03-04T13:08:42.482846+0000","last_became_active":"2024-03-04T12:20:18.831105+0000","last_became_peered":"2024-03-04T12:20:18.831105+0000","last_unstale":"2024-03-04T13:08:42.482846+0000","last_undegraded":"2024-03-04T13:08:42.482846+0000","last_fullsized":"2024-03-04T13:08:42.482846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:01.353910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"255'100","reported_seq":641,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.124207+0000","last_change":"2024-03-04T12:20:20.842912+0000","last_active":"2024-03-04T13:13:21.124207+0000","last_peered":"2024-03-04T13:13:21.124207+0000","last_clean":"2024-03-04T13:13:21.124207+0000","last_became_active":"2024-03-04T12:20:20.842361+0000","last_became_peered":"2024-03-04T12:20:20.842361+0000","last_unstale":"2024-03-04T13:13:21.124207+0000","last_undegraded":"2024-03-04T13:13:21.124207+0000","last_fullsized":"2024-03-04T13:13:21.124207+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:49:07.128719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":178,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499524+0000","last_change":"2024-03-04T12:20:22.857230+0000","last_active":"2024-03-04T13:10:22.499524+0000","last_peered":"2024-03-04T13:10:22.499524+0000","last_clean":"2024-03-04T13:10:22.499524+0000","last_became_active":"2024-03-04T12:20:22.856748+0000","last_became_peered":"2024-03-04T12:20:22.856748+0000","last_unstale":"2024-03-04T13:10:22.499524+0000","last_undegraded":"2024-03-04T13:10:22.499524+0000","last_fullsized":"2024-03-04T13:10:22.499524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:19:05.374574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"255'148","reported_seq":1190,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.552175+0000","last_change":"2024-03-04T12:20:24.865794+0000","last_active":"2024-03-04T13:13:12.552175+0000","last_peered":"2024-03-04T13:13:12.552175+0000","last_clean":"2024-03-04T13:13:12.552175+0000","last_became_active":"2024-03-04T12:20:24.865363+0000","last_became_peered":"2024-03-04T12:20:24.865363+0000","last_unstale":"2024-03-04T13:13:12.552175+0000","last_undegraded":"2024-03-04T13:13:12.552175+0000","last_fullsized":"2024-03-04T13:13:12.552175+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:49:27.367305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":819,"num_read_kb":785,"num_write":355,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"255'725","reported_seq":2131,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.951732+0000","last_change":"2024-03-04T12:20:16.820242+0000","last_active":"2024-03-04T13:12:36.951732+0000","last_peered":"2024-03-04T13:12:36.951732+0000","last_clean":"2024-03-04T13:12:36.951732+0000","last_became_active":"2024-03-04T12:20:16.819966+0000","last_became_peered":"2024-03-04T12:20:16.819966+0000","last_unstale":"2024-03-04T13:12:36.951732+0000","last_undegraded":"2024-03-04T13:12:36.951732+0000","last_fullsized":"2024-03-04T13:12:36.951732+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:05:44.485867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3297,"num_read_kb":2935,"num_write":968,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"255'281","reported_seq":926,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.459989+0000","last_change":"2024-03-04T12:20:14.824471+0000","last_active":"2024-03-04T13:12:22.459989+0000","last_peered":"2024-03-04T13:12:22.459989+0000","last_clean":"2024-03-04T13:12:22.459989+0000","last_became_active":"2024-03-04T12:20:14.824168+0000","last_became_peered":"2024-03-04T12:20:14.824168+0000","last_unstale":"2024-03-04T13:12:22.459989+0000","last_undegraded":"2024-03-04T13:12:22.459989+0000","last_fullsized":"2024-03-04T13:12:22.459989+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:06:00.013863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":709,"num_read_kb":4351,"num_write":1165,"num_write_kb":19276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":484,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:47.532640+0000","last_change":"2024-03-04T12:20:18.836753+0000","last_active":"2024-03-04T13:08:47.532640+0000","last_peered":"2024-03-04T13:08:47.532640+0000","last_clean":"2024-03-04T13:08:47.532640+0000","last_became_active":"2024-03-04T12:20:18.836203+0000","last_became_peered":"2024-03-04T12:20:18.836203+0000","last_unstale":"2024-03-04T13:08:47.532640+0000","last_undegraded":"2024-03-04T13:08:47.532640+0000","last_fullsized":"2024-03-04T13:08:47.532640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:43.974119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"255'161","reported_seq":737,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.149835+0000","last_change":"2024-03-04T12:20:20.842714+0000","last_active":"2024-03-04T13:13:21.149835+0000","last_peered":"2024-03-04T13:13:21.149835+0000","last_clean":"2024-03-04T13:13:21.149835+0000","last_became_active":"2024-03-04T12:20:20.842246+0000","last_became_peered":"2024-03-04T12:20:20.842246+0000","last_unstale":"2024-03-04T13:13:21.149835+0000","last_undegraded":"2024-03-04T13:13:21.149835+0000","last_fullsized":"2024-03-04T13:13:21.149835+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:08.729003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":208,"num_read_kb":255,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":469,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.446680+0000","last_change":"2024-03-04T12:20:22.856898+0000","last_active":"2024-03-04T13:10:22.446680+0000","last_peered":"2024-03-04T13:10:22.446680+0000","last_clean":"2024-03-04T13:10:22.446680+0000","last_became_active":"2024-03-04T12:20:22.856597+0000","last_became_peered":"2024-03-04T12:20:22.856597+0000","last_unstale":"2024-03-04T13:10:22.446680+0000","last_undegraded":"2024-03-04T13:10:22.446680+0000","last_fullsized":"2024-03-04T13:10:22.446680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:03:49.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"255'89","reported_seq":567,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:40.878711+0000","last_change":"2024-03-04T12:20:24.869755+0000","last_active":"2024-03-04T13:10:40.878711+0000","last_peered":"2024-03-04T13:10:40.878711+0000","last_clean":"2024-03-04T13:10:40.878711+0000","last_became_active":"2024-03-04T12:20:24.869207+0000","last_became_peered":"2024-03-04T12:20:24.869207+0000","last_unstale":"2024-03-04T13:10:40.878711+0000","last_undegraded":"2024-03-04T13:10:40.878711+0000","last_fullsized":"2024-03-04T13:10:40.878711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:06:32.609688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":212,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"255'1092","reported_seq":2657,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.557042+0000","last_change":"2024-03-04T12:20:16.832658+0000","last_active":"2024-03-04T13:12:22.557042+0000","last_peered":"2024-03-04T13:12:22.557042+0000","last_clean":"2024-03-04T13:12:22.557042+0000","last_became_active":"2024-03-04T12:20:16.832377+0000","last_became_peered":"2024-03-04T12:20:16.832377+0000","last_unstale":"2024-03-04T13:12:22.557042+0000","last_undegraded":"2024-03-04T13:12:22.557042+0000","last_fullsized":"2024-03-04T13:12:22.557042+0000","mapping_epoch":22,"log_start":"255'1000","ondisk_log_start":"255'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":1000,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:47:37.405815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4785,"num_read_kb":4211,"num_write":1502,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"255'213","reported_seq":860,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.122597+0000","last_change":"2024-03-04T12:20:14.817916+0000","last_active":"2024-03-04T13:13:21.122597+0000","last_peered":"2024-03-04T13:13:21.122597+0000","last_clean":"2024-03-04T13:13:21.122597+0000","last_became_active":"2024-03-04T12:20:14.817326+0000","last_became_peered":"2024-03-04T12:20:14.817326+0000","last_unstale":"2024-03-04T13:13:21.122597+0000","last_undegraded":"2024-03-04T13:13:21.122597+0000","last_fullsized":"2024-03-04T13:13:21.122597+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:49:00.626737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":463525,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":541,"num_read_kb":21798,"num_write":1100,"num_write_kb":25910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"255'796","reported_seq":2438,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.098986+0000","last_change":"2024-03-04T12:20:16.835151+0000","last_active":"2024-03-04T13:12:31.098986+0000","last_peered":"2024-03-04T13:12:31.098986+0000","last_clean":"2024-03-04T13:12:31.098986+0000","last_became_active":"2024-03-04T12:20:16.834823+0000","last_became_peered":"2024-03-04T12:20:16.834823+0000","last_unstale":"2024-03-04T13:12:31.098986+0000","last_undegraded":"2024-03-04T13:12:31.098986+0000","last_fullsized":"2024-03-04T13:12:31.098986+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:17.422055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3958,"num_read_kb":3565,"num_write":1074,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"255'210","reported_seq":853,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.181086+0000","last_change":"2024-03-04T12:20:14.819636+0000","last_active":"2024-03-04T13:13:21.181086+0000","last_peered":"2024-03-04T13:13:21.181086+0000","last_clean":"2024-03-04T13:13:21.181086+0000","last_became_active":"2024-03-04T12:20:14.819333+0000","last_became_peered":"2024-03-04T12:20:14.819333+0000","last_unstale":"2024-03-04T13:13:21.181086+0000","last_undegraded":"2024-03-04T13:13:21.181086+0000","last_fullsized":"2024-03-04T13:13:21.181086+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:25.357472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":688512,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":39432,"num_write":1114,"num_write_kb":31535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"255'567","reported_seq":2093,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.955018+0000","last_change":"2024-03-04T12:20:16.829090+0000","last_active":"2024-03-04T13:12:36.955018+0000","last_peered":"2024-03-04T13:12:36.955018+0000","last_clean":"2024-03-04T13:12:36.955018+0000","last_became_active":"2024-03-04T12:20:16.828799+0000","last_became_peered":"2024-03-04T12:20:16.828799+0000","last_unstale":"2024-03-04T13:12:36.955018+0000","last_undegraded":"2024-03-04T13:12:36.955018+0000","last_fullsized":"2024-03-04T13:12:36.955018+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:40:00.875926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2802,"num_read_kb":2536,"num_write":761,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"255'187","reported_seq":792,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.181487+0000","last_change":"2024-03-04T12:20:14.824170+0000","last_active":"2024-03-04T13:13:21.181487+0000","last_peered":"2024-03-04T13:13:21.181487+0000","last_clean":"2024-03-04T13:13:21.181487+0000","last_became_active":"2024-03-04T12:20:14.823794+0000","last_became_peered":"2024-03-04T12:20:14.823794+0000","last_unstale":"2024-03-04T13:13:21.181487+0000","last_undegraded":"2024-03-04T13:13:21.181487+0000","last_fullsized":"2024-03-04T13:13:21.181487+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:58:40.371668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27216,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":368,"num_read_kb":29267,"num_write":940,"num_write_kb":26221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"255'419","reported_seq":2014,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:14.106725+0000","last_change":"2024-03-04T12:20:16.830270+0000","last_active":"2024-03-04T13:12:14.106725+0000","last_peered":"2024-03-04T13:12:14.106725+0000","last_clean":"2024-03-04T13:12:14.106725+0000","last_became_active":"2024-03-04T12:20:16.830023+0000","last_became_peered":"2024-03-04T12:20:16.830023+0000","last_unstale":"2024-03-04T13:12:14.106725+0000","last_undegraded":"2024-03-04T13:12:14.106725+0000","last_fullsized":"2024-03-04T13:12:14.106725+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:15:50.412288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2457,"num_read_kb":2316,"num_write":500,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"255'181","reported_seq":764,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.155694+0000","last_change":"2024-03-04T12:20:14.814965+0000","last_active":"2024-03-04T13:13:21.155694+0000","last_peered":"2024-03-04T13:13:21.155694+0000","last_clean":"2024-03-04T13:13:21.155694+0000","last_became_active":"2024-03-04T12:20:14.814649+0000","last_became_peered":"2024-03-04T12:20:14.814649+0000","last_unstale":"2024-03-04T13:13:21.155694+0000","last_undegraded":"2024-03-04T13:13:21.155694+0000","last_fullsized":"2024-03-04T13:13:21.155694+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:38:26.781415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":350,"num_read_kb":14298,"num_write":961,"num_write_kb":45374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"255'670","reported_seq":2118,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.808990+0000","last_change":"2024-03-04T12:20:16.832110+0000","last_active":"2024-03-04T13:12:12.808990+0000","last_peered":"2024-03-04T13:12:12.808990+0000","last_clean":"2024-03-04T13:12:12.808990+0000","last_became_active":"2024-03-04T12:20:16.831861+0000","last_became_peered":"2024-03-04T12:20:16.831861+0000","last_unstale":"2024-03-04T13:12:12.808990+0000","last_undegraded":"2024-03-04T13:12:12.808990+0000","last_fullsized":"2024-03-04T13:12:12.808990+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":600,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:42:42.342669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3134,"num_read_kb":2831,"num_write":876,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"255'150","reported_seq":782,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.066149+0000","last_change":"2024-03-04T12:20:14.818277+0000","last_active":"2024-03-04T13:13:21.066149+0000","last_peered":"2024-03-04T13:13:21.066149+0000","last_clean":"2024-03-04T13:13:21.066149+0000","last_became_active":"2024-03-04T12:20:14.818011+0000","last_became_peered":"2024-03-04T12:20:14.818011+0000","last_unstale":"2024-03-04T13:13:21.066149+0000","last_undegraded":"2024-03-04T13:13:21.066149+0000","last_fullsized":"2024-03-04T13:13:21.066149+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:28:17.174533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6900048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":2296,"num_write":812,"num_write_kb":10260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"255'1153","reported_seq":2618,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.557788+0000","last_change":"2024-03-04T12:20:16.821337+0000","last_active":"2024-03-04T13:12:22.557788+0000","last_peered":"2024-03-04T13:12:22.557788+0000","last_clean":"2024-03-04T13:12:22.557788+0000","last_became_active":"2024-03-04T12:20:16.820794+0000","last_became_peered":"2024-03-04T12:20:16.820794+0000","last_unstale":"2024-03-04T13:12:22.557788+0000","last_undegraded":"2024-03-04T13:12:22.557788+0000","last_fullsized":"2024-03-04T13:12:22.557788+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":1100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:55:47.838168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4910,"num_read_kb":4282,"num_write":1611,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"255'210","reported_seq":833,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.541893+0000","last_change":"2024-03-04T12:20:14.812183+0000","last_active":"2024-03-04T13:10:07.541893+0000","last_peered":"2024-03-04T13:10:07.541893+0000","last_clean":"2024-03-04T13:10:07.541893+0000","last_became_active":"2024-03-04T12:20:14.811334+0000","last_became_peered":"2024-03-04T12:20:14.811334+0000","last_unstale":"2024-03-04T13:10:07.541893+0000","last_undegraded":"2024-03-04T13:10:07.541893+0000","last_fullsized":"2024-03-04T13:10:07.541893+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:50:58.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12062855,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":462,"num_read_kb":33282,"num_write":1224,"num_write_kb":31843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"255'760","reported_seq":2377,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.555573+0000","last_change":"2024-03-04T12:20:16.835553+0000","last_active":"2024-03-04T13:12:22.555573+0000","last_peered":"2024-03-04T13:12:22.555573+0000","last_clean":"2024-03-04T13:12:22.555573+0000","last_became_active":"2024-03-04T12:20:16.835285+0000","last_became_peered":"2024-03-04T12:20:16.835285+0000","last_unstale":"2024-03-04T13:12:22.555573+0000","last_undegraded":"2024-03-04T13:12:22.555573+0000","last_fullsized":"2024-03-04T13:12:22.555573+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:29:20.569225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3723,"num_read_kb":3381,"num_write":1013,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"255'217","reported_seq":846,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.137749+0000","last_change":"2024-03-04T12:20:14.818864+0000","last_active":"2024-03-04T13:13:21.137749+0000","last_peered":"2024-03-04T13:13:21.137749+0000","last_clean":"2024-03-04T13:13:21.137749+0000","last_became_active":"2024-03-04T12:20:14.818385+0000","last_became_peered":"2024-03-04T12:20:14.818385+0000","last_unstale":"2024-03-04T13:13:21.137749+0000","last_undegraded":"2024-03-04T13:13:21.137749+0000","last_fullsized":"2024-03-04T13:13:21.137749+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:02.154903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":39388,"num_write":1130,"num_write_kb":46394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"255'1082","reported_seq":2780,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.766506+0000","last_change":"2024-03-04T12:20:16.823981+0000","last_active":"2024-03-04T13:12:12.766506+0000","last_peered":"2024-03-04T13:12:12.766506+0000","last_clean":"2024-03-04T13:12:12.766506+0000","last_became_active":"2024-03-04T12:20:16.823596+0000","last_became_peered":"2024-03-04T12:20:16.823596+0000","last_unstale":"2024-03-04T13:12:12.766506+0000","last_undegraded":"2024-03-04T13:12:12.766506+0000","last_fullsized":"2024-03-04T13:12:12.766506+0000","mapping_epoch":22,"log_start":"255'1000","ondisk_log_start":"255'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":1000,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:37:17.796839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5087,"num_read_kb":4523,"num_write":1483,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"255'226","reported_seq":1075,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.174081+0000","last_change":"2024-03-04T12:20:14.818818+0000","last_active":"2024-03-04T13:13:21.174081+0000","last_peered":"2024-03-04T13:13:21.174081+0000","last_clean":"2024-03-04T13:13:21.174081+0000","last_became_active":"2024-03-04T12:20:14.818340+0000","last_became_peered":"2024-03-04T12:20:14.818340+0000","last_unstale":"2024-03-04T13:13:21.174081+0000","last_undegraded":"2024-03-04T13:13:21.174081+0000","last_fullsized":"2024-03-04T13:13:21.174081+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:30:11.725740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":933,"num_read_kb":21991,"num_write":1290,"num_write_kb":38918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"255'450","reported_seq":1993,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.297591+0000","last_change":"2024-03-04T12:20:16.830513+0000","last_active":"2024-03-04T13:12:31.297591+0000","last_peered":"2024-03-04T13:12:31.297591+0000","last_clean":"2024-03-04T13:12:31.297591+0000","last_became_active":"2024-03-04T12:20:16.830259+0000","last_became_peered":"2024-03-04T12:20:16.830259+0000","last_unstale":"2024-03-04T13:12:31.297591+0000","last_undegraded":"2024-03-04T13:12:31.297591+0000","last_fullsized":"2024-03-04T13:12:31.297591+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:12:15.968195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2206,"num_write":536,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"255'206","reported_seq":855,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.052457+0000","last_change":"2024-03-04T12:20:14.824797+0000","last_active":"2024-03-04T13:13:21.052457+0000","last_peered":"2024-03-04T13:13:21.052457+0000","last_clean":"2024-03-04T13:13:21.052457+0000","last_became_active":"2024-03-04T12:20:14.823513+0000","last_became_peered":"2024-03-04T12:20:14.823513+0000","last_unstale":"2024-03-04T13:13:21.052457+0000","last_undegraded":"2024-03-04T13:13:21.052457+0000","last_fullsized":"2024-03-04T13:13:21.052457+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:15:56.550416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706375,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":60209,"num_write":1193,"num_write_kb":41508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"255'752","reported_seq":2232,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:05.090024+0000","last_change":"2024-03-04T12:20:16.825790+0000","last_active":"2024-03-04T13:12:05.090024+0000","last_peered":"2024-03-04T13:12:05.090024+0000","last_clean":"2024-03-04T13:12:05.090024+0000","last_became_active":"2024-03-04T12:20:16.825534+0000","last_became_peered":"2024-03-04T12:20:16.825534+0000","last_unstale":"2024-03-04T13:12:05.090024+0000","last_undegraded":"2024-03-04T13:12:05.090024+0000","last_fullsized":"2024-03-04T13:12:05.090024+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:47:30.154655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3330,"num_read_kb":2980,"num_write":1004,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"255'222","reported_seq":830,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.066163+0000","last_change":"2024-03-04T12:20:14.817902+0000","last_active":"2024-03-04T13:13:21.066163+0000","last_peered":"2024-03-04T13:13:21.066163+0000","last_clean":"2024-03-04T13:13:21.066163+0000","last_became_active":"2024-03-04T12:20:14.817531+0000","last_became_peered":"2024-03-04T12:20:14.817531+0000","last_unstale":"2024-03-04T13:13:21.066163+0000","last_undegraded":"2024-03-04T13:13:21.066163+0000","last_fullsized":"2024-03-04T13:13:21.066163+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:38:40.926380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7696,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":19231,"num_write":1186,"num_write_kb":63143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"255'534","reported_seq":2107,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:01.977958+0000","last_change":"2024-03-04T12:20:16.823620+0000","last_active":"2024-03-04T13:12:01.977958+0000","last_peered":"2024-03-04T13:12:01.977958+0000","last_clean":"2024-03-04T13:12:01.977958+0000","last_became_active":"2024-03-04T12:20:16.823358+0000","last_became_peered":"2024-03-04T12:20:16.823358+0000","last_unstale":"2024-03-04T13:12:01.977958+0000","last_undegraded":"2024-03-04T13:12:01.977958+0000","last_fullsized":"2024-03-04T13:12:01.977958+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:56:00.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2875,"num_read_kb":2619,"num_write":718,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"255'185","reported_seq":789,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.005459+0000","last_change":"2024-03-04T12:20:50.902553+0000","last_active":"2024-03-04T13:13:21.005459+0000","last_peered":"2024-03-04T13:13:21.005459+0000","last_clean":"2024-03-04T13:13:21.005459+0000","last_became_active":"2024-03-04T12:20:50.902181+0000","last_became_peered":"2024-03-04T12:20:50.902181+0000","last_unstale":"2024-03-04T13:13:21.005459+0000","last_undegraded":"2024-03-04T13:13:21.005459+0000","last_fullsized":"2024-03-04T13:13:21.005459+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:36.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918078,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":20827,"num_write":1047,"num_write_kb":19608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"255'418","reported_seq":1796,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:01.977296+0000","last_change":"2024-03-04T12:20:16.819439+0000","last_active":"2024-03-04T13:12:01.977296+0000","last_peered":"2024-03-04T13:12:01.977296+0000","last_clean":"2024-03-04T13:12:01.977296+0000","last_became_active":"2024-03-04T12:20:16.819169+0000","last_became_peered":"2024-03-04T12:20:16.819169+0000","last_unstale":"2024-03-04T13:12:01.977296+0000","last_undegraded":"2024-03-04T13:12:01.977296+0000","last_fullsized":"2024-03-04T13:12:01.977296+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:22:24.173643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2116,"num_read_kb":1957,"num_write":522,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"255'172","reported_seq":787,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.042546+0000","last_change":"2024-03-04T12:20:14.823104+0000","last_active":"2024-03-04T13:13:21.042546+0000","last_peered":"2024-03-04T13:13:21.042546+0000","last_clean":"2024-03-04T13:13:21.042546+0000","last_became_active":"2024-03-04T12:20:14.822588+0000","last_became_peered":"2024-03-04T12:20:14.822588+0000","last_unstale":"2024-03-04T13:13:21.042546+0000","last_undegraded":"2024-03-04T13:13:21.042546+0000","last_fullsized":"2024-03-04T13:13:21.042546+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:58:44.728443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":390,"num_read_kb":47350,"num_write":1028,"num_write_kb":32429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"255'482","reported_seq":2025,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.558145+0000","last_change":"2024-03-04T12:20:16.828912+0000","last_active":"2024-03-04T13:12:22.558145+0000","last_peered":"2024-03-04T13:12:22.558145+0000","last_clean":"2024-03-04T13:12:22.558145+0000","last_became_active":"2024-03-04T12:20:16.828618+0000","last_became_peered":"2024-03-04T12:20:16.828618+0000","last_unstale":"2024-03-04T13:12:22.558145+0000","last_undegraded":"2024-03-04T13:12:22.558145+0000","last_fullsized":"2024-03-04T13:12:22.558145+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:00:24.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2516,"num_read_kb":2328,"num_write":610,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"255'180","reported_seq":910,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.206947+0000","last_change":"2024-03-04T12:20:14.819283+0000","last_active":"2024-03-04T13:13:21.206947+0000","last_peered":"2024-03-04T13:13:21.206947+0000","last_clean":"2024-03-04T13:13:21.206947+0000","last_became_active":"2024-03-04T12:20:14.818924+0000","last_became_peered":"2024-03-04T12:20:14.818924+0000","last_unstale":"2024-03-04T13:13:21.206947+0000","last_undegraded":"2024-03-04T13:13:21.206947+0000","last_fullsized":"2024-03-04T13:13:21.206947+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:41:49.091659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":719,"num_read_kb":26573,"num_write":1059,"num_write_kb":25938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"255'850","reported_seq":2378,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.782373+0000","last_change":"2024-03-04T12:20:16.835574+0000","last_active":"2024-03-04T13:12:34.782373+0000","last_peered":"2024-03-04T13:12:34.782373+0000","last_clean":"2024-03-04T13:12:34.782373+0000","last_became_active":"2024-03-04T12:20:16.835308+0000","last_became_peered":"2024-03-04T12:20:16.835308+0000","last_unstale":"2024-03-04T13:12:34.782373+0000","last_undegraded":"2024-03-04T13:12:34.782373+0000","last_fullsized":"2024-03-04T13:12:34.782373+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:38.783596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3917,"num_read_kb":3486,"num_write":1199,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"255'194","reported_seq":801,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.154246+0000","last_change":"2024-03-04T12:20:14.816730+0000","last_active":"2024-03-04T13:13:21.154246+0000","last_peered":"2024-03-04T13:13:21.154246+0000","last_clean":"2024-03-04T13:13:21.154246+0000","last_became_active":"2024-03-04T12:20:14.816440+0000","last_became_peered":"2024-03-04T12:20:14.816440+0000","last_unstale":"2024-03-04T13:13:21.154246+0000","last_undegraded":"2024-03-04T13:13:21.154246+0000","last_fullsized":"2024-03-04T13:13:21.154246+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:38.943831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17822208,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":392,"num_read_kb":7899,"num_write":1089,"num_write_kb":49946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"255'688","reported_seq":2008,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.308538+0000","last_change":"2024-03-04T12:20:16.828266+0000","last_active":"2024-03-04T13:12:39.308538+0000","last_peered":"2024-03-04T13:12:39.308538+0000","last_clean":"2024-03-04T13:12:39.308538+0000","last_became_active":"2024-03-04T12:20:16.827770+0000","last_became_peered":"2024-03-04T12:20:16.827770+0000","last_unstale":"2024-03-04T13:12:39.308538+0000","last_undegraded":"2024-03-04T13:12:39.308538+0000","last_fullsized":"2024-03-04T13:12:39.308538+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":600,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:29:10.790580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3073,"num_read_kb":2741,"num_write":929,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"255'191","reported_seq":798,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.079883+0000","last_change":"2024-03-04T12:20:14.820669+0000","last_active":"2024-03-04T13:13:21.079883+0000","last_peered":"2024-03-04T13:13:21.079883+0000","last_clean":"2024-03-04T13:13:21.079883+0000","last_became_active":"2024-03-04T12:20:14.820393+0000","last_became_peered":"2024-03-04T12:20:14.820393+0000","last_unstale":"2024-03-04T13:13:21.079883+0000","last_undegraded":"2024-03-04T13:13:21.079883+0000","last_fullsized":"2024-03-04T13:13:21.079883+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:28.246980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":6825,"num_write":1149,"num_write_kb":21389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"255'357","reported_seq":1774,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573122+0000","last_change":"2024-03-04T12:20:16.829573+0000","last_active":"2024-03-04T13:12:50.573122+0000","last_peered":"2024-03-04T13:12:50.573122+0000","last_clean":"2024-03-04T13:12:50.573122+0000","last_became_active":"2024-03-04T12:20:16.829306+0000","last_became_peered":"2024-03-04T12:20:16.829306+0000","last_unstale":"2024-03-04T13:12:50.573122+0000","last_undegraded":"2024-03-04T13:12:50.573122+0000","last_fullsized":"2024-03-04T13:12:50.573122+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:34.297959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1952,"num_read_kb":1858,"num_write":426,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"255'171","reported_seq":773,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.129708+0000","last_change":"2024-03-04T12:20:14.823519+0000","last_active":"2024-03-04T13:13:21.129708+0000","last_peered":"2024-03-04T13:13:21.129708+0000","last_clean":"2024-03-04T13:13:21.129708+0000","last_became_active":"2024-03-04T12:20:14.821961+0000","last_became_peered":"2024-03-04T12:20:14.821961+0000","last_unstale":"2024-03-04T13:13:21.129708+0000","last_undegraded":"2024-03-04T13:13:21.129708+0000","last_fullsized":"2024-03-04T13:13:21.129708+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:49.422340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":395,"num_read_kb":13429,"num_write":876,"num_write_kb":50070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"255'154","reported_seq":722,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.058864+0000","last_change":"2024-03-04T12:20:51.031233+0000","last_active":"2024-03-04T13:13:21.058864+0000","last_peered":"2024-03-04T13:13:21.058864+0000","last_clean":"2024-03-04T13:13:21.058864+0000","last_became_active":"2024-03-04T12:20:51.030887+0000","last_became_peered":"2024-03-04T12:20:51.030887+0000","last_unstale":"2024-03-04T13:13:21.058864+0000","last_undegraded":"2024-03-04T13:13:21.058864+0000","last_fullsized":"2024-03-04T13:13:21.058864+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:43:37.763295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":307,"num_read_kb":55812,"num_write":877,"num_write_kb":48688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"255'385","reported_seq":1778,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.327576+0000","last_change":"2024-03-04T12:20:16.831651+0000","last_active":"2024-03-04T13:12:39.327576+0000","last_peered":"2024-03-04T13:12:39.327576+0000","last_clean":"2024-03-04T13:12:39.327576+0000","last_became_active":"2024-03-04T12:20:16.831393+0000","last_became_peered":"2024-03-04T12:20:16.831393+0000","last_unstale":"2024-03-04T13:12:39.327576+0000","last_undegraded":"2024-03-04T13:12:39.327576+0000","last_fullsized":"2024-03-04T13:12:39.327576+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:40.571982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2009,"num_read_kb":1888,"num_write":461,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"255'190","reported_seq":862,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:14.420866+0000","last_change":"2024-03-04T12:20:14.818169+0000","last_active":"2024-03-04T13:10:14.420866+0000","last_peered":"2024-03-04T13:10:14.420866+0000","last_clean":"2024-03-04T13:10:14.420866+0000","last_became_active":"2024-03-04T12:20:14.817894+0000","last_became_peered":"2024-03-04T12:20:14.817894+0000","last_unstale":"2024-03-04T13:10:14.420866+0000","last_undegraded":"2024-03-04T13:10:14.420866+0000","last_fullsized":"2024-03-04T13:10:14.420866+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:00.852850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270127,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":164272,"num_write":1069,"num_write_kb":63423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"255'517","reported_seq":1960,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.741465+0000","last_change":"2024-03-04T12:20:16.824278+0000","last_active":"2024-03-04T13:11:27.741465+0000","last_peered":"2024-03-04T13:11:27.741465+0000","last_clean":"2024-03-04T13:11:27.741465+0000","last_became_active":"2024-03-04T12:20:16.823974+0000","last_became_peered":"2024-03-04T12:20:16.823974+0000","last_unstale":"2024-03-04T13:11:27.741465+0000","last_undegraded":"2024-03-04T13:11:27.741465+0000","last_fullsized":"2024-03-04T13:11:27.741465+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:53.806735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2611,"num_read_kb":2352,"num_write":706,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":133,"num_read_kb":185523,"num_write":151,"num_write_kb":127147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55623680,"data_stored":55622944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5335,"num_read_kb":3794,"num_write":2149,"num_write_kb":803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1182,"ondisk_log_size":1182,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":10065,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":12124,"num_read_kb":11961,"num_write":14025,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":20130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2376,"ondisk_log_size":2376,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":278213,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8407,"num_read_kb":10340,"num_write":5903,"num_write_kb":2708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":30088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1894,"ondisk_log_size":1894,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1637,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1554,"num_read_kb":1549,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":187558,"num_read_kb":170512,"num_write":50934,"num_write_kb":17677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3785,"ondisk_log_size":3785,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":230107981,"num_objects":280,"num_object_clones":0,"num_object_copies":560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":29459,"num_read_kb":2152910,"num_write":68717,"num_write_kb":2157934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":455168000,"data_stored":453533199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4233,"ondisk_log_size":4233,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":196827,"num_write":154,"num_write_kb":127147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45088768,"data_stored":45088768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575492,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":278660,"kb_used_data":71104,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94093180,"statfs":{"total":96636764160,"available":96351416320,"internally_reserved":0,"allocated":72810496,"data_stored":71072930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212466122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575493,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274148,"kb_used_data":40240,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94097692,"statfs":{"total":96636764160,"available":96356036608,"internally_reserved":0,"allocated":41205760,"data_stored":39656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575493,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149996,"kb_used_data":68804,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94221844,"statfs":{"total":96636764160,"available":96483168256,"internally_reserved":0,"allocated":70455296,"data_stored":68729090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575492,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108236,"kb_used_data":40948,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94263604,"statfs":{"total":96636764160,"available":96525930496,"internally_reserved":0,"allocated":41930752,"data_stored":40369557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575492,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284164,"kb_used_data":76592,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94087676,"statfs":{"total":96636764160,"available":96345780224,"internally_reserved":0,"allocated":78430208,"data_stored":76690401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":212466119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575493,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119312,"kb_used_data":47864,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94252528,"statfs":{"total":96636764160,"available":96514588672,"internally_reserved":0,"allocated":49012736,"data_stored":47453483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575493,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276104,"kb_used_data":164480,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94095736,"statfs":{"total":96636764160,"available":96354033664,"internally_reserved":0,"allocated":168427520,"data_stored":166747056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575491,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273248,"kb_used_data":61540,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94098592,"statfs":{"total":96636764160,"available":96356958208,"internally_reserved":0,"allocated":63016960,"data_stored":61377358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":47357952,"data_stored":47171521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":124960768,"data_stored":124750176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45522944,"data_stored":45373582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":64413696,"data_stored":64121957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32161792,"data_stored":31999474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":56401920,"data_stored":56160984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21966848,"data_stored":21846112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":62382080,"data_stored":62109393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":23702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22069248,"data_stored":22068512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T13:13:22.741 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T13:13:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:23.083 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-03-04T13:13:23.086 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":1850,"stamp":"2024-03-04T13:13:22.552736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":277125608,"num_objects":674,"num_object_clones":0,"num_object_copies":1348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":674,"num_whiteouts":0,"num_read":244835,"num_read_kb":2733524,"num_write":142224,"num_write_kb":2439956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14195,"ondisk_log_size":14195,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1763868,"kb_used_data":571572,"kb_used_omap":12,"kb_used_meta":1191859,"kb_avail":753210852,"statfs":{"total":773094113280,"available":771287912448,"internally_reserved":0,"allocated":585289728,"data_stored":572096195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1220464178},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-477632227,"num_objects":-234,"num_object_clones":0,"num_object_copies":-468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-234,"num_whiteouts":0,"num_read":555,"num_read_kb":12938,"num_write":359,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004349"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.484480+0000","last_change":"2024-03-04T12:46:22.249796+0000","last_active":"2024-03-04T13:08:52.484480+0000","last_peered":"2024-03-04T13:08:52.484480+0000","last_clean":"2024-03-04T13:08:52.484480+0000","last_became_active":"2024-03-04T12:46:22.248352+0000","last_became_peered":"2024-03-04T12:46:22.248352+0000","last_unstale":"2024-03-04T13:08:52.484480+0000","last_undegraded":"2024-03-04T13:08:52.484480+0000","last_fullsized":"2024-03-04T13:08:52.484480+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:06:29.651006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.542968+0000","last_change":"2024-03-04T12:32:46.051455+0000","last_active":"2024-03-04T13:10:17.542968+0000","last_peered":"2024-03-04T13:10:17.542968+0000","last_clean":"2024-03-04T13:10:17.542968+0000","last_became_active":"2024-03-04T12:32:46.051177+0000","last_became_peered":"2024-03-04T12:32:46.051177+0000","last_unstale":"2024-03-04T13:10:17.542968+0000","last_undegraded":"2024-03-04T13:10:17.542968+0000","last_fullsized":"2024-03-04T13:10:17.542968+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:41:49.996314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"255'2","reported_seq":51,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.456404+0000","last_change":"2024-03-04T12:32:42.034412+0000","last_active":"2024-03-04T13:12:47.456404+0000","last_peered":"2024-03-04T13:12:47.456404+0000","last_clean":"2024-03-04T13:12:47.456404+0000","last_became_active":"2024-03-04T12:32:42.034142+0000","last_became_peered":"2024-03-04T12:32:42.034142+0000","last_unstale":"2024-03-04T13:12:47.456404+0000","last_undegraded":"2024-03-04T13:12:47.456404+0000","last_fullsized":"2024-03-04T13:12:47.456404+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:44.538526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"255'17","reported_seq":90,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.448801+0000","last_change":"2024-03-04T12:29:01.703199+0000","last_active":"2024-03-04T13:10:42.448801+0000","last_peered":"2024-03-04T13:10:42.448801+0000","last_clean":"2024-03-04T13:10:42.448801+0000","last_became_active":"2024-03-04T12:29:01.702925+0000","last_became_peered":"2024-03-04T12:29:01.702925+0000","last_unstale":"2024-03-04T13:10:42.448801+0000","last_undegraded":"2024-03-04T13:10:42.448801+0000","last_fullsized":"2024-03-04T13:10:42.448801+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:00:11.470237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":40,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.343248+0000","last_change":"2024-03-04T12:46:22.258654+0000","last_active":"2024-03-04T13:08:52.343248+0000","last_peered":"2024-03-04T13:08:52.343248+0000","last_clean":"2024-03-04T13:08:52.343248+0000","last_became_active":"2024-03-04T12:46:22.258268+0000","last_became_peered":"2024-03-04T12:46:22.258268+0000","last_unstale":"2024-03-04T13:08:52.343248+0000","last_undegraded":"2024-03-04T13:08:52.343248+0000","last_fullsized":"2024-03-04T13:08:52.343248+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:28:49.843503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"255'11","reported_seq":67,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.130583+0000","last_change":"2024-03-04T12:32:46.052063+0000","last_active":"2024-03-04T13:13:21.130583+0000","last_peered":"2024-03-04T13:13:21.130583+0000","last_clean":"2024-03-04T13:13:21.130583+0000","last_became_active":"2024-03-04T12:32:46.051799+0000","last_became_peered":"2024-03-04T12:32:46.051799+0000","last_unstale":"2024-03-04T13:13:21.130583+0000","last_undegraded":"2024-03-04T13:13:21.130583+0000","last_fullsized":"2024-03-04T13:13:21.130583+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:10:51.455925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":43010,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"255'9","reported_seq":64,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.006034+0000","last_change":"2024-03-04T12:32:42.038130+0000","last_active":"2024-03-04T13:13:21.006034+0000","last_peered":"2024-03-04T13:13:21.006034+0000","last_clean":"2024-03-04T13:13:21.006034+0000","last_became_active":"2024-03-04T12:32:42.037701+0000","last_became_peered":"2024-03-04T12:32:42.037701+0000","last_unstale":"2024-03-04T13:13:21.006034+0000","last_undegraded":"2024-03-04T13:13:21.006034+0000","last_fullsized":"2024-03-04T13:13:21.006034+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:21:40.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"255'28","reported_seq":119,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.451341+0000","last_change":"2024-03-04T12:29:01.701298+0000","last_active":"2024-03-04T13:11:07.451341+0000","last_peered":"2024-03-04T13:11:07.451341+0000","last_clean":"2024-03-04T13:11:07.451341+0000","last_became_active":"2024-03-04T12:29:01.701003+0000","last_became_peered":"2024-03-04T12:29:01.701003+0000","last_unstale":"2024-03-04T13:11:07.451341+0000","last_undegraded":"2024-03-04T13:11:07.451341+0000","last_fullsized":"2024-03-04T13:11:07.451341+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:24.902315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":75,"num_write":51,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.454100+0000","last_change":"2024-03-04T12:46:22.308264+0000","last_active":"2024-03-04T13:10:27.454100+0000","last_peered":"2024-03-04T13:10:27.454100+0000","last_clean":"2024-03-04T13:10:27.454100+0000","last_became_active":"2024-03-04T12:46:22.307955+0000","last_became_peered":"2024-03-04T12:46:22.307955+0000","last_unstale":"2024-03-04T13:10:27.454100+0000","last_undegraded":"2024-03-04T13:10:27.454100+0000","last_fullsized":"2024-03-04T13:10:27.454100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:02:47.868860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":41,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498796+0000","last_change":"2024-03-04T12:32:46.053816+0000","last_active":"2024-03-04T13:10:17.498796+0000","last_peered":"2024-03-04T13:10:17.498796+0000","last_clean":"2024-03-04T13:10:17.498796+0000","last_became_active":"2024-03-04T12:32:46.053497+0000","last_became_peered":"2024-03-04T12:32:46.053497+0000","last_unstale":"2024-03-04T13:10:17.498796+0000","last_undegraded":"2024-03-04T13:10:17.498796+0000","last_fullsized":"2024-03-04T13:10:17.498796+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:27:00.581234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"255'3","reported_seq":51,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:42.468735+0000","last_change":"2024-03-04T12:32:42.037134+0000","last_active":"2024-03-04T13:12:42.468735+0000","last_peered":"2024-03-04T13:12:42.468735+0000","last_clean":"2024-03-04T13:12:42.468735+0000","last_became_active":"2024-03-04T12:32:42.036801+0000","last_became_peered":"2024-03-04T12:32:42.036801+0000","last_unstale":"2024-03-04T13:12:42.468735+0000","last_undegraded":"2024-03-04T13:12:42.468735+0000","last_fullsized":"2024-03-04T13:12:42.468735+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:11.992223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"255'24","reported_seq":108,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.486375+0000","last_change":"2024-03-04T12:29:01.707999+0000","last_active":"2024-03-04T13:09:02.486375+0000","last_peered":"2024-03-04T13:09:02.486375+0000","last_clean":"2024-03-04T13:09:02.486375+0000","last_became_active":"2024-03-04T12:29:01.707589+0000","last_became_peered":"2024-03-04T12:29:01.707589+0000","last_unstale":"2024-03-04T13:09:02.486375+0000","last_undegraded":"2024-03-04T13:09:02.486375+0000","last_fullsized":"2024-03-04T13:09:02.486375+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:51.454986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":71,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:17.438941+0000","last_change":"2024-03-04T12:46:22.310150+0000","last_active":"2024-03-04T13:09:17.438941+0000","last_peered":"2024-03-04T13:09:17.438941+0000","last_clean":"2024-03-04T13:09:17.438941+0000","last_became_active":"2024-03-04T12:46:22.309869+0000","last_became_peered":"2024-03-04T12:46:22.309869+0000","last_unstale":"2024-03-04T13:09:17.438941+0000","last_undegraded":"2024-03-04T13:09:17.438941+0000","last_fullsized":"2024-03-04T13:09:17.438941+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:17:23.605967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"255'3","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:52.456967+0000","last_change":"2024-03-04T12:32:46.057930+0000","last_active":"2024-03-04T13:12:52.456967+0000","last_peered":"2024-03-04T13:12:52.456967+0000","last_clean":"2024-03-04T13:12:52.456967+0000","last_became_active":"2024-03-04T12:32:46.057603+0000","last_became_peered":"2024-03-04T12:32:46.057603+0000","last_unstale":"2024-03-04T13:12:52.456967+0000","last_undegraded":"2024-03-04T13:12:52.456967+0000","last_fullsized":"2024-03-04T13:12:52.456967+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:31:09.275711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"250'3","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.445413+0000","last_change":"2024-03-04T12:32:42.032501+0000","last_active":"2024-03-04T13:10:12.445413+0000","last_peered":"2024-03-04T13:10:12.445413+0000","last_clean":"2024-03-04T13:10:12.445413+0000","last_became_active":"2024-03-04T12:32:42.032231+0000","last_became_peered":"2024-03-04T12:32:42.032231+0000","last_unstale":"2024-03-04T13:10:12.445413+0000","last_undegraded":"2024-03-04T13:10:12.445413+0000","last_fullsized":"2024-03-04T13:10:12.445413+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:57:04.660301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"255'27","reported_seq":111,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.534374+0000","last_change":"2024-03-04T12:29:01.704816+0000","last_active":"2024-03-04T13:09:02.534374+0000","last_peered":"2024-03-04T13:09:02.534374+0000","last_clean":"2024-03-04T13:09:02.534374+0000","last_became_active":"2024-03-04T12:29:01.704548+0000","last_became_peered":"2024-03-04T12:29:01.704548+0000","last_unstale":"2024-03-04T13:09:02.534374+0000","last_undegraded":"2024-03-04T13:09:02.534374+0000","last_fullsized":"2024-03-04T13:09:02.534374+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:15:47.833044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":73,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.481590+0000","last_change":"2024-03-04T12:46:22.258204+0000","last_active":"2024-03-04T13:10:32.481590+0000","last_peered":"2024-03-04T13:10:32.481590+0000","last_clean":"2024-03-04T13:10:32.481590+0000","last_became_active":"2024-03-04T12:46:22.257894+0000","last_became_peered":"2024-03-04T12:46:22.257894+0000","last_unstale":"2024-03-04T13:10:32.481590+0000","last_undegraded":"2024-03-04T13:10:32.481590+0000","last_fullsized":"2024-03-04T13:10:32.481590+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:54:40.739780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:07.487245+0000","last_change":"2024-03-04T12:32:46.054248+0000","last_active":"2024-03-04T13:09:07.487245+0000","last_peered":"2024-03-04T13:09:07.487245+0000","last_clean":"2024-03-04T13:09:07.487245+0000","last_became_active":"2024-03-04T12:32:46.053946+0000","last_became_peered":"2024-03-04T12:32:46.053946+0000","last_unstale":"2024-03-04T13:09:07.487245+0000","last_undegraded":"2024-03-04T13:09:07.487245+0000","last_fullsized":"2024-03-04T13:09:07.487245+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:49.837502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"255'11","reported_seq":68,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:42.499521+0000","last_change":"2024-03-04T12:32:42.037699+0000","last_active":"2024-03-04T13:12:42.499521+0000","last_peered":"2024-03-04T13:12:42.499521+0000","last_clean":"2024-03-04T13:12:42.499521+0000","last_became_active":"2024-03-04T12:32:42.037387+0000","last_became_peered":"2024-03-04T12:32:42.037387+0000","last_unstale":"2024-03-04T13:12:42.499521+0000","last_undegraded":"2024-03-04T13:12:42.499521+0000","last_fullsized":"2024-03-04T13:12:42.499521+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:05.876966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":15,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"255'50","reported_seq":162,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.534333+0000","last_change":"2024-03-04T12:29:01.704333+0000","last_active":"2024-03-04T13:09:02.534333+0000","last_peered":"2024-03-04T13:09:02.534333+0000","last_clean":"2024-03-04T13:09:02.534333+0000","last_became_active":"2024-03-04T12:29:01.703815+0000","last_became_peered":"2024-03-04T12:29:01.703815+0000","last_unstale":"2024-03-04T13:09:02.534333+0000","last_undegraded":"2024-03-04T13:09:02.534333+0000","last_fullsized":"2024-03-04T13:09:02.534333+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:15:13.058945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":130,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:37.357774+0000","last_change":"2024-03-04T12:46:22.260813+0000","last_active":"2024-03-04T13:10:37.357774+0000","last_peered":"2024-03-04T13:10:37.357774+0000","last_clean":"2024-03-04T13:10:37.357774+0000","last_became_active":"2024-03-04T12:46:22.260529+0000","last_became_peered":"2024-03-04T12:46:22.260529+0000","last_unstale":"2024-03-04T13:10:37.357774+0000","last_undegraded":"2024-03-04T13:10:37.357774+0000","last_fullsized":"2024-03-04T13:10:37.357774+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:25:58.359881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"255'5","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.453596+0000","last_change":"2024-03-04T12:32:46.052656+0000","last_active":"2024-03-04T13:11:27.453596+0000","last_peered":"2024-03-04T13:11:27.453596+0000","last_clean":"2024-03-04T13:11:27.453596+0000","last_became_active":"2024-03-04T12:32:46.052388+0000","last_became_peered":"2024-03-04T12:32:46.052388+0000","last_unstale":"2024-03-04T13:11:27.453596+0000","last_undegraded":"2024-03-04T13:11:27.453596+0000","last_fullsized":"2024-03-04T13:11:27.453596+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:32.283432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5160,"num_write":5,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"0'0","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.452400+0000","last_change":"2024-03-04T12:32:42.031111+0000","last_active":"2024-03-04T13:10:12.452400+0000","last_peered":"2024-03-04T13:10:12.452400+0000","last_clean":"2024-03-04T13:10:12.452400+0000","last_became_active":"2024-03-04T12:32:42.030804+0000","last_became_peered":"2024-03-04T12:32:42.030804+0000","last_unstale":"2024-03-04T13:10:12.452400+0000","last_undegraded":"2024-03-04T13:10:12.452400+0000","last_fullsized":"2024-03-04T13:10:12.452400+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:18:47.403222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"255'35","reported_seq":128,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.486308+0000","last_change":"2024-03-04T12:29:01.703915+0000","last_active":"2024-03-04T13:09:02.486308+0000","last_peered":"2024-03-04T13:09:02.486308+0000","last_clean":"2024-03-04T13:09:02.486308+0000","last_became_active":"2024-03-04T12:29:01.703369+0000","last_became_peered":"2024-03-04T12:29:01.703369+0000","last_unstale":"2024-03-04T13:09:02.486308+0000","last_undegraded":"2024-03-04T13:09:02.486308+0000","last_fullsized":"2024-03-04T13:09:02.486308+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:00:37.472429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":90,"num_write":62,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.443264+0000","last_change":"2024-03-04T12:46:22.256005+0000","last_active":"2024-03-04T13:08:52.443264+0000","last_peered":"2024-03-04T13:08:52.443264+0000","last_clean":"2024-03-04T13:08:52.443264+0000","last_became_active":"2024-03-04T12:46:22.255588+0000","last_became_peered":"2024-03-04T12:46:22.255588+0000","last_unstale":"2024-03-04T13:08:52.443264+0000","last_undegraded":"2024-03-04T13:08:52.443264+0000","last_fullsized":"2024-03-04T13:08:52.443264+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:06:23.252303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"255'6","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.462864+0000","last_change":"2024-03-04T12:32:46.057798+0000","last_active":"2024-03-04T13:12:47.462864+0000","last_peered":"2024-03-04T13:12:47.462864+0000","last_clean":"2024-03-04T13:12:47.462864+0000","last_became_active":"2024-03-04T12:32:46.057413+0000","last_became_peered":"2024-03-04T12:32:46.057413+0000","last_unstale":"2024-03-04T13:12:47.462864+0000","last_undegraded":"2024-03-04T13:12:47.462864+0000","last_fullsized":"2024-03-04T13:12:47.462864+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:42.088318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"255'6","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:57.533622+0000","last_change":"2024-03-04T12:32:42.031365+0000","last_active":"2024-03-04T13:08:57.533622+0000","last_peered":"2024-03-04T13:08:57.533622+0000","last_clean":"2024-03-04T13:08:57.533622+0000","last_became_active":"2024-03-04T12:32:42.031099+0000","last_became_peered":"2024-03-04T12:32:42.031099+0000","last_unstale":"2024-03-04T13:08:57.533622+0000","last_undegraded":"2024-03-04T13:08:57.533622+0000","last_fullsized":"2024-03-04T13:08:57.533622+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:05.270417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"255'41","reported_seq":139,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.452360+0000","last_change":"2024-03-04T12:29:01.701202+0000","last_active":"2024-03-04T13:10:12.452360+0000","last_peered":"2024-03-04T13:10:12.452360+0000","last_clean":"2024-03-04T13:10:12.452360+0000","last_became_active":"2024-03-04T12:29:01.700917+0000","last_became_peered":"2024-03-04T12:29:01.700917+0000","last_unstale":"2024-03-04T13:10:12.452360+0000","last_undegraded":"2024-03-04T13:10:12.452360+0000","last_fullsized":"2024-03-04T13:10:12.452360+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:02.058404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":100,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.468177+0000","last_change":"2024-03-04T12:46:22.256121+0000","last_active":"2024-03-04T13:08:52.468177+0000","last_peered":"2024-03-04T13:08:52.468177+0000","last_clean":"2024-03-04T13:08:52.468177+0000","last_became_active":"2024-03-04T12:46:22.255812+0000","last_became_peered":"2024-03-04T12:46:22.255812+0000","last_unstale":"2024-03-04T13:08:52.468177+0000","last_undegraded":"2024-03-04T13:08:52.468177+0000","last_fullsized":"2024-03-04T13:08:52.468177+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:10:20.330661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498622+0000","last_change":"2024-03-04T12:32:46.053933+0000","last_active":"2024-03-04T13:10:17.498622+0000","last_peered":"2024-03-04T13:10:17.498622+0000","last_clean":"2024-03-04T13:10:17.498622+0000","last_became_active":"2024-03-04T12:32:46.053172+0000","last_became_peered":"2024-03-04T12:32:46.053172+0000","last_unstale":"2024-03-04T13:10:17.498622+0000","last_undegraded":"2024-03-04T13:10:17.498622+0000","last_fullsized":"2024-03-04T13:10:17.498622+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:58:29.044468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"255'5","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.453640+0000","last_change":"2024-03-04T12:32:42.037511+0000","last_active":"2024-03-04T13:11:27.453640+0000","last_peered":"2024-03-04T13:11:27.453640+0000","last_clean":"2024-03-04T13:11:27.453640+0000","last_became_active":"2024-03-04T12:32:42.033315+0000","last_became_peered":"2024-03-04T12:32:42.033315+0000","last_unstale":"2024-03-04T13:11:27.453640+0000","last_undegraded":"2024-03-04T13:11:27.453640+0000","last_fullsized":"2024-03-04T13:11:27.453640+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:57:22.224861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5136,"num_write":5,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"255'18","reported_seq":96,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.353304+0000","last_change":"2024-03-04T12:29:01.707001+0000","last_active":"2024-03-04T13:10:07.353304+0000","last_peered":"2024-03-04T13:10:07.353304+0000","last_clean":"2024-03-04T13:10:07.353304+0000","last_became_active":"2024-03-04T12:29:01.706695+0000","last_became_peered":"2024-03-04T12:29:01.706695+0000","last_unstale":"2024-03-04T13:10:07.353304+0000","last_undegraded":"2024-03-04T13:10:07.353304+0000","last_fullsized":"2024-03-04T13:10:07.353304+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:25:41.776852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":54,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"252'1","reported_seq":25,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.445978+0000","last_change":"2024-03-04T12:46:51.979336+0000","last_active":"2024-03-04T13:10:17.445978+0000","last_peered":"2024-03-04T13:10:17.445978+0000","last_clean":"2024-03-04T13:10:17.445978+0000","last_became_active":"2024-03-04T12:46:51.977076+0000","last_became_peered":"2024-03-04T12:46:51.977076+0000","last_unstale":"2024-03-04T13:10:17.445978+0000","last_undegraded":"2024-03-04T13:10:17.445978+0000","last_fullsized":"2024-03-04T13:10:17.445978+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:24.892234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.486407+0000","last_change":"2024-03-04T12:32:46.056068+0000","last_active":"2024-03-04T13:09:02.486407+0000","last_peered":"2024-03-04T13:09:02.486407+0000","last_clean":"2024-03-04T13:09:02.486407+0000","last_became_active":"2024-03-04T12:32:46.055692+0000","last_became_peered":"2024-03-04T12:32:46.055692+0000","last_unstale":"2024-03-04T13:09:02.486407+0000","last_undegraded":"2024-03-04T13:09:02.486407+0000","last_fullsized":"2024-03-04T13:09:02.486407+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:41:41.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"0'0","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:57.443861+0000","last_change":"2024-03-04T12:32:42.030205+0000","last_active":"2024-03-04T13:08:57.443861+0000","last_peered":"2024-03-04T13:08:57.443861+0000","last_clean":"2024-03-04T13:08:57.443861+0000","last_became_active":"2024-03-04T12:32:42.029940+0000","last_became_peered":"2024-03-04T12:32:42.029940+0000","last_unstale":"2024-03-04T13:08:57.443861+0000","last_undegraded":"2024-03-04T13:08:57.443861+0000","last_fullsized":"2024-03-04T13:08:57.443861+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:36.549896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"255'31","reported_seq":118,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.478216+0000","last_change":"2024-03-04T12:29:01.701660+0000","last_active":"2024-03-04T13:10:07.478216+0000","last_peered":"2024-03-04T13:10:07.478216+0000","last_clean":"2024-03-04T13:10:07.478216+0000","last_became_active":"2024-03-04T12:29:01.701379+0000","last_became_peered":"2024-03-04T12:29:01.701379+0000","last_unstale":"2024-03-04T13:10:07.478216+0000","last_undegraded":"2024-03-04T13:10:07.478216+0000","last_fullsized":"2024-03-04T13:10:07.478216+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:12:36.501891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":79,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.454754+0000","last_change":"2024-03-04T12:46:22.309007+0000","last_active":"2024-03-04T13:10:32.454754+0000","last_peered":"2024-03-04T13:10:32.454754+0000","last_clean":"2024-03-04T13:10:32.454754+0000","last_became_active":"2024-03-04T12:46:22.308714+0000","last_became_peered":"2024-03-04T12:46:22.308714+0000","last_unstale":"2024-03-04T13:10:32.454754+0000","last_undegraded":"2024-03-04T13:10:32.454754+0000","last_fullsized":"2024-03-04T13:10:32.454754+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:10.983835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"255'6","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:37.375099+0000","last_change":"2024-03-04T12:32:46.052223+0000","last_active":"2024-03-04T13:12:37.375099+0000","last_peered":"2024-03-04T13:12:37.375099+0000","last_clean":"2024-03-04T13:12:37.375099+0000","last_became_active":"2024-03-04T12:32:46.051926+0000","last_became_peered":"2024-03-04T12:32:46.051926+0000","last_unstale":"2024-03-04T13:12:37.375099+0000","last_undegraded":"2024-03-04T13:12:37.375099+0000","last_fullsized":"2024-03-04T13:12:37.375099+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:13:09.671991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"0'0","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:57.436868+0000","last_change":"2024-03-04T12:32:42.034599+0000","last_active":"2024-03-04T13:08:57.436868+0000","last_peered":"2024-03-04T13:08:57.436868+0000","last_clean":"2024-03-04T13:08:57.436868+0000","last_became_active":"2024-03-04T12:32:42.034301+0000","last_became_peered":"2024-03-04T12:32:42.034301+0000","last_unstale":"2024-03-04T13:08:57.436868+0000","last_undegraded":"2024-03-04T13:08:57.436868+0000","last_fullsized":"2024-03-04T13:08:57.436868+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:14:58.871710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"255'132","reported_seq":425,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.541907+0000","last_change":"2024-03-04T12:29:01.703498+0000","last_active":"2024-03-04T13:10:07.541907+0000","last_peered":"2024-03-04T13:10:07.541907+0000","last_clean":"2024-03-04T13:10:07.541907+0000","last_became_active":"2024-03-04T12:29:01.703239+0000","last_became_peered":"2024-03-04T12:29:01.703239+0000","last_unstale":"2024-03-04T13:10:07.541907+0000","last_undegraded":"2024-03-04T13:10:07.541907+0000","last_fullsized":"2024-03-04T13:10:07.541907+0000","mapping_epoch":242,"log_start":"255'100","ondisk_log_start":"255'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:42:59.963681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":704,"num_read_kb":496,"num_write":192,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.501311+0000","last_change":"2024-03-04T12:46:22.259911+0000","last_active":"2024-03-04T13:10:32.501311+0000","last_peered":"2024-03-04T13:10:32.501311+0000","last_clean":"2024-03-04T13:10:32.501311+0000","last_became_active":"2024-03-04T12:46:22.259424+0000","last_became_peered":"2024-03-04T12:46:22.259424+0000","last_unstale":"2024-03-04T13:10:32.501311+0000","last_undegraded":"2024-03-04T13:10:32.501311+0000","last_fullsized":"2024-03-04T13:10:32.501311+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:44:30.252593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"250'5","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.437423+0000","last_change":"2024-03-04T12:32:46.057250+0000","last_active":"2024-03-04T13:09:02.437423+0000","last_peered":"2024-03-04T13:09:02.437423+0000","last_clean":"2024-03-04T13:09:02.437423+0000","last_became_active":"2024-03-04T12:32:46.056976+0000","last_became_peered":"2024-03-04T12:32:46.056976+0000","last_unstale":"2024-03-04T13:09:02.437423+0000","last_undegraded":"2024-03-04T13:09:02.437423+0000","last_fullsized":"2024-03-04T13:09:02.437423+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:22.480400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497894+0000","last_change":"2024-03-04T12:32:42.037353+0000","last_active":"2024-03-04T13:10:12.497894+0000","last_peered":"2024-03-04T13:10:12.497894+0000","last_clean":"2024-03-04T13:10:12.497894+0000","last_became_active":"2024-03-04T12:32:42.036694+0000","last_became_peered":"2024-03-04T12:32:42.036694+0000","last_unstale":"2024-03-04T13:10:12.497894+0000","last_undegraded":"2024-03-04T13:10:12.497894+0000","last_fullsized":"2024-03-04T13:10:12.497894+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:57:01.079244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"255'13","reported_seq":77,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.439473+0000","last_change":"2024-03-04T12:29:01.706751+0000","last_active":"2024-03-04T13:10:07.439473+0000","last_peered":"2024-03-04T13:10:07.439473+0000","last_clean":"2024-03-04T13:10:07.439473+0000","last_became_active":"2024-03-04T12:29:01.706467+0000","last_became_peered":"2024-03-04T12:29:01.706467+0000","last_unstale":"2024-03-04T13:10:07.439473+0000","last_undegraded":"2024-03-04T13:10:07.439473+0000","last_fullsized":"2024-03-04T13:10:07.439473+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:29:39.335950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.454804+0000","last_change":"2024-03-04T12:46:22.311206+0000","last_active":"2024-03-04T13:10:32.454804+0000","last_peered":"2024-03-04T13:10:32.454804+0000","last_clean":"2024-03-04T13:10:32.454804+0000","last_became_active":"2024-03-04T12:46:22.310952+0000","last_became_peered":"2024-03-04T12:46:22.310952+0000","last_unstale":"2024-03-04T13:10:32.454804+0000","last_undegraded":"2024-03-04T13:10:32.454804+0000","last_fullsized":"2024-03-04T13:10:32.454804+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:16:54.485327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"250'3","reported_seq":43,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.432359+0000","last_change":"2024-03-04T12:32:46.055077+0000","last_active":"2024-03-04T13:09:02.432359+0000","last_peered":"2024-03-04T13:09:02.432359+0000","last_clean":"2024-03-04T13:09:02.432359+0000","last_became_active":"2024-03-04T12:32:46.054752+0000","last_became_peered":"2024-03-04T12:32:46.054752+0000","last_unstale":"2024-03-04T13:09:02.432359+0000","last_undegraded":"2024-03-04T13:09:02.432359+0000","last_fullsized":"2024-03-04T13:09:02.432359+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:35:26.379046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"255'2","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:22.447389+0000","last_change":"2024-03-04T12:32:42.034215+0000","last_active":"2024-03-04T13:11:22.447389+0000","last_peered":"2024-03-04T13:11:22.447389+0000","last_clean":"2024-03-04T13:11:22.447389+0000","last_became_active":"2024-03-04T12:32:42.033898+0000","last_became_peered":"2024-03-04T12:32:42.033898+0000","last_unstale":"2024-03-04T13:11:22.447389+0000","last_undegraded":"2024-03-04T13:11:22.447389+0000","last_fullsized":"2024-03-04T13:11:22.447389+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:12:35.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"255'43","reported_seq":147,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:47.532685+0000","last_change":"2024-03-04T12:29:01.705464+0000","last_active":"2024-03-04T13:08:47.532685+0000","last_peered":"2024-03-04T13:08:47.532685+0000","last_clean":"2024-03-04T13:08:47.532685+0000","last_became_active":"2024-03-04T12:29:01.705183+0000","last_became_peered":"2024-03-04T12:29:01.705183+0000","last_unstale":"2024-03-04T13:08:47.532685+0000","last_undegraded":"2024-03-04T13:08:47.532685+0000","last_fullsized":"2024-03-04T13:08:47.532685+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:25.877488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":113,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.538980+0000","last_change":"2024-03-04T12:46:22.246381+0000","last_active":"2024-03-04T13:09:42.538980+0000","last_peered":"2024-03-04T13:09:42.538980+0000","last_clean":"2024-03-04T13:09:42.538980+0000","last_became_active":"2024-03-04T12:46:22.245967+0000","last_became_peered":"2024-03-04T12:46:22.245967+0000","last_unstale":"2024-03-04T13:09:42.538980+0000","last_undegraded":"2024-03-04T13:09:42.538980+0000","last_fullsized":"2024-03-04T13:09:42.538980+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:34:41.879387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.451813+0000","last_change":"2024-03-04T12:32:46.051614+0000","last_active":"2024-03-04T13:10:07.451813+0000","last_peered":"2024-03-04T13:10:07.451813+0000","last_clean":"2024-03-04T13:10:07.451813+0000","last_became_active":"2024-03-04T12:32:46.051360+0000","last_became_peered":"2024-03-04T12:32:46.051360+0000","last_unstale":"2024-03-04T13:10:07.451813+0000","last_undegraded":"2024-03-04T13:10:07.451813+0000","last_fullsized":"2024-03-04T13:10:07.451813+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:55.771101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"0'0","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:02.444339+0000","last_change":"2024-03-04T12:32:42.029927+0000","last_active":"2024-03-04T13:10:02.444339+0000","last_peered":"2024-03-04T13:10:02.444339+0000","last_clean":"2024-03-04T13:10:02.444339+0000","last_became_active":"2024-03-04T12:32:42.029559+0000","last_became_peered":"2024-03-04T12:32:42.029559+0000","last_unstale":"2024-03-04T13:10:02.444339+0000","last_undegraded":"2024-03-04T13:10:02.444339+0000","last_fullsized":"2024-03-04T13:10:02.444339+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:35.578821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"250'28","reported_seq":116,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.445115+0000","last_change":"2024-03-04T12:29:01.707645+0000","last_active":"2024-03-04T13:11:02.445115+0000","last_peered":"2024-03-04T13:11:02.445115+0000","last_clean":"2024-03-04T13:11:02.445115+0000","last_became_active":"2024-03-04T12:29:01.705726+0000","last_became_peered":"2024-03-04T12:29:01.705726+0000","last_unstale":"2024-03-04T13:11:02.445115+0000","last_undegraded":"2024-03-04T13:11:02.445115+0000","last_fullsized":"2024-03-04T13:11:02.445115+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:13:42.259053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":49,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.539021+0000","last_change":"2024-03-04T12:46:22.259972+0000","last_active":"2024-03-04T13:09:42.539021+0000","last_peered":"2024-03-04T13:09:42.539021+0000","last_clean":"2024-03-04T13:09:42.539021+0000","last_became_active":"2024-03-04T12:46:22.259134+0000","last_became_peered":"2024-03-04T12:46:22.259134+0000","last_unstale":"2024-03-04T13:09:42.539021+0000","last_undegraded":"2024-03-04T13:09:42.539021+0000","last_fullsized":"2024-03-04T13:09:42.539021+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:01:20.186301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.496892+0000","last_change":"2024-03-04T12:32:46.053557+0000","last_active":"2024-03-04T13:10:07.496892+0000","last_peered":"2024-03-04T13:10:07.496892+0000","last_clean":"2024-03-04T13:10:07.496892+0000","last_became_active":"2024-03-04T12:32:46.053156+0000","last_became_peered":"2024-03-04T12:32:46.053156+0000","last_unstale":"2024-03-04T13:10:07.496892+0000","last_undegraded":"2024-03-04T13:10:07.496892+0000","last_fullsized":"2024-03-04T13:10:07.496892+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:39.367675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"255'10","reported_seq":69,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520454+0000","last_change":"2024-03-04T12:32:42.036924+0000","last_active":"2024-03-04T13:12:22.520454+0000","last_peered":"2024-03-04T13:12:22.520454+0000","last_clean":"2024-03-04T13:12:22.520454+0000","last_became_active":"2024-03-04T12:32:42.036617+0000","last_became_peered":"2024-03-04T12:32:42.036617+0000","last_unstale":"2024-03-04T13:12:22.520454+0000","last_undegraded":"2024-03-04T13:12:22.520454+0000","last_fullsized":"2024-03-04T13:12:22.520454+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:10:49.987113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":29698,"num_write":14,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"255'17","reported_seq":94,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.361248+0000","last_change":"2024-03-04T12:29:01.701993+0000","last_active":"2024-03-04T13:11:02.361248+0000","last_peered":"2024-03-04T13:11:02.361248+0000","last_clean":"2024-03-04T13:11:02.361248+0000","last_became_active":"2024-03-04T12:29:01.701712+0000","last_became_peered":"2024-03-04T12:29:01.701712+0000","last_unstale":"2024-03-04T13:11:02.361248+0000","last_undegraded":"2024-03-04T13:11:02.361248+0000","last_fullsized":"2024-03-04T13:11:02.361248+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:53.885309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":51,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.474805+0000","last_change":"2024-03-04T12:46:22.257008+0000","last_active":"2024-03-04T13:09:42.474805+0000","last_peered":"2024-03-04T13:09:42.474805+0000","last_clean":"2024-03-04T13:09:42.474805+0000","last_became_active":"2024-03-04T12:46:22.256617+0000","last_became_peered":"2024-03-04T12:46:22.256617+0000","last_unstale":"2024-03-04T13:09:42.474805+0000","last_undegraded":"2024-03-04T13:09:42.474805+0000","last_fullsized":"2024-03-04T13:09:42.474805+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:25.255969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.353352+0000","last_change":"2024-03-04T12:32:46.053973+0000","last_active":"2024-03-04T13:10:07.353352+0000","last_peered":"2024-03-04T13:10:07.353352+0000","last_clean":"2024-03-04T13:10:07.353352+0000","last_became_active":"2024-03-04T12:32:46.053272+0000","last_became_peered":"2024-03-04T12:32:46.053272+0000","last_unstale":"2024-03-04T13:10:07.353352+0000","last_undegraded":"2024-03-04T13:10:07.353352+0000","last_fullsized":"2024-03-04T13:10:07.353352+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:51:06.764174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"0'0","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:02.451255+0000","last_change":"2024-03-04T12:32:42.036193+0000","last_active":"2024-03-04T13:10:02.451255+0000","last_peered":"2024-03-04T13:10:02.451255+0000","last_clean":"2024-03-04T13:10:02.451255+0000","last_became_active":"2024-03-04T12:32:42.035923+0000","last_became_peered":"2024-03-04T12:32:42.035923+0000","last_unstale":"2024-03-04T13:10:02.451255+0000","last_undegraded":"2024-03-04T13:10:02.451255+0000","last_fullsized":"2024-03-04T13:10:02.451255+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:56:49.994031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"255'34","reported_seq":131,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.506332+0000","last_change":"2024-03-04T12:29:01.703208+0000","last_active":"2024-03-04T13:11:02.506332+0000","last_peered":"2024-03-04T13:11:02.506332+0000","last_clean":"2024-03-04T13:11:02.506332+0000","last_became_active":"2024-03-04T12:29:01.702327+0000","last_became_peered":"2024-03-04T12:29:01.702327+0000","last_unstale":"2024-03-04T13:11:02.506332+0000","last_undegraded":"2024-03-04T13:11:02.506332+0000","last_fullsized":"2024-03-04T13:11:02.506332+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:05.157615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"252'1","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.448820+0000","last_change":"2024-03-04T12:46:22.258104+0000","last_active":"2024-03-04T13:09:42.448820+0000","last_peered":"2024-03-04T13:09:42.448820+0000","last_clean":"2024-03-04T13:09:42.448820+0000","last_became_active":"2024-03-04T12:46:22.257651+0000","last_became_peered":"2024-03-04T12:46:22.257651+0000","last_unstale":"2024-03-04T13:09:42.448820+0000","last_undegraded":"2024-03-04T13:09:42.448820+0000","last_fullsized":"2024-03-04T13:09:42.448820+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:10:20.836802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"250'7","reported_seq":58,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.478111+0000","last_change":"2024-03-04T12:32:46.049805+0000","last_active":"2024-03-04T13:10:07.478111+0000","last_peered":"2024-03-04T13:10:07.478111+0000","last_clean":"2024-03-04T13:10:07.478111+0000","last_became_active":"2024-03-04T12:32:46.049512+0000","last_became_peered":"2024-03-04T12:32:46.049512+0000","last_unstale":"2024-03-04T13:10:07.478111+0000","last_undegraded":"2024-03-04T13:10:07.478111+0000","last_fullsized":"2024-03-04T13:10:07.478111+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:41:47.962697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":11,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"0'0","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:02.496141+0000","last_change":"2024-03-04T12:32:42.032301+0000","last_active":"2024-03-04T13:10:02.496141+0000","last_peered":"2024-03-04T13:10:02.496141+0000","last_clean":"2024-03-04T13:10:02.496141+0000","last_became_active":"2024-03-04T12:32:42.032034+0000","last_became_peered":"2024-03-04T12:32:42.032034+0000","last_unstale":"2024-03-04T13:10:02.496141+0000","last_undegraded":"2024-03-04T13:10:02.496141+0000","last_fullsized":"2024-03-04T13:10:02.496141+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:46:46.488545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"255'51","reported_seq":170,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.457681+0000","last_change":"2024-03-04T12:29:01.703695+0000","last_active":"2024-03-04T13:11:02.457681+0000","last_peered":"2024-03-04T13:11:02.457681+0000","last_clean":"2024-03-04T13:11:02.457681+0000","last_became_active":"2024-03-04T12:29:01.703361+0000","last_became_peered":"2024-03-04T12:29:01.703361+0000","last_unstale":"2024-03-04T13:11:02.457681+0000","last_undegraded":"2024-03-04T13:11:02.457681+0000","last_fullsized":"2024-03-04T13:11:02.457681+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:51:42.885870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":146,"num_write":83,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"253'1","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.458334+0000","last_change":"2024-03-04T12:46:22.255919+0000","last_active":"2024-03-04T13:11:07.458334+0000","last_peered":"2024-03-04T13:11:07.458334+0000","last_clean":"2024-03-04T13:11:07.458334+0000","last_became_active":"2024-03-04T12:46:22.255498+0000","last_became_peered":"2024-03-04T12:46:22.255498+0000","last_unstale":"2024-03-04T13:11:07.458334+0000","last_undegraded":"2024-03-04T13:11:07.458334+0000","last_fullsized":"2024-03-04T13:11:07.458334+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:36:32.059020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"255'2","reported_seq":43,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:17.459427+0000","last_change":"2024-03-04T12:32:46.059035+0000","last_active":"2024-03-04T13:13:17.459427+0000","last_peered":"2024-03-04T13:13:17.459427+0000","last_clean":"2024-03-04T13:13:17.459427+0000","last_became_active":"2024-03-04T12:32:46.058792+0000","last_became_peered":"2024-03-04T12:32:46.058792+0000","last_unstale":"2024-03-04T13:13:17.459427+0000","last_undegraded":"2024-03-04T13:13:17.459427+0000","last_fullsized":"2024-03-04T13:13:17.459427+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:04:32.439128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:57.360698+0000","last_change":"2024-03-04T12:32:42.036922+0000","last_active":"2024-03-04T13:10:57.360698+0000","last_peered":"2024-03-04T13:10:57.360698+0000","last_clean":"2024-03-04T13:10:57.360698+0000","last_became_active":"2024-03-04T12:32:42.036427+0000","last_became_peered":"2024-03-04T12:32:42.036427+0000","last_unstale":"2024-03-04T13:10:57.360698+0000","last_undegraded":"2024-03-04T13:10:57.360698+0000","last_fullsized":"2024-03-04T13:10:57.360698+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:03:27.512996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"255'56","reported_seq":177,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.349999+0000","last_change":"2024-03-04T12:29:01.706989+0000","last_active":"2024-03-04T13:09:42.349999+0000","last_peered":"2024-03-04T13:09:42.349999+0000","last_clean":"2024-03-04T13:09:42.349999+0000","last_became_active":"2024-03-04T12:29:01.706666+0000","last_became_peered":"2024-03-04T12:29:01.706666+0000","last_unstale":"2024-03-04T13:09:42.349999+0000","last_undegraded":"2024-03-04T13:09:42.349999+0000","last_fullsized":"2024-03-04T13:09:42.349999+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:53:35.119335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":151,"num_write":99,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.458356+0000","last_change":"2024-03-04T12:46:22.257205+0000","last_active":"2024-03-04T13:11:07.458356+0000","last_peered":"2024-03-04T13:11:07.458356+0000","last_clean":"2024-03-04T13:11:07.458356+0000","last_became_active":"2024-03-04T12:46:22.256882+0000","last_became_peered":"2024-03-04T12:46:22.256882+0000","last_unstale":"2024-03-04T13:11:07.458356+0000","last_undegraded":"2024-03-04T13:11:07.458356+0000","last_fullsized":"2024-03-04T13:11:07.458356+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:56.552546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":40,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.506364+0000","last_change":"2024-03-04T12:32:46.057344+0000","last_active":"2024-03-04T13:11:02.506364+0000","last_peered":"2024-03-04T13:11:02.506364+0000","last_clean":"2024-03-04T13:11:02.506364+0000","last_became_active":"2024-03-04T12:32:46.057079+0000","last_became_peered":"2024-03-04T12:32:46.057079+0000","last_unstale":"2024-03-04T13:11:02.506364+0000","last_undegraded":"2024-03-04T13:11:02.506364+0000","last_fullsized":"2024-03-04T13:11:02.506364+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:12:31.155909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"255'8","reported_seq":66,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:17.472607+0000","last_change":"2024-03-04T12:32:42.035815+0000","last_active":"2024-03-04T13:13:17.472607+0000","last_peered":"2024-03-04T13:13:17.472607+0000","last_clean":"2024-03-04T13:13:17.472607+0000","last_became_active":"2024-03-04T12:32:42.035488+0000","last_became_peered":"2024-03-04T12:32:42.035488+0000","last_unstale":"2024-03-04T13:13:17.472607+0000","last_undegraded":"2024-03-04T13:13:17.472607+0000","last_fullsized":"2024-03-04T13:13:17.472607+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:01.448566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"255'14","reported_seq":79,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.473534+0000","last_change":"2024-03-04T12:29:01.707068+0000","last_active":"2024-03-04T13:09:32.473534+0000","last_peered":"2024-03-04T13:09:32.473534+0000","last_clean":"2024-03-04T13:09:32.473534+0000","last_became_active":"2024-03-04T12:29:01.706786+0000","last_became_peered":"2024-03-04T12:29:01.706786+0000","last_unstale":"2024-03-04T13:09:32.473534+0000","last_undegraded":"2024-03-04T13:09:32.473534+0000","last_fullsized":"2024-03-04T13:09:32.473534+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:37.249442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.458370+0000","last_change":"2024-03-04T12:46:22.259694+0000","last_active":"2024-03-04T13:11:07.458370+0000","last_peered":"2024-03-04T13:11:07.458370+0000","last_clean":"2024-03-04T13:11:07.458370+0000","last_became_active":"2024-03-04T12:46:22.259400+0000","last_became_peered":"2024-03-04T12:46:22.259400+0000","last_unstale":"2024-03-04T13:11:07.458370+0000","last_undegraded":"2024-03-04T13:11:07.458370+0000","last_fullsized":"2024-03-04T13:11:07.458370+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:17:32.594215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.533195+0000","last_change":"2024-03-04T12:32:46.051598+0000","last_active":"2024-03-04T13:08:52.533195+0000","last_peered":"2024-03-04T13:08:52.533195+0000","last_clean":"2024-03-04T13:08:52.533195+0000","last_became_active":"2024-03-04T12:32:46.051318+0000","last_became_peered":"2024-03-04T12:32:46.051318+0000","last_unstale":"2024-03-04T13:08:52.533195+0000","last_undegraded":"2024-03-04T13:08:52.533195+0000","last_fullsized":"2024-03-04T13:08:52.533195+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:16.567127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"255'10","reported_seq":63,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.458916+0000","last_change":"2024-03-04T12:32:42.036135+0000","last_active":"2024-03-04T13:13:12.458916+0000","last_peered":"2024-03-04T13:13:12.458916+0000","last_clean":"2024-03-04T13:13:12.458916+0000","last_became_active":"2024-03-04T12:32:42.035743+0000","last_became_peered":"2024-03-04T12:32:42.035743+0000","last_unstale":"2024-03-04T13:13:12.458916+0000","last_undegraded":"2024-03-04T13:13:12.458916+0000","last_fullsized":"2024-03-04T13:13:12.458916+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:11:55.738398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9243,"num_write":20,"num_write_kb":10267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"255'55","reported_seq":187,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.491385+0000","last_change":"2024-03-04T12:29:01.702750+0000","last_active":"2024-03-04T13:09:32.491385+0000","last_peered":"2024-03-04T13:09:32.491385+0000","last_clean":"2024-03-04T13:09:32.491385+0000","last_became_active":"2024-03-04T12:29:01.700933+0000","last_became_peered":"2024-03-04T12:29:01.700933+0000","last_unstale":"2024-03-04T13:09:32.491385+0000","last_undegraded":"2024-03-04T13:09:32.491385+0000","last_fullsized":"2024-03-04T13:09:32.491385+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:59:22.963300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":175,"num_write":86,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:57.533702+0000","last_change":"2024-03-04T12:46:22.310324+0000","last_active":"2024-03-04T13:08:57.533702+0000","last_peered":"2024-03-04T13:08:57.533702+0000","last_clean":"2024-03-04T13:08:57.533702+0000","last_became_active":"2024-03-04T12:46:22.310043+0000","last_became_peered":"2024-03-04T12:46:22.310043+0000","last_unstale":"2024-03-04T13:08:57.533702+0000","last_undegraded":"2024-03-04T13:08:57.533702+0000","last_fullsized":"2024-03-04T13:08:57.533702+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:12:22.140057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"250'3","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.450776+0000","last_change":"2024-03-04T12:32:46.056965+0000","last_active":"2024-03-04T13:11:02.450776+0000","last_peered":"2024-03-04T13:11:02.450776+0000","last_clean":"2024-03-04T13:11:02.450776+0000","last_became_active":"2024-03-04T12:32:46.056687+0000","last_became_peered":"2024-03-04T12:32:46.056687+0000","last_unstale":"2024-03-04T13:11:02.450776+0000","last_undegraded":"2024-03-04T13:11:02.450776+0000","last_fullsized":"2024-03-04T13:11:02.450776+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:06.808040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:57.484624+0000","last_change":"2024-03-04T12:32:42.036985+0000","last_active":"2024-03-04T13:10:57.484624+0000","last_peered":"2024-03-04T13:10:57.484624+0000","last_clean":"2024-03-04T13:10:57.484624+0000","last_became_active":"2024-03-04T12:32:42.036690+0000","last_became_peered":"2024-03-04T12:32:42.036690+0000","last_unstale":"2024-03-04T13:10:57.484624+0000","last_undegraded":"2024-03-04T13:10:57.484624+0000","last_fullsized":"2024-03-04T13:10:57.484624+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:33:40.882885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"0'0","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.348453+0000","last_change":"2024-03-04T12:29:01.701088+0000","last_active":"2024-03-04T13:09:32.348453+0000","last_peered":"2024-03-04T13:09:32.348453+0000","last_clean":"2024-03-04T13:09:32.348453+0000","last_became_active":"2024-03-04T12:29:01.700739+0000","last_became_peered":"2024-03-04T12:29:01.700739+0000","last_unstale":"2024-03-04T13:09:32.348453+0000","last_undegraded":"2024-03-04T13:09:32.348453+0000","last_fullsized":"2024-03-04T13:09:32.348453+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:24:34.666643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497750+0000","last_change":"2024-03-04T12:46:22.308562+0000","last_active":"2024-03-04T13:10:12.497750+0000","last_peered":"2024-03-04T13:10:12.497750+0000","last_clean":"2024-03-04T13:10:12.497750+0000","last_became_active":"2024-03-04T12:46:22.308300+0000","last_became_peered":"2024-03-04T12:46:22.308300+0000","last_unstale":"2024-03-04T13:10:12.497750+0000","last_undegraded":"2024-03-04T13:10:12.497750+0000","last_fullsized":"2024-03-04T13:10:12.497750+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:44:03.273585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":40,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:37.538309+0000","last_change":"2024-03-04T12:32:46.051902+0000","last_active":"2024-03-04T13:09:37.538309+0000","last_peered":"2024-03-04T13:09:37.538309+0000","last_clean":"2024-03-04T13:09:37.538309+0000","last_became_active":"2024-03-04T12:32:46.051614+0000","last_became_peered":"2024-03-04T12:32:46.051614+0000","last_unstale":"2024-03-04T13:09:37.538309+0000","last_undegraded":"2024-03-04T13:09:37.538309+0000","last_fullsized":"2024-03-04T13:09:37.538309+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:43:57.663077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.492975+0000","last_change":"2024-03-04T12:32:42.033609+0000","last_active":"2024-03-04T13:09:42.492975+0000","last_peered":"2024-03-04T13:09:42.492975+0000","last_clean":"2024-03-04T13:09:42.492975+0000","last_became_active":"2024-03-04T12:32:42.033182+0000","last_became_peered":"2024-03-04T12:32:42.033182+0000","last_unstale":"2024-03-04T13:09:42.492975+0000","last_undegraded":"2024-03-04T13:09:42.492975+0000","last_fullsized":"2024-03-04T13:09:42.492975+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:21.548201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"250'41","reported_seq":160,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.537725+0000","last_change":"2024-03-04T12:29:01.709192+0000","last_active":"2024-03-04T13:09:32.537725+0000","last_peered":"2024-03-04T13:09:32.537725+0000","last_clean":"2024-03-04T13:09:32.537725+0000","last_became_active":"2024-03-04T12:29:01.708876+0000","last_became_peered":"2024-03-04T12:29:01.708876+0000","last_unstale":"2024-03-04T13:09:32.537725+0000","last_undegraded":"2024-03-04T13:09:32.537725+0000","last_fullsized":"2024-03-04T13:09:32.537725+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:14:35.685901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":148,"num_write":55,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497742+0000","last_change":"2024-03-04T12:46:22.256922+0000","last_active":"2024-03-04T13:10:12.497742+0000","last_peered":"2024-03-04T13:10:12.497742+0000","last_clean":"2024-03-04T13:10:12.497742+0000","last_became_active":"2024-03-04T12:46:22.256617+0000","last_became_peered":"2024-03-04T12:46:22.256617+0000","last_unstale":"2024-03-04T13:10:12.497742+0000","last_undegraded":"2024-03-04T13:10:12.497742+0000","last_fullsized":"2024-03-04T13:10:12.497742+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:16:12.469482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"250'2","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:37.441469+0000","last_change":"2024-03-04T12:32:46.055551+0000","last_active":"2024-03-04T13:09:37.441469+0000","last_peered":"2024-03-04T13:09:37.441469+0000","last_clean":"2024-03-04T13:09:37.441469+0000","last_became_active":"2024-03-04T12:32:46.055321+0000","last_became_peered":"2024-03-04T12:32:46.055321+0000","last_unstale":"2024-03-04T13:09:37.441469+0000","last_undegraded":"2024-03-04T13:09:37.441469+0000","last_fullsized":"2024-03-04T13:09:37.441469+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:16.410422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"250'5","reported_seq":57,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:57.450237+0000","last_change":"2024-03-04T12:32:42.030944+0000","last_active":"2024-03-04T13:10:57.450237+0000","last_peered":"2024-03-04T13:10:57.450237+0000","last_clean":"2024-03-04T13:10:57.450237+0000","last_became_active":"2024-03-04T12:32:42.030512+0000","last_became_peered":"2024-03-04T12:32:42.030512+0000","last_unstale":"2024-03-04T13:10:57.450237+0000","last_undegraded":"2024-03-04T13:10:57.450237+0000","last_fullsized":"2024-03-04T13:10:57.450237+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:20.706121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"255'57","reported_seq":188,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.440412+0000","last_change":"2024-03-04T12:29:01.699812+0000","last_active":"2024-03-04T13:10:17.440412+0000","last_peered":"2024-03-04T13:10:17.440412+0000","last_clean":"2024-03-04T13:10:17.440412+0000","last_became_active":"2024-03-04T12:29:01.699507+0000","last_became_peered":"2024-03-04T12:29:01.699507+0000","last_unstale":"2024-03-04T13:10:17.440412+0000","last_undegraded":"2024-03-04T13:10:17.440412+0000","last_fullsized":"2024-03-04T13:10:17.440412+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:16:54.424195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":165,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498707+0000","last_change":"2024-03-04T12:46:22.256492+0000","last_active":"2024-03-04T13:10:17.498707+0000","last_peered":"2024-03-04T13:10:17.498707+0000","last_clean":"2024-03-04T13:10:17.498707+0000","last_became_active":"2024-03-04T12:46:22.256181+0000","last_became_peered":"2024-03-04T12:46:22.256181+0000","last_unstale":"2024-03-04T13:10:17.498707+0000","last_undegraded":"2024-03-04T13:10:17.498707+0000","last_fullsized":"2024-03-04T13:10:17.498707+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:08:40.855920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"255'8","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:17.530463+0000","last_change":"2024-03-04T12:32:46.045905+0000","last_active":"2024-03-04T13:13:17.530463+0000","last_peered":"2024-03-04T13:13:17.530463+0000","last_clean":"2024-03-04T13:13:17.530463+0000","last_became_active":"2024-03-04T12:32:46.045552+0000","last_became_peered":"2024-03-04T12:32:46.045552+0000","last_unstale":"2024-03-04T13:13:17.530463+0000","last_undegraded":"2024-03-04T13:13:17.530463+0000","last_fullsized":"2024-03-04T13:13:17.530463+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:26:04.913934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.473463+0000","last_change":"2024-03-04T12:32:42.036672+0000","last_active":"2024-03-04T13:09:32.473463+0000","last_peered":"2024-03-04T13:09:32.473463+0000","last_clean":"2024-03-04T13:09:32.473463+0000","last_became_active":"2024-03-04T12:32:42.035436+0000","last_became_peered":"2024-03-04T12:32:42.035436+0000","last_unstale":"2024-03-04T13:09:32.473463+0000","last_undegraded":"2024-03-04T13:09:32.473463+0000","last_fullsized":"2024-03-04T13:09:32.473463+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:12.296339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"255'54","reported_seq":179,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.439926+0000","last_change":"2024-03-04T12:29:01.705876+0000","last_active":"2024-03-04T13:10:12.439926+0000","last_peered":"2024-03-04T13:10:12.439926+0000","last_clean":"2024-03-04T13:10:12.439926+0000","last_became_active":"2024-03-04T12:29:01.704434+0000","last_became_peered":"2024-03-04T12:29:01.704434+0000","last_unstale":"2024-03-04T13:10:12.439926+0000","last_undegraded":"2024-03-04T13:10:12.439926+0000","last_fullsized":"2024-03-04T13:10:12.439926+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:09:02.530451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":154,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.533144+0000","last_change":"2024-03-04T12:46:22.257771+0000","last_active":"2024-03-04T13:08:52.533144+0000","last_peered":"2024-03-04T13:08:52.533144+0000","last_clean":"2024-03-04T13:08:52.533144+0000","last_became_active":"2024-03-04T12:46:22.257495+0000","last_became_peered":"2024-03-04T12:46:22.257495+0000","last_unstale":"2024-03-04T13:08:52.533144+0000","last_undegraded":"2024-03-04T13:08:52.533144+0000","last_fullsized":"2024-03-04T13:08:52.533144+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:35:28.573364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"255'3","reported_seq":43,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:52.456356+0000","last_change":"2024-03-04T12:32:46.057285+0000","last_active":"2024-03-04T13:11:52.456356+0000","last_peered":"2024-03-04T13:11:52.456356+0000","last_clean":"2024-03-04T13:11:52.456356+0000","last_became_active":"2024-03-04T12:32:46.056737+0000","last_became_peered":"2024-03-04T12:32:46.056737+0000","last_unstale":"2024-03-04T13:11:52.456356+0000","last_undegraded":"2024-03-04T13:11:52.456356+0000","last_fullsized":"2024-03-04T13:11:52.456356+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:23:08.710392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.447462+0000","last_change":"2024-03-04T12:32:42.029327+0000","last_active":"2024-03-04T13:09:32.447462+0000","last_peered":"2024-03-04T13:09:32.447462+0000","last_clean":"2024-03-04T13:09:32.447462+0000","last_became_active":"2024-03-04T12:32:42.029043+0000","last_became_peered":"2024-03-04T12:32:42.029043+0000","last_unstale":"2024-03-04T13:09:32.447462+0000","last_undegraded":"2024-03-04T13:09:32.447462+0000","last_fullsized":"2024-03-04T13:09:32.447462+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:27:12.022258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"255'45","reported_seq":156,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.478783+0000","last_change":"2024-03-04T12:29:01.702439+0000","last_active":"2024-03-04T13:10:12.478783+0000","last_peered":"2024-03-04T13:10:12.478783+0000","last_clean":"2024-03-04T13:10:12.478783+0000","last_became_active":"2024-03-04T12:29:01.702146+0000","last_became_peered":"2024-03-04T12:29:01.702146+0000","last_unstale":"2024-03-04T13:10:12.478783+0000","last_undegraded":"2024-03-04T13:10:12.478783+0000","last_fullsized":"2024-03-04T13:10:12.478783+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:16:58.177901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":123,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:17.438909+0000","last_change":"2024-03-04T12:46:22.311207+0000","last_active":"2024-03-04T13:09:17.438909+0000","last_peered":"2024-03-04T13:09:17.438909+0000","last_clean":"2024-03-04T13:09:17.438909+0000","last_became_active":"2024-03-04T12:46:22.310830+0000","last_became_peered":"2024-03-04T12:46:22.310830+0000","last_unstale":"2024-03-04T13:09:17.438909+0000","last_undegraded":"2024-03-04T13:09:17.438909+0000","last_fullsized":"2024-03-04T13:09:17.438909+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:24:30.083017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"255'2","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.454246+0000","last_change":"2024-03-04T12:32:46.058735+0000","last_active":"2024-03-04T13:12:27.454246+0000","last_peered":"2024-03-04T13:12:27.454246+0000","last_clean":"2024-03-04T13:12:27.454246+0000","last_became_active":"2024-03-04T12:32:46.058306+0000","last_became_peered":"2024-03-04T12:32:46.058306+0000","last_unstale":"2024-03-04T13:12:27.454246+0000","last_undegraded":"2024-03-04T13:12:27.454246+0000","last_fullsized":"2024-03-04T13:12:27.454246+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:23.146488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"255'5","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.995332+0000","last_change":"2024-03-04T12:32:42.035623+0000","last_active":"2024-03-04T13:13:20.995332+0000","last_peered":"2024-03-04T13:13:20.995332+0000","last_clean":"2024-03-04T13:13:20.995332+0000","last_became_active":"2024-03-04T12:32:42.035302+0000","last_became_peered":"2024-03-04T12:32:42.035302+0000","last_unstale":"2024-03-04T13:13:20.995332+0000","last_undegraded":"2024-03-04T13:13:20.995332+0000","last_fullsized":"2024-03-04T13:13:20.995332+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:30:11.132509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6192,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"255'41","reported_seq":154,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.439984+0000","last_change":"2024-03-04T12:29:01.707171+0000","last_active":"2024-03-04T13:10:12.439984+0000","last_peered":"2024-03-04T13:10:12.439984+0000","last_clean":"2024-03-04T13:10:12.439984+0000","last_became_active":"2024-03-04T12:29:01.706897+0000","last_became_peered":"2024-03-04T12:29:01.706897+0000","last_unstale":"2024-03-04T13:10:12.439984+0000","last_undegraded":"2024-03-04T13:10:12.439984+0000","last_fullsized":"2024-03-04T13:10:12.439984+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:46:21.234572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":127,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.439467+0000","last_change":"2024-03-04T12:46:22.253306+0000","last_active":"2024-03-04T13:09:22.439467+0000","last_peered":"2024-03-04T13:09:22.439467+0000","last_clean":"2024-03-04T13:09:22.439467+0000","last_became_active":"2024-03-04T12:46:22.252955+0000","last_became_peered":"2024-03-04T12:46:22.252955+0000","last_unstale":"2024-03-04T13:09:22.439467+0000","last_undegraded":"2024-03-04T13:09:22.439467+0000","last_fullsized":"2024-03-04T13:09:22.439467+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:46:23.427621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"255'11","reported_seq":63,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.183394+0000","last_change":"2024-03-04T12:32:46.056590+0000","last_active":"2024-03-04T13:13:21.183394+0000","last_peered":"2024-03-04T13:13:21.183394+0000","last_clean":"2024-03-04T13:13:21.183394+0000","last_became_active":"2024-03-04T12:32:46.056219+0000","last_became_peered":"2024-03-04T12:32:46.056219+0000","last_unstale":"2024-03-04T13:13:21.183394+0000","last_undegraded":"2024-03-04T13:13:21.183394+0000","last_fullsized":"2024-03-04T13:13:21.183394+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:43.098655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25600,"num_write":16,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"255'8","reported_seq":60,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.996709+0000","last_change":"2024-03-04T12:32:42.034819+0000","last_active":"2024-03-04T13:13:20.996709+0000","last_peered":"2024-03-04T13:13:20.996709+0000","last_clean":"2024-03-04T13:13:20.996709+0000","last_became_active":"2024-03-04T12:32:42.034556+0000","last_became_peered":"2024-03-04T12:32:42.034556+0000","last_unstale":"2024-03-04T13:13:20.996709+0000","last_undegraded":"2024-03-04T13:13:20.996709+0000","last_fullsized":"2024-03-04T13:13:20.996709+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:27.683103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12328,"num_write":8,"num_write_kb":12328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"255'42","reported_seq":147,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497950+0000","last_change":"2024-03-04T12:29:01.706878+0000","last_active":"2024-03-04T13:10:12.497950+0000","last_peered":"2024-03-04T13:10:12.497950+0000","last_clean":"2024-03-04T13:10:12.497950+0000","last_became_active":"2024-03-04T12:29:01.706549+0000","last_became_peered":"2024-03-04T12:29:01.706549+0000","last_unstale":"2024-03-04T13:10:12.497950+0000","last_undegraded":"2024-03-04T13:10:12.497950+0000","last_fullsized":"2024-03-04T13:10:12.497950+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:52:21.965189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":111,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"252'1","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497886+0000","last_change":"2024-03-04T12:46:22.254600+0000","last_active":"2024-03-04T13:10:12.497886+0000","last_peered":"2024-03-04T13:10:12.497886+0000","last_clean":"2024-03-04T13:10:12.497886+0000","last_became_active":"2024-03-04T12:46:22.254303+0000","last_became_peered":"2024-03-04T12:46:22.254303+0000","last_unstale":"2024-03-04T13:10:12.497886+0000","last_undegraded":"2024-03-04T13:10:12.497886+0000","last_fullsized":"2024-03-04T13:10:12.497886+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:56:13.243949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"255'3","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:47.514375+0000","last_change":"2024-03-04T12:32:46.055817+0000","last_active":"2024-03-04T13:11:47.514375+0000","last_peered":"2024-03-04T13:11:47.514375+0000","last_clean":"2024-03-04T13:11:47.514375+0000","last_became_active":"2024-03-04T12:32:46.055497+0000","last_became_peered":"2024-03-04T12:32:46.055497+0000","last_unstale":"2024-03-04T13:11:47.514375+0000","last_undegraded":"2024-03-04T13:11:47.514375+0000","last_fullsized":"2024-03-04T13:11:47.514375+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:51:26.771686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.542388+0000","last_change":"2024-03-04T12:32:42.036436+0000","last_active":"2024-03-04T13:10:12.542388+0000","last_peered":"2024-03-04T13:10:12.542388+0000","last_clean":"2024-03-04T13:10:12.542388+0000","last_became_active":"2024-03-04T12:32:42.036150+0000","last_became_peered":"2024-03-04T12:32:42.036150+0000","last_unstale":"2024-03-04T13:10:12.542388+0000","last_undegraded":"2024-03-04T13:10:12.542388+0000","last_fullsized":"2024-03-04T13:10:12.542388+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:31:48.514077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"255'68","reported_seq":270,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:52.360028+0000","last_change":"2024-03-04T12:29:01.700959+0000","last_active":"2024-03-04T13:10:52.360028+0000","last_peered":"2024-03-04T13:10:52.360028+0000","last_clean":"2024-03-04T13:10:52.360028+0000","last_became_active":"2024-03-04T12:29:01.700624+0000","last_became_peered":"2024-03-04T12:29:01.700624+0000","last_unstale":"2024-03-04T13:10:52.360028+0000","last_undegraded":"2024-03-04T13:10:52.360028+0000","last_fullsized":"2024-03-04T13:10:52.360028+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:04.670734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":295,"num_write":88,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497975+0000","last_change":"2024-03-04T12:46:22.309757+0000","last_active":"2024-03-04T13:10:12.497975+0000","last_peered":"2024-03-04T13:10:12.497975+0000","last_clean":"2024-03-04T13:10:12.497975+0000","last_became_active":"2024-03-04T12:46:22.309493+0000","last_became_peered":"2024-03-04T12:46:22.309493+0000","last_unstale":"2024-03-04T13:10:12.497975+0000","last_undegraded":"2024-03-04T13:10:12.497975+0000","last_fullsized":"2024-03-04T13:10:12.497975+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:56.850351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"255'10","reported_seq":61,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.190787+0000","last_change":"2024-03-04T12:32:46.054533+0000","last_active":"2024-03-04T13:13:21.190787+0000","last_peered":"2024-03-04T13:13:21.190787+0000","last_clean":"2024-03-04T13:13:21.190787+0000","last_became_active":"2024-03-04T12:32:46.054256+0000","last_became_peered":"2024-03-04T12:32:46.054256+0000","last_unstale":"2024-03-04T13:13:21.190787+0000","last_undegraded":"2024-03-04T13:13:21.190787+0000","last_fullsized":"2024-03-04T13:13:21.190787+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:56:03.550607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":16480,"num_write":15,"num_write_kb":11320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499619+0000","last_change":"2024-03-04T12:32:42.035988+0000","last_active":"2024-03-04T13:10:22.499619+0000","last_peered":"2024-03-04T13:10:22.499619+0000","last_clean":"2024-03-04T13:10:22.499619+0000","last_became_active":"2024-03-04T12:32:42.035683+0000","last_became_peered":"2024-03-04T12:32:42.035683+0000","last_unstale":"2024-03-04T13:10:22.499619+0000","last_undegraded":"2024-03-04T13:10:22.499619+0000","last_fullsized":"2024-03-04T13:10:22.499619+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:02:00.359791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"255'43","reported_seq":144,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.503035+0000","last_change":"2024-03-04T12:29:01.701803+0000","last_active":"2024-03-04T13:10:42.503035+0000","last_peered":"2024-03-04T13:10:42.503035+0000","last_clean":"2024-03-04T13:10:42.503035+0000","last_became_active":"2024-03-04T12:29:01.701396+0000","last_became_peered":"2024-03-04T12:29:01.701396+0000","last_unstale":"2024-03-04T13:10:42.503035+0000","last_undegraded":"2024-03-04T13:10:42.503035+0000","last_fullsized":"2024-03-04T13:10:42.503035+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:53:53.242346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.356344+0000","last_change":"2024-03-04T12:46:22.260088+0000","last_active":"2024-03-04T13:10:27.356344+0000","last_peered":"2024-03-04T13:10:27.356344+0000","last_clean":"2024-03-04T13:10:27.356344+0000","last_became_active":"2024-03-04T12:46:22.259763+0000","last_became_peered":"2024-03-04T12:46:22.259763+0000","last_unstale":"2024-03-04T13:10:27.356344+0000","last_undegraded":"2024-03-04T13:10:27.356344+0000","last_fullsized":"2024-03-04T13:10:27.356344+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:33.450477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"255'5","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.032505+0000","last_change":"2024-03-04T12:32:46.057881+0000","last_active":"2024-03-04T13:13:21.032505+0000","last_peered":"2024-03-04T13:13:21.032505+0000","last_clean":"2024-03-04T13:13:21.032505+0000","last_became_active":"2024-03-04T12:32:46.057646+0000","last_became_peered":"2024-03-04T12:32:46.057646+0000","last_unstale":"2024-03-04T13:13:21.032505+0000","last_undegraded":"2024-03-04T13:13:21.032505+0000","last_fullsized":"2024-03-04T13:13:21.032505+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:26:52.859284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5168,"num_write":5,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"255'2","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:17.519439+0000","last_change":"2024-03-04T12:32:42.027057+0000","last_active":"2024-03-04T13:12:17.519439+0000","last_peered":"2024-03-04T13:12:17.519439+0000","last_clean":"2024-03-04T13:12:17.519439+0000","last_became_active":"2024-03-04T12:32:42.026771+0000","last_became_peered":"2024-03-04T12:32:42.026771+0000","last_unstale":"2024-03-04T13:12:17.519439+0000","last_undegraded":"2024-03-04T13:12:17.519439+0000","last_fullsized":"2024-03-04T13:12:17.519439+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:49:21.026487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"255'43","reported_seq":153,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.455774+0000","last_change":"2024-03-04T12:29:01.702097+0000","last_active":"2024-03-04T13:10:42.455774+0000","last_peered":"2024-03-04T13:10:42.455774+0000","last_clean":"2024-03-04T13:10:42.455774+0000","last_became_active":"2024-03-04T12:29:01.701812+0000","last_became_peered":"2024-03-04T12:29:01.701812+0000","last_unstale":"2024-03-04T13:10:42.455774+0000","last_undegraded":"2024-03-04T13:10:42.455774+0000","last_fullsized":"2024-03-04T13:10:42.455774+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:59:24.881817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":121,"num_write":82,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:17.535979+0000","last_change":"2024-03-04T12:46:22.247949+0000","last_active":"2024-03-04T13:09:17.535979+0000","last_peered":"2024-03-04T13:09:17.535979+0000","last_clean":"2024-03-04T13:09:17.535979+0000","last_became_active":"2024-03-04T12:46:22.247655+0000","last_became_peered":"2024-03-04T12:46:22.247655+0000","last_unstale":"2024-03-04T13:09:17.535979+0000","last_undegraded":"2024-03-04T13:09:17.535979+0000","last_fullsized":"2024-03-04T13:09:17.535979+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:28.814124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"255'3","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.526860+0000","last_change":"2024-03-04T12:32:46.058700+0000","last_active":"2024-03-04T13:12:57.526860+0000","last_peered":"2024-03-04T13:12:57.526860+0000","last_clean":"2024-03-04T13:12:57.526860+0000","last_became_active":"2024-03-04T12:32:46.058466+0000","last_became_peered":"2024-03-04T12:32:46.058466+0000","last_unstale":"2024-03-04T13:12:57.526860+0000","last_undegraded":"2024-03-04T13:12:57.526860+0000","last_fullsized":"2024-03-04T13:12:57.526860+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:45:44.721969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.354089+0000","last_change":"2024-03-04T12:32:42.031684+0000","last_active":"2024-03-04T13:10:12.354089+0000","last_peered":"2024-03-04T13:10:12.354089+0000","last_clean":"2024-03-04T13:10:12.354089+0000","last_became_active":"2024-03-04T12:32:42.031410+0000","last_became_peered":"2024-03-04T12:32:42.031410+0000","last_unstale":"2024-03-04T13:10:12.354089+0000","last_undegraded":"2024-03-04T13:10:12.354089+0000","last_fullsized":"2024-03-04T13:10:12.354089+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:20:00.365398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"255'27","reported_seq":115,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.482916+0000","last_change":"2024-03-04T12:29:01.703669+0000","last_active":"2024-03-04T13:10:42.482916+0000","last_peered":"2024-03-04T13:10:42.482916+0000","last_clean":"2024-03-04T13:10:42.482916+0000","last_became_active":"2024-03-04T12:29:01.703420+0000","last_became_peered":"2024-03-04T12:29:01.703420+0000","last_unstale":"2024-03-04T13:10:42.482916+0000","last_undegraded":"2024-03-04T13:10:42.482916+0000","last_fullsized":"2024-03-04T13:10:42.482916+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:31:39.634520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":74,"num_write":42,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:17.489139+0000","last_change":"2024-03-04T12:46:22.250162+0000","last_active":"2024-03-04T13:09:17.489139+0000","last_peered":"2024-03-04T13:09:17.489139+0000","last_clean":"2024-03-04T13:09:17.489139+0000","last_became_active":"2024-03-04T12:46:22.249854+0000","last_became_peered":"2024-03-04T12:46:22.249854+0000","last_unstale":"2024-03-04T13:09:17.489139+0000","last_undegraded":"2024-03-04T13:09:17.489139+0000","last_fullsized":"2024-03-04T13:09:17.489139+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:41:19.298108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":41,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.479555+0000","last_change":"2024-03-04T12:32:46.051913+0000","last_active":"2024-03-04T13:10:17.479555+0000","last_peered":"2024-03-04T13:10:17.479555+0000","last_clean":"2024-03-04T13:10:17.479555+0000","last_became_active":"2024-03-04T12:32:46.051498+0000","last_became_peered":"2024-03-04T12:32:46.051498+0000","last_unstale":"2024-03-04T13:10:17.479555+0000","last_undegraded":"2024-03-04T13:10:17.479555+0000","last_fullsized":"2024-03-04T13:10:17.479555+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:31:49.935678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"255'6","reported_seq":61,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:52.525983+0000","last_change":"2024-03-04T12:32:42.038655+0000","last_active":"2024-03-04T13:12:52.525983+0000","last_peered":"2024-03-04T13:12:52.525983+0000","last_clean":"2024-03-04T13:12:52.525983+0000","last_became_active":"2024-03-04T12:32:42.038349+0000","last_became_peered":"2024-03-04T12:32:42.038349+0000","last_unstale":"2024-03-04T13:12:52.525983+0000","last_undegraded":"2024-03-04T13:12:52.525983+0000","last_fullsized":"2024-03-04T13:12:52.525983+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:35:57.593667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"255'90","reported_seq":258,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.358360+0000","last_change":"2024-03-04T12:29:01.701552+0000","last_active":"2024-03-04T13:10:42.358360+0000","last_peered":"2024-03-04T13:10:42.358360+0000","last_clean":"2024-03-04T13:10:42.358360+0000","last_became_active":"2024-03-04T12:29:01.701282+0000","last_became_peered":"2024-03-04T12:29:01.701282+0000","last_unstale":"2024-03-04T13:10:42.358360+0000","last_undegraded":"2024-03-04T13:10:42.358360+0000","last_fullsized":"2024-03-04T13:10:42.358360+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:31:15.249708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":354,"num_read_kb":252,"num_write":156,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:17.471339+0000","last_change":"2024-03-04T12:46:22.259364+0000","last_active":"2024-03-04T13:09:17.471339+0000","last_peered":"2024-03-04T13:09:17.471339+0000","last_clean":"2024-03-04T13:09:17.471339+0000","last_became_active":"2024-03-04T12:46:22.258936+0000","last_became_peered":"2024-03-04T12:46:22.258936+0000","last_unstale":"2024-03-04T13:09:17.471339+0000","last_undegraded":"2024-03-04T13:09:17.471339+0000","last_fullsized":"2024-03-04T13:09:17.471339+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:15:52.268943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":41,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.542901+0000","last_change":"2024-03-04T12:32:46.053786+0000","last_active":"2024-03-04T13:10:17.542901+0000","last_peered":"2024-03-04T13:10:17.542901+0000","last_clean":"2024-03-04T13:10:17.542901+0000","last_became_active":"2024-03-04T12:32:46.053456+0000","last_became_peered":"2024-03-04T12:32:46.053456+0000","last_unstale":"2024-03-04T13:10:17.542901+0000","last_undegraded":"2024-03-04T13:10:17.542901+0000","last_fullsized":"2024-03-04T13:10:17.542901+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:10.231648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.478815+0000","last_change":"2024-03-04T12:32:42.035705+0000","last_active":"2024-03-04T13:10:12.478815+0000","last_peered":"2024-03-04T13:10:12.478815+0000","last_clean":"2024-03-04T13:10:12.478815+0000","last_became_active":"2024-03-04T12:32:42.035413+0000","last_became_peered":"2024-03-04T12:32:42.035413+0000","last_unstale":"2024-03-04T13:10:12.478815+0000","last_undegraded":"2024-03-04T13:10:12.478815+0000","last_fullsized":"2024-03-04T13:10:12.478815+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:30:04.933989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"255'17","reported_seq":94,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.445657+0000","last_change":"2024-03-04T12:29:01.702839+0000","last_active":"2024-03-04T13:11:07.445657+0000","last_peered":"2024-03-04T13:11:07.445657+0000","last_clean":"2024-03-04T13:11:07.445657+0000","last_became_active":"2024-03-04T12:29:01.702555+0000","last_became_peered":"2024-03-04T12:29:01.702555+0000","last_unstale":"2024-03-04T13:11:07.445657+0000","last_undegraded":"2024-03-04T13:11:07.445657+0000","last_fullsized":"2024-03-04T13:11:07.445657+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:55:13.316774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":47,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"255'178","reported_seq":782,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.182995+0000","last_change":"2024-03-04T12:20:14.820927+0000","last_active":"2024-03-04T13:13:21.182995+0000","last_peered":"2024-03-04T13:13:21.182995+0000","last_clean":"2024-03-04T13:13:21.182995+0000","last_became_active":"2024-03-04T12:20:14.820595+0000","last_became_peered":"2024-03-04T12:20:14.820595+0000","last_unstale":"2024-03-04T13:13:21.182995+0000","last_undegraded":"2024-03-04T13:13:21.182995+0000","last_fullsized":"2024-03-04T13:13:21.182995+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:07:18.920479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":457,"num_write":1012,"num_write_kb":11218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"255'475","reported_seq":1778,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.976981+0000","last_change":"2024-03-04T12:20:16.828823+0000","last_active":"2024-03-04T13:12:36.976981+0000","last_peered":"2024-03-04T13:12:36.976981+0000","last_clean":"2024-03-04T13:12:36.976981+0000","last_became_active":"2024-03-04T12:20:16.828539+0000","last_became_peered":"2024-03-04T12:20:16.828539+0000","last_unstale":"2024-03-04T13:12:36.976981+0000","last_undegraded":"2024-03-04T13:12:36.976981+0000","last_fullsized":"2024-03-04T13:12:36.976981+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:22:24.173643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2301,"num_read_kb":2121,"num_write":643,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"255'219","reported_seq":869,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:35.776295+0000","last_change":"2024-03-04T12:20:14.815583+0000","last_active":"2024-03-04T13:12:35.776295+0000","last_peered":"2024-03-04T13:12:35.776295+0000","last_clean":"2024-03-04T13:12:35.776295+0000","last_became_active":"2024-03-04T12:20:14.814863+0000","last_became_peered":"2024-03-04T12:20:14.814863+0000","last_unstale":"2024-03-04T13:12:35.776295+0000","last_undegraded":"2024-03-04T13:12:35.776295+0000","last_fullsized":"2024-03-04T13:12:35.776295+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:13:54.813411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9034256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":516,"num_read_kb":15449,"num_write":1322,"num_write_kb":40818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"255'559","reported_seq":1909,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573307+0000","last_change":"2024-03-04T12:20:16.837515+0000","last_active":"2024-03-04T13:12:50.573307+0000","last_peered":"2024-03-04T13:12:50.573307+0000","last_clean":"2024-03-04T13:12:50.573307+0000","last_became_active":"2024-03-04T12:20:16.837200+0000","last_became_peered":"2024-03-04T12:20:16.837200+0000","last_unstale":"2024-03-04T13:12:50.573307+0000","last_undegraded":"2024-03-04T13:12:50.573307+0000","last_fullsized":"2024-03-04T13:12:50.573307+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:27.972671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2594,"num_read_kb":2289,"num_write":764,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"255'155","reported_seq":747,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.163314+0000","last_change":"2024-03-04T12:20:14.816919+0000","last_active":"2024-03-04T13:13:21.163314+0000","last_peered":"2024-03-04T13:13:21.163314+0000","last_clean":"2024-03-04T13:13:21.163314+0000","last_became_active":"2024-03-04T12:20:14.816597+0000","last_became_peered":"2024-03-04T12:20:14.816597+0000","last_unstale":"2024-03-04T13:13:21.163314+0000","last_undegraded":"2024-03-04T13:13:21.163314+0000","last_fullsized":"2024-03-04T13:13:21.163314+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:22:06.737898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":326,"num_read_kb":1168,"num_write":917,"num_write_kb":5749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"255'452","reported_seq":1950,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:08.259447+0000","last_change":"2024-03-04T12:20:16.821071+0000","last_active":"2024-03-04T13:12:08.259447+0000","last_peered":"2024-03-04T13:12:08.259447+0000","last_clean":"2024-03-04T13:12:08.259447+0000","last_became_active":"2024-03-04T12:20:16.820419+0000","last_became_peered":"2024-03-04T12:20:16.820419+0000","last_unstale":"2024-03-04T13:12:08.259447+0000","last_undegraded":"2024-03-04T13:12:08.259447+0000","last_fullsized":"2024-03-04T13:12:08.259447+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:43.521050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2318,"num_read_kb":2161,"num_write":537,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"255'245","reported_seq":882,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.373607+0000","last_change":"2024-03-04T12:20:14.826502+0000","last_active":"2024-03-04T13:12:27.373607+0000","last_peered":"2024-03-04T13:12:27.373607+0000","last_clean":"2024-03-04T13:12:27.373607+0000","last_became_active":"2024-03-04T12:20:14.824779+0000","last_became_peered":"2024-03-04T12:20:14.824779+0000","last_unstale":"2024-03-04T13:12:27.373607+0000","last_undegraded":"2024-03-04T13:12:27.373607+0000","last_fullsized":"2024-03-04T13:12:27.373607+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:29.747512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4160401,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":13558,"num_write":1376,"num_write_kb":36455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"255'351","reported_seq":1793,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.327892+0000","last_change":"2024-03-04T12:20:16.828116+0000","last_active":"2024-03-04T13:12:39.327892+0000","last_peered":"2024-03-04T13:12:39.327892+0000","last_clean":"2024-03-04T13:12:39.327892+0000","last_became_active":"2024-03-04T12:20:16.827613+0000","last_became_peered":"2024-03-04T12:20:16.827613+0000","last_unstale":"2024-03-04T13:12:39.327892+0000","last_undegraded":"2024-03-04T13:12:39.327892+0000","last_fullsized":"2024-03-04T13:12:39.327892+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:56:19.430664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1915,"num_read_kb":1843,"num_write":383,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"255'195","reported_seq":834,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.096823+0000","last_change":"2024-03-04T12:20:14.816830+0000","last_active":"2024-03-04T13:13:21.096823+0000","last_peered":"2024-03-04T13:13:21.096823+0000","last_clean":"2024-03-04T13:13:21.096823+0000","last_became_active":"2024-03-04T12:20:14.816532+0000","last_became_peered":"2024-03-04T12:20:14.816532+0000","last_unstale":"2024-03-04T13:13:21.096823+0000","last_undegraded":"2024-03-04T13:13:21.096823+0000","last_fullsized":"2024-03-04T13:13:21.096823+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:37:37.790276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5789792,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":440,"num_read_kb":58154,"num_write":1069,"num_write_kb":58795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"255'405","reported_seq":2045,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.099180+0000","last_change":"2024-03-04T12:20:16.816980+0000","last_active":"2024-03-04T13:12:31.099180+0000","last_peered":"2024-03-04T13:12:31.099180+0000","last_clean":"2024-03-04T13:12:31.099180+0000","last_became_active":"2024-03-04T12:20:16.816688+0000","last_became_peered":"2024-03-04T12:20:16.816688+0000","last_unstale":"2024-03-04T13:12:31.099180+0000","last_undegraded":"2024-03-04T13:12:31.099180+0000","last_fullsized":"2024-03-04T13:12:31.099180+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:36:29.402179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2407,"num_read_kb":2304,"num_write":479,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"255'170","reported_seq":750,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.063180+0000","last_change":"2024-03-04T12:20:51.031065+0000","last_active":"2024-03-04T13:12:12.063180+0000","last_peered":"2024-03-04T13:12:12.063180+0000","last_clean":"2024-03-04T13:12:12.063180+0000","last_became_active":"2024-03-04T12:20:51.030709+0000","last_became_peered":"2024-03-04T12:20:51.030709+0000","last_unstale":"2024-03-04T13:12:12.063180+0000","last_undegraded":"2024-03-04T13:12:12.063180+0000","last_fullsized":"2024-03-04T13:12:12.063180+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:16:42.363646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13826798,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":359,"num_read_kb":29477,"num_write":994,"num_write_kb":29693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"255'775","reported_seq":2153,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.309100+0000","last_change":"2024-03-04T12:20:16.825330+0000","last_active":"2024-03-04T13:12:39.309100+0000","last_peered":"2024-03-04T13:12:39.309100+0000","last_clean":"2024-03-04T13:12:39.309100+0000","last_became_active":"2024-03-04T12:20:16.822282+0000","last_became_peered":"2024-03-04T12:20:16.822282+0000","last_unstale":"2024-03-04T13:12:39.309100+0000","last_undegraded":"2024-03-04T13:12:39.309100+0000","last_fullsized":"2024-03-04T13:12:39.309100+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:56:51.893473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3372,"num_read_kb":2974,"num_write":1065,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"255'195","reported_seq":826,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.101704+0000","last_change":"2024-03-04T12:20:14.815689+0000","last_active":"2024-03-04T13:13:21.101704+0000","last_peered":"2024-03-04T13:13:21.101704+0000","last_clean":"2024-03-04T13:13:21.101704+0000","last_became_active":"2024-03-04T12:20:14.815388+0000","last_became_peered":"2024-03-04T12:20:14.815388+0000","last_unstale":"2024-03-04T13:13:21.101704+0000","last_undegraded":"2024-03-04T13:13:21.101704+0000","last_fullsized":"2024-03-04T13:13:21.101704+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:43:25.448300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262238,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":61923,"num_write":1063,"num_write_kb":47041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"255'684","reported_seq":2154,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.557057+0000","last_change":"2024-03-04T12:20:16.833569+0000","last_active":"2024-03-04T13:12:22.557057+0000","last_peered":"2024-03-04T13:12:22.557057+0000","last_clean":"2024-03-04T13:12:22.557057+0000","last_became_active":"2024-03-04T12:20:16.833268+0000","last_became_peered":"2024-03-04T12:20:16.833268+0000","last_unstale":"2024-03-04T13:12:22.557057+0000","last_undegraded":"2024-03-04T13:12:22.557057+0000","last_fullsized":"2024-03-04T13:12:22.557057+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:17.714462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3214,"num_read_kb":2906,"num_write":892,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"255'232","reported_seq":873,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.181027+0000","last_change":"2024-03-04T12:20:14.828265+0000","last_active":"2024-03-04T13:13:21.181027+0000","last_peered":"2024-03-04T13:13:21.181027+0000","last_clean":"2024-03-04T13:13:21.181027+0000","last_became_active":"2024-03-04T12:20:14.827948+0000","last_became_peered":"2024-03-04T12:20:14.827948+0000","last_unstale":"2024-03-04T13:13:21.181027+0000","last_undegraded":"2024-03-04T13:13:21.181027+0000","last_fullsized":"2024-03-04T13:13:21.181027+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:04:36.496722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2119867,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":498,"num_read_kb":35496,"num_write":1177,"num_write_kb":50438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"255'329","reported_seq":1701,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.953895+0000","last_change":"2024-03-04T12:20:16.831041+0000","last_active":"2024-03-04T13:12:36.953895+0000","last_peered":"2024-03-04T13:12:36.953895+0000","last_clean":"2024-03-04T13:12:36.953895+0000","last_became_active":"2024-03-04T12:20:16.830773+0000","last_became_peered":"2024-03-04T12:20:16.830773+0000","last_unstale":"2024-03-04T13:12:36.953895+0000","last_undegraded":"2024-03-04T13:12:36.953895+0000","last_fullsized":"2024-03-04T13:12:36.953895+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:29:14.244772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1823,"num_read_kb":1743,"num_write":376,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"255'403","reported_seq":1977,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.059106+0000","last_change":"2024-03-04T12:20:16.820827+0000","last_active":"2024-03-04T13:12:18.059106+0000","last_peered":"2024-03-04T13:12:18.059106+0000","last_clean":"2024-03-04T13:12:18.059106+0000","last_became_active":"2024-03-04T12:20:16.820533+0000","last_became_peered":"2024-03-04T12:20:16.820533+0000","last_unstale":"2024-03-04T13:12:18.059106+0000","last_undegraded":"2024-03-04T13:12:18.059106+0000","last_fullsized":"2024-03-04T13:12:18.059106+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:23:30.720165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2265,"num_read_kb":2155,"num_write":466,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"255'193","reported_seq":823,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:12.508125+0000","last_change":"2024-03-04T12:20:14.820881+0000","last_active":"2024-03-04T13:11:12.508125+0000","last_peered":"2024-03-04T13:11:12.508125+0000","last_clean":"2024-03-04T13:11:12.508125+0000","last_became_active":"2024-03-04T12:20:14.820248+0000","last_became_peered":"2024-03-04T12:20:14.820248+0000","last_unstale":"2024-03-04T13:11:12.508125+0000","last_undegraded":"2024-03-04T13:11:12.508125+0000","last_fullsized":"2024-03-04T13:11:12.508125+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:59:02.821081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847147,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":428,"num_read_kb":15441,"num_write":1092,"num_write_kb":31882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"255'1140","reported_seq":2690,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573468+0000","last_change":"2024-03-04T12:20:16.837314+0000","last_active":"2024-03-04T13:12:50.573468+0000","last_peered":"2024-03-04T13:12:50.573468+0000","last_clean":"2024-03-04T13:12:50.573468+0000","last_became_active":"2024-03-04T12:20:16.837126+0000","last_became_peered":"2024-03-04T12:20:16.837126+0000","last_unstale":"2024-03-04T13:12:50.573468+0000","last_undegraded":"2024-03-04T13:12:50.573468+0000","last_fullsized":"2024-03-04T13:12:50.573468+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:39:46.380503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4770,"num_read_kb":4178,"num_write":1557,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"255'198","reported_seq":813,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.115479+0000","last_change":"2024-03-04T12:20:14.824468+0000","last_active":"2024-03-04T13:13:21.115479+0000","last_peered":"2024-03-04T13:13:21.115479+0000","last_clean":"2024-03-04T13:13:21.115479+0000","last_became_active":"2024-03-04T12:20:14.824133+0000","last_became_peered":"2024-03-04T12:20:14.824133+0000","last_unstale":"2024-03-04T13:13:21.115479+0000","last_undegraded":"2024-03-04T13:13:21.115479+0000","last_fullsized":"2024-03-04T13:13:21.115479+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:58:01.156356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399138,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":430,"num_read_kb":9751,"num_write":1008,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"255'738","reported_seq":2185,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.777698+0000","last_change":"2024-03-04T12:20:16.825766+0000","last_active":"2024-03-04T13:12:34.777698+0000","last_peered":"2024-03-04T13:12:34.777698+0000","last_clean":"2024-03-04T13:12:34.777698+0000","last_became_active":"2024-03-04T12:20:16.825499+0000","last_became_peered":"2024-03-04T12:20:16.825499+0000","last_unstale":"2024-03-04T13:12:34.777698+0000","last_undegraded":"2024-03-04T13:12:34.777698+0000","last_fullsized":"2024-03-04T13:12:34.777698+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:43:04.157793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3318,"num_read_kb":2969,"num_write":989,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"255'240","reported_seq":871,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.228733+0000","last_change":"2024-03-04T12:20:14.828323+0000","last_active":"2024-03-04T13:13:21.228733+0000","last_peered":"2024-03-04T13:13:21.228733+0000","last_clean":"2024-03-04T13:13:21.228733+0000","last_became_active":"2024-03-04T12:20:14.827979+0000","last_became_peered":"2024-03-04T12:20:14.827979+0000","last_unstale":"2024-03-04T13:13:21.228733+0000","last_undegraded":"2024-03-04T13:13:21.228733+0000","last_fullsized":"2024-03-04T13:13:21.228733+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:12:15.676059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":577599,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":7999,"num_write":1192,"num_write_kb":30331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"255'777","reported_seq":2213,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:20.376868+0000","last_change":"2024-03-04T12:20:16.826162+0000","last_active":"2024-03-04T13:12:20.376868+0000","last_peered":"2024-03-04T13:12:20.376868+0000","last_clean":"2024-03-04T13:12:20.376868+0000","last_became_active":"2024-03-04T12:20:16.825897+0000","last_became_peered":"2024-03-04T12:20:16.825897+0000","last_unstale":"2024-03-04T13:12:20.376868+0000","last_undegraded":"2024-03-04T13:12:20.376868+0000","last_fullsized":"2024-03-04T13:12:20.376868+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:45:52.489712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3571,"num_read_kb":3184,"num_write":1054,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"255'154","reported_seq":753,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.180904+0000","last_change":"2024-03-04T12:20:14.824375+0000","last_active":"2024-03-04T13:13:21.180904+0000","last_peered":"2024-03-04T13:13:21.180904+0000","last_clean":"2024-03-04T13:13:21.180904+0000","last_became_active":"2024-03-04T12:20:14.823430+0000","last_became_peered":"2024-03-04T12:20:14.823430+0000","last_unstale":"2024-03-04T13:13:21.180904+0000","last_undegraded":"2024-03-04T13:13:21.180904+0000","last_fullsized":"2024-03-04T13:13:21.180904+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:00:47.840698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1683023,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":325,"num_read_kb":32856,"num_write":784,"num_write_kb":22354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"255'556","reported_seq":2086,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:37.308042+0000","last_change":"2024-03-04T12:20:16.830040+0000","last_active":"2024-03-04T13:12:37.308042+0000","last_peered":"2024-03-04T13:12:37.308042+0000","last_clean":"2024-03-04T13:12:37.308042+0000","last_became_active":"2024-03-04T12:20:16.829685+0000","last_became_peered":"2024-03-04T12:20:16.829685+0000","last_unstale":"2024-03-04T13:12:37.308042+0000","last_undegraded":"2024-03-04T13:12:37.308042+0000","last_fullsized":"2024-03-04T13:12:37.308042+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:39:48.525836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2792,"num_read_kb":2527,"num_write":750,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"255'193","reported_seq":775,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:19.681138+0000","last_change":"2024-03-04T12:20:14.822181+0000","last_active":"2024-03-04T13:09:19.681138+0000","last_peered":"2024-03-04T13:09:19.681138+0000","last_clean":"2024-03-04T13:09:19.681138+0000","last_became_active":"2024-03-04T12:20:14.821923+0000","last_became_peered":"2024-03-04T12:20:14.821923+0000","last_unstale":"2024-03-04T13:09:19.681138+0000","last_undegraded":"2024-03-04T13:09:19.681138+0000","last_fullsized":"2024-03-04T13:09:19.681138+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:23:35.278346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":428,"num_write":1012,"num_write_kb":16985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"255'373","reported_seq":1788,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.098146+0000","last_change":"2024-03-04T12:20:16.826907+0000","last_active":"2024-03-04T13:12:31.098146+0000","last_peered":"2024-03-04T13:12:31.098146+0000","last_clean":"2024-03-04T13:12:31.098146+0000","last_became_active":"2024-03-04T12:20:16.826208+0000","last_became_peered":"2024-03-04T12:20:16.826208+0000","last_unstale":"2024-03-04T13:12:31.098146+0000","last_undegraded":"2024-03-04T13:12:31.098146+0000","last_fullsized":"2024-03-04T13:12:31.098146+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:48:38.580682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1988,"num_read_kb":1881,"num_write":441,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"255'173","reported_seq":777,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.206884+0000","last_change":"2024-03-04T12:20:14.812110+0000","last_active":"2024-03-04T13:13:21.206884+0000","last_peered":"2024-03-04T13:13:21.206884+0000","last_clean":"2024-03-04T13:13:21.206884+0000","last_became_active":"2024-03-04T12:20:14.811813+0000","last_became_peered":"2024-03-04T12:20:14.811813+0000","last_unstale":"2024-03-04T13:13:21.206884+0000","last_undegraded":"2024-03-04T13:13:21.206884+0000","last_fullsized":"2024-03-04T13:13:21.206884+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:16:22.043018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":397,"num_read_kb":4485,"num_write":973,"num_write_kb":10922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"255'93","reported_seq":579,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:15.761317+0000","last_change":"2024-03-04T12:20:24.871376+0000","last_active":"2024-03-04T13:12:15.761317+0000","last_peered":"2024-03-04T13:12:15.761317+0000","last_clean":"2024-03-04T13:12:15.761317+0000","last_became_active":"2024-03-04T12:20:24.871089+0000","last_became_peered":"2024-03-04T12:20:24.871089+0000","last_unstale":"2024-03-04T13:12:15.761317+0000","last_undegraded":"2024-03-04T13:12:15.761317+0000","last_fullsized":"2024-03-04T13:12:15.761317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:35.987784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":97,"num_write":227,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"255'790","reported_seq":2212,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.056199+0000","last_change":"2024-03-04T12:20:16.829280+0000","last_active":"2024-03-04T13:12:18.056199+0000","last_peered":"2024-03-04T13:12:18.056199+0000","last_clean":"2024-03-04T13:12:18.056199+0000","last_became_active":"2024-03-04T12:20:16.828977+0000","last_became_peered":"2024-03-04T12:20:16.828977+0000","last_unstale":"2024-03-04T13:12:18.056199+0000","last_undegraded":"2024-03-04T13:12:18.056199+0000","last_fullsized":"2024-03-04T13:12:18.056199+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:08:11.691344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3439,"num_read_kb":3056,"num_write":1047,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"255'219","reported_seq":869,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.154310+0000","last_change":"2024-03-04T12:20:14.817012+0000","last_active":"2024-03-04T13:13:21.154310+0000","last_peered":"2024-03-04T13:13:21.154310+0000","last_clean":"2024-03-04T13:13:21.154310+0000","last_became_active":"2024-03-04T12:20:14.816722+0000","last_became_peered":"2024-03-04T12:20:14.816722+0000","last_unstale":"2024-03-04T13:13:21.154310+0000","last_undegraded":"2024-03-04T13:13:21.154310+0000","last_fullsized":"2024-03-04T13:13:21.154310+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:03:31.043930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1705735,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":471,"num_read_kb":103623,"num_write":1220,"num_write_kb":57222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.341660+0000","last_change":"2024-03-04T12:20:18.835916+0000","last_active":"2024-03-04T13:08:42.341660+0000","last_peered":"2024-03-04T13:08:42.341660+0000","last_clean":"2024-03-04T13:08:42.341660+0000","last_became_active":"2024-03-04T12:20:18.835597+0000","last_became_peered":"2024-03-04T12:20:18.835597+0000","last_unstale":"2024-03-04T13:08:42.341660+0000","last_undegraded":"2024-03-04T13:08:42.341660+0000","last_fullsized":"2024-03-04T13:08:42.341660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:45:01.355651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"255'185","reported_seq":768,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.068220+0000","last_change":"2024-03-04T12:20:20.837358+0000","last_active":"2024-03-04T13:13:21.068220+0000","last_peered":"2024-03-04T13:13:21.068220+0000","last_clean":"2024-03-04T13:13:21.068220+0000","last_became_active":"2024-03-04T12:20:20.837048+0000","last_became_peered":"2024-03-04T12:20:20.837048+0000","last_unstale":"2024-03-04T13:13:21.068220+0000","last_undegraded":"2024-03-04T13:13:21.068220+0000","last_fullsized":"2024-03-04T13:13:21.068220+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:43:04.505643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":254,"num_read_kb":315,"num_write":146,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.483022+0000","last_change":"2024-03-04T12:20:22.852800+0000","last_active":"2024-03-04T13:08:42.483022+0000","last_peered":"2024-03-04T13:08:42.483022+0000","last_clean":"2024-03-04T13:08:42.483022+0000","last_became_active":"2024-03-04T12:20:22.852461+0000","last_became_peered":"2024-03-04T12:20:22.852461+0000","last_unstale":"2024-03-04T13:08:42.483022+0000","last_undegraded":"2024-03-04T13:08:42.483022+0000","last_fullsized":"2024-03-04T13:08:42.483022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:03:51.860258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"255'2372","reported_seq":4166,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.462461+0000","last_change":"2024-03-04T12:20:24.869696+0000","last_active":"2024-03-04T13:13:12.462461+0000","last_peered":"2024-03-04T13:13:12.462461+0000","last_clean":"2024-03-04T13:13:12.462461+0000","last_became_active":"2024-03-04T12:20:24.869395+0000","last_became_peered":"2024-03-04T12:20:24.869395+0000","last_unstale":"2024-03-04T13:13:12.462461+0000","last_undegraded":"2024-03-04T13:13:12.462461+0000","last_fullsized":"2024-03-04T13:13:12.462461+0000","mapping_epoch":30,"log_start":"255'2300","ondisk_log_start":"255'2300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":2300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:18:14.602967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5943,"num_read_kb":5935,"num_write":4730,"num_write_kb":1746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"255'345","reported_seq":1811,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.571922+0000","last_change":"2024-03-04T12:20:16.829693+0000","last_active":"2024-03-04T13:12:50.571922+0000","last_peered":"2024-03-04T13:12:50.571922+0000","last_clean":"2024-03-04T13:12:50.571922+0000","last_became_active":"2024-03-04T12:20:16.829441+0000","last_became_peered":"2024-03-04T12:20:16.829441+0000","last_unstale":"2024-03-04T13:12:50.571922+0000","last_undegraded":"2024-03-04T13:12:50.571922+0000","last_fullsized":"2024-03-04T13:12:50.571922+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:15:29.713063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2107,"num_read_kb":2006,"num_write":408,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"255'161","reported_seq":724,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.007166+0000","last_change":"2024-03-04T12:20:14.819912+0000","last_active":"2024-03-04T13:13:21.007166+0000","last_peered":"2024-03-04T13:13:21.007166+0000","last_clean":"2024-03-04T13:13:21.007166+0000","last_became_active":"2024-03-04T12:20:14.819559+0000","last_became_peered":"2024-03-04T12:20:14.819559+0000","last_unstale":"2024-03-04T13:13:21.007166+0000","last_undegraded":"2024-03-04T13:13:21.007166+0000","last_fullsized":"2024-03-04T13:13:21.007166+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:48:45.189022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":323,"num_read_kb":7587,"num_write":849,"num_write_kb":22276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:27.446912+0000","last_change":"2024-03-04T12:20:18.834062+0000","last_active":"2024-03-04T13:09:27.446912+0000","last_peered":"2024-03-04T13:09:27.446912+0000","last_clean":"2024-03-04T13:09:27.446912+0000","last_became_active":"2024-03-04T12:20:18.833470+0000","last_became_peered":"2024-03-04T12:20:18.833470+0000","last_unstale":"2024-03-04T13:09:27.446912+0000","last_undegraded":"2024-03-04T13:09:27.446912+0000","last_fullsized":"2024-03-04T13:09:27.446912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:12.993503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"255'77","reported_seq":593,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.519703+0000","last_change":"2024-03-04T12:20:20.838187+0000","last_active":"2024-03-04T13:10:53.519703+0000","last_peered":"2024-03-04T13:10:53.519703+0000","last_clean":"2024-03-04T13:10:53.519703+0000","last_became_active":"2024-03-04T12:20:20.837905+0000","last_became_peered":"2024-03-04T12:20:20.837905+0000","last_unstale":"2024-03-04T13:10:53.519703+0000","last_undegraded":"2024-03-04T13:10:53.519703+0000","last_fullsized":"2024-03-04T13:10:53.519703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:44:38.381403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.482996+0000","last_change":"2024-03-04T12:20:22.849051+0000","last_active":"2024-03-04T13:08:42.482996+0000","last_peered":"2024-03-04T13:08:42.482996+0000","last_clean":"2024-03-04T13:08:42.482996+0000","last_became_active":"2024-03-04T12:20:22.848773+0000","last_became_peered":"2024-03-04T12:20:22.848773+0000","last_unstale":"2024-03-04T13:08:42.482996+0000","last_undegraded":"2024-03-04T13:08:42.482996+0000","last_fullsized":"2024-03-04T13:08:42.482996+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:55:51.999361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"255'116","reported_seq":607,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:28.660007+0000","last_change":"2024-03-04T12:20:24.869138+0000","last_active":"2024-03-04T13:11:28.660007+0000","last_peered":"2024-03-04T13:11:28.660007+0000","last_clean":"2024-03-04T13:11:28.660007+0000","last_became_active":"2024-03-04T12:20:24.868746+0000","last_became_peered":"2024-03-04T12:20:24.868746+0000","last_unstale":"2024-03-04T13:11:28.660007+0000","last_undegraded":"2024-03-04T13:11:28.660007+0000","last_fullsized":"2024-03-04T13:11:28.660007+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:03:02.799287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"255'390","reported_seq":1881,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573222+0000","last_change":"2024-03-04T12:20:16.829905+0000","last_active":"2024-03-04T13:12:50.573222+0000","last_peered":"2024-03-04T13:12:50.573222+0000","last_clean":"2024-03-04T13:12:50.573222+0000","last_became_active":"2024-03-04T12:20:16.829641+0000","last_became_peered":"2024-03-04T12:20:16.829641+0000","last_unstale":"2024-03-04T13:12:50.573222+0000","last_undegraded":"2024-03-04T13:12:50.573222+0000","last_fullsized":"2024-03-04T13:12:50.573222+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:38:20.140291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2147,"num_read_kb":2039,"num_write":462,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"255'144","reported_seq":758,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:37.512605+0000","last_change":"2024-03-04T12:20:14.817840+0000","last_active":"2024-03-04T13:11:37.512605+0000","last_peered":"2024-03-04T13:11:37.512605+0000","last_clean":"2024-03-04T13:11:37.512605+0000","last_became_active":"2024-03-04T12:20:14.817556+0000","last_became_peered":"2024-03-04T12:20:14.817556+0000","last_unstale":"2024-03-04T13:11:37.512605+0000","last_undegraded":"2024-03-04T13:11:37.512605+0000","last_fullsized":"2024-03-04T13:11:37.512605+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:38.563036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524480,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":366,"num_read_kb":1564,"num_write":822,"num_write_kb":17292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.442244+0000","last_change":"2024-03-04T12:20:18.836217+0000","last_active":"2024-03-04T13:08:42.442244+0000","last_peered":"2024-03-04T13:08:42.442244+0000","last_clean":"2024-03-04T13:08:42.442244+0000","last_became_active":"2024-03-04T12:20:18.835760+0000","last_became_peered":"2024-03-04T12:20:18.835760+0000","last_unstale":"2024-03-04T13:08:42.442244+0000","last_undegraded":"2024-03-04T13:08:42.442244+0000","last_fullsized":"2024-03-04T13:08:42.442244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:42:21.998349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"255'113","reported_seq":638,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.692750+0000","last_change":"2024-03-04T12:20:20.838715+0000","last_active":"2024-03-04T13:10:53.692750+0000","last_peered":"2024-03-04T13:10:53.692750+0000","last_clean":"2024-03-04T13:10:53.692750+0000","last_became_active":"2024-03-04T12:20:20.838094+0000","last_became_peered":"2024-03-04T12:20:20.838094+0000","last_unstale":"2024-03-04T13:10:53.692750+0000","last_undegraded":"2024-03-04T13:10:53.692750+0000","last_fullsized":"2024-03-04T13:10:53.692750+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:31.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":129,"num_write":92,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"255'502","reported_seq":1929,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.004248+0000","last_change":"2024-03-04T12:20:22.851329+0000","last_active":"2024-03-04T13:13:21.004248+0000","last_peered":"2024-03-04T13:13:21.004248+0000","last_clean":"2024-03-04T13:13:21.004248+0000","last_became_active":"2024-03-04T12:20:22.851062+0000","last_became_peered":"2024-03-04T12:20:22.851062+0000","last_unstale":"2024-03-04T13:13:21.004248+0000","last_undegraded":"2024-03-04T13:13:21.004248+0000","last_fullsized":"2024-03-04T13:13:21.004248+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:10.088059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"255'137","reported_seq":615,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:20.402198+0000","last_change":"2024-03-04T12:20:24.912322+0000","last_active":"2024-03-04T13:12:20.402198+0000","last_peered":"2024-03-04T13:12:20.402198+0000","last_clean":"2024-03-04T13:12:20.402198+0000","last_became_active":"2024-03-04T12:20:24.912068+0000","last_became_peered":"2024-03-04T12:20:24.912068+0000","last_unstale":"2024-03-04T13:12:20.402198+0000","last_undegraded":"2024-03-04T13:12:20.402198+0000","last_fullsized":"2024-03-04T13:12:20.402198+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:30:34.171289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":66,"num_write":291,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"255'856","reported_seq":2536,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.954099+0000","last_change":"2024-03-04T12:20:16.831420+0000","last_active":"2024-03-04T13:12:36.954099+0000","last_peered":"2024-03-04T13:12:36.954099+0000","last_clean":"2024-03-04T13:12:36.954099+0000","last_became_active":"2024-03-04T12:20:16.831039+0000","last_became_peered":"2024-03-04T12:20:16.831039+0000","last_unstale":"2024-03-04T13:12:36.954099+0000","last_undegraded":"2024-03-04T13:12:36.954099+0000","last_fullsized":"2024-03-04T13:12:36.954099+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:45:56.296756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4009,"num_read_kb":3592,"num_write":1144,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"255'195","reported_seq":798,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.172515+0000","last_change":"2024-03-04T12:20:14.818137+0000","last_active":"2024-03-04T13:13:21.172515+0000","last_peered":"2024-03-04T13:13:21.172515+0000","last_clean":"2024-03-04T13:13:21.172515+0000","last_became_active":"2024-03-04T12:20:14.817863+0000","last_became_peered":"2024-03-04T12:20:14.817863+0000","last_unstale":"2024-03-04T13:13:21.172515+0000","last_undegraded":"2024-03-04T13:13:21.172515+0000","last_fullsized":"2024-03-04T13:13:21.172515+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:33:32.762020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9161812,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":19635,"num_write":1198,"num_write_kb":36958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"32'4","reported_seq":792,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.703405+0000","last_change":"2024-03-04T12:20:18.838746+0000","last_active":"2024-03-04T13:13:20.703405+0000","last_peered":"2024-03-04T13:13:20.703405+0000","last_clean":"2024-03-04T13:13:20.703405+0000","last_became_active":"2024-03-04T12:20:18.838266+0000","last_became_peered":"2024-03-04T12:20:18.838266+0000","last_unstale":"2024-03-04T13:13:20.703405+0000","last_undegraded":"2024-03-04T13:13:20.703405+0000","last_fullsized":"2024-03-04T13:13:20.703405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:40:00.829417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":466,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"255'129","reported_seq":693,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.027522+0000","last_change":"2024-03-04T12:20:21.643825+0000","last_active":"2024-03-04T13:13:21.027522+0000","last_peered":"2024-03-04T13:13:21.027522+0000","last_clean":"2024-03-04T13:13:21.027522+0000","last_became_active":"2024-03-04T12:20:21.643542+0000","last_became_peered":"2024-03-04T12:20:21.643542+0000","last_unstale":"2024-03-04T13:13:21.027522+0000","last_undegraded":"2024-03-04T13:13:21.027522+0000","last_fullsized":"2024-03-04T13:13:21.027522+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:37.997080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9148,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":181,"num_read_kb":265,"num_write":100,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"255'530","reported_seq":1912,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.939056+0000","last_change":"2024-03-04T12:20:22.858901+0000","last_active":"2024-03-04T13:13:20.939056+0000","last_peered":"2024-03-04T13:13:20.939056+0000","last_clean":"2024-03-04T13:13:20.939056+0000","last_became_active":"2024-03-04T12:20:22.858575+0000","last_became_peered":"2024-03-04T12:20:22.858575+0000","last_unstale":"2024-03-04T13:13:20.939056+0000","last_undegraded":"2024-03-04T13:13:20.939056+0000","last_fullsized":"2024-03-04T13:13:20.939056+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:54:58.667292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"255'391","reported_seq":1796,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:40.169266+0000","last_change":"2024-03-04T12:20:16.830920+0000","last_active":"2024-03-04T13:11:40.169266+0000","last_peered":"2024-03-04T13:11:40.169266+0000","last_clean":"2024-03-04T13:11:40.169266+0000","last_became_active":"2024-03-04T12:20:16.830531+0000","last_became_peered":"2024-03-04T12:20:16.830531+0000","last_unstale":"2024-03-04T13:11:40.169266+0000","last_undegraded":"2024-03-04T13:11:40.169266+0000","last_fullsized":"2024-03-04T13:11:40.169266+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:40:48.153427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2065,"num_write":498,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"255'174","reported_seq":849,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.101751+0000","last_change":"2024-03-04T12:20:14.818724+0000","last_active":"2024-03-04T13:13:21.101751+0000","last_peered":"2024-03-04T13:13:21.101751+0000","last_clean":"2024-03-04T13:13:21.101751+0000","last_became_active":"2024-03-04T12:20:14.818441+0000","last_became_peered":"2024-03-04T12:20:14.818441+0000","last_unstale":"2024-03-04T13:13:21.101751+0000","last_undegraded":"2024-03-04T13:13:21.101751+0000","last_fullsized":"2024-03-04T13:13:21.101751+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:15.961414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10526962,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":524,"num_read_kb":158242,"num_write":986,"num_write_kb":38243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":492,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497846+0000","last_change":"2024-03-04T12:20:18.832672+0000","last_active":"2024-03-04T13:10:12.497846+0000","last_peered":"2024-03-04T13:10:12.497846+0000","last_clean":"2024-03-04T13:10:12.497846+0000","last_became_active":"2024-03-04T12:20:18.832349+0000","last_became_peered":"2024-03-04T12:20:18.832349+0000","last_unstale":"2024-03-04T13:10:12.497846+0000","last_undegraded":"2024-03-04T13:10:12.497846+0000","last_fullsized":"2024-03-04T13:10:12.497846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:17.354349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"255'217","reported_seq":821,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.104550+0000","last_change":"2024-03-04T12:20:21.642137+0000","last_active":"2024-03-04T13:13:21.104550+0000","last_peered":"2024-03-04T13:13:21.104550+0000","last_clean":"2024-03-04T13:13:21.104550+0000","last_became_active":"2024-03-04T12:20:21.641749+0000","last_became_peered":"2024-03-04T12:20:21.641749+0000","last_unstale":"2024-03-04T13:13:21.104550+0000","last_undegraded":"2024-03-04T13:13:21.104550+0000","last_fullsized":"2024-03-04T13:13:21.104550+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:33:09.469358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6571,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":304,"num_read_kb":381,"num_write":178,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":477,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.540203+0000","last_change":"2024-03-04T12:20:22.852908+0000","last_active":"2024-03-04T13:09:52.540203+0000","last_peered":"2024-03-04T13:09:52.540203+0000","last_clean":"2024-03-04T13:09:52.540203+0000","last_became_active":"2024-03-04T12:20:22.852612+0000","last_became_peered":"2024-03-04T12:20:22.852612+0000","last_unstale":"2024-03-04T13:09:52.540203+0000","last_undegraded":"2024-03-04T13:09:52.540203+0000","last_fullsized":"2024-03-04T13:09:52.540203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:41:53.817861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"255'523","reported_seq":1316,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.165868+0000","last_change":"2024-03-04T12:20:24.869764+0000","last_active":"2024-03-04T13:13:14.165868+0000","last_peered":"2024-03-04T13:13:14.165868+0000","last_clean":"2024-03-04T13:13:14.165868+0000","last_became_active":"2024-03-04T12:20:24.869409+0000","last_became_peered":"2024-03-04T12:20:24.869409+0000","last_unstale":"2024-03-04T13:13:14.165868+0000","last_undegraded":"2024-03-04T13:13:14.165868+0000","last_fullsized":"2024-03-04T13:13:14.165868+0000","mapping_epoch":30,"log_start":"255'500","ondisk_log_start":"255'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:47:48.263171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1237,"num_read_kb":1237,"num_write":1069,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"255'315","reported_seq":1782,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573805+0000","last_change":"2024-03-04T12:20:16.826445+0000","last_active":"2024-03-04T13:12:50.573805+0000","last_peered":"2024-03-04T13:12:50.573805+0000","last_clean":"2024-03-04T13:12:50.573805+0000","last_became_active":"2024-03-04T12:20:16.826183+0000","last_became_peered":"2024-03-04T12:20:16.826183+0000","last_unstale":"2024-03-04T13:12:50.573805+0000","last_undegraded":"2024-03-04T13:12:50.573805+0000","last_fullsized":"2024-03-04T13:12:50.573805+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:57:50.116407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2023,"num_read_kb":1945,"num_write":353,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"255'180","reported_seq":810,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.137408+0000","last_change":"2024-03-04T12:20:14.819684+0000","last_active":"2024-03-04T13:13:21.137408+0000","last_peered":"2024-03-04T13:13:21.137408+0000","last_clean":"2024-03-04T13:13:21.137408+0000","last_became_active":"2024-03-04T12:20:14.819389+0000","last_became_peered":"2024-03-04T12:20:14.819389+0000","last_unstale":"2024-03-04T13:13:21.137408+0000","last_undegraded":"2024-03-04T13:13:21.137408+0000","last_fullsized":"2024-03-04T13:13:21.137408+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:30:11.677107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":382,"num_read_kb":37991,"num_write":1066,"num_write_kb":16641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":486,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.439917+0000","last_change":"2024-03-04T12:20:18.834899+0000","last_active":"2024-03-04T13:10:12.439917+0000","last_peered":"2024-03-04T13:10:12.439917+0000","last_clean":"2024-03-04T13:10:12.439917+0000","last_became_active":"2024-03-04T12:20:18.834619+0000","last_became_peered":"2024-03-04T12:20:18.834619+0000","last_unstale":"2024-03-04T13:10:12.439917+0000","last_undegraded":"2024-03-04T13:10:12.439917+0000","last_fullsized":"2024-03-04T13:10:12.439917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:42:40.542910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"255'129","reported_seq":684,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.202231+0000","last_change":"2024-03-04T12:20:20.843676+0000","last_active":"2024-03-04T13:13:21.202231+0000","last_peered":"2024-03-04T13:13:21.202231+0000","last_clean":"2024-03-04T13:13:21.202231+0000","last_became_active":"2024-03-04T12:20:20.843195+0000","last_became_peered":"2024-03-04T12:20:20.843195+0000","last_unstale":"2024-03-04T13:13:21.202231+0000","last_undegraded":"2024-03-04T13:13:21.202231+0000","last_fullsized":"2024-03-04T13:13:21.202231+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:56:20.314287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":216,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":474,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.452976+0000","last_change":"2024-03-04T12:20:22.859027+0000","last_active":"2024-03-04T13:10:17.452976+0000","last_peered":"2024-03-04T13:10:17.452976+0000","last_clean":"2024-03-04T13:10:17.452976+0000","last_became_active":"2024-03-04T12:20:22.858722+0000","last_became_peered":"2024-03-04T12:20:22.858722+0000","last_unstale":"2024-03-04T13:10:17.452976+0000","last_undegraded":"2024-03-04T13:10:17.452976+0000","last_fullsized":"2024-03-04T13:10:17.452976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:18:20.285059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"255'182","reported_seq":703,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:17.325728+0000","last_change":"2024-03-04T12:20:24.869476+0000","last_active":"2024-03-04T13:11:17.325728+0000","last_peered":"2024-03-04T13:11:17.325728+0000","last_clean":"2024-03-04T13:11:17.325728+0000","last_became_active":"2024-03-04T12:20:24.869152+0000","last_became_peered":"2024-03-04T12:20:24.869152+0000","last_unstale":"2024-03-04T13:11:17.325728+0000","last_undegraded":"2024-03-04T13:11:17.325728+0000","last_fullsized":"2024-03-04T13:11:17.325728+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:21.486498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":286,"num_read_kb":243,"num_write":358,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"255'1227","reported_seq":2769,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.767503+0000","last_change":"2024-03-04T12:20:16.826525+0000","last_active":"2024-03-04T13:12:12.767503+0000","last_peered":"2024-03-04T13:12:12.767503+0000","last_clean":"2024-03-04T13:12:12.767503+0000","last_became_active":"2024-03-04T12:20:16.826172+0000","last_became_peered":"2024-03-04T12:20:16.826172+0000","last_unstale":"2024-03-04T13:12:12.767503+0000","last_undegraded":"2024-03-04T13:12:12.767503+0000","last_fullsized":"2024-03-04T13:12:12.767503+0000","mapping_epoch":22,"log_start":"255'1200","ondisk_log_start":"255'1200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:12:29.317623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5093,"num_read_kb":4391,"num_write":1710,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"255'179","reported_seq":838,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.059570+0000","last_change":"2024-03-04T12:20:14.828602+0000","last_active":"2024-03-04T13:13:21.059570+0000","last_peered":"2024-03-04T13:13:21.059570+0000","last_clean":"2024-03-04T13:13:21.059570+0000","last_became_active":"2024-03-04T12:20:14.828250+0000","last_became_peered":"2024-03-04T12:20:14.828250+0000","last_unstale":"2024-03-04T13:13:21.059570+0000","last_undegraded":"2024-03-04T13:13:21.059570+0000","last_fullsized":"2024-03-04T13:13:21.059570+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:46.934324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22063,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":10895,"num_write":937,"num_write_kb":21474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.437970+0000","last_change":"2024-03-04T12:20:18.835161+0000","last_active":"2024-03-04T13:09:52.437970+0000","last_peered":"2024-03-04T13:09:52.437970+0000","last_clean":"2024-03-04T13:09:52.437970+0000","last_became_active":"2024-03-04T12:20:18.834897+0000","last_became_peered":"2024-03-04T12:20:18.834897+0000","last_unstale":"2024-03-04T13:09:52.437970+0000","last_undegraded":"2024-03-04T13:09:52.437970+0000","last_fullsized":"2024-03-04T13:09:52.437970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:23:32.729578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"255'162","reported_seq":746,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.117978+0000","last_change":"2024-03-04T12:20:20.839989+0000","last_active":"2024-03-04T13:13:21.117978+0000","last_peered":"2024-03-04T13:13:21.117978+0000","last_clean":"2024-03-04T13:13:21.117978+0000","last_became_active":"2024-03-04T12:20:20.839295+0000","last_became_peered":"2024-03-04T12:20:20.839295+0000","last_unstale":"2024-03-04T13:13:21.117978+0000","last_undegraded":"2024-03-04T13:13:21.117978+0000","last_fullsized":"2024-03-04T13:13:21.117978+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:08:54.656704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":221,"num_read_kb":283,"num_write":122,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"255'515","reported_seq":1896,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.939978+0000","last_change":"2024-03-04T12:20:22.852803+0000","last_active":"2024-03-04T13:13:20.939978+0000","last_peered":"2024-03-04T13:13:20.939978+0000","last_clean":"2024-03-04T13:13:20.939978+0000","last_became_active":"2024-03-04T12:20:22.852529+0000","last_became_peered":"2024-03-04T12:20:22.852529+0000","last_unstale":"2024-03-04T13:13:20.939978+0000","last_undegraded":"2024-03-04T13:13:20.939978+0000","last_fullsized":"2024-03-04T13:13:20.939978+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:41:17.465191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"255'110","reported_seq":578,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:26.130806+0000","last_change":"2024-03-04T12:20:24.868355+0000","last_active":"2024-03-04T13:11:26.130806+0000","last_peered":"2024-03-04T13:11:26.130806+0000","last_clean":"2024-03-04T13:11:26.130806+0000","last_became_active":"2024-03-04T12:20:24.868076+0000","last_became_peered":"2024-03-04T12:20:24.868076+0000","last_unstale":"2024-03-04T13:11:26.130806+0000","last_undegraded":"2024-03-04T13:11:26.130806+0000","last_fullsized":"2024-03-04T13:11:26.130806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:52.616216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"255'360","reported_seq":1757,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.430573+0000","last_change":"2024-03-04T12:20:16.829010+0000","last_active":"2024-03-04T13:12:39.430573+0000","last_peered":"2024-03-04T13:12:39.430573+0000","last_clean":"2024-03-04T13:12:39.430573+0000","last_became_active":"2024-03-04T12:20:16.828738+0000","last_became_peered":"2024-03-04T12:20:16.828738+0000","last_unstale":"2024-03-04T13:12:39.430573+0000","last_undegraded":"2024-03-04T13:12:39.430573+0000","last_fullsized":"2024-03-04T13:12:39.430573+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:50:10.406480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1878,"num_read_kb":1794,"num_write":404,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"255'280","reported_seq":1007,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.196031+0000","last_change":"2024-03-04T12:20:14.824611+0000","last_active":"2024-03-04T13:13:21.196031+0000","last_peered":"2024-03-04T13:13:21.196031+0000","last_clean":"2024-03-04T13:13:21.196031+0000","last_became_active":"2024-03-04T12:20:14.824192+0000","last_became_peered":"2024-03-04T12:20:14.824192+0000","last_unstale":"2024-03-04T13:13:21.196031+0000","last_undegraded":"2024-03-04T13:13:21.196031+0000","last_fullsized":"2024-03-04T13:13:21.196031+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:58:08.994156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":790,"num_read_kb":21513,"num_write":1394,"num_write_kb":41658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":486,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.440425+0000","last_change":"2024-03-04T12:20:18.832777+0000","last_active":"2024-03-04T13:10:17.440425+0000","last_peered":"2024-03-04T13:10:17.440425+0000","last_clean":"2024-03-04T13:10:17.440425+0000","last_became_active":"2024-03-04T12:20:18.832483+0000","last_became_peered":"2024-03-04T12:20:18.832483+0000","last_unstale":"2024-03-04T13:10:17.440425+0000","last_undegraded":"2024-03-04T13:10:17.440425+0000","last_fullsized":"2024-03-04T13:10:17.440425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:14.119980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"255'190","reported_seq":804,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.224040+0000","last_change":"2024-03-04T12:20:20.838146+0000","last_active":"2024-03-04T13:13:21.224040+0000","last_peered":"2024-03-04T13:13:21.224040+0000","last_clean":"2024-03-04T13:13:21.224040+0000","last_became_active":"2024-03-04T12:20:20.837748+0000","last_became_peered":"2024-03-04T12:20:20.837748+0000","last_unstale":"2024-03-04T13:13:21.224040+0000","last_undegraded":"2024-03-04T13:13:21.224040+0000","last_fullsized":"2024-03-04T13:13:21.224040+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:22:00.778993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13702,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":270,"num_read_kb":346,"num_write":130,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":478,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.439897+0000","last_change":"2024-03-04T12:20:22.850065+0000","last_active":"2024-03-04T13:10:12.439897+0000","last_peered":"2024-03-04T13:10:12.439897+0000","last_clean":"2024-03-04T13:10:12.439897+0000","last_became_active":"2024-03-04T12:20:22.849784+0000","last_became_peered":"2024-03-04T12:20:22.849784+0000","last_unstale":"2024-03-04T13:10:12.439897+0000","last_undegraded":"2024-03-04T13:10:12.439897+0000","last_fullsized":"2024-03-04T13:10:12.439897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:29:20.336237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"255'99","reported_seq":608,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.080830+0000","last_change":"2024-03-04T12:20:24.865119+0000","last_active":"2024-03-04T13:12:18.080830+0000","last_peered":"2024-03-04T13:12:18.080830+0000","last_clean":"2024-03-04T13:12:18.080830+0000","last_became_active":"2024-03-04T12:20:24.864820+0000","last_became_peered":"2024-03-04T12:20:24.864820+0000","last_unstale":"2024-03-04T13:12:18.080830+0000","last_undegraded":"2024-03-04T13:12:18.080830+0000","last_fullsized":"2024-03-04T13:12:18.080830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:32:18.059621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":165,"num_write":238,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"255'1121","reported_seq":2623,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:15.756787+0000","last_change":"2024-03-04T12:20:16.828787+0000","last_active":"2024-03-04T13:12:15.756787+0000","last_peered":"2024-03-04T13:12:15.756787+0000","last_clean":"2024-03-04T13:12:15.756787+0000","last_became_active":"2024-03-04T12:20:16.828486+0000","last_became_peered":"2024-03-04T12:20:16.828486+0000","last_unstale":"2024-03-04T13:12:15.756787+0000","last_undegraded":"2024-03-04T13:12:15.756787+0000","last_fullsized":"2024-03-04T13:12:15.756787+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:11:58.117667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4686,"num_read_kb":4085,"num_write":1549,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"255'242","reported_seq":877,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.005697+0000","last_change":"2024-03-04T12:20:14.817073+0000","last_active":"2024-03-04T13:13:21.005697+0000","last_peered":"2024-03-04T13:13:21.005697+0000","last_clean":"2024-03-04T13:13:21.005697+0000","last_became_active":"2024-03-04T12:20:14.816412+0000","last_became_peered":"2024-03-04T12:20:14.816412+0000","last_unstale":"2024-03-04T13:13:21.005697+0000","last_undegraded":"2024-03-04T13:13:21.005697+0000","last_fullsized":"2024-03-04T13:13:21.005697+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:58:05.576367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399147,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":515,"num_read_kb":1880,"num_write":1395,"num_write_kb":20590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.437990+0000","last_change":"2024-03-04T12:20:18.831057+0000","last_active":"2024-03-04T13:09:52.437990+0000","last_peered":"2024-03-04T13:09:52.437990+0000","last_clean":"2024-03-04T13:09:52.437990+0000","last_became_active":"2024-03-04T12:20:18.830763+0000","last_became_peered":"2024-03-04T12:20:18.830763+0000","last_unstale":"2024-03-04T13:09:52.437990+0000","last_undegraded":"2024-03-04T13:09:52.437990+0000","last_fullsized":"2024-03-04T13:09:52.437990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:07:14.625882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"255'156","reported_seq":725,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.229852+0000","last_change":"2024-03-04T12:20:20.842557+0000","last_active":"2024-03-04T13:13:21.229852+0000","last_peered":"2024-03-04T13:13:21.229852+0000","last_clean":"2024-03-04T13:13:21.229852+0000","last_became_active":"2024-03-04T12:20:20.842216+0000","last_became_peered":"2024-03-04T12:20:20.842216+0000","last_unstale":"2024-03-04T13:13:21.229852+0000","last_undegraded":"2024-03-04T13:13:21.229852+0000","last_fullsized":"2024-03-04T13:13:21.229852+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:02:08.824556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7566,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":219,"num_read_kb":283,"num_write":166,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":471,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:57.443894+0000","last_change":"2024-03-04T12:20:22.855807+0000","last_active":"2024-03-04T13:09:57.443894+0000","last_peered":"2024-03-04T13:09:57.443894+0000","last_clean":"2024-03-04T13:09:57.443894+0000","last_became_active":"2024-03-04T12:20:22.855480+0000","last_became_peered":"2024-03-04T12:20:22.855480+0000","last_unstale":"2024-03-04T13:09:57.443894+0000","last_undegraded":"2024-03-04T13:09:57.443894+0000","last_fullsized":"2024-03-04T13:09:57.443894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:21:14.052483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"255'88","reported_seq":562,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.454648+0000","last_change":"2024-03-04T12:20:24.865258+0000","last_active":"2024-03-04T13:10:32.454648+0000","last_peered":"2024-03-04T13:10:32.454648+0000","last_clean":"2024-03-04T13:10:32.454648+0000","last_became_active":"2024-03-04T12:20:24.864982+0000","last_became_peered":"2024-03-04T12:20:24.864982+0000","last_unstale":"2024-03-04T13:10:32.454648+0000","last_undegraded":"2024-03-04T13:10:32.454648+0000","last_fullsized":"2024-03-04T13:10:32.454648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:45:57.341191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":209,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"255'386","reported_seq":1736,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573507+0000","last_change":"2024-03-04T12:20:16.826836+0000","last_active":"2024-03-04T13:12:50.573507+0000","last_peered":"2024-03-04T13:12:50.573507+0000","last_clean":"2024-03-04T13:12:50.573507+0000","last_became_active":"2024-03-04T12:20:16.824033+0000","last_became_peered":"2024-03-04T12:20:16.824033+0000","last_unstale":"2024-03-04T13:12:50.573507+0000","last_undegraded":"2024-03-04T13:12:50.573507+0000","last_fullsized":"2024-03-04T13:12:50.573507+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:20:02.860419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1899,"num_read_kb":1781,"num_write":448,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"255'222","reported_seq":837,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.173651+0000","last_change":"2024-03-04T12:20:14.818954+0000","last_active":"2024-03-04T13:13:21.173651+0000","last_peered":"2024-03-04T13:13:21.173651+0000","last_clean":"2024-03-04T13:13:21.173651+0000","last_became_active":"2024-03-04T12:20:14.818461+0000","last_became_peered":"2024-03-04T12:20:14.818461+0000","last_unstale":"2024-03-04T13:13:21.173651+0000","last_undegraded":"2024-03-04T13:13:21.173651+0000","last_fullsized":"2024-03-04T13:13:21.173651+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:54:12.327719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":446,"num_read_kb":17082,"num_write":1054,"num_write_kb":47848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.540225+0000","last_change":"2024-03-04T12:20:18.837780+0000","last_active":"2024-03-04T13:09:52.540225+0000","last_peered":"2024-03-04T13:09:52.540225+0000","last_clean":"2024-03-04T13:09:52.540225+0000","last_became_active":"2024-03-04T12:20:18.837494+0000","last_became_peered":"2024-03-04T12:20:18.837494+0000","last_unstale":"2024-03-04T13:09:52.540225+0000","last_undegraded":"2024-03-04T13:09:52.540225+0000","last_fullsized":"2024-03-04T13:09:52.540225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:44:36.195379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"255'172","reported_seq":749,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.185293+0000","last_change":"2024-03-04T12:20:20.842124+0000","last_active":"2024-03-04T13:13:21.185293+0000","last_peered":"2024-03-04T13:13:21.185293+0000","last_clean":"2024-03-04T13:13:21.185293+0000","last_became_active":"2024-03-04T12:20:20.841801+0000","last_became_peered":"2024-03-04T12:20:20.841801+0000","last_unstale":"2024-03-04T13:13:21.185293+0000","last_undegraded":"2024-03-04T13:13:21.185293+0000","last_fullsized":"2024-03-04T13:13:21.185293+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:24.485585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7601,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":303,"num_write":134,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"255'492","reported_seq":1885,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.936078+0000","last_change":"2024-03-04T12:20:22.857881+0000","last_active":"2024-03-04T13:13:20.936078+0000","last_peered":"2024-03-04T13:13:20.936078+0000","last_clean":"2024-03-04T13:13:20.936078+0000","last_became_active":"2024-03-04T12:20:22.857578+0000","last_became_peered":"2024-03-04T12:20:22.857578+0000","last_unstale":"2024-03-04T13:13:20.936078+0000","last_undegraded":"2024-03-04T13:13:20.936078+0000","last_fullsized":"2024-03-04T13:13:20.936078+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:27:44.703793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"255'108","reported_seq":590,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.581000+0000","last_change":"2024-03-04T12:20:24.867786+0000","last_active":"2024-03-04T13:12:22.581000+0000","last_peered":"2024-03-04T13:12:22.581000+0000","last_clean":"2024-03-04T13:12:22.581000+0000","last_became_active":"2024-03-04T12:20:24.867482+0000","last_became_peered":"2024-03-04T12:20:24.867482+0000","last_unstale":"2024-03-04T13:12:22.581000+0000","last_undegraded":"2024-03-04T13:12:22.581000+0000","last_fullsized":"2024-03-04T13:12:22.581000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:09:06.813366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":731,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":256,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"255'343","reported_seq":1943,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.059046+0000","last_change":"2024-03-04T12:20:16.819106+0000","last_active":"2024-03-04T13:12:18.059046+0000","last_peered":"2024-03-04T13:12:18.059046+0000","last_clean":"2024-03-04T13:12:18.059046+0000","last_became_active":"2024-03-04T12:20:16.818795+0000","last_became_peered":"2024-03-04T12:20:16.818795+0000","last_unstale":"2024-03-04T13:12:18.059046+0000","last_undegraded":"2024-03-04T13:12:18.059046+0000","last_fullsized":"2024-03-04T13:12:18.059046+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:29.845769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2162,"num_read_kb":2105,"num_write":376,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"255'220","reported_seq":839,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.207201+0000","last_change":"2024-03-04T12:20:14.818157+0000","last_active":"2024-03-04T13:13:21.207201+0000","last_peered":"2024-03-04T13:13:21.207201+0000","last_clean":"2024-03-04T13:13:21.207201+0000","last_became_active":"2024-03-04T12:20:14.817859+0000","last_became_peered":"2024-03-04T12:20:14.817859+0000","last_unstale":"2024-03-04T13:13:21.207201+0000","last_undegraded":"2024-03-04T13:13:21.207201+0000","last_fullsized":"2024-03-04T13:13:21.207201+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:00.268672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":387,"num_read_kb":14098,"num_write":1105,"num_write_kb":34013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":1101,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.713803+0000","last_change":"2024-03-04T12:20:18.839281+0000","last_active":"2024-03-04T13:13:20.713803+0000","last_peered":"2024-03-04T13:13:20.713803+0000","last_clean":"2024-03-04T13:13:20.713803+0000","last_became_active":"2024-03-04T12:20:18.838389+0000","last_became_peered":"2024-03-04T12:20:18.838389+0000","last_unstale":"2024-03-04T13:13:20.713803+0000","last_undegraded":"2024-03-04T13:13:20.713803+0000","last_fullsized":"2024-03-04T13:13:20.713803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:57.735142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":615,"num_read_kb":615,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"255'101","reported_seq":608,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.392687+0000","last_change":"2024-03-04T12:20:21.642158+0000","last_active":"2024-03-04T13:10:53.392687+0000","last_peered":"2024-03-04T13:10:53.392687+0000","last_clean":"2024-03-04T13:10:53.392687+0000","last_became_active":"2024-03-04T12:20:21.641809+0000","last_became_peered":"2024-03-04T12:20:21.641809+0000","last_unstale":"2024-03-04T13:10:53.392687+0000","last_undegraded":"2024-03-04T13:10:53.392687+0000","last_fullsized":"2024-03-04T13:10:53.392687+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:46:54.198373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":103,"num_read_kb":92,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"255'498","reported_seq":2278,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.937077+0000","last_change":"2024-03-04T12:20:22.849616+0000","last_active":"2024-03-04T13:13:20.937077+0000","last_peered":"2024-03-04T13:13:20.937077+0000","last_clean":"2024-03-04T13:13:20.937077+0000","last_became_active":"2024-03-04T12:20:22.849288+0000","last_became_peered":"2024-03-04T12:20:22.849288+0000","last_unstale":"2024-03-04T13:13:20.937077+0000","last_undegraded":"2024-03-04T13:13:20.937077+0000","last_fullsized":"2024-03-04T13:13:20.937077+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:38:12.869906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"255'87","reported_seq":571,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:30.968772+0000","last_change":"2024-03-04T12:20:24.870938+0000","last_active":"2024-03-04T13:10:30.968772+0000","last_peered":"2024-03-04T13:10:30.968772+0000","last_clean":"2024-03-04T13:10:30.968772+0000","last_became_active":"2024-03-04T12:20:24.870568+0000","last_became_peered":"2024-03-04T12:20:24.870568+0000","last_unstale":"2024-03-04T13:10:30.968772+0000","last_undegraded":"2024-03-04T13:10:30.968772+0000","last_fullsized":"2024-03-04T13:10:30.968772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:41:06.369980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":82,"num_read_kb":81,"num_write":219,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"255'297","reported_seq":1655,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.745392+0000","last_change":"2024-03-04T12:20:16.831299+0000","last_active":"2024-03-04T13:12:12.745392+0000","last_peered":"2024-03-04T13:12:12.745392+0000","last_clean":"2024-03-04T13:12:12.745392+0000","last_became_active":"2024-03-04T12:20:16.831001+0000","last_became_peered":"2024-03-04T12:20:16.831001+0000","last_unstale":"2024-03-04T13:12:12.745392+0000","last_undegraded":"2024-03-04T13:12:12.745392+0000","last_fullsized":"2024-03-04T13:12:12.745392+0000","mapping_epoch":22,"log_start":"255'200","ondisk_log_start":"255'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:17:15.203257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1692,"num_read_kb":1639,"num_write":326,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"255'199","reported_seq":821,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.172765+0000","last_change":"2024-03-04T12:20:14.813162+0000","last_active":"2024-03-04T13:13:21.172765+0000","last_peered":"2024-03-04T13:13:21.172765+0000","last_clean":"2024-03-04T13:13:21.172765+0000","last_became_active":"2024-03-04T12:20:14.812881+0000","last_became_peered":"2024-03-04T12:20:14.812881+0000","last_unstale":"2024-03-04T13:13:21.172765+0000","last_undegraded":"2024-03-04T13:13:21.172765+0000","last_fullsized":"2024-03-04T13:13:21.172765+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:50:49.495670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6401060,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":24185,"num_write":1082,"num_write_kb":42346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.494731+0000","last_change":"2024-03-04T12:20:18.836790+0000","last_active":"2024-03-04T13:09:52.494731+0000","last_peered":"2024-03-04T13:09:52.494731+0000","last_clean":"2024-03-04T13:09:52.494731+0000","last_became_active":"2024-03-04T12:20:18.836493+0000","last_became_peered":"2024-03-04T12:20:18.836493+0000","last_unstale":"2024-03-04T13:09:52.494731+0000","last_undegraded":"2024-03-04T13:09:52.494731+0000","last_fullsized":"2024-03-04T13:09:52.494731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:56.713786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"255'249","reported_seq":846,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.074245+0000","last_change":"2024-03-04T12:20:20.839419+0000","last_active":"2024-03-04T13:13:21.074245+0000","last_peered":"2024-03-04T13:13:21.074245+0000","last_clean":"2024-03-04T13:13:21.074245+0000","last_became_active":"2024-03-04T12:20:20.839079+0000","last_became_peered":"2024-03-04T12:20:20.839079+0000","last_unstale":"2024-03-04T13:13:21.074245+0000","last_undegraded":"2024-03-04T13:13:21.074245+0000","last_fullsized":"2024-03-04T13:13:21.074245+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:59:03.433466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7172,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":931,"num_read_kb":985,"num_write":1462,"num_write_kb":1319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.476116+0000","last_change":"2024-03-04T12:20:22.855248+0000","last_active":"2024-03-04T13:09:52.476116+0000","last_peered":"2024-03-04T13:09:52.476116+0000","last_clean":"2024-03-04T13:09:52.476116+0000","last_became_active":"2024-03-04T12:20:22.854860+0000","last_became_peered":"2024-03-04T12:20:22.854860+0000","last_unstale":"2024-03-04T13:09:52.476116+0000","last_undegraded":"2024-03-04T13:09:52.476116+0000","last_fullsized":"2024-03-04T13:09:52.476116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:11.625286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"255'104","reported_seq":584,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.544052+0000","last_change":"2024-03-04T12:20:24.866168+0000","last_active":"2024-03-04T13:10:27.544052+0000","last_peered":"2024-03-04T13:10:27.544052+0000","last_clean":"2024-03-04T13:10:27.544052+0000","last_became_active":"2024-03-04T12:20:24.865830+0000","last_became_peered":"2024-03-04T12:20:24.865830+0000","last_unstale":"2024-03-04T13:10:27.544052+0000","last_undegraded":"2024-03-04T13:10:27.544052+0000","last_fullsized":"2024-03-04T13:10:27.544052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:29.311908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":242,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"255'318","reported_seq":1695,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.078010+0000","last_change":"2024-03-04T12:20:16.821797+0000","last_active":"2024-03-04T13:12:18.078010+0000","last_peered":"2024-03-04T13:12:18.078010+0000","last_clean":"2024-03-04T13:12:18.078010+0000","last_became_active":"2024-03-04T12:20:16.821495+0000","last_became_peered":"2024-03-04T12:20:16.821495+0000","last_unstale":"2024-03-04T13:12:18.078010+0000","last_undegraded":"2024-03-04T13:12:18.078010+0000","last_fullsized":"2024-03-04T13:12:18.078010+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:21:21.722236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1811,"num_read_kb":1736,"num_write":364,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":664,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497781+0000","last_change":"2024-03-04T12:19:58.807747+0000","last_active":"2024-03-04T13:10:12.497781+0000","last_peered":"2024-03-04T13:10:12.497781+0000","last_clean":"2024-03-04T13:10:12.497781+0000","last_became_active":"2024-03-04T12:19:58.806723+0000","last_became_peered":"2024-03-04T12:19:58.806723+0000","last_unstale":"2024-03-04T13:10:12.497781+0000","last_undegraded":"2024-03-04T13:10:12.497781+0000","last_fullsized":"2024-03-04T13:10:12.497781+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:19:57.750293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:19:57.750293+0000","last_clean_scrub_stamp":"2024-03-04T12:19:57.750293+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:53:17.368805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":500,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.353364+0000","last_change":"2024-03-04T12:20:05.783212+0000","last_active":"2024-03-04T13:10:07.353364+0000","last_peered":"2024-03-04T13:10:07.353364+0000","last_clean":"2024-03-04T13:10:07.353364+0000","last_became_active":"2024-03-04T12:20:05.782921+0000","last_became_peered":"2024-03-04T12:20:05.782921+0000","last_unstale":"2024-03-04T13:10:07.353364+0000","last_undegraded":"2024-03-04T13:10:07.353364+0000","last_fullsized":"2024-03-04T13:10:07.353364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:47.241725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"255'172","reported_seq":785,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.103293+0000","last_change":"2024-03-04T12:20:51.032035+0000","last_active":"2024-03-04T13:13:21.103293+0000","last_peered":"2024-03-04T13:13:21.103293+0000","last_clean":"2024-03-04T13:13:21.103293+0000","last_became_active":"2024-03-04T12:20:51.031720+0000","last_became_peered":"2024-03-04T12:20:51.031720+0000","last_unstale":"2024-03-04T13:13:21.103293+0000","last_undegraded":"2024-03-04T13:13:21.103293+0000","last_fullsized":"2024-03-04T13:13:21.103293+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:35:26.492810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263538,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":417,"num_read_kb":68206,"num_write":949,"num_write_kb":44048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":493,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499605+0000","last_change":"2024-03-04T12:20:18.830022+0000","last_active":"2024-03-04T13:10:22.499605+0000","last_peered":"2024-03-04T13:10:22.499605+0000","last_clean":"2024-03-04T13:10:22.499605+0000","last_became_active":"2024-03-04T12:20:18.829703+0000","last_became_peered":"2024-03-04T12:20:18.829703+0000","last_unstale":"2024-03-04T13:10:22.499605+0000","last_undegraded":"2024-03-04T13:10:22.499605+0000","last_fullsized":"2024-03-04T13:10:22.499605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:01:37.596430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"255'312","reported_seq":1000,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.167644+0000","last_change":"2024-03-04T12:20:20.842756+0000","last_active":"2024-03-04T13:13:21.167644+0000","last_peered":"2024-03-04T13:13:21.167644+0000","last_clean":"2024-03-04T13:13:21.167644+0000","last_became_active":"2024-03-04T12:20:20.842433+0000","last_became_peered":"2024-03-04T12:20:20.842433+0000","last_unstale":"2024-03-04T13:13:21.167644+0000","last_undegraded":"2024-03-04T13:13:21.167644+0000","last_fullsized":"2024-03-04T13:13:21.167644+0000","mapping_epoch":26,"log_start":"255'300","ondisk_log_start":"255'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:13:17.760985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34072,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":590,"num_read_kb":823,"num_write":540,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":472,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.445437+0000","last_change":"2024-03-04T12:20:22.849592+0000","last_active":"2024-03-04T13:10:12.445437+0000","last_peered":"2024-03-04T13:10:12.445437+0000","last_clean":"2024-03-04T13:10:12.445437+0000","last_became_active":"2024-03-04T12:20:22.849274+0000","last_became_peered":"2024-03-04T12:20:22.849274+0000","last_unstale":"2024-03-04T13:10:12.445437+0000","last_undegraded":"2024-03-04T13:10:12.445437+0000","last_fullsized":"2024-03-04T13:10:12.445437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:45.671251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"255'108","reported_seq":598,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.765516+0000","last_change":"2024-03-04T12:20:24.865055+0000","last_active":"2024-03-04T13:11:27.765516+0000","last_peered":"2024-03-04T13:11:27.765516+0000","last_clean":"2024-03-04T13:11:27.765516+0000","last_became_active":"2024-03-04T12:20:24.864796+0000","last_became_peered":"2024-03-04T12:20:24.864796+0000","last_unstale":"2024-03-04T13:11:27.765516+0000","last_undegraded":"2024-03-04T13:11:27.765516+0000","last_fullsized":"2024-03-04T13:11:27.765516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:46:49.314439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":748,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":267,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"255'391","reported_seq":1914,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.309517+0000","last_change":"2024-03-04T12:20:16.836409+0000","last_active":"2024-03-04T13:12:39.309517+0000","last_peered":"2024-03-04T13:12:39.309517+0000","last_clean":"2024-03-04T13:12:39.309517+0000","last_became_active":"2024-03-04T12:20:16.836050+0000","last_became_peered":"2024-03-04T12:20:16.836050+0000","last_unstale":"2024-03-04T13:12:39.309517+0000","last_undegraded":"2024-03-04T13:12:39.309517+0000","last_fullsized":"2024-03-04T13:12:39.309517+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:34:01.964185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2110,"num_read_kb":2020,"num_write":444,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":508,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498621+0000","last_change":"2024-03-04T12:20:05.781479+0000","last_active":"2024-03-04T13:10:17.498621+0000","last_peered":"2024-03-04T13:10:17.498621+0000","last_clean":"2024-03-04T13:10:17.498621+0000","last_became_active":"2024-03-04T12:20:05.781199+0000","last_became_peered":"2024-03-04T12:20:05.781199+0000","last_unstale":"2024-03-04T13:10:17.498621+0000","last_undegraded":"2024-03-04T13:10:17.498621+0000","last_fullsized":"2024-03-04T13:10:17.498621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:44.684083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"255'204","reported_seq":828,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.101882+0000","last_change":"2024-03-04T12:20:14.821799+0000","last_active":"2024-03-04T13:13:21.101882+0000","last_peered":"2024-03-04T13:13:21.101882+0000","last_clean":"2024-03-04T13:13:21.101882+0000","last_became_active":"2024-03-04T12:20:14.821540+0000","last_became_peered":"2024-03-04T12:20:14.821540+0000","last_unstale":"2024-03-04T13:13:21.101882+0000","last_undegraded":"2024-03-04T13:13:21.101882+0000","last_fullsized":"2024-03-04T13:13:21.101882+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:53.300740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":43110,"num_write":1111,"num_write_kb":41335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.354153+0000","last_change":"2024-03-04T12:20:18.836025+0000","last_active":"2024-03-04T13:10:12.354153+0000","last_peered":"2024-03-04T13:10:12.354153+0000","last_clean":"2024-03-04T13:10:12.354153+0000","last_became_active":"2024-03-04T12:20:18.835509+0000","last_became_peered":"2024-03-04T12:20:18.835509+0000","last_unstale":"2024-03-04T13:10:12.354153+0000","last_undegraded":"2024-03-04T13:10:12.354153+0000","last_fullsized":"2024-03-04T13:10:12.354153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:20.235577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"255'693","reported_seq":2154,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:17.045647+0000","last_change":"2024-03-04T12:20:20.838876+0000","last_active":"2024-03-04T13:13:17.045647+0000","last_peered":"2024-03-04T13:13:17.045647+0000","last_clean":"2024-03-04T13:13:17.045647+0000","last_became_active":"2024-03-04T12:20:20.838633+0000","last_became_peered":"2024-03-04T12:20:20.838633+0000","last_unstale":"2024-03-04T13:13:17.045647+0000","last_undegraded":"2024-03-04T13:13:17.045647+0000","last_fullsized":"2024-03-04T13:13:17.045647+0000","mapping_epoch":26,"log_start":"255'600","ondisk_log_start":"255'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:41.132219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35283,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":944,"num_read_kb":1133,"num_write":338,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.501338+0000","last_change":"2024-03-04T12:20:22.848790+0000","last_active":"2024-03-04T13:10:32.501338+0000","last_peered":"2024-03-04T13:10:32.501338+0000","last_clean":"2024-03-04T13:10:32.501338+0000","last_became_active":"2024-03-04T12:20:22.848403+0000","last_became_peered":"2024-03-04T12:20:22.848403+0000","last_unstale":"2024-03-04T13:10:32.501338+0000","last_undegraded":"2024-03-04T13:10:32.501338+0000","last_fullsized":"2024-03-04T13:10:32.501338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:12:33.606788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"255'84","reported_seq":571,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.786585+0000","last_change":"2024-03-04T12:20:24.911878+0000","last_active":"2024-03-04T13:12:34.786585+0000","last_peered":"2024-03-04T13:12:34.786585+0000","last_clean":"2024-03-04T13:12:34.786585+0000","last_became_active":"2024-03-04T12:20:24.911303+0000","last_became_peered":"2024-03-04T12:20:24.911303+0000","last_unstale":"2024-03-04T13:12:34.786585+0000","last_undegraded":"2024-03-04T13:12:34.786585+0000","last_fullsized":"2024-03-04T13:12:34.786585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:38:09.768192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":85,"num_write":192,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"255'417","reported_seq":2050,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573274+0000","last_change":"2024-03-04T12:20:16.828170+0000","last_active":"2024-03-04T13:12:50.573274+0000","last_peered":"2024-03-04T13:12:50.573274+0000","last_clean":"2024-03-04T13:12:50.573274+0000","last_became_active":"2024-03-04T12:20:16.827513+0000","last_became_peered":"2024-03-04T12:20:16.827513+0000","last_unstale":"2024-03-04T13:12:50.573274+0000","last_undegraded":"2024-03-04T13:12:50.573274+0000","last_fullsized":"2024-03-04T13:12:50.573274+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:45:19.736683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2343,"num_read_kb":2241,"num_write":475,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":501,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.439427+0000","last_change":"2024-03-04T12:20:05.864062+0000","last_active":"2024-03-04T13:10:07.439427+0000","last_peered":"2024-03-04T13:10:07.439427+0000","last_clean":"2024-03-04T13:10:07.439427+0000","last_became_active":"2024-03-04T12:20:05.863125+0000","last_became_peered":"2024-03-04T12:20:05.863125+0000","last_unstale":"2024-03-04T13:10:07.439427+0000","last_undegraded":"2024-03-04T13:10:07.439427+0000","last_fullsized":"2024-03-04T13:10:07.439427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:25.960438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"255'165","reported_seq":746,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.449594+0000","last_change":"2024-03-04T12:20:14.813050+0000","last_active":"2024-03-04T13:12:07.449594+0000","last_peered":"2024-03-04T13:12:07.449594+0000","last_clean":"2024-03-04T13:12:07.449594+0000","last_became_active":"2024-03-04T12:20:14.812722+0000","last_became_peered":"2024-03-04T12:20:14.812722+0000","last_unstale":"2024-03-04T13:12:07.449594+0000","last_undegraded":"2024-03-04T13:12:07.449594+0000","last_fullsized":"2024-03-04T13:12:07.449594+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:14.492385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7550492,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":307,"num_read_kb":18084,"num_write":973,"num_write_kb":46336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.439970+0000","last_change":"2024-03-04T12:20:18.839341+0000","last_active":"2024-03-04T13:10:12.439970+0000","last_peered":"2024-03-04T13:10:12.439970+0000","last_clean":"2024-03-04T13:10:12.439970+0000","last_became_active":"2024-03-04T12:20:18.839038+0000","last_became_peered":"2024-03-04T12:20:18.839038+0000","last_unstale":"2024-03-04T13:10:12.439970+0000","last_undegraded":"2024-03-04T13:10:12.439970+0000","last_fullsized":"2024-03-04T13:10:12.439970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:51.813750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"255'245","reported_seq":1416,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.332033+0000","last_change":"2024-03-04T12:20:21.643795+0000","last_active":"2024-03-04T13:13:14.332033+0000","last_peered":"2024-03-04T13:13:14.332033+0000","last_clean":"2024-03-04T13:13:14.332033+0000","last_became_active":"2024-03-04T12:20:21.643475+0000","last_became_peered":"2024-03-04T12:20:21.643475+0000","last_unstale":"2024-03-04T13:13:14.332033+0000","last_undegraded":"2024-03-04T13:13:14.332033+0000","last_fullsized":"2024-03-04T13:13:14.332033+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:03:47.701687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":203,"num_write":195,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":473,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.446723+0000","last_change":"2024-03-04T12:20:22.854718+0000","last_active":"2024-03-04T13:10:22.446723+0000","last_peered":"2024-03-04T13:10:22.446723+0000","last_clean":"2024-03-04T13:10:22.446723+0000","last_became_active":"2024-03-04T12:20:22.854343+0000","last_became_peered":"2024-03-04T12:20:22.854343+0000","last_unstale":"2024-03-04T13:10:22.446723+0000","last_undegraded":"2024-03-04T13:10:22.446723+0000","last_fullsized":"2024-03-04T13:10:22.446723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:03:53.997420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"255'188","reported_seq":699,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:56.712390+0000","last_change":"2024-03-04T12:20:24.871310+0000","last_active":"2024-03-04T13:11:56.712390+0000","last_peered":"2024-03-04T13:11:56.712390+0000","last_clean":"2024-03-04T13:11:56.712390+0000","last_became_active":"2024-03-04T12:20:24.871020+0000","last_became_peered":"2024-03-04T12:20:24.871020+0000","last_unstale":"2024-03-04T13:11:56.712390+0000","last_undegraded":"2024-03-04T13:11:56.712390+0000","last_fullsized":"2024-03-04T13:11:56.712390+0000","mapping_epoch":30,"log_start":"250'100","ondisk_log_start":"250'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:50:33.268463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":353,"num_read_kb":362,"num_write":419,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"255'387","reported_seq":1852,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.953201+0000","last_change":"2024-03-04T12:20:16.825718+0000","last_active":"2024-03-04T13:12:36.953201+0000","last_peered":"2024-03-04T13:12:36.953201+0000","last_clean":"2024-03-04T13:12:36.953201+0000","last_became_active":"2024-03-04T12:20:16.825006+0000","last_became_peered":"2024-03-04T12:20:16.825006+0000","last_unstale":"2024-03-04T13:12:36.953201+0000","last_undegraded":"2024-03-04T13:12:36.953201+0000","last_fullsized":"2024-03-04T13:12:36.953201+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:46.542834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2027,"num_read_kb":1928,"num_write":438,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":500,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.353341+0000","last_change":"2024-03-04T12:20:05.783217+0000","last_active":"2024-03-04T13:10:07.353341+0000","last_peered":"2024-03-04T13:10:07.353341+0000","last_clean":"2024-03-04T13:10:07.353341+0000","last_became_active":"2024-03-04T12:20:05.782897+0000","last_became_peered":"2024-03-04T12:20:05.782897+0000","last_unstale":"2024-03-04T13:10:07.353341+0000","last_undegraded":"2024-03-04T13:10:07.353341+0000","last_fullsized":"2024-03-04T13:10:07.353341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:51:54.079894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"255'200","reported_seq":874,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.137782+0000","last_change":"2024-03-04T12:20:14.825079+0000","last_active":"2024-03-04T13:13:21.137782+0000","last_peered":"2024-03-04T13:13:21.137782+0000","last_clean":"2024-03-04T13:13:21.137782+0000","last_became_active":"2024-03-04T12:20:14.824810+0000","last_became_peered":"2024-03-04T12:20:14.824810+0000","last_unstale":"2024-03-04T13:13:21.137782+0000","last_undegraded":"2024-03-04T13:13:21.137782+0000","last_fullsized":"2024-03-04T13:13:21.137782+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:26:24.671565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3544974,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":19088,"num_write":1144,"num_write_kb":38256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.447280+0000","last_change":"2024-03-04T12:20:18.833327+0000","last_active":"2024-03-04T13:10:27.447280+0000","last_peered":"2024-03-04T13:10:27.447280+0000","last_clean":"2024-03-04T13:10:27.447280+0000","last_became_active":"2024-03-04T12:20:18.833051+0000","last_became_peered":"2024-03-04T12:20:18.833051+0000","last_unstale":"2024-03-04T13:10:27.447280+0000","last_undegraded":"2024-03-04T13:10:27.447280+0000","last_fullsized":"2024-03-04T13:10:27.447280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:42:25.419408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"255'125","reported_seq":654,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.300078+0000","last_change":"2024-03-04T12:20:20.845424+0000","last_active":"2024-03-04T13:10:53.300078+0000","last_peered":"2024-03-04T13:10:53.300078+0000","last_clean":"2024-03-04T13:10:53.300078+0000","last_became_active":"2024-03-04T12:20:20.845192+0000","last_became_peered":"2024-03-04T12:20:20.845192+0000","last_unstale":"2024-03-04T13:10:53.300078+0000","last_undegraded":"2024-03-04T13:10:53.300078+0000","last_fullsized":"2024-03-04T13:10:53.300078+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:32:04.776537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":155,"num_read_kb":149,"num_write":110,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.478882+0000","last_change":"2024-03-04T12:20:22.853030+0000","last_active":"2024-03-04T13:10:12.478882+0000","last_peered":"2024-03-04T13:10:12.478882+0000","last_clean":"2024-03-04T13:10:12.478882+0000","last_became_active":"2024-03-04T12:20:22.852745+0000","last_became_peered":"2024-03-04T12:20:22.852745+0000","last_unstale":"2024-03-04T13:10:12.478882+0000","last_undegraded":"2024-03-04T13:10:12.478882+0000","last_fullsized":"2024-03-04T13:10:12.478882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:47:11.374457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"255'85","reported_seq":579,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.354798+0000","last_change":"2024-03-04T12:20:24.865098+0000","last_active":"2024-03-04T13:10:17.354798+0000","last_peered":"2024-03-04T13:10:17.354798+0000","last_clean":"2024-03-04T13:10:17.354798+0000","last_became_active":"2024-03-04T12:20:24.864783+0000","last_became_peered":"2024-03-04T12:20:24.864783+0000","last_unstale":"2024-03-04T13:10:17.354798+0000","last_undegraded":"2024-03-04T13:10:17.354798+0000","last_fullsized":"2024-03-04T13:10:17.354798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:20:08.408598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":204,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"255'443","reported_seq":1900,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.307923+0000","last_change":"2024-03-04T12:20:16.827086+0000","last_active":"2024-03-04T13:12:39.307923+0000","last_peered":"2024-03-04T13:12:39.307923+0000","last_clean":"2024-03-04T13:12:39.307923+0000","last_became_active":"2024-03-04T12:20:16.826823+0000","last_became_peered":"2024-03-04T12:20:16.826823+0000","last_unstale":"2024-03-04T13:12:39.307923+0000","last_undegraded":"2024-03-04T13:12:39.307923+0000","last_fullsized":"2024-03-04T13:12:39.307923+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:21:23.072626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2302,"num_read_kb":2131,"num_write":558,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"255'158","reported_seq":753,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:09.809682+0000","last_change":"2024-03-04T12:20:14.819761+0000","last_active":"2024-03-04T13:13:09.809682+0000","last_peered":"2024-03-04T13:13:09.809682+0000","last_clean":"2024-03-04T13:13:09.809682+0000","last_became_active":"2024-03-04T12:20:14.819483+0000","last_became_peered":"2024-03-04T12:20:14.819483+0000","last_unstale":"2024-03-04T13:13:09.809682+0000","last_undegraded":"2024-03-04T13:13:09.809682+0000","last_fullsized":"2024-03-04T13:13:09.809682+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:40.255499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553728,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":336,"num_read_kb":12779,"num_write":962,"num_write_kb":35384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":501,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.541882+0000","last_change":"2024-03-04T12:20:05.863592+0000","last_active":"2024-03-04T13:10:07.541882+0000","last_peered":"2024-03-04T13:10:07.541882+0000","last_clean":"2024-03-04T13:10:07.541882+0000","last_became_active":"2024-03-04T12:20:05.863311+0000","last_became_peered":"2024-03-04T12:20:05.863311+0000","last_unstale":"2024-03-04T13:10:07.541882+0000","last_undegraded":"2024-03-04T13:10:07.541882+0000","last_fullsized":"2024-03-04T13:10:07.541882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:19:53.481187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.446710+0000","last_change":"2024-03-04T12:20:18.832677+0000","last_active":"2024-03-04T13:10:22.446710+0000","last_peered":"2024-03-04T13:10:22.446710+0000","last_clean":"2024-03-04T13:10:22.446710+0000","last_became_active":"2024-03-04T12:20:18.832355+0000","last_became_peered":"2024-03-04T12:20:18.832355+0000","last_unstale":"2024-03-04T13:10:22.446710+0000","last_undegraded":"2024-03-04T13:10:22.446710+0000","last_fullsized":"2024-03-04T13:10:22.446710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:45.490990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"255'260","reported_seq":909,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.175827+0000","last_change":"2024-03-04T12:20:20.842632+0000","last_active":"2024-03-04T13:13:21.175827+0000","last_peered":"2024-03-04T13:13:21.175827+0000","last_clean":"2024-03-04T13:13:21.175827+0000","last_became_active":"2024-03-04T12:20:20.842330+0000","last_became_peered":"2024-03-04T12:20:20.842330+0000","last_unstale":"2024-03-04T13:13:21.175827+0000","last_undegraded":"2024-03-04T13:13:21.175827+0000","last_fullsized":"2024-03-04T13:13:21.175827+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:06:51.329907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11717,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":373,"num_read_kb":489,"num_write":198,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":483,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499455+0000","last_change":"2024-03-04T12:20:22.854985+0000","last_active":"2024-03-04T13:10:22.499455+0000","last_peered":"2024-03-04T13:10:22.499455+0000","last_clean":"2024-03-04T13:10:22.499455+0000","last_became_active":"2024-03-04T12:20:22.854507+0000","last_became_peered":"2024-03-04T12:20:22.854507+0000","last_unstale":"2024-03-04T13:10:22.499455+0000","last_undegraded":"2024-03-04T13:10:22.499455+0000","last_fullsized":"2024-03-04T13:10:22.499455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:46:38.735735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"255'106","reported_seq":591,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:17.346925+0000","last_change":"2024-03-04T12:20:24.912422+0000","last_active":"2024-03-04T13:11:17.346925+0000","last_peered":"2024-03-04T13:11:17.346925+0000","last_clean":"2024-03-04T13:11:17.346925+0000","last_became_active":"2024-03-04T12:20:24.911970+0000","last_became_peered":"2024-03-04T12:20:24.911970+0000","last_unstale":"2024-03-04T13:11:17.346925+0000","last_undegraded":"2024-03-04T13:11:17.346925+0000","last_fullsized":"2024-03-04T13:11:17.346925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:21:27.924509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":120,"num_write":241,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"255'321","reported_seq":1676,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.075729+0000","last_change":"2024-03-04T12:20:16.825499+0000","last_active":"2024-03-04T13:12:18.075729+0000","last_peered":"2024-03-04T13:12:18.075729+0000","last_clean":"2024-03-04T13:12:18.075729+0000","last_became_active":"2024-03-04T12:20:16.825241+0000","last_became_peered":"2024-03-04T12:20:16.825241+0000","last_unstale":"2024-03-04T13:12:18.075729+0000","last_undegraded":"2024-03-04T13:12:18.075729+0000","last_fullsized":"2024-03-04T13:12:18.075729+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:35:19.260142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1925,"num_read_kb":1835,"num_write":376,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"255'162","reported_seq":753,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:19.640793+0000","last_change":"2024-03-04T12:20:14.816111+0000","last_active":"2024-03-04T13:12:19.640793+0000","last_peered":"2024-03-04T13:12:19.640793+0000","last_clean":"2024-03-04T13:12:19.640793+0000","last_became_active":"2024-03-04T12:20:14.815589+0000","last_became_peered":"2024-03-04T12:20:14.815589+0000","last_unstale":"2024-03-04T13:12:19.640793+0000","last_undegraded":"2024-03-04T13:12:19.640793+0000","last_fullsized":"2024-03-04T13:12:19.640793+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:18:53.206330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11384047,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":367,"num_read_kb":3319,"num_write":965,"num_write_kb":11696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":507,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498811+0000","last_change":"2024-03-04T12:20:05.863980+0000","last_active":"2024-03-04T13:10:17.498811+0000","last_peered":"2024-03-04T13:10:17.498811+0000","last_clean":"2024-03-04T13:10:17.498811+0000","last_became_active":"2024-03-04T12:20:05.863682+0000","last_became_peered":"2024-03-04T12:20:05.863682+0000","last_unstale":"2024-03-04T13:10:17.498811+0000","last_undegraded":"2024-03-04T13:10:17.498811+0000","last_fullsized":"2024-03-04T13:10:17.498811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:13.302689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.480354+0000","last_change":"2024-03-04T12:20:18.834213+0000","last_active":"2024-03-04T13:10:22.480354+0000","last_peered":"2024-03-04T13:10:22.480354+0000","last_clean":"2024-03-04T13:10:22.480354+0000","last_became_active":"2024-03-04T12:20:18.833896+0000","last_became_peered":"2024-03-04T12:20:18.833896+0000","last_unstale":"2024-03-04T13:10:22.480354+0000","last_undegraded":"2024-03-04T13:10:22.480354+0000","last_fullsized":"2024-03-04T13:10:22.480354+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:39:33.270747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"255'200","reported_seq":755,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:53.809580+0000","last_change":"2024-03-04T12:20:21.642318+0000","last_active":"2024-03-04T13:12:53.809580+0000","last_peered":"2024-03-04T13:12:53.809580+0000","last_clean":"2024-03-04T13:12:53.809580+0000","last_became_active":"2024-03-04T12:20:21.641826+0000","last_became_peered":"2024-03-04T12:20:21.641826+0000","last_unstale":"2024-03-04T13:12:53.809580+0000","last_undegraded":"2024-03-04T13:12:53.809580+0000","last_fullsized":"2024-03-04T13:12:53.809580+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:07:56.018494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":255,"num_read_kb":248,"num_write":230,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"255'535","reported_seq":4185,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.933669+0000","last_change":"2024-03-04T12:20:22.853803+0000","last_active":"2024-03-04T13:13:20.933669+0000","last_peered":"2024-03-04T13:13:20.933669+0000","last_clean":"2024-03-04T13:13:20.933669+0000","last_became_active":"2024-03-04T12:20:22.853588+0000","last_became_peered":"2024-03-04T12:20:22.853588+0000","last_unstale":"2024-03-04T13:13:20.933669+0000","last_undegraded":"2024-03-04T13:13:20.933669+0000","last_fullsized":"2024-03-04T13:13:20.933669+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:04:32.122406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"255'115","reported_seq":592,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:17.465945+0000","last_change":"2024-03-04T12:20:24.911411+0000","last_active":"2024-03-04T13:12:17.465945+0000","last_peered":"2024-03-04T13:12:17.465945+0000","last_clean":"2024-03-04T13:12:17.465945+0000","last_became_active":"2024-03-04T12:20:24.911103+0000","last_became_peered":"2024-03-04T12:20:24.911103+0000","last_unstale":"2024-03-04T13:12:17.465945+0000","last_undegraded":"2024-03-04T13:12:17.465945+0000","last_fullsized":"2024-03-04T13:12:17.465945+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:46.488236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":105,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"255'1398","reported_seq":3054,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.328335+0000","last_change":"2024-03-04T12:20:16.834067+0000","last_active":"2024-03-04T13:12:39.328335+0000","last_peered":"2024-03-04T13:12:39.328335+0000","last_clean":"2024-03-04T13:12:39.328335+0000","last_became_active":"2024-03-04T12:20:16.833689+0000","last_became_peered":"2024-03-04T12:20:16.833689+0000","last_unstale":"2024-03-04T13:12:39.328335+0000","last_undegraded":"2024-03-04T13:12:39.328335+0000","last_fullsized":"2024-03-04T13:12:39.328335+0000","mapping_epoch":22,"log_start":"255'1300","ondisk_log_start":"255'1300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":1300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:28:45.636854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5949,"num_read_kb":5124,"num_write":2086,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"255'143","reported_seq":823,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:17.465937+0000","last_change":"2024-03-04T12:20:14.814534+0000","last_active":"2024-03-04T13:12:17.465937+0000","last_peered":"2024-03-04T13:12:17.465937+0000","last_clean":"2024-03-04T13:12:17.465937+0000","last_became_active":"2024-03-04T12:20:14.814220+0000","last_became_peered":"2024-03-04T12:20:14.814220+0000","last_unstale":"2024-03-04T13:12:17.465937+0000","last_undegraded":"2024-03-04T13:12:17.465937+0000","last_fullsized":"2024-03-04T13:12:17.465937+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:53.600042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262328,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":11189,"num_write":841,"num_write_kb":14687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":500,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:57.540873+0000","last_change":"2024-03-04T12:20:05.784418+0000","last_active":"2024-03-04T13:09:57.540873+0000","last_peered":"2024-03-04T13:09:57.540873+0000","last_clean":"2024-03-04T13:09:57.540873+0000","last_became_active":"2024-03-04T12:20:05.784145+0000","last_became_peered":"2024-03-04T12:20:05.784145+0000","last_unstale":"2024-03-04T13:09:57.540873+0000","last_undegraded":"2024-03-04T13:09:57.540873+0000","last_fullsized":"2024-03-04T13:09:57.540873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:41.291467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499426+0000","last_change":"2024-03-04T12:20:18.833379+0000","last_active":"2024-03-04T13:10:22.499426+0000","last_peered":"2024-03-04T13:10:22.499426+0000","last_clean":"2024-03-04T13:10:22.499426+0000","last_became_active":"2024-03-04T12:20:18.832932+0000","last_became_peered":"2024-03-04T12:20:18.832932+0000","last_unstale":"2024-03-04T13:10:22.499426+0000","last_undegraded":"2024-03-04T13:10:22.499426+0000","last_fullsized":"2024-03-04T13:10:22.499426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:38:57.403504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"255'109","reported_seq":641,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.740133+0000","last_change":"2024-03-04T12:20:20.841516+0000","last_active":"2024-03-04T13:10:53.740133+0000","last_peered":"2024-03-04T13:10:53.740133+0000","last_clean":"2024-03-04T13:10:53.740133+0000","last_became_active":"2024-03-04T12:20:20.841108+0000","last_became_peered":"2024-03-04T12:20:20.841108+0000","last_unstale":"2024-03-04T13:10:53.740133+0000","last_undegraded":"2024-03-04T13:10:53.740133+0000","last_fullsized":"2024-03-04T13:10:53.740133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:56:40.136670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":86,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"255'530","reported_seq":2283,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.937891+0000","last_change":"2024-03-04T12:20:22.859649+0000","last_active":"2024-03-04T13:13:20.937891+0000","last_peered":"2024-03-04T13:13:20.937891+0000","last_clean":"2024-03-04T13:13:20.937891+0000","last_became_active":"2024-03-04T12:20:22.859306+0000","last_became_peered":"2024-03-04T12:20:22.859306+0000","last_unstale":"2024-03-04T13:13:20.937891+0000","last_undegraded":"2024-03-04T13:13:20.937891+0000","last_fullsized":"2024-03-04T13:13:20.937891+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:16:12.502466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"255'153","reported_seq":634,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:02.370689+0000","last_change":"2024-03-04T12:20:24.866096+0000","last_active":"2024-03-04T13:10:02.370689+0000","last_peered":"2024-03-04T13:10:02.370689+0000","last_clean":"2024-03-04T13:10:02.370689+0000","last_became_active":"2024-03-04T12:20:24.865816+0000","last_became_peered":"2024-03-04T12:20:24.865816+0000","last_unstale":"2024-03-04T13:10:02.370689+0000","last_undegraded":"2024-03-04T13:10:02.370689+0000","last_fullsized":"2024-03-04T13:10:02.370689+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:36:25.465085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":201,"num_read_kb":201,"num_write":359,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"255'653","reported_seq":2055,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.558225+0000","last_change":"2024-03-04T12:20:16.825715+0000","last_active":"2024-03-04T13:12:22.558225+0000","last_peered":"2024-03-04T13:12:22.558225+0000","last_clean":"2024-03-04T13:12:22.558225+0000","last_became_active":"2024-03-04T12:20:16.825377+0000","last_became_peered":"2024-03-04T12:20:16.825377+0000","last_unstale":"2024-03-04T13:12:22.558225+0000","last_undegraded":"2024-03-04T13:12:22.558225+0000","last_fullsized":"2024-03-04T13:12:22.558225+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:08.216187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2990,"num_read_kb":2698,"num_write":869,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"255'180","reported_seq":872,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.021737+0000","last_change":"2024-03-04T12:20:14.812062+0000","last_active":"2024-03-04T13:13:21.021737+0000","last_peered":"2024-03-04T13:13:21.021737+0000","last_clean":"2024-03-04T13:13:21.021737+0000","last_became_active":"2024-03-04T12:20:14.811756+0000","last_became_peered":"2024-03-04T12:20:14.811756+0000","last_unstale":"2024-03-04T13:13:21.021737+0000","last_undegraded":"2024-03-04T13:13:21.021737+0000","last_fullsized":"2024-03-04T13:13:21.021737+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:10:50.920801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104383,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":578,"num_read_kb":172500,"num_write":1029,"num_write_kb":54165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":502,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:57.476776+0000","last_change":"2024-03-04T12:20:05.779688+0000","last_active":"2024-03-04T13:09:57.476776+0000","last_peered":"2024-03-04T13:09:57.476776+0000","last_clean":"2024-03-04T13:09:57.476776+0000","last_became_active":"2024-03-04T12:20:05.779370+0000","last_became_peered":"2024-03-04T12:20:05.779370+0000","last_unstale":"2024-03-04T13:09:57.476776+0000","last_undegraded":"2024-03-04T13:09:57.476776+0000","last_fullsized":"2024-03-04T13:09:57.476776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:52.901612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"32'3","reported_seq":795,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.704335+0000","last_change":"2024-03-04T12:20:18.833572+0000","last_active":"2024-03-04T13:13:20.704335+0000","last_peered":"2024-03-04T13:13:20.704335+0000","last_clean":"2024-03-04T13:13:20.704335+0000","last_became_active":"2024-03-04T12:20:18.833273+0000","last_became_peered":"2024-03-04T12:20:18.833273+0000","last_unstale":"2024-03-04T13:13:20.704335+0000","last_undegraded":"2024-03-04T13:13:20.704335+0000","last_fullsized":"2024-03-04T13:13:20.704335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:15.952949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":470,"num_read_kb":468,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"255'322","reported_seq":1037,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.213330+0000","last_change":"2024-03-04T12:20:21.643470+0000","last_active":"2024-03-04T13:13:21.213330+0000","last_peered":"2024-03-04T13:13:21.213330+0000","last_clean":"2024-03-04T13:13:21.213330+0000","last_became_active":"2024-03-04T12:20:21.642696+0000","last_became_peered":"2024-03-04T12:20:21.642696+0000","last_unstale":"2024-03-04T13:13:21.213330+0000","last_undegraded":"2024-03-04T13:13:21.213330+0000","last_fullsized":"2024-03-04T13:13:21.213330+0000","mapping_epoch":26,"log_start":"255'300","ondisk_log_start":"255'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:21:06.437125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17780,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":637,"num_write":242,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":475,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.453513+0000","last_change":"2024-03-04T12:20:22.853586+0000","last_active":"2024-03-04T13:10:22.453513+0000","last_peered":"2024-03-04T13:10:22.453513+0000","last_clean":"2024-03-04T13:10:22.453513+0000","last_became_active":"2024-03-04T12:20:22.853272+0000","last_became_peered":"2024-03-04T12:20:22.853272+0000","last_unstale":"2024-03-04T13:10:22.453513+0000","last_undegraded":"2024-03-04T13:10:22.453513+0000","last_fullsized":"2024-03-04T13:10:22.453513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:01.588693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"255'108","reported_seq":582,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:03.491177+0000","last_change":"2024-03-04T12:20:24.864478+0000","last_active":"2024-03-04T13:10:03.491177+0000","last_peered":"2024-03-04T13:10:03.491177+0000","last_clean":"2024-03-04T13:10:03.491177+0000","last_became_active":"2024-03-04T12:20:24.863996+0000","last_became_peered":"2024-03-04T12:20:24.863996+0000","last_unstale":"2024-03-04T13:10:03.491177+0000","last_undegraded":"2024-03-04T13:10:03.491177+0000","last_fullsized":"2024-03-04T13:10:03.491177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:25:42.964622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":275,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"255'114","reported_seq":602,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:08.265674+0000","last_change":"2024-03-04T12:20:24.868945+0000","last_active":"2024-03-04T13:12:08.265674+0000","last_peered":"2024-03-04T13:12:08.265674+0000","last_clean":"2024-03-04T13:12:08.265674+0000","last_became_active":"2024-03-04T12:20:24.868636+0000","last_became_peered":"2024-03-04T12:20:24.868636+0000","last_unstale":"2024-03-04T13:12:08.265674+0000","last_undegraded":"2024-03-04T13:12:08.265674+0000","last_fullsized":"2024-03-04T13:12:08.265674+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:22:02.061168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":141,"num_write":275,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"255'387","reported_seq":1862,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573873+0000","last_change":"2024-03-04T12:20:16.823240+0000","last_active":"2024-03-04T13:12:50.573873+0000","last_peered":"2024-03-04T13:12:50.573873+0000","last_clean":"2024-03-04T13:12:50.573873+0000","last_became_active":"2024-03-04T12:20:16.822887+0000","last_became_peered":"2024-03-04T12:20:16.822887+0000","last_unstale":"2024-03-04T13:12:50.573873+0000","last_undegraded":"2024-03-04T13:12:50.573873+0000","last_fullsized":"2024-03-04T13:12:50.573873+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:22:42.786549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2100,"num_read_kb":1986,"num_write":448,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"255'173","reported_seq":777,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.066553+0000","last_change":"2024-03-04T12:20:14.824134+0000","last_active":"2024-03-04T13:13:21.066553+0000","last_peered":"2024-03-04T13:13:21.066553+0000","last_clean":"2024-03-04T13:13:21.066553+0000","last_became_active":"2024-03-04T12:20:14.823661+0000","last_became_peered":"2024-03-04T12:20:14.823661+0000","last_unstale":"2024-03-04T13:13:21.066553+0000","last_undegraded":"2024-03-04T13:13:21.066553+0000","last_fullsized":"2024-03-04T13:13:21.066553+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:36:15.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":384,"num_read_kb":10388,"num_write":1049,"num_write_kb":6576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":484,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.536495+0000","last_change":"2024-03-04T12:20:18.836980+0000","last_active":"2024-03-04T13:09:22.536495+0000","last_peered":"2024-03-04T13:09:22.536495+0000","last_clean":"2024-03-04T13:09:22.536495+0000","last_became_active":"2024-03-04T12:20:18.836487+0000","last_became_peered":"2024-03-04T12:20:18.836487+0000","last_unstale":"2024-03-04T13:09:22.536495+0000","last_undegraded":"2024-03-04T13:09:22.536495+0000","last_fullsized":"2024-03-04T13:09:22.536495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:57.938086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"255'141","reported_seq":701,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.110626+0000","last_change":"2024-03-04T12:20:20.841992+0000","last_active":"2024-03-04T13:13:21.110626+0000","last_peered":"2024-03-04T13:13:21.110626+0000","last_clean":"2024-03-04T13:13:21.110626+0000","last_became_active":"2024-03-04T12:20:20.841696+0000","last_became_peered":"2024-03-04T12:20:20.841696+0000","last_unstale":"2024-03-04T13:13:21.110626+0000","last_undegraded":"2024-03-04T13:13:21.110626+0000","last_fullsized":"2024-03-04T13:13:21.110626+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:29.714761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11864,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":271,"num_write":104,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":472,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.446298+0000","last_change":"2024-03-04T12:20:22.857779+0000","last_active":"2024-03-04T13:09:22.446298+0000","last_peered":"2024-03-04T13:09:22.446298+0000","last_clean":"2024-03-04T13:09:22.446298+0000","last_became_active":"2024-03-04T12:20:22.857513+0000","last_became_peered":"2024-03-04T12:20:22.857513+0000","last_unstale":"2024-03-04T13:09:22.446298+0000","last_undegraded":"2024-03-04T13:09:22.446298+0000","last_fullsized":"2024-03-04T13:09:22.446298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:18.804581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"255'97","reported_seq":578,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.454779+0000","last_change":"2024-03-04T12:20:24.863622+0000","last_active":"2024-03-04T13:10:32.454779+0000","last_peered":"2024-03-04T13:10:32.454779+0000","last_clean":"2024-03-04T13:10:32.454779+0000","last_became_active":"2024-03-04T12:20:24.863346+0000","last_became_peered":"2024-03-04T12:20:24.863346+0000","last_unstale":"2024-03-04T13:10:32.454779+0000","last_undegraded":"2024-03-04T13:10:32.454779+0000","last_fullsized":"2024-03-04T13:10:32.454779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:44:24.783559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":222,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"255'705","reported_seq":2061,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.916714+0000","last_change":"2024-03-04T12:20:16.834338+0000","last_active":"2024-03-04T13:12:57.916714+0000","last_peered":"2024-03-04T13:12:57.916714+0000","last_clean":"2024-03-04T13:12:57.916714+0000","last_became_active":"2024-03-04T12:20:16.834080+0000","last_became_peered":"2024-03-04T12:20:16.834080+0000","last_unstale":"2024-03-04T13:12:57.916714+0000","last_undegraded":"2024-03-04T13:12:57.916714+0000","last_fullsized":"2024-03-04T13:12:57.916714+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":600,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:22.194726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3097,"num_read_kb":2763,"num_write":935,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"255'233","reported_seq":908,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.052555+0000","last_change":"2024-03-04T12:20:14.816239+0000","last_active":"2024-03-04T13:13:21.052555+0000","last_peered":"2024-03-04T13:13:21.052555+0000","last_clean":"2024-03-04T13:13:21.052555+0000","last_became_active":"2024-03-04T12:20:14.814738+0000","last_became_peered":"2024-03-04T12:20:14.814738+0000","last_unstale":"2024-03-04T13:13:21.052555+0000","last_undegraded":"2024-03-04T13:13:21.052555+0000","last_fullsized":"2024-03-04T13:13:21.052555+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:21:09.377678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5787887,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":617,"num_read_kb":16203,"num_write":1488,"num_write_kb":37968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.446358+0000","last_change":"2024-03-04T12:20:18.835129+0000","last_active":"2024-03-04T13:09:22.446358+0000","last_peered":"2024-03-04T13:09:22.446358+0000","last_clean":"2024-03-04T13:09:22.446358+0000","last_became_active":"2024-03-04T12:20:18.834793+0000","last_became_peered":"2024-03-04T12:20:18.834793+0000","last_unstale":"2024-03-04T13:09:22.446358+0000","last_undegraded":"2024-03-04T13:09:22.446358+0000","last_fullsized":"2024-03-04T13:09:22.446358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:21:52.556360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"255'57","reported_seq":543,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:52.173344+0000","last_change":"2024-03-04T12:20:20.832322+0000","last_active":"2024-03-04T13:10:52.173344+0000","last_peered":"2024-03-04T13:10:52.173344+0000","last_clean":"2024-03-04T13:10:52.173344+0000","last_became_active":"2024-03-04T12:20:20.832034+0000","last_became_peered":"2024-03-04T12:20:20.832034+0000","last_unstale":"2024-03-04T13:10:52.173344+0000","last_undegraded":"2024-03-04T13:10:52.173344+0000","last_fullsized":"2024-03-04T13:10:52.173344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:23:22.034376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":40,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.489906+0000","last_change":"2024-03-04T12:20:22.855900+0000","last_active":"2024-03-04T13:09:22.489906+0000","last_peered":"2024-03-04T13:09:22.489906+0000","last_clean":"2024-03-04T13:09:22.489906+0000","last_became_active":"2024-03-04T12:20:22.855477+0000","last_became_peered":"2024-03-04T12:20:22.855477+0000","last_unstale":"2024-03-04T13:09:22.489906+0000","last_undegraded":"2024-03-04T13:09:22.489906+0000","last_fullsized":"2024-03-04T13:09:22.489906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:25:54.549022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"255'84","reported_seq":558,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.447271+0000","last_change":"2024-03-04T12:20:24.865842+0000","last_active":"2024-03-04T13:10:27.447271+0000","last_peered":"2024-03-04T13:10:27.447271+0000","last_clean":"2024-03-04T13:10:27.447271+0000","last_became_active":"2024-03-04T12:20:24.865534+0000","last_became_peered":"2024-03-04T12:20:24.865534+0000","last_unstale":"2024-03-04T13:10:27.447271+0000","last_undegraded":"2024-03-04T13:10:27.447271+0000","last_fullsized":"2024-03-04T13:10:27.447271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:17:39.700895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":78,"num_write":202,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"255'718","reported_seq":2253,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:04.176061+0000","last_change":"2024-03-04T12:20:16.830393+0000","last_active":"2024-03-04T13:12:04.176061+0000","last_peered":"2024-03-04T13:12:04.176061+0000","last_clean":"2024-03-04T13:12:04.176061+0000","last_became_active":"2024-03-04T12:20:16.829012+0000","last_became_peered":"2024-03-04T12:20:16.829012+0000","last_unstale":"2024-03-04T13:12:04.176061+0000","last_undegraded":"2024-03-04T13:12:04.176061+0000","last_fullsized":"2024-03-04T13:12:04.176061+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:21:58.770726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3304,"num_read_kb":2912,"num_write":1016,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"255'175","reported_seq":859,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.066968+0000","last_change":"2024-03-04T12:20:14.822487+0000","last_active":"2024-03-04T13:13:21.066968+0000","last_peered":"2024-03-04T13:13:21.066968+0000","last_clean":"2024-03-04T13:13:21.066968+0000","last_became_active":"2024-03-04T12:20:14.822127+0000","last_became_peered":"2024-03-04T12:20:14.822127+0000","last_unstale":"2024-03-04T13:13:21.066968+0000","last_undegraded":"2024-03-04T13:13:21.066968+0000","last_fullsized":"2024-03-04T13:13:21.066968+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:19.430639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947361,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":518,"num_read_kb":182821,"num_write":997,"num_write_kb":40014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.489870+0000","last_change":"2024-03-04T12:20:18.831317+0000","last_active":"2024-03-04T13:09:22.489870+0000","last_peered":"2024-03-04T13:09:22.489870+0000","last_clean":"2024-03-04T13:09:22.489870+0000","last_became_active":"2024-03-04T12:20:18.830818+0000","last_became_peered":"2024-03-04T12:20:18.830818+0000","last_unstale":"2024-03-04T13:09:22.489870+0000","last_undegraded":"2024-03-04T13:09:22.489870+0000","last_fullsized":"2024-03-04T13:09:22.489870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:02.931088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"255'164","reported_seq":739,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.014265+0000","last_change":"2024-03-04T12:20:20.841367+0000","last_active":"2024-03-04T13:13:21.014265+0000","last_peered":"2024-03-04T13:13:21.014265+0000","last_clean":"2024-03-04T13:13:21.014265+0000","last_became_active":"2024-03-04T12:20:20.840999+0000","last_became_peered":"2024-03-04T12:20:20.840999+0000","last_unstale":"2024-03-04T13:13:21.014265+0000","last_undegraded":"2024-03-04T13:13:21.014265+0000","last_fullsized":"2024-03-04T13:13:21.014265+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:44:25.478712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8097,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":284,"num_write":124,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.472066+0000","last_change":"2024-03-04T12:20:22.849190+0000","last_active":"2024-03-04T13:09:22.472066+0000","last_peered":"2024-03-04T13:09:22.472066+0000","last_clean":"2024-03-04T13:09:22.472066+0000","last_became_active":"2024-03-04T12:20:22.848877+0000","last_became_peered":"2024-03-04T12:20:22.848877+0000","last_unstale":"2024-03-04T13:09:22.472066+0000","last_undegraded":"2024-03-04T13:09:22.472066+0000","last_fullsized":"2024-03-04T13:09:22.472066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:55:22.244587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"255'99","reported_seq":570,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:14.114497+0000","last_change":"2024-03-04T12:20:24.864100+0000","last_active":"2024-03-04T13:12:14.114497+0000","last_peered":"2024-03-04T13:12:14.114497+0000","last_clean":"2024-03-04T13:12:14.114497+0000","last_became_active":"2024-03-04T12:20:24.863810+0000","last_became_peered":"2024-03-04T12:20:24.863810+0000","last_unstale":"2024-03-04T13:12:14.114497+0000","last_undegraded":"2024-03-04T13:12:14.114497+0000","last_fullsized":"2024-03-04T13:12:14.114497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:00:35.223823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":234,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"255'782","reported_seq":2313,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.954531+0000","last_change":"2024-03-04T12:20:51.031767+0000","last_active":"2024-03-04T13:12:36.954531+0000","last_peered":"2024-03-04T13:12:36.954531+0000","last_clean":"2024-03-04T13:12:36.954531+0000","last_became_active":"2024-03-04T12:20:51.031448+0000","last_became_peered":"2024-03-04T12:20:51.031448+0000","last_unstale":"2024-03-04T13:12:36.954531+0000","last_undegraded":"2024-03-04T13:12:36.954531+0000","last_fullsized":"2024-03-04T13:12:36.954531+0000","mapping_epoch":33,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:52.075573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3519,"num_read_kb":3144,"num_write":1038,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"255'186","reported_seq":815,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.195707+0000","last_change":"2024-03-04T12:20:14.824465+0000","last_active":"2024-03-04T13:13:21.195707+0000","last_peered":"2024-03-04T13:13:21.195707+0000","last_clean":"2024-03-04T13:13:21.195707+0000","last_became_active":"2024-03-04T12:20:14.824152+0000","last_became_peered":"2024-03-04T12:20:14.824152+0000","last_unstale":"2024-03-04T13:13:21.195707+0000","last_undegraded":"2024-03-04T13:13:21.195707+0000","last_fullsized":"2024-03-04T13:13:21.195707+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:16:58.677646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259657,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":396,"num_read_kb":84164,"num_write":1039,"num_write_kb":34071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":486,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.472038+0000","last_change":"2024-03-04T12:20:18.839090+0000","last_active":"2024-03-04T13:09:22.472038+0000","last_peered":"2024-03-04T13:09:22.472038+0000","last_clean":"2024-03-04T13:09:22.472038+0000","last_became_active":"2024-03-04T12:20:18.838749+0000","last_became_peered":"2024-03-04T12:20:18.838749+0000","last_unstale":"2024-03-04T13:09:22.472038+0000","last_undegraded":"2024-03-04T13:09:22.472038+0000","last_fullsized":"2024-03-04T13:09:22.472038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:30:49.140805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"255'125","reported_seq":689,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.989916+0000","last_change":"2024-03-04T12:20:20.839637+0000","last_active":"2024-03-04T13:13:20.989916+0000","last_peered":"2024-03-04T13:13:20.989916+0000","last_clean":"2024-03-04T13:13:20.989916+0000","last_became_active":"2024-03-04T12:20:20.839286+0000","last_became_peered":"2024-03-04T12:20:20.839286+0000","last_unstale":"2024-03-04T13:13:20.989916+0000","last_undegraded":"2024-03-04T13:13:20.989916+0000","last_fullsized":"2024-03-04T13:13:20.989916+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:46.347069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":210,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":470,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.439439+0000","last_change":"2024-03-04T12:20:22.849602+0000","last_active":"2024-03-04T13:09:22.439439+0000","last_peered":"2024-03-04T13:09:22.439439+0000","last_clean":"2024-03-04T13:09:22.439439+0000","last_became_active":"2024-03-04T12:20:22.849340+0000","last_became_peered":"2024-03-04T12:20:22.849340+0000","last_unstale":"2024-03-04T13:09:22.439439+0000","last_undegraded":"2024-03-04T13:09:22.439439+0000","last_fullsized":"2024-03-04T13:09:22.439439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:54:45.340993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"255'412","reported_seq":1874,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.782213+0000","last_change":"2024-03-04T12:20:16.821743+0000","last_active":"2024-03-04T13:12:34.782213+0000","last_peered":"2024-03-04T13:12:34.782213+0000","last_clean":"2024-03-04T13:12:34.782213+0000","last_became_active":"2024-03-04T12:20:16.821451+0000","last_became_peered":"2024-03-04T12:20:16.821451+0000","last_unstale":"2024-03-04T13:12:34.782213+0000","last_undegraded":"2024-03-04T13:12:34.782213+0000","last_fullsized":"2024-03-04T13:12:34.782213+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:11:35.448538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2212,"num_read_kb":2069,"num_write":499,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"255'211","reported_seq":801,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.050793+0000","last_change":"2024-03-04T12:20:14.810574+0000","last_active":"2024-03-04T13:13:21.050793+0000","last_peered":"2024-03-04T13:13:21.050793+0000","last_clean":"2024-03-04T13:13:21.050793+0000","last_became_active":"2024-03-04T12:20:14.810309+0000","last_became_peered":"2024-03-04T12:20:14.810309+0000","last_unstale":"2024-03-04T13:13:21.050793+0000","last_undegraded":"2024-03-04T13:13:21.050793+0000","last_fullsized":"2024-03-04T13:13:21.050793+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:00:53.380209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195451,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":442,"num_read_kb":8634,"num_write":1082,"num_write_kb":36368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.447299+0000","last_change":"2024-03-04T12:20:18.833581+0000","last_active":"2024-03-04T13:10:27.447299+0000","last_peered":"2024-03-04T13:10:27.447299+0000","last_clean":"2024-03-04T13:10:27.447299+0000","last_became_active":"2024-03-04T12:20:18.833300+0000","last_became_peered":"2024-03-04T12:20:18.833300+0000","last_unstale":"2024-03-04T13:10:27.447299+0000","last_undegraded":"2024-03-04T13:10:27.447299+0000","last_fullsized":"2024-03-04T13:10:27.447299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:18.547510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"255'193","reported_seq":801,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.135599+0000","last_change":"2024-03-04T12:20:20.838878+0000","last_active":"2024-03-04T13:13:14.135599+0000","last_peered":"2024-03-04T13:13:14.135599+0000","last_clean":"2024-03-04T13:13:14.135599+0000","last_became_active":"2024-03-04T12:20:20.838600+0000","last_became_peered":"2024-03-04T12:20:20.838600+0000","last_unstale":"2024-03-04T13:13:14.135599+0000","last_undegraded":"2024-03-04T13:13:14.135599+0000","last_fullsized":"2024-03-04T13:13:14.135599+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:23:04.099319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23990,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":269,"num_read_kb":389,"num_write":134,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":474,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.355538+0000","last_change":"2024-03-04T12:20:22.855745+0000","last_active":"2024-03-04T13:10:22.355538+0000","last_peered":"2024-03-04T13:10:22.355538+0000","last_clean":"2024-03-04T13:10:22.355538+0000","last_became_active":"2024-03-04T12:20:22.855464+0000","last_became_peered":"2024-03-04T12:20:22.855464+0000","last_unstale":"2024-03-04T13:10:22.355538+0000","last_undegraded":"2024-03-04T13:10:22.355538+0000","last_fullsized":"2024-03-04T13:10:22.355538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:30:46.542674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"255'170","reported_seq":663,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:47.462606+0000","last_change":"2024-03-04T12:20:24.912595+0000","last_active":"2024-03-04T13:11:47.462606+0000","last_peered":"2024-03-04T13:11:47.462606+0000","last_clean":"2024-03-04T13:11:47.462606+0000","last_became_active":"2024-03-04T12:20:24.912118+0000","last_became_peered":"2024-03-04T12:20:24.912118+0000","last_unstale":"2024-03-04T13:11:47.462606+0000","last_undegraded":"2024-03-04T13:11:47.462606+0000","last_fullsized":"2024-03-04T13:11:47.462606+0000","mapping_epoch":30,"log_start":"250'100","ondisk_log_start":"250'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:40:35.111451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":221,"num_read_kb":223,"num_write":386,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"255'445","reported_seq":1784,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.557491+0000","last_change":"2024-03-04T12:20:16.828841+0000","last_active":"2024-03-04T13:12:22.557491+0000","last_peered":"2024-03-04T13:12:22.557491+0000","last_clean":"2024-03-04T13:12:22.557491+0000","last_became_active":"2024-03-04T12:20:16.828550+0000","last_became_peered":"2024-03-04T12:20:16.828550+0000","last_unstale":"2024-03-04T13:12:22.557491+0000","last_undegraded":"2024-03-04T13:12:22.557491+0000","last_fullsized":"2024-03-04T13:12:22.557491+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:57:14.787116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2172,"num_read_kb":1979,"num_write":576,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"255'149","reported_seq":720,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:00.902037+0000","last_change":"2024-03-04T12:20:14.811751+0000","last_active":"2024-03-04T13:12:00.902037+0000","last_peered":"2024-03-04T13:12:00.902037+0000","last_clean":"2024-03-04T13:12:00.902037+0000","last_became_active":"2024-03-04T12:20:14.811474+0000","last_became_peered":"2024-03-04T12:20:14.811474+0000","last_unstale":"2024-03-04T13:12:00.902037+0000","last_undegraded":"2024-03-04T13:12:00.902037+0000","last_fullsized":"2024-03-04T13:12:00.902037+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:47:39.651078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2020301,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":290,"num_read_kb":3660,"num_write":930,"num_write_kb":16669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.480432+0000","last_change":"2024-03-04T12:20:18.836323+0000","last_active":"2024-03-04T13:10:22.480432+0000","last_peered":"2024-03-04T13:10:22.480432+0000","last_clean":"2024-03-04T13:10:22.480432+0000","last_became_active":"2024-03-04T12:20:18.836021+0000","last_became_peered":"2024-03-04T12:20:18.836021+0000","last_unstale":"2024-03-04T13:10:22.480432+0000","last_undegraded":"2024-03-04T13:10:22.480432+0000","last_fullsized":"2024-03-04T13:10:22.480432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:21:06.430437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"255'166","reported_seq":747,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.998533+0000","last_change":"2024-03-04T12:20:20.838524+0000","last_active":"2024-03-04T13:13:20.998533+0000","last_peered":"2024-03-04T13:13:20.998533+0000","last_clean":"2024-03-04T13:13:20.998533+0000","last_became_active":"2024-03-04T12:20:20.838216+0000","last_became_peered":"2024-03-04T12:20:20.838216+0000","last_unstale":"2024-03-04T13:13:20.998533+0000","last_undegraded":"2024-03-04T13:13:20.998533+0000","last_fullsized":"2024-03-04T13:13:20.998533+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:42:52.068202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12653,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":241,"num_read_kb":319,"num_write":160,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":475,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.543497+0000","last_change":"2024-03-04T12:20:22.856748+0000","last_active":"2024-03-04T13:10:22.543497+0000","last_peered":"2024-03-04T13:10:22.543497+0000","last_clean":"2024-03-04T13:10:22.543497+0000","last_became_active":"2024-03-04T12:20:22.856471+0000","last_became_peered":"2024-03-04T12:20:22.856471+0000","last_unstale":"2024-03-04T13:10:22.543497+0000","last_undegraded":"2024-03-04T13:10:22.543497+0000","last_fullsized":"2024-03-04T13:10:22.543497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:11:44.331825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"255'161","reported_seq":1004,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.643094+0000","last_change":"2024-03-04T12:20:24.863580+0000","last_active":"2024-03-04T13:13:12.643094+0000","last_peered":"2024-03-04T13:13:12.643094+0000","last_clean":"2024-03-04T13:13:12.643094+0000","last_became_active":"2024-03-04T12:20:24.863291+0000","last_became_peered":"2024-03-04T12:20:24.863291+0000","last_unstale":"2024-03-04T13:13:12.643094+0000","last_undegraded":"2024-03-04T13:13:12.643094+0000","last_fullsized":"2024-03-04T13:13:12.643094+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:12:00.193269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1530,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":567,"num_read_kb":564,"num_write":466,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"255'445","reported_seq":1849,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.328231+0000","last_change":"2024-03-04T12:20:50.906133+0000","last_active":"2024-03-04T13:12:39.328231+0000","last_peered":"2024-03-04T13:12:39.328231+0000","last_clean":"2024-03-04T13:12:39.328231+0000","last_became_active":"2024-03-04T12:20:50.905894+0000","last_became_peered":"2024-03-04T12:20:50.905894+0000","last_unstale":"2024-03-04T13:12:39.328231+0000","last_undegraded":"2024-03-04T13:12:39.328231+0000","last_fullsized":"2024-03-04T13:12:39.328231+0000","mapping_epoch":33,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:28:12.350446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2307,"num_read_kb":2145,"num_write":589,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"255'290","reported_seq":1044,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.184377+0000","last_change":"2024-03-04T12:20:14.816872+0000","last_active":"2024-03-04T13:13:21.184377+0000","last_peered":"2024-03-04T13:13:21.184377+0000","last_clean":"2024-03-04T13:13:21.184377+0000","last_became_active":"2024-03-04T12:20:14.816522+0000","last_became_peered":"2024-03-04T12:20:14.816522+0000","last_unstale":"2024-03-04T13:13:21.184377+0000","last_undegraded":"2024-03-04T13:13:21.184377+0000","last_fullsized":"2024-03-04T13:13:21.184377+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:29:45.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291510,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":856,"num_read_kb":55073,"num_write":1469,"num_write_kb":53223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499567+0000","last_change":"2024-03-04T12:20:18.831825+0000","last_active":"2024-03-04T13:10:22.499567+0000","last_peered":"2024-03-04T13:10:22.499567+0000","last_clean":"2024-03-04T13:10:22.499567+0000","last_became_active":"2024-03-04T12:20:18.831535+0000","last_became_peered":"2024-03-04T12:20:18.831535+0000","last_unstale":"2024-03-04T13:10:22.499567+0000","last_undegraded":"2024-03-04T13:10:22.499567+0000","last_fullsized":"2024-03-04T13:10:22.499567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:34:27.137812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"255'148","reported_seq":711,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.141793+0000","last_change":"2024-03-04T12:20:21.642237+0000","last_active":"2024-03-04T13:13:21.141793+0000","last_peered":"2024-03-04T13:13:21.141793+0000","last_clean":"2024-03-04T13:13:21.141793+0000","last_became_active":"2024-03-04T12:20:21.641872+0000","last_became_peered":"2024-03-04T12:20:21.641872+0000","last_unstale":"2024-03-04T13:13:21.141793+0000","last_undegraded":"2024-03-04T13:13:21.141793+0000","last_fullsized":"2024-03-04T13:13:21.141793+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:56.543890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6408,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":262,"num_write":108,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.544084+0000","last_change":"2024-03-04T12:20:22.854770+0000","last_active":"2024-03-04T13:10:27.544084+0000","last_peered":"2024-03-04T13:10:27.544084+0000","last_clean":"2024-03-04T13:10:27.544084+0000","last_became_active":"2024-03-04T12:20:22.854454+0000","last_became_peered":"2024-03-04T12:20:22.854454+0000","last_unstale":"2024-03-04T13:10:27.544084+0000","last_undegraded":"2024-03-04T13:10:27.544084+0000","last_fullsized":"2024-03-04T13:10:27.544084+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:43:50.254636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"255'101","reported_seq":576,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.164834+0000","last_change":"2024-03-04T12:20:24.862523+0000","last_active":"2024-03-04T13:13:14.164834+0000","last_peered":"2024-03-04T13:13:14.164834+0000","last_clean":"2024-03-04T13:13:14.164834+0000","last_became_active":"2024-03-04T12:20:24.862179+0000","last_became_peered":"2024-03-04T12:20:24.862179+0000","last_unstale":"2024-03-04T13:13:14.164834+0000","last_undegraded":"2024-03-04T13:13:14.164834+0000","last_fullsized":"2024-03-04T13:13:14.164834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:35:13.449840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":249,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"255'454","reported_seq":1906,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.593396+0000","last_change":"2024-03-04T12:20:16.836521+0000","last_active":"2024-03-04T13:12:50.593396+0000","last_peered":"2024-03-04T13:12:50.593396+0000","last_clean":"2024-03-04T13:12:50.593396+0000","last_became_active":"2024-03-04T12:20:16.836224+0000","last_became_peered":"2024-03-04T12:20:16.836224+0000","last_unstale":"2024-03-04T13:12:50.593396+0000","last_undegraded":"2024-03-04T13:12:50.593396+0000","last_fullsized":"2024-03-04T13:12:50.593396+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:20.664502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2418,"num_read_kb":2273,"num_write":600,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"255'189","reported_seq":779,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.462885+0000","last_change":"2024-03-04T12:20:14.821178+0000","last_active":"2024-03-04T13:12:47.462885+0000","last_peered":"2024-03-04T13:12:47.462885+0000","last_clean":"2024-03-04T13:12:47.462885+0000","last_became_active":"2024-03-04T12:20:14.820789+0000","last_became_peered":"2024-03-04T12:20:14.820789+0000","last_unstale":"2024-03-04T13:12:47.462885+0000","last_undegraded":"2024-03-04T13:12:47.462885+0000","last_fullsized":"2024-03-04T13:12:47.462885+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:09:03.198251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":398,"num_read_kb":8887,"num_write":907,"num_write_kb":18227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":483,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.543490+0000","last_change":"2024-03-04T12:20:18.838301+0000","last_active":"2024-03-04T13:10:22.543490+0000","last_peered":"2024-03-04T13:10:22.543490+0000","last_clean":"2024-03-04T13:10:22.543490+0000","last_became_active":"2024-03-04T12:20:18.837949+0000","last_became_peered":"2024-03-04T12:20:18.837949+0000","last_unstale":"2024-03-04T13:10:22.543490+0000","last_undegraded":"2024-03-04T13:10:22.543490+0000","last_fullsized":"2024-03-04T13:10:22.543490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:48:00.814962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"255'84","reported_seq":602,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.838249+0000","last_change":"2024-03-04T12:20:21.642153+0000","last_active":"2024-03-04T13:10:53.838249+0000","last_peered":"2024-03-04T13:10:53.838249+0000","last_clean":"2024-03-04T13:10:53.838249+0000","last_became_active":"2024-03-04T12:20:21.641757+0000","last_became_peered":"2024-03-04T12:20:21.641757+0000","last_unstale":"2024-03-04T13:10:53.838249+0000","last_undegraded":"2024-03-04T13:10:53.838249+0000","last_fullsized":"2024-03-04T13:10:53.838249+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:33:04.943209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":90,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"255'498","reported_seq":3564,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.932748+0000","last_change":"2024-03-04T12:20:22.850624+0000","last_active":"2024-03-04T13:13:20.932748+0000","last_peered":"2024-03-04T13:13:20.932748+0000","last_clean":"2024-03-04T13:13:20.932748+0000","last_became_active":"2024-03-04T12:20:22.849630+0000","last_became_peered":"2024-03-04T12:20:22.849630+0000","last_unstale":"2024-03-04T13:13:20.932748+0000","last_undegraded":"2024-03-04T13:13:20.932748+0000","last_fullsized":"2024-03-04T13:13:20.932748+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:05.162543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"255'140","reported_seq":628,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:11.369454+0000","last_change":"2024-03-04T12:20:24.863651+0000","last_active":"2024-03-04T13:12:11.369454+0000","last_peered":"2024-03-04T13:12:11.369454+0000","last_clean":"2024-03-04T13:12:11.369454+0000","last_became_active":"2024-03-04T12:20:24.863312+0000","last_became_peered":"2024-03-04T12:20:24.863312+0000","last_unstale":"2024-03-04T13:12:11.369454+0000","last_undegraded":"2024-03-04T13:12:11.369454+0000","last_fullsized":"2024-03-04T13:12:11.369454+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:10.861121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":307,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"255'558","reported_seq":2206,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.971775+0000","last_change":"2024-03-04T12:20:16.828351+0000","last_active":"2024-03-04T13:12:36.971775+0000","last_peered":"2024-03-04T13:12:36.971775+0000","last_clean":"2024-03-04T13:12:36.971775+0000","last_became_active":"2024-03-04T12:20:16.828102+0000","last_became_peered":"2024-03-04T12:20:16.828102+0000","last_unstale":"2024-03-04T13:12:36.971775+0000","last_undegraded":"2024-03-04T13:12:36.971775+0000","last_fullsized":"2024-03-04T13:12:36.971775+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:35:22.025393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2984,"num_read_kb":2771,"num_write":760,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"255'207","reported_seq":841,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.182107+0000","last_change":"2024-03-04T12:20:14.827443+0000","last_active":"2024-03-04T13:13:21.182107+0000","last_peered":"2024-03-04T13:13:21.182107+0000","last_clean":"2024-03-04T13:13:21.182107+0000","last_became_active":"2024-03-04T12:20:14.826522+0000","last_became_peered":"2024-03-04T12:20:14.826522+0000","last_unstale":"2024-03-04T13:13:21.182107+0000","last_undegraded":"2024-03-04T13:13:21.182107+0000","last_fullsized":"2024-03-04T13:13:21.182107+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:32:50.275769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27217,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":463,"num_read_kb":10394,"num_write":1165,"num_write_kb":28391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499523+0000","last_change":"2024-03-04T12:20:18.832929+0000","last_active":"2024-03-04T13:10:22.499523+0000","last_peered":"2024-03-04T13:10:22.499523+0000","last_clean":"2024-03-04T13:10:22.499523+0000","last_became_active":"2024-03-04T12:20:18.832607+0000","last_became_peered":"2024-03-04T12:20:18.832607+0000","last_unstale":"2024-03-04T13:10:22.499523+0000","last_undegraded":"2024-03-04T13:10:22.499523+0000","last_fullsized":"2024-03-04T13:10:22.499523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:37:17.213186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"255'174","reported_seq":748,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.191936+0000","last_change":"2024-03-04T12:20:20.838476+0000","last_active":"2024-03-04T13:13:21.191936+0000","last_peered":"2024-03-04T13:13:21.191936+0000","last_clean":"2024-03-04T13:13:21.191936+0000","last_became_active":"2024-03-04T12:20:20.838062+0000","last_became_peered":"2024-03-04T12:20:20.838062+0000","last_unstale":"2024-03-04T13:13:21.191936+0000","last_undegraded":"2024-03-04T13:13:21.191936+0000","last_fullsized":"2024-03-04T13:13:21.191936+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:55.057171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8941,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":239,"num_read_kb":314,"num_write":142,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":469,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.435067+0000","last_change":"2024-03-04T12:20:22.856843+0000","last_active":"2024-03-04T13:08:42.435067+0000","last_peered":"2024-03-04T13:08:42.435067+0000","last_clean":"2024-03-04T13:08:42.435067+0000","last_became_active":"2024-03-04T12:20:22.856540+0000","last_became_peered":"2024-03-04T12:20:22.856540+0000","last_unstale":"2024-03-04T13:08:42.435067+0000","last_undegraded":"2024-03-04T13:08:42.435067+0000","last_fullsized":"2024-03-04T13:08:42.435067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:57:43.229611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"255'88","reported_seq":574,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:15.292251+0000","last_change":"2024-03-04T12:20:24.867999+0000","last_active":"2024-03-04T13:10:15.292251+0000","last_peered":"2024-03-04T13:10:15.292251+0000","last_clean":"2024-03-04T13:10:15.292251+0000","last_became_active":"2024-03-04T12:20:24.866984+0000","last_became_peered":"2024-03-04T12:20:24.866984+0000","last_unstale":"2024-03-04T13:10:15.292251+0000","last_undegraded":"2024-03-04T13:10:15.292251+0000","last_fullsized":"2024-03-04T13:10:15.292251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:35.692000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":81,"num_write":221,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"255'841","reported_seq":2368,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.800189+0000","last_change":"2024-03-04T12:20:16.827865+0000","last_active":"2024-03-04T13:12:34.800189+0000","last_peered":"2024-03-04T13:12:34.800189+0000","last_clean":"2024-03-04T13:12:34.800189+0000","last_became_active":"2024-03-04T12:20:16.827592+0000","last_became_peered":"2024-03-04T12:20:16.827592+0000","last_unstale":"2024-03-04T13:12:34.800189+0000","last_undegraded":"2024-03-04T13:12:34.800189+0000","last_fullsized":"2024-03-04T13:12:34.800189+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:28.558695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3846,"num_read_kb":3408,"num_write":1191,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"255'226","reported_seq":858,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.026297+0000","last_change":"2024-03-04T12:20:14.827317+0000","last_active":"2024-03-04T13:13:21.026297+0000","last_peered":"2024-03-04T13:13:21.026297+0000","last_clean":"2024-03-04T13:13:21.026297+0000","last_became_active":"2024-03-04T12:20:14.827034+0000","last_became_peered":"2024-03-04T12:20:14.827034+0000","last_unstale":"2024-03-04T13:13:21.026297+0000","last_undegraded":"2024-03-04T13:13:21.026297+0000","last_fullsized":"2024-03-04T13:13:21.026297+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:46:52.185291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":510,"num_read_kb":74328,"num_write":1121,"num_write_kb":53240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.355518+0000","last_change":"2024-03-04T12:20:18.836142+0000","last_active":"2024-03-04T13:10:22.355518+0000","last_peered":"2024-03-04T13:10:22.355518+0000","last_clean":"2024-03-04T13:10:22.355518+0000","last_became_active":"2024-03-04T12:20:18.835852+0000","last_became_peered":"2024-03-04T12:20:18.835852+0000","last_unstale":"2024-03-04T13:10:22.355518+0000","last_undegraded":"2024-03-04T13:10:22.355518+0000","last_fullsized":"2024-03-04T13:10:22.355518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:46.704265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"255'135","reported_seq":686,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.196987+0000","last_change":"2024-03-04T12:20:20.837534+0000","last_active":"2024-03-04T13:13:21.196987+0000","last_peered":"2024-03-04T13:13:21.196987+0000","last_clean":"2024-03-04T13:13:21.196987+0000","last_became_active":"2024-03-04T12:20:20.837239+0000","last_became_peered":"2024-03-04T12:20:20.837239+0000","last_unstale":"2024-03-04T13:13:21.196987+0000","last_undegraded":"2024-03-04T13:13:21.196987+0000","last_fullsized":"2024-03-04T13:13:21.196987+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:10:30.624161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7816,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":230,"num_write":86,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":477,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.468138+0000","last_change":"2024-03-04T12:20:22.850044+0000","last_active":"2024-03-04T13:08:52.468138+0000","last_peered":"2024-03-04T13:08:52.468138+0000","last_clean":"2024-03-04T13:08:52.468138+0000","last_became_active":"2024-03-04T12:20:22.849731+0000","last_became_peered":"2024-03-04T12:20:22.849731+0000","last_unstale":"2024-03-04T13:08:52.468138+0000","last_undegraded":"2024-03-04T13:08:52.468138+0000","last_fullsized":"2024-03-04T13:08:52.468138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:28.076705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"255'119","reported_seq":617,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.314222+0000","last_change":"2024-03-04T12:20:24.912999+0000","last_active":"2024-03-04T13:12:39.314222+0000","last_peered":"2024-03-04T13:12:39.314222+0000","last_clean":"2024-03-04T13:12:39.314222+0000","last_became_active":"2024-03-04T12:20:24.912599+0000","last_became_peered":"2024-03-04T12:20:24.912599+0000","last_unstale":"2024-03-04T13:12:39.314222+0000","last_undegraded":"2024-03-04T13:12:39.314222+0000","last_fullsized":"2024-03-04T13:12:39.314222+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:16.458774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":888,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":157,"num_write":287,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"255'1175","reported_seq":2747,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.308261+0000","last_change":"2024-03-04T12:20:16.828068+0000","last_active":"2024-03-04T13:12:39.308261+0000","last_peered":"2024-03-04T13:12:39.308261+0000","last_clean":"2024-03-04T13:12:39.308261+0000","last_became_active":"2024-03-04T12:20:16.827448+0000","last_became_peered":"2024-03-04T12:20:16.827448+0000","last_unstale":"2024-03-04T13:12:39.308261+0000","last_undegraded":"2024-03-04T13:12:39.308261+0000","last_fullsized":"2024-03-04T13:12:39.308261+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":1100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:16:26.503650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5284,"num_read_kb":4621,"num_write":1652,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"255'215","reported_seq":845,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.165611+0000","last_change":"2024-03-04T12:20:14.822903+0000","last_active":"2024-03-04T13:13:21.165611+0000","last_peered":"2024-03-04T13:13:21.165611+0000","last_clean":"2024-03-04T13:13:21.165611+0000","last_became_active":"2024-03-04T12:20:14.822619+0000","last_became_peered":"2024-03-04T12:20:14.822619+0000","last_unstale":"2024-03-04T13:13:21.165611+0000","last_undegraded":"2024-03-04T13:13:21.165611+0000","last_fullsized":"2024-03-04T13:13:21.165611+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:39:36.460713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9035448,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":16616,"num_write":1088,"num_write_kb":32501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.482846+0000","last_change":"2024-03-04T12:20:18.831493+0000","last_active":"2024-03-04T13:08:42.482846+0000","last_peered":"2024-03-04T13:08:42.482846+0000","last_clean":"2024-03-04T13:08:42.482846+0000","last_became_active":"2024-03-04T12:20:18.831105+0000","last_became_peered":"2024-03-04T12:20:18.831105+0000","last_unstale":"2024-03-04T13:08:42.482846+0000","last_undegraded":"2024-03-04T13:08:42.482846+0000","last_fullsized":"2024-03-04T13:08:42.482846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:01.353910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"255'100","reported_seq":641,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.124207+0000","last_change":"2024-03-04T12:20:20.842912+0000","last_active":"2024-03-04T13:13:21.124207+0000","last_peered":"2024-03-04T13:13:21.124207+0000","last_clean":"2024-03-04T13:13:21.124207+0000","last_became_active":"2024-03-04T12:20:20.842361+0000","last_became_peered":"2024-03-04T12:20:20.842361+0000","last_unstale":"2024-03-04T13:13:21.124207+0000","last_undegraded":"2024-03-04T13:13:21.124207+0000","last_fullsized":"2024-03-04T13:13:21.124207+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:49:07.128719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":178,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499524+0000","last_change":"2024-03-04T12:20:22.857230+0000","last_active":"2024-03-04T13:10:22.499524+0000","last_peered":"2024-03-04T13:10:22.499524+0000","last_clean":"2024-03-04T13:10:22.499524+0000","last_became_active":"2024-03-04T12:20:22.856748+0000","last_became_peered":"2024-03-04T12:20:22.856748+0000","last_unstale":"2024-03-04T13:10:22.499524+0000","last_undegraded":"2024-03-04T13:10:22.499524+0000","last_fullsized":"2024-03-04T13:10:22.499524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:19:05.374574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"255'148","reported_seq":1190,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.552175+0000","last_change":"2024-03-04T12:20:24.865794+0000","last_active":"2024-03-04T13:13:12.552175+0000","last_peered":"2024-03-04T13:13:12.552175+0000","last_clean":"2024-03-04T13:13:12.552175+0000","last_became_active":"2024-03-04T12:20:24.865363+0000","last_became_peered":"2024-03-04T12:20:24.865363+0000","last_unstale":"2024-03-04T13:13:12.552175+0000","last_undegraded":"2024-03-04T13:13:12.552175+0000","last_fullsized":"2024-03-04T13:13:12.552175+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:49:27.367305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":819,"num_read_kb":785,"num_write":355,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"255'725","reported_seq":2131,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.951732+0000","last_change":"2024-03-04T12:20:16.820242+0000","last_active":"2024-03-04T13:12:36.951732+0000","last_peered":"2024-03-04T13:12:36.951732+0000","last_clean":"2024-03-04T13:12:36.951732+0000","last_became_active":"2024-03-04T12:20:16.819966+0000","last_became_peered":"2024-03-04T12:20:16.819966+0000","last_unstale":"2024-03-04T13:12:36.951732+0000","last_undegraded":"2024-03-04T13:12:36.951732+0000","last_fullsized":"2024-03-04T13:12:36.951732+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:05:44.485867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3297,"num_read_kb":2935,"num_write":968,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"255'281","reported_seq":926,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.459989+0000","last_change":"2024-03-04T12:20:14.824471+0000","last_active":"2024-03-04T13:12:22.459989+0000","last_peered":"2024-03-04T13:12:22.459989+0000","last_clean":"2024-03-04T13:12:22.459989+0000","last_became_active":"2024-03-04T12:20:14.824168+0000","last_became_peered":"2024-03-04T12:20:14.824168+0000","last_unstale":"2024-03-04T13:12:22.459989+0000","last_undegraded":"2024-03-04T13:12:22.459989+0000","last_fullsized":"2024-03-04T13:12:22.459989+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:06:00.013863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":709,"num_read_kb":4351,"num_write":1165,"num_write_kb":19276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":484,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:47.532640+0000","last_change":"2024-03-04T12:20:18.836753+0000","last_active":"2024-03-04T13:08:47.532640+0000","last_peered":"2024-03-04T13:08:47.532640+0000","last_clean":"2024-03-04T13:08:47.532640+0000","last_became_active":"2024-03-04T12:20:18.836203+0000","last_became_peered":"2024-03-04T12:20:18.836203+0000","last_unstale":"2024-03-04T13:08:47.532640+0000","last_undegraded":"2024-03-04T13:08:47.532640+0000","last_fullsized":"2024-03-04T13:08:47.532640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:43.974119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"255'161","reported_seq":737,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.149835+0000","last_change":"2024-03-04T12:20:20.842714+0000","last_active":"2024-03-04T13:13:21.149835+0000","last_peered":"2024-03-04T13:13:21.149835+0000","last_clean":"2024-03-04T13:13:21.149835+0000","last_became_active":"2024-03-04T12:20:20.842246+0000","last_became_peered":"2024-03-04T12:20:20.842246+0000","last_unstale":"2024-03-04T13:13:21.149835+0000","last_undegraded":"2024-03-04T13:13:21.149835+0000","last_fullsized":"2024-03-04T13:13:21.149835+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:08.729003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":208,"num_read_kb":255,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":469,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.446680+0000","last_change":"2024-03-04T12:20:22.856898+0000","last_active":"2024-03-04T13:10:22.446680+0000","last_peered":"2024-03-04T13:10:22.446680+0000","last_clean":"2024-03-04T13:10:22.446680+0000","last_became_active":"2024-03-04T12:20:22.856597+0000","last_became_peered":"2024-03-04T12:20:22.856597+0000","last_unstale":"2024-03-04T13:10:22.446680+0000","last_undegraded":"2024-03-04T13:10:22.446680+0000","last_fullsized":"2024-03-04T13:10:22.446680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:03:49.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"255'89","reported_seq":567,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:40.878711+0000","last_change":"2024-03-04T12:20:24.869755+0000","last_active":"2024-03-04T13:10:40.878711+0000","last_peered":"2024-03-04T13:10:40.878711+0000","last_clean":"2024-03-04T13:10:40.878711+0000","last_became_active":"2024-03-04T12:20:24.869207+0000","last_became_peered":"2024-03-04T12:20:24.869207+0000","last_unstale":"2024-03-04T13:10:40.878711+0000","last_undegraded":"2024-03-04T13:10:40.878711+0000","last_fullsized":"2024-03-04T13:10:40.878711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:06:32.609688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":212,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"255'1092","reported_seq":2657,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.557042+0000","last_change":"2024-03-04T12:20:16.832658+0000","last_active":"2024-03-04T13:12:22.557042+0000","last_peered":"2024-03-04T13:12:22.557042+0000","last_clean":"2024-03-04T13:12:22.557042+0000","last_became_active":"2024-03-04T12:20:16.832377+0000","last_became_peered":"2024-03-04T12:20:16.832377+0000","last_unstale":"2024-03-04T13:12:22.557042+0000","last_undegraded":"2024-03-04T13:12:22.557042+0000","last_fullsized":"2024-03-04T13:12:22.557042+0000","mapping_epoch":22,"log_start":"255'1000","ondisk_log_start":"255'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":1000,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:47:37.405815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4785,"num_read_kb":4211,"num_write":1502,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"255'213","reported_seq":860,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.122597+0000","last_change":"2024-03-04T12:20:14.817916+0000","last_active":"2024-03-04T13:13:21.122597+0000","last_peered":"2024-03-04T13:13:21.122597+0000","last_clean":"2024-03-04T13:13:21.122597+0000","last_became_active":"2024-03-04T12:20:14.817326+0000","last_became_peered":"2024-03-04T12:20:14.817326+0000","last_unstale":"2024-03-04T13:13:21.122597+0000","last_undegraded":"2024-03-04T13:13:21.122597+0000","last_fullsized":"2024-03-04T13:13:21.122597+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:49:00.626737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":463525,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":541,"num_read_kb":21798,"num_write":1100,"num_write_kb":25910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"255'796","reported_seq":2438,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.098986+0000","last_change":"2024-03-04T12:20:16.835151+0000","last_active":"2024-03-04T13:12:31.098986+0000","last_peered":"2024-03-04T13:12:31.098986+0000","last_clean":"2024-03-04T13:12:31.098986+0000","last_became_active":"2024-03-04T12:20:16.834823+0000","last_became_peered":"2024-03-04T12:20:16.834823+0000","last_unstale":"2024-03-04T13:12:31.098986+0000","last_undegraded":"2024-03-04T13:12:31.098986+0000","last_fullsized":"2024-03-04T13:12:31.098986+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:17.422055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3958,"num_read_kb":3565,"num_write":1074,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"255'210","reported_seq":853,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.181086+0000","last_change":"2024-03-04T12:20:14.819636+0000","last_active":"2024-03-04T13:13:21.181086+0000","last_peered":"2024-03-04T13:13:21.181086+0000","last_clean":"2024-03-04T13:13:21.181086+0000","last_became_active":"2024-03-04T12:20:14.819333+0000","last_became_peered":"2024-03-04T12:20:14.819333+0000","last_unstale":"2024-03-04T13:13:21.181086+0000","last_undegraded":"2024-03-04T13:13:21.181086+0000","last_fullsized":"2024-03-04T13:13:21.181086+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:25.357472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":688512,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":39432,"num_write":1114,"num_write_kb":31535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"255'567","reported_seq":2093,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.955018+0000","last_change":"2024-03-04T12:20:16.829090+0000","last_active":"2024-03-04T13:12:36.955018+0000","last_peered":"2024-03-04T13:12:36.955018+0000","last_clean":"2024-03-04T13:12:36.955018+0000","last_became_active":"2024-03-04T12:20:16.828799+0000","last_became_peered":"2024-03-04T12:20:16.828799+0000","last_unstale":"2024-03-04T13:12:36.955018+0000","last_undegraded":"2024-03-04T13:12:36.955018+0000","last_fullsized":"2024-03-04T13:12:36.955018+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:40:00.875926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2802,"num_read_kb":2536,"num_write":761,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"255'187","reported_seq":792,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.181487+0000","last_change":"2024-03-04T12:20:14.824170+0000","last_active":"2024-03-04T13:13:21.181487+0000","last_peered":"2024-03-04T13:13:21.181487+0000","last_clean":"2024-03-04T13:13:21.181487+0000","last_became_active":"2024-03-04T12:20:14.823794+0000","last_became_peered":"2024-03-04T12:20:14.823794+0000","last_unstale":"2024-03-04T13:13:21.181487+0000","last_undegraded":"2024-03-04T13:13:21.181487+0000","last_fullsized":"2024-03-04T13:13:21.181487+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:58:40.371668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27216,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":368,"num_read_kb":29267,"num_write":940,"num_write_kb":26221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"255'419","reported_seq":2014,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:14.106725+0000","last_change":"2024-03-04T12:20:16.830270+0000","last_active":"2024-03-04T13:12:14.106725+0000","last_peered":"2024-03-04T13:12:14.106725+0000","last_clean":"2024-03-04T13:12:14.106725+0000","last_became_active":"2024-03-04T12:20:16.830023+0000","last_became_peered":"2024-03-04T12:20:16.830023+0000","last_unstale":"2024-03-04T13:12:14.106725+0000","last_undegraded":"2024-03-04T13:12:14.106725+0000","last_fullsized":"2024-03-04T13:12:14.106725+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:15:50.412288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2457,"num_read_kb":2316,"num_write":500,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"255'181","reported_seq":764,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.155694+0000","last_change":"2024-03-04T12:20:14.814965+0000","last_active":"2024-03-04T13:13:21.155694+0000","last_peered":"2024-03-04T13:13:21.155694+0000","last_clean":"2024-03-04T13:13:21.155694+0000","last_became_active":"2024-03-04T12:20:14.814649+0000","last_became_peered":"2024-03-04T12:20:14.814649+0000","last_unstale":"2024-03-04T13:13:21.155694+0000","last_undegraded":"2024-03-04T13:13:21.155694+0000","last_fullsized":"2024-03-04T13:13:21.155694+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:38:26.781415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":350,"num_read_kb":14298,"num_write":961,"num_write_kb":45374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"255'670","reported_seq":2118,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.808990+0000","last_change":"2024-03-04T12:20:16.832110+0000","last_active":"2024-03-04T13:12:12.808990+0000","last_peered":"2024-03-04T13:12:12.808990+0000","last_clean":"2024-03-04T13:12:12.808990+0000","last_became_active":"2024-03-04T12:20:16.831861+0000","last_became_peered":"2024-03-04T12:20:16.831861+0000","last_unstale":"2024-03-04T13:12:12.808990+0000","last_undegraded":"2024-03-04T13:12:12.808990+0000","last_fullsized":"2024-03-04T13:12:12.808990+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":600,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:42:42.342669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3134,"num_read_kb":2831,"num_write":876,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"255'150","reported_seq":782,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.066149+0000","last_change":"2024-03-04T12:20:14.818277+0000","last_active":"2024-03-04T13:13:21.066149+0000","last_peered":"2024-03-04T13:13:21.066149+0000","last_clean":"2024-03-04T13:13:21.066149+0000","last_became_active":"2024-03-04T12:20:14.818011+0000","last_became_peered":"2024-03-04T12:20:14.818011+0000","last_unstale":"2024-03-04T13:13:21.066149+0000","last_undegraded":"2024-03-04T13:13:21.066149+0000","last_fullsized":"2024-03-04T13:13:21.066149+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:28:17.174533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6900048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":2296,"num_write":812,"num_write_kb":10260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"255'1153","reported_seq":2618,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.557788+0000","last_change":"2024-03-04T12:20:16.821337+0000","last_active":"2024-03-04T13:12:22.557788+0000","last_peered":"2024-03-04T13:12:22.557788+0000","last_clean":"2024-03-04T13:12:22.557788+0000","last_became_active":"2024-03-04T12:20:16.820794+0000","last_became_peered":"2024-03-04T12:20:16.820794+0000","last_unstale":"2024-03-04T13:12:22.557788+0000","last_undegraded":"2024-03-04T13:12:22.557788+0000","last_fullsized":"2024-03-04T13:12:22.557788+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":1100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:55:47.838168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4910,"num_read_kb":4282,"num_write":1611,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"255'210","reported_seq":833,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.541893+0000","last_change":"2024-03-04T12:20:14.812183+0000","last_active":"2024-03-04T13:10:07.541893+0000","last_peered":"2024-03-04T13:10:07.541893+0000","last_clean":"2024-03-04T13:10:07.541893+0000","last_became_active":"2024-03-04T12:20:14.811334+0000","last_became_peered":"2024-03-04T12:20:14.811334+0000","last_unstale":"2024-03-04T13:10:07.541893+0000","last_undegraded":"2024-03-04T13:10:07.541893+0000","last_fullsized":"2024-03-04T13:10:07.541893+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:50:58.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12062855,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":462,"num_read_kb":33282,"num_write":1224,"num_write_kb":31843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"255'760","reported_seq":2377,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.555573+0000","last_change":"2024-03-04T12:20:16.835553+0000","last_active":"2024-03-04T13:12:22.555573+0000","last_peered":"2024-03-04T13:12:22.555573+0000","last_clean":"2024-03-04T13:12:22.555573+0000","last_became_active":"2024-03-04T12:20:16.835285+0000","last_became_peered":"2024-03-04T12:20:16.835285+0000","last_unstale":"2024-03-04T13:12:22.555573+0000","last_undegraded":"2024-03-04T13:12:22.555573+0000","last_fullsized":"2024-03-04T13:12:22.555573+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:29:20.569225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3723,"num_read_kb":3381,"num_write":1013,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"255'217","reported_seq":846,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.137749+0000","last_change":"2024-03-04T12:20:14.818864+0000","last_active":"2024-03-04T13:13:21.137749+0000","last_peered":"2024-03-04T13:13:21.137749+0000","last_clean":"2024-03-04T13:13:21.137749+0000","last_became_active":"2024-03-04T12:20:14.818385+0000","last_became_peered":"2024-03-04T12:20:14.818385+0000","last_unstale":"2024-03-04T13:13:21.137749+0000","last_undegraded":"2024-03-04T13:13:21.137749+0000","last_fullsized":"2024-03-04T13:13:21.137749+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:02.154903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":39388,"num_write":1130,"num_write_kb":46394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"255'1082","reported_seq":2780,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.766506+0000","last_change":"2024-03-04T12:20:16.823981+0000","last_active":"2024-03-04T13:12:12.766506+0000","last_peered":"2024-03-04T13:12:12.766506+0000","last_clean":"2024-03-04T13:12:12.766506+0000","last_became_active":"2024-03-04T12:20:16.823596+0000","last_became_peered":"2024-03-04T12:20:16.823596+0000","last_unstale":"2024-03-04T13:12:12.766506+0000","last_undegraded":"2024-03-04T13:12:12.766506+0000","last_fullsized":"2024-03-04T13:12:12.766506+0000","mapping_epoch":22,"log_start":"255'1000","ondisk_log_start":"255'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":1000,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:37:17.796839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5087,"num_read_kb":4523,"num_write":1483,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"255'226","reported_seq":1075,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.174081+0000","last_change":"2024-03-04T12:20:14.818818+0000","last_active":"2024-03-04T13:13:21.174081+0000","last_peered":"2024-03-04T13:13:21.174081+0000","last_clean":"2024-03-04T13:13:21.174081+0000","last_became_active":"2024-03-04T12:20:14.818340+0000","last_became_peered":"2024-03-04T12:20:14.818340+0000","last_unstale":"2024-03-04T13:13:21.174081+0000","last_undegraded":"2024-03-04T13:13:21.174081+0000","last_fullsized":"2024-03-04T13:13:21.174081+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:30:11.725740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":933,"num_read_kb":21991,"num_write":1290,"num_write_kb":38918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"255'450","reported_seq":1993,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.297591+0000","last_change":"2024-03-04T12:20:16.830513+0000","last_active":"2024-03-04T13:12:31.297591+0000","last_peered":"2024-03-04T13:12:31.297591+0000","last_clean":"2024-03-04T13:12:31.297591+0000","last_became_active":"2024-03-04T12:20:16.830259+0000","last_became_peered":"2024-03-04T12:20:16.830259+0000","last_unstale":"2024-03-04T13:12:31.297591+0000","last_undegraded":"2024-03-04T13:12:31.297591+0000","last_fullsized":"2024-03-04T13:12:31.297591+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:12:15.968195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2206,"num_write":536,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"255'206","reported_seq":855,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.052457+0000","last_change":"2024-03-04T12:20:14.824797+0000","last_active":"2024-03-04T13:13:21.052457+0000","last_peered":"2024-03-04T13:13:21.052457+0000","last_clean":"2024-03-04T13:13:21.052457+0000","last_became_active":"2024-03-04T12:20:14.823513+0000","last_became_peered":"2024-03-04T12:20:14.823513+0000","last_unstale":"2024-03-04T13:13:21.052457+0000","last_undegraded":"2024-03-04T13:13:21.052457+0000","last_fullsized":"2024-03-04T13:13:21.052457+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:15:56.550416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706375,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":60209,"num_write":1193,"num_write_kb":41508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"255'752","reported_seq":2232,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:05.090024+0000","last_change":"2024-03-04T12:20:16.825790+0000","last_active":"2024-03-04T13:12:05.090024+0000","last_peered":"2024-03-04T13:12:05.090024+0000","last_clean":"2024-03-04T13:12:05.090024+0000","last_became_active":"2024-03-04T12:20:16.825534+0000","last_became_peered":"2024-03-04T12:20:16.825534+0000","last_unstale":"2024-03-04T13:12:05.090024+0000","last_undegraded":"2024-03-04T13:12:05.090024+0000","last_fullsized":"2024-03-04T13:12:05.090024+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:47:30.154655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3330,"num_read_kb":2980,"num_write":1004,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"255'222","reported_seq":830,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.066163+0000","last_change":"2024-03-04T12:20:14.817902+0000","last_active":"2024-03-04T13:13:21.066163+0000","last_peered":"2024-03-04T13:13:21.066163+0000","last_clean":"2024-03-04T13:13:21.066163+0000","last_became_active":"2024-03-04T12:20:14.817531+0000","last_became_peered":"2024-03-04T12:20:14.817531+0000","last_unstale":"2024-03-04T13:13:21.066163+0000","last_undegraded":"2024-03-04T13:13:21.066163+0000","last_fullsized":"2024-03-04T13:13:21.066163+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:38:40.926380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7696,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":19231,"num_write":1186,"num_write_kb":63143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"255'534","reported_seq":2107,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:01.977958+0000","last_change":"2024-03-04T12:20:16.823620+0000","last_active":"2024-03-04T13:12:01.977958+0000","last_peered":"2024-03-04T13:12:01.977958+0000","last_clean":"2024-03-04T13:12:01.977958+0000","last_became_active":"2024-03-04T12:20:16.823358+0000","last_became_peered":"2024-03-04T12:20:16.823358+0000","last_unstale":"2024-03-04T13:12:01.977958+0000","last_undegraded":"2024-03-04T13:12:01.977958+0000","last_fullsized":"2024-03-04T13:12:01.977958+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:56:00.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2875,"num_read_kb":2619,"num_write":718,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"255'185","reported_seq":789,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.005459+0000","last_change":"2024-03-04T12:20:50.902553+0000","last_active":"2024-03-04T13:13:21.005459+0000","last_peered":"2024-03-04T13:13:21.005459+0000","last_clean":"2024-03-04T13:13:21.005459+0000","last_became_active":"2024-03-04T12:20:50.902181+0000","last_became_peered":"2024-03-04T12:20:50.902181+0000","last_unstale":"2024-03-04T13:13:21.005459+0000","last_undegraded":"2024-03-04T13:13:21.005459+0000","last_fullsized":"2024-03-04T13:13:21.005459+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:36.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918078,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":20827,"num_write":1047,"num_write_kb":19608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"255'418","reported_seq":1796,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:01.977296+0000","last_change":"2024-03-04T12:20:16.819439+0000","last_active":"2024-03-04T13:12:01.977296+0000","last_peered":"2024-03-04T13:12:01.977296+0000","last_clean":"2024-03-04T13:12:01.977296+0000","last_became_active":"2024-03-04T12:20:16.819169+0000","last_became_peered":"2024-03-04T12:20:16.819169+0000","last_unstale":"2024-03-04T13:12:01.977296+0000","last_undegraded":"2024-03-04T13:12:01.977296+0000","last_fullsized":"2024-03-04T13:12:01.977296+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:22:24.173643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2116,"num_read_kb":1957,"num_write":522,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"255'172","reported_seq":787,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.042546+0000","last_change":"2024-03-04T12:20:14.823104+0000","last_active":"2024-03-04T13:13:21.042546+0000","last_peered":"2024-03-04T13:13:21.042546+0000","last_clean":"2024-03-04T13:13:21.042546+0000","last_became_active":"2024-03-04T12:20:14.822588+0000","last_became_peered":"2024-03-04T12:20:14.822588+0000","last_unstale":"2024-03-04T13:13:21.042546+0000","last_undegraded":"2024-03-04T13:13:21.042546+0000","last_fullsized":"2024-03-04T13:13:21.042546+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:58:44.728443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":390,"num_read_kb":47350,"num_write":1028,"num_write_kb":32429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"255'482","reported_seq":2025,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.558145+0000","last_change":"2024-03-04T12:20:16.828912+0000","last_active":"2024-03-04T13:12:22.558145+0000","last_peered":"2024-03-04T13:12:22.558145+0000","last_clean":"2024-03-04T13:12:22.558145+0000","last_became_active":"2024-03-04T12:20:16.828618+0000","last_became_peered":"2024-03-04T12:20:16.828618+0000","last_unstale":"2024-03-04T13:12:22.558145+0000","last_undegraded":"2024-03-04T13:12:22.558145+0000","last_fullsized":"2024-03-04T13:12:22.558145+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:00:24.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2516,"num_read_kb":2328,"num_write":610,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"255'180","reported_seq":910,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.206947+0000","last_change":"2024-03-04T12:20:14.819283+0000","last_active":"2024-03-04T13:13:21.206947+0000","last_peered":"2024-03-04T13:13:21.206947+0000","last_clean":"2024-03-04T13:13:21.206947+0000","last_became_active":"2024-03-04T12:20:14.818924+0000","last_became_peered":"2024-03-04T12:20:14.818924+0000","last_unstale":"2024-03-04T13:13:21.206947+0000","last_undegraded":"2024-03-04T13:13:21.206947+0000","last_fullsized":"2024-03-04T13:13:21.206947+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:41:49.091659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":719,"num_read_kb":26573,"num_write":1059,"num_write_kb":25938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"255'850","reported_seq":2378,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.782373+0000","last_change":"2024-03-04T12:20:16.835574+0000","last_active":"2024-03-04T13:12:34.782373+0000","last_peered":"2024-03-04T13:12:34.782373+0000","last_clean":"2024-03-04T13:12:34.782373+0000","last_became_active":"2024-03-04T12:20:16.835308+0000","last_became_peered":"2024-03-04T12:20:16.835308+0000","last_unstale":"2024-03-04T13:12:34.782373+0000","last_undegraded":"2024-03-04T13:12:34.782373+0000","last_fullsized":"2024-03-04T13:12:34.782373+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:38.783596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3917,"num_read_kb":3486,"num_write":1199,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"255'194","reported_seq":801,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.154246+0000","last_change":"2024-03-04T12:20:14.816730+0000","last_active":"2024-03-04T13:13:21.154246+0000","last_peered":"2024-03-04T13:13:21.154246+0000","last_clean":"2024-03-04T13:13:21.154246+0000","last_became_active":"2024-03-04T12:20:14.816440+0000","last_became_peered":"2024-03-04T12:20:14.816440+0000","last_unstale":"2024-03-04T13:13:21.154246+0000","last_undegraded":"2024-03-04T13:13:21.154246+0000","last_fullsized":"2024-03-04T13:13:21.154246+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:38.943831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17822208,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":392,"num_read_kb":7899,"num_write":1089,"num_write_kb":49946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"255'688","reported_seq":2008,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.308538+0000","last_change":"2024-03-04T12:20:16.828266+0000","last_active":"2024-03-04T13:12:39.308538+0000","last_peered":"2024-03-04T13:12:39.308538+0000","last_clean":"2024-03-04T13:12:39.308538+0000","last_became_active":"2024-03-04T12:20:16.827770+0000","last_became_peered":"2024-03-04T12:20:16.827770+0000","last_unstale":"2024-03-04T13:12:39.308538+0000","last_undegraded":"2024-03-04T13:12:39.308538+0000","last_fullsized":"2024-03-04T13:12:39.308538+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":600,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:29:10.790580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3073,"num_read_kb":2741,"num_write":929,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"255'191","reported_seq":798,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.079883+0000","last_change":"2024-03-04T12:20:14.820669+0000","last_active":"2024-03-04T13:13:21.079883+0000","last_peered":"2024-03-04T13:13:21.079883+0000","last_clean":"2024-03-04T13:13:21.079883+0000","last_became_active":"2024-03-04T12:20:14.820393+0000","last_became_peered":"2024-03-04T12:20:14.820393+0000","last_unstale":"2024-03-04T13:13:21.079883+0000","last_undegraded":"2024-03-04T13:13:21.079883+0000","last_fullsized":"2024-03-04T13:13:21.079883+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:28.246980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":6825,"num_write":1149,"num_write_kb":21389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"255'357","reported_seq":1774,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573122+0000","last_change":"2024-03-04T12:20:16.829573+0000","last_active":"2024-03-04T13:12:50.573122+0000","last_peered":"2024-03-04T13:12:50.573122+0000","last_clean":"2024-03-04T13:12:50.573122+0000","last_became_active":"2024-03-04T12:20:16.829306+0000","last_became_peered":"2024-03-04T12:20:16.829306+0000","last_unstale":"2024-03-04T13:12:50.573122+0000","last_undegraded":"2024-03-04T13:12:50.573122+0000","last_fullsized":"2024-03-04T13:12:50.573122+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:34.297959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1952,"num_read_kb":1858,"num_write":426,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"255'171","reported_seq":773,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.129708+0000","last_change":"2024-03-04T12:20:14.823519+0000","last_active":"2024-03-04T13:13:21.129708+0000","last_peered":"2024-03-04T13:13:21.129708+0000","last_clean":"2024-03-04T13:13:21.129708+0000","last_became_active":"2024-03-04T12:20:14.821961+0000","last_became_peered":"2024-03-04T12:20:14.821961+0000","last_unstale":"2024-03-04T13:13:21.129708+0000","last_undegraded":"2024-03-04T13:13:21.129708+0000","last_fullsized":"2024-03-04T13:13:21.129708+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:49.422340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":395,"num_read_kb":13429,"num_write":876,"num_write_kb":50070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"255'154","reported_seq":722,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.058864+0000","last_change":"2024-03-04T12:20:51.031233+0000","last_active":"2024-03-04T13:13:21.058864+0000","last_peered":"2024-03-04T13:13:21.058864+0000","last_clean":"2024-03-04T13:13:21.058864+0000","last_became_active":"2024-03-04T12:20:51.030887+0000","last_became_peered":"2024-03-04T12:20:51.030887+0000","last_unstale":"2024-03-04T13:13:21.058864+0000","last_undegraded":"2024-03-04T13:13:21.058864+0000","last_fullsized":"2024-03-04T13:13:21.058864+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:43:37.763295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":307,"num_read_kb":55812,"num_write":877,"num_write_kb":48688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"255'385","reported_seq":1778,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.327576+0000","last_change":"2024-03-04T12:20:16.831651+0000","last_active":"2024-03-04T13:12:39.327576+0000","last_peered":"2024-03-04T13:12:39.327576+0000","last_clean":"2024-03-04T13:12:39.327576+0000","last_became_active":"2024-03-04T12:20:16.831393+0000","last_became_peered":"2024-03-04T12:20:16.831393+0000","last_unstale":"2024-03-04T13:12:39.327576+0000","last_undegraded":"2024-03-04T13:12:39.327576+0000","last_fullsized":"2024-03-04T13:12:39.327576+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:40.571982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2009,"num_read_kb":1888,"num_write":461,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"255'190","reported_seq":862,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:14.420866+0000","last_change":"2024-03-04T12:20:14.818169+0000","last_active":"2024-03-04T13:10:14.420866+0000","last_peered":"2024-03-04T13:10:14.420866+0000","last_clean":"2024-03-04T13:10:14.420866+0000","last_became_active":"2024-03-04T12:20:14.817894+0000","last_became_peered":"2024-03-04T12:20:14.817894+0000","last_unstale":"2024-03-04T13:10:14.420866+0000","last_undegraded":"2024-03-04T13:10:14.420866+0000","last_fullsized":"2024-03-04T13:10:14.420866+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:00.852850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270127,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":164272,"num_write":1069,"num_write_kb":63423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"255'517","reported_seq":1960,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.741465+0000","last_change":"2024-03-04T12:20:16.824278+0000","last_active":"2024-03-04T13:11:27.741465+0000","last_peered":"2024-03-04T13:11:27.741465+0000","last_clean":"2024-03-04T13:11:27.741465+0000","last_became_active":"2024-03-04T12:20:16.823974+0000","last_became_peered":"2024-03-04T12:20:16.823974+0000","last_unstale":"2024-03-04T13:11:27.741465+0000","last_undegraded":"2024-03-04T13:11:27.741465+0000","last_fullsized":"2024-03-04T13:11:27.741465+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:53.806735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2611,"num_read_kb":2352,"num_write":706,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":133,"num_read_kb":185523,"num_write":151,"num_write_kb":127147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55623680,"data_stored":55622944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5335,"num_read_kb":3794,"num_write":2149,"num_write_kb":803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1182,"ondisk_log_size":1182,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":10065,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":12124,"num_read_kb":11961,"num_write":14025,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":20130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2376,"ondisk_log_size":2376,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":278213,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8407,"num_read_kb":10340,"num_write":5903,"num_write_kb":2708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":30088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1894,"ondisk_log_size":1894,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1637,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1554,"num_read_kb":1549,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":187558,"num_read_kb":170512,"num_write":50934,"num_write_kb":17677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3785,"ondisk_log_size":3785,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":230107981,"num_objects":280,"num_object_clones":0,"num_object_copies":560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":29459,"num_read_kb":2152910,"num_write":68717,"num_write_kb":2157934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":455168000,"data_stored":453533199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4233,"ondisk_log_size":4233,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":196827,"num_write":154,"num_write_kb":127147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45088768,"data_stored":45088768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575492,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":278660,"kb_used_data":71104,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94093180,"statfs":{"total":96636764160,"available":96351416320,"internally_reserved":0,"allocated":72810496,"data_stored":71072930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212466122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575493,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274148,"kb_used_data":40240,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94097692,"statfs":{"total":96636764160,"available":96356036608,"internally_reserved":0,"allocated":41205760,"data_stored":39656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575493,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149996,"kb_used_data":68804,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94221844,"statfs":{"total":96636764160,"available":96483168256,"internally_reserved":0,"allocated":70455296,"data_stored":68729090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575492,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108236,"kb_used_data":40948,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94263604,"statfs":{"total":96636764160,"available":96525930496,"internally_reserved":0,"allocated":41930752,"data_stored":40369557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575492,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284164,"kb_used_data":76592,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94087676,"statfs":{"total":96636764160,"available":96345780224,"internally_reserved":0,"allocated":78430208,"data_stored":76690401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":212466119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575493,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119312,"kb_used_data":47864,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94252528,"statfs":{"total":96636764160,"available":96514588672,"internally_reserved":0,"allocated":49012736,"data_stored":47453483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575493,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276104,"kb_used_data":164480,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94095736,"statfs":{"total":96636764160,"available":96354033664,"internally_reserved":0,"allocated":168427520,"data_stored":166747056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575491,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273248,"kb_used_data":61540,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94098592,"statfs":{"total":96636764160,"available":96356958208,"internally_reserved":0,"allocated":63016960,"data_stored":61377358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":47357952,"data_stored":47171521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":124960768,"data_stored":124750176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45522944,"data_stored":45373582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":64413696,"data_stored":64121957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32161792,"data_stored":31999474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":56401920,"data_stored":56160984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21966848,"data_stored":21846112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":62382080,"data_stored":62109393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":23702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22069248,"data_stored":22068512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T13:13:23.102 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-04T13:13:23.102 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T13:13:23.441 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:23.454 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-03-04T13:13:23.456 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":1850,"stamp":"2024-03-04T13:13:22.552736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":277125608,"num_objects":674,"num_object_clones":0,"num_object_copies":1348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":674,"num_whiteouts":0,"num_read":244835,"num_read_kb":2733524,"num_write":142224,"num_write_kb":2439956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14195,"ondisk_log_size":14195,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1763868,"kb_used_data":571572,"kb_used_omap":12,"kb_used_meta":1191859,"kb_avail":753210852,"statfs":{"total":773094113280,"available":771287912448,"internally_reserved":0,"allocated":585289728,"data_stored":572096195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1220464178},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-477632227,"num_objects":-234,"num_object_clones":0,"num_object_copies":-468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-234,"num_whiteouts":0,"num_read":555,"num_read_kb":12938,"num_write":359,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004349"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.484480+0000","last_change":"2024-03-04T12:46:22.249796+0000","last_active":"2024-03-04T13:08:52.484480+0000","last_peered":"2024-03-04T13:08:52.484480+0000","last_clean":"2024-03-04T13:08:52.484480+0000","last_became_active":"2024-03-04T12:46:22.248352+0000","last_became_peered":"2024-03-04T12:46:22.248352+0000","last_unstale":"2024-03-04T13:08:52.484480+0000","last_undegraded":"2024-03-04T13:08:52.484480+0000","last_fullsized":"2024-03-04T13:08:52.484480+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:06:29.651006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.542968+0000","last_change":"2024-03-04T12:32:46.051455+0000","last_active":"2024-03-04T13:10:17.542968+0000","last_peered":"2024-03-04T13:10:17.542968+0000","last_clean":"2024-03-04T13:10:17.542968+0000","last_became_active":"2024-03-04T12:32:46.051177+0000","last_became_peered":"2024-03-04T12:32:46.051177+0000","last_unstale":"2024-03-04T13:10:17.542968+0000","last_undegraded":"2024-03-04T13:10:17.542968+0000","last_fullsized":"2024-03-04T13:10:17.542968+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:41:49.996314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"255'2","reported_seq":51,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.456404+0000","last_change":"2024-03-04T12:32:42.034412+0000","last_active":"2024-03-04T13:12:47.456404+0000","last_peered":"2024-03-04T13:12:47.456404+0000","last_clean":"2024-03-04T13:12:47.456404+0000","last_became_active":"2024-03-04T12:32:42.034142+0000","last_became_peered":"2024-03-04T12:32:42.034142+0000","last_unstale":"2024-03-04T13:12:47.456404+0000","last_undegraded":"2024-03-04T13:12:47.456404+0000","last_fullsized":"2024-03-04T13:12:47.456404+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:44.538526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"255'17","reported_seq":90,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.448801+0000","last_change":"2024-03-04T12:29:01.703199+0000","last_active":"2024-03-04T13:10:42.448801+0000","last_peered":"2024-03-04T13:10:42.448801+0000","last_clean":"2024-03-04T13:10:42.448801+0000","last_became_active":"2024-03-04T12:29:01.702925+0000","last_became_peered":"2024-03-04T12:29:01.702925+0000","last_unstale":"2024-03-04T13:10:42.448801+0000","last_undegraded":"2024-03-04T13:10:42.448801+0000","last_fullsized":"2024-03-04T13:10:42.448801+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:00:11.470237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":40,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.343248+0000","last_change":"2024-03-04T12:46:22.258654+0000","last_active":"2024-03-04T13:08:52.343248+0000","last_peered":"2024-03-04T13:08:52.343248+0000","last_clean":"2024-03-04T13:08:52.343248+0000","last_became_active":"2024-03-04T12:46:22.258268+0000","last_became_peered":"2024-03-04T12:46:22.258268+0000","last_unstale":"2024-03-04T13:08:52.343248+0000","last_undegraded":"2024-03-04T13:08:52.343248+0000","last_fullsized":"2024-03-04T13:08:52.343248+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:28:49.843503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"255'11","reported_seq":67,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.130583+0000","last_change":"2024-03-04T12:32:46.052063+0000","last_active":"2024-03-04T13:13:21.130583+0000","last_peered":"2024-03-04T13:13:21.130583+0000","last_clean":"2024-03-04T13:13:21.130583+0000","last_became_active":"2024-03-04T12:32:46.051799+0000","last_became_peered":"2024-03-04T12:32:46.051799+0000","last_unstale":"2024-03-04T13:13:21.130583+0000","last_undegraded":"2024-03-04T13:13:21.130583+0000","last_fullsized":"2024-03-04T13:13:21.130583+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:10:51.455925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":43010,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"255'9","reported_seq":64,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.006034+0000","last_change":"2024-03-04T12:32:42.038130+0000","last_active":"2024-03-04T13:13:21.006034+0000","last_peered":"2024-03-04T13:13:21.006034+0000","last_clean":"2024-03-04T13:13:21.006034+0000","last_became_active":"2024-03-04T12:32:42.037701+0000","last_became_peered":"2024-03-04T12:32:42.037701+0000","last_unstale":"2024-03-04T13:13:21.006034+0000","last_undegraded":"2024-03-04T13:13:21.006034+0000","last_fullsized":"2024-03-04T13:13:21.006034+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:21:40.863589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"255'28","reported_seq":119,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.451341+0000","last_change":"2024-03-04T12:29:01.701298+0000","last_active":"2024-03-04T13:11:07.451341+0000","last_peered":"2024-03-04T13:11:07.451341+0000","last_clean":"2024-03-04T13:11:07.451341+0000","last_became_active":"2024-03-04T12:29:01.701003+0000","last_became_peered":"2024-03-04T12:29:01.701003+0000","last_unstale":"2024-03-04T13:11:07.451341+0000","last_undegraded":"2024-03-04T13:11:07.451341+0000","last_fullsized":"2024-03-04T13:11:07.451341+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:24.902315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":75,"num_write":51,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.454100+0000","last_change":"2024-03-04T12:46:22.308264+0000","last_active":"2024-03-04T13:10:27.454100+0000","last_peered":"2024-03-04T13:10:27.454100+0000","last_clean":"2024-03-04T13:10:27.454100+0000","last_became_active":"2024-03-04T12:46:22.307955+0000","last_became_peered":"2024-03-04T12:46:22.307955+0000","last_unstale":"2024-03-04T13:10:27.454100+0000","last_undegraded":"2024-03-04T13:10:27.454100+0000","last_fullsized":"2024-03-04T13:10:27.454100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:02:47.868860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":41,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498796+0000","last_change":"2024-03-04T12:32:46.053816+0000","last_active":"2024-03-04T13:10:17.498796+0000","last_peered":"2024-03-04T13:10:17.498796+0000","last_clean":"2024-03-04T13:10:17.498796+0000","last_became_active":"2024-03-04T12:32:46.053497+0000","last_became_peered":"2024-03-04T12:32:46.053497+0000","last_unstale":"2024-03-04T13:10:17.498796+0000","last_undegraded":"2024-03-04T13:10:17.498796+0000","last_fullsized":"2024-03-04T13:10:17.498796+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:27:00.581234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"255'3","reported_seq":51,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:42.468735+0000","last_change":"2024-03-04T12:32:42.037134+0000","last_active":"2024-03-04T13:12:42.468735+0000","last_peered":"2024-03-04T13:12:42.468735+0000","last_clean":"2024-03-04T13:12:42.468735+0000","last_became_active":"2024-03-04T12:32:42.036801+0000","last_became_peered":"2024-03-04T12:32:42.036801+0000","last_unstale":"2024-03-04T13:12:42.468735+0000","last_undegraded":"2024-03-04T13:12:42.468735+0000","last_fullsized":"2024-03-04T13:12:42.468735+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:11.992223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"255'24","reported_seq":108,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.486375+0000","last_change":"2024-03-04T12:29:01.707999+0000","last_active":"2024-03-04T13:09:02.486375+0000","last_peered":"2024-03-04T13:09:02.486375+0000","last_clean":"2024-03-04T13:09:02.486375+0000","last_became_active":"2024-03-04T12:29:01.707589+0000","last_became_peered":"2024-03-04T12:29:01.707589+0000","last_unstale":"2024-03-04T13:09:02.486375+0000","last_undegraded":"2024-03-04T13:09:02.486375+0000","last_fullsized":"2024-03-04T13:09:02.486375+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:51.454986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":71,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:17.438941+0000","last_change":"2024-03-04T12:46:22.310150+0000","last_active":"2024-03-04T13:09:17.438941+0000","last_peered":"2024-03-04T13:09:17.438941+0000","last_clean":"2024-03-04T13:09:17.438941+0000","last_became_active":"2024-03-04T12:46:22.309869+0000","last_became_peered":"2024-03-04T12:46:22.309869+0000","last_unstale":"2024-03-04T13:09:17.438941+0000","last_undegraded":"2024-03-04T13:09:17.438941+0000","last_fullsized":"2024-03-04T13:09:17.438941+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:17:23.605967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"255'3","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:52.456967+0000","last_change":"2024-03-04T12:32:46.057930+0000","last_active":"2024-03-04T13:12:52.456967+0000","last_peered":"2024-03-04T13:12:52.456967+0000","last_clean":"2024-03-04T13:12:52.456967+0000","last_became_active":"2024-03-04T12:32:46.057603+0000","last_became_peered":"2024-03-04T12:32:46.057603+0000","last_unstale":"2024-03-04T13:12:52.456967+0000","last_undegraded":"2024-03-04T13:12:52.456967+0000","last_fullsized":"2024-03-04T13:12:52.456967+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:31:09.275711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"250'3","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.445413+0000","last_change":"2024-03-04T12:32:42.032501+0000","last_active":"2024-03-04T13:10:12.445413+0000","last_peered":"2024-03-04T13:10:12.445413+0000","last_clean":"2024-03-04T13:10:12.445413+0000","last_became_active":"2024-03-04T12:32:42.032231+0000","last_became_peered":"2024-03-04T12:32:42.032231+0000","last_unstale":"2024-03-04T13:10:12.445413+0000","last_undegraded":"2024-03-04T13:10:12.445413+0000","last_fullsized":"2024-03-04T13:10:12.445413+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:57:04.660301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"255'27","reported_seq":111,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.534374+0000","last_change":"2024-03-04T12:29:01.704816+0000","last_active":"2024-03-04T13:09:02.534374+0000","last_peered":"2024-03-04T13:09:02.534374+0000","last_clean":"2024-03-04T13:09:02.534374+0000","last_became_active":"2024-03-04T12:29:01.704548+0000","last_became_peered":"2024-03-04T12:29:01.704548+0000","last_unstale":"2024-03-04T13:09:02.534374+0000","last_undegraded":"2024-03-04T13:09:02.534374+0000","last_fullsized":"2024-03-04T13:09:02.534374+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:15:47.833044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":73,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.481590+0000","last_change":"2024-03-04T12:46:22.258204+0000","last_active":"2024-03-04T13:10:32.481590+0000","last_peered":"2024-03-04T13:10:32.481590+0000","last_clean":"2024-03-04T13:10:32.481590+0000","last_became_active":"2024-03-04T12:46:22.257894+0000","last_became_peered":"2024-03-04T12:46:22.257894+0000","last_unstale":"2024-03-04T13:10:32.481590+0000","last_undegraded":"2024-03-04T13:10:32.481590+0000","last_fullsized":"2024-03-04T13:10:32.481590+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:54:40.739780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:07.487245+0000","last_change":"2024-03-04T12:32:46.054248+0000","last_active":"2024-03-04T13:09:07.487245+0000","last_peered":"2024-03-04T13:09:07.487245+0000","last_clean":"2024-03-04T13:09:07.487245+0000","last_became_active":"2024-03-04T12:32:46.053946+0000","last_became_peered":"2024-03-04T12:32:46.053946+0000","last_unstale":"2024-03-04T13:09:07.487245+0000","last_undegraded":"2024-03-04T13:09:07.487245+0000","last_fullsized":"2024-03-04T13:09:07.487245+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:49.837502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"255'11","reported_seq":68,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:42.499521+0000","last_change":"2024-03-04T12:32:42.037699+0000","last_active":"2024-03-04T13:12:42.499521+0000","last_peered":"2024-03-04T13:12:42.499521+0000","last_clean":"2024-03-04T13:12:42.499521+0000","last_became_active":"2024-03-04T12:32:42.037387+0000","last_became_peered":"2024-03-04T12:32:42.037387+0000","last_unstale":"2024-03-04T13:12:42.499521+0000","last_undegraded":"2024-03-04T13:12:42.499521+0000","last_fullsized":"2024-03-04T13:12:42.499521+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:05.876966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":15,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"255'50","reported_seq":162,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.534333+0000","last_change":"2024-03-04T12:29:01.704333+0000","last_active":"2024-03-04T13:09:02.534333+0000","last_peered":"2024-03-04T13:09:02.534333+0000","last_clean":"2024-03-04T13:09:02.534333+0000","last_became_active":"2024-03-04T12:29:01.703815+0000","last_became_peered":"2024-03-04T12:29:01.703815+0000","last_unstale":"2024-03-04T13:09:02.534333+0000","last_undegraded":"2024-03-04T13:09:02.534333+0000","last_fullsized":"2024-03-04T13:09:02.534333+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:15:13.058945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":130,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:37.357774+0000","last_change":"2024-03-04T12:46:22.260813+0000","last_active":"2024-03-04T13:10:37.357774+0000","last_peered":"2024-03-04T13:10:37.357774+0000","last_clean":"2024-03-04T13:10:37.357774+0000","last_became_active":"2024-03-04T12:46:22.260529+0000","last_became_peered":"2024-03-04T12:46:22.260529+0000","last_unstale":"2024-03-04T13:10:37.357774+0000","last_undegraded":"2024-03-04T13:10:37.357774+0000","last_fullsized":"2024-03-04T13:10:37.357774+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:25:58.359881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"255'5","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.453596+0000","last_change":"2024-03-04T12:32:46.052656+0000","last_active":"2024-03-04T13:11:27.453596+0000","last_peered":"2024-03-04T13:11:27.453596+0000","last_clean":"2024-03-04T13:11:27.453596+0000","last_became_active":"2024-03-04T12:32:46.052388+0000","last_became_peered":"2024-03-04T12:32:46.052388+0000","last_unstale":"2024-03-04T13:11:27.453596+0000","last_undegraded":"2024-03-04T13:11:27.453596+0000","last_fullsized":"2024-03-04T13:11:27.453596+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:32.283432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5160,"num_write":5,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"0'0","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.452400+0000","last_change":"2024-03-04T12:32:42.031111+0000","last_active":"2024-03-04T13:10:12.452400+0000","last_peered":"2024-03-04T13:10:12.452400+0000","last_clean":"2024-03-04T13:10:12.452400+0000","last_became_active":"2024-03-04T12:32:42.030804+0000","last_became_peered":"2024-03-04T12:32:42.030804+0000","last_unstale":"2024-03-04T13:10:12.452400+0000","last_undegraded":"2024-03-04T13:10:12.452400+0000","last_fullsized":"2024-03-04T13:10:12.452400+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:18:47.403222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"255'35","reported_seq":128,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.486308+0000","last_change":"2024-03-04T12:29:01.703915+0000","last_active":"2024-03-04T13:09:02.486308+0000","last_peered":"2024-03-04T13:09:02.486308+0000","last_clean":"2024-03-04T13:09:02.486308+0000","last_became_active":"2024-03-04T12:29:01.703369+0000","last_became_peered":"2024-03-04T12:29:01.703369+0000","last_unstale":"2024-03-04T13:09:02.486308+0000","last_undegraded":"2024-03-04T13:09:02.486308+0000","last_fullsized":"2024-03-04T13:09:02.486308+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:00:37.472429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":90,"num_write":62,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.443264+0000","last_change":"2024-03-04T12:46:22.256005+0000","last_active":"2024-03-04T13:08:52.443264+0000","last_peered":"2024-03-04T13:08:52.443264+0000","last_clean":"2024-03-04T13:08:52.443264+0000","last_became_active":"2024-03-04T12:46:22.255588+0000","last_became_peered":"2024-03-04T12:46:22.255588+0000","last_unstale":"2024-03-04T13:08:52.443264+0000","last_undegraded":"2024-03-04T13:08:52.443264+0000","last_fullsized":"2024-03-04T13:08:52.443264+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:06:23.252303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"255'6","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.462864+0000","last_change":"2024-03-04T12:32:46.057798+0000","last_active":"2024-03-04T13:12:47.462864+0000","last_peered":"2024-03-04T13:12:47.462864+0000","last_clean":"2024-03-04T13:12:47.462864+0000","last_became_active":"2024-03-04T12:32:46.057413+0000","last_became_peered":"2024-03-04T12:32:46.057413+0000","last_unstale":"2024-03-04T13:12:47.462864+0000","last_undegraded":"2024-03-04T13:12:47.462864+0000","last_fullsized":"2024-03-04T13:12:47.462864+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:42.088318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"255'6","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:57.533622+0000","last_change":"2024-03-04T12:32:42.031365+0000","last_active":"2024-03-04T13:08:57.533622+0000","last_peered":"2024-03-04T13:08:57.533622+0000","last_clean":"2024-03-04T13:08:57.533622+0000","last_became_active":"2024-03-04T12:32:42.031099+0000","last_became_peered":"2024-03-04T12:32:42.031099+0000","last_unstale":"2024-03-04T13:08:57.533622+0000","last_undegraded":"2024-03-04T13:08:57.533622+0000","last_fullsized":"2024-03-04T13:08:57.533622+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:05.270417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"255'41","reported_seq":139,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.452360+0000","last_change":"2024-03-04T12:29:01.701202+0000","last_active":"2024-03-04T13:10:12.452360+0000","last_peered":"2024-03-04T13:10:12.452360+0000","last_clean":"2024-03-04T13:10:12.452360+0000","last_became_active":"2024-03-04T12:29:01.700917+0000","last_became_peered":"2024-03-04T12:29:01.700917+0000","last_unstale":"2024-03-04T13:10:12.452360+0000","last_undegraded":"2024-03-04T13:10:12.452360+0000","last_fullsized":"2024-03-04T13:10:12.452360+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:02.058404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":100,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.468177+0000","last_change":"2024-03-04T12:46:22.256121+0000","last_active":"2024-03-04T13:08:52.468177+0000","last_peered":"2024-03-04T13:08:52.468177+0000","last_clean":"2024-03-04T13:08:52.468177+0000","last_became_active":"2024-03-04T12:46:22.255812+0000","last_became_peered":"2024-03-04T12:46:22.255812+0000","last_unstale":"2024-03-04T13:08:52.468177+0000","last_undegraded":"2024-03-04T13:08:52.468177+0000","last_fullsized":"2024-03-04T13:08:52.468177+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:10:20.330661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498622+0000","last_change":"2024-03-04T12:32:46.053933+0000","last_active":"2024-03-04T13:10:17.498622+0000","last_peered":"2024-03-04T13:10:17.498622+0000","last_clean":"2024-03-04T13:10:17.498622+0000","last_became_active":"2024-03-04T12:32:46.053172+0000","last_became_peered":"2024-03-04T12:32:46.053172+0000","last_unstale":"2024-03-04T13:10:17.498622+0000","last_undegraded":"2024-03-04T13:10:17.498622+0000","last_fullsized":"2024-03-04T13:10:17.498622+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:58:29.044468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"255'5","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.453640+0000","last_change":"2024-03-04T12:32:42.037511+0000","last_active":"2024-03-04T13:11:27.453640+0000","last_peered":"2024-03-04T13:11:27.453640+0000","last_clean":"2024-03-04T13:11:27.453640+0000","last_became_active":"2024-03-04T12:32:42.033315+0000","last_became_peered":"2024-03-04T12:32:42.033315+0000","last_unstale":"2024-03-04T13:11:27.453640+0000","last_undegraded":"2024-03-04T13:11:27.453640+0000","last_fullsized":"2024-03-04T13:11:27.453640+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:57:22.224861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5136,"num_write":5,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"255'18","reported_seq":96,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.353304+0000","last_change":"2024-03-04T12:29:01.707001+0000","last_active":"2024-03-04T13:10:07.353304+0000","last_peered":"2024-03-04T13:10:07.353304+0000","last_clean":"2024-03-04T13:10:07.353304+0000","last_became_active":"2024-03-04T12:29:01.706695+0000","last_became_peered":"2024-03-04T12:29:01.706695+0000","last_unstale":"2024-03-04T13:10:07.353304+0000","last_undegraded":"2024-03-04T13:10:07.353304+0000","last_fullsized":"2024-03-04T13:10:07.353304+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:25:41.776852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":54,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"252'1","reported_seq":25,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.445978+0000","last_change":"2024-03-04T12:46:51.979336+0000","last_active":"2024-03-04T13:10:17.445978+0000","last_peered":"2024-03-04T13:10:17.445978+0000","last_clean":"2024-03-04T13:10:17.445978+0000","last_became_active":"2024-03-04T12:46:51.977076+0000","last_became_peered":"2024-03-04T12:46:51.977076+0000","last_unstale":"2024-03-04T13:10:17.445978+0000","last_undegraded":"2024-03-04T13:10:17.445978+0000","last_fullsized":"2024-03-04T13:10:17.445978+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:24.892234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.486407+0000","last_change":"2024-03-04T12:32:46.056068+0000","last_active":"2024-03-04T13:09:02.486407+0000","last_peered":"2024-03-04T13:09:02.486407+0000","last_clean":"2024-03-04T13:09:02.486407+0000","last_became_active":"2024-03-04T12:32:46.055692+0000","last_became_peered":"2024-03-04T12:32:46.055692+0000","last_unstale":"2024-03-04T13:09:02.486407+0000","last_undegraded":"2024-03-04T13:09:02.486407+0000","last_fullsized":"2024-03-04T13:09:02.486407+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:41:41.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"0'0","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:57.443861+0000","last_change":"2024-03-04T12:32:42.030205+0000","last_active":"2024-03-04T13:08:57.443861+0000","last_peered":"2024-03-04T13:08:57.443861+0000","last_clean":"2024-03-04T13:08:57.443861+0000","last_became_active":"2024-03-04T12:32:42.029940+0000","last_became_peered":"2024-03-04T12:32:42.029940+0000","last_unstale":"2024-03-04T13:08:57.443861+0000","last_undegraded":"2024-03-04T13:08:57.443861+0000","last_fullsized":"2024-03-04T13:08:57.443861+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:48:36.549896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"255'31","reported_seq":118,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.478216+0000","last_change":"2024-03-04T12:29:01.701660+0000","last_active":"2024-03-04T13:10:07.478216+0000","last_peered":"2024-03-04T13:10:07.478216+0000","last_clean":"2024-03-04T13:10:07.478216+0000","last_became_active":"2024-03-04T12:29:01.701379+0000","last_became_peered":"2024-03-04T12:29:01.701379+0000","last_unstale":"2024-03-04T13:10:07.478216+0000","last_undegraded":"2024-03-04T13:10:07.478216+0000","last_fullsized":"2024-03-04T13:10:07.478216+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:12:36.501891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":79,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.454754+0000","last_change":"2024-03-04T12:46:22.309007+0000","last_active":"2024-03-04T13:10:32.454754+0000","last_peered":"2024-03-04T13:10:32.454754+0000","last_clean":"2024-03-04T13:10:32.454754+0000","last_became_active":"2024-03-04T12:46:22.308714+0000","last_became_peered":"2024-03-04T12:46:22.308714+0000","last_unstale":"2024-03-04T13:10:32.454754+0000","last_undegraded":"2024-03-04T13:10:32.454754+0000","last_fullsized":"2024-03-04T13:10:32.454754+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:10.983835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"255'6","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:37.375099+0000","last_change":"2024-03-04T12:32:46.052223+0000","last_active":"2024-03-04T13:12:37.375099+0000","last_peered":"2024-03-04T13:12:37.375099+0000","last_clean":"2024-03-04T13:12:37.375099+0000","last_became_active":"2024-03-04T12:32:46.051926+0000","last_became_peered":"2024-03-04T12:32:46.051926+0000","last_unstale":"2024-03-04T13:12:37.375099+0000","last_undegraded":"2024-03-04T13:12:37.375099+0000","last_fullsized":"2024-03-04T13:12:37.375099+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:13:09.671991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"0'0","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:57.436868+0000","last_change":"2024-03-04T12:32:42.034599+0000","last_active":"2024-03-04T13:08:57.436868+0000","last_peered":"2024-03-04T13:08:57.436868+0000","last_clean":"2024-03-04T13:08:57.436868+0000","last_became_active":"2024-03-04T12:32:42.034301+0000","last_became_peered":"2024-03-04T12:32:42.034301+0000","last_unstale":"2024-03-04T13:08:57.436868+0000","last_undegraded":"2024-03-04T13:08:57.436868+0000","last_fullsized":"2024-03-04T13:08:57.436868+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:14:58.871710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"255'132","reported_seq":425,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.541907+0000","last_change":"2024-03-04T12:29:01.703498+0000","last_active":"2024-03-04T13:10:07.541907+0000","last_peered":"2024-03-04T13:10:07.541907+0000","last_clean":"2024-03-04T13:10:07.541907+0000","last_became_active":"2024-03-04T12:29:01.703239+0000","last_became_peered":"2024-03-04T12:29:01.703239+0000","last_unstale":"2024-03-04T13:10:07.541907+0000","last_undegraded":"2024-03-04T13:10:07.541907+0000","last_fullsized":"2024-03-04T13:10:07.541907+0000","mapping_epoch":242,"log_start":"255'100","ondisk_log_start":"255'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:42:59.963681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":704,"num_read_kb":496,"num_write":192,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.501311+0000","last_change":"2024-03-04T12:46:22.259911+0000","last_active":"2024-03-04T13:10:32.501311+0000","last_peered":"2024-03-04T13:10:32.501311+0000","last_clean":"2024-03-04T13:10:32.501311+0000","last_became_active":"2024-03-04T12:46:22.259424+0000","last_became_peered":"2024-03-04T12:46:22.259424+0000","last_unstale":"2024-03-04T13:10:32.501311+0000","last_undegraded":"2024-03-04T13:10:32.501311+0000","last_fullsized":"2024-03-04T13:10:32.501311+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:44:30.252593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"250'5","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.437423+0000","last_change":"2024-03-04T12:32:46.057250+0000","last_active":"2024-03-04T13:09:02.437423+0000","last_peered":"2024-03-04T13:09:02.437423+0000","last_clean":"2024-03-04T13:09:02.437423+0000","last_became_active":"2024-03-04T12:32:46.056976+0000","last_became_peered":"2024-03-04T12:32:46.056976+0000","last_unstale":"2024-03-04T13:09:02.437423+0000","last_undegraded":"2024-03-04T13:09:02.437423+0000","last_fullsized":"2024-03-04T13:09:02.437423+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:50:22.480400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497894+0000","last_change":"2024-03-04T12:32:42.037353+0000","last_active":"2024-03-04T13:10:12.497894+0000","last_peered":"2024-03-04T13:10:12.497894+0000","last_clean":"2024-03-04T13:10:12.497894+0000","last_became_active":"2024-03-04T12:32:42.036694+0000","last_became_peered":"2024-03-04T12:32:42.036694+0000","last_unstale":"2024-03-04T13:10:12.497894+0000","last_undegraded":"2024-03-04T13:10:12.497894+0000","last_fullsized":"2024-03-04T13:10:12.497894+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:57:01.079244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"255'13","reported_seq":77,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.439473+0000","last_change":"2024-03-04T12:29:01.706751+0000","last_active":"2024-03-04T13:10:07.439473+0000","last_peered":"2024-03-04T13:10:07.439473+0000","last_clean":"2024-03-04T13:10:07.439473+0000","last_became_active":"2024-03-04T12:29:01.706467+0000","last_became_peered":"2024-03-04T12:29:01.706467+0000","last_unstale":"2024-03-04T13:10:07.439473+0000","last_undegraded":"2024-03-04T13:10:07.439473+0000","last_fullsized":"2024-03-04T13:10:07.439473+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:29:39.335950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.454804+0000","last_change":"2024-03-04T12:46:22.311206+0000","last_active":"2024-03-04T13:10:32.454804+0000","last_peered":"2024-03-04T13:10:32.454804+0000","last_clean":"2024-03-04T13:10:32.454804+0000","last_became_active":"2024-03-04T12:46:22.310952+0000","last_became_peered":"2024-03-04T12:46:22.310952+0000","last_unstale":"2024-03-04T13:10:32.454804+0000","last_undegraded":"2024-03-04T13:10:32.454804+0000","last_fullsized":"2024-03-04T13:10:32.454804+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:16:54.485327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"250'3","reported_seq":43,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.432359+0000","last_change":"2024-03-04T12:32:46.055077+0000","last_active":"2024-03-04T13:09:02.432359+0000","last_peered":"2024-03-04T13:09:02.432359+0000","last_clean":"2024-03-04T13:09:02.432359+0000","last_became_active":"2024-03-04T12:32:46.054752+0000","last_became_peered":"2024-03-04T12:32:46.054752+0000","last_unstale":"2024-03-04T13:09:02.432359+0000","last_undegraded":"2024-03-04T13:09:02.432359+0000","last_fullsized":"2024-03-04T13:09:02.432359+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:35:26.379046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"255'2","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:22.447389+0000","last_change":"2024-03-04T12:32:42.034215+0000","last_active":"2024-03-04T13:11:22.447389+0000","last_peered":"2024-03-04T13:11:22.447389+0000","last_clean":"2024-03-04T13:11:22.447389+0000","last_became_active":"2024-03-04T12:32:42.033898+0000","last_became_peered":"2024-03-04T12:32:42.033898+0000","last_unstale":"2024-03-04T13:11:22.447389+0000","last_undegraded":"2024-03-04T13:11:22.447389+0000","last_fullsized":"2024-03-04T13:11:22.447389+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:12:35.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"255'43","reported_seq":147,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:47.532685+0000","last_change":"2024-03-04T12:29:01.705464+0000","last_active":"2024-03-04T13:08:47.532685+0000","last_peered":"2024-03-04T13:08:47.532685+0000","last_clean":"2024-03-04T13:08:47.532685+0000","last_became_active":"2024-03-04T12:29:01.705183+0000","last_became_peered":"2024-03-04T12:29:01.705183+0000","last_unstale":"2024-03-04T13:08:47.532685+0000","last_undegraded":"2024-03-04T13:08:47.532685+0000","last_fullsized":"2024-03-04T13:08:47.532685+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:17:25.877488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":113,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.538980+0000","last_change":"2024-03-04T12:46:22.246381+0000","last_active":"2024-03-04T13:09:42.538980+0000","last_peered":"2024-03-04T13:09:42.538980+0000","last_clean":"2024-03-04T13:09:42.538980+0000","last_became_active":"2024-03-04T12:46:22.245967+0000","last_became_peered":"2024-03-04T12:46:22.245967+0000","last_unstale":"2024-03-04T13:09:42.538980+0000","last_undegraded":"2024-03-04T13:09:42.538980+0000","last_fullsized":"2024-03-04T13:09:42.538980+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:34:41.879387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.451813+0000","last_change":"2024-03-04T12:32:46.051614+0000","last_active":"2024-03-04T13:10:07.451813+0000","last_peered":"2024-03-04T13:10:07.451813+0000","last_clean":"2024-03-04T13:10:07.451813+0000","last_became_active":"2024-03-04T12:32:46.051360+0000","last_became_peered":"2024-03-04T12:32:46.051360+0000","last_unstale":"2024-03-04T13:10:07.451813+0000","last_undegraded":"2024-03-04T13:10:07.451813+0000","last_fullsized":"2024-03-04T13:10:07.451813+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:55.771101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"0'0","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:02.444339+0000","last_change":"2024-03-04T12:32:42.029927+0000","last_active":"2024-03-04T13:10:02.444339+0000","last_peered":"2024-03-04T13:10:02.444339+0000","last_clean":"2024-03-04T13:10:02.444339+0000","last_became_active":"2024-03-04T12:32:42.029559+0000","last_became_peered":"2024-03-04T12:32:42.029559+0000","last_unstale":"2024-03-04T13:10:02.444339+0000","last_undegraded":"2024-03-04T13:10:02.444339+0000","last_fullsized":"2024-03-04T13:10:02.444339+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:52:35.578821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"250'28","reported_seq":116,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.445115+0000","last_change":"2024-03-04T12:29:01.707645+0000","last_active":"2024-03-04T13:11:02.445115+0000","last_peered":"2024-03-04T13:11:02.445115+0000","last_clean":"2024-03-04T13:11:02.445115+0000","last_became_active":"2024-03-04T12:29:01.705726+0000","last_became_peered":"2024-03-04T12:29:01.705726+0000","last_unstale":"2024-03-04T13:11:02.445115+0000","last_undegraded":"2024-03-04T13:11:02.445115+0000","last_fullsized":"2024-03-04T13:11:02.445115+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:13:42.259053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":49,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.539021+0000","last_change":"2024-03-04T12:46:22.259972+0000","last_active":"2024-03-04T13:09:42.539021+0000","last_peered":"2024-03-04T13:09:42.539021+0000","last_clean":"2024-03-04T13:09:42.539021+0000","last_became_active":"2024-03-04T12:46:22.259134+0000","last_became_peered":"2024-03-04T12:46:22.259134+0000","last_unstale":"2024-03-04T13:09:42.539021+0000","last_undegraded":"2024-03-04T13:09:42.539021+0000","last_fullsized":"2024-03-04T13:09:42.539021+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:01:20.186301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.496892+0000","last_change":"2024-03-04T12:32:46.053557+0000","last_active":"2024-03-04T13:10:07.496892+0000","last_peered":"2024-03-04T13:10:07.496892+0000","last_clean":"2024-03-04T13:10:07.496892+0000","last_became_active":"2024-03-04T12:32:46.053156+0000","last_became_peered":"2024-03-04T12:32:46.053156+0000","last_unstale":"2024-03-04T13:10:07.496892+0000","last_undegraded":"2024-03-04T13:10:07.496892+0000","last_fullsized":"2024-03-04T13:10:07.496892+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:39.367675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"255'10","reported_seq":69,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520454+0000","last_change":"2024-03-04T12:32:42.036924+0000","last_active":"2024-03-04T13:12:22.520454+0000","last_peered":"2024-03-04T13:12:22.520454+0000","last_clean":"2024-03-04T13:12:22.520454+0000","last_became_active":"2024-03-04T12:32:42.036617+0000","last_became_peered":"2024-03-04T12:32:42.036617+0000","last_unstale":"2024-03-04T13:12:22.520454+0000","last_undegraded":"2024-03-04T13:12:22.520454+0000","last_fullsized":"2024-03-04T13:12:22.520454+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:10:49.987113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":29698,"num_write":14,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"255'17","reported_seq":94,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.361248+0000","last_change":"2024-03-04T12:29:01.701993+0000","last_active":"2024-03-04T13:11:02.361248+0000","last_peered":"2024-03-04T13:11:02.361248+0000","last_clean":"2024-03-04T13:11:02.361248+0000","last_became_active":"2024-03-04T12:29:01.701712+0000","last_became_peered":"2024-03-04T12:29:01.701712+0000","last_unstale":"2024-03-04T13:11:02.361248+0000","last_undegraded":"2024-03-04T13:11:02.361248+0000","last_fullsized":"2024-03-04T13:11:02.361248+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:53.885309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":51,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.474805+0000","last_change":"2024-03-04T12:46:22.257008+0000","last_active":"2024-03-04T13:09:42.474805+0000","last_peered":"2024-03-04T13:09:42.474805+0000","last_clean":"2024-03-04T13:09:42.474805+0000","last_became_active":"2024-03-04T12:46:22.256617+0000","last_became_peered":"2024-03-04T12:46:22.256617+0000","last_unstale":"2024-03-04T13:09:42.474805+0000","last_undegraded":"2024-03-04T13:09:42.474805+0000","last_fullsized":"2024-03-04T13:09:42.474805+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:25.255969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.353352+0000","last_change":"2024-03-04T12:32:46.053973+0000","last_active":"2024-03-04T13:10:07.353352+0000","last_peered":"2024-03-04T13:10:07.353352+0000","last_clean":"2024-03-04T13:10:07.353352+0000","last_became_active":"2024-03-04T12:32:46.053272+0000","last_became_peered":"2024-03-04T12:32:46.053272+0000","last_unstale":"2024-03-04T13:10:07.353352+0000","last_undegraded":"2024-03-04T13:10:07.353352+0000","last_fullsized":"2024-03-04T13:10:07.353352+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:51:06.764174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"0'0","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:02.451255+0000","last_change":"2024-03-04T12:32:42.036193+0000","last_active":"2024-03-04T13:10:02.451255+0000","last_peered":"2024-03-04T13:10:02.451255+0000","last_clean":"2024-03-04T13:10:02.451255+0000","last_became_active":"2024-03-04T12:32:42.035923+0000","last_became_peered":"2024-03-04T12:32:42.035923+0000","last_unstale":"2024-03-04T13:10:02.451255+0000","last_undegraded":"2024-03-04T13:10:02.451255+0000","last_fullsized":"2024-03-04T13:10:02.451255+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:56:49.994031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"255'34","reported_seq":131,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.506332+0000","last_change":"2024-03-04T12:29:01.703208+0000","last_active":"2024-03-04T13:11:02.506332+0000","last_peered":"2024-03-04T13:11:02.506332+0000","last_clean":"2024-03-04T13:11:02.506332+0000","last_became_active":"2024-03-04T12:29:01.702327+0000","last_became_peered":"2024-03-04T12:29:01.702327+0000","last_unstale":"2024-03-04T13:11:02.506332+0000","last_undegraded":"2024-03-04T13:11:02.506332+0000","last_fullsized":"2024-03-04T13:11:02.506332+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:06:05.157615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"252'1","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.448820+0000","last_change":"2024-03-04T12:46:22.258104+0000","last_active":"2024-03-04T13:09:42.448820+0000","last_peered":"2024-03-04T13:09:42.448820+0000","last_clean":"2024-03-04T13:09:42.448820+0000","last_became_active":"2024-03-04T12:46:22.257651+0000","last_became_peered":"2024-03-04T12:46:22.257651+0000","last_unstale":"2024-03-04T13:09:42.448820+0000","last_undegraded":"2024-03-04T13:09:42.448820+0000","last_fullsized":"2024-03-04T13:09:42.448820+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:10:20.836802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"250'7","reported_seq":58,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.478111+0000","last_change":"2024-03-04T12:32:46.049805+0000","last_active":"2024-03-04T13:10:07.478111+0000","last_peered":"2024-03-04T13:10:07.478111+0000","last_clean":"2024-03-04T13:10:07.478111+0000","last_became_active":"2024-03-04T12:32:46.049512+0000","last_became_peered":"2024-03-04T12:32:46.049512+0000","last_unstale":"2024-03-04T13:10:07.478111+0000","last_undegraded":"2024-03-04T13:10:07.478111+0000","last_fullsized":"2024-03-04T13:10:07.478111+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:41:47.962697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":11,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"0'0","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:02.496141+0000","last_change":"2024-03-04T12:32:42.032301+0000","last_active":"2024-03-04T13:10:02.496141+0000","last_peered":"2024-03-04T13:10:02.496141+0000","last_clean":"2024-03-04T13:10:02.496141+0000","last_became_active":"2024-03-04T12:32:42.032034+0000","last_became_peered":"2024-03-04T12:32:42.032034+0000","last_unstale":"2024-03-04T13:10:02.496141+0000","last_undegraded":"2024-03-04T13:10:02.496141+0000","last_fullsized":"2024-03-04T13:10:02.496141+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:46:46.488545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"255'51","reported_seq":170,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.457681+0000","last_change":"2024-03-04T12:29:01.703695+0000","last_active":"2024-03-04T13:11:02.457681+0000","last_peered":"2024-03-04T13:11:02.457681+0000","last_clean":"2024-03-04T13:11:02.457681+0000","last_became_active":"2024-03-04T12:29:01.703361+0000","last_became_peered":"2024-03-04T12:29:01.703361+0000","last_unstale":"2024-03-04T13:11:02.457681+0000","last_undegraded":"2024-03-04T13:11:02.457681+0000","last_fullsized":"2024-03-04T13:11:02.457681+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:51:42.885870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":146,"num_write":83,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"253'1","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.458334+0000","last_change":"2024-03-04T12:46:22.255919+0000","last_active":"2024-03-04T13:11:07.458334+0000","last_peered":"2024-03-04T13:11:07.458334+0000","last_clean":"2024-03-04T13:11:07.458334+0000","last_became_active":"2024-03-04T12:46:22.255498+0000","last_became_peered":"2024-03-04T12:46:22.255498+0000","last_unstale":"2024-03-04T13:11:07.458334+0000","last_undegraded":"2024-03-04T13:11:07.458334+0000","last_fullsized":"2024-03-04T13:11:07.458334+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:36:32.059020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"255'2","reported_seq":43,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:17.459427+0000","last_change":"2024-03-04T12:32:46.059035+0000","last_active":"2024-03-04T13:13:17.459427+0000","last_peered":"2024-03-04T13:13:17.459427+0000","last_clean":"2024-03-04T13:13:17.459427+0000","last_became_active":"2024-03-04T12:32:46.058792+0000","last_became_peered":"2024-03-04T12:32:46.058792+0000","last_unstale":"2024-03-04T13:13:17.459427+0000","last_undegraded":"2024-03-04T13:13:17.459427+0000","last_fullsized":"2024-03-04T13:13:17.459427+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:04:32.439128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:57.360698+0000","last_change":"2024-03-04T12:32:42.036922+0000","last_active":"2024-03-04T13:10:57.360698+0000","last_peered":"2024-03-04T13:10:57.360698+0000","last_clean":"2024-03-04T13:10:57.360698+0000","last_became_active":"2024-03-04T12:32:42.036427+0000","last_became_peered":"2024-03-04T12:32:42.036427+0000","last_unstale":"2024-03-04T13:10:57.360698+0000","last_undegraded":"2024-03-04T13:10:57.360698+0000","last_fullsized":"2024-03-04T13:10:57.360698+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:03:27.512996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"255'56","reported_seq":177,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.349999+0000","last_change":"2024-03-04T12:29:01.706989+0000","last_active":"2024-03-04T13:09:42.349999+0000","last_peered":"2024-03-04T13:09:42.349999+0000","last_clean":"2024-03-04T13:09:42.349999+0000","last_became_active":"2024-03-04T12:29:01.706666+0000","last_became_peered":"2024-03-04T12:29:01.706666+0000","last_unstale":"2024-03-04T13:09:42.349999+0000","last_undegraded":"2024-03-04T13:09:42.349999+0000","last_fullsized":"2024-03-04T13:09:42.349999+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:53:35.119335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":151,"num_write":99,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.458356+0000","last_change":"2024-03-04T12:46:22.257205+0000","last_active":"2024-03-04T13:11:07.458356+0000","last_peered":"2024-03-04T13:11:07.458356+0000","last_clean":"2024-03-04T13:11:07.458356+0000","last_became_active":"2024-03-04T12:46:22.256882+0000","last_became_peered":"2024-03-04T12:46:22.256882+0000","last_unstale":"2024-03-04T13:11:07.458356+0000","last_undegraded":"2024-03-04T13:11:07.458356+0000","last_fullsized":"2024-03-04T13:11:07.458356+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:44:56.552546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":40,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.506364+0000","last_change":"2024-03-04T12:32:46.057344+0000","last_active":"2024-03-04T13:11:02.506364+0000","last_peered":"2024-03-04T13:11:02.506364+0000","last_clean":"2024-03-04T13:11:02.506364+0000","last_became_active":"2024-03-04T12:32:46.057079+0000","last_became_peered":"2024-03-04T12:32:46.057079+0000","last_unstale":"2024-03-04T13:11:02.506364+0000","last_undegraded":"2024-03-04T13:11:02.506364+0000","last_fullsized":"2024-03-04T13:11:02.506364+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:12:31.155909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"255'8","reported_seq":66,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:17.472607+0000","last_change":"2024-03-04T12:32:42.035815+0000","last_active":"2024-03-04T13:13:17.472607+0000","last_peered":"2024-03-04T13:13:17.472607+0000","last_clean":"2024-03-04T13:13:17.472607+0000","last_became_active":"2024-03-04T12:32:42.035488+0000","last_became_peered":"2024-03-04T12:32:42.035488+0000","last_unstale":"2024-03-04T13:13:17.472607+0000","last_undegraded":"2024-03-04T13:13:17.472607+0000","last_fullsized":"2024-03-04T13:13:17.472607+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:01.448566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"255'14","reported_seq":79,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.473534+0000","last_change":"2024-03-04T12:29:01.707068+0000","last_active":"2024-03-04T13:09:32.473534+0000","last_peered":"2024-03-04T13:09:32.473534+0000","last_clean":"2024-03-04T13:09:32.473534+0000","last_became_active":"2024-03-04T12:29:01.706786+0000","last_became_peered":"2024-03-04T12:29:01.706786+0000","last_unstale":"2024-03-04T13:09:32.473534+0000","last_undegraded":"2024-03-04T13:09:32.473534+0000","last_fullsized":"2024-03-04T13:09:32.473534+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:37.249442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.458370+0000","last_change":"2024-03-04T12:46:22.259694+0000","last_active":"2024-03-04T13:11:07.458370+0000","last_peered":"2024-03-04T13:11:07.458370+0000","last_clean":"2024-03-04T13:11:07.458370+0000","last_became_active":"2024-03-04T12:46:22.259400+0000","last_became_peered":"2024-03-04T12:46:22.259400+0000","last_unstale":"2024-03-04T13:11:07.458370+0000","last_undegraded":"2024-03-04T13:11:07.458370+0000","last_fullsized":"2024-03-04T13:11:07.458370+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:17:32.594215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.533195+0000","last_change":"2024-03-04T12:32:46.051598+0000","last_active":"2024-03-04T13:08:52.533195+0000","last_peered":"2024-03-04T13:08:52.533195+0000","last_clean":"2024-03-04T13:08:52.533195+0000","last_became_active":"2024-03-04T12:32:46.051318+0000","last_became_peered":"2024-03-04T12:32:46.051318+0000","last_unstale":"2024-03-04T13:08:52.533195+0000","last_undegraded":"2024-03-04T13:08:52.533195+0000","last_fullsized":"2024-03-04T13:08:52.533195+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:16.567127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"255'10","reported_seq":63,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.458916+0000","last_change":"2024-03-04T12:32:42.036135+0000","last_active":"2024-03-04T13:13:12.458916+0000","last_peered":"2024-03-04T13:13:12.458916+0000","last_clean":"2024-03-04T13:13:12.458916+0000","last_became_active":"2024-03-04T12:32:42.035743+0000","last_became_peered":"2024-03-04T12:32:42.035743+0000","last_unstale":"2024-03-04T13:13:12.458916+0000","last_undegraded":"2024-03-04T13:13:12.458916+0000","last_fullsized":"2024-03-04T13:13:12.458916+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:11:55.738398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9243,"num_write":20,"num_write_kb":10267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"255'55","reported_seq":187,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.491385+0000","last_change":"2024-03-04T12:29:01.702750+0000","last_active":"2024-03-04T13:09:32.491385+0000","last_peered":"2024-03-04T13:09:32.491385+0000","last_clean":"2024-03-04T13:09:32.491385+0000","last_became_active":"2024-03-04T12:29:01.700933+0000","last_became_peered":"2024-03-04T12:29:01.700933+0000","last_unstale":"2024-03-04T13:09:32.491385+0000","last_undegraded":"2024-03-04T13:09:32.491385+0000","last_fullsized":"2024-03-04T13:09:32.491385+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:59:22.963300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":175,"num_write":86,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:57.533702+0000","last_change":"2024-03-04T12:46:22.310324+0000","last_active":"2024-03-04T13:08:57.533702+0000","last_peered":"2024-03-04T13:08:57.533702+0000","last_clean":"2024-03-04T13:08:57.533702+0000","last_became_active":"2024-03-04T12:46:22.310043+0000","last_became_peered":"2024-03-04T12:46:22.310043+0000","last_unstale":"2024-03-04T13:08:57.533702+0000","last_undegraded":"2024-03-04T13:08:57.533702+0000","last_fullsized":"2024-03-04T13:08:57.533702+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:12:22.140057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"250'3","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.450776+0000","last_change":"2024-03-04T12:32:46.056965+0000","last_active":"2024-03-04T13:11:02.450776+0000","last_peered":"2024-03-04T13:11:02.450776+0000","last_clean":"2024-03-04T13:11:02.450776+0000","last_became_active":"2024-03-04T12:32:46.056687+0000","last_became_peered":"2024-03-04T12:32:46.056687+0000","last_unstale":"2024-03-04T13:11:02.450776+0000","last_undegraded":"2024-03-04T13:11:02.450776+0000","last_fullsized":"2024-03-04T13:11:02.450776+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:06.808040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:57.484624+0000","last_change":"2024-03-04T12:32:42.036985+0000","last_active":"2024-03-04T13:10:57.484624+0000","last_peered":"2024-03-04T13:10:57.484624+0000","last_clean":"2024-03-04T13:10:57.484624+0000","last_became_active":"2024-03-04T12:32:42.036690+0000","last_became_peered":"2024-03-04T12:32:42.036690+0000","last_unstale":"2024-03-04T13:10:57.484624+0000","last_undegraded":"2024-03-04T13:10:57.484624+0000","last_fullsized":"2024-03-04T13:10:57.484624+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:33:40.882885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"0'0","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.348453+0000","last_change":"2024-03-04T12:29:01.701088+0000","last_active":"2024-03-04T13:09:32.348453+0000","last_peered":"2024-03-04T13:09:32.348453+0000","last_clean":"2024-03-04T13:09:32.348453+0000","last_became_active":"2024-03-04T12:29:01.700739+0000","last_became_peered":"2024-03-04T12:29:01.700739+0000","last_unstale":"2024-03-04T13:09:32.348453+0000","last_undegraded":"2024-03-04T13:09:32.348453+0000","last_fullsized":"2024-03-04T13:09:32.348453+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:24:34.666643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497750+0000","last_change":"2024-03-04T12:46:22.308562+0000","last_active":"2024-03-04T13:10:12.497750+0000","last_peered":"2024-03-04T13:10:12.497750+0000","last_clean":"2024-03-04T13:10:12.497750+0000","last_became_active":"2024-03-04T12:46:22.308300+0000","last_became_peered":"2024-03-04T12:46:22.308300+0000","last_unstale":"2024-03-04T13:10:12.497750+0000","last_undegraded":"2024-03-04T13:10:12.497750+0000","last_fullsized":"2024-03-04T13:10:12.497750+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:44:03.273585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":40,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:37.538309+0000","last_change":"2024-03-04T12:32:46.051902+0000","last_active":"2024-03-04T13:09:37.538309+0000","last_peered":"2024-03-04T13:09:37.538309+0000","last_clean":"2024-03-04T13:09:37.538309+0000","last_became_active":"2024-03-04T12:32:46.051614+0000","last_became_peered":"2024-03-04T12:32:46.051614+0000","last_unstale":"2024-03-04T13:09:37.538309+0000","last_undegraded":"2024-03-04T13:09:37.538309+0000","last_fullsized":"2024-03-04T13:09:37.538309+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:43:57.663077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.492975+0000","last_change":"2024-03-04T12:32:42.033609+0000","last_active":"2024-03-04T13:09:42.492975+0000","last_peered":"2024-03-04T13:09:42.492975+0000","last_clean":"2024-03-04T13:09:42.492975+0000","last_became_active":"2024-03-04T12:32:42.033182+0000","last_became_peered":"2024-03-04T12:32:42.033182+0000","last_unstale":"2024-03-04T13:09:42.492975+0000","last_undegraded":"2024-03-04T13:09:42.492975+0000","last_fullsized":"2024-03-04T13:09:42.492975+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:21.548201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"250'41","reported_seq":160,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.537725+0000","last_change":"2024-03-04T12:29:01.709192+0000","last_active":"2024-03-04T13:09:32.537725+0000","last_peered":"2024-03-04T13:09:32.537725+0000","last_clean":"2024-03-04T13:09:32.537725+0000","last_became_active":"2024-03-04T12:29:01.708876+0000","last_became_peered":"2024-03-04T12:29:01.708876+0000","last_unstale":"2024-03-04T13:09:32.537725+0000","last_undegraded":"2024-03-04T13:09:32.537725+0000","last_fullsized":"2024-03-04T13:09:32.537725+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:14:35.685901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":148,"num_write":55,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497742+0000","last_change":"2024-03-04T12:46:22.256922+0000","last_active":"2024-03-04T13:10:12.497742+0000","last_peered":"2024-03-04T13:10:12.497742+0000","last_clean":"2024-03-04T13:10:12.497742+0000","last_became_active":"2024-03-04T12:46:22.256617+0000","last_became_peered":"2024-03-04T12:46:22.256617+0000","last_unstale":"2024-03-04T13:10:12.497742+0000","last_undegraded":"2024-03-04T13:10:12.497742+0000","last_fullsized":"2024-03-04T13:10:12.497742+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:16:12.469482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"250'2","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:37.441469+0000","last_change":"2024-03-04T12:32:46.055551+0000","last_active":"2024-03-04T13:09:37.441469+0000","last_peered":"2024-03-04T13:09:37.441469+0000","last_clean":"2024-03-04T13:09:37.441469+0000","last_became_active":"2024-03-04T12:32:46.055321+0000","last_became_peered":"2024-03-04T12:32:46.055321+0000","last_unstale":"2024-03-04T13:09:37.441469+0000","last_undegraded":"2024-03-04T13:09:37.441469+0000","last_fullsized":"2024-03-04T13:09:37.441469+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:16.410422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"250'5","reported_seq":57,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:57.450237+0000","last_change":"2024-03-04T12:32:42.030944+0000","last_active":"2024-03-04T13:10:57.450237+0000","last_peered":"2024-03-04T13:10:57.450237+0000","last_clean":"2024-03-04T13:10:57.450237+0000","last_became_active":"2024-03-04T12:32:42.030512+0000","last_became_peered":"2024-03-04T12:32:42.030512+0000","last_unstale":"2024-03-04T13:10:57.450237+0000","last_undegraded":"2024-03-04T13:10:57.450237+0000","last_fullsized":"2024-03-04T13:10:57.450237+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:20.706121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"255'57","reported_seq":188,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.440412+0000","last_change":"2024-03-04T12:29:01.699812+0000","last_active":"2024-03-04T13:10:17.440412+0000","last_peered":"2024-03-04T13:10:17.440412+0000","last_clean":"2024-03-04T13:10:17.440412+0000","last_became_active":"2024-03-04T12:29:01.699507+0000","last_became_peered":"2024-03-04T12:29:01.699507+0000","last_unstale":"2024-03-04T13:10:17.440412+0000","last_undegraded":"2024-03-04T13:10:17.440412+0000","last_fullsized":"2024-03-04T13:10:17.440412+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:16:54.424195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":165,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498707+0000","last_change":"2024-03-04T12:46:22.256492+0000","last_active":"2024-03-04T13:10:17.498707+0000","last_peered":"2024-03-04T13:10:17.498707+0000","last_clean":"2024-03-04T13:10:17.498707+0000","last_became_active":"2024-03-04T12:46:22.256181+0000","last_became_peered":"2024-03-04T12:46:22.256181+0000","last_unstale":"2024-03-04T13:10:17.498707+0000","last_undegraded":"2024-03-04T13:10:17.498707+0000","last_fullsized":"2024-03-04T13:10:17.498707+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:08:40.855920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"255'8","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:17.530463+0000","last_change":"2024-03-04T12:32:46.045905+0000","last_active":"2024-03-04T13:13:17.530463+0000","last_peered":"2024-03-04T13:13:17.530463+0000","last_clean":"2024-03-04T13:13:17.530463+0000","last_became_active":"2024-03-04T12:32:46.045552+0000","last_became_peered":"2024-03-04T12:32:46.045552+0000","last_unstale":"2024-03-04T13:13:17.530463+0000","last_undegraded":"2024-03-04T13:13:17.530463+0000","last_fullsized":"2024-03-04T13:13:17.530463+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:26:04.913934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.473463+0000","last_change":"2024-03-04T12:32:42.036672+0000","last_active":"2024-03-04T13:09:32.473463+0000","last_peered":"2024-03-04T13:09:32.473463+0000","last_clean":"2024-03-04T13:09:32.473463+0000","last_became_active":"2024-03-04T12:32:42.035436+0000","last_became_peered":"2024-03-04T12:32:42.035436+0000","last_unstale":"2024-03-04T13:09:32.473463+0000","last_undegraded":"2024-03-04T13:09:32.473463+0000","last_fullsized":"2024-03-04T13:09:32.473463+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:12.296339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"255'54","reported_seq":179,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.439926+0000","last_change":"2024-03-04T12:29:01.705876+0000","last_active":"2024-03-04T13:10:12.439926+0000","last_peered":"2024-03-04T13:10:12.439926+0000","last_clean":"2024-03-04T13:10:12.439926+0000","last_became_active":"2024-03-04T12:29:01.704434+0000","last_became_peered":"2024-03-04T12:29:01.704434+0000","last_unstale":"2024-03-04T13:10:12.439926+0000","last_undegraded":"2024-03-04T13:10:12.439926+0000","last_fullsized":"2024-03-04T13:10:12.439926+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:09:02.530451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":154,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.533144+0000","last_change":"2024-03-04T12:46:22.257771+0000","last_active":"2024-03-04T13:08:52.533144+0000","last_peered":"2024-03-04T13:08:52.533144+0000","last_clean":"2024-03-04T13:08:52.533144+0000","last_became_active":"2024-03-04T12:46:22.257495+0000","last_became_peered":"2024-03-04T12:46:22.257495+0000","last_unstale":"2024-03-04T13:08:52.533144+0000","last_undegraded":"2024-03-04T13:08:52.533144+0000","last_fullsized":"2024-03-04T13:08:52.533144+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:35:28.573364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"255'3","reported_seq":43,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:52.456356+0000","last_change":"2024-03-04T12:32:46.057285+0000","last_active":"2024-03-04T13:11:52.456356+0000","last_peered":"2024-03-04T13:11:52.456356+0000","last_clean":"2024-03-04T13:11:52.456356+0000","last_became_active":"2024-03-04T12:32:46.056737+0000","last_became_peered":"2024-03-04T12:32:46.056737+0000","last_unstale":"2024-03-04T13:11:52.456356+0000","last_undegraded":"2024-03-04T13:11:52.456356+0000","last_fullsized":"2024-03-04T13:11:52.456356+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:23:08.710392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.447462+0000","last_change":"2024-03-04T12:32:42.029327+0000","last_active":"2024-03-04T13:09:32.447462+0000","last_peered":"2024-03-04T13:09:32.447462+0000","last_clean":"2024-03-04T13:09:32.447462+0000","last_became_active":"2024-03-04T12:32:42.029043+0000","last_became_peered":"2024-03-04T12:32:42.029043+0000","last_unstale":"2024-03-04T13:09:32.447462+0000","last_undegraded":"2024-03-04T13:09:32.447462+0000","last_fullsized":"2024-03-04T13:09:32.447462+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:27:12.022258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"255'45","reported_seq":156,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.478783+0000","last_change":"2024-03-04T12:29:01.702439+0000","last_active":"2024-03-04T13:10:12.478783+0000","last_peered":"2024-03-04T13:10:12.478783+0000","last_clean":"2024-03-04T13:10:12.478783+0000","last_became_active":"2024-03-04T12:29:01.702146+0000","last_became_peered":"2024-03-04T12:29:01.702146+0000","last_unstale":"2024-03-04T13:10:12.478783+0000","last_undegraded":"2024-03-04T13:10:12.478783+0000","last_fullsized":"2024-03-04T13:10:12.478783+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:16:58.177901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":123,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:17.438909+0000","last_change":"2024-03-04T12:46:22.311207+0000","last_active":"2024-03-04T13:09:17.438909+0000","last_peered":"2024-03-04T13:09:17.438909+0000","last_clean":"2024-03-04T13:09:17.438909+0000","last_became_active":"2024-03-04T12:46:22.310830+0000","last_became_peered":"2024-03-04T12:46:22.310830+0000","last_unstale":"2024-03-04T13:09:17.438909+0000","last_undegraded":"2024-03-04T13:09:17.438909+0000","last_fullsized":"2024-03-04T13:09:17.438909+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:24:30.083017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"255'2","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.454246+0000","last_change":"2024-03-04T12:32:46.058735+0000","last_active":"2024-03-04T13:12:27.454246+0000","last_peered":"2024-03-04T13:12:27.454246+0000","last_clean":"2024-03-04T13:12:27.454246+0000","last_became_active":"2024-03-04T12:32:46.058306+0000","last_became_peered":"2024-03-04T12:32:46.058306+0000","last_unstale":"2024-03-04T13:12:27.454246+0000","last_undegraded":"2024-03-04T13:12:27.454246+0000","last_fullsized":"2024-03-04T13:12:27.454246+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:23.146488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"255'5","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.995332+0000","last_change":"2024-03-04T12:32:42.035623+0000","last_active":"2024-03-04T13:13:20.995332+0000","last_peered":"2024-03-04T13:13:20.995332+0000","last_clean":"2024-03-04T13:13:20.995332+0000","last_became_active":"2024-03-04T12:32:42.035302+0000","last_became_peered":"2024-03-04T12:32:42.035302+0000","last_unstale":"2024-03-04T13:13:20.995332+0000","last_undegraded":"2024-03-04T13:13:20.995332+0000","last_fullsized":"2024-03-04T13:13:20.995332+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:30:11.132509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6192,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"255'41","reported_seq":154,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.439984+0000","last_change":"2024-03-04T12:29:01.707171+0000","last_active":"2024-03-04T13:10:12.439984+0000","last_peered":"2024-03-04T13:10:12.439984+0000","last_clean":"2024-03-04T13:10:12.439984+0000","last_became_active":"2024-03-04T12:29:01.706897+0000","last_became_peered":"2024-03-04T12:29:01.706897+0000","last_unstale":"2024-03-04T13:10:12.439984+0000","last_undegraded":"2024-03-04T13:10:12.439984+0000","last_fullsized":"2024-03-04T13:10:12.439984+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:46:21.234572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":127,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.439467+0000","last_change":"2024-03-04T12:46:22.253306+0000","last_active":"2024-03-04T13:09:22.439467+0000","last_peered":"2024-03-04T13:09:22.439467+0000","last_clean":"2024-03-04T13:09:22.439467+0000","last_became_active":"2024-03-04T12:46:22.252955+0000","last_became_peered":"2024-03-04T12:46:22.252955+0000","last_unstale":"2024-03-04T13:09:22.439467+0000","last_undegraded":"2024-03-04T13:09:22.439467+0000","last_fullsized":"2024-03-04T13:09:22.439467+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:46:23.427621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"255'11","reported_seq":63,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.183394+0000","last_change":"2024-03-04T12:32:46.056590+0000","last_active":"2024-03-04T13:13:21.183394+0000","last_peered":"2024-03-04T13:13:21.183394+0000","last_clean":"2024-03-04T13:13:21.183394+0000","last_became_active":"2024-03-04T12:32:46.056219+0000","last_became_peered":"2024-03-04T12:32:46.056219+0000","last_unstale":"2024-03-04T13:13:21.183394+0000","last_undegraded":"2024-03-04T13:13:21.183394+0000","last_fullsized":"2024-03-04T13:13:21.183394+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:43.098655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25600,"num_write":16,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"255'8","reported_seq":60,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.996709+0000","last_change":"2024-03-04T12:32:42.034819+0000","last_active":"2024-03-04T13:13:20.996709+0000","last_peered":"2024-03-04T13:13:20.996709+0000","last_clean":"2024-03-04T13:13:20.996709+0000","last_became_active":"2024-03-04T12:32:42.034556+0000","last_became_peered":"2024-03-04T12:32:42.034556+0000","last_unstale":"2024-03-04T13:13:20.996709+0000","last_undegraded":"2024-03-04T13:13:20.996709+0000","last_fullsized":"2024-03-04T13:13:20.996709+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:27.683103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12328,"num_write":8,"num_write_kb":12328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"255'42","reported_seq":147,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497950+0000","last_change":"2024-03-04T12:29:01.706878+0000","last_active":"2024-03-04T13:10:12.497950+0000","last_peered":"2024-03-04T13:10:12.497950+0000","last_clean":"2024-03-04T13:10:12.497950+0000","last_became_active":"2024-03-04T12:29:01.706549+0000","last_became_peered":"2024-03-04T12:29:01.706549+0000","last_unstale":"2024-03-04T13:10:12.497950+0000","last_undegraded":"2024-03-04T13:10:12.497950+0000","last_fullsized":"2024-03-04T13:10:12.497950+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:52:21.965189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":111,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"252'1","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497886+0000","last_change":"2024-03-04T12:46:22.254600+0000","last_active":"2024-03-04T13:10:12.497886+0000","last_peered":"2024-03-04T13:10:12.497886+0000","last_clean":"2024-03-04T13:10:12.497886+0000","last_became_active":"2024-03-04T12:46:22.254303+0000","last_became_peered":"2024-03-04T12:46:22.254303+0000","last_unstale":"2024-03-04T13:10:12.497886+0000","last_undegraded":"2024-03-04T13:10:12.497886+0000","last_fullsized":"2024-03-04T13:10:12.497886+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:56:13.243949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"255'3","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:47.514375+0000","last_change":"2024-03-04T12:32:46.055817+0000","last_active":"2024-03-04T13:11:47.514375+0000","last_peered":"2024-03-04T13:11:47.514375+0000","last_clean":"2024-03-04T13:11:47.514375+0000","last_became_active":"2024-03-04T12:32:46.055497+0000","last_became_peered":"2024-03-04T12:32:46.055497+0000","last_unstale":"2024-03-04T13:11:47.514375+0000","last_undegraded":"2024-03-04T13:11:47.514375+0000","last_fullsized":"2024-03-04T13:11:47.514375+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:51:26.771686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.542388+0000","last_change":"2024-03-04T12:32:42.036436+0000","last_active":"2024-03-04T13:10:12.542388+0000","last_peered":"2024-03-04T13:10:12.542388+0000","last_clean":"2024-03-04T13:10:12.542388+0000","last_became_active":"2024-03-04T12:32:42.036150+0000","last_became_peered":"2024-03-04T12:32:42.036150+0000","last_unstale":"2024-03-04T13:10:12.542388+0000","last_undegraded":"2024-03-04T13:10:12.542388+0000","last_fullsized":"2024-03-04T13:10:12.542388+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:31:48.514077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"255'68","reported_seq":270,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:52.360028+0000","last_change":"2024-03-04T12:29:01.700959+0000","last_active":"2024-03-04T13:10:52.360028+0000","last_peered":"2024-03-04T13:10:52.360028+0000","last_clean":"2024-03-04T13:10:52.360028+0000","last_became_active":"2024-03-04T12:29:01.700624+0000","last_became_peered":"2024-03-04T12:29:01.700624+0000","last_unstale":"2024-03-04T13:10:52.360028+0000","last_undegraded":"2024-03-04T13:10:52.360028+0000","last_fullsized":"2024-03-04T13:10:52.360028+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:04.670734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":295,"num_write":88,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497975+0000","last_change":"2024-03-04T12:46:22.309757+0000","last_active":"2024-03-04T13:10:12.497975+0000","last_peered":"2024-03-04T13:10:12.497975+0000","last_clean":"2024-03-04T13:10:12.497975+0000","last_became_active":"2024-03-04T12:46:22.309493+0000","last_became_peered":"2024-03-04T12:46:22.309493+0000","last_unstale":"2024-03-04T13:10:12.497975+0000","last_undegraded":"2024-03-04T13:10:12.497975+0000","last_fullsized":"2024-03-04T13:10:12.497975+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:56.850351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"255'10","reported_seq":61,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.190787+0000","last_change":"2024-03-04T12:32:46.054533+0000","last_active":"2024-03-04T13:13:21.190787+0000","last_peered":"2024-03-04T13:13:21.190787+0000","last_clean":"2024-03-04T13:13:21.190787+0000","last_became_active":"2024-03-04T12:32:46.054256+0000","last_became_peered":"2024-03-04T12:32:46.054256+0000","last_unstale":"2024-03-04T13:13:21.190787+0000","last_undegraded":"2024-03-04T13:13:21.190787+0000","last_fullsized":"2024-03-04T13:13:21.190787+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:56:03.550607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":16480,"num_write":15,"num_write_kb":11320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499619+0000","last_change":"2024-03-04T12:32:42.035988+0000","last_active":"2024-03-04T13:10:22.499619+0000","last_peered":"2024-03-04T13:10:22.499619+0000","last_clean":"2024-03-04T13:10:22.499619+0000","last_became_active":"2024-03-04T12:32:42.035683+0000","last_became_peered":"2024-03-04T12:32:42.035683+0000","last_unstale":"2024-03-04T13:10:22.499619+0000","last_undegraded":"2024-03-04T13:10:22.499619+0000","last_fullsized":"2024-03-04T13:10:22.499619+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:02:00.359791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"255'43","reported_seq":144,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.503035+0000","last_change":"2024-03-04T12:29:01.701803+0000","last_active":"2024-03-04T13:10:42.503035+0000","last_peered":"2024-03-04T13:10:42.503035+0000","last_clean":"2024-03-04T13:10:42.503035+0000","last_became_active":"2024-03-04T12:29:01.701396+0000","last_became_peered":"2024-03-04T12:29:01.701396+0000","last_unstale":"2024-03-04T13:10:42.503035+0000","last_undegraded":"2024-03-04T13:10:42.503035+0000","last_fullsized":"2024-03-04T13:10:42.503035+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:53:53.242346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.356344+0000","last_change":"2024-03-04T12:46:22.260088+0000","last_active":"2024-03-04T13:10:27.356344+0000","last_peered":"2024-03-04T13:10:27.356344+0000","last_clean":"2024-03-04T13:10:27.356344+0000","last_became_active":"2024-03-04T12:46:22.259763+0000","last_became_peered":"2024-03-04T12:46:22.259763+0000","last_unstale":"2024-03-04T13:10:27.356344+0000","last_undegraded":"2024-03-04T13:10:27.356344+0000","last_fullsized":"2024-03-04T13:10:27.356344+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:33.450477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"255'5","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.032505+0000","last_change":"2024-03-04T12:32:46.057881+0000","last_active":"2024-03-04T13:13:21.032505+0000","last_peered":"2024-03-04T13:13:21.032505+0000","last_clean":"2024-03-04T13:13:21.032505+0000","last_became_active":"2024-03-04T12:32:46.057646+0000","last_became_peered":"2024-03-04T12:32:46.057646+0000","last_unstale":"2024-03-04T13:13:21.032505+0000","last_undegraded":"2024-03-04T13:13:21.032505+0000","last_fullsized":"2024-03-04T13:13:21.032505+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:26:52.859284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5168,"num_write":5,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"255'2","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:17.519439+0000","last_change":"2024-03-04T12:32:42.027057+0000","last_active":"2024-03-04T13:12:17.519439+0000","last_peered":"2024-03-04T13:12:17.519439+0000","last_clean":"2024-03-04T13:12:17.519439+0000","last_became_active":"2024-03-04T12:32:42.026771+0000","last_became_peered":"2024-03-04T12:32:42.026771+0000","last_unstale":"2024-03-04T13:12:17.519439+0000","last_undegraded":"2024-03-04T13:12:17.519439+0000","last_fullsized":"2024-03-04T13:12:17.519439+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:49:21.026487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"255'43","reported_seq":153,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.455774+0000","last_change":"2024-03-04T12:29:01.702097+0000","last_active":"2024-03-04T13:10:42.455774+0000","last_peered":"2024-03-04T13:10:42.455774+0000","last_clean":"2024-03-04T13:10:42.455774+0000","last_became_active":"2024-03-04T12:29:01.701812+0000","last_became_peered":"2024-03-04T12:29:01.701812+0000","last_unstale":"2024-03-04T13:10:42.455774+0000","last_undegraded":"2024-03-04T13:10:42.455774+0000","last_fullsized":"2024-03-04T13:10:42.455774+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:59:24.881817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":121,"num_write":82,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:17.535979+0000","last_change":"2024-03-04T12:46:22.247949+0000","last_active":"2024-03-04T13:09:17.535979+0000","last_peered":"2024-03-04T13:09:17.535979+0000","last_clean":"2024-03-04T13:09:17.535979+0000","last_became_active":"2024-03-04T12:46:22.247655+0000","last_became_peered":"2024-03-04T12:46:22.247655+0000","last_unstale":"2024-03-04T13:09:17.535979+0000","last_undegraded":"2024-03-04T13:09:17.535979+0000","last_fullsized":"2024-03-04T13:09:17.535979+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:28.814124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"255'3","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.526860+0000","last_change":"2024-03-04T12:32:46.058700+0000","last_active":"2024-03-04T13:12:57.526860+0000","last_peered":"2024-03-04T13:12:57.526860+0000","last_clean":"2024-03-04T13:12:57.526860+0000","last_became_active":"2024-03-04T12:32:46.058466+0000","last_became_peered":"2024-03-04T12:32:46.058466+0000","last_unstale":"2024-03-04T13:12:57.526860+0000","last_undegraded":"2024-03-04T13:12:57.526860+0000","last_fullsized":"2024-03-04T13:12:57.526860+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:45:44.721969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.354089+0000","last_change":"2024-03-04T12:32:42.031684+0000","last_active":"2024-03-04T13:10:12.354089+0000","last_peered":"2024-03-04T13:10:12.354089+0000","last_clean":"2024-03-04T13:10:12.354089+0000","last_became_active":"2024-03-04T12:32:42.031410+0000","last_became_peered":"2024-03-04T12:32:42.031410+0000","last_unstale":"2024-03-04T13:10:12.354089+0000","last_undegraded":"2024-03-04T13:10:12.354089+0000","last_fullsized":"2024-03-04T13:10:12.354089+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:20:00.365398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"255'27","reported_seq":115,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.482916+0000","last_change":"2024-03-04T12:29:01.703669+0000","last_active":"2024-03-04T13:10:42.482916+0000","last_peered":"2024-03-04T13:10:42.482916+0000","last_clean":"2024-03-04T13:10:42.482916+0000","last_became_active":"2024-03-04T12:29:01.703420+0000","last_became_peered":"2024-03-04T12:29:01.703420+0000","last_unstale":"2024-03-04T13:10:42.482916+0000","last_undegraded":"2024-03-04T13:10:42.482916+0000","last_fullsized":"2024-03-04T13:10:42.482916+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:31:39.634520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":74,"num_write":42,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:17.489139+0000","last_change":"2024-03-04T12:46:22.250162+0000","last_active":"2024-03-04T13:09:17.489139+0000","last_peered":"2024-03-04T13:09:17.489139+0000","last_clean":"2024-03-04T13:09:17.489139+0000","last_became_active":"2024-03-04T12:46:22.249854+0000","last_became_peered":"2024-03-04T12:46:22.249854+0000","last_unstale":"2024-03-04T13:09:17.489139+0000","last_undegraded":"2024-03-04T13:09:17.489139+0000","last_fullsized":"2024-03-04T13:09:17.489139+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:41:19.298108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":41,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.479555+0000","last_change":"2024-03-04T12:32:46.051913+0000","last_active":"2024-03-04T13:10:17.479555+0000","last_peered":"2024-03-04T13:10:17.479555+0000","last_clean":"2024-03-04T13:10:17.479555+0000","last_became_active":"2024-03-04T12:32:46.051498+0000","last_became_peered":"2024-03-04T12:32:46.051498+0000","last_unstale":"2024-03-04T13:10:17.479555+0000","last_undegraded":"2024-03-04T13:10:17.479555+0000","last_fullsized":"2024-03-04T13:10:17.479555+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:31:49.935678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"255'6","reported_seq":61,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:52.525983+0000","last_change":"2024-03-04T12:32:42.038655+0000","last_active":"2024-03-04T13:12:52.525983+0000","last_peered":"2024-03-04T13:12:52.525983+0000","last_clean":"2024-03-04T13:12:52.525983+0000","last_became_active":"2024-03-04T12:32:42.038349+0000","last_became_peered":"2024-03-04T12:32:42.038349+0000","last_unstale":"2024-03-04T13:12:52.525983+0000","last_undegraded":"2024-03-04T13:12:52.525983+0000","last_fullsized":"2024-03-04T13:12:52.525983+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:35:57.593667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"255'90","reported_seq":258,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.358360+0000","last_change":"2024-03-04T12:29:01.701552+0000","last_active":"2024-03-04T13:10:42.358360+0000","last_peered":"2024-03-04T13:10:42.358360+0000","last_clean":"2024-03-04T13:10:42.358360+0000","last_became_active":"2024-03-04T12:29:01.701282+0000","last_became_peered":"2024-03-04T12:29:01.701282+0000","last_unstale":"2024-03-04T13:10:42.358360+0000","last_undegraded":"2024-03-04T13:10:42.358360+0000","last_fullsized":"2024-03-04T13:10:42.358360+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:31:15.249708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":354,"num_read_kb":252,"num_write":156,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:17.471339+0000","last_change":"2024-03-04T12:46:22.259364+0000","last_active":"2024-03-04T13:09:17.471339+0000","last_peered":"2024-03-04T13:09:17.471339+0000","last_clean":"2024-03-04T13:09:17.471339+0000","last_became_active":"2024-03-04T12:46:22.258936+0000","last_became_peered":"2024-03-04T12:46:22.258936+0000","last_unstale":"2024-03-04T13:09:17.471339+0000","last_undegraded":"2024-03-04T13:09:17.471339+0000","last_fullsized":"2024-03-04T13:09:17.471339+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:15:52.268943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":41,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.542901+0000","last_change":"2024-03-04T12:32:46.053786+0000","last_active":"2024-03-04T13:10:17.542901+0000","last_peered":"2024-03-04T13:10:17.542901+0000","last_clean":"2024-03-04T13:10:17.542901+0000","last_became_active":"2024-03-04T12:32:46.053456+0000","last_became_peered":"2024-03-04T12:32:46.053456+0000","last_unstale":"2024-03-04T13:10:17.542901+0000","last_undegraded":"2024-03-04T13:10:17.542901+0000","last_fullsized":"2024-03-04T13:10:17.542901+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:10.231648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.478815+0000","last_change":"2024-03-04T12:32:42.035705+0000","last_active":"2024-03-04T13:10:12.478815+0000","last_peered":"2024-03-04T13:10:12.478815+0000","last_clean":"2024-03-04T13:10:12.478815+0000","last_became_active":"2024-03-04T12:32:42.035413+0000","last_became_peered":"2024-03-04T12:32:42.035413+0000","last_unstale":"2024-03-04T13:10:12.478815+0000","last_undegraded":"2024-03-04T13:10:12.478815+0000","last_fullsized":"2024-03-04T13:10:12.478815+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:30:04.933989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"255'17","reported_seq":94,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.445657+0000","last_change":"2024-03-04T12:29:01.702839+0000","last_active":"2024-03-04T13:11:07.445657+0000","last_peered":"2024-03-04T13:11:07.445657+0000","last_clean":"2024-03-04T13:11:07.445657+0000","last_became_active":"2024-03-04T12:29:01.702555+0000","last_became_peered":"2024-03-04T12:29:01.702555+0000","last_unstale":"2024-03-04T13:11:07.445657+0000","last_undegraded":"2024-03-04T13:11:07.445657+0000","last_fullsized":"2024-03-04T13:11:07.445657+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:55:13.316774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":47,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"255'178","reported_seq":782,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.182995+0000","last_change":"2024-03-04T12:20:14.820927+0000","last_active":"2024-03-04T13:13:21.182995+0000","last_peered":"2024-03-04T13:13:21.182995+0000","last_clean":"2024-03-04T13:13:21.182995+0000","last_became_active":"2024-03-04T12:20:14.820595+0000","last_became_peered":"2024-03-04T12:20:14.820595+0000","last_unstale":"2024-03-04T13:13:21.182995+0000","last_undegraded":"2024-03-04T13:13:21.182995+0000","last_fullsized":"2024-03-04T13:13:21.182995+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:07:18.920479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":457,"num_write":1012,"num_write_kb":11218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"255'475","reported_seq":1778,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.976981+0000","last_change":"2024-03-04T12:20:16.828823+0000","last_active":"2024-03-04T13:12:36.976981+0000","last_peered":"2024-03-04T13:12:36.976981+0000","last_clean":"2024-03-04T13:12:36.976981+0000","last_became_active":"2024-03-04T12:20:16.828539+0000","last_became_peered":"2024-03-04T12:20:16.828539+0000","last_unstale":"2024-03-04T13:12:36.976981+0000","last_undegraded":"2024-03-04T13:12:36.976981+0000","last_fullsized":"2024-03-04T13:12:36.976981+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:22:24.173643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2301,"num_read_kb":2121,"num_write":643,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"255'219","reported_seq":869,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:35.776295+0000","last_change":"2024-03-04T12:20:14.815583+0000","last_active":"2024-03-04T13:12:35.776295+0000","last_peered":"2024-03-04T13:12:35.776295+0000","last_clean":"2024-03-04T13:12:35.776295+0000","last_became_active":"2024-03-04T12:20:14.814863+0000","last_became_peered":"2024-03-04T12:20:14.814863+0000","last_unstale":"2024-03-04T13:12:35.776295+0000","last_undegraded":"2024-03-04T13:12:35.776295+0000","last_fullsized":"2024-03-04T13:12:35.776295+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:13:54.813411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9034256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":516,"num_read_kb":15449,"num_write":1322,"num_write_kb":40818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"255'559","reported_seq":1909,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573307+0000","last_change":"2024-03-04T12:20:16.837515+0000","last_active":"2024-03-04T13:12:50.573307+0000","last_peered":"2024-03-04T13:12:50.573307+0000","last_clean":"2024-03-04T13:12:50.573307+0000","last_became_active":"2024-03-04T12:20:16.837200+0000","last_became_peered":"2024-03-04T12:20:16.837200+0000","last_unstale":"2024-03-04T13:12:50.573307+0000","last_undegraded":"2024-03-04T13:12:50.573307+0000","last_fullsized":"2024-03-04T13:12:50.573307+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:27.972671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2594,"num_read_kb":2289,"num_write":764,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"255'155","reported_seq":747,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.163314+0000","last_change":"2024-03-04T12:20:14.816919+0000","last_active":"2024-03-04T13:13:21.163314+0000","last_peered":"2024-03-04T13:13:21.163314+0000","last_clean":"2024-03-04T13:13:21.163314+0000","last_became_active":"2024-03-04T12:20:14.816597+0000","last_became_peered":"2024-03-04T12:20:14.816597+0000","last_unstale":"2024-03-04T13:13:21.163314+0000","last_undegraded":"2024-03-04T13:13:21.163314+0000","last_fullsized":"2024-03-04T13:13:21.163314+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:22:06.737898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":326,"num_read_kb":1168,"num_write":917,"num_write_kb":5749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"255'452","reported_seq":1950,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:08.259447+0000","last_change":"2024-03-04T12:20:16.821071+0000","last_active":"2024-03-04T13:12:08.259447+0000","last_peered":"2024-03-04T13:12:08.259447+0000","last_clean":"2024-03-04T13:12:08.259447+0000","last_became_active":"2024-03-04T12:20:16.820419+0000","last_became_peered":"2024-03-04T12:20:16.820419+0000","last_unstale":"2024-03-04T13:12:08.259447+0000","last_undegraded":"2024-03-04T13:12:08.259447+0000","last_fullsized":"2024-03-04T13:12:08.259447+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:43.521050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2318,"num_read_kb":2161,"num_write":537,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"255'245","reported_seq":882,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.373607+0000","last_change":"2024-03-04T12:20:14.826502+0000","last_active":"2024-03-04T13:12:27.373607+0000","last_peered":"2024-03-04T13:12:27.373607+0000","last_clean":"2024-03-04T13:12:27.373607+0000","last_became_active":"2024-03-04T12:20:14.824779+0000","last_became_peered":"2024-03-04T12:20:14.824779+0000","last_unstale":"2024-03-04T13:12:27.373607+0000","last_undegraded":"2024-03-04T13:12:27.373607+0000","last_fullsized":"2024-03-04T13:12:27.373607+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:29.747512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4160401,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":13558,"num_write":1376,"num_write_kb":36455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"255'351","reported_seq":1793,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.327892+0000","last_change":"2024-03-04T12:20:16.828116+0000","last_active":"2024-03-04T13:12:39.327892+0000","last_peered":"2024-03-04T13:12:39.327892+0000","last_clean":"2024-03-04T13:12:39.327892+0000","last_became_active":"2024-03-04T12:20:16.827613+0000","last_became_peered":"2024-03-04T12:20:16.827613+0000","last_unstale":"2024-03-04T13:12:39.327892+0000","last_undegraded":"2024-03-04T13:12:39.327892+0000","last_fullsized":"2024-03-04T13:12:39.327892+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:56:19.430664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1915,"num_read_kb":1843,"num_write":383,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"255'195","reported_seq":834,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.096823+0000","last_change":"2024-03-04T12:20:14.816830+0000","last_active":"2024-03-04T13:13:21.096823+0000","last_peered":"2024-03-04T13:13:21.096823+0000","last_clean":"2024-03-04T13:13:21.096823+0000","last_became_active":"2024-03-04T12:20:14.816532+0000","last_became_peered":"2024-03-04T12:20:14.816532+0000","last_unstale":"2024-03-04T13:13:21.096823+0000","last_undegraded":"2024-03-04T13:13:21.096823+0000","last_fullsized":"2024-03-04T13:13:21.096823+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:37:37.790276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5789792,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":440,"num_read_kb":58154,"num_write":1069,"num_write_kb":58795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"255'405","reported_seq":2045,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.099180+0000","last_change":"2024-03-04T12:20:16.816980+0000","last_active":"2024-03-04T13:12:31.099180+0000","last_peered":"2024-03-04T13:12:31.099180+0000","last_clean":"2024-03-04T13:12:31.099180+0000","last_became_active":"2024-03-04T12:20:16.816688+0000","last_became_peered":"2024-03-04T12:20:16.816688+0000","last_unstale":"2024-03-04T13:12:31.099180+0000","last_undegraded":"2024-03-04T13:12:31.099180+0000","last_fullsized":"2024-03-04T13:12:31.099180+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:36:29.402179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2407,"num_read_kb":2304,"num_write":479,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"255'170","reported_seq":750,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.063180+0000","last_change":"2024-03-04T12:20:51.031065+0000","last_active":"2024-03-04T13:12:12.063180+0000","last_peered":"2024-03-04T13:12:12.063180+0000","last_clean":"2024-03-04T13:12:12.063180+0000","last_became_active":"2024-03-04T12:20:51.030709+0000","last_became_peered":"2024-03-04T12:20:51.030709+0000","last_unstale":"2024-03-04T13:12:12.063180+0000","last_undegraded":"2024-03-04T13:12:12.063180+0000","last_fullsized":"2024-03-04T13:12:12.063180+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:16:42.363646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13826798,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":359,"num_read_kb":29477,"num_write":994,"num_write_kb":29693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"255'775","reported_seq":2153,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.309100+0000","last_change":"2024-03-04T12:20:16.825330+0000","last_active":"2024-03-04T13:12:39.309100+0000","last_peered":"2024-03-04T13:12:39.309100+0000","last_clean":"2024-03-04T13:12:39.309100+0000","last_became_active":"2024-03-04T12:20:16.822282+0000","last_became_peered":"2024-03-04T12:20:16.822282+0000","last_unstale":"2024-03-04T13:12:39.309100+0000","last_undegraded":"2024-03-04T13:12:39.309100+0000","last_fullsized":"2024-03-04T13:12:39.309100+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:56:51.893473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3372,"num_read_kb":2974,"num_write":1065,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"255'195","reported_seq":826,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.101704+0000","last_change":"2024-03-04T12:20:14.815689+0000","last_active":"2024-03-04T13:13:21.101704+0000","last_peered":"2024-03-04T13:13:21.101704+0000","last_clean":"2024-03-04T13:13:21.101704+0000","last_became_active":"2024-03-04T12:20:14.815388+0000","last_became_peered":"2024-03-04T12:20:14.815388+0000","last_unstale":"2024-03-04T13:13:21.101704+0000","last_undegraded":"2024-03-04T13:13:21.101704+0000","last_fullsized":"2024-03-04T13:13:21.101704+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:43:25.448300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262238,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":61923,"num_write":1063,"num_write_kb":47041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"255'684","reported_seq":2154,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.557057+0000","last_change":"2024-03-04T12:20:16.833569+0000","last_active":"2024-03-04T13:12:22.557057+0000","last_peered":"2024-03-04T13:12:22.557057+0000","last_clean":"2024-03-04T13:12:22.557057+0000","last_became_active":"2024-03-04T12:20:16.833268+0000","last_became_peered":"2024-03-04T12:20:16.833268+0000","last_unstale":"2024-03-04T13:12:22.557057+0000","last_undegraded":"2024-03-04T13:12:22.557057+0000","last_fullsized":"2024-03-04T13:12:22.557057+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:17.714462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3214,"num_read_kb":2906,"num_write":892,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"255'232","reported_seq":873,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.181027+0000","last_change":"2024-03-04T12:20:14.828265+0000","last_active":"2024-03-04T13:13:21.181027+0000","last_peered":"2024-03-04T13:13:21.181027+0000","last_clean":"2024-03-04T13:13:21.181027+0000","last_became_active":"2024-03-04T12:20:14.827948+0000","last_became_peered":"2024-03-04T12:20:14.827948+0000","last_unstale":"2024-03-04T13:13:21.181027+0000","last_undegraded":"2024-03-04T13:13:21.181027+0000","last_fullsized":"2024-03-04T13:13:21.181027+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:04:36.496722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2119867,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":498,"num_read_kb":35496,"num_write":1177,"num_write_kb":50438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"255'329","reported_seq":1701,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.953895+0000","last_change":"2024-03-04T12:20:16.831041+0000","last_active":"2024-03-04T13:12:36.953895+0000","last_peered":"2024-03-04T13:12:36.953895+0000","last_clean":"2024-03-04T13:12:36.953895+0000","last_became_active":"2024-03-04T12:20:16.830773+0000","last_became_peered":"2024-03-04T12:20:16.830773+0000","last_unstale":"2024-03-04T13:12:36.953895+0000","last_undegraded":"2024-03-04T13:12:36.953895+0000","last_fullsized":"2024-03-04T13:12:36.953895+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:29:14.244772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1823,"num_read_kb":1743,"num_write":376,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"255'403","reported_seq":1977,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.059106+0000","last_change":"2024-03-04T12:20:16.820827+0000","last_active":"2024-03-04T13:12:18.059106+0000","last_peered":"2024-03-04T13:12:18.059106+0000","last_clean":"2024-03-04T13:12:18.059106+0000","last_became_active":"2024-03-04T12:20:16.820533+0000","last_became_peered":"2024-03-04T12:20:16.820533+0000","last_unstale":"2024-03-04T13:12:18.059106+0000","last_undegraded":"2024-03-04T13:12:18.059106+0000","last_fullsized":"2024-03-04T13:12:18.059106+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:23:30.720165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2265,"num_read_kb":2155,"num_write":466,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"255'193","reported_seq":823,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:12.508125+0000","last_change":"2024-03-04T12:20:14.820881+0000","last_active":"2024-03-04T13:11:12.508125+0000","last_peered":"2024-03-04T13:11:12.508125+0000","last_clean":"2024-03-04T13:11:12.508125+0000","last_became_active":"2024-03-04T12:20:14.820248+0000","last_became_peered":"2024-03-04T12:20:14.820248+0000","last_unstale":"2024-03-04T13:11:12.508125+0000","last_undegraded":"2024-03-04T13:11:12.508125+0000","last_fullsized":"2024-03-04T13:11:12.508125+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:59:02.821081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847147,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":428,"num_read_kb":15441,"num_write":1092,"num_write_kb":31882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"255'1140","reported_seq":2690,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573468+0000","last_change":"2024-03-04T12:20:16.837314+0000","last_active":"2024-03-04T13:12:50.573468+0000","last_peered":"2024-03-04T13:12:50.573468+0000","last_clean":"2024-03-04T13:12:50.573468+0000","last_became_active":"2024-03-04T12:20:16.837126+0000","last_became_peered":"2024-03-04T12:20:16.837126+0000","last_unstale":"2024-03-04T13:12:50.573468+0000","last_undegraded":"2024-03-04T13:12:50.573468+0000","last_fullsized":"2024-03-04T13:12:50.573468+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:39:46.380503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4770,"num_read_kb":4178,"num_write":1557,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"255'198","reported_seq":813,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.115479+0000","last_change":"2024-03-04T12:20:14.824468+0000","last_active":"2024-03-04T13:13:21.115479+0000","last_peered":"2024-03-04T13:13:21.115479+0000","last_clean":"2024-03-04T13:13:21.115479+0000","last_became_active":"2024-03-04T12:20:14.824133+0000","last_became_peered":"2024-03-04T12:20:14.824133+0000","last_unstale":"2024-03-04T13:13:21.115479+0000","last_undegraded":"2024-03-04T13:13:21.115479+0000","last_fullsized":"2024-03-04T13:13:21.115479+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:58:01.156356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399138,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":430,"num_read_kb":9751,"num_write":1008,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"255'738","reported_seq":2185,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.777698+0000","last_change":"2024-03-04T12:20:16.825766+0000","last_active":"2024-03-04T13:12:34.777698+0000","last_peered":"2024-03-04T13:12:34.777698+0000","last_clean":"2024-03-04T13:12:34.777698+0000","last_became_active":"2024-03-04T12:20:16.825499+0000","last_became_peered":"2024-03-04T12:20:16.825499+0000","last_unstale":"2024-03-04T13:12:34.777698+0000","last_undegraded":"2024-03-04T13:12:34.777698+0000","last_fullsized":"2024-03-04T13:12:34.777698+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:43:04.157793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3318,"num_read_kb":2969,"num_write":989,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"255'240","reported_seq":871,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.228733+0000","last_change":"2024-03-04T12:20:14.828323+0000","last_active":"2024-03-04T13:13:21.228733+0000","last_peered":"2024-03-04T13:13:21.228733+0000","last_clean":"2024-03-04T13:13:21.228733+0000","last_became_active":"2024-03-04T12:20:14.827979+0000","last_became_peered":"2024-03-04T12:20:14.827979+0000","last_unstale":"2024-03-04T13:13:21.228733+0000","last_undegraded":"2024-03-04T13:13:21.228733+0000","last_fullsized":"2024-03-04T13:13:21.228733+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:12:15.676059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":577599,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":7999,"num_write":1192,"num_write_kb":30331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"255'777","reported_seq":2213,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:20.376868+0000","last_change":"2024-03-04T12:20:16.826162+0000","last_active":"2024-03-04T13:12:20.376868+0000","last_peered":"2024-03-04T13:12:20.376868+0000","last_clean":"2024-03-04T13:12:20.376868+0000","last_became_active":"2024-03-04T12:20:16.825897+0000","last_became_peered":"2024-03-04T12:20:16.825897+0000","last_unstale":"2024-03-04T13:12:20.376868+0000","last_undegraded":"2024-03-04T13:12:20.376868+0000","last_fullsized":"2024-03-04T13:12:20.376868+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:45:52.489712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3571,"num_read_kb":3184,"num_write":1054,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"255'154","reported_seq":753,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.180904+0000","last_change":"2024-03-04T12:20:14.824375+0000","last_active":"2024-03-04T13:13:21.180904+0000","last_peered":"2024-03-04T13:13:21.180904+0000","last_clean":"2024-03-04T13:13:21.180904+0000","last_became_active":"2024-03-04T12:20:14.823430+0000","last_became_peered":"2024-03-04T12:20:14.823430+0000","last_unstale":"2024-03-04T13:13:21.180904+0000","last_undegraded":"2024-03-04T13:13:21.180904+0000","last_fullsized":"2024-03-04T13:13:21.180904+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:00:47.840698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1683023,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":325,"num_read_kb":32856,"num_write":784,"num_write_kb":22354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"255'556","reported_seq":2086,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:37.308042+0000","last_change":"2024-03-04T12:20:16.830040+0000","last_active":"2024-03-04T13:12:37.308042+0000","last_peered":"2024-03-04T13:12:37.308042+0000","last_clean":"2024-03-04T13:12:37.308042+0000","last_became_active":"2024-03-04T12:20:16.829685+0000","last_became_peered":"2024-03-04T12:20:16.829685+0000","last_unstale":"2024-03-04T13:12:37.308042+0000","last_undegraded":"2024-03-04T13:12:37.308042+0000","last_fullsized":"2024-03-04T13:12:37.308042+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:39:48.525836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2792,"num_read_kb":2527,"num_write":750,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"255'193","reported_seq":775,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:19.681138+0000","last_change":"2024-03-04T12:20:14.822181+0000","last_active":"2024-03-04T13:09:19.681138+0000","last_peered":"2024-03-04T13:09:19.681138+0000","last_clean":"2024-03-04T13:09:19.681138+0000","last_became_active":"2024-03-04T12:20:14.821923+0000","last_became_peered":"2024-03-04T12:20:14.821923+0000","last_unstale":"2024-03-04T13:09:19.681138+0000","last_undegraded":"2024-03-04T13:09:19.681138+0000","last_fullsized":"2024-03-04T13:09:19.681138+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:23:35.278346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":428,"num_write":1012,"num_write_kb":16985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"255'373","reported_seq":1788,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.098146+0000","last_change":"2024-03-04T12:20:16.826907+0000","last_active":"2024-03-04T13:12:31.098146+0000","last_peered":"2024-03-04T13:12:31.098146+0000","last_clean":"2024-03-04T13:12:31.098146+0000","last_became_active":"2024-03-04T12:20:16.826208+0000","last_became_peered":"2024-03-04T12:20:16.826208+0000","last_unstale":"2024-03-04T13:12:31.098146+0000","last_undegraded":"2024-03-04T13:12:31.098146+0000","last_fullsized":"2024-03-04T13:12:31.098146+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:48:38.580682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1988,"num_read_kb":1881,"num_write":441,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"255'173","reported_seq":777,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.206884+0000","last_change":"2024-03-04T12:20:14.812110+0000","last_active":"2024-03-04T13:13:21.206884+0000","last_peered":"2024-03-04T13:13:21.206884+0000","last_clean":"2024-03-04T13:13:21.206884+0000","last_became_active":"2024-03-04T12:20:14.811813+0000","last_became_peered":"2024-03-04T12:20:14.811813+0000","last_unstale":"2024-03-04T13:13:21.206884+0000","last_undegraded":"2024-03-04T13:13:21.206884+0000","last_fullsized":"2024-03-04T13:13:21.206884+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:16:22.043018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":397,"num_read_kb":4485,"num_write":973,"num_write_kb":10922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"255'93","reported_seq":579,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:15.761317+0000","last_change":"2024-03-04T12:20:24.871376+0000","last_active":"2024-03-04T13:12:15.761317+0000","last_peered":"2024-03-04T13:12:15.761317+0000","last_clean":"2024-03-04T13:12:15.761317+0000","last_became_active":"2024-03-04T12:20:24.871089+0000","last_became_peered":"2024-03-04T12:20:24.871089+0000","last_unstale":"2024-03-04T13:12:15.761317+0000","last_undegraded":"2024-03-04T13:12:15.761317+0000","last_fullsized":"2024-03-04T13:12:15.761317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:14:35.987784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":97,"num_write":227,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"255'790","reported_seq":2212,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.056199+0000","last_change":"2024-03-04T12:20:16.829280+0000","last_active":"2024-03-04T13:12:18.056199+0000","last_peered":"2024-03-04T13:12:18.056199+0000","last_clean":"2024-03-04T13:12:18.056199+0000","last_became_active":"2024-03-04T12:20:16.828977+0000","last_became_peered":"2024-03-04T12:20:16.828977+0000","last_unstale":"2024-03-04T13:12:18.056199+0000","last_undegraded":"2024-03-04T13:12:18.056199+0000","last_fullsized":"2024-03-04T13:12:18.056199+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:08:11.691344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3439,"num_read_kb":3056,"num_write":1047,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"255'219","reported_seq":869,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.154310+0000","last_change":"2024-03-04T12:20:14.817012+0000","last_active":"2024-03-04T13:13:21.154310+0000","last_peered":"2024-03-04T13:13:21.154310+0000","last_clean":"2024-03-04T13:13:21.154310+0000","last_became_active":"2024-03-04T12:20:14.816722+0000","last_became_peered":"2024-03-04T12:20:14.816722+0000","last_unstale":"2024-03-04T13:13:21.154310+0000","last_undegraded":"2024-03-04T13:13:21.154310+0000","last_fullsized":"2024-03-04T13:13:21.154310+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:03:31.043930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1705735,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":471,"num_read_kb":103623,"num_write":1220,"num_write_kb":57222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.341660+0000","last_change":"2024-03-04T12:20:18.835916+0000","last_active":"2024-03-04T13:08:42.341660+0000","last_peered":"2024-03-04T13:08:42.341660+0000","last_clean":"2024-03-04T13:08:42.341660+0000","last_became_active":"2024-03-04T12:20:18.835597+0000","last_became_peered":"2024-03-04T12:20:18.835597+0000","last_unstale":"2024-03-04T13:08:42.341660+0000","last_undegraded":"2024-03-04T13:08:42.341660+0000","last_fullsized":"2024-03-04T13:08:42.341660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:45:01.355651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"255'185","reported_seq":768,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.068220+0000","last_change":"2024-03-04T12:20:20.837358+0000","last_active":"2024-03-04T13:13:21.068220+0000","last_peered":"2024-03-04T13:13:21.068220+0000","last_clean":"2024-03-04T13:13:21.068220+0000","last_became_active":"2024-03-04T12:20:20.837048+0000","last_became_peered":"2024-03-04T12:20:20.837048+0000","last_unstale":"2024-03-04T13:13:21.068220+0000","last_undegraded":"2024-03-04T13:13:21.068220+0000","last_fullsized":"2024-03-04T13:13:21.068220+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:43:04.505643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":254,"num_read_kb":315,"num_write":146,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.483022+0000","last_change":"2024-03-04T12:20:22.852800+0000","last_active":"2024-03-04T13:08:42.483022+0000","last_peered":"2024-03-04T13:08:42.483022+0000","last_clean":"2024-03-04T13:08:42.483022+0000","last_became_active":"2024-03-04T12:20:22.852461+0000","last_became_peered":"2024-03-04T12:20:22.852461+0000","last_unstale":"2024-03-04T13:08:42.483022+0000","last_undegraded":"2024-03-04T13:08:42.483022+0000","last_fullsized":"2024-03-04T13:08:42.483022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:03:51.860258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"255'2372","reported_seq":4166,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.462461+0000","last_change":"2024-03-04T12:20:24.869696+0000","last_active":"2024-03-04T13:13:12.462461+0000","last_peered":"2024-03-04T13:13:12.462461+0000","last_clean":"2024-03-04T13:13:12.462461+0000","last_became_active":"2024-03-04T12:20:24.869395+0000","last_became_peered":"2024-03-04T12:20:24.869395+0000","last_unstale":"2024-03-04T13:13:12.462461+0000","last_undegraded":"2024-03-04T13:13:12.462461+0000","last_fullsized":"2024-03-04T13:13:12.462461+0000","mapping_epoch":30,"log_start":"255'2300","ondisk_log_start":"255'2300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":2300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:18:14.602967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5943,"num_read_kb":5935,"num_write":4730,"num_write_kb":1746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"255'345","reported_seq":1811,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.571922+0000","last_change":"2024-03-04T12:20:16.829693+0000","last_active":"2024-03-04T13:12:50.571922+0000","last_peered":"2024-03-04T13:12:50.571922+0000","last_clean":"2024-03-04T13:12:50.571922+0000","last_became_active":"2024-03-04T12:20:16.829441+0000","last_became_peered":"2024-03-04T12:20:16.829441+0000","last_unstale":"2024-03-04T13:12:50.571922+0000","last_undegraded":"2024-03-04T13:12:50.571922+0000","last_fullsized":"2024-03-04T13:12:50.571922+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:15:29.713063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2107,"num_read_kb":2006,"num_write":408,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"255'161","reported_seq":724,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.007166+0000","last_change":"2024-03-04T12:20:14.819912+0000","last_active":"2024-03-04T13:13:21.007166+0000","last_peered":"2024-03-04T13:13:21.007166+0000","last_clean":"2024-03-04T13:13:21.007166+0000","last_became_active":"2024-03-04T12:20:14.819559+0000","last_became_peered":"2024-03-04T12:20:14.819559+0000","last_unstale":"2024-03-04T13:13:21.007166+0000","last_undegraded":"2024-03-04T13:13:21.007166+0000","last_fullsized":"2024-03-04T13:13:21.007166+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:48:45.189022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":323,"num_read_kb":7587,"num_write":849,"num_write_kb":22276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:27.446912+0000","last_change":"2024-03-04T12:20:18.834062+0000","last_active":"2024-03-04T13:09:27.446912+0000","last_peered":"2024-03-04T13:09:27.446912+0000","last_clean":"2024-03-04T13:09:27.446912+0000","last_became_active":"2024-03-04T12:20:18.833470+0000","last_became_peered":"2024-03-04T12:20:18.833470+0000","last_unstale":"2024-03-04T13:09:27.446912+0000","last_undegraded":"2024-03-04T13:09:27.446912+0000","last_fullsized":"2024-03-04T13:09:27.446912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:12.993503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"255'77","reported_seq":593,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.519703+0000","last_change":"2024-03-04T12:20:20.838187+0000","last_active":"2024-03-04T13:10:53.519703+0000","last_peered":"2024-03-04T13:10:53.519703+0000","last_clean":"2024-03-04T13:10:53.519703+0000","last_became_active":"2024-03-04T12:20:20.837905+0000","last_became_peered":"2024-03-04T12:20:20.837905+0000","last_unstale":"2024-03-04T13:10:53.519703+0000","last_undegraded":"2024-03-04T13:10:53.519703+0000","last_fullsized":"2024-03-04T13:10:53.519703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:44:38.381403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.482996+0000","last_change":"2024-03-04T12:20:22.849051+0000","last_active":"2024-03-04T13:08:42.482996+0000","last_peered":"2024-03-04T13:08:42.482996+0000","last_clean":"2024-03-04T13:08:42.482996+0000","last_became_active":"2024-03-04T12:20:22.848773+0000","last_became_peered":"2024-03-04T12:20:22.848773+0000","last_unstale":"2024-03-04T13:08:42.482996+0000","last_undegraded":"2024-03-04T13:08:42.482996+0000","last_fullsized":"2024-03-04T13:08:42.482996+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:55:51.999361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"255'116","reported_seq":607,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:28.660007+0000","last_change":"2024-03-04T12:20:24.869138+0000","last_active":"2024-03-04T13:11:28.660007+0000","last_peered":"2024-03-04T13:11:28.660007+0000","last_clean":"2024-03-04T13:11:28.660007+0000","last_became_active":"2024-03-04T12:20:24.868746+0000","last_became_peered":"2024-03-04T12:20:24.868746+0000","last_unstale":"2024-03-04T13:11:28.660007+0000","last_undegraded":"2024-03-04T13:11:28.660007+0000","last_fullsized":"2024-03-04T13:11:28.660007+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:03:02.799287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"255'390","reported_seq":1881,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573222+0000","last_change":"2024-03-04T12:20:16.829905+0000","last_active":"2024-03-04T13:12:50.573222+0000","last_peered":"2024-03-04T13:12:50.573222+0000","last_clean":"2024-03-04T13:12:50.573222+0000","last_became_active":"2024-03-04T12:20:16.829641+0000","last_became_peered":"2024-03-04T12:20:16.829641+0000","last_unstale":"2024-03-04T13:12:50.573222+0000","last_undegraded":"2024-03-04T13:12:50.573222+0000","last_fullsized":"2024-03-04T13:12:50.573222+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:38:20.140291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2147,"num_read_kb":2039,"num_write":462,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"255'144","reported_seq":758,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:37.512605+0000","last_change":"2024-03-04T12:20:14.817840+0000","last_active":"2024-03-04T13:11:37.512605+0000","last_peered":"2024-03-04T13:11:37.512605+0000","last_clean":"2024-03-04T13:11:37.512605+0000","last_became_active":"2024-03-04T12:20:14.817556+0000","last_became_peered":"2024-03-04T12:20:14.817556+0000","last_unstale":"2024-03-04T13:11:37.512605+0000","last_undegraded":"2024-03-04T13:11:37.512605+0000","last_fullsized":"2024-03-04T13:11:37.512605+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:38.563036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524480,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":366,"num_read_kb":1564,"num_write":822,"num_write_kb":17292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.442244+0000","last_change":"2024-03-04T12:20:18.836217+0000","last_active":"2024-03-04T13:08:42.442244+0000","last_peered":"2024-03-04T13:08:42.442244+0000","last_clean":"2024-03-04T13:08:42.442244+0000","last_became_active":"2024-03-04T12:20:18.835760+0000","last_became_peered":"2024-03-04T12:20:18.835760+0000","last_unstale":"2024-03-04T13:08:42.442244+0000","last_undegraded":"2024-03-04T13:08:42.442244+0000","last_fullsized":"2024-03-04T13:08:42.442244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:42:21.998349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"255'113","reported_seq":638,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.692750+0000","last_change":"2024-03-04T12:20:20.838715+0000","last_active":"2024-03-04T13:10:53.692750+0000","last_peered":"2024-03-04T13:10:53.692750+0000","last_clean":"2024-03-04T13:10:53.692750+0000","last_became_active":"2024-03-04T12:20:20.838094+0000","last_became_peered":"2024-03-04T12:20:20.838094+0000","last_unstale":"2024-03-04T13:10:53.692750+0000","last_undegraded":"2024-03-04T13:10:53.692750+0000","last_fullsized":"2024-03-04T13:10:53.692750+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:31.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":129,"num_write":92,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"255'502","reported_seq":1929,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.004248+0000","last_change":"2024-03-04T12:20:22.851329+0000","last_active":"2024-03-04T13:13:21.004248+0000","last_peered":"2024-03-04T13:13:21.004248+0000","last_clean":"2024-03-04T13:13:21.004248+0000","last_became_active":"2024-03-04T12:20:22.851062+0000","last_became_peered":"2024-03-04T12:20:22.851062+0000","last_unstale":"2024-03-04T13:13:21.004248+0000","last_undegraded":"2024-03-04T13:13:21.004248+0000","last_fullsized":"2024-03-04T13:13:21.004248+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:10.088059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"255'137","reported_seq":615,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:20.402198+0000","last_change":"2024-03-04T12:20:24.912322+0000","last_active":"2024-03-04T13:12:20.402198+0000","last_peered":"2024-03-04T13:12:20.402198+0000","last_clean":"2024-03-04T13:12:20.402198+0000","last_became_active":"2024-03-04T12:20:24.912068+0000","last_became_peered":"2024-03-04T12:20:24.912068+0000","last_unstale":"2024-03-04T13:12:20.402198+0000","last_undegraded":"2024-03-04T13:12:20.402198+0000","last_fullsized":"2024-03-04T13:12:20.402198+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:30:34.171289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":66,"num_write":291,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"255'856","reported_seq":2536,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.954099+0000","last_change":"2024-03-04T12:20:16.831420+0000","last_active":"2024-03-04T13:12:36.954099+0000","last_peered":"2024-03-04T13:12:36.954099+0000","last_clean":"2024-03-04T13:12:36.954099+0000","last_became_active":"2024-03-04T12:20:16.831039+0000","last_became_peered":"2024-03-04T12:20:16.831039+0000","last_unstale":"2024-03-04T13:12:36.954099+0000","last_undegraded":"2024-03-04T13:12:36.954099+0000","last_fullsized":"2024-03-04T13:12:36.954099+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:45:56.296756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4009,"num_read_kb":3592,"num_write":1144,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"255'195","reported_seq":798,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.172515+0000","last_change":"2024-03-04T12:20:14.818137+0000","last_active":"2024-03-04T13:13:21.172515+0000","last_peered":"2024-03-04T13:13:21.172515+0000","last_clean":"2024-03-04T13:13:21.172515+0000","last_became_active":"2024-03-04T12:20:14.817863+0000","last_became_peered":"2024-03-04T12:20:14.817863+0000","last_unstale":"2024-03-04T13:13:21.172515+0000","last_undegraded":"2024-03-04T13:13:21.172515+0000","last_fullsized":"2024-03-04T13:13:21.172515+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:33:32.762020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9161812,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":19635,"num_write":1198,"num_write_kb":36958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"32'4","reported_seq":792,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.703405+0000","last_change":"2024-03-04T12:20:18.838746+0000","last_active":"2024-03-04T13:13:20.703405+0000","last_peered":"2024-03-04T13:13:20.703405+0000","last_clean":"2024-03-04T13:13:20.703405+0000","last_became_active":"2024-03-04T12:20:18.838266+0000","last_became_peered":"2024-03-04T12:20:18.838266+0000","last_unstale":"2024-03-04T13:13:20.703405+0000","last_undegraded":"2024-03-04T13:13:20.703405+0000","last_fullsized":"2024-03-04T13:13:20.703405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:40:00.829417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":466,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"255'129","reported_seq":693,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.027522+0000","last_change":"2024-03-04T12:20:21.643825+0000","last_active":"2024-03-04T13:13:21.027522+0000","last_peered":"2024-03-04T13:13:21.027522+0000","last_clean":"2024-03-04T13:13:21.027522+0000","last_became_active":"2024-03-04T12:20:21.643542+0000","last_became_peered":"2024-03-04T12:20:21.643542+0000","last_unstale":"2024-03-04T13:13:21.027522+0000","last_undegraded":"2024-03-04T13:13:21.027522+0000","last_fullsized":"2024-03-04T13:13:21.027522+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:37.997080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9148,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":181,"num_read_kb":265,"num_write":100,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"255'530","reported_seq":1912,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.939056+0000","last_change":"2024-03-04T12:20:22.858901+0000","last_active":"2024-03-04T13:13:20.939056+0000","last_peered":"2024-03-04T13:13:20.939056+0000","last_clean":"2024-03-04T13:13:20.939056+0000","last_became_active":"2024-03-04T12:20:22.858575+0000","last_became_peered":"2024-03-04T12:20:22.858575+0000","last_unstale":"2024-03-04T13:13:20.939056+0000","last_undegraded":"2024-03-04T13:13:20.939056+0000","last_fullsized":"2024-03-04T13:13:20.939056+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:54:58.667292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"255'391","reported_seq":1796,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:40.169266+0000","last_change":"2024-03-04T12:20:16.830920+0000","last_active":"2024-03-04T13:11:40.169266+0000","last_peered":"2024-03-04T13:11:40.169266+0000","last_clean":"2024-03-04T13:11:40.169266+0000","last_became_active":"2024-03-04T12:20:16.830531+0000","last_became_peered":"2024-03-04T12:20:16.830531+0000","last_unstale":"2024-03-04T13:11:40.169266+0000","last_undegraded":"2024-03-04T13:11:40.169266+0000","last_fullsized":"2024-03-04T13:11:40.169266+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:40:48.153427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2065,"num_write":498,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"255'174","reported_seq":849,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.101751+0000","last_change":"2024-03-04T12:20:14.818724+0000","last_active":"2024-03-04T13:13:21.101751+0000","last_peered":"2024-03-04T13:13:21.101751+0000","last_clean":"2024-03-04T13:13:21.101751+0000","last_became_active":"2024-03-04T12:20:14.818441+0000","last_became_peered":"2024-03-04T12:20:14.818441+0000","last_unstale":"2024-03-04T13:13:21.101751+0000","last_undegraded":"2024-03-04T13:13:21.101751+0000","last_fullsized":"2024-03-04T13:13:21.101751+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:15.961414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10526962,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":524,"num_read_kb":158242,"num_write":986,"num_write_kb":38243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":492,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497846+0000","last_change":"2024-03-04T12:20:18.832672+0000","last_active":"2024-03-04T13:10:12.497846+0000","last_peered":"2024-03-04T13:10:12.497846+0000","last_clean":"2024-03-04T13:10:12.497846+0000","last_became_active":"2024-03-04T12:20:18.832349+0000","last_became_peered":"2024-03-04T12:20:18.832349+0000","last_unstale":"2024-03-04T13:10:12.497846+0000","last_undegraded":"2024-03-04T13:10:12.497846+0000","last_fullsized":"2024-03-04T13:10:12.497846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:17.354349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"255'217","reported_seq":821,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.104550+0000","last_change":"2024-03-04T12:20:21.642137+0000","last_active":"2024-03-04T13:13:21.104550+0000","last_peered":"2024-03-04T13:13:21.104550+0000","last_clean":"2024-03-04T13:13:21.104550+0000","last_became_active":"2024-03-04T12:20:21.641749+0000","last_became_peered":"2024-03-04T12:20:21.641749+0000","last_unstale":"2024-03-04T13:13:21.104550+0000","last_undegraded":"2024-03-04T13:13:21.104550+0000","last_fullsized":"2024-03-04T13:13:21.104550+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:33:09.469358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6571,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":304,"num_read_kb":381,"num_write":178,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":477,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.540203+0000","last_change":"2024-03-04T12:20:22.852908+0000","last_active":"2024-03-04T13:09:52.540203+0000","last_peered":"2024-03-04T13:09:52.540203+0000","last_clean":"2024-03-04T13:09:52.540203+0000","last_became_active":"2024-03-04T12:20:22.852612+0000","last_became_peered":"2024-03-04T12:20:22.852612+0000","last_unstale":"2024-03-04T13:09:52.540203+0000","last_undegraded":"2024-03-04T13:09:52.540203+0000","last_fullsized":"2024-03-04T13:09:52.540203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:41:53.817861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"255'523","reported_seq":1316,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.165868+0000","last_change":"2024-03-04T12:20:24.869764+0000","last_active":"2024-03-04T13:13:14.165868+0000","last_peered":"2024-03-04T13:13:14.165868+0000","last_clean":"2024-03-04T13:13:14.165868+0000","last_became_active":"2024-03-04T12:20:24.869409+0000","last_became_peered":"2024-03-04T12:20:24.869409+0000","last_unstale":"2024-03-04T13:13:14.165868+0000","last_undegraded":"2024-03-04T13:13:14.165868+0000","last_fullsized":"2024-03-04T13:13:14.165868+0000","mapping_epoch":30,"log_start":"255'500","ondisk_log_start":"255'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:47:48.263171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1237,"num_read_kb":1237,"num_write":1069,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"255'315","reported_seq":1782,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573805+0000","last_change":"2024-03-04T12:20:16.826445+0000","last_active":"2024-03-04T13:12:50.573805+0000","last_peered":"2024-03-04T13:12:50.573805+0000","last_clean":"2024-03-04T13:12:50.573805+0000","last_became_active":"2024-03-04T12:20:16.826183+0000","last_became_peered":"2024-03-04T12:20:16.826183+0000","last_unstale":"2024-03-04T13:12:50.573805+0000","last_undegraded":"2024-03-04T13:12:50.573805+0000","last_fullsized":"2024-03-04T13:12:50.573805+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:57:50.116407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2023,"num_read_kb":1945,"num_write":353,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"255'180","reported_seq":810,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.137408+0000","last_change":"2024-03-04T12:20:14.819684+0000","last_active":"2024-03-04T13:13:21.137408+0000","last_peered":"2024-03-04T13:13:21.137408+0000","last_clean":"2024-03-04T13:13:21.137408+0000","last_became_active":"2024-03-04T12:20:14.819389+0000","last_became_peered":"2024-03-04T12:20:14.819389+0000","last_unstale":"2024-03-04T13:13:21.137408+0000","last_undegraded":"2024-03-04T13:13:21.137408+0000","last_fullsized":"2024-03-04T13:13:21.137408+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:30:11.677107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":382,"num_read_kb":37991,"num_write":1066,"num_write_kb":16641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":486,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.439917+0000","last_change":"2024-03-04T12:20:18.834899+0000","last_active":"2024-03-04T13:10:12.439917+0000","last_peered":"2024-03-04T13:10:12.439917+0000","last_clean":"2024-03-04T13:10:12.439917+0000","last_became_active":"2024-03-04T12:20:18.834619+0000","last_became_peered":"2024-03-04T12:20:18.834619+0000","last_unstale":"2024-03-04T13:10:12.439917+0000","last_undegraded":"2024-03-04T13:10:12.439917+0000","last_fullsized":"2024-03-04T13:10:12.439917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:42:40.542910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"255'129","reported_seq":684,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.202231+0000","last_change":"2024-03-04T12:20:20.843676+0000","last_active":"2024-03-04T13:13:21.202231+0000","last_peered":"2024-03-04T13:13:21.202231+0000","last_clean":"2024-03-04T13:13:21.202231+0000","last_became_active":"2024-03-04T12:20:20.843195+0000","last_became_peered":"2024-03-04T12:20:20.843195+0000","last_unstale":"2024-03-04T13:13:21.202231+0000","last_undegraded":"2024-03-04T13:13:21.202231+0000","last_fullsized":"2024-03-04T13:13:21.202231+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:56:20.314287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":216,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":474,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.452976+0000","last_change":"2024-03-04T12:20:22.859027+0000","last_active":"2024-03-04T13:10:17.452976+0000","last_peered":"2024-03-04T13:10:17.452976+0000","last_clean":"2024-03-04T13:10:17.452976+0000","last_became_active":"2024-03-04T12:20:22.858722+0000","last_became_peered":"2024-03-04T12:20:22.858722+0000","last_unstale":"2024-03-04T13:10:17.452976+0000","last_undegraded":"2024-03-04T13:10:17.452976+0000","last_fullsized":"2024-03-04T13:10:17.452976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:18:20.285059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"255'182","reported_seq":703,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:17.325728+0000","last_change":"2024-03-04T12:20:24.869476+0000","last_active":"2024-03-04T13:11:17.325728+0000","last_peered":"2024-03-04T13:11:17.325728+0000","last_clean":"2024-03-04T13:11:17.325728+0000","last_became_active":"2024-03-04T12:20:24.869152+0000","last_became_peered":"2024-03-04T12:20:24.869152+0000","last_unstale":"2024-03-04T13:11:17.325728+0000","last_undegraded":"2024-03-04T13:11:17.325728+0000","last_fullsized":"2024-03-04T13:11:17.325728+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:21.486498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":286,"num_read_kb":243,"num_write":358,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"255'1227","reported_seq":2769,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.767503+0000","last_change":"2024-03-04T12:20:16.826525+0000","last_active":"2024-03-04T13:12:12.767503+0000","last_peered":"2024-03-04T13:12:12.767503+0000","last_clean":"2024-03-04T13:12:12.767503+0000","last_became_active":"2024-03-04T12:20:16.826172+0000","last_became_peered":"2024-03-04T12:20:16.826172+0000","last_unstale":"2024-03-04T13:12:12.767503+0000","last_undegraded":"2024-03-04T13:12:12.767503+0000","last_fullsized":"2024-03-04T13:12:12.767503+0000","mapping_epoch":22,"log_start":"255'1200","ondisk_log_start":"255'1200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:12:29.317623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5093,"num_read_kb":4391,"num_write":1710,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"255'179","reported_seq":838,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.059570+0000","last_change":"2024-03-04T12:20:14.828602+0000","last_active":"2024-03-04T13:13:21.059570+0000","last_peered":"2024-03-04T13:13:21.059570+0000","last_clean":"2024-03-04T13:13:21.059570+0000","last_became_active":"2024-03-04T12:20:14.828250+0000","last_became_peered":"2024-03-04T12:20:14.828250+0000","last_unstale":"2024-03-04T13:13:21.059570+0000","last_undegraded":"2024-03-04T13:13:21.059570+0000","last_fullsized":"2024-03-04T13:13:21.059570+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:46.934324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22063,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":10895,"num_write":937,"num_write_kb":21474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.437970+0000","last_change":"2024-03-04T12:20:18.835161+0000","last_active":"2024-03-04T13:09:52.437970+0000","last_peered":"2024-03-04T13:09:52.437970+0000","last_clean":"2024-03-04T13:09:52.437970+0000","last_became_active":"2024-03-04T12:20:18.834897+0000","last_became_peered":"2024-03-04T12:20:18.834897+0000","last_unstale":"2024-03-04T13:09:52.437970+0000","last_undegraded":"2024-03-04T13:09:52.437970+0000","last_fullsized":"2024-03-04T13:09:52.437970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:23:32.729578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"255'162","reported_seq":746,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.117978+0000","last_change":"2024-03-04T12:20:20.839989+0000","last_active":"2024-03-04T13:13:21.117978+0000","last_peered":"2024-03-04T13:13:21.117978+0000","last_clean":"2024-03-04T13:13:21.117978+0000","last_became_active":"2024-03-04T12:20:20.839295+0000","last_became_peered":"2024-03-04T12:20:20.839295+0000","last_unstale":"2024-03-04T13:13:21.117978+0000","last_undegraded":"2024-03-04T13:13:21.117978+0000","last_fullsized":"2024-03-04T13:13:21.117978+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:08:54.656704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":221,"num_read_kb":283,"num_write":122,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"255'515","reported_seq":1896,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.939978+0000","last_change":"2024-03-04T12:20:22.852803+0000","last_active":"2024-03-04T13:13:20.939978+0000","last_peered":"2024-03-04T13:13:20.939978+0000","last_clean":"2024-03-04T13:13:20.939978+0000","last_became_active":"2024-03-04T12:20:22.852529+0000","last_became_peered":"2024-03-04T12:20:22.852529+0000","last_unstale":"2024-03-04T13:13:20.939978+0000","last_undegraded":"2024-03-04T13:13:20.939978+0000","last_fullsized":"2024-03-04T13:13:20.939978+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:41:17.465191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"255'110","reported_seq":578,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:26.130806+0000","last_change":"2024-03-04T12:20:24.868355+0000","last_active":"2024-03-04T13:11:26.130806+0000","last_peered":"2024-03-04T13:11:26.130806+0000","last_clean":"2024-03-04T13:11:26.130806+0000","last_became_active":"2024-03-04T12:20:24.868076+0000","last_became_peered":"2024-03-04T12:20:24.868076+0000","last_unstale":"2024-03-04T13:11:26.130806+0000","last_undegraded":"2024-03-04T13:11:26.130806+0000","last_fullsized":"2024-03-04T13:11:26.130806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:48:52.616216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"255'360","reported_seq":1757,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.430573+0000","last_change":"2024-03-04T12:20:16.829010+0000","last_active":"2024-03-04T13:12:39.430573+0000","last_peered":"2024-03-04T13:12:39.430573+0000","last_clean":"2024-03-04T13:12:39.430573+0000","last_became_active":"2024-03-04T12:20:16.828738+0000","last_became_peered":"2024-03-04T12:20:16.828738+0000","last_unstale":"2024-03-04T13:12:39.430573+0000","last_undegraded":"2024-03-04T13:12:39.430573+0000","last_fullsized":"2024-03-04T13:12:39.430573+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:50:10.406480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1878,"num_read_kb":1794,"num_write":404,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"255'280","reported_seq":1007,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.196031+0000","last_change":"2024-03-04T12:20:14.824611+0000","last_active":"2024-03-04T13:13:21.196031+0000","last_peered":"2024-03-04T13:13:21.196031+0000","last_clean":"2024-03-04T13:13:21.196031+0000","last_became_active":"2024-03-04T12:20:14.824192+0000","last_became_peered":"2024-03-04T12:20:14.824192+0000","last_unstale":"2024-03-04T13:13:21.196031+0000","last_undegraded":"2024-03-04T13:13:21.196031+0000","last_fullsized":"2024-03-04T13:13:21.196031+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:58:08.994156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":790,"num_read_kb":21513,"num_write":1394,"num_write_kb":41658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":486,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.440425+0000","last_change":"2024-03-04T12:20:18.832777+0000","last_active":"2024-03-04T13:10:17.440425+0000","last_peered":"2024-03-04T13:10:17.440425+0000","last_clean":"2024-03-04T13:10:17.440425+0000","last_became_active":"2024-03-04T12:20:18.832483+0000","last_became_peered":"2024-03-04T12:20:18.832483+0000","last_unstale":"2024-03-04T13:10:17.440425+0000","last_undegraded":"2024-03-04T13:10:17.440425+0000","last_fullsized":"2024-03-04T13:10:17.440425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:02:14.119980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"255'190","reported_seq":804,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.224040+0000","last_change":"2024-03-04T12:20:20.838146+0000","last_active":"2024-03-04T13:13:21.224040+0000","last_peered":"2024-03-04T13:13:21.224040+0000","last_clean":"2024-03-04T13:13:21.224040+0000","last_became_active":"2024-03-04T12:20:20.837748+0000","last_became_peered":"2024-03-04T12:20:20.837748+0000","last_unstale":"2024-03-04T13:13:21.224040+0000","last_undegraded":"2024-03-04T13:13:21.224040+0000","last_fullsized":"2024-03-04T13:13:21.224040+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:22:00.778993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13702,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":270,"num_read_kb":346,"num_write":130,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":478,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.439897+0000","last_change":"2024-03-04T12:20:22.850065+0000","last_active":"2024-03-04T13:10:12.439897+0000","last_peered":"2024-03-04T13:10:12.439897+0000","last_clean":"2024-03-04T13:10:12.439897+0000","last_became_active":"2024-03-04T12:20:22.849784+0000","last_became_peered":"2024-03-04T12:20:22.849784+0000","last_unstale":"2024-03-04T13:10:12.439897+0000","last_undegraded":"2024-03-04T13:10:12.439897+0000","last_fullsized":"2024-03-04T13:10:12.439897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:29:20.336237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"255'99","reported_seq":608,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.080830+0000","last_change":"2024-03-04T12:20:24.865119+0000","last_active":"2024-03-04T13:12:18.080830+0000","last_peered":"2024-03-04T13:12:18.080830+0000","last_clean":"2024-03-04T13:12:18.080830+0000","last_became_active":"2024-03-04T12:20:24.864820+0000","last_became_peered":"2024-03-04T12:20:24.864820+0000","last_unstale":"2024-03-04T13:12:18.080830+0000","last_undegraded":"2024-03-04T13:12:18.080830+0000","last_fullsized":"2024-03-04T13:12:18.080830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:32:18.059621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":165,"num_write":238,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"255'1121","reported_seq":2623,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:15.756787+0000","last_change":"2024-03-04T12:20:16.828787+0000","last_active":"2024-03-04T13:12:15.756787+0000","last_peered":"2024-03-04T13:12:15.756787+0000","last_clean":"2024-03-04T13:12:15.756787+0000","last_became_active":"2024-03-04T12:20:16.828486+0000","last_became_peered":"2024-03-04T12:20:16.828486+0000","last_unstale":"2024-03-04T13:12:15.756787+0000","last_undegraded":"2024-03-04T13:12:15.756787+0000","last_fullsized":"2024-03-04T13:12:15.756787+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:11:58.117667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4686,"num_read_kb":4085,"num_write":1549,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"255'242","reported_seq":877,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.005697+0000","last_change":"2024-03-04T12:20:14.817073+0000","last_active":"2024-03-04T13:13:21.005697+0000","last_peered":"2024-03-04T13:13:21.005697+0000","last_clean":"2024-03-04T13:13:21.005697+0000","last_became_active":"2024-03-04T12:20:14.816412+0000","last_became_peered":"2024-03-04T12:20:14.816412+0000","last_unstale":"2024-03-04T13:13:21.005697+0000","last_undegraded":"2024-03-04T13:13:21.005697+0000","last_fullsized":"2024-03-04T13:13:21.005697+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:58:05.576367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399147,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":515,"num_read_kb":1880,"num_write":1395,"num_write_kb":20590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.437990+0000","last_change":"2024-03-04T12:20:18.831057+0000","last_active":"2024-03-04T13:09:52.437990+0000","last_peered":"2024-03-04T13:09:52.437990+0000","last_clean":"2024-03-04T13:09:52.437990+0000","last_became_active":"2024-03-04T12:20:18.830763+0000","last_became_peered":"2024-03-04T12:20:18.830763+0000","last_unstale":"2024-03-04T13:09:52.437990+0000","last_undegraded":"2024-03-04T13:09:52.437990+0000","last_fullsized":"2024-03-04T13:09:52.437990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:07:14.625882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"255'156","reported_seq":725,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.229852+0000","last_change":"2024-03-04T12:20:20.842557+0000","last_active":"2024-03-04T13:13:21.229852+0000","last_peered":"2024-03-04T13:13:21.229852+0000","last_clean":"2024-03-04T13:13:21.229852+0000","last_became_active":"2024-03-04T12:20:20.842216+0000","last_became_peered":"2024-03-04T12:20:20.842216+0000","last_unstale":"2024-03-04T13:13:21.229852+0000","last_undegraded":"2024-03-04T13:13:21.229852+0000","last_fullsized":"2024-03-04T13:13:21.229852+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:02:08.824556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7566,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":219,"num_read_kb":283,"num_write":166,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":471,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:57.443894+0000","last_change":"2024-03-04T12:20:22.855807+0000","last_active":"2024-03-04T13:09:57.443894+0000","last_peered":"2024-03-04T13:09:57.443894+0000","last_clean":"2024-03-04T13:09:57.443894+0000","last_became_active":"2024-03-04T12:20:22.855480+0000","last_became_peered":"2024-03-04T12:20:22.855480+0000","last_unstale":"2024-03-04T13:09:57.443894+0000","last_undegraded":"2024-03-04T13:09:57.443894+0000","last_fullsized":"2024-03-04T13:09:57.443894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:21:14.052483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"255'88","reported_seq":562,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.454648+0000","last_change":"2024-03-04T12:20:24.865258+0000","last_active":"2024-03-04T13:10:32.454648+0000","last_peered":"2024-03-04T13:10:32.454648+0000","last_clean":"2024-03-04T13:10:32.454648+0000","last_became_active":"2024-03-04T12:20:24.864982+0000","last_became_peered":"2024-03-04T12:20:24.864982+0000","last_unstale":"2024-03-04T13:10:32.454648+0000","last_undegraded":"2024-03-04T13:10:32.454648+0000","last_fullsized":"2024-03-04T13:10:32.454648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:45:57.341191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":209,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"255'386","reported_seq":1736,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573507+0000","last_change":"2024-03-04T12:20:16.826836+0000","last_active":"2024-03-04T13:12:50.573507+0000","last_peered":"2024-03-04T13:12:50.573507+0000","last_clean":"2024-03-04T13:12:50.573507+0000","last_became_active":"2024-03-04T12:20:16.824033+0000","last_became_peered":"2024-03-04T12:20:16.824033+0000","last_unstale":"2024-03-04T13:12:50.573507+0000","last_undegraded":"2024-03-04T13:12:50.573507+0000","last_fullsized":"2024-03-04T13:12:50.573507+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:20:02.860419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1899,"num_read_kb":1781,"num_write":448,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"255'222","reported_seq":837,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.173651+0000","last_change":"2024-03-04T12:20:14.818954+0000","last_active":"2024-03-04T13:13:21.173651+0000","last_peered":"2024-03-04T13:13:21.173651+0000","last_clean":"2024-03-04T13:13:21.173651+0000","last_became_active":"2024-03-04T12:20:14.818461+0000","last_became_peered":"2024-03-04T12:20:14.818461+0000","last_unstale":"2024-03-04T13:13:21.173651+0000","last_undegraded":"2024-03-04T13:13:21.173651+0000","last_fullsized":"2024-03-04T13:13:21.173651+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:54:12.327719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":446,"num_read_kb":17082,"num_write":1054,"num_write_kb":47848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.540225+0000","last_change":"2024-03-04T12:20:18.837780+0000","last_active":"2024-03-04T13:09:52.540225+0000","last_peered":"2024-03-04T13:09:52.540225+0000","last_clean":"2024-03-04T13:09:52.540225+0000","last_became_active":"2024-03-04T12:20:18.837494+0000","last_became_peered":"2024-03-04T12:20:18.837494+0000","last_unstale":"2024-03-04T13:09:52.540225+0000","last_undegraded":"2024-03-04T13:09:52.540225+0000","last_fullsized":"2024-03-04T13:09:52.540225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:44:36.195379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"255'172","reported_seq":749,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.185293+0000","last_change":"2024-03-04T12:20:20.842124+0000","last_active":"2024-03-04T13:13:21.185293+0000","last_peered":"2024-03-04T13:13:21.185293+0000","last_clean":"2024-03-04T13:13:21.185293+0000","last_became_active":"2024-03-04T12:20:20.841801+0000","last_became_peered":"2024-03-04T12:20:20.841801+0000","last_unstale":"2024-03-04T13:13:21.185293+0000","last_undegraded":"2024-03-04T13:13:21.185293+0000","last_fullsized":"2024-03-04T13:13:21.185293+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:58:24.485585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7601,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":303,"num_write":134,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"255'492","reported_seq":1885,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.936078+0000","last_change":"2024-03-04T12:20:22.857881+0000","last_active":"2024-03-04T13:13:20.936078+0000","last_peered":"2024-03-04T13:13:20.936078+0000","last_clean":"2024-03-04T13:13:20.936078+0000","last_became_active":"2024-03-04T12:20:22.857578+0000","last_became_peered":"2024-03-04T12:20:22.857578+0000","last_unstale":"2024-03-04T13:13:20.936078+0000","last_undegraded":"2024-03-04T13:13:20.936078+0000","last_fullsized":"2024-03-04T13:13:20.936078+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:27:44.703793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"255'108","reported_seq":590,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.581000+0000","last_change":"2024-03-04T12:20:24.867786+0000","last_active":"2024-03-04T13:12:22.581000+0000","last_peered":"2024-03-04T13:12:22.581000+0000","last_clean":"2024-03-04T13:12:22.581000+0000","last_became_active":"2024-03-04T12:20:24.867482+0000","last_became_peered":"2024-03-04T12:20:24.867482+0000","last_unstale":"2024-03-04T13:12:22.581000+0000","last_undegraded":"2024-03-04T13:12:22.581000+0000","last_fullsized":"2024-03-04T13:12:22.581000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:09:06.813366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":731,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":256,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"255'343","reported_seq":1943,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.059046+0000","last_change":"2024-03-04T12:20:16.819106+0000","last_active":"2024-03-04T13:12:18.059046+0000","last_peered":"2024-03-04T13:12:18.059046+0000","last_clean":"2024-03-04T13:12:18.059046+0000","last_became_active":"2024-03-04T12:20:16.818795+0000","last_became_peered":"2024-03-04T12:20:16.818795+0000","last_unstale":"2024-03-04T13:12:18.059046+0000","last_undegraded":"2024-03-04T13:12:18.059046+0000","last_fullsized":"2024-03-04T13:12:18.059046+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:22:29.845769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2162,"num_read_kb":2105,"num_write":376,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"255'220","reported_seq":839,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.207201+0000","last_change":"2024-03-04T12:20:14.818157+0000","last_active":"2024-03-04T13:13:21.207201+0000","last_peered":"2024-03-04T13:13:21.207201+0000","last_clean":"2024-03-04T13:13:21.207201+0000","last_became_active":"2024-03-04T12:20:14.817859+0000","last_became_peered":"2024-03-04T12:20:14.817859+0000","last_unstale":"2024-03-04T13:13:21.207201+0000","last_undegraded":"2024-03-04T13:13:21.207201+0000","last_fullsized":"2024-03-04T13:13:21.207201+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:00.268672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":387,"num_read_kb":14098,"num_write":1105,"num_write_kb":34013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":1101,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.713803+0000","last_change":"2024-03-04T12:20:18.839281+0000","last_active":"2024-03-04T13:13:20.713803+0000","last_peered":"2024-03-04T13:13:20.713803+0000","last_clean":"2024-03-04T13:13:20.713803+0000","last_became_active":"2024-03-04T12:20:18.838389+0000","last_became_peered":"2024-03-04T12:20:18.838389+0000","last_unstale":"2024-03-04T13:13:20.713803+0000","last_undegraded":"2024-03-04T13:13:20.713803+0000","last_fullsized":"2024-03-04T13:13:20.713803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:57.735142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":615,"num_read_kb":615,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"255'101","reported_seq":608,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.392687+0000","last_change":"2024-03-04T12:20:21.642158+0000","last_active":"2024-03-04T13:10:53.392687+0000","last_peered":"2024-03-04T13:10:53.392687+0000","last_clean":"2024-03-04T13:10:53.392687+0000","last_became_active":"2024-03-04T12:20:21.641809+0000","last_became_peered":"2024-03-04T12:20:21.641809+0000","last_unstale":"2024-03-04T13:10:53.392687+0000","last_undegraded":"2024-03-04T13:10:53.392687+0000","last_fullsized":"2024-03-04T13:10:53.392687+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:46:54.198373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":103,"num_read_kb":92,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"255'498","reported_seq":2278,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.937077+0000","last_change":"2024-03-04T12:20:22.849616+0000","last_active":"2024-03-04T13:13:20.937077+0000","last_peered":"2024-03-04T13:13:20.937077+0000","last_clean":"2024-03-04T13:13:20.937077+0000","last_became_active":"2024-03-04T12:20:22.849288+0000","last_became_peered":"2024-03-04T12:20:22.849288+0000","last_unstale":"2024-03-04T13:13:20.937077+0000","last_undegraded":"2024-03-04T13:13:20.937077+0000","last_fullsized":"2024-03-04T13:13:20.937077+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:38:12.869906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"255'87","reported_seq":571,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:30.968772+0000","last_change":"2024-03-04T12:20:24.870938+0000","last_active":"2024-03-04T13:10:30.968772+0000","last_peered":"2024-03-04T13:10:30.968772+0000","last_clean":"2024-03-04T13:10:30.968772+0000","last_became_active":"2024-03-04T12:20:24.870568+0000","last_became_peered":"2024-03-04T12:20:24.870568+0000","last_unstale":"2024-03-04T13:10:30.968772+0000","last_undegraded":"2024-03-04T13:10:30.968772+0000","last_fullsized":"2024-03-04T13:10:30.968772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:41:06.369980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":82,"num_read_kb":81,"num_write":219,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"255'297","reported_seq":1655,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.745392+0000","last_change":"2024-03-04T12:20:16.831299+0000","last_active":"2024-03-04T13:12:12.745392+0000","last_peered":"2024-03-04T13:12:12.745392+0000","last_clean":"2024-03-04T13:12:12.745392+0000","last_became_active":"2024-03-04T12:20:16.831001+0000","last_became_peered":"2024-03-04T12:20:16.831001+0000","last_unstale":"2024-03-04T13:12:12.745392+0000","last_undegraded":"2024-03-04T13:12:12.745392+0000","last_fullsized":"2024-03-04T13:12:12.745392+0000","mapping_epoch":22,"log_start":"255'200","ondisk_log_start":"255'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:17:15.203257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1692,"num_read_kb":1639,"num_write":326,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"255'199","reported_seq":821,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.172765+0000","last_change":"2024-03-04T12:20:14.813162+0000","last_active":"2024-03-04T13:13:21.172765+0000","last_peered":"2024-03-04T13:13:21.172765+0000","last_clean":"2024-03-04T13:13:21.172765+0000","last_became_active":"2024-03-04T12:20:14.812881+0000","last_became_peered":"2024-03-04T12:20:14.812881+0000","last_unstale":"2024-03-04T13:13:21.172765+0000","last_undegraded":"2024-03-04T13:13:21.172765+0000","last_fullsized":"2024-03-04T13:13:21.172765+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:50:49.495670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6401060,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":24185,"num_write":1082,"num_write_kb":42346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.494731+0000","last_change":"2024-03-04T12:20:18.836790+0000","last_active":"2024-03-04T13:09:52.494731+0000","last_peered":"2024-03-04T13:09:52.494731+0000","last_clean":"2024-03-04T13:09:52.494731+0000","last_became_active":"2024-03-04T12:20:18.836493+0000","last_became_peered":"2024-03-04T12:20:18.836493+0000","last_unstale":"2024-03-04T13:09:52.494731+0000","last_undegraded":"2024-03-04T13:09:52.494731+0000","last_fullsized":"2024-03-04T13:09:52.494731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:56.713786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"255'249","reported_seq":846,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.074245+0000","last_change":"2024-03-04T12:20:20.839419+0000","last_active":"2024-03-04T13:13:21.074245+0000","last_peered":"2024-03-04T13:13:21.074245+0000","last_clean":"2024-03-04T13:13:21.074245+0000","last_became_active":"2024-03-04T12:20:20.839079+0000","last_became_peered":"2024-03-04T12:20:20.839079+0000","last_unstale":"2024-03-04T13:13:21.074245+0000","last_undegraded":"2024-03-04T13:13:21.074245+0000","last_fullsized":"2024-03-04T13:13:21.074245+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:59:03.433466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7172,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":931,"num_read_kb":985,"num_write":1462,"num_write_kb":1319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.476116+0000","last_change":"2024-03-04T12:20:22.855248+0000","last_active":"2024-03-04T13:09:52.476116+0000","last_peered":"2024-03-04T13:09:52.476116+0000","last_clean":"2024-03-04T13:09:52.476116+0000","last_became_active":"2024-03-04T12:20:22.854860+0000","last_became_peered":"2024-03-04T12:20:22.854860+0000","last_unstale":"2024-03-04T13:09:52.476116+0000","last_undegraded":"2024-03-04T13:09:52.476116+0000","last_fullsized":"2024-03-04T13:09:52.476116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:11.625286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"255'104","reported_seq":584,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.544052+0000","last_change":"2024-03-04T12:20:24.866168+0000","last_active":"2024-03-04T13:10:27.544052+0000","last_peered":"2024-03-04T13:10:27.544052+0000","last_clean":"2024-03-04T13:10:27.544052+0000","last_became_active":"2024-03-04T12:20:24.865830+0000","last_became_peered":"2024-03-04T12:20:24.865830+0000","last_unstale":"2024-03-04T13:10:27.544052+0000","last_undegraded":"2024-03-04T13:10:27.544052+0000","last_fullsized":"2024-03-04T13:10:27.544052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:24:29.311908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":242,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"255'318","reported_seq":1695,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.078010+0000","last_change":"2024-03-04T12:20:16.821797+0000","last_active":"2024-03-04T13:12:18.078010+0000","last_peered":"2024-03-04T13:12:18.078010+0000","last_clean":"2024-03-04T13:12:18.078010+0000","last_became_active":"2024-03-04T12:20:16.821495+0000","last_became_peered":"2024-03-04T12:20:16.821495+0000","last_unstale":"2024-03-04T13:12:18.078010+0000","last_undegraded":"2024-03-04T13:12:18.078010+0000","last_fullsized":"2024-03-04T13:12:18.078010+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:21:21.722236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1811,"num_read_kb":1736,"num_write":364,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":664,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497781+0000","last_change":"2024-03-04T12:19:58.807747+0000","last_active":"2024-03-04T13:10:12.497781+0000","last_peered":"2024-03-04T13:10:12.497781+0000","last_clean":"2024-03-04T13:10:12.497781+0000","last_became_active":"2024-03-04T12:19:58.806723+0000","last_became_peered":"2024-03-04T12:19:58.806723+0000","last_unstale":"2024-03-04T13:10:12.497781+0000","last_undegraded":"2024-03-04T13:10:12.497781+0000","last_fullsized":"2024-03-04T13:10:12.497781+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:19:57.750293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:19:57.750293+0000","last_clean_scrub_stamp":"2024-03-04T12:19:57.750293+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:53:17.368805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":500,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.353364+0000","last_change":"2024-03-04T12:20:05.783212+0000","last_active":"2024-03-04T13:10:07.353364+0000","last_peered":"2024-03-04T13:10:07.353364+0000","last_clean":"2024-03-04T13:10:07.353364+0000","last_became_active":"2024-03-04T12:20:05.782921+0000","last_became_peered":"2024-03-04T12:20:05.782921+0000","last_unstale":"2024-03-04T13:10:07.353364+0000","last_undegraded":"2024-03-04T13:10:07.353364+0000","last_fullsized":"2024-03-04T13:10:07.353364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:47.241725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"255'172","reported_seq":785,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.103293+0000","last_change":"2024-03-04T12:20:51.032035+0000","last_active":"2024-03-04T13:13:21.103293+0000","last_peered":"2024-03-04T13:13:21.103293+0000","last_clean":"2024-03-04T13:13:21.103293+0000","last_became_active":"2024-03-04T12:20:51.031720+0000","last_became_peered":"2024-03-04T12:20:51.031720+0000","last_unstale":"2024-03-04T13:13:21.103293+0000","last_undegraded":"2024-03-04T13:13:21.103293+0000","last_fullsized":"2024-03-04T13:13:21.103293+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:35:26.492810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263538,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":417,"num_read_kb":68206,"num_write":949,"num_write_kb":44048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":493,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499605+0000","last_change":"2024-03-04T12:20:18.830022+0000","last_active":"2024-03-04T13:10:22.499605+0000","last_peered":"2024-03-04T13:10:22.499605+0000","last_clean":"2024-03-04T13:10:22.499605+0000","last_became_active":"2024-03-04T12:20:18.829703+0000","last_became_peered":"2024-03-04T12:20:18.829703+0000","last_unstale":"2024-03-04T13:10:22.499605+0000","last_undegraded":"2024-03-04T13:10:22.499605+0000","last_fullsized":"2024-03-04T13:10:22.499605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:01:37.596430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"255'312","reported_seq":1000,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.167644+0000","last_change":"2024-03-04T12:20:20.842756+0000","last_active":"2024-03-04T13:13:21.167644+0000","last_peered":"2024-03-04T13:13:21.167644+0000","last_clean":"2024-03-04T13:13:21.167644+0000","last_became_active":"2024-03-04T12:20:20.842433+0000","last_became_peered":"2024-03-04T12:20:20.842433+0000","last_unstale":"2024-03-04T13:13:21.167644+0000","last_undegraded":"2024-03-04T13:13:21.167644+0000","last_fullsized":"2024-03-04T13:13:21.167644+0000","mapping_epoch":26,"log_start":"255'300","ondisk_log_start":"255'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:13:17.760985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34072,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":590,"num_read_kb":823,"num_write":540,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":472,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.445437+0000","last_change":"2024-03-04T12:20:22.849592+0000","last_active":"2024-03-04T13:10:12.445437+0000","last_peered":"2024-03-04T13:10:12.445437+0000","last_clean":"2024-03-04T13:10:12.445437+0000","last_became_active":"2024-03-04T12:20:22.849274+0000","last_became_peered":"2024-03-04T12:20:22.849274+0000","last_unstale":"2024-03-04T13:10:12.445437+0000","last_undegraded":"2024-03-04T13:10:12.445437+0000","last_fullsized":"2024-03-04T13:10:12.445437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:15:45.671251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"255'108","reported_seq":598,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.765516+0000","last_change":"2024-03-04T12:20:24.865055+0000","last_active":"2024-03-04T13:11:27.765516+0000","last_peered":"2024-03-04T13:11:27.765516+0000","last_clean":"2024-03-04T13:11:27.765516+0000","last_became_active":"2024-03-04T12:20:24.864796+0000","last_became_peered":"2024-03-04T12:20:24.864796+0000","last_unstale":"2024-03-04T13:11:27.765516+0000","last_undegraded":"2024-03-04T13:11:27.765516+0000","last_fullsized":"2024-03-04T13:11:27.765516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:46:49.314439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":748,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":267,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"255'391","reported_seq":1914,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.309517+0000","last_change":"2024-03-04T12:20:16.836409+0000","last_active":"2024-03-04T13:12:39.309517+0000","last_peered":"2024-03-04T13:12:39.309517+0000","last_clean":"2024-03-04T13:12:39.309517+0000","last_became_active":"2024-03-04T12:20:16.836050+0000","last_became_peered":"2024-03-04T12:20:16.836050+0000","last_unstale":"2024-03-04T13:12:39.309517+0000","last_undegraded":"2024-03-04T13:12:39.309517+0000","last_fullsized":"2024-03-04T13:12:39.309517+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:34:01.964185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2110,"num_read_kb":2020,"num_write":444,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":508,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498621+0000","last_change":"2024-03-04T12:20:05.781479+0000","last_active":"2024-03-04T13:10:17.498621+0000","last_peered":"2024-03-04T13:10:17.498621+0000","last_clean":"2024-03-04T13:10:17.498621+0000","last_became_active":"2024-03-04T12:20:05.781199+0000","last_became_peered":"2024-03-04T12:20:05.781199+0000","last_unstale":"2024-03-04T13:10:17.498621+0000","last_undegraded":"2024-03-04T13:10:17.498621+0000","last_fullsized":"2024-03-04T13:10:17.498621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:44.684083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"255'204","reported_seq":828,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.101882+0000","last_change":"2024-03-04T12:20:14.821799+0000","last_active":"2024-03-04T13:13:21.101882+0000","last_peered":"2024-03-04T13:13:21.101882+0000","last_clean":"2024-03-04T13:13:21.101882+0000","last_became_active":"2024-03-04T12:20:14.821540+0000","last_became_peered":"2024-03-04T12:20:14.821540+0000","last_unstale":"2024-03-04T13:13:21.101882+0000","last_undegraded":"2024-03-04T13:13:21.101882+0000","last_fullsized":"2024-03-04T13:13:21.101882+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:53.300740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":43110,"num_write":1111,"num_write_kb":41335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.354153+0000","last_change":"2024-03-04T12:20:18.836025+0000","last_active":"2024-03-04T13:10:12.354153+0000","last_peered":"2024-03-04T13:10:12.354153+0000","last_clean":"2024-03-04T13:10:12.354153+0000","last_became_active":"2024-03-04T12:20:18.835509+0000","last_became_peered":"2024-03-04T12:20:18.835509+0000","last_unstale":"2024-03-04T13:10:12.354153+0000","last_undegraded":"2024-03-04T13:10:12.354153+0000","last_fullsized":"2024-03-04T13:10:12.354153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:20.235577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"255'693","reported_seq":2154,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:17.045647+0000","last_change":"2024-03-04T12:20:20.838876+0000","last_active":"2024-03-04T13:13:17.045647+0000","last_peered":"2024-03-04T13:13:17.045647+0000","last_clean":"2024-03-04T13:13:17.045647+0000","last_became_active":"2024-03-04T12:20:20.838633+0000","last_became_peered":"2024-03-04T12:20:20.838633+0000","last_unstale":"2024-03-04T13:13:17.045647+0000","last_undegraded":"2024-03-04T13:13:17.045647+0000","last_fullsized":"2024-03-04T13:13:17.045647+0000","mapping_epoch":26,"log_start":"255'600","ondisk_log_start":"255'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:22:41.132219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35283,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":944,"num_read_kb":1133,"num_write":338,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.501338+0000","last_change":"2024-03-04T12:20:22.848790+0000","last_active":"2024-03-04T13:10:32.501338+0000","last_peered":"2024-03-04T13:10:32.501338+0000","last_clean":"2024-03-04T13:10:32.501338+0000","last_became_active":"2024-03-04T12:20:22.848403+0000","last_became_peered":"2024-03-04T12:20:22.848403+0000","last_unstale":"2024-03-04T13:10:32.501338+0000","last_undegraded":"2024-03-04T13:10:32.501338+0000","last_fullsized":"2024-03-04T13:10:32.501338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:12:33.606788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"255'84","reported_seq":571,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.786585+0000","last_change":"2024-03-04T12:20:24.911878+0000","last_active":"2024-03-04T13:12:34.786585+0000","last_peered":"2024-03-04T13:12:34.786585+0000","last_clean":"2024-03-04T13:12:34.786585+0000","last_became_active":"2024-03-04T12:20:24.911303+0000","last_became_peered":"2024-03-04T12:20:24.911303+0000","last_unstale":"2024-03-04T13:12:34.786585+0000","last_undegraded":"2024-03-04T13:12:34.786585+0000","last_fullsized":"2024-03-04T13:12:34.786585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:38:09.768192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":85,"num_write":192,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"255'417","reported_seq":2050,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573274+0000","last_change":"2024-03-04T12:20:16.828170+0000","last_active":"2024-03-04T13:12:50.573274+0000","last_peered":"2024-03-04T13:12:50.573274+0000","last_clean":"2024-03-04T13:12:50.573274+0000","last_became_active":"2024-03-04T12:20:16.827513+0000","last_became_peered":"2024-03-04T12:20:16.827513+0000","last_unstale":"2024-03-04T13:12:50.573274+0000","last_undegraded":"2024-03-04T13:12:50.573274+0000","last_fullsized":"2024-03-04T13:12:50.573274+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:45:19.736683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2343,"num_read_kb":2241,"num_write":475,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":501,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.439427+0000","last_change":"2024-03-04T12:20:05.864062+0000","last_active":"2024-03-04T13:10:07.439427+0000","last_peered":"2024-03-04T13:10:07.439427+0000","last_clean":"2024-03-04T13:10:07.439427+0000","last_became_active":"2024-03-04T12:20:05.863125+0000","last_became_peered":"2024-03-04T12:20:05.863125+0000","last_unstale":"2024-03-04T13:10:07.439427+0000","last_undegraded":"2024-03-04T13:10:07.439427+0000","last_fullsized":"2024-03-04T13:10:07.439427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:25.960438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"255'165","reported_seq":746,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.449594+0000","last_change":"2024-03-04T12:20:14.813050+0000","last_active":"2024-03-04T13:12:07.449594+0000","last_peered":"2024-03-04T13:12:07.449594+0000","last_clean":"2024-03-04T13:12:07.449594+0000","last_became_active":"2024-03-04T12:20:14.812722+0000","last_became_peered":"2024-03-04T12:20:14.812722+0000","last_unstale":"2024-03-04T13:12:07.449594+0000","last_undegraded":"2024-03-04T13:12:07.449594+0000","last_fullsized":"2024-03-04T13:12:07.449594+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:14.492385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7550492,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":307,"num_read_kb":18084,"num_write":973,"num_write_kb":46336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.439970+0000","last_change":"2024-03-04T12:20:18.839341+0000","last_active":"2024-03-04T13:10:12.439970+0000","last_peered":"2024-03-04T13:10:12.439970+0000","last_clean":"2024-03-04T13:10:12.439970+0000","last_became_active":"2024-03-04T12:20:18.839038+0000","last_became_peered":"2024-03-04T12:20:18.839038+0000","last_unstale":"2024-03-04T13:10:12.439970+0000","last_undegraded":"2024-03-04T13:10:12.439970+0000","last_fullsized":"2024-03-04T13:10:12.439970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:51.813750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"255'245","reported_seq":1416,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.332033+0000","last_change":"2024-03-04T12:20:21.643795+0000","last_active":"2024-03-04T13:13:14.332033+0000","last_peered":"2024-03-04T13:13:14.332033+0000","last_clean":"2024-03-04T13:13:14.332033+0000","last_became_active":"2024-03-04T12:20:21.643475+0000","last_became_peered":"2024-03-04T12:20:21.643475+0000","last_unstale":"2024-03-04T13:13:14.332033+0000","last_undegraded":"2024-03-04T13:13:14.332033+0000","last_fullsized":"2024-03-04T13:13:14.332033+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:03:47.701687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":203,"num_write":195,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":473,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.446723+0000","last_change":"2024-03-04T12:20:22.854718+0000","last_active":"2024-03-04T13:10:22.446723+0000","last_peered":"2024-03-04T13:10:22.446723+0000","last_clean":"2024-03-04T13:10:22.446723+0000","last_became_active":"2024-03-04T12:20:22.854343+0000","last_became_peered":"2024-03-04T12:20:22.854343+0000","last_unstale":"2024-03-04T13:10:22.446723+0000","last_undegraded":"2024-03-04T13:10:22.446723+0000","last_fullsized":"2024-03-04T13:10:22.446723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:03:53.997420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"255'188","reported_seq":699,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:56.712390+0000","last_change":"2024-03-04T12:20:24.871310+0000","last_active":"2024-03-04T13:11:56.712390+0000","last_peered":"2024-03-04T13:11:56.712390+0000","last_clean":"2024-03-04T13:11:56.712390+0000","last_became_active":"2024-03-04T12:20:24.871020+0000","last_became_peered":"2024-03-04T12:20:24.871020+0000","last_unstale":"2024-03-04T13:11:56.712390+0000","last_undegraded":"2024-03-04T13:11:56.712390+0000","last_fullsized":"2024-03-04T13:11:56.712390+0000","mapping_epoch":30,"log_start":"250'100","ondisk_log_start":"250'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:50:33.268463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":353,"num_read_kb":362,"num_write":419,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"255'387","reported_seq":1852,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.953201+0000","last_change":"2024-03-04T12:20:16.825718+0000","last_active":"2024-03-04T13:12:36.953201+0000","last_peered":"2024-03-04T13:12:36.953201+0000","last_clean":"2024-03-04T13:12:36.953201+0000","last_became_active":"2024-03-04T12:20:16.825006+0000","last_became_peered":"2024-03-04T12:20:16.825006+0000","last_unstale":"2024-03-04T13:12:36.953201+0000","last_undegraded":"2024-03-04T13:12:36.953201+0000","last_fullsized":"2024-03-04T13:12:36.953201+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:46.542834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2027,"num_read_kb":1928,"num_write":438,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":500,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.353341+0000","last_change":"2024-03-04T12:20:05.783217+0000","last_active":"2024-03-04T13:10:07.353341+0000","last_peered":"2024-03-04T13:10:07.353341+0000","last_clean":"2024-03-04T13:10:07.353341+0000","last_became_active":"2024-03-04T12:20:05.782897+0000","last_became_peered":"2024-03-04T12:20:05.782897+0000","last_unstale":"2024-03-04T13:10:07.353341+0000","last_undegraded":"2024-03-04T13:10:07.353341+0000","last_fullsized":"2024-03-04T13:10:07.353341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:51:54.079894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"255'200","reported_seq":874,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.137782+0000","last_change":"2024-03-04T12:20:14.825079+0000","last_active":"2024-03-04T13:13:21.137782+0000","last_peered":"2024-03-04T13:13:21.137782+0000","last_clean":"2024-03-04T13:13:21.137782+0000","last_became_active":"2024-03-04T12:20:14.824810+0000","last_became_peered":"2024-03-04T12:20:14.824810+0000","last_unstale":"2024-03-04T13:13:21.137782+0000","last_undegraded":"2024-03-04T13:13:21.137782+0000","last_fullsized":"2024-03-04T13:13:21.137782+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:26:24.671565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3544974,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":19088,"num_write":1144,"num_write_kb":38256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.447280+0000","last_change":"2024-03-04T12:20:18.833327+0000","last_active":"2024-03-04T13:10:27.447280+0000","last_peered":"2024-03-04T13:10:27.447280+0000","last_clean":"2024-03-04T13:10:27.447280+0000","last_became_active":"2024-03-04T12:20:18.833051+0000","last_became_peered":"2024-03-04T12:20:18.833051+0000","last_unstale":"2024-03-04T13:10:27.447280+0000","last_undegraded":"2024-03-04T13:10:27.447280+0000","last_fullsized":"2024-03-04T13:10:27.447280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:42:25.419408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"255'125","reported_seq":654,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.300078+0000","last_change":"2024-03-04T12:20:20.845424+0000","last_active":"2024-03-04T13:10:53.300078+0000","last_peered":"2024-03-04T13:10:53.300078+0000","last_clean":"2024-03-04T13:10:53.300078+0000","last_became_active":"2024-03-04T12:20:20.845192+0000","last_became_peered":"2024-03-04T12:20:20.845192+0000","last_unstale":"2024-03-04T13:10:53.300078+0000","last_undegraded":"2024-03-04T13:10:53.300078+0000","last_fullsized":"2024-03-04T13:10:53.300078+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:32:04.776537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":155,"num_read_kb":149,"num_write":110,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.478882+0000","last_change":"2024-03-04T12:20:22.853030+0000","last_active":"2024-03-04T13:10:12.478882+0000","last_peered":"2024-03-04T13:10:12.478882+0000","last_clean":"2024-03-04T13:10:12.478882+0000","last_became_active":"2024-03-04T12:20:22.852745+0000","last_became_peered":"2024-03-04T12:20:22.852745+0000","last_unstale":"2024-03-04T13:10:12.478882+0000","last_undegraded":"2024-03-04T13:10:12.478882+0000","last_fullsized":"2024-03-04T13:10:12.478882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:47:11.374457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"255'85","reported_seq":579,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.354798+0000","last_change":"2024-03-04T12:20:24.865098+0000","last_active":"2024-03-04T13:10:17.354798+0000","last_peered":"2024-03-04T13:10:17.354798+0000","last_clean":"2024-03-04T13:10:17.354798+0000","last_became_active":"2024-03-04T12:20:24.864783+0000","last_became_peered":"2024-03-04T12:20:24.864783+0000","last_unstale":"2024-03-04T13:10:17.354798+0000","last_undegraded":"2024-03-04T13:10:17.354798+0000","last_fullsized":"2024-03-04T13:10:17.354798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:20:08.408598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":204,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"255'443","reported_seq":1900,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.307923+0000","last_change":"2024-03-04T12:20:16.827086+0000","last_active":"2024-03-04T13:12:39.307923+0000","last_peered":"2024-03-04T13:12:39.307923+0000","last_clean":"2024-03-04T13:12:39.307923+0000","last_became_active":"2024-03-04T12:20:16.826823+0000","last_became_peered":"2024-03-04T12:20:16.826823+0000","last_unstale":"2024-03-04T13:12:39.307923+0000","last_undegraded":"2024-03-04T13:12:39.307923+0000","last_fullsized":"2024-03-04T13:12:39.307923+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:21:23.072626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2302,"num_read_kb":2131,"num_write":558,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"255'158","reported_seq":753,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:09.809682+0000","last_change":"2024-03-04T12:20:14.819761+0000","last_active":"2024-03-04T13:13:09.809682+0000","last_peered":"2024-03-04T13:13:09.809682+0000","last_clean":"2024-03-04T13:13:09.809682+0000","last_became_active":"2024-03-04T12:20:14.819483+0000","last_became_peered":"2024-03-04T12:20:14.819483+0000","last_unstale":"2024-03-04T13:13:09.809682+0000","last_undegraded":"2024-03-04T13:13:09.809682+0000","last_fullsized":"2024-03-04T13:13:09.809682+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:40.255499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553728,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":336,"num_read_kb":12779,"num_write":962,"num_write_kb":35384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":501,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.541882+0000","last_change":"2024-03-04T12:20:05.863592+0000","last_active":"2024-03-04T13:10:07.541882+0000","last_peered":"2024-03-04T13:10:07.541882+0000","last_clean":"2024-03-04T13:10:07.541882+0000","last_became_active":"2024-03-04T12:20:05.863311+0000","last_became_peered":"2024-03-04T12:20:05.863311+0000","last_unstale":"2024-03-04T13:10:07.541882+0000","last_undegraded":"2024-03-04T13:10:07.541882+0000","last_fullsized":"2024-03-04T13:10:07.541882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:19:53.481187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.446710+0000","last_change":"2024-03-04T12:20:18.832677+0000","last_active":"2024-03-04T13:10:22.446710+0000","last_peered":"2024-03-04T13:10:22.446710+0000","last_clean":"2024-03-04T13:10:22.446710+0000","last_became_active":"2024-03-04T12:20:18.832355+0000","last_became_peered":"2024-03-04T12:20:18.832355+0000","last_unstale":"2024-03-04T13:10:22.446710+0000","last_undegraded":"2024-03-04T13:10:22.446710+0000","last_fullsized":"2024-03-04T13:10:22.446710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:36:45.490990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"255'260","reported_seq":909,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.175827+0000","last_change":"2024-03-04T12:20:20.842632+0000","last_active":"2024-03-04T13:13:21.175827+0000","last_peered":"2024-03-04T13:13:21.175827+0000","last_clean":"2024-03-04T13:13:21.175827+0000","last_became_active":"2024-03-04T12:20:20.842330+0000","last_became_peered":"2024-03-04T12:20:20.842330+0000","last_unstale":"2024-03-04T13:13:21.175827+0000","last_undegraded":"2024-03-04T13:13:21.175827+0000","last_fullsized":"2024-03-04T13:13:21.175827+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:06:51.329907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11717,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":373,"num_read_kb":489,"num_write":198,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":483,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499455+0000","last_change":"2024-03-04T12:20:22.854985+0000","last_active":"2024-03-04T13:10:22.499455+0000","last_peered":"2024-03-04T13:10:22.499455+0000","last_clean":"2024-03-04T13:10:22.499455+0000","last_became_active":"2024-03-04T12:20:22.854507+0000","last_became_peered":"2024-03-04T12:20:22.854507+0000","last_unstale":"2024-03-04T13:10:22.499455+0000","last_undegraded":"2024-03-04T13:10:22.499455+0000","last_fullsized":"2024-03-04T13:10:22.499455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:46:38.735735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"255'106","reported_seq":591,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:17.346925+0000","last_change":"2024-03-04T12:20:24.912422+0000","last_active":"2024-03-04T13:11:17.346925+0000","last_peered":"2024-03-04T13:11:17.346925+0000","last_clean":"2024-03-04T13:11:17.346925+0000","last_became_active":"2024-03-04T12:20:24.911970+0000","last_became_peered":"2024-03-04T12:20:24.911970+0000","last_unstale":"2024-03-04T13:11:17.346925+0000","last_undegraded":"2024-03-04T13:11:17.346925+0000","last_fullsized":"2024-03-04T13:11:17.346925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:21:27.924509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":120,"num_write":241,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"255'321","reported_seq":1676,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.075729+0000","last_change":"2024-03-04T12:20:16.825499+0000","last_active":"2024-03-04T13:12:18.075729+0000","last_peered":"2024-03-04T13:12:18.075729+0000","last_clean":"2024-03-04T13:12:18.075729+0000","last_became_active":"2024-03-04T12:20:16.825241+0000","last_became_peered":"2024-03-04T12:20:16.825241+0000","last_unstale":"2024-03-04T13:12:18.075729+0000","last_undegraded":"2024-03-04T13:12:18.075729+0000","last_fullsized":"2024-03-04T13:12:18.075729+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:35:19.260142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1925,"num_read_kb":1835,"num_write":376,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"255'162","reported_seq":753,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:19.640793+0000","last_change":"2024-03-04T12:20:14.816111+0000","last_active":"2024-03-04T13:12:19.640793+0000","last_peered":"2024-03-04T13:12:19.640793+0000","last_clean":"2024-03-04T13:12:19.640793+0000","last_became_active":"2024-03-04T12:20:14.815589+0000","last_became_peered":"2024-03-04T12:20:14.815589+0000","last_unstale":"2024-03-04T13:12:19.640793+0000","last_undegraded":"2024-03-04T13:12:19.640793+0000","last_fullsized":"2024-03-04T13:12:19.640793+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:18:53.206330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11384047,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":367,"num_read_kb":3319,"num_write":965,"num_write_kb":11696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":507,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498811+0000","last_change":"2024-03-04T12:20:05.863980+0000","last_active":"2024-03-04T13:10:17.498811+0000","last_peered":"2024-03-04T13:10:17.498811+0000","last_clean":"2024-03-04T13:10:17.498811+0000","last_became_active":"2024-03-04T12:20:05.863682+0000","last_became_peered":"2024-03-04T12:20:05.863682+0000","last_unstale":"2024-03-04T13:10:17.498811+0000","last_undegraded":"2024-03-04T13:10:17.498811+0000","last_fullsized":"2024-03-04T13:10:17.498811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:13.302689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.480354+0000","last_change":"2024-03-04T12:20:18.834213+0000","last_active":"2024-03-04T13:10:22.480354+0000","last_peered":"2024-03-04T13:10:22.480354+0000","last_clean":"2024-03-04T13:10:22.480354+0000","last_became_active":"2024-03-04T12:20:18.833896+0000","last_became_peered":"2024-03-04T12:20:18.833896+0000","last_unstale":"2024-03-04T13:10:22.480354+0000","last_undegraded":"2024-03-04T13:10:22.480354+0000","last_fullsized":"2024-03-04T13:10:22.480354+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:39:33.270747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"255'200","reported_seq":755,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:53.809580+0000","last_change":"2024-03-04T12:20:21.642318+0000","last_active":"2024-03-04T13:12:53.809580+0000","last_peered":"2024-03-04T13:12:53.809580+0000","last_clean":"2024-03-04T13:12:53.809580+0000","last_became_active":"2024-03-04T12:20:21.641826+0000","last_became_peered":"2024-03-04T12:20:21.641826+0000","last_unstale":"2024-03-04T13:12:53.809580+0000","last_undegraded":"2024-03-04T13:12:53.809580+0000","last_fullsized":"2024-03-04T13:12:53.809580+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:07:56.018494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":255,"num_read_kb":248,"num_write":230,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"255'535","reported_seq":4185,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.933669+0000","last_change":"2024-03-04T12:20:22.853803+0000","last_active":"2024-03-04T13:13:20.933669+0000","last_peered":"2024-03-04T13:13:20.933669+0000","last_clean":"2024-03-04T13:13:20.933669+0000","last_became_active":"2024-03-04T12:20:22.853588+0000","last_became_peered":"2024-03-04T12:20:22.853588+0000","last_unstale":"2024-03-04T13:13:20.933669+0000","last_undegraded":"2024-03-04T13:13:20.933669+0000","last_fullsized":"2024-03-04T13:13:20.933669+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:04:32.122406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"255'115","reported_seq":592,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:17.465945+0000","last_change":"2024-03-04T12:20:24.911411+0000","last_active":"2024-03-04T13:12:17.465945+0000","last_peered":"2024-03-04T13:12:17.465945+0000","last_clean":"2024-03-04T13:12:17.465945+0000","last_became_active":"2024-03-04T12:20:24.911103+0000","last_became_peered":"2024-03-04T12:20:24.911103+0000","last_unstale":"2024-03-04T13:12:17.465945+0000","last_undegraded":"2024-03-04T13:12:17.465945+0000","last_fullsized":"2024-03-04T13:12:17.465945+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:20:46.488236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":105,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"255'1398","reported_seq":3054,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.328335+0000","last_change":"2024-03-04T12:20:16.834067+0000","last_active":"2024-03-04T13:12:39.328335+0000","last_peered":"2024-03-04T13:12:39.328335+0000","last_clean":"2024-03-04T13:12:39.328335+0000","last_became_active":"2024-03-04T12:20:16.833689+0000","last_became_peered":"2024-03-04T12:20:16.833689+0000","last_unstale":"2024-03-04T13:12:39.328335+0000","last_undegraded":"2024-03-04T13:12:39.328335+0000","last_fullsized":"2024-03-04T13:12:39.328335+0000","mapping_epoch":22,"log_start":"255'1300","ondisk_log_start":"255'1300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":1300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:28:45.636854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5949,"num_read_kb":5124,"num_write":2086,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"255'143","reported_seq":823,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:17.465937+0000","last_change":"2024-03-04T12:20:14.814534+0000","last_active":"2024-03-04T13:12:17.465937+0000","last_peered":"2024-03-04T13:12:17.465937+0000","last_clean":"2024-03-04T13:12:17.465937+0000","last_became_active":"2024-03-04T12:20:14.814220+0000","last_became_peered":"2024-03-04T12:20:14.814220+0000","last_unstale":"2024-03-04T13:12:17.465937+0000","last_undegraded":"2024-03-04T13:12:17.465937+0000","last_fullsized":"2024-03-04T13:12:17.465937+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:53.600042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262328,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":11189,"num_write":841,"num_write_kb":14687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":500,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:57.540873+0000","last_change":"2024-03-04T12:20:05.784418+0000","last_active":"2024-03-04T13:09:57.540873+0000","last_peered":"2024-03-04T13:09:57.540873+0000","last_clean":"2024-03-04T13:09:57.540873+0000","last_became_active":"2024-03-04T12:20:05.784145+0000","last_became_peered":"2024-03-04T12:20:05.784145+0000","last_unstale":"2024-03-04T13:09:57.540873+0000","last_undegraded":"2024-03-04T13:09:57.540873+0000","last_fullsized":"2024-03-04T13:09:57.540873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:41.291467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499426+0000","last_change":"2024-03-04T12:20:18.833379+0000","last_active":"2024-03-04T13:10:22.499426+0000","last_peered":"2024-03-04T13:10:22.499426+0000","last_clean":"2024-03-04T13:10:22.499426+0000","last_became_active":"2024-03-04T12:20:18.832932+0000","last_became_peered":"2024-03-04T12:20:18.832932+0000","last_unstale":"2024-03-04T13:10:22.499426+0000","last_undegraded":"2024-03-04T13:10:22.499426+0000","last_fullsized":"2024-03-04T13:10:22.499426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:38:57.403504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"255'109","reported_seq":641,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.740133+0000","last_change":"2024-03-04T12:20:20.841516+0000","last_active":"2024-03-04T13:10:53.740133+0000","last_peered":"2024-03-04T13:10:53.740133+0000","last_clean":"2024-03-04T13:10:53.740133+0000","last_became_active":"2024-03-04T12:20:20.841108+0000","last_became_peered":"2024-03-04T12:20:20.841108+0000","last_unstale":"2024-03-04T13:10:53.740133+0000","last_undegraded":"2024-03-04T13:10:53.740133+0000","last_fullsized":"2024-03-04T13:10:53.740133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:56:40.136670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":86,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"255'530","reported_seq":2283,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.937891+0000","last_change":"2024-03-04T12:20:22.859649+0000","last_active":"2024-03-04T13:13:20.937891+0000","last_peered":"2024-03-04T13:13:20.937891+0000","last_clean":"2024-03-04T13:13:20.937891+0000","last_became_active":"2024-03-04T12:20:22.859306+0000","last_became_peered":"2024-03-04T12:20:22.859306+0000","last_unstale":"2024-03-04T13:13:20.937891+0000","last_undegraded":"2024-03-04T13:13:20.937891+0000","last_fullsized":"2024-03-04T13:13:20.937891+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:16:12.502466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"255'153","reported_seq":634,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:02.370689+0000","last_change":"2024-03-04T12:20:24.866096+0000","last_active":"2024-03-04T13:10:02.370689+0000","last_peered":"2024-03-04T13:10:02.370689+0000","last_clean":"2024-03-04T13:10:02.370689+0000","last_became_active":"2024-03-04T12:20:24.865816+0000","last_became_peered":"2024-03-04T12:20:24.865816+0000","last_unstale":"2024-03-04T13:10:02.370689+0000","last_undegraded":"2024-03-04T13:10:02.370689+0000","last_fullsized":"2024-03-04T13:10:02.370689+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:36:25.465085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":201,"num_read_kb":201,"num_write":359,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"255'653","reported_seq":2055,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.558225+0000","last_change":"2024-03-04T12:20:16.825715+0000","last_active":"2024-03-04T13:12:22.558225+0000","last_peered":"2024-03-04T13:12:22.558225+0000","last_clean":"2024-03-04T13:12:22.558225+0000","last_became_active":"2024-03-04T12:20:16.825377+0000","last_became_peered":"2024-03-04T12:20:16.825377+0000","last_unstale":"2024-03-04T13:12:22.558225+0000","last_undegraded":"2024-03-04T13:12:22.558225+0000","last_fullsized":"2024-03-04T13:12:22.558225+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:24:08.216187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2990,"num_read_kb":2698,"num_write":869,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"255'180","reported_seq":872,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.021737+0000","last_change":"2024-03-04T12:20:14.812062+0000","last_active":"2024-03-04T13:13:21.021737+0000","last_peered":"2024-03-04T13:13:21.021737+0000","last_clean":"2024-03-04T13:13:21.021737+0000","last_became_active":"2024-03-04T12:20:14.811756+0000","last_became_peered":"2024-03-04T12:20:14.811756+0000","last_unstale":"2024-03-04T13:13:21.021737+0000","last_undegraded":"2024-03-04T13:13:21.021737+0000","last_fullsized":"2024-03-04T13:13:21.021737+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:10:50.920801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104383,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":578,"num_read_kb":172500,"num_write":1029,"num_write_kb":54165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":502,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:57.476776+0000","last_change":"2024-03-04T12:20:05.779688+0000","last_active":"2024-03-04T13:09:57.476776+0000","last_peered":"2024-03-04T13:09:57.476776+0000","last_clean":"2024-03-04T13:09:57.476776+0000","last_became_active":"2024-03-04T12:20:05.779370+0000","last_became_peered":"2024-03-04T12:20:05.779370+0000","last_unstale":"2024-03-04T13:09:57.476776+0000","last_undegraded":"2024-03-04T13:09:57.476776+0000","last_fullsized":"2024-03-04T13:09:57.476776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:52.901612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"32'3","reported_seq":795,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.704335+0000","last_change":"2024-03-04T12:20:18.833572+0000","last_active":"2024-03-04T13:13:20.704335+0000","last_peered":"2024-03-04T13:13:20.704335+0000","last_clean":"2024-03-04T13:13:20.704335+0000","last_became_active":"2024-03-04T12:20:18.833273+0000","last_became_peered":"2024-03-04T12:20:18.833273+0000","last_unstale":"2024-03-04T13:13:20.704335+0000","last_undegraded":"2024-03-04T13:13:20.704335+0000","last_fullsized":"2024-03-04T13:13:20.704335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:15.952949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":470,"num_read_kb":468,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"255'322","reported_seq":1037,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.213330+0000","last_change":"2024-03-04T12:20:21.643470+0000","last_active":"2024-03-04T13:13:21.213330+0000","last_peered":"2024-03-04T13:13:21.213330+0000","last_clean":"2024-03-04T13:13:21.213330+0000","last_became_active":"2024-03-04T12:20:21.642696+0000","last_became_peered":"2024-03-04T12:20:21.642696+0000","last_unstale":"2024-03-04T13:13:21.213330+0000","last_undegraded":"2024-03-04T13:13:21.213330+0000","last_fullsized":"2024-03-04T13:13:21.213330+0000","mapping_epoch":26,"log_start":"255'300","ondisk_log_start":"255'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:21:06.437125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17780,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":637,"num_write":242,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":475,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.453513+0000","last_change":"2024-03-04T12:20:22.853586+0000","last_active":"2024-03-04T13:10:22.453513+0000","last_peered":"2024-03-04T13:10:22.453513+0000","last_clean":"2024-03-04T13:10:22.453513+0000","last_became_active":"2024-03-04T12:20:22.853272+0000","last_became_peered":"2024-03-04T12:20:22.853272+0000","last_unstale":"2024-03-04T13:10:22.453513+0000","last_undegraded":"2024-03-04T13:10:22.453513+0000","last_fullsized":"2024-03-04T13:10:22.453513+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:23:01.588693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"255'108","reported_seq":582,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:03.491177+0000","last_change":"2024-03-04T12:20:24.864478+0000","last_active":"2024-03-04T13:10:03.491177+0000","last_peered":"2024-03-04T13:10:03.491177+0000","last_clean":"2024-03-04T13:10:03.491177+0000","last_became_active":"2024-03-04T12:20:24.863996+0000","last_became_peered":"2024-03-04T12:20:24.863996+0000","last_unstale":"2024-03-04T13:10:03.491177+0000","last_undegraded":"2024-03-04T13:10:03.491177+0000","last_fullsized":"2024-03-04T13:10:03.491177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:25:42.964622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":275,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"255'114","reported_seq":602,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:08.265674+0000","last_change":"2024-03-04T12:20:24.868945+0000","last_active":"2024-03-04T13:12:08.265674+0000","last_peered":"2024-03-04T13:12:08.265674+0000","last_clean":"2024-03-04T13:12:08.265674+0000","last_became_active":"2024-03-04T12:20:24.868636+0000","last_became_peered":"2024-03-04T12:20:24.868636+0000","last_unstale":"2024-03-04T13:12:08.265674+0000","last_undegraded":"2024-03-04T13:12:08.265674+0000","last_fullsized":"2024-03-04T13:12:08.265674+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:22:02.061168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":141,"num_write":275,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"255'387","reported_seq":1862,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573873+0000","last_change":"2024-03-04T12:20:16.823240+0000","last_active":"2024-03-04T13:12:50.573873+0000","last_peered":"2024-03-04T13:12:50.573873+0000","last_clean":"2024-03-04T13:12:50.573873+0000","last_became_active":"2024-03-04T12:20:16.822887+0000","last_became_peered":"2024-03-04T12:20:16.822887+0000","last_unstale":"2024-03-04T13:12:50.573873+0000","last_undegraded":"2024-03-04T13:12:50.573873+0000","last_fullsized":"2024-03-04T13:12:50.573873+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:22:42.786549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2100,"num_read_kb":1986,"num_write":448,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"255'173","reported_seq":777,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.066553+0000","last_change":"2024-03-04T12:20:14.824134+0000","last_active":"2024-03-04T13:13:21.066553+0000","last_peered":"2024-03-04T13:13:21.066553+0000","last_clean":"2024-03-04T13:13:21.066553+0000","last_became_active":"2024-03-04T12:20:14.823661+0000","last_became_peered":"2024-03-04T12:20:14.823661+0000","last_unstale":"2024-03-04T13:13:21.066553+0000","last_undegraded":"2024-03-04T13:13:21.066553+0000","last_fullsized":"2024-03-04T13:13:21.066553+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:36:15.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":384,"num_read_kb":10388,"num_write":1049,"num_write_kb":6576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":484,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.536495+0000","last_change":"2024-03-04T12:20:18.836980+0000","last_active":"2024-03-04T13:09:22.536495+0000","last_peered":"2024-03-04T13:09:22.536495+0000","last_clean":"2024-03-04T13:09:22.536495+0000","last_became_active":"2024-03-04T12:20:18.836487+0000","last_became_peered":"2024-03-04T12:20:18.836487+0000","last_unstale":"2024-03-04T13:09:22.536495+0000","last_undegraded":"2024-03-04T13:09:22.536495+0000","last_fullsized":"2024-03-04T13:09:22.536495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:57.938086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"255'141","reported_seq":701,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.110626+0000","last_change":"2024-03-04T12:20:20.841992+0000","last_active":"2024-03-04T13:13:21.110626+0000","last_peered":"2024-03-04T13:13:21.110626+0000","last_clean":"2024-03-04T13:13:21.110626+0000","last_became_active":"2024-03-04T12:20:20.841696+0000","last_became_peered":"2024-03-04T12:20:20.841696+0000","last_unstale":"2024-03-04T13:13:21.110626+0000","last_undegraded":"2024-03-04T13:13:21.110626+0000","last_fullsized":"2024-03-04T13:13:21.110626+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:41:29.714761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11864,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":271,"num_write":104,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":472,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.446298+0000","last_change":"2024-03-04T12:20:22.857779+0000","last_active":"2024-03-04T13:09:22.446298+0000","last_peered":"2024-03-04T13:09:22.446298+0000","last_clean":"2024-03-04T13:09:22.446298+0000","last_became_active":"2024-03-04T12:20:22.857513+0000","last_became_peered":"2024-03-04T12:20:22.857513+0000","last_unstale":"2024-03-04T13:09:22.446298+0000","last_undegraded":"2024-03-04T13:09:22.446298+0000","last_fullsized":"2024-03-04T13:09:22.446298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:18.804581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"255'97","reported_seq":578,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.454779+0000","last_change":"2024-03-04T12:20:24.863622+0000","last_active":"2024-03-04T13:10:32.454779+0000","last_peered":"2024-03-04T13:10:32.454779+0000","last_clean":"2024-03-04T13:10:32.454779+0000","last_became_active":"2024-03-04T12:20:24.863346+0000","last_became_peered":"2024-03-04T12:20:24.863346+0000","last_unstale":"2024-03-04T13:10:32.454779+0000","last_undegraded":"2024-03-04T13:10:32.454779+0000","last_fullsized":"2024-03-04T13:10:32.454779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:44:24.783559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":222,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"255'705","reported_seq":2061,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.916714+0000","last_change":"2024-03-04T12:20:16.834338+0000","last_active":"2024-03-04T13:12:57.916714+0000","last_peered":"2024-03-04T13:12:57.916714+0000","last_clean":"2024-03-04T13:12:57.916714+0000","last_became_active":"2024-03-04T12:20:16.834080+0000","last_became_peered":"2024-03-04T12:20:16.834080+0000","last_unstale":"2024-03-04T13:12:57.916714+0000","last_undegraded":"2024-03-04T13:12:57.916714+0000","last_fullsized":"2024-03-04T13:12:57.916714+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":600,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:22.194726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3097,"num_read_kb":2763,"num_write":935,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"255'233","reported_seq":908,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.052555+0000","last_change":"2024-03-04T12:20:14.816239+0000","last_active":"2024-03-04T13:13:21.052555+0000","last_peered":"2024-03-04T13:13:21.052555+0000","last_clean":"2024-03-04T13:13:21.052555+0000","last_became_active":"2024-03-04T12:20:14.814738+0000","last_became_peered":"2024-03-04T12:20:14.814738+0000","last_unstale":"2024-03-04T13:13:21.052555+0000","last_undegraded":"2024-03-04T13:13:21.052555+0000","last_fullsized":"2024-03-04T13:13:21.052555+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:21:09.377678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5787887,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":617,"num_read_kb":16203,"num_write":1488,"num_write_kb":37968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.446358+0000","last_change":"2024-03-04T12:20:18.835129+0000","last_active":"2024-03-04T13:09:22.446358+0000","last_peered":"2024-03-04T13:09:22.446358+0000","last_clean":"2024-03-04T13:09:22.446358+0000","last_became_active":"2024-03-04T12:20:18.834793+0000","last_became_peered":"2024-03-04T12:20:18.834793+0000","last_unstale":"2024-03-04T13:09:22.446358+0000","last_undegraded":"2024-03-04T13:09:22.446358+0000","last_fullsized":"2024-03-04T13:09:22.446358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:21:52.556360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"255'57","reported_seq":543,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:52.173344+0000","last_change":"2024-03-04T12:20:20.832322+0000","last_active":"2024-03-04T13:10:52.173344+0000","last_peered":"2024-03-04T13:10:52.173344+0000","last_clean":"2024-03-04T13:10:52.173344+0000","last_became_active":"2024-03-04T12:20:20.832034+0000","last_became_peered":"2024-03-04T12:20:20.832034+0000","last_unstale":"2024-03-04T13:10:52.173344+0000","last_undegraded":"2024-03-04T13:10:52.173344+0000","last_fullsized":"2024-03-04T13:10:52.173344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:23:22.034376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":40,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.489906+0000","last_change":"2024-03-04T12:20:22.855900+0000","last_active":"2024-03-04T13:09:22.489906+0000","last_peered":"2024-03-04T13:09:22.489906+0000","last_clean":"2024-03-04T13:09:22.489906+0000","last_became_active":"2024-03-04T12:20:22.855477+0000","last_became_peered":"2024-03-04T12:20:22.855477+0000","last_unstale":"2024-03-04T13:09:22.489906+0000","last_undegraded":"2024-03-04T13:09:22.489906+0000","last_fullsized":"2024-03-04T13:09:22.489906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:25:54.549022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"255'84","reported_seq":558,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.447271+0000","last_change":"2024-03-04T12:20:24.865842+0000","last_active":"2024-03-04T13:10:27.447271+0000","last_peered":"2024-03-04T13:10:27.447271+0000","last_clean":"2024-03-04T13:10:27.447271+0000","last_became_active":"2024-03-04T12:20:24.865534+0000","last_became_peered":"2024-03-04T12:20:24.865534+0000","last_unstale":"2024-03-04T13:10:27.447271+0000","last_undegraded":"2024-03-04T13:10:27.447271+0000","last_fullsized":"2024-03-04T13:10:27.447271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:17:39.700895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":78,"num_write":202,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"255'718","reported_seq":2253,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:04.176061+0000","last_change":"2024-03-04T12:20:16.830393+0000","last_active":"2024-03-04T13:12:04.176061+0000","last_peered":"2024-03-04T13:12:04.176061+0000","last_clean":"2024-03-04T13:12:04.176061+0000","last_became_active":"2024-03-04T12:20:16.829012+0000","last_became_peered":"2024-03-04T12:20:16.829012+0000","last_unstale":"2024-03-04T13:12:04.176061+0000","last_undegraded":"2024-03-04T13:12:04.176061+0000","last_fullsized":"2024-03-04T13:12:04.176061+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:21:58.770726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3304,"num_read_kb":2912,"num_write":1016,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"255'175","reported_seq":859,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.066968+0000","last_change":"2024-03-04T12:20:14.822487+0000","last_active":"2024-03-04T13:13:21.066968+0000","last_peered":"2024-03-04T13:13:21.066968+0000","last_clean":"2024-03-04T13:13:21.066968+0000","last_became_active":"2024-03-04T12:20:14.822127+0000","last_became_peered":"2024-03-04T12:20:14.822127+0000","last_unstale":"2024-03-04T13:13:21.066968+0000","last_undegraded":"2024-03-04T13:13:21.066968+0000","last_fullsized":"2024-03-04T13:13:21.066968+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:19.430639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947361,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":518,"num_read_kb":182821,"num_write":997,"num_write_kb":40014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.489870+0000","last_change":"2024-03-04T12:20:18.831317+0000","last_active":"2024-03-04T13:09:22.489870+0000","last_peered":"2024-03-04T13:09:22.489870+0000","last_clean":"2024-03-04T13:09:22.489870+0000","last_became_active":"2024-03-04T12:20:18.830818+0000","last_became_peered":"2024-03-04T12:20:18.830818+0000","last_unstale":"2024-03-04T13:09:22.489870+0000","last_undegraded":"2024-03-04T13:09:22.489870+0000","last_fullsized":"2024-03-04T13:09:22.489870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:02.931088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"255'164","reported_seq":739,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.014265+0000","last_change":"2024-03-04T12:20:20.841367+0000","last_active":"2024-03-04T13:13:21.014265+0000","last_peered":"2024-03-04T13:13:21.014265+0000","last_clean":"2024-03-04T13:13:21.014265+0000","last_became_active":"2024-03-04T12:20:20.840999+0000","last_became_peered":"2024-03-04T12:20:20.840999+0000","last_unstale":"2024-03-04T13:13:21.014265+0000","last_undegraded":"2024-03-04T13:13:21.014265+0000","last_fullsized":"2024-03-04T13:13:21.014265+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:44:25.478712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8097,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":284,"num_write":124,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.472066+0000","last_change":"2024-03-04T12:20:22.849190+0000","last_active":"2024-03-04T13:09:22.472066+0000","last_peered":"2024-03-04T13:09:22.472066+0000","last_clean":"2024-03-04T13:09:22.472066+0000","last_became_active":"2024-03-04T12:20:22.848877+0000","last_became_peered":"2024-03-04T12:20:22.848877+0000","last_unstale":"2024-03-04T13:09:22.472066+0000","last_undegraded":"2024-03-04T13:09:22.472066+0000","last_fullsized":"2024-03-04T13:09:22.472066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:55:22.244587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"255'99","reported_seq":570,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:14.114497+0000","last_change":"2024-03-04T12:20:24.864100+0000","last_active":"2024-03-04T13:12:14.114497+0000","last_peered":"2024-03-04T13:12:14.114497+0000","last_clean":"2024-03-04T13:12:14.114497+0000","last_became_active":"2024-03-04T12:20:24.863810+0000","last_became_peered":"2024-03-04T12:20:24.863810+0000","last_unstale":"2024-03-04T13:12:14.114497+0000","last_undegraded":"2024-03-04T13:12:14.114497+0000","last_fullsized":"2024-03-04T13:12:14.114497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:00:35.223823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":234,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"255'782","reported_seq":2313,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.954531+0000","last_change":"2024-03-04T12:20:51.031767+0000","last_active":"2024-03-04T13:12:36.954531+0000","last_peered":"2024-03-04T13:12:36.954531+0000","last_clean":"2024-03-04T13:12:36.954531+0000","last_became_active":"2024-03-04T12:20:51.031448+0000","last_became_peered":"2024-03-04T12:20:51.031448+0000","last_unstale":"2024-03-04T13:12:36.954531+0000","last_undegraded":"2024-03-04T13:12:36.954531+0000","last_fullsized":"2024-03-04T13:12:36.954531+0000","mapping_epoch":33,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:13:52.075573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3519,"num_read_kb":3144,"num_write":1038,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"255'186","reported_seq":815,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.195707+0000","last_change":"2024-03-04T12:20:14.824465+0000","last_active":"2024-03-04T13:13:21.195707+0000","last_peered":"2024-03-04T13:13:21.195707+0000","last_clean":"2024-03-04T13:13:21.195707+0000","last_became_active":"2024-03-04T12:20:14.824152+0000","last_became_peered":"2024-03-04T12:20:14.824152+0000","last_unstale":"2024-03-04T13:13:21.195707+0000","last_undegraded":"2024-03-04T13:13:21.195707+0000","last_fullsized":"2024-03-04T13:13:21.195707+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:16:58.677646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259657,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":396,"num_read_kb":84164,"num_write":1039,"num_write_kb":34071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":486,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.472038+0000","last_change":"2024-03-04T12:20:18.839090+0000","last_active":"2024-03-04T13:09:22.472038+0000","last_peered":"2024-03-04T13:09:22.472038+0000","last_clean":"2024-03-04T13:09:22.472038+0000","last_became_active":"2024-03-04T12:20:18.838749+0000","last_became_peered":"2024-03-04T12:20:18.838749+0000","last_unstale":"2024-03-04T13:09:22.472038+0000","last_undegraded":"2024-03-04T13:09:22.472038+0000","last_fullsized":"2024-03-04T13:09:22.472038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:30:49.140805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"255'125","reported_seq":689,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.989916+0000","last_change":"2024-03-04T12:20:20.839637+0000","last_active":"2024-03-04T13:13:20.989916+0000","last_peered":"2024-03-04T13:13:20.989916+0000","last_clean":"2024-03-04T13:13:20.989916+0000","last_became_active":"2024-03-04T12:20:20.839286+0000","last_became_peered":"2024-03-04T12:20:20.839286+0000","last_unstale":"2024-03-04T13:13:20.989916+0000","last_undegraded":"2024-03-04T13:13:20.989916+0000","last_fullsized":"2024-03-04T13:13:20.989916+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:46.347069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":210,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":470,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.439439+0000","last_change":"2024-03-04T12:20:22.849602+0000","last_active":"2024-03-04T13:09:22.439439+0000","last_peered":"2024-03-04T13:09:22.439439+0000","last_clean":"2024-03-04T13:09:22.439439+0000","last_became_active":"2024-03-04T12:20:22.849340+0000","last_became_peered":"2024-03-04T12:20:22.849340+0000","last_unstale":"2024-03-04T13:09:22.439439+0000","last_undegraded":"2024-03-04T13:09:22.439439+0000","last_fullsized":"2024-03-04T13:09:22.439439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:54:45.340993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"255'412","reported_seq":1874,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.782213+0000","last_change":"2024-03-04T12:20:16.821743+0000","last_active":"2024-03-04T13:12:34.782213+0000","last_peered":"2024-03-04T13:12:34.782213+0000","last_clean":"2024-03-04T13:12:34.782213+0000","last_became_active":"2024-03-04T12:20:16.821451+0000","last_became_peered":"2024-03-04T12:20:16.821451+0000","last_unstale":"2024-03-04T13:12:34.782213+0000","last_undegraded":"2024-03-04T13:12:34.782213+0000","last_fullsized":"2024-03-04T13:12:34.782213+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:11:35.448538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2212,"num_read_kb":2069,"num_write":499,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"255'211","reported_seq":801,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.050793+0000","last_change":"2024-03-04T12:20:14.810574+0000","last_active":"2024-03-04T13:13:21.050793+0000","last_peered":"2024-03-04T13:13:21.050793+0000","last_clean":"2024-03-04T13:13:21.050793+0000","last_became_active":"2024-03-04T12:20:14.810309+0000","last_became_peered":"2024-03-04T12:20:14.810309+0000","last_unstale":"2024-03-04T13:13:21.050793+0000","last_undegraded":"2024-03-04T13:13:21.050793+0000","last_fullsized":"2024-03-04T13:13:21.050793+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:00:53.380209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195451,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":442,"num_read_kb":8634,"num_write":1082,"num_write_kb":36368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.447299+0000","last_change":"2024-03-04T12:20:18.833581+0000","last_active":"2024-03-04T13:10:27.447299+0000","last_peered":"2024-03-04T13:10:27.447299+0000","last_clean":"2024-03-04T13:10:27.447299+0000","last_became_active":"2024-03-04T12:20:18.833300+0000","last_became_peered":"2024-03-04T12:20:18.833300+0000","last_unstale":"2024-03-04T13:10:27.447299+0000","last_undegraded":"2024-03-04T13:10:27.447299+0000","last_fullsized":"2024-03-04T13:10:27.447299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:18.547510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"255'193","reported_seq":801,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.135599+0000","last_change":"2024-03-04T12:20:20.838878+0000","last_active":"2024-03-04T13:13:14.135599+0000","last_peered":"2024-03-04T13:13:14.135599+0000","last_clean":"2024-03-04T13:13:14.135599+0000","last_became_active":"2024-03-04T12:20:20.838600+0000","last_became_peered":"2024-03-04T12:20:20.838600+0000","last_unstale":"2024-03-04T13:13:14.135599+0000","last_undegraded":"2024-03-04T13:13:14.135599+0000","last_fullsized":"2024-03-04T13:13:14.135599+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:23:04.099319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23990,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":269,"num_read_kb":389,"num_write":134,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":474,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.355538+0000","last_change":"2024-03-04T12:20:22.855745+0000","last_active":"2024-03-04T13:10:22.355538+0000","last_peered":"2024-03-04T13:10:22.355538+0000","last_clean":"2024-03-04T13:10:22.355538+0000","last_became_active":"2024-03-04T12:20:22.855464+0000","last_became_peered":"2024-03-04T12:20:22.855464+0000","last_unstale":"2024-03-04T13:10:22.355538+0000","last_undegraded":"2024-03-04T13:10:22.355538+0000","last_fullsized":"2024-03-04T13:10:22.355538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:30:46.542674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"255'170","reported_seq":663,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:47.462606+0000","last_change":"2024-03-04T12:20:24.912595+0000","last_active":"2024-03-04T13:11:47.462606+0000","last_peered":"2024-03-04T13:11:47.462606+0000","last_clean":"2024-03-04T13:11:47.462606+0000","last_became_active":"2024-03-04T12:20:24.912118+0000","last_became_peered":"2024-03-04T12:20:24.912118+0000","last_unstale":"2024-03-04T13:11:47.462606+0000","last_undegraded":"2024-03-04T13:11:47.462606+0000","last_fullsized":"2024-03-04T13:11:47.462606+0000","mapping_epoch":30,"log_start":"250'100","ondisk_log_start":"250'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:40:35.111451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":221,"num_read_kb":223,"num_write":386,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"255'445","reported_seq":1784,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.557491+0000","last_change":"2024-03-04T12:20:16.828841+0000","last_active":"2024-03-04T13:12:22.557491+0000","last_peered":"2024-03-04T13:12:22.557491+0000","last_clean":"2024-03-04T13:12:22.557491+0000","last_became_active":"2024-03-04T12:20:16.828550+0000","last_became_peered":"2024-03-04T12:20:16.828550+0000","last_unstale":"2024-03-04T13:12:22.557491+0000","last_undegraded":"2024-03-04T13:12:22.557491+0000","last_fullsized":"2024-03-04T13:12:22.557491+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:57:14.787116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2172,"num_read_kb":1979,"num_write":576,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"255'149","reported_seq":720,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:00.902037+0000","last_change":"2024-03-04T12:20:14.811751+0000","last_active":"2024-03-04T13:12:00.902037+0000","last_peered":"2024-03-04T13:12:00.902037+0000","last_clean":"2024-03-04T13:12:00.902037+0000","last_became_active":"2024-03-04T12:20:14.811474+0000","last_became_peered":"2024-03-04T12:20:14.811474+0000","last_unstale":"2024-03-04T13:12:00.902037+0000","last_undegraded":"2024-03-04T13:12:00.902037+0000","last_fullsized":"2024-03-04T13:12:00.902037+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:47:39.651078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2020301,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":290,"num_read_kb":3660,"num_write":930,"num_write_kb":16669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.480432+0000","last_change":"2024-03-04T12:20:18.836323+0000","last_active":"2024-03-04T13:10:22.480432+0000","last_peered":"2024-03-04T13:10:22.480432+0000","last_clean":"2024-03-04T13:10:22.480432+0000","last_became_active":"2024-03-04T12:20:18.836021+0000","last_became_peered":"2024-03-04T12:20:18.836021+0000","last_unstale":"2024-03-04T13:10:22.480432+0000","last_undegraded":"2024-03-04T13:10:22.480432+0000","last_fullsized":"2024-03-04T13:10:22.480432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:21:06.430437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"255'166","reported_seq":747,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.998533+0000","last_change":"2024-03-04T12:20:20.838524+0000","last_active":"2024-03-04T13:13:20.998533+0000","last_peered":"2024-03-04T13:13:20.998533+0000","last_clean":"2024-03-04T13:13:20.998533+0000","last_became_active":"2024-03-04T12:20:20.838216+0000","last_became_peered":"2024-03-04T12:20:20.838216+0000","last_unstale":"2024-03-04T13:13:20.998533+0000","last_undegraded":"2024-03-04T13:13:20.998533+0000","last_fullsized":"2024-03-04T13:13:20.998533+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:42:52.068202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12653,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":241,"num_read_kb":319,"num_write":160,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":475,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.543497+0000","last_change":"2024-03-04T12:20:22.856748+0000","last_active":"2024-03-04T13:10:22.543497+0000","last_peered":"2024-03-04T13:10:22.543497+0000","last_clean":"2024-03-04T13:10:22.543497+0000","last_became_active":"2024-03-04T12:20:22.856471+0000","last_became_peered":"2024-03-04T12:20:22.856471+0000","last_unstale":"2024-03-04T13:10:22.543497+0000","last_undegraded":"2024-03-04T13:10:22.543497+0000","last_fullsized":"2024-03-04T13:10:22.543497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:11:44.331825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"255'161","reported_seq":1004,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.643094+0000","last_change":"2024-03-04T12:20:24.863580+0000","last_active":"2024-03-04T13:13:12.643094+0000","last_peered":"2024-03-04T13:13:12.643094+0000","last_clean":"2024-03-04T13:13:12.643094+0000","last_became_active":"2024-03-04T12:20:24.863291+0000","last_became_peered":"2024-03-04T12:20:24.863291+0000","last_unstale":"2024-03-04T13:13:12.643094+0000","last_undegraded":"2024-03-04T13:13:12.643094+0000","last_fullsized":"2024-03-04T13:13:12.643094+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:12:00.193269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1530,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":567,"num_read_kb":564,"num_write":466,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"255'445","reported_seq":1849,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.328231+0000","last_change":"2024-03-04T12:20:50.906133+0000","last_active":"2024-03-04T13:12:39.328231+0000","last_peered":"2024-03-04T13:12:39.328231+0000","last_clean":"2024-03-04T13:12:39.328231+0000","last_became_active":"2024-03-04T12:20:50.905894+0000","last_became_peered":"2024-03-04T12:20:50.905894+0000","last_unstale":"2024-03-04T13:12:39.328231+0000","last_undegraded":"2024-03-04T13:12:39.328231+0000","last_fullsized":"2024-03-04T13:12:39.328231+0000","mapping_epoch":33,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:28:12.350446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2307,"num_read_kb":2145,"num_write":589,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"255'290","reported_seq":1044,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.184377+0000","last_change":"2024-03-04T12:20:14.816872+0000","last_active":"2024-03-04T13:13:21.184377+0000","last_peered":"2024-03-04T13:13:21.184377+0000","last_clean":"2024-03-04T13:13:21.184377+0000","last_became_active":"2024-03-04T12:20:14.816522+0000","last_became_peered":"2024-03-04T12:20:14.816522+0000","last_unstale":"2024-03-04T13:13:21.184377+0000","last_undegraded":"2024-03-04T13:13:21.184377+0000","last_fullsized":"2024-03-04T13:13:21.184377+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:29:45.146558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291510,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":856,"num_read_kb":55073,"num_write":1469,"num_write_kb":53223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499567+0000","last_change":"2024-03-04T12:20:18.831825+0000","last_active":"2024-03-04T13:10:22.499567+0000","last_peered":"2024-03-04T13:10:22.499567+0000","last_clean":"2024-03-04T13:10:22.499567+0000","last_became_active":"2024-03-04T12:20:18.831535+0000","last_became_peered":"2024-03-04T12:20:18.831535+0000","last_unstale":"2024-03-04T13:10:22.499567+0000","last_undegraded":"2024-03-04T13:10:22.499567+0000","last_fullsized":"2024-03-04T13:10:22.499567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:34:27.137812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"255'148","reported_seq":711,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.141793+0000","last_change":"2024-03-04T12:20:21.642237+0000","last_active":"2024-03-04T13:13:21.141793+0000","last_peered":"2024-03-04T13:13:21.141793+0000","last_clean":"2024-03-04T13:13:21.141793+0000","last_became_active":"2024-03-04T12:20:21.641872+0000","last_became_peered":"2024-03-04T12:20:21.641872+0000","last_unstale":"2024-03-04T13:13:21.141793+0000","last_undegraded":"2024-03-04T13:13:21.141793+0000","last_fullsized":"2024-03-04T13:13:21.141793+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:52:56.543890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6408,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":262,"num_write":108,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.544084+0000","last_change":"2024-03-04T12:20:22.854770+0000","last_active":"2024-03-04T13:10:27.544084+0000","last_peered":"2024-03-04T13:10:27.544084+0000","last_clean":"2024-03-04T13:10:27.544084+0000","last_became_active":"2024-03-04T12:20:22.854454+0000","last_became_peered":"2024-03-04T12:20:22.854454+0000","last_unstale":"2024-03-04T13:10:27.544084+0000","last_undegraded":"2024-03-04T13:10:27.544084+0000","last_fullsized":"2024-03-04T13:10:27.544084+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:43:50.254636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"255'101","reported_seq":576,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.164834+0000","last_change":"2024-03-04T12:20:24.862523+0000","last_active":"2024-03-04T13:13:14.164834+0000","last_peered":"2024-03-04T13:13:14.164834+0000","last_clean":"2024-03-04T13:13:14.164834+0000","last_became_active":"2024-03-04T12:20:24.862179+0000","last_became_peered":"2024-03-04T12:20:24.862179+0000","last_unstale":"2024-03-04T13:13:14.164834+0000","last_undegraded":"2024-03-04T13:13:14.164834+0000","last_fullsized":"2024-03-04T13:13:14.164834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:35:13.449840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":249,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"255'454","reported_seq":1906,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.593396+0000","last_change":"2024-03-04T12:20:16.836521+0000","last_active":"2024-03-04T13:12:50.593396+0000","last_peered":"2024-03-04T13:12:50.593396+0000","last_clean":"2024-03-04T13:12:50.593396+0000","last_became_active":"2024-03-04T12:20:16.836224+0000","last_became_peered":"2024-03-04T12:20:16.836224+0000","last_unstale":"2024-03-04T13:12:50.593396+0000","last_undegraded":"2024-03-04T13:12:50.593396+0000","last_fullsized":"2024-03-04T13:12:50.593396+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:05:20.664502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2418,"num_read_kb":2273,"num_write":600,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"255'189","reported_seq":779,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.462885+0000","last_change":"2024-03-04T12:20:14.821178+0000","last_active":"2024-03-04T13:12:47.462885+0000","last_peered":"2024-03-04T13:12:47.462885+0000","last_clean":"2024-03-04T13:12:47.462885+0000","last_became_active":"2024-03-04T12:20:14.820789+0000","last_became_peered":"2024-03-04T12:20:14.820789+0000","last_unstale":"2024-03-04T13:12:47.462885+0000","last_undegraded":"2024-03-04T13:12:47.462885+0000","last_fullsized":"2024-03-04T13:12:47.462885+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:09:03.198251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":398,"num_read_kb":8887,"num_write":907,"num_write_kb":18227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":483,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.543490+0000","last_change":"2024-03-04T12:20:18.838301+0000","last_active":"2024-03-04T13:10:22.543490+0000","last_peered":"2024-03-04T13:10:22.543490+0000","last_clean":"2024-03-04T13:10:22.543490+0000","last_became_active":"2024-03-04T12:20:18.837949+0000","last_became_peered":"2024-03-04T12:20:18.837949+0000","last_unstale":"2024-03-04T13:10:22.543490+0000","last_undegraded":"2024-03-04T13:10:22.543490+0000","last_fullsized":"2024-03-04T13:10:22.543490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:48:00.814962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"255'84","reported_seq":602,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:53.838249+0000","last_change":"2024-03-04T12:20:21.642153+0000","last_active":"2024-03-04T13:10:53.838249+0000","last_peered":"2024-03-04T13:10:53.838249+0000","last_clean":"2024-03-04T13:10:53.838249+0000","last_became_active":"2024-03-04T12:20:21.641757+0000","last_became_peered":"2024-03-04T12:20:21.641757+0000","last_unstale":"2024-03-04T13:10:53.838249+0000","last_undegraded":"2024-03-04T13:10:53.838249+0000","last_fullsized":"2024-03-04T13:10:53.838249+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:33:04.943209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":90,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"255'498","reported_seq":3564,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.932748+0000","last_change":"2024-03-04T12:20:22.850624+0000","last_active":"2024-03-04T13:13:20.932748+0000","last_peered":"2024-03-04T13:13:20.932748+0000","last_clean":"2024-03-04T13:13:20.932748+0000","last_became_active":"2024-03-04T12:20:22.849630+0000","last_became_peered":"2024-03-04T12:20:22.849630+0000","last_unstale":"2024-03-04T13:13:20.932748+0000","last_undegraded":"2024-03-04T13:13:20.932748+0000","last_fullsized":"2024-03-04T13:13:20.932748+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:05.162543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"255'140","reported_seq":628,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:11.369454+0000","last_change":"2024-03-04T12:20:24.863651+0000","last_active":"2024-03-04T13:12:11.369454+0000","last_peered":"2024-03-04T13:12:11.369454+0000","last_clean":"2024-03-04T13:12:11.369454+0000","last_became_active":"2024-03-04T12:20:24.863312+0000","last_became_peered":"2024-03-04T12:20:24.863312+0000","last_unstale":"2024-03-04T13:12:11.369454+0000","last_undegraded":"2024-03-04T13:12:11.369454+0000","last_fullsized":"2024-03-04T13:12:11.369454+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:10.861121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":307,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"255'558","reported_seq":2206,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.971775+0000","last_change":"2024-03-04T12:20:16.828351+0000","last_active":"2024-03-04T13:12:36.971775+0000","last_peered":"2024-03-04T13:12:36.971775+0000","last_clean":"2024-03-04T13:12:36.971775+0000","last_became_active":"2024-03-04T12:20:16.828102+0000","last_became_peered":"2024-03-04T12:20:16.828102+0000","last_unstale":"2024-03-04T13:12:36.971775+0000","last_undegraded":"2024-03-04T13:12:36.971775+0000","last_fullsized":"2024-03-04T13:12:36.971775+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:35:22.025393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2984,"num_read_kb":2771,"num_write":760,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"255'207","reported_seq":841,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.182107+0000","last_change":"2024-03-04T12:20:14.827443+0000","last_active":"2024-03-04T13:13:21.182107+0000","last_peered":"2024-03-04T13:13:21.182107+0000","last_clean":"2024-03-04T13:13:21.182107+0000","last_became_active":"2024-03-04T12:20:14.826522+0000","last_became_peered":"2024-03-04T12:20:14.826522+0000","last_unstale":"2024-03-04T13:13:21.182107+0000","last_undegraded":"2024-03-04T13:13:21.182107+0000","last_fullsized":"2024-03-04T13:13:21.182107+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:32:50.275769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27217,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":463,"num_read_kb":10394,"num_write":1165,"num_write_kb":28391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499523+0000","last_change":"2024-03-04T12:20:18.832929+0000","last_active":"2024-03-04T13:10:22.499523+0000","last_peered":"2024-03-04T13:10:22.499523+0000","last_clean":"2024-03-04T13:10:22.499523+0000","last_became_active":"2024-03-04T12:20:18.832607+0000","last_became_peered":"2024-03-04T12:20:18.832607+0000","last_unstale":"2024-03-04T13:10:22.499523+0000","last_undegraded":"2024-03-04T13:10:22.499523+0000","last_fullsized":"2024-03-04T13:10:22.499523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:37:17.213186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"255'174","reported_seq":748,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.191936+0000","last_change":"2024-03-04T12:20:20.838476+0000","last_active":"2024-03-04T13:13:21.191936+0000","last_peered":"2024-03-04T13:13:21.191936+0000","last_clean":"2024-03-04T13:13:21.191936+0000","last_became_active":"2024-03-04T12:20:20.838062+0000","last_became_peered":"2024-03-04T12:20:20.838062+0000","last_unstale":"2024-03-04T13:13:21.191936+0000","last_undegraded":"2024-03-04T13:13:21.191936+0000","last_fullsized":"2024-03-04T13:13:21.191936+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:55.057171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8941,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":239,"num_read_kb":314,"num_write":142,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":469,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.435067+0000","last_change":"2024-03-04T12:20:22.856843+0000","last_active":"2024-03-04T13:08:42.435067+0000","last_peered":"2024-03-04T13:08:42.435067+0000","last_clean":"2024-03-04T13:08:42.435067+0000","last_became_active":"2024-03-04T12:20:22.856540+0000","last_became_peered":"2024-03-04T12:20:22.856540+0000","last_unstale":"2024-03-04T13:08:42.435067+0000","last_undegraded":"2024-03-04T13:08:42.435067+0000","last_fullsized":"2024-03-04T13:08:42.435067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:57:43.229611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"255'88","reported_seq":574,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:15.292251+0000","last_change":"2024-03-04T12:20:24.867999+0000","last_active":"2024-03-04T13:10:15.292251+0000","last_peered":"2024-03-04T13:10:15.292251+0000","last_clean":"2024-03-04T13:10:15.292251+0000","last_became_active":"2024-03-04T12:20:24.866984+0000","last_became_peered":"2024-03-04T12:20:24.866984+0000","last_unstale":"2024-03-04T13:10:15.292251+0000","last_undegraded":"2024-03-04T13:10:15.292251+0000","last_fullsized":"2024-03-04T13:10:15.292251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:35.692000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":81,"num_write":221,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"255'841","reported_seq":2368,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.800189+0000","last_change":"2024-03-04T12:20:16.827865+0000","last_active":"2024-03-04T13:12:34.800189+0000","last_peered":"2024-03-04T13:12:34.800189+0000","last_clean":"2024-03-04T13:12:34.800189+0000","last_became_active":"2024-03-04T12:20:16.827592+0000","last_became_peered":"2024-03-04T12:20:16.827592+0000","last_unstale":"2024-03-04T13:12:34.800189+0000","last_undegraded":"2024-03-04T13:12:34.800189+0000","last_fullsized":"2024-03-04T13:12:34.800189+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:28.558695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3846,"num_read_kb":3408,"num_write":1191,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"255'226","reported_seq":858,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.026297+0000","last_change":"2024-03-04T12:20:14.827317+0000","last_active":"2024-03-04T13:13:21.026297+0000","last_peered":"2024-03-04T13:13:21.026297+0000","last_clean":"2024-03-04T13:13:21.026297+0000","last_became_active":"2024-03-04T12:20:14.827034+0000","last_became_peered":"2024-03-04T12:20:14.827034+0000","last_unstale":"2024-03-04T13:13:21.026297+0000","last_undegraded":"2024-03-04T13:13:21.026297+0000","last_fullsized":"2024-03-04T13:13:21.026297+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:46:52.185291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":510,"num_read_kb":74328,"num_write":1121,"num_write_kb":53240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.355518+0000","last_change":"2024-03-04T12:20:18.836142+0000","last_active":"2024-03-04T13:10:22.355518+0000","last_peered":"2024-03-04T13:10:22.355518+0000","last_clean":"2024-03-04T13:10:22.355518+0000","last_became_active":"2024-03-04T12:20:18.835852+0000","last_became_peered":"2024-03-04T12:20:18.835852+0000","last_unstale":"2024-03-04T13:10:22.355518+0000","last_undegraded":"2024-03-04T13:10:22.355518+0000","last_fullsized":"2024-03-04T13:10:22.355518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:46.704265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"255'135","reported_seq":686,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.196987+0000","last_change":"2024-03-04T12:20:20.837534+0000","last_active":"2024-03-04T13:13:21.196987+0000","last_peered":"2024-03-04T13:13:21.196987+0000","last_clean":"2024-03-04T13:13:21.196987+0000","last_became_active":"2024-03-04T12:20:20.837239+0000","last_became_peered":"2024-03-04T12:20:20.837239+0000","last_unstale":"2024-03-04T13:13:21.196987+0000","last_undegraded":"2024-03-04T13:13:21.196987+0000","last_fullsized":"2024-03-04T13:13:21.196987+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:10:30.624161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7816,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":230,"num_write":86,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":477,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.468138+0000","last_change":"2024-03-04T12:20:22.850044+0000","last_active":"2024-03-04T13:08:52.468138+0000","last_peered":"2024-03-04T13:08:52.468138+0000","last_clean":"2024-03-04T13:08:52.468138+0000","last_became_active":"2024-03-04T12:20:22.849731+0000","last_became_peered":"2024-03-04T12:20:22.849731+0000","last_unstale":"2024-03-04T13:08:52.468138+0000","last_undegraded":"2024-03-04T13:08:52.468138+0000","last_fullsized":"2024-03-04T13:08:52.468138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:28.076705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"255'119","reported_seq":617,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.314222+0000","last_change":"2024-03-04T12:20:24.912999+0000","last_active":"2024-03-04T13:12:39.314222+0000","last_peered":"2024-03-04T13:12:39.314222+0000","last_clean":"2024-03-04T13:12:39.314222+0000","last_became_active":"2024-03-04T12:20:24.912599+0000","last_became_peered":"2024-03-04T12:20:24.912599+0000","last_unstale":"2024-03-04T13:12:39.314222+0000","last_undegraded":"2024-03-04T13:12:39.314222+0000","last_fullsized":"2024-03-04T13:12:39.314222+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:16.458774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":888,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":157,"num_write":287,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"255'1175","reported_seq":2747,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.308261+0000","last_change":"2024-03-04T12:20:16.828068+0000","last_active":"2024-03-04T13:12:39.308261+0000","last_peered":"2024-03-04T13:12:39.308261+0000","last_clean":"2024-03-04T13:12:39.308261+0000","last_became_active":"2024-03-04T12:20:16.827448+0000","last_became_peered":"2024-03-04T12:20:16.827448+0000","last_unstale":"2024-03-04T13:12:39.308261+0000","last_undegraded":"2024-03-04T13:12:39.308261+0000","last_fullsized":"2024-03-04T13:12:39.308261+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":1100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:16:26.503650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5284,"num_read_kb":4621,"num_write":1652,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"255'215","reported_seq":845,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.165611+0000","last_change":"2024-03-04T12:20:14.822903+0000","last_active":"2024-03-04T13:13:21.165611+0000","last_peered":"2024-03-04T13:13:21.165611+0000","last_clean":"2024-03-04T13:13:21.165611+0000","last_became_active":"2024-03-04T12:20:14.822619+0000","last_became_peered":"2024-03-04T12:20:14.822619+0000","last_unstale":"2024-03-04T13:13:21.165611+0000","last_undegraded":"2024-03-04T13:13:21.165611+0000","last_fullsized":"2024-03-04T13:13:21.165611+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:39:36.460713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9035448,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":16616,"num_write":1088,"num_write_kb":32501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.482846+0000","last_change":"2024-03-04T12:20:18.831493+0000","last_active":"2024-03-04T13:08:42.482846+0000","last_peered":"2024-03-04T13:08:42.482846+0000","last_clean":"2024-03-04T13:08:42.482846+0000","last_became_active":"2024-03-04T12:20:18.831105+0000","last_became_peered":"2024-03-04T12:20:18.831105+0000","last_unstale":"2024-03-04T13:08:42.482846+0000","last_undegraded":"2024-03-04T13:08:42.482846+0000","last_fullsized":"2024-03-04T13:08:42.482846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:38:01.353910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"255'100","reported_seq":641,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.124207+0000","last_change":"2024-03-04T12:20:20.842912+0000","last_active":"2024-03-04T13:13:21.124207+0000","last_peered":"2024-03-04T13:13:21.124207+0000","last_clean":"2024-03-04T13:13:21.124207+0000","last_became_active":"2024-03-04T12:20:20.842361+0000","last_became_peered":"2024-03-04T12:20:20.842361+0000","last_unstale":"2024-03-04T13:13:21.124207+0000","last_undegraded":"2024-03-04T13:13:21.124207+0000","last_fullsized":"2024-03-04T13:13:21.124207+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:49:07.128719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":178,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499524+0000","last_change":"2024-03-04T12:20:22.857230+0000","last_active":"2024-03-04T13:10:22.499524+0000","last_peered":"2024-03-04T13:10:22.499524+0000","last_clean":"2024-03-04T13:10:22.499524+0000","last_became_active":"2024-03-04T12:20:22.856748+0000","last_became_peered":"2024-03-04T12:20:22.856748+0000","last_unstale":"2024-03-04T13:10:22.499524+0000","last_undegraded":"2024-03-04T13:10:22.499524+0000","last_fullsized":"2024-03-04T13:10:22.499524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:19:05.374574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"255'148","reported_seq":1190,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.552175+0000","last_change":"2024-03-04T12:20:24.865794+0000","last_active":"2024-03-04T13:13:12.552175+0000","last_peered":"2024-03-04T13:13:12.552175+0000","last_clean":"2024-03-04T13:13:12.552175+0000","last_became_active":"2024-03-04T12:20:24.865363+0000","last_became_peered":"2024-03-04T12:20:24.865363+0000","last_unstale":"2024-03-04T13:13:12.552175+0000","last_undegraded":"2024-03-04T13:13:12.552175+0000","last_fullsized":"2024-03-04T13:13:12.552175+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:49:27.367305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":819,"num_read_kb":785,"num_write":355,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"255'725","reported_seq":2131,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.951732+0000","last_change":"2024-03-04T12:20:16.820242+0000","last_active":"2024-03-04T13:12:36.951732+0000","last_peered":"2024-03-04T13:12:36.951732+0000","last_clean":"2024-03-04T13:12:36.951732+0000","last_became_active":"2024-03-04T12:20:16.819966+0000","last_became_peered":"2024-03-04T12:20:16.819966+0000","last_unstale":"2024-03-04T13:12:36.951732+0000","last_undegraded":"2024-03-04T13:12:36.951732+0000","last_fullsized":"2024-03-04T13:12:36.951732+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:05:44.485867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3297,"num_read_kb":2935,"num_write":968,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"255'281","reported_seq":926,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.459989+0000","last_change":"2024-03-04T12:20:14.824471+0000","last_active":"2024-03-04T13:12:22.459989+0000","last_peered":"2024-03-04T13:12:22.459989+0000","last_clean":"2024-03-04T13:12:22.459989+0000","last_became_active":"2024-03-04T12:20:14.824168+0000","last_became_peered":"2024-03-04T12:20:14.824168+0000","last_unstale":"2024-03-04T13:12:22.459989+0000","last_undegraded":"2024-03-04T13:12:22.459989+0000","last_fullsized":"2024-03-04T13:12:22.459989+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:06:00.013863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":709,"num_read_kb":4351,"num_write":1165,"num_write_kb":19276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":484,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:47.532640+0000","last_change":"2024-03-04T12:20:18.836753+0000","last_active":"2024-03-04T13:08:47.532640+0000","last_peered":"2024-03-04T13:08:47.532640+0000","last_clean":"2024-03-04T13:08:47.532640+0000","last_became_active":"2024-03-04T12:20:18.836203+0000","last_became_peered":"2024-03-04T12:20:18.836203+0000","last_unstale":"2024-03-04T13:08:47.532640+0000","last_undegraded":"2024-03-04T13:08:47.532640+0000","last_fullsized":"2024-03-04T13:08:47.532640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:43.974119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"255'161","reported_seq":737,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.149835+0000","last_change":"2024-03-04T12:20:20.842714+0000","last_active":"2024-03-04T13:13:21.149835+0000","last_peered":"2024-03-04T13:13:21.149835+0000","last_clean":"2024-03-04T13:13:21.149835+0000","last_became_active":"2024-03-04T12:20:20.842246+0000","last_became_peered":"2024-03-04T12:20:20.842246+0000","last_unstale":"2024-03-04T13:13:21.149835+0000","last_undegraded":"2024-03-04T13:13:21.149835+0000","last_fullsized":"2024-03-04T13:13:21.149835+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:08.729003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":208,"num_read_kb":255,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":469,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.446680+0000","last_change":"2024-03-04T12:20:22.856898+0000","last_active":"2024-03-04T13:10:22.446680+0000","last_peered":"2024-03-04T13:10:22.446680+0000","last_clean":"2024-03-04T13:10:22.446680+0000","last_became_active":"2024-03-04T12:20:22.856597+0000","last_became_peered":"2024-03-04T12:20:22.856597+0000","last_unstale":"2024-03-04T13:10:22.446680+0000","last_undegraded":"2024-03-04T13:10:22.446680+0000","last_fullsized":"2024-03-04T13:10:22.446680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:03:49.712588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"255'89","reported_seq":567,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:40.878711+0000","last_change":"2024-03-04T12:20:24.869755+0000","last_active":"2024-03-04T13:10:40.878711+0000","last_peered":"2024-03-04T13:10:40.878711+0000","last_clean":"2024-03-04T13:10:40.878711+0000","last_became_active":"2024-03-04T12:20:24.869207+0000","last_became_peered":"2024-03-04T12:20:24.869207+0000","last_unstale":"2024-03-04T13:10:40.878711+0000","last_undegraded":"2024-03-04T13:10:40.878711+0000","last_fullsized":"2024-03-04T13:10:40.878711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:06:32.609688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":212,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"255'1092","reported_seq":2657,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.557042+0000","last_change":"2024-03-04T12:20:16.832658+0000","last_active":"2024-03-04T13:12:22.557042+0000","last_peered":"2024-03-04T13:12:22.557042+0000","last_clean":"2024-03-04T13:12:22.557042+0000","last_became_active":"2024-03-04T12:20:16.832377+0000","last_became_peered":"2024-03-04T12:20:16.832377+0000","last_unstale":"2024-03-04T13:12:22.557042+0000","last_undegraded":"2024-03-04T13:12:22.557042+0000","last_fullsized":"2024-03-04T13:12:22.557042+0000","mapping_epoch":22,"log_start":"255'1000","ondisk_log_start":"255'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":1000,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:47:37.405815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4785,"num_read_kb":4211,"num_write":1502,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"255'213","reported_seq":860,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.122597+0000","last_change":"2024-03-04T12:20:14.817916+0000","last_active":"2024-03-04T13:13:21.122597+0000","last_peered":"2024-03-04T13:13:21.122597+0000","last_clean":"2024-03-04T13:13:21.122597+0000","last_became_active":"2024-03-04T12:20:14.817326+0000","last_became_peered":"2024-03-04T12:20:14.817326+0000","last_unstale":"2024-03-04T13:13:21.122597+0000","last_undegraded":"2024-03-04T13:13:21.122597+0000","last_fullsized":"2024-03-04T13:13:21.122597+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:49:00.626737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":463525,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":541,"num_read_kb":21798,"num_write":1100,"num_write_kb":25910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"255'796","reported_seq":2438,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.098986+0000","last_change":"2024-03-04T12:20:16.835151+0000","last_active":"2024-03-04T13:12:31.098986+0000","last_peered":"2024-03-04T13:12:31.098986+0000","last_clean":"2024-03-04T13:12:31.098986+0000","last_became_active":"2024-03-04T12:20:16.834823+0000","last_became_peered":"2024-03-04T12:20:16.834823+0000","last_unstale":"2024-03-04T13:12:31.098986+0000","last_undegraded":"2024-03-04T13:12:31.098986+0000","last_fullsized":"2024-03-04T13:12:31.098986+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:17.422055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3958,"num_read_kb":3565,"num_write":1074,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"255'210","reported_seq":853,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.181086+0000","last_change":"2024-03-04T12:20:14.819636+0000","last_active":"2024-03-04T13:13:21.181086+0000","last_peered":"2024-03-04T13:13:21.181086+0000","last_clean":"2024-03-04T13:13:21.181086+0000","last_became_active":"2024-03-04T12:20:14.819333+0000","last_became_peered":"2024-03-04T12:20:14.819333+0000","last_unstale":"2024-03-04T13:13:21.181086+0000","last_undegraded":"2024-03-04T13:13:21.181086+0000","last_fullsized":"2024-03-04T13:13:21.181086+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:25.357472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":688512,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":39432,"num_write":1114,"num_write_kb":31535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"255'567","reported_seq":2093,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.955018+0000","last_change":"2024-03-04T12:20:16.829090+0000","last_active":"2024-03-04T13:12:36.955018+0000","last_peered":"2024-03-04T13:12:36.955018+0000","last_clean":"2024-03-04T13:12:36.955018+0000","last_became_active":"2024-03-04T12:20:16.828799+0000","last_became_peered":"2024-03-04T12:20:16.828799+0000","last_unstale":"2024-03-04T13:12:36.955018+0000","last_undegraded":"2024-03-04T13:12:36.955018+0000","last_fullsized":"2024-03-04T13:12:36.955018+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:40:00.875926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2802,"num_read_kb":2536,"num_write":761,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"255'187","reported_seq":792,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.181487+0000","last_change":"2024-03-04T12:20:14.824170+0000","last_active":"2024-03-04T13:13:21.181487+0000","last_peered":"2024-03-04T13:13:21.181487+0000","last_clean":"2024-03-04T13:13:21.181487+0000","last_became_active":"2024-03-04T12:20:14.823794+0000","last_became_peered":"2024-03-04T12:20:14.823794+0000","last_unstale":"2024-03-04T13:13:21.181487+0000","last_undegraded":"2024-03-04T13:13:21.181487+0000","last_fullsized":"2024-03-04T13:13:21.181487+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:58:40.371668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27216,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":368,"num_read_kb":29267,"num_write":940,"num_write_kb":26221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"255'419","reported_seq":2014,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:14.106725+0000","last_change":"2024-03-04T12:20:16.830270+0000","last_active":"2024-03-04T13:12:14.106725+0000","last_peered":"2024-03-04T13:12:14.106725+0000","last_clean":"2024-03-04T13:12:14.106725+0000","last_became_active":"2024-03-04T12:20:16.830023+0000","last_became_peered":"2024-03-04T12:20:16.830023+0000","last_unstale":"2024-03-04T13:12:14.106725+0000","last_undegraded":"2024-03-04T13:12:14.106725+0000","last_fullsized":"2024-03-04T13:12:14.106725+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:15:50.412288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2457,"num_read_kb":2316,"num_write":500,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"255'181","reported_seq":764,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.155694+0000","last_change":"2024-03-04T12:20:14.814965+0000","last_active":"2024-03-04T13:13:21.155694+0000","last_peered":"2024-03-04T13:13:21.155694+0000","last_clean":"2024-03-04T13:13:21.155694+0000","last_became_active":"2024-03-04T12:20:14.814649+0000","last_became_peered":"2024-03-04T12:20:14.814649+0000","last_unstale":"2024-03-04T13:13:21.155694+0000","last_undegraded":"2024-03-04T13:13:21.155694+0000","last_fullsized":"2024-03-04T13:13:21.155694+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:38:26.781415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":350,"num_read_kb":14298,"num_write":961,"num_write_kb":45374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"255'670","reported_seq":2118,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.808990+0000","last_change":"2024-03-04T12:20:16.832110+0000","last_active":"2024-03-04T13:12:12.808990+0000","last_peered":"2024-03-04T13:12:12.808990+0000","last_clean":"2024-03-04T13:12:12.808990+0000","last_became_active":"2024-03-04T12:20:16.831861+0000","last_became_peered":"2024-03-04T12:20:16.831861+0000","last_unstale":"2024-03-04T13:12:12.808990+0000","last_undegraded":"2024-03-04T13:12:12.808990+0000","last_fullsized":"2024-03-04T13:12:12.808990+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":600,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:42:42.342669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3134,"num_read_kb":2831,"num_write":876,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"255'150","reported_seq":782,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.066149+0000","last_change":"2024-03-04T12:20:14.818277+0000","last_active":"2024-03-04T13:13:21.066149+0000","last_peered":"2024-03-04T13:13:21.066149+0000","last_clean":"2024-03-04T13:13:21.066149+0000","last_became_active":"2024-03-04T12:20:14.818011+0000","last_became_peered":"2024-03-04T12:20:14.818011+0000","last_unstale":"2024-03-04T13:13:21.066149+0000","last_undegraded":"2024-03-04T13:13:21.066149+0000","last_fullsized":"2024-03-04T13:13:21.066149+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:28:17.174533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6900048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":2296,"num_write":812,"num_write_kb":10260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"255'1153","reported_seq":2618,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.557788+0000","last_change":"2024-03-04T12:20:16.821337+0000","last_active":"2024-03-04T13:12:22.557788+0000","last_peered":"2024-03-04T13:12:22.557788+0000","last_clean":"2024-03-04T13:12:22.557788+0000","last_became_active":"2024-03-04T12:20:16.820794+0000","last_became_peered":"2024-03-04T12:20:16.820794+0000","last_unstale":"2024-03-04T13:12:22.557788+0000","last_undegraded":"2024-03-04T13:12:22.557788+0000","last_fullsized":"2024-03-04T13:12:22.557788+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":1100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:55:47.838168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4910,"num_read_kb":4282,"num_write":1611,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"255'210","reported_seq":833,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.541893+0000","last_change":"2024-03-04T12:20:14.812183+0000","last_active":"2024-03-04T13:10:07.541893+0000","last_peered":"2024-03-04T13:10:07.541893+0000","last_clean":"2024-03-04T13:10:07.541893+0000","last_became_active":"2024-03-04T12:20:14.811334+0000","last_became_peered":"2024-03-04T12:20:14.811334+0000","last_unstale":"2024-03-04T13:10:07.541893+0000","last_undegraded":"2024-03-04T13:10:07.541893+0000","last_fullsized":"2024-03-04T13:10:07.541893+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:50:58.929170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12062855,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":462,"num_read_kb":33282,"num_write":1224,"num_write_kb":31843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"255'760","reported_seq":2377,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.555573+0000","last_change":"2024-03-04T12:20:16.835553+0000","last_active":"2024-03-04T13:12:22.555573+0000","last_peered":"2024-03-04T13:12:22.555573+0000","last_clean":"2024-03-04T13:12:22.555573+0000","last_became_active":"2024-03-04T12:20:16.835285+0000","last_became_peered":"2024-03-04T12:20:16.835285+0000","last_unstale":"2024-03-04T13:12:22.555573+0000","last_undegraded":"2024-03-04T13:12:22.555573+0000","last_fullsized":"2024-03-04T13:12:22.555573+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:29:20.569225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3723,"num_read_kb":3381,"num_write":1013,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"255'217","reported_seq":846,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.137749+0000","last_change":"2024-03-04T12:20:14.818864+0000","last_active":"2024-03-04T13:13:21.137749+0000","last_peered":"2024-03-04T13:13:21.137749+0000","last_clean":"2024-03-04T13:13:21.137749+0000","last_became_active":"2024-03-04T12:20:14.818385+0000","last_became_peered":"2024-03-04T12:20:14.818385+0000","last_unstale":"2024-03-04T13:13:21.137749+0000","last_undegraded":"2024-03-04T13:13:21.137749+0000","last_fullsized":"2024-03-04T13:13:21.137749+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:02.154903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":39388,"num_write":1130,"num_write_kb":46394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"255'1082","reported_seq":2780,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.766506+0000","last_change":"2024-03-04T12:20:16.823981+0000","last_active":"2024-03-04T13:12:12.766506+0000","last_peered":"2024-03-04T13:12:12.766506+0000","last_clean":"2024-03-04T13:12:12.766506+0000","last_became_active":"2024-03-04T12:20:16.823596+0000","last_became_peered":"2024-03-04T12:20:16.823596+0000","last_unstale":"2024-03-04T13:12:12.766506+0000","last_undegraded":"2024-03-04T13:12:12.766506+0000","last_fullsized":"2024-03-04T13:12:12.766506+0000","mapping_epoch":22,"log_start":"255'1000","ondisk_log_start":"255'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":1000,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:37:17.796839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5087,"num_read_kb":4523,"num_write":1483,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"255'226","reported_seq":1075,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.174081+0000","last_change":"2024-03-04T12:20:14.818818+0000","last_active":"2024-03-04T13:13:21.174081+0000","last_peered":"2024-03-04T13:13:21.174081+0000","last_clean":"2024-03-04T13:13:21.174081+0000","last_became_active":"2024-03-04T12:20:14.818340+0000","last_became_peered":"2024-03-04T12:20:14.818340+0000","last_unstale":"2024-03-04T13:13:21.174081+0000","last_undegraded":"2024-03-04T13:13:21.174081+0000","last_fullsized":"2024-03-04T13:13:21.174081+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:30:11.725740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":933,"num_read_kb":21991,"num_write":1290,"num_write_kb":38918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"255'450","reported_seq":1993,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.297591+0000","last_change":"2024-03-04T12:20:16.830513+0000","last_active":"2024-03-04T13:12:31.297591+0000","last_peered":"2024-03-04T13:12:31.297591+0000","last_clean":"2024-03-04T13:12:31.297591+0000","last_became_active":"2024-03-04T12:20:16.830259+0000","last_became_peered":"2024-03-04T12:20:16.830259+0000","last_unstale":"2024-03-04T13:12:31.297591+0000","last_undegraded":"2024-03-04T13:12:31.297591+0000","last_fullsized":"2024-03-04T13:12:31.297591+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:12:15.968195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2206,"num_write":536,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"255'206","reported_seq":855,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.052457+0000","last_change":"2024-03-04T12:20:14.824797+0000","last_active":"2024-03-04T13:13:21.052457+0000","last_peered":"2024-03-04T13:13:21.052457+0000","last_clean":"2024-03-04T13:13:21.052457+0000","last_became_active":"2024-03-04T12:20:14.823513+0000","last_became_peered":"2024-03-04T12:20:14.823513+0000","last_unstale":"2024-03-04T13:13:21.052457+0000","last_undegraded":"2024-03-04T13:13:21.052457+0000","last_fullsized":"2024-03-04T13:13:21.052457+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:15:56.550416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706375,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":60209,"num_write":1193,"num_write_kb":41508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"255'752","reported_seq":2232,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:05.090024+0000","last_change":"2024-03-04T12:20:16.825790+0000","last_active":"2024-03-04T13:12:05.090024+0000","last_peered":"2024-03-04T13:12:05.090024+0000","last_clean":"2024-03-04T13:12:05.090024+0000","last_became_active":"2024-03-04T12:20:16.825534+0000","last_became_peered":"2024-03-04T12:20:16.825534+0000","last_unstale":"2024-03-04T13:12:05.090024+0000","last_undegraded":"2024-03-04T13:12:05.090024+0000","last_fullsized":"2024-03-04T13:12:05.090024+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:47:30.154655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3330,"num_read_kb":2980,"num_write":1004,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"255'222","reported_seq":830,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.066163+0000","last_change":"2024-03-04T12:20:14.817902+0000","last_active":"2024-03-04T13:13:21.066163+0000","last_peered":"2024-03-04T13:13:21.066163+0000","last_clean":"2024-03-04T13:13:21.066163+0000","last_became_active":"2024-03-04T12:20:14.817531+0000","last_became_peered":"2024-03-04T12:20:14.817531+0000","last_unstale":"2024-03-04T13:13:21.066163+0000","last_undegraded":"2024-03-04T13:13:21.066163+0000","last_fullsized":"2024-03-04T13:13:21.066163+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:38:40.926380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7696,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":19231,"num_write":1186,"num_write_kb":63143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"255'534","reported_seq":2107,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:01.977958+0000","last_change":"2024-03-04T12:20:16.823620+0000","last_active":"2024-03-04T13:12:01.977958+0000","last_peered":"2024-03-04T13:12:01.977958+0000","last_clean":"2024-03-04T13:12:01.977958+0000","last_became_active":"2024-03-04T12:20:16.823358+0000","last_became_peered":"2024-03-04T12:20:16.823358+0000","last_unstale":"2024-03-04T13:12:01.977958+0000","last_undegraded":"2024-03-04T13:12:01.977958+0000","last_fullsized":"2024-03-04T13:12:01.977958+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:56:00.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2875,"num_read_kb":2619,"num_write":718,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"255'185","reported_seq":789,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.005459+0000","last_change":"2024-03-04T12:20:50.902553+0000","last_active":"2024-03-04T13:13:21.005459+0000","last_peered":"2024-03-04T13:13:21.005459+0000","last_clean":"2024-03-04T13:13:21.005459+0000","last_became_active":"2024-03-04T12:20:50.902181+0000","last_became_peered":"2024-03-04T12:20:50.902181+0000","last_unstale":"2024-03-04T13:13:21.005459+0000","last_undegraded":"2024-03-04T13:13:21.005459+0000","last_fullsized":"2024-03-04T13:13:21.005459+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:36.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918078,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":20827,"num_write":1047,"num_write_kb":19608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"255'418","reported_seq":1796,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:01.977296+0000","last_change":"2024-03-04T12:20:16.819439+0000","last_active":"2024-03-04T13:12:01.977296+0000","last_peered":"2024-03-04T13:12:01.977296+0000","last_clean":"2024-03-04T13:12:01.977296+0000","last_became_active":"2024-03-04T12:20:16.819169+0000","last_became_peered":"2024-03-04T12:20:16.819169+0000","last_unstale":"2024-03-04T13:12:01.977296+0000","last_undegraded":"2024-03-04T13:12:01.977296+0000","last_fullsized":"2024-03-04T13:12:01.977296+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:22:24.173643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2116,"num_read_kb":1957,"num_write":522,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"255'172","reported_seq":787,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.042546+0000","last_change":"2024-03-04T12:20:14.823104+0000","last_active":"2024-03-04T13:13:21.042546+0000","last_peered":"2024-03-04T13:13:21.042546+0000","last_clean":"2024-03-04T13:13:21.042546+0000","last_became_active":"2024-03-04T12:20:14.822588+0000","last_became_peered":"2024-03-04T12:20:14.822588+0000","last_unstale":"2024-03-04T13:13:21.042546+0000","last_undegraded":"2024-03-04T13:13:21.042546+0000","last_fullsized":"2024-03-04T13:13:21.042546+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:58:44.728443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":390,"num_read_kb":47350,"num_write":1028,"num_write_kb":32429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"255'482","reported_seq":2025,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.558145+0000","last_change":"2024-03-04T12:20:16.828912+0000","last_active":"2024-03-04T13:12:22.558145+0000","last_peered":"2024-03-04T13:12:22.558145+0000","last_clean":"2024-03-04T13:12:22.558145+0000","last_became_active":"2024-03-04T12:20:16.828618+0000","last_became_peered":"2024-03-04T12:20:16.828618+0000","last_unstale":"2024-03-04T13:12:22.558145+0000","last_undegraded":"2024-03-04T13:12:22.558145+0000","last_fullsized":"2024-03-04T13:12:22.558145+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:00:24.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2516,"num_read_kb":2328,"num_write":610,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"255'180","reported_seq":910,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.206947+0000","last_change":"2024-03-04T12:20:14.819283+0000","last_active":"2024-03-04T13:13:21.206947+0000","last_peered":"2024-03-04T13:13:21.206947+0000","last_clean":"2024-03-04T13:13:21.206947+0000","last_became_active":"2024-03-04T12:20:14.818924+0000","last_became_peered":"2024-03-04T12:20:14.818924+0000","last_unstale":"2024-03-04T13:13:21.206947+0000","last_undegraded":"2024-03-04T13:13:21.206947+0000","last_fullsized":"2024-03-04T13:13:21.206947+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:41:49.091659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":719,"num_read_kb":26573,"num_write":1059,"num_write_kb":25938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"255'850","reported_seq":2378,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.782373+0000","last_change":"2024-03-04T12:20:16.835574+0000","last_active":"2024-03-04T13:12:34.782373+0000","last_peered":"2024-03-04T13:12:34.782373+0000","last_clean":"2024-03-04T13:12:34.782373+0000","last_became_active":"2024-03-04T12:20:16.835308+0000","last_became_peered":"2024-03-04T12:20:16.835308+0000","last_unstale":"2024-03-04T13:12:34.782373+0000","last_undegraded":"2024-03-04T13:12:34.782373+0000","last_fullsized":"2024-03-04T13:12:34.782373+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:38.783596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3917,"num_read_kb":3486,"num_write":1199,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"255'194","reported_seq":801,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.154246+0000","last_change":"2024-03-04T12:20:14.816730+0000","last_active":"2024-03-04T13:13:21.154246+0000","last_peered":"2024-03-04T13:13:21.154246+0000","last_clean":"2024-03-04T13:13:21.154246+0000","last_became_active":"2024-03-04T12:20:14.816440+0000","last_became_peered":"2024-03-04T12:20:14.816440+0000","last_unstale":"2024-03-04T13:13:21.154246+0000","last_undegraded":"2024-03-04T13:13:21.154246+0000","last_fullsized":"2024-03-04T13:13:21.154246+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:38.943831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17822208,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":392,"num_read_kb":7899,"num_write":1089,"num_write_kb":49946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"255'688","reported_seq":2008,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.308538+0000","last_change":"2024-03-04T12:20:16.828266+0000","last_active":"2024-03-04T13:12:39.308538+0000","last_peered":"2024-03-04T13:12:39.308538+0000","last_clean":"2024-03-04T13:12:39.308538+0000","last_became_active":"2024-03-04T12:20:16.827770+0000","last_became_peered":"2024-03-04T12:20:16.827770+0000","last_unstale":"2024-03-04T13:12:39.308538+0000","last_undegraded":"2024-03-04T13:12:39.308538+0000","last_fullsized":"2024-03-04T13:12:39.308538+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":600,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:29:10.790580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3073,"num_read_kb":2741,"num_write":929,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"255'191","reported_seq":798,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.079883+0000","last_change":"2024-03-04T12:20:14.820669+0000","last_active":"2024-03-04T13:13:21.079883+0000","last_peered":"2024-03-04T13:13:21.079883+0000","last_clean":"2024-03-04T13:13:21.079883+0000","last_became_active":"2024-03-04T12:20:14.820393+0000","last_became_peered":"2024-03-04T12:20:14.820393+0000","last_unstale":"2024-03-04T13:13:21.079883+0000","last_undegraded":"2024-03-04T13:13:21.079883+0000","last_fullsized":"2024-03-04T13:13:21.079883+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:28.246980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":6825,"num_write":1149,"num_write_kb":21389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"255'357","reported_seq":1774,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573122+0000","last_change":"2024-03-04T12:20:16.829573+0000","last_active":"2024-03-04T13:12:50.573122+0000","last_peered":"2024-03-04T13:12:50.573122+0000","last_clean":"2024-03-04T13:12:50.573122+0000","last_became_active":"2024-03-04T12:20:16.829306+0000","last_became_peered":"2024-03-04T12:20:16.829306+0000","last_unstale":"2024-03-04T13:12:50.573122+0000","last_undegraded":"2024-03-04T13:12:50.573122+0000","last_fullsized":"2024-03-04T13:12:50.573122+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:34.297959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1952,"num_read_kb":1858,"num_write":426,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"255'171","reported_seq":773,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.129708+0000","last_change":"2024-03-04T12:20:14.823519+0000","last_active":"2024-03-04T13:13:21.129708+0000","last_peered":"2024-03-04T13:13:21.129708+0000","last_clean":"2024-03-04T13:13:21.129708+0000","last_became_active":"2024-03-04T12:20:14.821961+0000","last_became_peered":"2024-03-04T12:20:14.821961+0000","last_unstale":"2024-03-04T13:13:21.129708+0000","last_undegraded":"2024-03-04T13:13:21.129708+0000","last_fullsized":"2024-03-04T13:13:21.129708+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:49.422340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":395,"num_read_kb":13429,"num_write":876,"num_write_kb":50070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"255'154","reported_seq":722,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.058864+0000","last_change":"2024-03-04T12:20:51.031233+0000","last_active":"2024-03-04T13:13:21.058864+0000","last_peered":"2024-03-04T13:13:21.058864+0000","last_clean":"2024-03-04T13:13:21.058864+0000","last_became_active":"2024-03-04T12:20:51.030887+0000","last_became_peered":"2024-03-04T12:20:51.030887+0000","last_unstale":"2024-03-04T13:13:21.058864+0000","last_undegraded":"2024-03-04T13:13:21.058864+0000","last_fullsized":"2024-03-04T13:13:21.058864+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:43:37.763295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":307,"num_read_kb":55812,"num_write":877,"num_write_kb":48688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"255'385","reported_seq":1778,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.327576+0000","last_change":"2024-03-04T12:20:16.831651+0000","last_active":"2024-03-04T13:12:39.327576+0000","last_peered":"2024-03-04T13:12:39.327576+0000","last_clean":"2024-03-04T13:12:39.327576+0000","last_became_active":"2024-03-04T12:20:16.831393+0000","last_became_peered":"2024-03-04T12:20:16.831393+0000","last_unstale":"2024-03-04T13:12:39.327576+0000","last_undegraded":"2024-03-04T13:12:39.327576+0000","last_fullsized":"2024-03-04T13:12:39.327576+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:40.571982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2009,"num_read_kb":1888,"num_write":461,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"255'190","reported_seq":862,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:14.420866+0000","last_change":"2024-03-04T12:20:14.818169+0000","last_active":"2024-03-04T13:10:14.420866+0000","last_peered":"2024-03-04T13:10:14.420866+0000","last_clean":"2024-03-04T13:10:14.420866+0000","last_became_active":"2024-03-04T12:20:14.817894+0000","last_became_peered":"2024-03-04T12:20:14.817894+0000","last_unstale":"2024-03-04T13:10:14.420866+0000","last_undegraded":"2024-03-04T13:10:14.420866+0000","last_fullsized":"2024-03-04T13:10:14.420866+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:00.852850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270127,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":164272,"num_write":1069,"num_write_kb":63423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"255'517","reported_seq":1960,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.741465+0000","last_change":"2024-03-04T12:20:16.824278+0000","last_active":"2024-03-04T13:11:27.741465+0000","last_peered":"2024-03-04T13:11:27.741465+0000","last_clean":"2024-03-04T13:11:27.741465+0000","last_became_active":"2024-03-04T12:20:16.823974+0000","last_became_peered":"2024-03-04T12:20:16.823974+0000","last_unstale":"2024-03-04T13:11:27.741465+0000","last_undegraded":"2024-03-04T13:11:27.741465+0000","last_fullsized":"2024-03-04T13:11:27.741465+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:53.806735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2611,"num_read_kb":2352,"num_write":706,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":133,"num_read_kb":185523,"num_write":151,"num_write_kb":127147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55623680,"data_stored":55622944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5335,"num_read_kb":3794,"num_write":2149,"num_write_kb":803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1182,"ondisk_log_size":1182,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":10065,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":12124,"num_read_kb":11961,"num_write":14025,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":20130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2376,"ondisk_log_size":2376,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":278213,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8407,"num_read_kb":10340,"num_write":5903,"num_write_kb":2708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":30088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1894,"ondisk_log_size":1894,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1637,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1554,"num_read_kb":1549,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":187558,"num_read_kb":170512,"num_write":50934,"num_write_kb":17677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3785,"ondisk_log_size":3785,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":230107981,"num_objects":280,"num_object_clones":0,"num_object_copies":560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":29459,"num_read_kb":2152910,"num_write":68717,"num_write_kb":2157934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":455168000,"data_stored":453533199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4233,"ondisk_log_size":4233,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":196827,"num_write":154,"num_write_kb":127147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45088768,"data_stored":45088768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575492,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":278660,"kb_used_data":71104,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94093180,"statfs":{"total":96636764160,"available":96351416320,"internally_reserved":0,"allocated":72810496,"data_stored":71072930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212466122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575493,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274148,"kb_used_data":40240,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94097692,"statfs":{"total":96636764160,"available":96356036608,"internally_reserved":0,"allocated":41205760,"data_stored":39656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575493,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149996,"kb_used_data":68804,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94221844,"statfs":{"total":96636764160,"available":96483168256,"internally_reserved":0,"allocated":70455296,"data_stored":68729090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575492,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108236,"kb_used_data":40948,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94263604,"statfs":{"total":96636764160,"available":96525930496,"internally_reserved":0,"allocated":41930752,"data_stored":40369557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575492,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284164,"kb_used_data":76592,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94087676,"statfs":{"total":96636764160,"available":96345780224,"internally_reserved":0,"allocated":78430208,"data_stored":76690401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":212466119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575493,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119312,"kb_used_data":47864,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94252528,"statfs":{"total":96636764160,"available":96514588672,"internally_reserved":0,"allocated":49012736,"data_stored":47453483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575493,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276104,"kb_used_data":164480,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94095736,"statfs":{"total":96636764160,"available":96354033664,"internally_reserved":0,"allocated":168427520,"data_stored":166747056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575491,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273248,"kb_used_data":61540,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94098592,"statfs":{"total":96636764160,"available":96356958208,"internally_reserved":0,"allocated":63016960,"data_stored":61377358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":47357952,"data_stored":47171521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":124960768,"data_stored":124750176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45522944,"data_stored":45373582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":64413696,"data_stored":64121957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32161792,"data_stored":31999474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":56401920,"data_stored":56160984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21966848,"data_stored":21846112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":62382080,"data_stored":62109393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":23702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22069248,"data_stored":22068512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T13:13:23.472 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-04T13:13:23.787 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:23.787 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":255,"fsid":"d1d8dd61-f240-416d-a8c7-564800fa8311","created":"2024-03-04T12:19:45.018205+0000","modified":"2024-03-04T12:46:51.959125+0000","last_up_change":"2024-03-04T12:19:56.748782+0000","last_in_change":"2024-03-04T12:19:48.216003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":67,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-04T12:19:57.318984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-04T12:20:03.986192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-03-04T12:20:13.654079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-03-04T12:20:15.134788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-03-04T12:20:16.975960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-03-04T12:20:19.093681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-03-04T12:20:20.844477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-03-04T12:20:22.912520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":64,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-03-04T12:29:00.007585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"244","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-03-04T12:32:40.740863+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"247","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-03-04T12:32:44.940192+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"250","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.otp","create_time":"2024-03-04T12:46:20.937729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"253","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"922e853a-a6f3-4c4d-8778-e24d4fe356f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":254,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3146826323},{"type":"v1","addr":"172.21.15.110:6809","nonce":3146826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3146826323},{"type":"v1","addr":"172.21.15.110:6811","nonce":3146826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3146826323},{"type":"v1","addr":"172.21.15.110:6815","nonce":3146826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3146826323},{"type":"v1","addr":"172.21.15.110:6813","nonce":3146826323}]},"public_addr":"172.21.15.110:6809/3146826323","cluster_addr":"172.21.15.110:6811/3146826323","heartbeat_back_addr":"172.21.15.110:6815/3146826323","heartbeat_front_addr":"172.21.15.110:6813/3146826323","state":["exists","up"]},{"osd":1,"uuid":"dc1229f0-30b4-46f3-8d1b-05eac1e21ae9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":251,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3005097257},{"type":"v1","addr":"172.21.15.110:6825","nonce":3005097257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3005097257},{"type":"v1","addr":"172.21.15.110:6827","nonce":3005097257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3005097257},{"type":"v1","addr":"172.21.15.110:6831","nonce":3005097257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3005097257},{"type":"v1","addr":"172.21.15.110:6829","nonce":3005097257}]},"public_addr":"172.21.15.110:6825/3005097257","cluster_addr":"172.21.15.110:6827/3005097257","heartbeat_back_addr":"172.21.15.110:6831/3005097257","heartbeat_front_addr":"172.21.15.110:6829/3005097257","state":["exists","up"]},{"osd":2,"uuid":"5ff1bd28-cc33-4d98-8e2b-c214194ee334","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":248,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2482344533},{"type":"v1","addr":"172.21.15.110:6801","nonce":2482344533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2482344533},{"type":"v1","addr":"172.21.15.110:6803","nonce":2482344533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2482344533},{"type":"v1","addr":"172.21.15.110:6807","nonce":2482344533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2482344533},{"type":"v1","addr":"172.21.15.110:6805","nonce":2482344533}]},"public_addr":"172.21.15.110:6801/2482344533","cluster_addr":"172.21.15.110:6803/2482344533","heartbeat_back_addr":"172.21.15.110:6807/2482344533","heartbeat_front_addr":"172.21.15.110:6805/2482344533","state":["exists","up"]},{"osd":3,"uuid":"ca92763a-b287-481e-a6d2-56a30f5fcd7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":251,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2308430566},{"type":"v1","addr":"172.21.15.110:6817","nonce":2308430566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2308430566},{"type":"v1","addr":"172.21.15.110:6819","nonce":2308430566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2308430566},{"type":"v1","addr":"172.21.15.110:6823","nonce":2308430566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2308430566},{"type":"v1","addr":"172.21.15.110:6821","nonce":2308430566}]},"public_addr":"172.21.15.110:6817/2308430566","cluster_addr":"172.21.15.110:6819/2308430566","heartbeat_back_addr":"172.21.15.110:6823/2308430566","heartbeat_front_addr":"172.21.15.110:6821/2308430566","state":["exists","up"]},{"osd":4,"uuid":"b95079a0-f322-48fe-ba2c-4a78ffe05dfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":251,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3873506104},{"type":"v1","addr":"172.21.15.172:6809","nonce":3873506104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3873506104},{"type":"v1","addr":"172.21.15.172:6811","nonce":3873506104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3873506104},{"type":"v1","addr":"172.21.15.172:6815","nonce":3873506104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3873506104},{"type":"v1","addr":"172.21.15.172:6813","nonce":3873506104}]},"public_addr":"172.21.15.172:6809/3873506104","cluster_addr":"172.21.15.172:6811/3873506104","heartbeat_back_addr":"172.21.15.172:6815/3873506104","heartbeat_front_addr":"172.21.15.172:6813/3873506104","state":["exists","up"]},{"osd":5,"uuid":"11d5852a-b541-4483-a150-d5255e18cb28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":251,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":824320839},{"type":"v1","addr":"172.21.15.172:6801","nonce":824320839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":824320839},{"type":"v1","addr":"172.21.15.172:6803","nonce":824320839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":824320839},{"type":"v1","addr":"172.21.15.172:6807","nonce":824320839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":824320839},{"type":"v1","addr":"172.21.15.172:6805","nonce":824320839}]},"public_addr":"172.21.15.172:6801/824320839","cluster_addr":"172.21.15.172:6803/824320839","heartbeat_back_addr":"172.21.15.172:6807/824320839","heartbeat_front_addr":"172.21.15.172:6805/824320839","state":["exists","up"]},{"osd":6,"uuid":"cd71a69e-5780-4a9e-952e-84e5ca55c859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":251,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6821","nonce":1928063852},{"type":"v1","addr":"172.21.15.172:6823","nonce":1928063852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6825","nonce":1928063852},{"type":"v1","addr":"172.21.15.172:6827","nonce":1928063852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1928063852},{"type":"v1","addr":"172.21.15.172:6831","nonce":1928063852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1928063852},{"type":"v1","addr":"172.21.15.172:6829","nonce":1928063852}]},"public_addr":"172.21.15.172:6823/1928063852","cluster_addr":"172.21.15.172:6827/1928063852","heartbeat_back_addr":"172.21.15.172:6831/1928063852","heartbeat_front_addr":"172.21.15.172:6829/1928063852","state":["exists","up"]},{"osd":7,"uuid":"1068d0ef-20ea-4d21-bec0-9cfa650be0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":251,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":486554607},{"type":"v1","addr":"172.21.15.172:6817","nonce":486554607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":486554607},{"type":"v1","addr":"172.21.15.172:6819","nonce":486554607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":486554607},{"type":"v1","addr":"172.21.15.172:6826","nonce":486554607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":486554607},{"type":"v1","addr":"172.21.15.172:6822","nonce":486554607}]},"public_addr":"172.21.15.172:6817/486554607","cluster_addr":"172.21.15.172:6819/486554607","heartbeat_back_addr":"172.21.15.172:6826/486554607","heartbeat_front_addr":"172.21.15.172:6822/486554607","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.396267+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.415617+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.330003+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.354908+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.437877+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.300459+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.394851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-04T12:19:53.377902+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":1}]},{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"67.14","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-04T13:13:24.801 INFO:tasks.ceph:Scrubbing osd.0 2024-03-04T13:13:24.802 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-04T13:13:24.951 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T13:13:24.952 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T13:13:24.952 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T13:13:24.963 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-04T13:13:25.259 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 0 to deep-scrub 2024-03-04T13:13:25.272 INFO:tasks.ceph:Scrubbing osd.1 2024-03-04T13:13:25.272 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-04T13:13:25.410 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T13:13:25.410 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T13:13:25.410 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T13:13:25.421 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-04T13:13:25.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-03-04T13:13:25.718 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 1 to deep-scrub 2024-03-04T13:13:25.731 INFO:tasks.ceph:Scrubbing osd.2 2024-03-04T13:13:25.732 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-04T13:13:25.870 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T13:13:25.870 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T13:13:25.870 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T13:13:25.881 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-04T13:13:26.178 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 2 to deep-scrub 2024-03-04T13:13:26.191 INFO:tasks.ceph:Scrubbing osd.3 2024-03-04T13:13:26.191 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-04T13:13:26.329 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T13:13:26.329 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T13:13:26.329 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T13:13:26.339 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-04T13:13:26.641 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 3 to deep-scrub 2024-03-04T13:13:26.654 INFO:tasks.ceph:Scrubbing osd.4 2024-03-04T13:13:26.655 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-04T13:13:26.796 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T13:13:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T13:13:26.797 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T13:13:26.807 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-04T13:13:27.105 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 4 to deep-scrub 2024-03-04T13:13:27.118 INFO:tasks.ceph:Scrubbing osd.5 2024-03-04T13:13:27.118 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-04T13:13:27.257 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T13:13:27.257 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T13:13:27.257 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T13:13:27.267 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-04T13:13:27.564 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 5 to deep-scrub 2024-03-04T13:13:27.578 INFO:tasks.ceph:Scrubbing osd.6 2024-03-04T13:13:27.578 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-04T13:13:27.717 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T13:13:27.717 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T13:13:27.718 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T13:13:27.729 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-04T13:13:28.028 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 6 to deep-scrub 2024-03-04T13:13:28.041 INFO:tasks.ceph:Scrubbing osd.7 2024-03-04T13:13:28.041 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-04T13:13:28.179 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-03-04T13:13:28.179 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-04T13:13:28.179 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-03-04T13:13:28.190 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-04T13:13:28.486 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 7 to deep-scrub 2024-03-04T13:13:28.500 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T13:13:28.830 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:28.842 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-03-04T13:13:28.845 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":1853,"stamp":"2024-03-04T13:13:28.554952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":224166809,"num_objects":654,"num_object_clones":0,"num_object_copies":1308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":654,"num_whiteouts":0,"num_read":244903,"num_read_kb":2733632,"num_write":142264,"num_write_kb":2439961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14137,"ondisk_log_size":14137,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1658556,"kb_used_data":466344,"kb_used_omap":12,"kb_used_meta":1191859,"kb_avail":753316164,"statfs":{"total":773094113280,"available":771395751936,"internally_reserved":0,"allocated":477536256,"data_stored":464436620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1220464178},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-530591026,"num_objects":-254,"num_object_clones":0,"num_object_copies":-508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-254,"num_whiteouts":0,"num_read":618,"num_read_kb":694,"num_write":399,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004408"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:22.510049+0000","last_change":"2024-03-04T12:46:22.249796+0000","last_active":"2024-03-04T13:11:22.510049+0000","last_peered":"2024-03-04T13:11:22.510049+0000","last_clean":"2024-03-04T13:11:22.510049+0000","last_became_active":"2024-03-04T12:46:22.248352+0000","last_became_peered":"2024-03-04T12:46:22.248352+0000","last_unstale":"2024-03-04T13:11:22.510049+0000","last_undegraded":"2024-03-04T13:11:22.510049+0000","last_fullsized":"2024-03-04T13:11:22.510049+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.559403+0000","last_change":"2024-03-04T12:32:46.051455+0000","last_active":"2024-03-04T13:12:47.559403+0000","last_peered":"2024-03-04T13:12:47.559403+0000","last_clean":"2024-03-04T13:12:47.559403+0000","last_became_active":"2024-03-04T12:32:46.051177+0000","last_became_peered":"2024-03-04T12:32:46.051177+0000","last_unstale":"2024-03-04T13:12:47.559403+0000","last_undegraded":"2024-03-04T13:12:47.559403+0000","last_fullsized":"2024-03-04T13:12:47.559403+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"255'2","reported_seq":52,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.195877+0000","last_change":"2024-03-04T12:32:42.034412+0000","last_active":"2024-03-04T13:13:21.195877+0000","last_peered":"2024-03-04T13:13:21.195877+0000","last_clean":"2024-03-04T13:13:21.195877+0000","last_became_active":"2024-03-04T12:32:42.034142+0000","last_became_peered":"2024-03-04T12:32:42.034142+0000","last_unstale":"2024-03-04T13:13:21.195877+0000","last_undegraded":"2024-03-04T13:13:21.195877+0000","last_fullsized":"2024-03-04T13:13:21.195877+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"255'17","reported_seq":91,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.462943+0000","last_change":"2024-03-04T12:29:01.703199+0000","last_active":"2024-03-04T13:12:47.462943+0000","last_peered":"2024-03-04T13:12:47.462943+0000","last_clean":"2024-03-04T13:12:47.462943+0000","last_became_active":"2024-03-04T12:29:01.702925+0000","last_became_peered":"2024-03-04T12:29:01.702925+0000","last_unstale":"2024-03-04T13:12:47.462943+0000","last_undegraded":"2024-03-04T13:12:47.462943+0000","last_fullsized":"2024-03-04T13:12:47.462943+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":40,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.343248+0000","last_change":"2024-03-04T12:46:22.258654+0000","last_active":"2024-03-04T13:08:52.343248+0000","last_peered":"2024-03-04T13:08:52.343248+0000","last_clean":"2024-03-04T13:08:52.343248+0000","last_became_active":"2024-03-04T12:46:22.258268+0000","last_became_peered":"2024-03-04T12:46:22.258268+0000","last_unstale":"2024-03-04T13:08:52.343248+0000","last_undegraded":"2024-03-04T13:08:52.343248+0000","last_fullsized":"2024-03-04T13:08:52.343248+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:28:49.843503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"255'11","reported_seq":68,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.130764+0000","last_change":"2024-03-04T12:32:46.052063+0000","last_active":"2024-03-04T13:13:21.130764+0000","last_peered":"2024-03-04T13:13:21.130764+0000","last_clean":"2024-03-04T13:13:21.130764+0000","last_became_active":"2024-03-04T12:32:46.051799+0000","last_became_peered":"2024-03-04T12:32:46.051799+0000","last_unstale":"2024-03-04T13:13:21.130764+0000","last_undegraded":"2024-03-04T13:13:21.130764+0000","last_fullsized":"2024-03-04T13:13:21.130764+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":43010,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"255'9","reported_seq":65,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.164575+0000","last_change":"2024-03-04T12:32:42.038130+0000","last_active":"2024-03-04T13:13:21.164575+0000","last_peered":"2024-03-04T13:13:21.164575+0000","last_clean":"2024-03-04T13:13:21.164575+0000","last_became_active":"2024-03-04T12:32:42.037701+0000","last_became_peered":"2024-03-04T12:32:42.037701+0000","last_unstale":"2024-03-04T13:13:21.164575+0000","last_undegraded":"2024-03-04T13:13:21.164575+0000","last_fullsized":"2024-03-04T13:13:21.164575+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"255'28","reported_seq":120,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:07.465133+0000","last_change":"2024-03-04T12:29:01.701298+0000","last_active":"2024-03-04T13:13:07.465133+0000","last_peered":"2024-03-04T13:13:07.465133+0000","last_clean":"2024-03-04T13:13:07.465133+0000","last_became_active":"2024-03-04T12:29:01.701003+0000","last_became_peered":"2024-03-04T12:29:01.701003+0000","last_unstale":"2024-03-04T13:13:07.465133+0000","last_undegraded":"2024-03-04T13:13:07.465133+0000","last_fullsized":"2024-03-04T13:13:07.465133+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":75,"num_write":51,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.467137+0000","last_change":"2024-03-04T12:46:22.308264+0000","last_active":"2024-03-04T13:12:27.467137+0000","last_peered":"2024-03-04T13:12:27.467137+0000","last_clean":"2024-03-04T13:12:27.467137+0000","last_became_active":"2024-03-04T12:46:22.307955+0000","last_became_peered":"2024-03-04T12:46:22.307955+0000","last_unstale":"2024-03-04T13:12:27.467137+0000","last_undegraded":"2024-03-04T13:12:27.467137+0000","last_fullsized":"2024-03-04T13:12:27.467137+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":42,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520565+0000","last_change":"2024-03-04T12:32:46.053816+0000","last_active":"2024-03-04T13:12:22.520565+0000","last_peered":"2024-03-04T13:12:22.520565+0000","last_clean":"2024-03-04T13:12:22.520565+0000","last_became_active":"2024-03-04T12:32:46.053497+0000","last_became_peered":"2024-03-04T12:32:46.053497+0000","last_unstale":"2024-03-04T13:12:22.520565+0000","last_undegraded":"2024-03-04T13:12:22.520565+0000","last_fullsized":"2024-03-04T13:12:22.520565+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"255'3","reported_seq":52,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.222037+0000","last_change":"2024-03-04T12:32:42.037134+0000","last_active":"2024-03-04T13:13:21.222037+0000","last_peered":"2024-03-04T13:13:21.222037+0000","last_clean":"2024-03-04T13:13:21.222037+0000","last_became_active":"2024-03-04T12:32:42.036801+0000","last_became_peered":"2024-03-04T12:32:42.036801+0000","last_unstale":"2024-03-04T13:13:21.222037+0000","last_undegraded":"2024-03-04T13:13:21.222037+0000","last_fullsized":"2024-03-04T13:13:21.222037+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"255'24","reported_seq":108,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.486375+0000","last_change":"2024-03-04T12:29:01.707999+0000","last_active":"2024-03-04T13:09:02.486375+0000","last_peered":"2024-03-04T13:09:02.486375+0000","last_clean":"2024-03-04T13:09:02.486375+0000","last_became_active":"2024-03-04T12:29:01.707589+0000","last_became_peered":"2024-03-04T12:29:01.707589+0000","last_unstale":"2024-03-04T13:09:02.486375+0000","last_undegraded":"2024-03-04T13:09:02.486375+0000","last_fullsized":"2024-03-04T13:09:02.486375+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:49:51.454986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":71,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260932+0000","last_change":"2024-03-04T12:46:22.310150+0000","last_active":"2024-03-04T13:13:25.260932+0000","last_peered":"2024-03-04T13:13:25.260932+0000","last_clean":"2024-03-04T13:13:25.260932+0000","last_became_active":"2024-03-04T12:46:22.309869+0000","last_became_peered":"2024-03-04T12:46:22.309869+0000","last_unstale":"2024-03-04T13:13:25.260932+0000","last_undegraded":"2024-03-04T13:13:25.260932+0000","last_fullsized":"2024-03-04T13:13:25.260932+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"255'3","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.109546+0000","last_change":"2024-03-04T12:32:46.057930+0000","last_active":"2024-03-04T13:13:21.109546+0000","last_peered":"2024-03-04T13:13:21.109546+0000","last_clean":"2024-03-04T13:13:21.109546+0000","last_became_active":"2024-03-04T12:32:46.057603+0000","last_became_peered":"2024-03-04T12:32:46.057603+0000","last_unstale":"2024-03-04T13:13:21.109546+0000","last_undegraded":"2024-03-04T13:13:21.109546+0000","last_fullsized":"2024-03-04T13:13:21.109546+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"250'3","reported_seq":59,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.892793+0000","last_change":"2024-03-04T13:13:25.892816+0000","last_active":"2024-03-04T13:13:25.892793+0000","last_peered":"2024-03-04T13:13:25.892793+0000","last_clean":"2024-03-04T13:13:25.892793+0000","last_became_active":"2024-03-04T12:32:42.032231+0000","last_became_peered":"2024-03-04T12:32:42.032231+0000","last_unstale":"2024-03-04T13:13:25.892793+0000","last_undegraded":"2024-03-04T13:13:25.892793+0000","last_fullsized":"2024-03-04T13:13:25.892793+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'3","last_scrub_stamp":"2024-03-04T13:13:25.892721+0000","last_deep_scrub":"250'3","last_deep_scrub_stamp":"2024-03-04T13:13:25.892721+0000","last_clean_scrub_stamp":"2024-03-04T13:13:25.892721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:39:35.803550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"255'27","reported_seq":112,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:32.550907+0000","last_change":"2024-03-04T12:29:01.704816+0000","last_active":"2024-03-04T13:11:32.550907+0000","last_peered":"2024-03-04T13:11:32.550907+0000","last_clean":"2024-03-04T13:11:32.550907+0000","last_became_active":"2024-03-04T12:29:01.704548+0000","last_became_peered":"2024-03-04T12:29:01.704548+0000","last_unstale":"2024-03-04T13:11:32.550907+0000","last_undegraded":"2024-03-04T13:11:32.550907+0000","last_fullsized":"2024-03-04T13:11:32.550907+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":73,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.481590+0000","last_change":"2024-03-04T12:46:22.258204+0000","last_active":"2024-03-04T13:10:32.481590+0000","last_peered":"2024-03-04T13:10:32.481590+0000","last_clean":"2024-03-04T13:10:32.481590+0000","last_became_active":"2024-03-04T12:46:22.257894+0000","last_became_peered":"2024-03-04T12:46:22.257894+0000","last_unstale":"2024-03-04T13:10:32.481590+0000","last_undegraded":"2024-03-04T13:10:32.481590+0000","last_fullsized":"2024-03-04T13:10:32.481590+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:54:40.739780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:32.511747+0000","last_change":"2024-03-04T12:32:46.054248+0000","last_active":"2024-03-04T13:11:32.511747+0000","last_peered":"2024-03-04T13:11:32.511747+0000","last_clean":"2024-03-04T13:11:32.511747+0000","last_became_active":"2024-03-04T12:32:46.053946+0000","last_became_peered":"2024-03-04T12:32:46.053946+0000","last_unstale":"2024-03-04T13:11:32.511747+0000","last_undegraded":"2024-03-04T13:11:32.511747+0000","last_fullsized":"2024-03-04T13:11:32.511747+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"255'11","reported_seq":68,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:42.499521+0000","last_change":"2024-03-04T12:32:42.037699+0000","last_active":"2024-03-04T13:12:42.499521+0000","last_peered":"2024-03-04T13:12:42.499521+0000","last_clean":"2024-03-04T13:12:42.499521+0000","last_became_active":"2024-03-04T12:32:42.037387+0000","last_became_peered":"2024-03-04T12:32:42.037387+0000","last_unstale":"2024-03-04T13:12:42.499521+0000","last_undegraded":"2024-03-04T13:12:42.499521+0000","last_fullsized":"2024-03-04T13:12:42.499521+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:05.876966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":15,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"255'50","reported_seq":163,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:32.550882+0000","last_change":"2024-03-04T12:29:01.704333+0000","last_active":"2024-03-04T13:11:32.550882+0000","last_peered":"2024-03-04T13:11:32.550882+0000","last_clean":"2024-03-04T13:11:32.550882+0000","last_became_active":"2024-03-04T12:29:01.703815+0000","last_became_peered":"2024-03-04T12:29:01.703815+0000","last_unstale":"2024-03-04T13:11:32.550882+0000","last_undegraded":"2024-03-04T13:11:32.550882+0000","last_fullsized":"2024-03-04T13:11:32.550882+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":130,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:37.357774+0000","last_change":"2024-03-04T12:46:22.260813+0000","last_active":"2024-03-04T13:10:37.357774+0000","last_peered":"2024-03-04T13:10:37.357774+0000","last_clean":"2024-03-04T13:10:37.357774+0000","last_became_active":"2024-03-04T12:46:22.260529+0000","last_became_peered":"2024-03-04T12:46:22.260529+0000","last_unstale":"2024-03-04T13:10:37.357774+0000","last_undegraded":"2024-03-04T13:10:37.357774+0000","last_fullsized":"2024-03-04T13:10:37.357774+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:25:58.359881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"255'5","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.201182+0000","last_change":"2024-03-04T12:32:46.052656+0000","last_active":"2024-03-04T13:13:21.201182+0000","last_peered":"2024-03-04T13:13:21.201182+0000","last_clean":"2024-03-04T13:13:21.201182+0000","last_became_active":"2024-03-04T12:32:46.052388+0000","last_became_peered":"2024-03-04T12:32:46.052388+0000","last_unstale":"2024-03-04T13:13:21.201182+0000","last_undegraded":"2024-03-04T13:13:21.201182+0000","last_fullsized":"2024-03-04T13:13:21.201182+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5160,"num_write":5,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"0'0","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:42.468710+0000","last_change":"2024-03-04T12:32:42.031111+0000","last_active":"2024-03-04T13:12:42.468710+0000","last_peered":"2024-03-04T13:12:42.468710+0000","last_clean":"2024-03-04T13:12:42.468710+0000","last_became_active":"2024-03-04T12:32:42.030804+0000","last_became_peered":"2024-03-04T12:32:42.030804+0000","last_unstale":"2024-03-04T13:12:42.468710+0000","last_undegraded":"2024-03-04T13:12:42.468710+0000","last_fullsized":"2024-03-04T13:12:42.468710+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"255'35","reported_seq":128,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.486308+0000","last_change":"2024-03-04T12:29:01.703915+0000","last_active":"2024-03-04T13:09:02.486308+0000","last_peered":"2024-03-04T13:09:02.486308+0000","last_clean":"2024-03-04T13:09:02.486308+0000","last_became_active":"2024-03-04T12:29:01.703369+0000","last_became_peered":"2024-03-04T12:29:01.703369+0000","last_unstale":"2024-03-04T13:09:02.486308+0000","last_undegraded":"2024-03-04T13:09:02.486308+0000","last_fullsized":"2024-03-04T13:09:02.486308+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:00:37.472429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":90,"num_write":62,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:22.459932+0000","last_change":"2024-03-04T12:46:22.256005+0000","last_active":"2024-03-04T13:11:22.459932+0000","last_peered":"2024-03-04T13:11:22.459932+0000","last_clean":"2024-03-04T13:11:22.459932+0000","last_became_active":"2024-03-04T12:46:22.255588+0000","last_became_peered":"2024-03-04T12:46:22.255588+0000","last_unstale":"2024-03-04T13:11:22.459932+0000","last_undegraded":"2024-03-04T13:11:22.459932+0000","last_fullsized":"2024-03-04T13:11:22.459932+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"255'6","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.042670+0000","last_change":"2024-03-04T12:32:46.057798+0000","last_active":"2024-03-04T13:13:21.042670+0000","last_peered":"2024-03-04T13:13:21.042670+0000","last_clean":"2024-03-04T13:13:21.042670+0000","last_became_active":"2024-03-04T12:32:46.057413+0000","last_became_peered":"2024-03-04T12:32:46.057413+0000","last_unstale":"2024-03-04T13:13:21.042670+0000","last_undegraded":"2024-03-04T13:13:21.042670+0000","last_fullsized":"2024-03-04T13:13:21.042670+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"255'9","reported_seq":58,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.219912+0000","last_change":"2024-03-04T12:32:42.031365+0000","last_active":"2024-03-04T13:13:21.219912+0000","last_peered":"2024-03-04T13:13:21.219912+0000","last_clean":"2024-03-04T13:13:21.219912+0000","last_became_active":"2024-03-04T12:32:42.031099+0000","last_became_peered":"2024-03-04T12:32:42.031099+0000","last_unstale":"2024-03-04T13:13:21.219912+0000","last_undegraded":"2024-03-04T13:13:21.219912+0000","last_fullsized":"2024-03-04T13:13:21.219912+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"255'41","reported_seq":140,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:37.468168+0000","last_change":"2024-03-04T12:29:01.701202+0000","last_active":"2024-03-04T13:12:37.468168+0000","last_peered":"2024-03-04T13:12:37.468168+0000","last_clean":"2024-03-04T13:12:37.468168+0000","last_became_active":"2024-03-04T12:29:01.700917+0000","last_became_peered":"2024-03-04T12:29:01.700917+0000","last_unstale":"2024-03-04T13:12:37.468168+0000","last_undegraded":"2024-03-04T13:12:37.468168+0000","last_fullsized":"2024-03-04T13:12:37.468168+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":100,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.468177+0000","last_change":"2024-03-04T12:46:22.256121+0000","last_active":"2024-03-04T13:08:52.468177+0000","last_peered":"2024-03-04T13:08:52.468177+0000","last_clean":"2024-03-04T13:08:52.468177+0000","last_became_active":"2024-03-04T12:46:22.255812+0000","last_became_peered":"2024-03-04T12:46:22.255812+0000","last_unstale":"2024-03-04T13:08:52.468177+0000","last_undegraded":"2024-03-04T13:08:52.468177+0000","last_fullsized":"2024-03-04T13:08:52.468177+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:10:20.330661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.525088+0000","last_change":"2024-03-04T12:32:46.053933+0000","last_active":"2024-03-04T13:12:47.525088+0000","last_peered":"2024-03-04T13:12:47.525088+0000","last_clean":"2024-03-04T13:12:47.525088+0000","last_became_active":"2024-03-04T12:32:46.053172+0000","last_became_peered":"2024-03-04T12:32:46.053172+0000","last_unstale":"2024-03-04T13:12:47.525088+0000","last_undegraded":"2024-03-04T13:12:47.525088+0000","last_fullsized":"2024-03-04T13:12:47.525088+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"255'5","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.235514+0000","last_change":"2024-03-04T12:32:42.037511+0000","last_active":"2024-03-04T13:13:21.235514+0000","last_peered":"2024-03-04T13:13:21.235514+0000","last_clean":"2024-03-04T13:13:21.235514+0000","last_became_active":"2024-03-04T12:32:42.033315+0000","last_became_peered":"2024-03-04T12:32:42.033315+0000","last_unstale":"2024-03-04T13:13:21.235514+0000","last_undegraded":"2024-03-04T13:13:21.235514+0000","last_fullsized":"2024-03-04T13:13:21.235514+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5136,"num_write":5,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"255'18","reported_seq":96,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.353304+0000","last_change":"2024-03-04T12:29:01.707001+0000","last_active":"2024-03-04T13:10:07.353304+0000","last_peered":"2024-03-04T13:10:07.353304+0000","last_clean":"2024-03-04T13:10:07.353304+0000","last_became_active":"2024-03-04T12:29:01.706695+0000","last_became_peered":"2024-03-04T12:29:01.706695+0000","last_unstale":"2024-03-04T13:10:07.353304+0000","last_undegraded":"2024-03-04T13:10:07.353304+0000","last_fullsized":"2024-03-04T13:10:07.353304+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:25:41.776852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":54,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"252'1","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:37.461823+0000","last_change":"2024-03-04T12:46:51.979336+0000","last_active":"2024-03-04T13:12:37.461823+0000","last_peered":"2024-03-04T13:12:37.461823+0000","last_clean":"2024-03-04T13:12:37.461823+0000","last_became_active":"2024-03-04T12:46:51.977076+0000","last_became_peered":"2024-03-04T12:46:51.977076+0000","last_unstale":"2024-03-04T13:12:37.461823+0000","last_undegraded":"2024-03-04T13:12:37.461823+0000","last_fullsized":"2024-03-04T13:12:37.461823+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:02.486407+0000","last_change":"2024-03-04T12:32:46.056068+0000","last_active":"2024-03-04T13:09:02.486407+0000","last_peered":"2024-03-04T13:09:02.486407+0000","last_clean":"2024-03-04T13:09:02.486407+0000","last_became_active":"2024-03-04T12:32:46.055692+0000","last_became_peered":"2024-03-04T12:32:46.055692+0000","last_unstale":"2024-03-04T13:09:02.486407+0000","last_undegraded":"2024-03-04T13:09:02.486407+0000","last_fullsized":"2024-03-04T13:09:02.486407+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:41:41.273761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"0'0","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.729090+0000","last_change":"2024-03-04T13:13:26.729125+0000","last_active":"2024-03-04T13:13:26.729090+0000","last_peered":"2024-03-04T13:13:26.729090+0000","last_clean":"2024-03-04T13:13:26.729090+0000","last_became_active":"2024-03-04T12:32:42.029940+0000","last_became_peered":"2024-03-04T12:32:42.029940+0000","last_unstale":"2024-03-04T13:13:26.729090+0000","last_undegraded":"2024-03-04T13:13:26.729090+0000","last_fullsized":"2024-03-04T13:13:26.729090+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:26.729003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:26.729003+0000","last_clean_scrub_stamp":"2024-03-04T13:13:26.729003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:20.396814+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"255'31","reported_seq":118,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.478216+0000","last_change":"2024-03-04T12:29:01.701660+0000","last_active":"2024-03-04T13:10:07.478216+0000","last_peered":"2024-03-04T13:10:07.478216+0000","last_clean":"2024-03-04T13:10:07.478216+0000","last_became_active":"2024-03-04T12:29:01.701379+0000","last_became_peered":"2024-03-04T12:29:01.701379+0000","last_unstale":"2024-03-04T13:10:07.478216+0000","last_undegraded":"2024-03-04T13:10:07.478216+0000","last_fullsized":"2024-03-04T13:10:07.478216+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:12:36.501891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":79,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.470218+0000","last_change":"2024-03-04T12:46:22.309007+0000","last_active":"2024-03-04T13:12:57.470218+0000","last_peered":"2024-03-04T13:12:57.470218+0000","last_clean":"2024-03-04T13:12:57.470218+0000","last_became_active":"2024-03-04T12:46:22.308714+0000","last_became_peered":"2024-03-04T12:46:22.308714+0000","last_unstale":"2024-03-04T13:12:57.470218+0000","last_undegraded":"2024-03-04T13:12:57.470218+0000","last_fullsized":"2024-03-04T13:12:57.470218+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"255'6","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:37.375099+0000","last_change":"2024-03-04T12:32:46.052223+0000","last_active":"2024-03-04T13:12:37.375099+0000","last_peered":"2024-03-04T13:12:37.375099+0000","last_clean":"2024-03-04T13:12:37.375099+0000","last_became_active":"2024-03-04T12:32:46.051926+0000","last_became_peered":"2024-03-04T12:32:46.051926+0000","last_unstale":"2024-03-04T13:12:37.375099+0000","last_undegraded":"2024-03-04T13:12:37.375099+0000","last_fullsized":"2024-03-04T13:12:37.375099+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:13:09.671991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"0'0","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.896393+0000","last_change":"2024-03-04T13:13:26.896414+0000","last_active":"2024-03-04T13:13:26.896393+0000","last_peered":"2024-03-04T13:13:26.896393+0000","last_clean":"2024-03-04T13:13:26.896393+0000","last_became_active":"2024-03-04T12:32:42.034301+0000","last_became_peered":"2024-03-04T12:32:42.034301+0000","last_unstale":"2024-03-04T13:13:26.896393+0000","last_undegraded":"2024-03-04T13:13:26.896393+0000","last_fullsized":"2024-03-04T13:13:26.896393+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:26.896317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:26.896317+0000","last_clean_scrub_stamp":"2024-03-04T13:13:26.896317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:03.628863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"255'132","reported_seq":426,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:32.557858+0000","last_change":"2024-03-04T12:29:01.703498+0000","last_active":"2024-03-04T13:12:32.557858+0000","last_peered":"2024-03-04T13:12:32.557858+0000","last_clean":"2024-03-04T13:12:32.557858+0000","last_became_active":"2024-03-04T12:29:01.703239+0000","last_became_peered":"2024-03-04T12:29:01.703239+0000","last_unstale":"2024-03-04T13:12:32.557858+0000","last_undegraded":"2024-03-04T13:12:32.557858+0000","last_fullsized":"2024-03-04T13:12:32.557858+0000","mapping_epoch":242,"log_start":"255'100","ondisk_log_start":"255'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":704,"num_read_kb":496,"num_write":192,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.526999+0000","last_change":"2024-03-04T12:46:22.259911+0000","last_active":"2024-03-04T13:12:57.526999+0000","last_peered":"2024-03-04T13:12:57.526999+0000","last_clean":"2024-03-04T13:12:57.526999+0000","last_became_active":"2024-03-04T12:46:22.259424+0000","last_became_peered":"2024-03-04T12:46:22.259424+0000","last_unstale":"2024-03-04T13:12:57.526999+0000","last_undegraded":"2024-03-04T13:12:57.526999+0000","last_fullsized":"2024-03-04T13:12:57.526999+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"250'5","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.453778+0000","last_change":"2024-03-04T12:32:46.057250+0000","last_active":"2024-03-04T13:11:27.453778+0000","last_peered":"2024-03-04T13:11:27.453778+0000","last_clean":"2024-03-04T13:11:27.453778+0000","last_became_active":"2024-03-04T12:32:46.056976+0000","last_became_peered":"2024-03-04T12:32:46.056976+0000","last_unstale":"2024-03-04T13:11:27.453778+0000","last_undegraded":"2024-03-04T13:11:27.453778+0000","last_fullsized":"2024-03-04T13:11:27.453778+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497894+0000","last_change":"2024-03-04T12:32:42.037353+0000","last_active":"2024-03-04T13:10:12.497894+0000","last_peered":"2024-03-04T13:10:12.497894+0000","last_clean":"2024-03-04T13:10:12.497894+0000","last_became_active":"2024-03-04T12:32:42.036694+0000","last_became_peered":"2024-03-04T12:32:42.036694+0000","last_unstale":"2024-03-04T13:10:12.497894+0000","last_undegraded":"2024-03-04T13:10:12.497894+0000","last_fullsized":"2024-03-04T13:10:12.497894+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:57:01.079244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"255'13","reported_seq":78,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:32.454767+0000","last_change":"2024-03-04T12:29:01.706751+0000","last_active":"2024-03-04T13:12:32.454767+0000","last_peered":"2024-03-04T13:12:32.454767+0000","last_clean":"2024-03-04T13:12:32.454767+0000","last_became_active":"2024-03-04T12:29:01.706467+0000","last_became_peered":"2024-03-04T12:29:01.706467+0000","last_unstale":"2024-03-04T13:12:32.454767+0000","last_undegraded":"2024-03-04T13:12:32.454767+0000","last_fullsized":"2024-03-04T13:12:32.454767+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.470245+0000","last_change":"2024-03-04T12:46:22.311206+0000","last_active":"2024-03-04T13:12:57.470245+0000","last_peered":"2024-03-04T13:12:57.470245+0000","last_clean":"2024-03-04T13:12:57.470245+0000","last_became_active":"2024-03-04T12:46:22.310952+0000","last_became_peered":"2024-03-04T12:46:22.310952+0000","last_unstale":"2024-03-04T13:12:57.470245+0000","last_undegraded":"2024-03-04T13:12:57.470245+0000","last_fullsized":"2024-03-04T13:12:57.470245+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"250'3","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.447918+0000","last_change":"2024-03-04T12:32:46.055077+0000","last_active":"2024-03-04T13:11:27.447918+0000","last_peered":"2024-03-04T13:11:27.447918+0000","last_clean":"2024-03-04T13:11:27.447918+0000","last_became_active":"2024-03-04T12:32:46.054752+0000","last_became_peered":"2024-03-04T12:32:46.054752+0000","last_unstale":"2024-03-04T13:11:27.447918+0000","last_undegraded":"2024-03-04T13:11:27.447918+0000","last_fullsized":"2024-03-04T13:11:27.447918+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"255'2","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.005771+0000","last_change":"2024-03-04T12:32:42.034215+0000","last_active":"2024-03-04T13:13:21.005771+0000","last_peered":"2024-03-04T13:13:21.005771+0000","last_clean":"2024-03-04T13:13:21.005771+0000","last_became_active":"2024-03-04T12:32:42.033898+0000","last_became_peered":"2024-03-04T12:32:42.033898+0000","last_unstale":"2024-03-04T13:13:21.005771+0000","last_undegraded":"2024-03-04T13:13:21.005771+0000","last_fullsized":"2024-03-04T13:13:21.005771+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"255'43","reported_seq":149,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.719980+0000","last_change":"2024-03-04T12:29:01.705464+0000","last_active":"2024-03-04T13:13:25.719980+0000","last_peered":"2024-03-04T13:13:25.719980+0000","last_clean":"2024-03-04T13:13:25.719980+0000","last_became_active":"2024-03-04T12:29:01.705183+0000","last_became_peered":"2024-03-04T12:29:01.705183+0000","last_unstale":"2024-03-04T13:13:25.719980+0000","last_undegraded":"2024-03-04T13:13:25.719980+0000","last_fullsized":"2024-03-04T13:13:25.719980+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":113,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:02.554403+0000","last_change":"2024-03-04T12:46:22.246381+0000","last_active":"2024-03-04T13:12:02.554403+0000","last_peered":"2024-03-04T13:12:02.554403+0000","last_clean":"2024-03-04T13:12:02.554403+0000","last_became_active":"2024-03-04T12:46:22.245967+0000","last_became_peered":"2024-03-04T12:46:22.245967+0000","last_unstale":"2024-03-04T13:12:02.554403+0000","last_undegraded":"2024-03-04T13:12:02.554403+0000","last_fullsized":"2024-03-04T13:12:02.554403+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.467055+0000","last_change":"2024-03-04T12:32:46.051614+0000","last_active":"2024-03-04T13:12:27.467055+0000","last_peered":"2024-03-04T13:12:27.467055+0000","last_clean":"2024-03-04T13:12:27.467055+0000","last_became_active":"2024-03-04T12:32:46.051360+0000","last_became_peered":"2024-03-04T12:32:46.051360+0000","last_unstale":"2024-03-04T13:12:27.467055+0000","last_undegraded":"2024-03-04T13:12:27.467055+0000","last_fullsized":"2024-03-04T13:12:27.467055+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.459894+0000","last_change":"2024-03-04T12:32:42.029927+0000","last_active":"2024-03-04T13:12:22.459894+0000","last_peered":"2024-03-04T13:12:22.459894+0000","last_clean":"2024-03-04T13:12:22.459894+0000","last_became_active":"2024-03-04T12:32:42.029559+0000","last_became_peered":"2024-03-04T12:32:42.029559+0000","last_unstale":"2024-03-04T13:12:22.459894+0000","last_undegraded":"2024-03-04T13:12:22.459894+0000","last_fullsized":"2024-03-04T13:12:22.459894+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"250'28","reported_seq":125,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.108278+0000","last_change":"2024-03-04T13:13:27.108303+0000","last_active":"2024-03-04T13:13:27.108278+0000","last_peered":"2024-03-04T13:13:27.108278+0000","last_clean":"2024-03-04T13:13:27.108278+0000","last_became_active":"2024-03-04T12:29:01.705726+0000","last_became_peered":"2024-03-04T12:29:01.705726+0000","last_unstale":"2024-03-04T13:13:27.108278+0000","last_undegraded":"2024-03-04T13:13:27.108278+0000","last_fullsized":"2024-03-04T13:13:27.108278+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'28","last_scrub_stamp":"2024-03-04T13:13:27.108190+0000","last_deep_scrub":"250'28","last_deep_scrub_stamp":"2024-03-04T13:13:27.108190+0000","last_clean_scrub_stamp":"2024-03-04T13:13:27.108190+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:54:20.406412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":49,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:02.554435+0000","last_change":"2024-03-04T12:46:22.259972+0000","last_active":"2024-03-04T13:12:02.554435+0000","last_peered":"2024-03-04T13:12:02.554435+0000","last_clean":"2024-03-04T13:12:02.554435+0000","last_became_active":"2024-03-04T12:46:22.259134+0000","last_became_peered":"2024-03-04T12:46:22.259134+0000","last_unstale":"2024-03-04T13:12:02.554435+0000","last_undegraded":"2024-03-04T13:12:02.554435+0000","last_fullsized":"2024-03-04T13:12:02.554435+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":40,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.521325+0000","last_change":"2024-03-04T12:32:46.053557+0000","last_active":"2024-03-04T13:12:27.521325+0000","last_peered":"2024-03-04T13:12:27.521325+0000","last_clean":"2024-03-04T13:12:27.521325+0000","last_became_active":"2024-03-04T12:32:46.053156+0000","last_became_peered":"2024-03-04T12:32:46.053156+0000","last_unstale":"2024-03-04T13:12:27.521325+0000","last_undegraded":"2024-03-04T13:12:27.521325+0000","last_fullsized":"2024-03-04T13:12:27.521325+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"255'10","reported_seq":69,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520454+0000","last_change":"2024-03-04T12:32:42.036924+0000","last_active":"2024-03-04T13:12:22.520454+0000","last_peered":"2024-03-04T13:12:22.520454+0000","last_clean":"2024-03-04T13:12:22.520454+0000","last_became_active":"2024-03-04T12:32:42.036617+0000","last_became_peered":"2024-03-04T12:32:42.036617+0000","last_unstale":"2024-03-04T13:12:22.520454+0000","last_undegraded":"2024-03-04T13:12:22.520454+0000","last_fullsized":"2024-03-04T13:12:22.520454+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:10:49.987113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":29698,"num_write":14,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"255'17","reported_seq":94,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.361248+0000","last_change":"2024-03-04T12:29:01.701993+0000","last_active":"2024-03-04T13:11:02.361248+0000","last_peered":"2024-03-04T13:11:02.361248+0000","last_clean":"2024-03-04T13:11:02.361248+0000","last_became_active":"2024-03-04T12:29:01.701712+0000","last_became_peered":"2024-03-04T12:29:01.701712+0000","last_unstale":"2024-03-04T13:11:02.361248+0000","last_undegraded":"2024-03-04T13:11:02.361248+0000","last_fullsized":"2024-03-04T13:11:02.361248+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:57:53.885309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":51,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.474805+0000","last_change":"2024-03-04T12:46:22.257008+0000","last_active":"2024-03-04T13:09:42.474805+0000","last_peered":"2024-03-04T13:09:42.474805+0000","last_clean":"2024-03-04T13:09:42.474805+0000","last_became_active":"2024-03-04T12:46:22.256617+0000","last_became_peered":"2024-03-04T12:46:22.256617+0000","last_unstale":"2024-03-04T13:09:42.474805+0000","last_undegraded":"2024-03-04T13:09:42.474805+0000","last_fullsized":"2024-03-04T13:09:42.474805+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:25.255969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.353352+0000","last_change":"2024-03-04T12:32:46.053973+0000","last_active":"2024-03-04T13:10:07.353352+0000","last_peered":"2024-03-04T13:10:07.353352+0000","last_clean":"2024-03-04T13:10:07.353352+0000","last_became_active":"2024-03-04T12:32:46.053272+0000","last_became_peered":"2024-03-04T12:32:46.053272+0000","last_unstale":"2024-03-04T13:10:07.353352+0000","last_undegraded":"2024-03-04T13:10:07.353352+0000","last_fullsized":"2024-03-04T13:10:07.353352+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:51:06.764174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.466454+0000","last_change":"2024-03-04T12:32:42.036193+0000","last_active":"2024-03-04T13:12:22.466454+0000","last_peered":"2024-03-04T13:12:22.466454+0000","last_clean":"2024-03-04T13:12:22.466454+0000","last_became_active":"2024-03-04T12:32:42.035923+0000","last_became_peered":"2024-03-04T12:32:42.035923+0000","last_unstale":"2024-03-04T13:12:22.466454+0000","last_undegraded":"2024-03-04T13:12:22.466454+0000","last_fullsized":"2024-03-04T13:12:22.466454+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"255'34","reported_seq":132,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:22.531305+0000","last_change":"2024-03-04T12:29:01.703208+0000","last_active":"2024-03-04T13:13:22.531305+0000","last_peered":"2024-03-04T13:13:22.531305+0000","last_clean":"2024-03-04T13:13:22.531305+0000","last_became_active":"2024-03-04T12:29:01.702327+0000","last_became_peered":"2024-03-04T12:29:01.702327+0000","last_unstale":"2024-03-04T13:13:22.531305+0000","last_undegraded":"2024-03-04T13:13:22.531305+0000","last_fullsized":"2024-03-04T13:13:22.531305+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"252'1","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:02.464260+0000","last_change":"2024-03-04T12:46:22.258104+0000","last_active":"2024-03-04T13:12:02.464260+0000","last_peered":"2024-03-04T13:12:02.464260+0000","last_clean":"2024-03-04T13:12:02.464260+0000","last_became_active":"2024-03-04T12:46:22.257651+0000","last_became_peered":"2024-03-04T12:46:22.257651+0000","last_unstale":"2024-03-04T13:12:02.464260+0000","last_undegraded":"2024-03-04T13:12:02.464260+0000","last_fullsized":"2024-03-04T13:12:02.464260+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"250'7","reported_seq":58,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.478111+0000","last_change":"2024-03-04T12:32:46.049805+0000","last_active":"2024-03-04T13:10:07.478111+0000","last_peered":"2024-03-04T13:10:07.478111+0000","last_clean":"2024-03-04T13:10:07.478111+0000","last_became_active":"2024-03-04T12:32:46.049512+0000","last_became_peered":"2024-03-04T12:32:46.049512+0000","last_unstale":"2024-03-04T13:10:07.478111+0000","last_undegraded":"2024-03-04T13:10:07.478111+0000","last_fullsized":"2024-03-04T13:10:07.478111+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:41:47.962697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":11,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520355+0000","last_change":"2024-03-04T12:32:42.032301+0000","last_active":"2024-03-04T13:12:22.520355+0000","last_peered":"2024-03-04T13:12:22.520355+0000","last_clean":"2024-03-04T13:12:22.520355+0000","last_became_active":"2024-03-04T12:32:42.032034+0000","last_became_peered":"2024-03-04T12:32:42.032034+0000","last_unstale":"2024-03-04T13:12:22.520355+0000","last_undegraded":"2024-03-04T13:12:22.520355+0000","last_fullsized":"2024-03-04T13:12:22.520355+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"255'51","reported_seq":171,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:22.473069+0000","last_change":"2024-03-04T12:29:01.703695+0000","last_active":"2024-03-04T13:13:22.473069+0000","last_peered":"2024-03-04T13:13:22.473069+0000","last_clean":"2024-03-04T13:13:22.473069+0000","last_became_active":"2024-03-04T12:29:01.703361+0000","last_became_peered":"2024-03-04T12:29:01.703361+0000","last_unstale":"2024-03-04T13:13:22.473069+0000","last_undegraded":"2024-03-04T13:13:22.473069+0000","last_fullsized":"2024-03-04T13:13:22.473069+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":146,"num_write":83,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"253'1","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:22.473142+0000","last_change":"2024-03-04T12:46:22.255919+0000","last_active":"2024-03-04T13:13:22.473142+0000","last_peered":"2024-03-04T13:13:22.473142+0000","last_clean":"2024-03-04T13:13:22.473142+0000","last_became_active":"2024-03-04T12:46:22.255498+0000","last_became_peered":"2024-03-04T12:46:22.255498+0000","last_unstale":"2024-03-04T13:13:22.473142+0000","last_undegraded":"2024-03-04T13:13:22.473142+0000","last_fullsized":"2024-03-04T13:13:22.473142+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"255'2","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.136919+0000","last_change":"2024-03-04T12:32:46.059035+0000","last_active":"2024-03-04T13:13:21.136919+0000","last_peered":"2024-03-04T13:13:21.136919+0000","last_clean":"2024-03-04T13:13:21.136919+0000","last_became_active":"2024-03-04T12:32:46.058792+0000","last_became_peered":"2024-03-04T12:32:46.058792+0000","last_unstale":"2024-03-04T13:13:21.136919+0000","last_undegraded":"2024-03-04T13:13:21.136919+0000","last_fullsized":"2024-03-04T13:13:21.136919+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:57.360698+0000","last_change":"2024-03-04T12:32:42.036922+0000","last_active":"2024-03-04T13:10:57.360698+0000","last_peered":"2024-03-04T13:10:57.360698+0000","last_clean":"2024-03-04T13:10:57.360698+0000","last_became_active":"2024-03-04T12:32:42.036427+0000","last_became_peered":"2024-03-04T12:32:42.036427+0000","last_unstale":"2024-03-04T13:10:57.360698+0000","last_undegraded":"2024-03-04T13:10:57.360698+0000","last_fullsized":"2024-03-04T13:10:57.360698+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:03:27.512996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"255'56","reported_seq":177,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.349999+0000","last_change":"2024-03-04T12:29:01.706989+0000","last_active":"2024-03-04T13:09:42.349999+0000","last_peered":"2024-03-04T13:09:42.349999+0000","last_clean":"2024-03-04T13:09:42.349999+0000","last_became_active":"2024-03-04T12:29:01.706666+0000","last_became_peered":"2024-03-04T12:29:01.706666+0000","last_unstale":"2024-03-04T13:09:42.349999+0000","last_undegraded":"2024-03-04T13:09:42.349999+0000","last_fullsized":"2024-03-04T13:09:42.349999+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:53:35.119335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":151,"num_write":99,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:22.473163+0000","last_change":"2024-03-04T12:46:22.257205+0000","last_active":"2024-03-04T13:13:22.473163+0000","last_peered":"2024-03-04T13:13:22.473163+0000","last_clean":"2024-03-04T13:13:22.473163+0000","last_became_active":"2024-03-04T12:46:22.256882+0000","last_became_peered":"2024-03-04T12:46:22.256882+0000","last_unstale":"2024-03-04T13:13:22.473163+0000","last_undegraded":"2024-03-04T13:13:22.473163+0000","last_fullsized":"2024-03-04T13:13:22.473163+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":40,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:02.506364+0000","last_change":"2024-03-04T12:32:46.057344+0000","last_active":"2024-03-04T13:11:02.506364+0000","last_peered":"2024-03-04T13:11:02.506364+0000","last_clean":"2024-03-04T13:11:02.506364+0000","last_became_active":"2024-03-04T12:32:46.057079+0000","last_became_peered":"2024-03-04T12:32:46.057079+0000","last_unstale":"2024-03-04T13:11:02.506364+0000","last_undegraded":"2024-03-04T13:11:02.506364+0000","last_fullsized":"2024-03-04T13:11:02.506364+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:12:31.155909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"255'8","reported_seq":67,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.996998+0000","last_change":"2024-03-04T12:32:42.035815+0000","last_active":"2024-03-04T13:13:20.996998+0000","last_peered":"2024-03-04T13:13:20.996998+0000","last_clean":"2024-03-04T13:13:20.996998+0000","last_became_active":"2024-03-04T12:32:42.035488+0000","last_became_peered":"2024-03-04T12:32:42.035488+0000","last_unstale":"2024-03-04T13:13:20.996998+0000","last_undegraded":"2024-03-04T13:13:20.996998+0000","last_fullsized":"2024-03-04T13:13:20.996998+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"255'14","reported_seq":79,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.473534+0000","last_change":"2024-03-04T12:29:01.707068+0000","last_active":"2024-03-04T13:09:32.473534+0000","last_peered":"2024-03-04T13:09:32.473534+0000","last_clean":"2024-03-04T13:09:32.473534+0000","last_became_active":"2024-03-04T12:29:01.706786+0000","last_became_peered":"2024-03-04T12:29:01.706786+0000","last_unstale":"2024-03-04T13:09:32.473534+0000","last_undegraded":"2024-03-04T13:09:32.473534+0000","last_fullsized":"2024-03-04T13:09:32.473534+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:37.249442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:22.473176+0000","last_change":"2024-03-04T12:46:22.259694+0000","last_active":"2024-03-04T13:13:22.473176+0000","last_peered":"2024-03-04T13:13:22.473176+0000","last_clean":"2024-03-04T13:13:22.473176+0000","last_became_active":"2024-03-04T12:46:22.259400+0000","last_became_peered":"2024-03-04T12:46:22.259400+0000","last_unstale":"2024-03-04T13:13:22.473176+0000","last_undegraded":"2024-03-04T13:13:22.473176+0000","last_fullsized":"2024-03-04T13:13:22.473176+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":41,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:22.563351+0000","last_change":"2024-03-04T12:32:46.051598+0000","last_active":"2024-03-04T13:13:22.563351+0000","last_peered":"2024-03-04T13:13:22.563351+0000","last_clean":"2024-03-04T13:13:22.563351+0000","last_became_active":"2024-03-04T12:32:46.051318+0000","last_became_peered":"2024-03-04T12:32:46.051318+0000","last_unstale":"2024-03-04T13:13:22.563351+0000","last_undegraded":"2024-03-04T13:13:22.563351+0000","last_fullsized":"2024-03-04T13:13:22.563351+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"255'10","reported_seq":64,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.162341+0000","last_change":"2024-03-04T12:32:42.036135+0000","last_active":"2024-03-04T13:13:21.162341+0000","last_peered":"2024-03-04T13:13:21.162341+0000","last_clean":"2024-03-04T13:13:21.162341+0000","last_became_active":"2024-03-04T12:32:42.035743+0000","last_became_peered":"2024-03-04T12:32:42.035743+0000","last_unstale":"2024-03-04T13:13:21.162341+0000","last_undegraded":"2024-03-04T13:13:21.162341+0000","last_fullsized":"2024-03-04T13:13:21.162341+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9243,"num_write":20,"num_write_kb":10267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"255'55","reported_seq":188,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:47.514313+0000","last_change":"2024-03-04T12:29:01.702750+0000","last_active":"2024-03-04T13:11:47.514313+0000","last_peered":"2024-03-04T13:11:47.514313+0000","last_clean":"2024-03-04T13:11:47.514313+0000","last_became_active":"2024-03-04T12:29:01.700933+0000","last_became_peered":"2024-03-04T12:29:01.700933+0000","last_unstale":"2024-03-04T13:11:47.514313+0000","last_undegraded":"2024-03-04T13:11:47.514313+0000","last_fullsized":"2024-03-04T13:11:47.514313+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":175,"num_write":86,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.720228+0000","last_change":"2024-03-04T12:46:22.310324+0000","last_active":"2024-03-04T13:13:25.720228+0000","last_peered":"2024-03-04T13:13:25.720228+0000","last_clean":"2024-03-04T13:13:25.720228+0000","last_became_active":"2024-03-04T12:46:22.310043+0000","last_became_peered":"2024-03-04T12:46:22.310043+0000","last_unstale":"2024-03-04T13:13:25.720228+0000","last_undegraded":"2024-03-04T13:13:25.720228+0000","last_fullsized":"2024-03-04T13:13:25.720228+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"250'3","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:17.466220+0000","last_change":"2024-03-04T12:32:46.056965+0000","last_active":"2024-03-04T13:13:17.466220+0000","last_peered":"2024-03-04T13:13:17.466220+0000","last_clean":"2024-03-04T13:13:17.466220+0000","last_became_active":"2024-03-04T12:32:46.056687+0000","last_became_peered":"2024-03-04T12:32:46.056687+0000","last_unstale":"2024-03-04T13:13:17.466220+0000","last_undegraded":"2024-03-04T13:13:17.466220+0000","last_fullsized":"2024-03-04T13:13:17.466220+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:57.484624+0000","last_change":"2024-03-04T12:32:42.036985+0000","last_active":"2024-03-04T13:10:57.484624+0000","last_peered":"2024-03-04T13:10:57.484624+0000","last_clean":"2024-03-04T13:10:57.484624+0000","last_became_active":"2024-03-04T12:32:42.036690+0000","last_became_peered":"2024-03-04T12:32:42.036690+0000","last_unstale":"2024-03-04T13:10:57.484624+0000","last_undegraded":"2024-03-04T13:10:57.484624+0000","last_fullsized":"2024-03-04T13:10:57.484624+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:33:40.882885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"0'0","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.348453+0000","last_change":"2024-03-04T12:29:01.701088+0000","last_active":"2024-03-04T13:09:32.348453+0000","last_peered":"2024-03-04T13:09:32.348453+0000","last_clean":"2024-03-04T13:09:32.348453+0000","last_became_active":"2024-03-04T12:29:01.700739+0000","last_became_peered":"2024-03-04T12:29:01.700739+0000","last_unstale":"2024-03-04T13:09:32.348453+0000","last_undegraded":"2024-03-04T13:09:32.348453+0000","last_fullsized":"2024-03-04T13:09:32.348453+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:24:34.666643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497750+0000","last_change":"2024-03-04T12:46:22.308562+0000","last_active":"2024-03-04T13:10:12.497750+0000","last_peered":"2024-03-04T13:10:12.497750+0000","last_clean":"2024-03-04T13:10:12.497750+0000","last_became_active":"2024-03-04T12:46:22.308300+0000","last_became_peered":"2024-03-04T12:46:22.308300+0000","last_unstale":"2024-03-04T13:10:12.497750+0000","last_undegraded":"2024-03-04T13:10:12.497750+0000","last_fullsized":"2024-03-04T13:10:12.497750+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:44:03.273585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":41,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:47.552753+0000","last_change":"2024-03-04T12:32:46.051902+0000","last_active":"2024-03-04T13:11:47.552753+0000","last_peered":"2024-03-04T13:11:47.552753+0000","last_clean":"2024-03-04T13:11:47.552753+0000","last_became_active":"2024-03-04T12:32:46.051614+0000","last_became_peered":"2024-03-04T12:32:46.051614+0000","last_unstale":"2024-03-04T13:11:47.552753+0000","last_undegraded":"2024-03-04T13:11:47.552753+0000","last_fullsized":"2024-03-04T13:11:47.552753+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:42.492975+0000","last_change":"2024-03-04T12:32:42.033609+0000","last_active":"2024-03-04T13:09:42.492975+0000","last_peered":"2024-03-04T13:09:42.492975+0000","last_clean":"2024-03-04T13:09:42.492975+0000","last_became_active":"2024-03-04T12:32:42.033182+0000","last_became_peered":"2024-03-04T12:32:42.033182+0000","last_unstale":"2024-03-04T13:09:42.492975+0000","last_undegraded":"2024-03-04T13:09:42.492975+0000","last_fullsized":"2024-03-04T13:09:42.492975+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:21.548201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"250'41","reported_seq":169,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.746749+0000","last_change":"2024-03-04T13:13:26.746795+0000","last_active":"2024-03-04T13:13:26.746749+0000","last_peered":"2024-03-04T13:13:26.746749+0000","last_clean":"2024-03-04T13:13:26.746749+0000","last_became_active":"2024-03-04T12:29:01.708876+0000","last_became_peered":"2024-03-04T12:29:01.708876+0000","last_unstale":"2024-03-04T13:13:26.746749+0000","last_undegraded":"2024-03-04T13:13:26.746749+0000","last_fullsized":"2024-03-04T13:13:26.746749+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'41","last_scrub_stamp":"2024-03-04T13:13:26.746633+0000","last_deep_scrub":"250'41","last_deep_scrub_stamp":"2024-03-04T13:13:26.746633+0000","last_clean_scrub_stamp":"2024-03-04T13:13:26.746633+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:14:28.512234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":148,"num_write":55,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520332+0000","last_change":"2024-03-04T12:46:22.256922+0000","last_active":"2024-03-04T13:12:22.520332+0000","last_peered":"2024-03-04T13:12:22.520332+0000","last_clean":"2024-03-04T13:12:22.520332+0000","last_became_active":"2024-03-04T12:46:22.256617+0000","last_became_peered":"2024-03-04T12:46:22.256617+0000","last_unstale":"2024-03-04T13:12:22.520332+0000","last_undegraded":"2024-03-04T13:12:22.520332+0000","last_fullsized":"2024-03-04T13:12:22.520332+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"250'2","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:47.455738+0000","last_change":"2024-03-04T12:32:46.055551+0000","last_active":"2024-03-04T13:11:47.455738+0000","last_peered":"2024-03-04T13:11:47.455738+0000","last_clean":"2024-03-04T13:11:47.455738+0000","last_became_active":"2024-03-04T12:32:46.055321+0000","last_became_peered":"2024-03-04T12:32:46.055321+0000","last_unstale":"2024-03-04T13:11:47.455738+0000","last_undegraded":"2024-03-04T13:11:47.455738+0000","last_fullsized":"2024-03-04T13:11:47.455738+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"250'5","reported_seq":58,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.465611+0000","last_change":"2024-03-04T12:32:42.030944+0000","last_active":"2024-03-04T13:13:12.465611+0000","last_peered":"2024-03-04T13:13:12.465611+0000","last_clean":"2024-03-04T13:13:12.465611+0000","last_became_active":"2024-03-04T12:32:42.030512+0000","last_became_peered":"2024-03-04T12:32:42.030512+0000","last_unstale":"2024-03-04T13:13:12.465611+0000","last_undegraded":"2024-03-04T13:13:12.465611+0000","last_fullsized":"2024-03-04T13:13:12.465611+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"255'57","reported_seq":189,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.454199+0000","last_change":"2024-03-04T12:29:01.699812+0000","last_active":"2024-03-04T13:12:27.454199+0000","last_peered":"2024-03-04T13:12:27.454199+0000","last_clean":"2024-03-04T13:12:27.454199+0000","last_became_active":"2024-03-04T12:29:01.699507+0000","last_became_peered":"2024-03-04T12:29:01.699507+0000","last_unstale":"2024-03-04T13:12:27.454199+0000","last_undegraded":"2024-03-04T13:12:27.454199+0000","last_fullsized":"2024-03-04T13:12:27.454199+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":165,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498707+0000","last_change":"2024-03-04T12:46:22.256492+0000","last_active":"2024-03-04T13:10:17.498707+0000","last_peered":"2024-03-04T13:10:17.498707+0000","last_clean":"2024-03-04T13:10:17.498707+0000","last_became_active":"2024-03-04T12:46:22.256181+0000","last_became_peered":"2024-03-04T12:46:22.256181+0000","last_unstale":"2024-03-04T13:10:17.498707+0000","last_undegraded":"2024-03-04T13:10:17.498707+0000","last_fullsized":"2024-03-04T13:10:17.498707+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:08:40.855920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"255'8","reported_seq":57,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.116930+0000","last_change":"2024-03-04T12:32:46.045905+0000","last_active":"2024-03-04T13:13:21.116930+0000","last_peered":"2024-03-04T13:13:21.116930+0000","last_clean":"2024-03-04T13:13:21.116930+0000","last_became_active":"2024-03-04T12:32:46.045552+0000","last_became_peered":"2024-03-04T12:32:46.045552+0000","last_unstale":"2024-03-04T13:13:21.116930+0000","last_undegraded":"2024-03-04T13:13:21.116930+0000","last_fullsized":"2024-03-04T13:13:21.116930+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:32.473463+0000","last_change":"2024-03-04T12:32:42.036672+0000","last_active":"2024-03-04T13:09:32.473463+0000","last_peered":"2024-03-04T13:09:32.473463+0000","last_clean":"2024-03-04T13:09:32.473463+0000","last_became_active":"2024-03-04T12:32:42.035436+0000","last_became_peered":"2024-03-04T12:32:42.035436+0000","last_unstale":"2024-03-04T13:09:32.473463+0000","last_undegraded":"2024-03-04T13:09:32.473463+0000","last_fullsized":"2024-03-04T13:09:32.473463+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:22:12.296339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"255'54","reported_seq":180,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.453722+0000","last_change":"2024-03-04T12:29:01.705876+0000","last_active":"2024-03-04T13:12:22.453722+0000","last_peered":"2024-03-04T13:12:22.453722+0000","last_clean":"2024-03-04T13:12:22.453722+0000","last_became_active":"2024-03-04T12:29:01.704434+0000","last_became_peered":"2024-03-04T12:29:01.704434+0000","last_unstale":"2024-03-04T13:12:22.453722+0000","last_undegraded":"2024-03-04T13:12:22.453722+0000","last_fullsized":"2024-03-04T13:12:22.453722+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":154,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:22.563281+0000","last_change":"2024-03-04T12:46:22.257771+0000","last_active":"2024-03-04T13:13:22.563281+0000","last_peered":"2024-03-04T13:13:22.563281+0000","last_clean":"2024-03-04T13:13:22.563281+0000","last_became_active":"2024-03-04T12:46:22.257495+0000","last_became_peered":"2024-03-04T12:46:22.257495+0000","last_unstale":"2024-03-04T13:13:22.563281+0000","last_undegraded":"2024-03-04T13:13:22.563281+0000","last_fullsized":"2024-03-04T13:13:22.563281+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"255'3","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.109538+0000","last_change":"2024-03-04T12:32:46.057285+0000","last_active":"2024-03-04T13:13:21.109538+0000","last_peered":"2024-03-04T13:13:21.109538+0000","last_clean":"2024-03-04T13:13:21.109538+0000","last_became_active":"2024-03-04T12:32:46.056737+0000","last_became_peered":"2024-03-04T12:32:46.056737+0000","last_unstale":"2024-03-04T13:13:21.109538+0000","last_undegraded":"2024-03-04T13:13:21.109538+0000","last_fullsized":"2024-03-04T13:13:21.109538+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:42.462077+0000","last_change":"2024-03-04T12:32:42.029327+0000","last_active":"2024-03-04T13:11:42.462077+0000","last_peered":"2024-03-04T13:11:42.462077+0000","last_clean":"2024-03-04T13:11:42.462077+0000","last_became_active":"2024-03-04T12:32:42.029043+0000","last_became_peered":"2024-03-04T12:32:42.029043+0000","last_unstale":"2024-03-04T13:11:42.462077+0000","last_undegraded":"2024-03-04T13:11:42.462077+0000","last_fullsized":"2024-03-04T13:11:42.462077+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"255'45","reported_seq":156,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.478783+0000","last_change":"2024-03-04T12:29:01.702439+0000","last_active":"2024-03-04T13:10:12.478783+0000","last_peered":"2024-03-04T13:10:12.478783+0000","last_clean":"2024-03-04T13:10:12.478783+0000","last_became_active":"2024-03-04T12:29:01.702146+0000","last_became_peered":"2024-03-04T12:29:01.702146+0000","last_unstale":"2024-03-04T13:10:12.478783+0000","last_undegraded":"2024-03-04T13:10:12.478783+0000","last_fullsized":"2024-03-04T13:10:12.478783+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:16:58.177901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":123,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260776+0000","last_change":"2024-03-04T12:46:22.311207+0000","last_active":"2024-03-04T13:13:25.260776+0000","last_peered":"2024-03-04T13:13:25.260776+0000","last_clean":"2024-03-04T13:13:25.260776+0000","last_became_active":"2024-03-04T12:46:22.310830+0000","last_became_peered":"2024-03-04T12:46:22.310830+0000","last_unstale":"2024-03-04T13:13:25.260776+0000","last_undegraded":"2024-03-04T13:13:25.260776+0000","last_fullsized":"2024-03-04T13:13:25.260776+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"255'2","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.040698+0000","last_change":"2024-03-04T12:32:46.058735+0000","last_active":"2024-03-04T13:13:21.040698+0000","last_peered":"2024-03-04T13:13:21.040698+0000","last_clean":"2024-03-04T13:13:21.040698+0000","last_became_active":"2024-03-04T12:32:46.058306+0000","last_became_peered":"2024-03-04T12:32:46.058306+0000","last_unstale":"2024-03-04T13:13:21.040698+0000","last_undegraded":"2024-03-04T13:13:21.040698+0000","last_fullsized":"2024-03-04T13:13:21.040698+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"255'5","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.995332+0000","last_change":"2024-03-04T12:32:42.035623+0000","last_active":"2024-03-04T13:13:20.995332+0000","last_peered":"2024-03-04T13:13:20.995332+0000","last_clean":"2024-03-04T13:13:20.995332+0000","last_became_active":"2024-03-04T12:32:42.035302+0000","last_became_peered":"2024-03-04T12:32:42.035302+0000","last_unstale":"2024-03-04T13:13:20.995332+0000","last_undegraded":"2024-03-04T13:13:20.995332+0000","last_fullsized":"2024-03-04T13:13:20.995332+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:30:11.132509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6192,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"255'41","reported_seq":155,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.453788+0000","last_change":"2024-03-04T12:29:01.707171+0000","last_active":"2024-03-04T13:12:22.453788+0000","last_peered":"2024-03-04T13:12:22.453788+0000","last_clean":"2024-03-04T13:12:22.453788+0000","last_became_active":"2024-03-04T12:29:01.706897+0000","last_became_peered":"2024-03-04T12:29:01.706897+0000","last_unstale":"2024-03-04T13:12:22.453788+0000","last_undegraded":"2024-03-04T13:12:22.453788+0000","last_fullsized":"2024-03-04T13:12:22.453788+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":127,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.453719+0000","last_change":"2024-03-04T12:46:22.253306+0000","last_active":"2024-03-04T13:11:27.453719+0000","last_peered":"2024-03-04T13:11:27.453719+0000","last_clean":"2024-03-04T13:11:27.453719+0000","last_became_active":"2024-03-04T12:46:22.252955+0000","last_became_peered":"2024-03-04T12:46:22.252955+0000","last_unstale":"2024-03-04T13:11:27.453719+0000","last_undegraded":"2024-03-04T13:11:27.453719+0000","last_fullsized":"2024-03-04T13:11:27.453719+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"255'11","reported_seq":63,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.183394+0000","last_change":"2024-03-04T12:32:46.056590+0000","last_active":"2024-03-04T13:13:21.183394+0000","last_peered":"2024-03-04T13:13:21.183394+0000","last_clean":"2024-03-04T13:13:21.183394+0000","last_became_active":"2024-03-04T12:32:46.056219+0000","last_became_peered":"2024-03-04T12:32:46.056219+0000","last_unstale":"2024-03-04T13:13:21.183394+0000","last_undegraded":"2024-03-04T13:13:21.183394+0000","last_fullsized":"2024-03-04T13:13:21.183394+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:34:43.098655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25600,"num_write":16,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"255'8","reported_seq":61,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.206397+0000","last_change":"2024-03-04T12:32:42.034819+0000","last_active":"2024-03-04T13:13:21.206397+0000","last_peered":"2024-03-04T13:13:21.206397+0000","last_clean":"2024-03-04T13:13:21.206397+0000","last_became_active":"2024-03-04T12:32:42.034556+0000","last_became_peered":"2024-03-04T12:32:42.034556+0000","last_unstale":"2024-03-04T13:13:21.206397+0000","last_undegraded":"2024-03-04T13:13:21.206397+0000","last_fullsized":"2024-03-04T13:13:21.206397+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12328,"num_write":8,"num_write_kb":12328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"255'42","reported_seq":147,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497950+0000","last_change":"2024-03-04T12:29:01.706878+0000","last_active":"2024-03-04T13:10:12.497950+0000","last_peered":"2024-03-04T13:10:12.497950+0000","last_clean":"2024-03-04T13:10:12.497950+0000","last_became_active":"2024-03-04T12:29:01.706549+0000","last_became_peered":"2024-03-04T12:29:01.706549+0000","last_unstale":"2024-03-04T13:10:12.497950+0000","last_undegraded":"2024-03-04T13:10:12.497950+0000","last_fullsized":"2024-03-04T13:10:12.497950+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:52:21.965189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":111,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"252'1","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520532+0000","last_change":"2024-03-04T12:46:22.254600+0000","last_active":"2024-03-04T13:12:22.520532+0000","last_peered":"2024-03-04T13:12:22.520532+0000","last_clean":"2024-03-04T13:12:22.520532+0000","last_became_active":"2024-03-04T12:46:22.254303+0000","last_became_peered":"2024-03-04T12:46:22.254303+0000","last_unstale":"2024-03-04T13:12:22.520532+0000","last_undegraded":"2024-03-04T13:12:22.520532+0000","last_fullsized":"2024-03-04T13:12:22.520532+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"255'3","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:47.514375+0000","last_change":"2024-03-04T12:32:46.055817+0000","last_active":"2024-03-04T13:11:47.514375+0000","last_peered":"2024-03-04T13:11:47.514375+0000","last_clean":"2024-03-04T13:11:47.514375+0000","last_became_active":"2024-03-04T12:32:46.055497+0000","last_became_peered":"2024-03-04T12:32:46.055497+0000","last_unstale":"2024-03-04T13:11:47.514375+0000","last_undegraded":"2024-03-04T13:11:47.514375+0000","last_fullsized":"2024-03-04T13:11:47.514375+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:51:26.771686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:17.555997+0000","last_change":"2024-03-04T12:32:42.036436+0000","last_active":"2024-03-04T13:12:17.555997+0000","last_peered":"2024-03-04T13:12:17.555997+0000","last_clean":"2024-03-04T13:12:17.555997+0000","last_became_active":"2024-03-04T12:32:42.036150+0000","last_became_peered":"2024-03-04T12:32:42.036150+0000","last_unstale":"2024-03-04T13:12:17.555997+0000","last_undegraded":"2024-03-04T13:12:17.555997+0000","last_fullsized":"2024-03-04T13:12:17.555997+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"255'68","reported_seq":270,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:52.360028+0000","last_change":"2024-03-04T12:29:01.700959+0000","last_active":"2024-03-04T13:10:52.360028+0000","last_peered":"2024-03-04T13:10:52.360028+0000","last_clean":"2024-03-04T13:10:52.360028+0000","last_became_active":"2024-03-04T12:29:01.700624+0000","last_became_peered":"2024-03-04T12:29:01.700624+0000","last_unstale":"2024-03-04T13:10:52.360028+0000","last_undegraded":"2024-03-04T13:10:52.360028+0000","last_fullsized":"2024-03-04T13:10:52.360028+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:04.670734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":295,"num_write":88,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497975+0000","last_change":"2024-03-04T12:46:22.309757+0000","last_active":"2024-03-04T13:10:12.497975+0000","last_peered":"2024-03-04T13:10:12.497975+0000","last_clean":"2024-03-04T13:10:12.497975+0000","last_became_active":"2024-03-04T12:46:22.309493+0000","last_became_peered":"2024-03-04T12:46:22.309493+0000","last_unstale":"2024-03-04T13:10:12.497975+0000","last_undegraded":"2024-03-04T13:10:12.497975+0000","last_fullsized":"2024-03-04T13:10:12.497975+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:56.850351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"255'10","reported_seq":61,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.190787+0000","last_change":"2024-03-04T12:32:46.054533+0000","last_active":"2024-03-04T13:13:21.190787+0000","last_peered":"2024-03-04T13:13:21.190787+0000","last_clean":"2024-03-04T13:13:21.190787+0000","last_became_active":"2024-03-04T12:32:46.054256+0000","last_became_peered":"2024-03-04T12:32:46.054256+0000","last_unstale":"2024-03-04T13:13:21.190787+0000","last_undegraded":"2024-03-04T13:13:21.190787+0000","last_fullsized":"2024-03-04T13:13:21.190787+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:56:03.550607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":16480,"num_write":15,"num_write_kb":11320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499619+0000","last_change":"2024-03-04T12:32:42.035988+0000","last_active":"2024-03-04T13:10:22.499619+0000","last_peered":"2024-03-04T13:10:22.499619+0000","last_clean":"2024-03-04T13:10:22.499619+0000","last_became_active":"2024-03-04T12:32:42.035683+0000","last_became_peered":"2024-03-04T12:32:42.035683+0000","last_unstale":"2024-03-04T13:10:22.499619+0000","last_undegraded":"2024-03-04T13:10:22.499619+0000","last_fullsized":"2024-03-04T13:10:22.499619+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:02:00.359791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"255'43","reported_seq":144,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.503035+0000","last_change":"2024-03-04T12:29:01.701803+0000","last_active":"2024-03-04T13:10:42.503035+0000","last_peered":"2024-03-04T13:10:42.503035+0000","last_clean":"2024-03-04T13:10:42.503035+0000","last_became_active":"2024-03-04T12:29:01.701396+0000","last_became_peered":"2024-03-04T12:29:01.701396+0000","last_unstale":"2024-03-04T13:10:42.503035+0000","last_undegraded":"2024-03-04T13:10:42.503035+0000","last_fullsized":"2024-03-04T13:10:42.503035+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:53:53.242346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:27.356344+0000","last_change":"2024-03-04T12:46:22.260088+0000","last_active":"2024-03-04T13:10:27.356344+0000","last_peered":"2024-03-04T13:10:27.356344+0000","last_clean":"2024-03-04T13:10:27.356344+0000","last_became_active":"2024-03-04T12:46:22.259763+0000","last_became_peered":"2024-03-04T12:46:22.259763+0000","last_unstale":"2024-03-04T13:10:27.356344+0000","last_undegraded":"2024-03-04T13:10:27.356344+0000","last_fullsized":"2024-03-04T13:10:27.356344+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:33.450477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"255'5","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.032505+0000","last_change":"2024-03-04T12:32:46.057881+0000","last_active":"2024-03-04T13:13:21.032505+0000","last_peered":"2024-03-04T13:13:21.032505+0000","last_clean":"2024-03-04T13:13:21.032505+0000","last_became_active":"2024-03-04T12:32:46.057646+0000","last_became_peered":"2024-03-04T12:32:46.057646+0000","last_unstale":"2024-03-04T13:13:21.032505+0000","last_undegraded":"2024-03-04T13:13:21.032505+0000","last_fullsized":"2024-03-04T13:13:21.032505+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:26:52.859284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5168,"num_write":5,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"255'2","reported_seq":51,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.181777+0000","last_change":"2024-03-04T12:32:42.027057+0000","last_active":"2024-03-04T13:13:21.181777+0000","last_peered":"2024-03-04T13:13:21.181777+0000","last_clean":"2024-03-04T13:13:21.181777+0000","last_became_active":"2024-03-04T12:32:42.026771+0000","last_became_peered":"2024-03-04T12:32:42.026771+0000","last_unstale":"2024-03-04T13:13:21.181777+0000","last_undegraded":"2024-03-04T13:13:21.181777+0000","last_fullsized":"2024-03-04T13:13:21.181777+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"255'43","reported_seq":154,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.469237+0000","last_change":"2024-03-04T12:29:01.702097+0000","last_active":"2024-03-04T13:12:47.469237+0000","last_peered":"2024-03-04T13:12:47.469237+0000","last_clean":"2024-03-04T13:12:47.469237+0000","last_became_active":"2024-03-04T12:29:01.701812+0000","last_became_peered":"2024-03-04T12:29:01.701812+0000","last_unstale":"2024-03-04T13:12:47.469237+0000","last_undegraded":"2024-03-04T13:12:47.469237+0000","last_fullsized":"2024-03-04T13:12:47.469237+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":121,"num_write":82,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.720178+0000","last_change":"2024-03-04T12:46:22.247949+0000","last_active":"2024-03-04T13:13:25.720178+0000","last_peered":"2024-03-04T13:13:25.720178+0000","last_clean":"2024-03-04T13:13:25.720178+0000","last_became_active":"2024-03-04T12:46:22.247655+0000","last_became_peered":"2024-03-04T12:46:22.247655+0000","last_unstale":"2024-03-04T13:13:25.720178+0000","last_undegraded":"2024-03-04T13:13:25.720178+0000","last_fullsized":"2024-03-04T13:13:25.720178+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"255'3","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.526860+0000","last_change":"2024-03-04T12:32:46.058700+0000","last_active":"2024-03-04T13:12:57.526860+0000","last_peered":"2024-03-04T13:12:57.526860+0000","last_clean":"2024-03-04T13:12:57.526860+0000","last_became_active":"2024-03-04T12:32:46.058466+0000","last_became_peered":"2024-03-04T12:32:46.058466+0000","last_unstale":"2024-03-04T13:12:57.526860+0000","last_undegraded":"2024-03-04T13:12:57.526860+0000","last_fullsized":"2024-03-04T13:12:57.526860+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:45:44.721969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.354089+0000","last_change":"2024-03-04T12:32:42.031684+0000","last_active":"2024-03-04T13:10:12.354089+0000","last_peered":"2024-03-04T13:10:12.354089+0000","last_clean":"2024-03-04T13:10:12.354089+0000","last_became_active":"2024-03-04T12:32:42.031410+0000","last_became_peered":"2024-03-04T12:32:42.031410+0000","last_unstale":"2024-03-04T13:10:12.354089+0000","last_undegraded":"2024-03-04T13:10:12.354089+0000","last_fullsized":"2024-03-04T13:10:12.354089+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:20:00.365398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"255'27","reported_seq":115,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.482916+0000","last_change":"2024-03-04T12:29:01.703669+0000","last_active":"2024-03-04T13:10:42.482916+0000","last_peered":"2024-03-04T13:10:42.482916+0000","last_clean":"2024-03-04T13:10:42.482916+0000","last_became_active":"2024-03-04T12:29:01.703420+0000","last_became_peered":"2024-03-04T12:29:01.703420+0000","last_unstale":"2024-03-04T13:10:42.482916+0000","last_undegraded":"2024-03-04T13:10:42.482916+0000","last_fullsized":"2024-03-04T13:10:42.482916+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:31:39.634520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":74,"num_write":42,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.107102+0000","last_change":"2024-03-04T12:46:22.250162+0000","last_active":"2024-03-04T13:13:27.107102+0000","last_peered":"2024-03-04T13:13:27.107102+0000","last_clean":"2024-03-04T13:13:27.107102+0000","last_became_active":"2024-03-04T12:46:22.249854+0000","last_became_peered":"2024-03-04T12:46:22.249854+0000","last_unstale":"2024-03-04T13:13:27.107102+0000","last_undegraded":"2024-03-04T13:13:27.107102+0000","last_fullsized":"2024-03-04T13:13:27.107102+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":41,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.479555+0000","last_change":"2024-03-04T12:32:46.051913+0000","last_active":"2024-03-04T13:10:17.479555+0000","last_peered":"2024-03-04T13:10:17.479555+0000","last_clean":"2024-03-04T13:10:17.479555+0000","last_became_active":"2024-03-04T12:32:46.051498+0000","last_became_peered":"2024-03-04T12:32:46.051498+0000","last_unstale":"2024-03-04T13:10:17.479555+0000","last_undegraded":"2024-03-04T13:10:17.479555+0000","last_fullsized":"2024-03-04T13:10:17.479555+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:31:49.935678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"255'6","reported_seq":61,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:52.525983+0000","last_change":"2024-03-04T12:32:42.038655+0000","last_active":"2024-03-04T13:12:52.525983+0000","last_peered":"2024-03-04T13:12:52.525983+0000","last_clean":"2024-03-04T13:12:52.525983+0000","last_became_active":"2024-03-04T12:32:42.038349+0000","last_became_peered":"2024-03-04T12:32:42.038349+0000","last_unstale":"2024-03-04T13:12:52.525983+0000","last_undegraded":"2024-03-04T13:12:52.525983+0000","last_fullsized":"2024-03-04T13:12:52.525983+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:35:57.593667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"255'90","reported_seq":258,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:42.358360+0000","last_change":"2024-03-04T12:29:01.701552+0000","last_active":"2024-03-04T13:10:42.358360+0000","last_peered":"2024-03-04T13:10:42.358360+0000","last_clean":"2024-03-04T13:10:42.358360+0000","last_became_active":"2024-03-04T12:29:01.701282+0000","last_became_peered":"2024-03-04T12:29:01.701282+0000","last_unstale":"2024-03-04T13:10:42.358360+0000","last_undegraded":"2024-03-04T13:10:42.358360+0000","last_fullsized":"2024-03-04T13:10:42.358360+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:31:15.249708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":354,"num_read_kb":252,"num_write":156,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:22.488104+0000","last_change":"2024-03-04T12:46:22.259364+0000","last_active":"2024-03-04T13:11:22.488104+0000","last_peered":"2024-03-04T13:11:22.488104+0000","last_clean":"2024-03-04T13:11:22.488104+0000","last_became_active":"2024-03-04T12:46:22.258936+0000","last_became_peered":"2024-03-04T12:46:22.258936+0000","last_unstale":"2024-03-04T13:11:22.488104+0000","last_undegraded":"2024-03-04T13:11:22.488104+0000","last_fullsized":"2024-03-04T13:11:22.488104+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:15:52.268943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":42,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.556615+0000","last_change":"2024-03-04T12:32:46.053786+0000","last_active":"2024-03-04T13:12:22.556615+0000","last_peered":"2024-03-04T13:12:22.556615+0000","last_clean":"2024-03-04T13:12:22.556615+0000","last_became_active":"2024-03-04T12:32:46.053456+0000","last_became_peered":"2024-03-04T12:32:46.053456+0000","last_unstale":"2024-03-04T13:12:22.556615+0000","last_undegraded":"2024-03-04T13:12:22.556615+0000","last_fullsized":"2024-03-04T13:12:22.556615+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.478815+0000","last_change":"2024-03-04T12:32:42.035705+0000","last_active":"2024-03-04T13:10:12.478815+0000","last_peered":"2024-03-04T13:10:12.478815+0000","last_clean":"2024-03-04T13:10:12.478815+0000","last_became_active":"2024-03-04T12:32:42.035413+0000","last_became_peered":"2024-03-04T12:32:42.035413+0000","last_unstale":"2024-03-04T13:10:12.478815+0000","last_undegraded":"2024-03-04T13:10:12.478815+0000","last_fullsized":"2024-03-04T13:10:12.478815+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:30:04.933989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"255'17","reported_seq":95,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:07.458386+0000","last_change":"2024-03-04T12:29:01.702839+0000","last_active":"2024-03-04T13:13:07.458386+0000","last_peered":"2024-03-04T13:13:07.458386+0000","last_clean":"2024-03-04T13:13:07.458386+0000","last_became_active":"2024-03-04T12:29:01.702555+0000","last_became_peered":"2024-03-04T12:29:01.702555+0000","last_unstale":"2024-03-04T13:13:07.458386+0000","last_undegraded":"2024-03-04T13:13:07.458386+0000","last_fullsized":"2024-03-04T13:13:07.458386+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":47,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"255'178","reported_seq":782,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.182995+0000","last_change":"2024-03-04T12:20:14.820927+0000","last_active":"2024-03-04T13:13:21.182995+0000","last_peered":"2024-03-04T13:13:21.182995+0000","last_clean":"2024-03-04T13:13:21.182995+0000","last_became_active":"2024-03-04T12:20:14.820595+0000","last_became_peered":"2024-03-04T12:20:14.820595+0000","last_unstale":"2024-03-04T13:13:21.182995+0000","last_undegraded":"2024-03-04T13:13:21.182995+0000","last_fullsized":"2024-03-04T13:13:21.182995+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:07:18.920479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":457,"num_write":1012,"num_write_kb":11218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"255'475","reported_seq":1778,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.976981+0000","last_change":"2024-03-04T12:20:16.828823+0000","last_active":"2024-03-04T13:12:36.976981+0000","last_peered":"2024-03-04T13:12:36.976981+0000","last_clean":"2024-03-04T13:12:36.976981+0000","last_became_active":"2024-03-04T12:20:16.828539+0000","last_became_peered":"2024-03-04T12:20:16.828539+0000","last_unstale":"2024-03-04T13:12:36.976981+0000","last_undegraded":"2024-03-04T13:12:36.976981+0000","last_fullsized":"2024-03-04T13:12:36.976981+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:22:24.173643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2301,"num_read_kb":2121,"num_write":643,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"255'223","reported_seq":874,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.162921+0000","last_change":"2024-03-04T12:20:14.815583+0000","last_active":"2024-03-04T13:13:21.162921+0000","last_peered":"2024-03-04T13:13:21.162921+0000","last_clean":"2024-03-04T13:13:21.162921+0000","last_became_active":"2024-03-04T12:20:14.814863+0000","last_became_peered":"2024-03-04T12:20:14.814863+0000","last_unstale":"2024-03-04T13:13:21.162921+0000","last_undegraded":"2024-03-04T13:13:21.162921+0000","last_fullsized":"2024-03-04T13:13:21.162921+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591266,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":15449,"num_write":1326,"num_write_kb":40818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"255'559","reported_seq":1909,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573307+0000","last_change":"2024-03-04T12:20:16.837515+0000","last_active":"2024-03-04T13:12:50.573307+0000","last_peered":"2024-03-04T13:12:50.573307+0000","last_clean":"2024-03-04T13:12:50.573307+0000","last_became_active":"2024-03-04T12:20:16.837200+0000","last_became_peered":"2024-03-04T12:20:16.837200+0000","last_unstale":"2024-03-04T13:12:50.573307+0000","last_undegraded":"2024-03-04T13:12:50.573307+0000","last_fullsized":"2024-03-04T13:12:50.573307+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:42:27.972671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2594,"num_read_kb":2289,"num_write":764,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"255'155","reported_seq":748,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.234154+0000","last_change":"2024-03-04T12:20:14.816919+0000","last_active":"2024-03-04T13:13:21.234154+0000","last_peered":"2024-03-04T13:13:21.234154+0000","last_clean":"2024-03-04T13:13:21.234154+0000","last_became_active":"2024-03-04T12:20:14.816597+0000","last_became_peered":"2024-03-04T12:20:14.816597+0000","last_unstale":"2024-03-04T13:13:21.234154+0000","last_undegraded":"2024-03-04T13:13:21.234154+0000","last_fullsized":"2024-03-04T13:13:21.234154+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":326,"num_read_kb":1168,"num_write":917,"num_write_kb":5749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"255'452","reported_seq":1951,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.525123+0000","last_change":"2024-03-04T12:20:16.821071+0000","last_active":"2024-03-04T13:12:47.525123+0000","last_peered":"2024-03-04T13:12:47.525123+0000","last_clean":"2024-03-04T13:12:47.525123+0000","last_became_active":"2024-03-04T12:20:16.820419+0000","last_became_peered":"2024-03-04T12:20:16.820419+0000","last_unstale":"2024-03-04T13:12:47.525123+0000","last_undegraded":"2024-03-04T13:12:47.525123+0000","last_fullsized":"2024-03-04T13:12:47.525123+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2318,"num_read_kb":2161,"num_write":537,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"255'245","reported_seq":882,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.373607+0000","last_change":"2024-03-04T12:20:14.826502+0000","last_active":"2024-03-04T13:12:27.373607+0000","last_peered":"2024-03-04T13:12:27.373607+0000","last_clean":"2024-03-04T13:12:27.373607+0000","last_became_active":"2024-03-04T12:20:14.824779+0000","last_became_peered":"2024-03-04T12:20:14.824779+0000","last_unstale":"2024-03-04T13:12:27.373607+0000","last_undegraded":"2024-03-04T13:12:27.373607+0000","last_fullsized":"2024-03-04T13:12:27.373607+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:29.747512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4160401,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":13558,"num_write":1376,"num_write_kb":36455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"255'351","reported_seq":1794,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.462894+0000","last_change":"2024-03-04T12:20:16.828116+0000","last_active":"2024-03-04T13:12:47.462894+0000","last_peered":"2024-03-04T13:12:47.462894+0000","last_clean":"2024-03-04T13:12:47.462894+0000","last_became_active":"2024-03-04T12:20:16.827613+0000","last_became_peered":"2024-03-04T12:20:16.827613+0000","last_unstale":"2024-03-04T13:12:47.462894+0000","last_undegraded":"2024-03-04T13:12:47.462894+0000","last_fullsized":"2024-03-04T13:12:47.462894+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1915,"num_read_kb":1843,"num_write":383,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"255'195","reported_seq":834,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.096823+0000","last_change":"2024-03-04T12:20:14.816830+0000","last_active":"2024-03-04T13:13:21.096823+0000","last_peered":"2024-03-04T13:13:21.096823+0000","last_clean":"2024-03-04T13:13:21.096823+0000","last_became_active":"2024-03-04T12:20:14.816532+0000","last_became_peered":"2024-03-04T12:20:14.816532+0000","last_unstale":"2024-03-04T13:13:21.096823+0000","last_undegraded":"2024-03-04T13:13:21.096823+0000","last_fullsized":"2024-03-04T13:13:21.096823+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:37:37.790276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5789792,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":440,"num_read_kb":58154,"num_write":1069,"num_write_kb":58795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"255'405","reported_seq":2045,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.099180+0000","last_change":"2024-03-04T12:20:16.816980+0000","last_active":"2024-03-04T13:12:31.099180+0000","last_peered":"2024-03-04T13:12:31.099180+0000","last_clean":"2024-03-04T13:12:31.099180+0000","last_became_active":"2024-03-04T12:20:16.816688+0000","last_became_peered":"2024-03-04T12:20:16.816688+0000","last_unstale":"2024-03-04T13:12:31.099180+0000","last_undegraded":"2024-03-04T13:12:31.099180+0000","last_fullsized":"2024-03-04T13:12:31.099180+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:36:29.402179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2407,"num_read_kb":2304,"num_write":479,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"255'174","reported_seq":756,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:22.563248+0000","last_change":"2024-03-04T12:20:51.031065+0000","last_active":"2024-03-04T13:13:22.563248+0000","last_peered":"2024-03-04T13:13:22.563248+0000","last_clean":"2024-03-04T13:13:22.563248+0000","last_became_active":"2024-03-04T12:20:51.030709+0000","last_became_peered":"2024-03-04T12:20:51.030709+0000","last_unstale":"2024-03-04T13:13:22.563248+0000","last_undegraded":"2024-03-04T13:13:22.563248+0000","last_fullsized":"2024-03-04T13:13:22.563248+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311793,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":363,"num_read_kb":29477,"num_write":998,"num_write_kb":29693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"255'775","reported_seq":2154,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.328361+0000","last_change":"2024-03-04T12:20:16.825330+0000","last_active":"2024-03-04T13:12:39.328361+0000","last_peered":"2024-03-04T13:12:39.328361+0000","last_clean":"2024-03-04T13:12:39.328361+0000","last_became_active":"2024-03-04T12:20:16.822282+0000","last_became_peered":"2024-03-04T12:20:16.822282+0000","last_unstale":"2024-03-04T13:12:39.328361+0000","last_undegraded":"2024-03-04T13:12:39.328361+0000","last_fullsized":"2024-03-04T13:12:39.328361+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3372,"num_read_kb":2974,"num_write":1065,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"255'195","reported_seq":826,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.101704+0000","last_change":"2024-03-04T12:20:14.815689+0000","last_active":"2024-03-04T13:13:21.101704+0000","last_peered":"2024-03-04T13:13:21.101704+0000","last_clean":"2024-03-04T13:13:21.101704+0000","last_became_active":"2024-03-04T12:20:14.815388+0000","last_became_peered":"2024-03-04T12:20:14.815388+0000","last_unstale":"2024-03-04T13:13:21.101704+0000","last_undegraded":"2024-03-04T13:13:21.101704+0000","last_fullsized":"2024-03-04T13:13:21.101704+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:43:25.448300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262238,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":61923,"num_write":1063,"num_write_kb":47041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"255'684","reported_seq":2154,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.557057+0000","last_change":"2024-03-04T12:20:16.833569+0000","last_active":"2024-03-04T13:12:22.557057+0000","last_peered":"2024-03-04T13:12:22.557057+0000","last_clean":"2024-03-04T13:12:22.557057+0000","last_became_active":"2024-03-04T12:20:16.833268+0000","last_became_peered":"2024-03-04T12:20:16.833268+0000","last_unstale":"2024-03-04T13:12:22.557057+0000","last_undegraded":"2024-03-04T13:12:22.557057+0000","last_fullsized":"2024-03-04T13:12:22.557057+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:35:17.714462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3214,"num_read_kb":2906,"num_write":892,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"255'232","reported_seq":874,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.228353+0000","last_change":"2024-03-04T12:20:14.828265+0000","last_active":"2024-03-04T13:13:21.228353+0000","last_peered":"2024-03-04T13:13:21.228353+0000","last_clean":"2024-03-04T13:13:21.228353+0000","last_became_active":"2024-03-04T12:20:14.827948+0000","last_became_peered":"2024-03-04T12:20:14.827948+0000","last_unstale":"2024-03-04T13:13:21.228353+0000","last_undegraded":"2024-03-04T13:13:21.228353+0000","last_fullsized":"2024-03-04T13:13:21.228353+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2119867,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":498,"num_read_kb":35496,"num_write":1177,"num_write_kb":50438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"255'329","reported_seq":1702,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.972662+0000","last_change":"2024-03-04T12:20:16.831041+0000","last_active":"2024-03-04T13:12:36.972662+0000","last_peered":"2024-03-04T13:12:36.972662+0000","last_clean":"2024-03-04T13:12:36.972662+0000","last_became_active":"2024-03-04T12:20:16.830773+0000","last_became_peered":"2024-03-04T12:20:16.830773+0000","last_unstale":"2024-03-04T13:12:36.972662+0000","last_undegraded":"2024-03-04T13:12:36.972662+0000","last_fullsized":"2024-03-04T13:12:36.972662+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1823,"num_read_kb":1743,"num_write":376,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"255'403","reported_seq":1978,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.077573+0000","last_change":"2024-03-04T12:20:16.820827+0000","last_active":"2024-03-04T13:12:18.077573+0000","last_peered":"2024-03-04T13:12:18.077573+0000","last_clean":"2024-03-04T13:12:18.077573+0000","last_became_active":"2024-03-04T12:20:16.820533+0000","last_became_peered":"2024-03-04T12:20:16.820533+0000","last_unstale":"2024-03-04T13:12:18.077573+0000","last_undegraded":"2024-03-04T13:12:18.077573+0000","last_fullsized":"2024-03-04T13:12:18.077573+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2265,"num_read_kb":2155,"num_write":466,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"255'193","reported_seq":823,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:12.508125+0000","last_change":"2024-03-04T12:20:14.820881+0000","last_active":"2024-03-04T13:11:12.508125+0000","last_peered":"2024-03-04T13:11:12.508125+0000","last_clean":"2024-03-04T13:11:12.508125+0000","last_became_active":"2024-03-04T12:20:14.820248+0000","last_became_peered":"2024-03-04T12:20:14.820248+0000","last_unstale":"2024-03-04T13:11:12.508125+0000","last_undegraded":"2024-03-04T13:11:12.508125+0000","last_fullsized":"2024-03-04T13:11:12.508125+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:59:02.821081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847147,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":428,"num_read_kb":15441,"num_write":1092,"num_write_kb":31882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"255'1140","reported_seq":2690,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573468+0000","last_change":"2024-03-04T12:20:16.837314+0000","last_active":"2024-03-04T13:12:50.573468+0000","last_peered":"2024-03-04T13:12:50.573468+0000","last_clean":"2024-03-04T13:12:50.573468+0000","last_became_active":"2024-03-04T12:20:16.837126+0000","last_became_peered":"2024-03-04T12:20:16.837126+0000","last_unstale":"2024-03-04T13:12:50.573468+0000","last_undegraded":"2024-03-04T13:12:50.573468+0000","last_fullsized":"2024-03-04T13:12:50.573468+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:39:46.380503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4770,"num_read_kb":4178,"num_write":1557,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"255'198","reported_seq":814,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.122135+0000","last_change":"2024-03-04T12:20:14.824468+0000","last_active":"2024-03-04T13:13:21.122135+0000","last_peered":"2024-03-04T13:13:21.122135+0000","last_clean":"2024-03-04T13:13:21.122135+0000","last_became_active":"2024-03-04T12:20:14.824133+0000","last_became_peered":"2024-03-04T12:20:14.824133+0000","last_unstale":"2024-03-04T13:13:21.122135+0000","last_undegraded":"2024-03-04T13:13:21.122135+0000","last_fullsized":"2024-03-04T13:13:21.122135+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:58:01.156356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399138,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":430,"num_read_kb":9751,"num_write":1008,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"255'738","reported_seq":2185,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.777698+0000","last_change":"2024-03-04T12:20:16.825766+0000","last_active":"2024-03-04T13:12:34.777698+0000","last_peered":"2024-03-04T13:12:34.777698+0000","last_clean":"2024-03-04T13:12:34.777698+0000","last_became_active":"2024-03-04T12:20:16.825499+0000","last_became_peered":"2024-03-04T12:20:16.825499+0000","last_unstale":"2024-03-04T13:12:34.777698+0000","last_undegraded":"2024-03-04T13:12:34.777698+0000","last_fullsized":"2024-03-04T13:12:34.777698+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:43:04.157793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3318,"num_read_kb":2969,"num_write":989,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"255'240","reported_seq":872,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.237486+0000","last_change":"2024-03-04T12:20:14.828323+0000","last_active":"2024-03-04T13:13:21.237486+0000","last_peered":"2024-03-04T13:13:21.237486+0000","last_clean":"2024-03-04T13:13:21.237486+0000","last_became_active":"2024-03-04T12:20:14.827979+0000","last_became_peered":"2024-03-04T12:20:14.827979+0000","last_unstale":"2024-03-04T13:13:21.237486+0000","last_undegraded":"2024-03-04T13:13:21.237486+0000","last_fullsized":"2024-03-04T13:13:21.237486+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:12:15.676059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":577599,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":7999,"num_write":1192,"num_write_kb":30331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"255'777","reported_seq":2215,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.179051+0000","last_change":"2024-03-04T12:20:16.826162+0000","last_active":"2024-03-04T13:13:26.179051+0000","last_peered":"2024-03-04T13:13:26.179051+0000","last_clean":"2024-03-04T13:13:26.179051+0000","last_became_active":"2024-03-04T12:20:16.825897+0000","last_became_peered":"2024-03-04T12:20:16.825897+0000","last_unstale":"2024-03-04T13:13:26.179051+0000","last_undegraded":"2024-03-04T13:13:26.179051+0000","last_fullsized":"2024-03-04T13:13:26.179051+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3571,"num_read_kb":3184,"num_write":1054,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"255'154","reported_seq":755,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.106284+0000","last_change":"2024-03-04T12:20:14.824375+0000","last_active":"2024-03-04T13:13:27.106284+0000","last_peered":"2024-03-04T13:13:27.106284+0000","last_clean":"2024-03-04T13:13:27.106284+0000","last_became_active":"2024-03-04T12:20:14.823430+0000","last_became_peered":"2024-03-04T12:20:14.823430+0000","last_unstale":"2024-03-04T13:13:27.106284+0000","last_undegraded":"2024-03-04T13:13:27.106284+0000","last_fullsized":"2024-03-04T13:13:27.106284+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1683023,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":325,"num_read_kb":32856,"num_write":784,"num_write_kb":22354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"255'556","reported_seq":2088,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.179051+0000","last_change":"2024-03-04T12:20:16.830040+0000","last_active":"2024-03-04T13:13:26.179051+0000","last_peered":"2024-03-04T13:13:26.179051+0000","last_clean":"2024-03-04T13:13:26.179051+0000","last_became_active":"2024-03-04T12:20:16.829685+0000","last_became_peered":"2024-03-04T12:20:16.829685+0000","last_unstale":"2024-03-04T13:13:26.179051+0000","last_undegraded":"2024-03-04T13:13:26.179051+0000","last_fullsized":"2024-03-04T13:13:26.179051+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2792,"num_read_kb":2527,"num_write":750,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"255'193","reported_seq":777,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.642264+0000","last_change":"2024-03-04T12:20:14.822181+0000","last_active":"2024-03-04T13:13:26.642264+0000","last_peered":"2024-03-04T13:13:26.642264+0000","last_clean":"2024-03-04T13:13:26.642264+0000","last_became_active":"2024-03-04T12:20:14.821923+0000","last_became_peered":"2024-03-04T12:20:14.821923+0000","last_unstale":"2024-03-04T13:13:26.642264+0000","last_undegraded":"2024-03-04T13:13:26.642264+0000","last_fullsized":"2024-03-04T13:13:26.642264+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":428,"num_write":1012,"num_write_kb":16985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"255'373","reported_seq":1790,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.106646+0000","last_change":"2024-03-04T12:20:16.826907+0000","last_active":"2024-03-04T13:13:27.106646+0000","last_peered":"2024-03-04T13:13:27.106646+0000","last_clean":"2024-03-04T13:13:27.106646+0000","last_became_active":"2024-03-04T12:20:16.826208+0000","last_became_peered":"2024-03-04T12:20:16.826208+0000","last_unstale":"2024-03-04T13:13:27.106646+0000","last_undegraded":"2024-03-04T13:13:27.106646+0000","last_fullsized":"2024-03-04T13:13:27.106646+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1988,"num_read_kb":1881,"num_write":441,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"255'173","reported_seq":778,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.207103+0000","last_change":"2024-03-04T12:20:14.812110+0000","last_active":"2024-03-04T13:13:21.207103+0000","last_peered":"2024-03-04T13:13:21.207103+0000","last_clean":"2024-03-04T13:13:21.207103+0000","last_became_active":"2024-03-04T12:20:14.811813+0000","last_became_peered":"2024-03-04T12:20:14.811813+0000","last_unstale":"2024-03-04T13:13:21.207103+0000","last_undegraded":"2024-03-04T13:13:21.207103+0000","last_fullsized":"2024-03-04T13:13:21.207103+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":397,"num_read_kb":4485,"num_write":973,"num_write_kb":10922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"255'93","reported_seq":580,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:15.780471+0000","last_change":"2024-03-04T12:20:24.871376+0000","last_active":"2024-03-04T13:12:15.780471+0000","last_peered":"2024-03-04T13:12:15.780471+0000","last_clean":"2024-03-04T13:12:15.780471+0000","last_became_active":"2024-03-04T12:20:24.871089+0000","last_became_peered":"2024-03-04T12:20:24.871089+0000","last_unstale":"2024-03-04T13:12:15.780471+0000","last_undegraded":"2024-03-04T13:12:15.780471+0000","last_fullsized":"2024-03-04T13:12:15.780471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":97,"num_write":227,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"255'790","reported_seq":2213,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.075240+0000","last_change":"2024-03-04T12:20:16.829280+0000","last_active":"2024-03-04T13:12:18.075240+0000","last_peered":"2024-03-04T13:12:18.075240+0000","last_clean":"2024-03-04T13:12:18.075240+0000","last_became_active":"2024-03-04T12:20:16.828977+0000","last_became_peered":"2024-03-04T12:20:16.828977+0000","last_unstale":"2024-03-04T13:12:18.075240+0000","last_undegraded":"2024-03-04T13:12:18.075240+0000","last_fullsized":"2024-03-04T13:12:18.075240+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3439,"num_read_kb":3056,"num_write":1047,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"255'219","reported_seq":869,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.154310+0000","last_change":"2024-03-04T12:20:14.817012+0000","last_active":"2024-03-04T13:13:21.154310+0000","last_peered":"2024-03-04T13:13:21.154310+0000","last_clean":"2024-03-04T13:13:21.154310+0000","last_became_active":"2024-03-04T12:20:14.816722+0000","last_became_peered":"2024-03-04T12:20:14.816722+0000","last_unstale":"2024-03-04T13:13:21.154310+0000","last_undegraded":"2024-03-04T13:13:21.154310+0000","last_fullsized":"2024-03-04T13:13:21.154310+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:03:31.043930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1705735,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":471,"num_read_kb":103623,"num_write":1220,"num_write_kb":57222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.341660+0000","last_change":"2024-03-04T12:20:18.835916+0000","last_active":"2024-03-04T13:08:42.341660+0000","last_peered":"2024-03-04T13:08:42.341660+0000","last_clean":"2024-03-04T13:08:42.341660+0000","last_became_active":"2024-03-04T12:20:18.835597+0000","last_became_peered":"2024-03-04T12:20:18.835597+0000","last_unstale":"2024-03-04T13:08:42.341660+0000","last_undegraded":"2024-03-04T13:08:42.341660+0000","last_fullsized":"2024-03-04T13:08:42.341660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:45:01.355651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"255'185","reported_seq":769,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.069140+0000","last_change":"2024-03-04T12:20:20.837358+0000","last_active":"2024-03-04T13:13:21.069140+0000","last_peered":"2024-03-04T13:13:21.069140+0000","last_clean":"2024-03-04T13:13:21.069140+0000","last_became_active":"2024-03-04T12:20:20.837048+0000","last_became_peered":"2024-03-04T12:20:20.837048+0000","last_unstale":"2024-03-04T13:13:21.069140+0000","last_undegraded":"2024-03-04T13:13:21.069140+0000","last_fullsized":"2024-03-04T13:13:21.069140+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":254,"num_read_kb":315,"num_write":146,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:42.483022+0000","last_change":"2024-03-04T12:20:22.852800+0000","last_active":"2024-03-04T13:08:42.483022+0000","last_peered":"2024-03-04T13:08:42.483022+0000","last_clean":"2024-03-04T13:08:42.483022+0000","last_became_active":"2024-03-04T12:20:22.852461+0000","last_became_peered":"2024-03-04T12:20:22.852461+0000","last_unstale":"2024-03-04T13:08:42.483022+0000","last_undegraded":"2024-03-04T13:08:42.483022+0000","last_fullsized":"2024-03-04T13:08:42.483022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:03:51.860258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"255'2372","reported_seq":4166,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.462461+0000","last_change":"2024-03-04T12:20:24.869696+0000","last_active":"2024-03-04T13:13:12.462461+0000","last_peered":"2024-03-04T13:13:12.462461+0000","last_clean":"2024-03-04T13:13:12.462461+0000","last_became_active":"2024-03-04T12:20:24.869395+0000","last_became_peered":"2024-03-04T12:20:24.869395+0000","last_unstale":"2024-03-04T13:13:12.462461+0000","last_undegraded":"2024-03-04T13:13:12.462461+0000","last_fullsized":"2024-03-04T13:13:12.462461+0000","mapping_epoch":30,"log_start":"255'2300","ondisk_log_start":"255'2300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":2300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:18:14.602967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5943,"num_read_kb":5935,"num_write":4730,"num_write_kb":1746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"255'345","reported_seq":1812,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.591170+0000","last_change":"2024-03-04T12:20:16.829693+0000","last_active":"2024-03-04T13:12:50.591170+0000","last_peered":"2024-03-04T13:12:50.591170+0000","last_clean":"2024-03-04T13:12:50.591170+0000","last_became_active":"2024-03-04T12:20:16.829441+0000","last_became_peered":"2024-03-04T12:20:16.829441+0000","last_unstale":"2024-03-04T13:12:50.591170+0000","last_undegraded":"2024-03-04T13:12:50.591170+0000","last_fullsized":"2024-03-04T13:12:50.591170+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:15:29.713063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2107,"num_read_kb":2006,"num_write":408,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"255'161","reported_seq":725,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.083992+0000","last_change":"2024-03-04T12:20:14.819912+0000","last_active":"2024-03-04T13:13:21.083992+0000","last_peered":"2024-03-04T13:13:21.083992+0000","last_clean":"2024-03-04T13:13:21.083992+0000","last_became_active":"2024-03-04T12:20:14.819559+0000","last_became_peered":"2024-03-04T12:20:14.819559+0000","last_unstale":"2024-03-04T13:13:21.083992+0000","last_undegraded":"2024-03-04T13:13:21.083992+0000","last_fullsized":"2024-03-04T13:13:21.083992+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":323,"num_read_kb":7587,"num_write":849,"num_write_kb":22276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:47.462643+0000","last_change":"2024-03-04T12:20:18.834062+0000","last_active":"2024-03-04T13:11:47.462643+0000","last_peered":"2024-03-04T13:11:47.462643+0000","last_clean":"2024-03-04T13:11:47.462643+0000","last_became_active":"2024-03-04T12:20:18.833470+0000","last_became_peered":"2024-03-04T12:20:18.833470+0000","last_unstale":"2024-03-04T13:11:47.462643+0000","last_undegraded":"2024-03-04T13:11:47.462643+0000","last_fullsized":"2024-03-04T13:11:47.462643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"255'77","reported_seq":594,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.507282+0000","last_change":"2024-03-04T12:20:20.838187+0000","last_active":"2024-03-04T13:11:07.507282+0000","last_peered":"2024-03-04T13:11:07.507282+0000","last_clean":"2024-03-04T13:11:07.507282+0000","last_became_active":"2024-03-04T12:20:20.837905+0000","last_became_peered":"2024-03-04T12:20:20.837905+0000","last_unstale":"2024-03-04T13:11:07.507282+0000","last_undegraded":"2024-03-04T13:11:07.507282+0000","last_fullsized":"2024-03-04T13:11:07.507282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.507247+0000","last_change":"2024-03-04T12:20:22.849051+0000","last_active":"2024-03-04T13:11:07.507247+0000","last_peered":"2024-03-04T13:11:07.507247+0000","last_clean":"2024-03-04T13:11:07.507247+0000","last_became_active":"2024-03-04T12:20:22.848773+0000","last_became_peered":"2024-03-04T12:20:22.848773+0000","last_unstale":"2024-03-04T13:11:07.507247+0000","last_undegraded":"2024-03-04T13:11:07.507247+0000","last_fullsized":"2024-03-04T13:11:07.507247+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"255'116","reported_seq":608,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.463971+0000","last_change":"2024-03-04T12:20:24.869138+0000","last_active":"2024-03-04T13:12:57.463971+0000","last_peered":"2024-03-04T13:12:57.463971+0000","last_clean":"2024-03-04T13:12:57.463971+0000","last_became_active":"2024-03-04T12:20:24.868746+0000","last_became_peered":"2024-03-04T12:20:24.868746+0000","last_unstale":"2024-03-04T13:12:57.463971+0000","last_undegraded":"2024-03-04T13:12:57.463971+0000","last_fullsized":"2024-03-04T13:12:57.463971+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"255'390","reported_seq":1883,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260514+0000","last_change":"2024-03-04T12:20:16.829905+0000","last_active":"2024-03-04T13:13:25.260514+0000","last_peered":"2024-03-04T13:13:25.260514+0000","last_clean":"2024-03-04T13:13:25.260514+0000","last_became_active":"2024-03-04T12:20:16.829641+0000","last_became_peered":"2024-03-04T12:20:16.829641+0000","last_unstale":"2024-03-04T13:13:25.260514+0000","last_undegraded":"2024-03-04T13:13:25.260514+0000","last_fullsized":"2024-03-04T13:13:25.260514+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2147,"num_read_kb":2039,"num_write":462,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"255'144","reported_seq":758,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:37.512605+0000","last_change":"2024-03-04T12:20:14.817840+0000","last_active":"2024-03-04T13:11:37.512605+0000","last_peered":"2024-03-04T13:11:37.512605+0000","last_clean":"2024-03-04T13:11:37.512605+0000","last_became_active":"2024-03-04T12:20:14.817556+0000","last_became_peered":"2024-03-04T12:20:14.817556+0000","last_unstale":"2024-03-04T13:11:37.512605+0000","last_undegraded":"2024-03-04T13:11:37.512605+0000","last_fullsized":"2024-03-04T13:11:37.512605+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:38.563036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524480,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":366,"num_read_kb":1564,"num_write":822,"num_write_kb":17292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.458392+0000","last_change":"2024-03-04T12:20:18.836217+0000","last_active":"2024-03-04T13:11:07.458392+0000","last_peered":"2024-03-04T13:11:07.458392+0000","last_clean":"2024-03-04T13:11:07.458392+0000","last_became_active":"2024-03-04T12:20:18.835760+0000","last_became_peered":"2024-03-04T12:20:18.835760+0000","last_unstale":"2024-03-04T13:11:07.458392+0000","last_undegraded":"2024-03-04T13:11:07.458392+0000","last_fullsized":"2024-03-04T13:11:07.458392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"255'113","reported_seq":639,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:47.450122+0000","last_change":"2024-03-04T12:20:20.838715+0000","last_active":"2024-03-04T13:11:47.450122+0000","last_peered":"2024-03-04T13:11:47.450122+0000","last_clean":"2024-03-04T13:11:47.450122+0000","last_became_active":"2024-03-04T12:20:20.838094+0000","last_became_peered":"2024-03-04T12:20:20.838094+0000","last_unstale":"2024-03-04T13:11:47.450122+0000","last_undegraded":"2024-03-04T13:11:47.450122+0000","last_fullsized":"2024-03-04T13:11:47.450122+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":129,"num_write":92,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"255'502","reported_seq":1929,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.004248+0000","last_change":"2024-03-04T12:20:22.851329+0000","last_active":"2024-03-04T13:13:21.004248+0000","last_peered":"2024-03-04T13:13:21.004248+0000","last_clean":"2024-03-04T13:13:21.004248+0000","last_became_active":"2024-03-04T12:20:22.851062+0000","last_became_peered":"2024-03-04T12:20:22.851062+0000","last_unstale":"2024-03-04T13:13:21.004248+0000","last_undegraded":"2024-03-04T13:13:21.004248+0000","last_fullsized":"2024-03-04T13:13:21.004248+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:48:10.088059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"255'137","reported_seq":616,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.526928+0000","last_change":"2024-03-04T12:20:24.912322+0000","last_active":"2024-03-04T13:12:57.526928+0000","last_peered":"2024-03-04T13:12:57.526928+0000","last_clean":"2024-03-04T13:12:57.526928+0000","last_became_active":"2024-03-04T12:20:24.912068+0000","last_became_peered":"2024-03-04T12:20:24.912068+0000","last_unstale":"2024-03-04T13:12:57.526928+0000","last_undegraded":"2024-03-04T13:12:57.526928+0000","last_fullsized":"2024-03-04T13:12:57.526928+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":66,"num_write":291,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"255'856","reported_seq":2538,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.642404+0000","last_change":"2024-03-04T12:20:16.831420+0000","last_active":"2024-03-04T13:13:26.642404+0000","last_peered":"2024-03-04T13:13:26.642404+0000","last_clean":"2024-03-04T13:13:26.642404+0000","last_became_active":"2024-03-04T12:20:16.831039+0000","last_became_peered":"2024-03-04T12:20:16.831039+0000","last_unstale":"2024-03-04T13:13:26.642404+0000","last_undegraded":"2024-03-04T13:13:26.642404+0000","last_fullsized":"2024-03-04T13:13:26.642404+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4009,"num_read_kb":3592,"num_write":1144,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"255'195","reported_seq":798,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.172515+0000","last_change":"2024-03-04T12:20:14.818137+0000","last_active":"2024-03-04T13:13:21.172515+0000","last_peered":"2024-03-04T13:13:21.172515+0000","last_clean":"2024-03-04T13:13:21.172515+0000","last_became_active":"2024-03-04T12:20:14.817863+0000","last_became_peered":"2024-03-04T12:20:14.817863+0000","last_unstale":"2024-03-04T13:13:21.172515+0000","last_undegraded":"2024-03-04T13:13:21.172515+0000","last_fullsized":"2024-03-04T13:13:21.172515+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:33:32.762020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9161812,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":19635,"num_write":1198,"num_write_kb":36958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"32'4","reported_seq":792,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.703405+0000","last_change":"2024-03-04T12:20:18.838746+0000","last_active":"2024-03-04T13:13:20.703405+0000","last_peered":"2024-03-04T13:13:20.703405+0000","last_clean":"2024-03-04T13:13:20.703405+0000","last_became_active":"2024-03-04T12:20:18.838266+0000","last_became_peered":"2024-03-04T12:20:18.838266+0000","last_unstale":"2024-03-04T13:13:20.703405+0000","last_undegraded":"2024-03-04T13:13:20.703405+0000","last_fullsized":"2024-03-04T13:13:20.703405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:40:00.829417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":466,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"255'129","reported_seq":693,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.027522+0000","last_change":"2024-03-04T12:20:21.643825+0000","last_active":"2024-03-04T13:13:21.027522+0000","last_peered":"2024-03-04T13:13:21.027522+0000","last_clean":"2024-03-04T13:13:21.027522+0000","last_became_active":"2024-03-04T12:20:21.643542+0000","last_became_peered":"2024-03-04T12:20:21.643542+0000","last_unstale":"2024-03-04T13:13:21.027522+0000","last_undegraded":"2024-03-04T13:13:21.027522+0000","last_fullsized":"2024-03-04T13:13:21.027522+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:25:37.997080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9148,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":181,"num_read_kb":265,"num_write":100,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"255'530","reported_seq":1913,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.248220+0000","last_change":"2024-03-04T12:20:22.858901+0000","last_active":"2024-03-04T13:13:21.248220+0000","last_peered":"2024-03-04T13:13:21.248220+0000","last_clean":"2024-03-04T13:13:21.248220+0000","last_became_active":"2024-03-04T12:20:22.858575+0000","last_became_peered":"2024-03-04T12:20:22.858575+0000","last_unstale":"2024-03-04T13:13:21.248220+0000","last_undegraded":"2024-03-04T13:13:21.248220+0000","last_fullsized":"2024-03-04T13:13:21.248220+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"255'391","reported_seq":1796,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:40.169266+0000","last_change":"2024-03-04T12:20:16.830920+0000","last_active":"2024-03-04T13:11:40.169266+0000","last_peered":"2024-03-04T13:11:40.169266+0000","last_clean":"2024-03-04T13:11:40.169266+0000","last_became_active":"2024-03-04T12:20:16.830531+0000","last_became_peered":"2024-03-04T12:20:16.830531+0000","last_unstale":"2024-03-04T13:11:40.169266+0000","last_undegraded":"2024-03-04T13:11:40.169266+0000","last_fullsized":"2024-03-04T13:11:40.169266+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:40:48.153427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2065,"num_write":498,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"255'174","reported_seq":849,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.101751+0000","last_change":"2024-03-04T12:20:14.818724+0000","last_active":"2024-03-04T13:13:21.101751+0000","last_peered":"2024-03-04T13:13:21.101751+0000","last_clean":"2024-03-04T13:13:21.101751+0000","last_became_active":"2024-03-04T12:20:14.818441+0000","last_became_peered":"2024-03-04T12:20:14.818441+0000","last_unstale":"2024-03-04T13:13:21.101751+0000","last_undegraded":"2024-03-04T13:13:21.101751+0000","last_fullsized":"2024-03-04T13:13:21.101751+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:32:15.961414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10526962,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":524,"num_read_kb":158242,"num_write":986,"num_write_kb":38243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":492,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497846+0000","last_change":"2024-03-04T12:20:18.832672+0000","last_active":"2024-03-04T13:10:12.497846+0000","last_peered":"2024-03-04T13:10:12.497846+0000","last_clean":"2024-03-04T13:10:12.497846+0000","last_became_active":"2024-03-04T12:20:18.832349+0000","last_became_peered":"2024-03-04T12:20:18.832349+0000","last_unstale":"2024-03-04T13:10:12.497846+0000","last_undegraded":"2024-03-04T13:10:12.497846+0000","last_fullsized":"2024-03-04T13:10:12.497846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:43:17.354349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"255'217","reported_seq":821,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.104550+0000","last_change":"2024-03-04T12:20:21.642137+0000","last_active":"2024-03-04T13:13:21.104550+0000","last_peered":"2024-03-04T13:13:21.104550+0000","last_clean":"2024-03-04T13:13:21.104550+0000","last_became_active":"2024-03-04T12:20:21.641749+0000","last_became_peered":"2024-03-04T12:20:21.641749+0000","last_unstale":"2024-03-04T13:13:21.104550+0000","last_undegraded":"2024-03-04T13:13:21.104550+0000","last_fullsized":"2024-03-04T13:13:21.104550+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:33:09.469358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6571,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":304,"num_read_kb":381,"num_write":178,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":478,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.554993+0000","last_change":"2024-03-04T12:20:22.852908+0000","last_active":"2024-03-04T13:12:07.554993+0000","last_peered":"2024-03-04T13:12:07.554993+0000","last_clean":"2024-03-04T13:12:07.554993+0000","last_became_active":"2024-03-04T12:20:22.852612+0000","last_became_peered":"2024-03-04T12:20:22.852612+0000","last_unstale":"2024-03-04T13:12:07.554993+0000","last_undegraded":"2024-03-04T13:12:07.554993+0000","last_fullsized":"2024-03-04T13:12:07.554993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"255'523","reported_seq":1316,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.165868+0000","last_change":"2024-03-04T12:20:24.869764+0000","last_active":"2024-03-04T13:13:14.165868+0000","last_peered":"2024-03-04T13:13:14.165868+0000","last_clean":"2024-03-04T13:13:14.165868+0000","last_became_active":"2024-03-04T12:20:24.869409+0000","last_became_peered":"2024-03-04T12:20:24.869409+0000","last_unstale":"2024-03-04T13:13:14.165868+0000","last_undegraded":"2024-03-04T13:13:14.165868+0000","last_fullsized":"2024-03-04T13:13:14.165868+0000","mapping_epoch":30,"log_start":"255'500","ondisk_log_start":"255'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:47:48.263171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1237,"num_read_kb":1237,"num_write":1069,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"255'315","reported_seq":1783,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.592082+0000","last_change":"2024-03-04T12:20:16.826445+0000","last_active":"2024-03-04T13:12:50.592082+0000","last_peered":"2024-03-04T13:12:50.592082+0000","last_clean":"2024-03-04T13:12:50.592082+0000","last_became_active":"2024-03-04T12:20:16.826183+0000","last_became_peered":"2024-03-04T12:20:16.826183+0000","last_unstale":"2024-03-04T13:12:50.592082+0000","last_undegraded":"2024-03-04T13:12:50.592082+0000","last_fullsized":"2024-03-04T13:12:50.592082+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2023,"num_read_kb":1945,"num_write":353,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"255'180","reported_seq":810,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.137408+0000","last_change":"2024-03-04T12:20:14.819684+0000","last_active":"2024-03-04T13:13:21.137408+0000","last_peered":"2024-03-04T13:13:21.137408+0000","last_clean":"2024-03-04T13:13:21.137408+0000","last_became_active":"2024-03-04T12:20:14.819389+0000","last_became_peered":"2024-03-04T12:20:14.819389+0000","last_unstale":"2024-03-04T13:13:21.137408+0000","last_undegraded":"2024-03-04T13:13:21.137408+0000","last_fullsized":"2024-03-04T13:13:21.137408+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:30:11.677107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":382,"num_read_kb":37991,"num_write":1066,"num_write_kb":16641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.453714+0000","last_change":"2024-03-04T12:20:18.834899+0000","last_active":"2024-03-04T13:12:22.453714+0000","last_peered":"2024-03-04T13:12:22.453714+0000","last_clean":"2024-03-04T13:12:22.453714+0000","last_became_active":"2024-03-04T12:20:18.834619+0000","last_became_peered":"2024-03-04T12:20:18.834619+0000","last_unstale":"2024-03-04T13:12:22.453714+0000","last_undegraded":"2024-03-04T13:12:22.453714+0000","last_fullsized":"2024-03-04T13:12:22.453714+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"255'129","reported_seq":685,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.203075+0000","last_change":"2024-03-04T12:20:20.843676+0000","last_active":"2024-03-04T13:13:21.203075+0000","last_peered":"2024-03-04T13:13:21.203075+0000","last_clean":"2024-03-04T13:13:21.203075+0000","last_became_active":"2024-03-04T12:20:20.843195+0000","last_became_peered":"2024-03-04T12:20:20.843195+0000","last_unstale":"2024-03-04T13:13:21.203075+0000","last_undegraded":"2024-03-04T13:13:21.203075+0000","last_fullsized":"2024-03-04T13:13:21.203075+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":216,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":475,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.467077+0000","last_change":"2024-03-04T12:20:22.859027+0000","last_active":"2024-03-04T13:12:27.467077+0000","last_peered":"2024-03-04T13:12:27.467077+0000","last_clean":"2024-03-04T13:12:27.467077+0000","last_became_active":"2024-03-04T12:20:22.858722+0000","last_became_peered":"2024-03-04T12:20:22.858722+0000","last_unstale":"2024-03-04T13:12:27.467077+0000","last_undegraded":"2024-03-04T13:12:27.467077+0000","last_fullsized":"2024-03-04T13:12:27.467077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"255'182","reported_seq":703,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:17.325728+0000","last_change":"2024-03-04T12:20:24.869476+0000","last_active":"2024-03-04T13:11:17.325728+0000","last_peered":"2024-03-04T13:11:17.325728+0000","last_clean":"2024-03-04T13:11:17.325728+0000","last_became_active":"2024-03-04T12:20:24.869152+0000","last_became_peered":"2024-03-04T12:20:24.869152+0000","last_unstale":"2024-03-04T13:11:17.325728+0000","last_undegraded":"2024-03-04T13:11:17.325728+0000","last_fullsized":"2024-03-04T13:11:17.325728+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:43:21.486498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":286,"num_read_kb":243,"num_write":358,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"255'1227","reported_seq":2769,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.767503+0000","last_change":"2024-03-04T12:20:16.826525+0000","last_active":"2024-03-04T13:12:12.767503+0000","last_peered":"2024-03-04T13:12:12.767503+0000","last_clean":"2024-03-04T13:12:12.767503+0000","last_became_active":"2024-03-04T12:20:16.826172+0000","last_became_peered":"2024-03-04T12:20:16.826172+0000","last_unstale":"2024-03-04T13:12:12.767503+0000","last_undegraded":"2024-03-04T13:12:12.767503+0000","last_fullsized":"2024-03-04T13:12:12.767503+0000","mapping_epoch":22,"log_start":"255'1200","ondisk_log_start":"255'1200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:12:29.317623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5093,"num_read_kb":4391,"num_write":1710,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"255'179","reported_seq":838,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.059570+0000","last_change":"2024-03-04T12:20:14.828602+0000","last_active":"2024-03-04T13:13:21.059570+0000","last_peered":"2024-03-04T13:13:21.059570+0000","last_clean":"2024-03-04T13:13:21.059570+0000","last_became_active":"2024-03-04T12:20:14.828250+0000","last_became_peered":"2024-03-04T12:20:14.828250+0000","last_unstale":"2024-03-04T13:13:21.059570+0000","last_undegraded":"2024-03-04T13:13:21.059570+0000","last_fullsized":"2024-03-04T13:13:21.059570+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:45:46.934324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22063,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":10895,"num_write":937,"num_write_kb":21474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":486,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.452270+0000","last_change":"2024-03-04T12:20:18.835161+0000","last_active":"2024-03-04T13:12:07.452270+0000","last_peered":"2024-03-04T13:12:07.452270+0000","last_clean":"2024-03-04T13:12:07.452270+0000","last_became_active":"2024-03-04T12:20:18.834897+0000","last_became_peered":"2024-03-04T12:20:18.834897+0000","last_unstale":"2024-03-04T13:12:07.452270+0000","last_undegraded":"2024-03-04T13:12:07.452270+0000","last_fullsized":"2024-03-04T13:12:07.452270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"255'162","reported_seq":746,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.117978+0000","last_change":"2024-03-04T12:20:20.839989+0000","last_active":"2024-03-04T13:13:21.117978+0000","last_peered":"2024-03-04T13:13:21.117978+0000","last_clean":"2024-03-04T13:13:21.117978+0000","last_became_active":"2024-03-04T12:20:20.839295+0000","last_became_peered":"2024-03-04T12:20:20.839295+0000","last_unstale":"2024-03-04T13:13:21.117978+0000","last_undegraded":"2024-03-04T13:13:21.117978+0000","last_fullsized":"2024-03-04T13:13:21.117978+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:08:54.656704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":221,"num_read_kb":283,"num_write":122,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"255'515","reported_seq":1897,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.249060+0000","last_change":"2024-03-04T12:20:22.852803+0000","last_active":"2024-03-04T13:13:21.249060+0000","last_peered":"2024-03-04T13:13:21.249060+0000","last_clean":"2024-03-04T13:13:21.249060+0000","last_became_active":"2024-03-04T12:20:22.852529+0000","last_became_peered":"2024-03-04T12:20:22.852529+0000","last_unstale":"2024-03-04T13:13:21.249060+0000","last_undegraded":"2024-03-04T13:13:21.249060+0000","last_fullsized":"2024-03-04T13:13:21.249060+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"255'110","reported_seq":579,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.460569+0000","last_change":"2024-03-04T12:20:24.868355+0000","last_active":"2024-03-04T13:12:27.460569+0000","last_peered":"2024-03-04T13:12:27.460569+0000","last_clean":"2024-03-04T13:12:27.460569+0000","last_became_active":"2024-03-04T12:20:24.868076+0000","last_became_peered":"2024-03-04T12:20:24.868076+0000","last_unstale":"2024-03-04T13:12:27.460569+0000","last_undegraded":"2024-03-04T13:12:27.460569+0000","last_fullsized":"2024-03-04T13:12:27.460569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"255'360","reported_seq":1758,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.444905+0000","last_change":"2024-03-04T12:20:16.829010+0000","last_active":"2024-03-04T13:12:39.444905+0000","last_peered":"2024-03-04T13:12:39.444905+0000","last_clean":"2024-03-04T13:12:39.444905+0000","last_became_active":"2024-03-04T12:20:16.828738+0000","last_became_peered":"2024-03-04T12:20:16.828738+0000","last_unstale":"2024-03-04T13:12:39.444905+0000","last_undegraded":"2024-03-04T13:12:39.444905+0000","last_fullsized":"2024-03-04T13:12:39.444905+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1878,"num_read_kb":1794,"num_write":404,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"255'280","reported_seq":1007,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.196031+0000","last_change":"2024-03-04T12:20:14.824611+0000","last_active":"2024-03-04T13:13:21.196031+0000","last_peered":"2024-03-04T13:13:21.196031+0000","last_clean":"2024-03-04T13:13:21.196031+0000","last_became_active":"2024-03-04T12:20:14.824192+0000","last_became_peered":"2024-03-04T12:20:14.824192+0000","last_unstale":"2024-03-04T13:13:21.196031+0000","last_undegraded":"2024-03-04T13:13:21.196031+0000","last_fullsized":"2024-03-04T13:13:21.196031+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:58:08.994156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":790,"num_read_kb":21513,"num_write":1394,"num_write_kb":41658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.454222+0000","last_change":"2024-03-04T12:20:18.832777+0000","last_active":"2024-03-04T13:12:27.454222+0000","last_peered":"2024-03-04T13:12:27.454222+0000","last_clean":"2024-03-04T13:12:27.454222+0000","last_became_active":"2024-03-04T12:20:18.832483+0000","last_became_peered":"2024-03-04T12:20:18.832483+0000","last_unstale":"2024-03-04T13:12:27.454222+0000","last_undegraded":"2024-03-04T13:12:27.454222+0000","last_fullsized":"2024-03-04T13:12:27.454222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"255'190","reported_seq":805,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.224983+0000","last_change":"2024-03-04T12:20:20.838146+0000","last_active":"2024-03-04T13:13:21.224983+0000","last_peered":"2024-03-04T13:13:21.224983+0000","last_clean":"2024-03-04T13:13:21.224983+0000","last_became_active":"2024-03-04T12:20:20.837748+0000","last_became_peered":"2024-03-04T12:20:20.837748+0000","last_unstale":"2024-03-04T13:13:21.224983+0000","last_undegraded":"2024-03-04T13:13:21.224983+0000","last_fullsized":"2024-03-04T13:13:21.224983+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13702,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":270,"num_read_kb":346,"num_write":130,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.453696+0000","last_change":"2024-03-04T12:20:22.850065+0000","last_active":"2024-03-04T13:12:22.453696+0000","last_peered":"2024-03-04T13:12:22.453696+0000","last_clean":"2024-03-04T13:12:22.453696+0000","last_became_active":"2024-03-04T12:20:22.849784+0000","last_became_peered":"2024-03-04T12:20:22.849784+0000","last_unstale":"2024-03-04T13:12:22.453696+0000","last_undegraded":"2024-03-04T13:12:22.453696+0000","last_fullsized":"2024-03-04T13:12:22.453696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"255'99","reported_seq":609,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.557321+0000","last_change":"2024-03-04T12:20:24.865119+0000","last_active":"2024-03-04T13:12:27.557321+0000","last_peered":"2024-03-04T13:12:27.557321+0000","last_clean":"2024-03-04T13:12:27.557321+0000","last_became_active":"2024-03-04T12:20:24.864820+0000","last_became_peered":"2024-03-04T12:20:24.864820+0000","last_unstale":"2024-03-04T13:12:27.557321+0000","last_undegraded":"2024-03-04T13:12:27.557321+0000","last_fullsized":"2024-03-04T13:12:27.557321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":165,"num_write":238,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"255'1121","reported_seq":2624,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:15.775415+0000","last_change":"2024-03-04T12:20:16.828787+0000","last_active":"2024-03-04T13:12:15.775415+0000","last_peered":"2024-03-04T13:12:15.775415+0000","last_clean":"2024-03-04T13:12:15.775415+0000","last_became_active":"2024-03-04T12:20:16.828486+0000","last_became_peered":"2024-03-04T12:20:16.828486+0000","last_unstale":"2024-03-04T13:12:15.775415+0000","last_undegraded":"2024-03-04T13:12:15.775415+0000","last_fullsized":"2024-03-04T13:12:15.775415+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4686,"num_read_kb":4085,"num_write":1549,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"255'242","reported_seq":878,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.228399+0000","last_change":"2024-03-04T12:20:14.817073+0000","last_active":"2024-03-04T13:13:21.228399+0000","last_peered":"2024-03-04T13:13:21.228399+0000","last_clean":"2024-03-04T13:13:21.228399+0000","last_became_active":"2024-03-04T12:20:14.816412+0000","last_became_peered":"2024-03-04T12:20:14.816412+0000","last_unstale":"2024-03-04T13:13:21.228399+0000","last_undegraded":"2024-03-04T13:13:21.228399+0000","last_fullsized":"2024-03-04T13:13:21.228399+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399147,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":515,"num_read_kb":1880,"num_write":1395,"num_write_kb":20590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":486,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.452298+0000","last_change":"2024-03-04T12:20:18.831057+0000","last_active":"2024-03-04T13:12:07.452298+0000","last_peered":"2024-03-04T13:12:07.452298+0000","last_clean":"2024-03-04T13:12:07.452298+0000","last_became_active":"2024-03-04T12:20:18.830763+0000","last_became_peered":"2024-03-04T12:20:18.830763+0000","last_unstale":"2024-03-04T13:12:07.452298+0000","last_undegraded":"2024-03-04T13:12:07.452298+0000","last_fullsized":"2024-03-04T13:12:07.452298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"255'156","reported_seq":726,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.230678+0000","last_change":"2024-03-04T12:20:20.842557+0000","last_active":"2024-03-04T13:13:21.230678+0000","last_peered":"2024-03-04T13:13:21.230678+0000","last_clean":"2024-03-04T13:13:21.230678+0000","last_became_active":"2024-03-04T12:20:20.842216+0000","last_became_peered":"2024-03-04T12:20:20.842216+0000","last_unstale":"2024-03-04T13:13:21.230678+0000","last_undegraded":"2024-03-04T13:13:21.230678+0000","last_fullsized":"2024-03-04T13:13:21.230678+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7566,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":219,"num_read_kb":283,"num_write":166,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":472,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.458889+0000","last_change":"2024-03-04T12:20:22.855807+0000","last_active":"2024-03-04T13:12:12.458889+0000","last_peered":"2024-03-04T13:12:12.458889+0000","last_clean":"2024-03-04T13:12:12.458889+0000","last_became_active":"2024-03-04T12:20:22.855480+0000","last_became_peered":"2024-03-04T12:20:22.855480+0000","last_unstale":"2024-03-04T13:12:12.458889+0000","last_undegraded":"2024-03-04T13:12:12.458889+0000","last_fullsized":"2024-03-04T13:12:12.458889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"255'88","reported_seq":563,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:32.467609+0000","last_change":"2024-03-04T12:20:24.865258+0000","last_active":"2024-03-04T13:12:32.467609+0000","last_peered":"2024-03-04T13:12:32.467609+0000","last_clean":"2024-03-04T13:12:32.467609+0000","last_became_active":"2024-03-04T12:20:24.864982+0000","last_became_peered":"2024-03-04T12:20:24.864982+0000","last_unstale":"2024-03-04T13:12:32.467609+0000","last_undegraded":"2024-03-04T13:12:32.467609+0000","last_fullsized":"2024-03-04T13:12:32.467609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":209,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"255'386","reported_seq":1737,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.591045+0000","last_change":"2024-03-04T12:20:16.826836+0000","last_active":"2024-03-04T13:12:50.591045+0000","last_peered":"2024-03-04T13:12:50.591045+0000","last_clean":"2024-03-04T13:12:50.591045+0000","last_became_active":"2024-03-04T12:20:16.824033+0000","last_became_peered":"2024-03-04T12:20:16.824033+0000","last_unstale":"2024-03-04T13:12:50.591045+0000","last_undegraded":"2024-03-04T13:12:50.591045+0000","last_fullsized":"2024-03-04T13:12:50.591045+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1899,"num_read_kb":1781,"num_write":448,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"255'222","reported_seq":837,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.173651+0000","last_change":"2024-03-04T12:20:14.818954+0000","last_active":"2024-03-04T13:13:21.173651+0000","last_peered":"2024-03-04T13:13:21.173651+0000","last_clean":"2024-03-04T13:13:21.173651+0000","last_became_active":"2024-03-04T12:20:14.818461+0000","last_became_peered":"2024-03-04T12:20:14.818461+0000","last_unstale":"2024-03-04T13:13:21.173651+0000","last_undegraded":"2024-03-04T13:13:21.173651+0000","last_fullsized":"2024-03-04T13:13:21.173651+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:54:12.327719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":446,"num_read_kb":17082,"num_write":1054,"num_write_kb":47848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":486,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.555017+0000","last_change":"2024-03-04T12:20:18.837780+0000","last_active":"2024-03-04T13:12:07.555017+0000","last_peered":"2024-03-04T13:12:07.555017+0000","last_clean":"2024-03-04T13:12:07.555017+0000","last_became_active":"2024-03-04T12:20:18.837494+0000","last_became_peered":"2024-03-04T12:20:18.837494+0000","last_unstale":"2024-03-04T13:12:07.555017+0000","last_undegraded":"2024-03-04T13:12:07.555017+0000","last_fullsized":"2024-03-04T13:12:07.555017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"255'172","reported_seq":750,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.186132+0000","last_change":"2024-03-04T12:20:20.842124+0000","last_active":"2024-03-04T13:13:21.186132+0000","last_peered":"2024-03-04T13:13:21.186132+0000","last_clean":"2024-03-04T13:13:21.186132+0000","last_became_active":"2024-03-04T12:20:20.841801+0000","last_became_peered":"2024-03-04T12:20:20.841801+0000","last_unstale":"2024-03-04T13:13:21.186132+0000","last_undegraded":"2024-03-04T13:13:21.186132+0000","last_fullsized":"2024-03-04T13:13:21.186132+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7601,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":303,"num_write":134,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"255'492","reported_seq":1886,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.245242+0000","last_change":"2024-03-04T12:20:22.857881+0000","last_active":"2024-03-04T13:13:21.245242+0000","last_peered":"2024-03-04T13:13:21.245242+0000","last_clean":"2024-03-04T13:13:21.245242+0000","last_became_active":"2024-03-04T12:20:22.857578+0000","last_became_peered":"2024-03-04T12:20:22.857578+0000","last_unstale":"2024-03-04T13:13:21.245242+0000","last_undegraded":"2024-03-04T13:13:21.245242+0000","last_fullsized":"2024-03-04T13:13:21.245242+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"255'108","reported_seq":591,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:32.557775+0000","last_change":"2024-03-04T12:20:24.867786+0000","last_active":"2024-03-04T13:12:32.557775+0000","last_peered":"2024-03-04T13:12:32.557775+0000","last_clean":"2024-03-04T13:12:32.557775+0000","last_became_active":"2024-03-04T12:20:24.867482+0000","last_became_peered":"2024-03-04T12:20:24.867482+0000","last_unstale":"2024-03-04T13:12:32.557775+0000","last_undegraded":"2024-03-04T13:12:32.557775+0000","last_fullsized":"2024-03-04T13:12:32.557775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":731,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":256,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"255'343","reported_seq":1944,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.077672+0000","last_change":"2024-03-04T12:20:16.819106+0000","last_active":"2024-03-04T13:12:18.077672+0000","last_peered":"2024-03-04T13:12:18.077672+0000","last_clean":"2024-03-04T13:12:18.077672+0000","last_became_active":"2024-03-04T12:20:16.818795+0000","last_became_peered":"2024-03-04T12:20:16.818795+0000","last_unstale":"2024-03-04T13:12:18.077672+0000","last_undegraded":"2024-03-04T13:12:18.077672+0000","last_fullsized":"2024-03-04T13:12:18.077672+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2162,"num_read_kb":2105,"num_write":376,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"255'220","reported_seq":840,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.221263+0000","last_change":"2024-03-04T12:20:14.818157+0000","last_active":"2024-03-04T13:13:21.221263+0000","last_peered":"2024-03-04T13:13:21.221263+0000","last_clean":"2024-03-04T13:13:21.221263+0000","last_became_active":"2024-03-04T12:20:14.817859+0000","last_became_peered":"2024-03-04T12:20:14.817859+0000","last_unstale":"2024-03-04T13:13:21.221263+0000","last_undegraded":"2024-03-04T13:13:21.221263+0000","last_fullsized":"2024-03-04T13:13:21.221263+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":387,"num_read_kb":14098,"num_write":1105,"num_write_kb":34013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":1101,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.713803+0000","last_change":"2024-03-04T12:20:18.839281+0000","last_active":"2024-03-04T13:13:20.713803+0000","last_peered":"2024-03-04T13:13:20.713803+0000","last_clean":"2024-03-04T13:13:20.713803+0000","last_became_active":"2024-03-04T12:20:18.838389+0000","last_became_peered":"2024-03-04T12:20:18.838389+0000","last_unstale":"2024-03-04T13:13:20.713803+0000","last_undegraded":"2024-03-04T13:13:20.713803+0000","last_fullsized":"2024-03-04T13:13:20.713803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:25:57.735142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":615,"num_read_kb":615,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"255'101","reported_seq":609,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.464788+0000","last_change":"2024-03-04T12:20:21.642158+0000","last_active":"2024-03-04T13:12:07.464788+0000","last_peered":"2024-03-04T13:12:07.464788+0000","last_clean":"2024-03-04T13:12:07.464788+0000","last_became_active":"2024-03-04T12:20:21.641809+0000","last_became_peered":"2024-03-04T12:20:21.641809+0000","last_unstale":"2024-03-04T13:12:07.464788+0000","last_undegraded":"2024-03-04T13:12:07.464788+0000","last_fullsized":"2024-03-04T13:12:07.464788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":103,"num_read_kb":92,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"255'498","reported_seq":2278,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.937077+0000","last_change":"2024-03-04T12:20:22.849616+0000","last_active":"2024-03-04T13:13:20.937077+0000","last_peered":"2024-03-04T13:13:20.937077+0000","last_clean":"2024-03-04T13:13:20.937077+0000","last_became_active":"2024-03-04T12:20:22.849288+0000","last_became_peered":"2024-03-04T12:20:22.849288+0000","last_unstale":"2024-03-04T13:13:20.937077+0000","last_undegraded":"2024-03-04T13:13:20.937077+0000","last_fullsized":"2024-03-04T13:13:20.937077+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:38:12.869906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"255'87","reported_seq":572,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:32.522269+0000","last_change":"2024-03-04T12:20:24.870938+0000","last_active":"2024-03-04T13:12:32.522269+0000","last_peered":"2024-03-04T13:12:32.522269+0000","last_clean":"2024-03-04T13:12:32.522269+0000","last_became_active":"2024-03-04T12:20:24.870568+0000","last_became_peered":"2024-03-04T12:20:24.870568+0000","last_unstale":"2024-03-04T13:12:32.522269+0000","last_undegraded":"2024-03-04T13:12:32.522269+0000","last_fullsized":"2024-03-04T13:12:32.522269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":82,"num_read_kb":81,"num_write":219,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"255'297","reported_seq":1656,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.772629+0000","last_change":"2024-03-04T12:20:16.831299+0000","last_active":"2024-03-04T13:12:12.772629+0000","last_peered":"2024-03-04T13:12:12.772629+0000","last_clean":"2024-03-04T13:12:12.772629+0000","last_became_active":"2024-03-04T12:20:16.831001+0000","last_became_peered":"2024-03-04T12:20:16.831001+0000","last_unstale":"2024-03-04T13:12:12.772629+0000","last_undegraded":"2024-03-04T13:12:12.772629+0000","last_fullsized":"2024-03-04T13:12:12.772629+0000","mapping_epoch":22,"log_start":"255'200","ondisk_log_start":"255'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1692,"num_read_kb":1639,"num_write":326,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"255'199","reported_seq":822,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.222514+0000","last_change":"2024-03-04T12:20:14.813162+0000","last_active":"2024-03-04T13:13:21.222514+0000","last_peered":"2024-03-04T13:13:21.222514+0000","last_clean":"2024-03-04T13:13:21.222514+0000","last_became_active":"2024-03-04T12:20:14.812881+0000","last_became_peered":"2024-03-04T12:20:14.812881+0000","last_unstale":"2024-03-04T13:13:21.222514+0000","last_undegraded":"2024-03-04T13:13:21.222514+0000","last_fullsized":"2024-03-04T13:13:21.222514+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6401060,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":24185,"num_write":1082,"num_write_kb":42346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.517781+0000","last_change":"2024-03-04T12:20:18.836790+0000","last_active":"2024-03-04T13:12:07.517781+0000","last_peered":"2024-03-04T13:12:07.517781+0000","last_clean":"2024-03-04T13:12:07.517781+0000","last_became_active":"2024-03-04T12:20:18.836493+0000","last_became_peered":"2024-03-04T12:20:18.836493+0000","last_unstale":"2024-03-04T13:12:07.517781+0000","last_undegraded":"2024-03-04T13:12:07.517781+0000","last_fullsized":"2024-03-04T13:12:07.517781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"255'249","reported_seq":846,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.074245+0000","last_change":"2024-03-04T12:20:20.839419+0000","last_active":"2024-03-04T13:13:21.074245+0000","last_peered":"2024-03-04T13:13:21.074245+0000","last_clean":"2024-03-04T13:13:21.074245+0000","last_became_active":"2024-03-04T12:20:20.839079+0000","last_became_peered":"2024-03-04T12:20:20.839079+0000","last_unstale":"2024-03-04T13:13:21.074245+0000","last_undegraded":"2024-03-04T13:13:21.074245+0000","last_fullsized":"2024-03-04T13:13:21.074245+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:59:03.433466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7172,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":931,"num_read_kb":985,"num_write":1462,"num_write_kb":1319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:52.476116+0000","last_change":"2024-03-04T12:20:22.855248+0000","last_active":"2024-03-04T13:09:52.476116+0000","last_peered":"2024-03-04T13:09:52.476116+0000","last_clean":"2024-03-04T13:09:52.476116+0000","last_became_active":"2024-03-04T12:20:22.854860+0000","last_became_peered":"2024-03-04T12:20:22.854860+0000","last_unstale":"2024-03-04T13:09:52.476116+0000","last_undegraded":"2024-03-04T13:09:52.476116+0000","last_fullsized":"2024-03-04T13:09:52.476116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:11.625286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"255'104","reported_seq":585,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:32.557821+0000","last_change":"2024-03-04T12:20:24.866168+0000","last_active":"2024-03-04T13:12:32.557821+0000","last_peered":"2024-03-04T13:12:32.557821+0000","last_clean":"2024-03-04T13:12:32.557821+0000","last_became_active":"2024-03-04T12:20:24.865830+0000","last_became_peered":"2024-03-04T12:20:24.865830+0000","last_unstale":"2024-03-04T13:12:32.557821+0000","last_undegraded":"2024-03-04T13:12:32.557821+0000","last_fullsized":"2024-03-04T13:12:32.557821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":242,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"255'318","reported_seq":1695,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.078010+0000","last_change":"2024-03-04T12:20:16.821797+0000","last_active":"2024-03-04T13:12:18.078010+0000","last_peered":"2024-03-04T13:12:18.078010+0000","last_clean":"2024-03-04T13:12:18.078010+0000","last_became_active":"2024-03-04T12:20:16.821495+0000","last_became_peered":"2024-03-04T12:20:16.821495+0000","last_unstale":"2024-03-04T13:12:18.078010+0000","last_undegraded":"2024-03-04T13:12:18.078010+0000","last_fullsized":"2024-03-04T13:12:18.078010+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:21:21.722236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1811,"num_read_kb":1736,"num_write":364,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":664,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.497781+0000","last_change":"2024-03-04T12:19:58.807747+0000","last_active":"2024-03-04T13:10:12.497781+0000","last_peered":"2024-03-04T13:10:12.497781+0000","last_clean":"2024-03-04T13:10:12.497781+0000","last_became_active":"2024-03-04T12:19:58.806723+0000","last_became_peered":"2024-03-04T12:19:58.806723+0000","last_unstale":"2024-03-04T13:10:12.497781+0000","last_undegraded":"2024-03-04T13:10:12.497781+0000","last_fullsized":"2024-03-04T13:10:12.497781+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:19:57.750293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:19:57.750293+0000","last_clean_scrub_stamp":"2024-03-04T12:19:57.750293+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:53:17.368805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":500,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.353364+0000","last_change":"2024-03-04T12:20:05.783212+0000","last_active":"2024-03-04T13:10:07.353364+0000","last_peered":"2024-03-04T13:10:07.353364+0000","last_clean":"2024-03-04T13:10:07.353364+0000","last_became_active":"2024-03-04T12:20:05.782921+0000","last_became_peered":"2024-03-04T12:20:05.782921+0000","last_unstale":"2024-03-04T13:10:07.353364+0000","last_undegraded":"2024-03-04T13:10:07.353364+0000","last_fullsized":"2024-03-04T13:10:07.353364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:47.241725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"255'172","reported_seq":786,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.220723+0000","last_change":"2024-03-04T12:20:51.032035+0000","last_active":"2024-03-04T13:13:21.220723+0000","last_peered":"2024-03-04T13:13:21.220723+0000","last_clean":"2024-03-04T13:13:21.220723+0000","last_became_active":"2024-03-04T12:20:51.031720+0000","last_became_peered":"2024-03-04T12:20:51.031720+0000","last_unstale":"2024-03-04T13:13:21.220723+0000","last_undegraded":"2024-03-04T13:13:21.220723+0000","last_fullsized":"2024-03-04T13:13:21.220723+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263538,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":417,"num_read_kb":68206,"num_write":949,"num_write_kb":44048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":493,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499605+0000","last_change":"2024-03-04T12:20:18.830022+0000","last_active":"2024-03-04T13:10:22.499605+0000","last_peered":"2024-03-04T13:10:22.499605+0000","last_clean":"2024-03-04T13:10:22.499605+0000","last_became_active":"2024-03-04T12:20:18.829703+0000","last_became_peered":"2024-03-04T12:20:18.829703+0000","last_unstale":"2024-03-04T13:10:22.499605+0000","last_undegraded":"2024-03-04T13:10:22.499605+0000","last_fullsized":"2024-03-04T13:10:22.499605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:01:37.596430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"255'312","reported_seq":1000,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.167644+0000","last_change":"2024-03-04T12:20:20.842756+0000","last_active":"2024-03-04T13:13:21.167644+0000","last_peered":"2024-03-04T13:13:21.167644+0000","last_clean":"2024-03-04T13:13:21.167644+0000","last_became_active":"2024-03-04T12:20:20.842433+0000","last_became_peered":"2024-03-04T12:20:20.842433+0000","last_unstale":"2024-03-04T13:13:21.167644+0000","last_undegraded":"2024-03-04T13:13:21.167644+0000","last_fullsized":"2024-03-04T13:13:21.167644+0000","mapping_epoch":26,"log_start":"255'300","ondisk_log_start":"255'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:13:17.760985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34072,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":590,"num_read_kb":823,"num_write":540,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":473,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.459969+0000","last_change":"2024-03-04T12:20:22.849592+0000","last_active":"2024-03-04T13:12:22.459969+0000","last_peered":"2024-03-04T13:12:22.459969+0000","last_clean":"2024-03-04T13:12:22.459969+0000","last_became_active":"2024-03-04T12:20:22.849274+0000","last_became_peered":"2024-03-04T12:20:22.849274+0000","last_unstale":"2024-03-04T13:12:22.459969+0000","last_undegraded":"2024-03-04T13:12:22.459969+0000","last_fullsized":"2024-03-04T13:12:22.459969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"255'108","reported_seq":598,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.765516+0000","last_change":"2024-03-04T12:20:24.865055+0000","last_active":"2024-03-04T13:11:27.765516+0000","last_peered":"2024-03-04T13:11:27.765516+0000","last_clean":"2024-03-04T13:11:27.765516+0000","last_became_active":"2024-03-04T12:20:24.864796+0000","last_became_peered":"2024-03-04T12:20:24.864796+0000","last_unstale":"2024-03-04T13:11:27.765516+0000","last_undegraded":"2024-03-04T13:11:27.765516+0000","last_fullsized":"2024-03-04T13:11:27.765516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:46:49.314439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":748,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":267,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"255'391","reported_seq":1915,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.327779+0000","last_change":"2024-03-04T12:20:16.836409+0000","last_active":"2024-03-04T13:12:39.327779+0000","last_peered":"2024-03-04T13:12:39.327779+0000","last_clean":"2024-03-04T13:12:39.327779+0000","last_became_active":"2024-03-04T12:20:16.836050+0000","last_became_peered":"2024-03-04T12:20:16.836050+0000","last_unstale":"2024-03-04T13:12:39.327779+0000","last_undegraded":"2024-03-04T13:12:39.327779+0000","last_fullsized":"2024-03-04T13:12:39.327779+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2110,"num_read_kb":2020,"num_write":444,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":508,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498621+0000","last_change":"2024-03-04T12:20:05.781479+0000","last_active":"2024-03-04T13:10:17.498621+0000","last_peered":"2024-03-04T13:10:17.498621+0000","last_clean":"2024-03-04T13:10:17.498621+0000","last_became_active":"2024-03-04T12:20:05.781199+0000","last_became_peered":"2024-03-04T12:20:05.781199+0000","last_unstale":"2024-03-04T13:10:17.498621+0000","last_undegraded":"2024-03-04T13:10:17.498621+0000","last_fullsized":"2024-03-04T13:10:17.498621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:37:44.684083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"255'204","reported_seq":829,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.122048+0000","last_change":"2024-03-04T12:20:14.821799+0000","last_active":"2024-03-04T13:13:21.122048+0000","last_peered":"2024-03-04T13:13:21.122048+0000","last_clean":"2024-03-04T13:13:21.122048+0000","last_became_active":"2024-03-04T12:20:14.821540+0000","last_became_peered":"2024-03-04T12:20:14.821540+0000","last_unstale":"2024-03-04T13:13:21.122048+0000","last_undegraded":"2024-03-04T13:13:21.122048+0000","last_fullsized":"2024-03-04T13:13:21.122048+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":43110,"num_write":1111,"num_write_kb":41335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.354153+0000","last_change":"2024-03-04T12:20:18.836025+0000","last_active":"2024-03-04T13:10:12.354153+0000","last_peered":"2024-03-04T13:10:12.354153+0000","last_clean":"2024-03-04T13:10:12.354153+0000","last_became_active":"2024-03-04T12:20:18.835509+0000","last_became_peered":"2024-03-04T12:20:18.835509+0000","last_unstale":"2024-03-04T13:10:12.354153+0000","last_undegraded":"2024-03-04T13:10:12.354153+0000","last_fullsized":"2024-03-04T13:10:12.354153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:20.235577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"255'707","reported_seq":2182,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.241375+0000","last_change":"2024-03-04T12:20:20.838876+0000","last_active":"2024-03-04T13:13:21.241375+0000","last_peered":"2024-03-04T13:13:21.241375+0000","last_clean":"2024-03-04T13:13:21.241375+0000","last_became_active":"2024-03-04T12:20:20.838633+0000","last_became_peered":"2024-03-04T12:20:20.838633+0000","last_unstale":"2024-03-04T13:13:21.241375+0000","last_undegraded":"2024-03-04T13:13:21.241375+0000","last_fullsized":"2024-03-04T13:13:21.241375+0000","mapping_epoch":26,"log_start":"255'600","ondisk_log_start":"255'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24617,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":974,"num_read_kb":1199,"num_write":350,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:32.501338+0000","last_change":"2024-03-04T12:20:22.848790+0000","last_active":"2024-03-04T13:10:32.501338+0000","last_peered":"2024-03-04T13:10:32.501338+0000","last_clean":"2024-03-04T13:10:32.501338+0000","last_became_active":"2024-03-04T12:20:22.848403+0000","last_became_peered":"2024-03-04T12:20:22.848403+0000","last_unstale":"2024-03-04T13:10:32.501338+0000","last_undegraded":"2024-03-04T13:10:32.501338+0000","last_fullsized":"2024-03-04T13:10:32.501338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:12:33.606788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"255'84","reported_seq":572,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.805266+0000","last_change":"2024-03-04T12:20:24.911878+0000","last_active":"2024-03-04T13:12:34.805266+0000","last_peered":"2024-03-04T13:12:34.805266+0000","last_clean":"2024-03-04T13:12:34.805266+0000","last_became_active":"2024-03-04T12:20:24.911303+0000","last_became_peered":"2024-03-04T12:20:24.911303+0000","last_unstale":"2024-03-04T13:12:34.805266+0000","last_undegraded":"2024-03-04T13:12:34.805266+0000","last_fullsized":"2024-03-04T13:12:34.805266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":85,"num_write":192,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"255'417","reported_seq":2051,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.594152+0000","last_change":"2024-03-04T12:20:16.828170+0000","last_active":"2024-03-04T13:12:50.594152+0000","last_peered":"2024-03-04T13:12:50.594152+0000","last_clean":"2024-03-04T13:12:50.594152+0000","last_became_active":"2024-03-04T12:20:16.827513+0000","last_became_peered":"2024-03-04T12:20:16.827513+0000","last_unstale":"2024-03-04T13:12:50.594152+0000","last_undegraded":"2024-03-04T13:12:50.594152+0000","last_fullsized":"2024-03-04T13:12:50.594152+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2343,"num_read_kb":2241,"num_write":475,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":502,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.452750+0000","last_change":"2024-03-04T12:20:05.864062+0000","last_active":"2024-03-04T13:12:12.452750+0000","last_peered":"2024-03-04T13:12:12.452750+0000","last_clean":"2024-03-04T13:12:12.452750+0000","last_became_active":"2024-03-04T12:20:05.863125+0000","last_became_peered":"2024-03-04T12:20:05.863125+0000","last_unstale":"2024-03-04T13:12:12.452750+0000","last_undegraded":"2024-03-04T13:12:12.452750+0000","last_fullsized":"2024-03-04T13:12:12.452750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"255'167","reported_seq":749,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.220223+0000","last_change":"2024-03-04T12:20:14.813050+0000","last_active":"2024-03-04T13:13:21.220223+0000","last_peered":"2024-03-04T13:13:21.220223+0000","last_clean":"2024-03-04T13:13:21.220223+0000","last_became_active":"2024-03-04T12:20:14.812722+0000","last_became_peered":"2024-03-04T12:20:14.812722+0000","last_unstale":"2024-03-04T13:13:21.220223+0000","last_undegraded":"2024-03-04T13:13:21.220223+0000","last_fullsized":"2024-03-04T13:13:21.220223+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1982965,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":309,"num_read_kb":18084,"num_write":975,"num_write_kb":46336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":488,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.453773+0000","last_change":"2024-03-04T12:20:18.839341+0000","last_active":"2024-03-04T13:12:22.453773+0000","last_peered":"2024-03-04T13:12:22.453773+0000","last_clean":"2024-03-04T13:12:22.453773+0000","last_became_active":"2024-03-04T12:20:18.839038+0000","last_became_peered":"2024-03-04T12:20:18.839038+0000","last_unstale":"2024-03-04T13:12:22.453773+0000","last_undegraded":"2024-03-04T13:12:22.453773+0000","last_fullsized":"2024-03-04T13:12:22.453773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"255'245","reported_seq":1416,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.332033+0000","last_change":"2024-03-04T12:20:21.643795+0000","last_active":"2024-03-04T13:13:14.332033+0000","last_peered":"2024-03-04T13:13:14.332033+0000","last_clean":"2024-03-04T13:13:14.332033+0000","last_became_active":"2024-03-04T12:20:21.643475+0000","last_became_peered":"2024-03-04T12:20:21.643475+0000","last_unstale":"2024-03-04T13:13:14.332033+0000","last_undegraded":"2024-03-04T13:13:14.332033+0000","last_fullsized":"2024-03-04T13:13:14.332033+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:03:47.701687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":203,"num_write":195,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":474,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.460533+0000","last_change":"2024-03-04T12:20:22.854718+0000","last_active":"2024-03-04T13:12:27.460533+0000","last_peered":"2024-03-04T13:12:27.460533+0000","last_clean":"2024-03-04T13:12:27.460533+0000","last_became_active":"2024-03-04T12:20:22.854343+0000","last_became_peered":"2024-03-04T12:20:22.854343+0000","last_unstale":"2024-03-04T13:12:27.460533+0000","last_undegraded":"2024-03-04T13:12:27.460533+0000","last_fullsized":"2024-03-04T13:12:27.460533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"255'188","reported_seq":700,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.465345+0000","last_change":"2024-03-04T12:20:24.871310+0000","last_active":"2024-03-04T13:12:12.465345+0000","last_peered":"2024-03-04T13:12:12.465345+0000","last_clean":"2024-03-04T13:12:12.465345+0000","last_became_active":"2024-03-04T12:20:24.871020+0000","last_became_peered":"2024-03-04T12:20:24.871020+0000","last_unstale":"2024-03-04T13:12:12.465345+0000","last_undegraded":"2024-03-04T13:12:12.465345+0000","last_fullsized":"2024-03-04T13:12:12.465345+0000","mapping_epoch":30,"log_start":"250'100","ondisk_log_start":"250'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":353,"num_read_kb":362,"num_write":419,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"255'387","reported_seq":1853,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.971813+0000","last_change":"2024-03-04T12:20:16.825718+0000","last_active":"2024-03-04T13:12:36.971813+0000","last_peered":"2024-03-04T13:12:36.971813+0000","last_clean":"2024-03-04T13:12:36.971813+0000","last_became_active":"2024-03-04T12:20:16.825006+0000","last_became_peered":"2024-03-04T12:20:16.825006+0000","last_unstale":"2024-03-04T13:12:36.971813+0000","last_undegraded":"2024-03-04T13:12:36.971813+0000","last_fullsized":"2024-03-04T13:12:36.971813+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2027,"num_read_kb":1928,"num_write":438,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":500,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:07.353341+0000","last_change":"2024-03-04T12:20:05.783217+0000","last_active":"2024-03-04T13:10:07.353341+0000","last_peered":"2024-03-04T13:10:07.353341+0000","last_clean":"2024-03-04T13:10:07.353341+0000","last_became_active":"2024-03-04T12:20:05.782897+0000","last_became_peered":"2024-03-04T12:20:05.782897+0000","last_unstale":"2024-03-04T13:10:07.353341+0000","last_undegraded":"2024-03-04T13:10:07.353341+0000","last_fullsized":"2024-03-04T13:10:07.353341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:51:54.079894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"255'200","reported_seq":875,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.234821+0000","last_change":"2024-03-04T12:20:14.825079+0000","last_active":"2024-03-04T13:13:21.234821+0000","last_peered":"2024-03-04T13:13:21.234821+0000","last_clean":"2024-03-04T13:13:21.234821+0000","last_became_active":"2024-03-04T12:20:14.824810+0000","last_became_peered":"2024-03-04T12:20:14.824810+0000","last_unstale":"2024-03-04T13:13:21.234821+0000","last_undegraded":"2024-03-04T13:13:21.234821+0000","last_fullsized":"2024-03-04T13:13:21.234821+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3544974,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":19088,"num_write":1144,"num_write_kb":38256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:32.461088+0000","last_change":"2024-03-04T12:20:18.833327+0000","last_active":"2024-03-04T13:12:32.461088+0000","last_peered":"2024-03-04T13:12:32.461088+0000","last_clean":"2024-03-04T13:12:32.461088+0000","last_became_active":"2024-03-04T12:20:18.833051+0000","last_became_peered":"2024-03-04T12:20:18.833051+0000","last_unstale":"2024-03-04T13:12:32.461088+0000","last_undegraded":"2024-03-04T13:12:32.461088+0000","last_fullsized":"2024-03-04T13:12:32.461088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"255'125","reported_seq":655,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.466544+0000","last_change":"2024-03-04T12:20:20.845424+0000","last_active":"2024-03-04T13:12:22.466544+0000","last_peered":"2024-03-04T13:12:22.466544+0000","last_clean":"2024-03-04T13:12:22.466544+0000","last_became_active":"2024-03-04T12:20:20.845192+0000","last_became_peered":"2024-03-04T12:20:20.845192+0000","last_unstale":"2024-03-04T13:12:22.466544+0000","last_undegraded":"2024-03-04T13:12:22.466544+0000","last_fullsized":"2024-03-04T13:12:22.466544+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":155,"num_read_kb":149,"num_write":110,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:12.478882+0000","last_change":"2024-03-04T12:20:22.853030+0000","last_active":"2024-03-04T13:10:12.478882+0000","last_peered":"2024-03-04T13:10:12.478882+0000","last_clean":"2024-03-04T13:10:12.478882+0000","last_became_active":"2024-03-04T12:20:22.852745+0000","last_became_peered":"2024-03-04T12:20:22.852745+0000","last_unstale":"2024-03-04T13:10:12.478882+0000","last_undegraded":"2024-03-04T13:10:12.478882+0000","last_fullsized":"2024-03-04T13:10:12.478882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:47:11.374457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"255'85","reported_seq":579,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.354798+0000","last_change":"2024-03-04T12:20:24.865098+0000","last_active":"2024-03-04T13:10:17.354798+0000","last_peered":"2024-03-04T13:10:17.354798+0000","last_clean":"2024-03-04T13:10:17.354798+0000","last_became_active":"2024-03-04T12:20:24.864783+0000","last_became_peered":"2024-03-04T12:20:24.864783+0000","last_unstale":"2024-03-04T13:10:17.354798+0000","last_undegraded":"2024-03-04T13:10:17.354798+0000","last_fullsized":"2024-03-04T13:10:17.354798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:20:08.408598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":204,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"255'443","reported_seq":1901,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.326519+0000","last_change":"2024-03-04T12:20:16.827086+0000","last_active":"2024-03-04T13:12:39.326519+0000","last_peered":"2024-03-04T13:12:39.326519+0000","last_clean":"2024-03-04T13:12:39.326519+0000","last_became_active":"2024-03-04T12:20:16.826823+0000","last_became_peered":"2024-03-04T12:20:16.826823+0000","last_unstale":"2024-03-04T13:12:39.326519+0000","last_undegraded":"2024-03-04T13:12:39.326519+0000","last_fullsized":"2024-03-04T13:12:39.326519+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2302,"num_read_kb":2131,"num_write":558,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"255'158","reported_seq":753,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:09.809682+0000","last_change":"2024-03-04T12:20:14.819761+0000","last_active":"2024-03-04T13:13:09.809682+0000","last_peered":"2024-03-04T13:13:09.809682+0000","last_clean":"2024-03-04T13:13:09.809682+0000","last_became_active":"2024-03-04T12:20:14.819483+0000","last_became_peered":"2024-03-04T12:20:14.819483+0000","last_unstale":"2024-03-04T13:13:09.809682+0000","last_undegraded":"2024-03-04T13:13:09.809682+0000","last_fullsized":"2024-03-04T13:13:09.809682+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:40.255499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553728,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":336,"num_read_kb":12779,"num_write":962,"num_write_kb":35384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":502,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.555524+0000","last_change":"2024-03-04T12:20:05.863592+0000","last_active":"2024-03-04T13:12:12.555524+0000","last_peered":"2024-03-04T13:12:12.555524+0000","last_clean":"2024-03-04T13:12:12.555524+0000","last_became_active":"2024-03-04T12:20:05.863311+0000","last_became_peered":"2024-03-04T12:20:05.863311+0000","last_unstale":"2024-03-04T13:12:12.555524+0000","last_undegraded":"2024-03-04T13:12:12.555524+0000","last_fullsized":"2024-03-04T13:12:12.555524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.460519+0000","last_change":"2024-03-04T12:20:18.832677+0000","last_active":"2024-03-04T13:12:27.460519+0000","last_peered":"2024-03-04T13:12:27.460519+0000","last_clean":"2024-03-04T13:12:27.460519+0000","last_became_active":"2024-03-04T12:20:18.832355+0000","last_became_peered":"2024-03-04T12:20:18.832355+0000","last_unstale":"2024-03-04T13:12:27.460519+0000","last_undegraded":"2024-03-04T13:12:27.460519+0000","last_fullsized":"2024-03-04T13:12:27.460519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"255'260","reported_seq":910,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.176638+0000","last_change":"2024-03-04T12:20:20.842632+0000","last_active":"2024-03-04T13:13:21.176638+0000","last_peered":"2024-03-04T13:13:21.176638+0000","last_clean":"2024-03-04T13:13:21.176638+0000","last_became_active":"2024-03-04T12:20:20.842330+0000","last_became_peered":"2024-03-04T12:20:20.842330+0000","last_unstale":"2024-03-04T13:13:21.176638+0000","last_undegraded":"2024-03-04T13:13:21.176638+0000","last_fullsized":"2024-03-04T13:13:21.176638+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11717,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":373,"num_read_kb":489,"num_write":198,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":484,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.521405+0000","last_change":"2024-03-04T12:20:22.854985+0000","last_active":"2024-03-04T13:12:27.521405+0000","last_peered":"2024-03-04T13:12:27.521405+0000","last_clean":"2024-03-04T13:12:27.521405+0000","last_became_active":"2024-03-04T12:20:22.854507+0000","last_became_peered":"2024-03-04T12:20:22.854507+0000","last_unstale":"2024-03-04T13:12:27.521405+0000","last_undegraded":"2024-03-04T13:12:27.521405+0000","last_fullsized":"2024-03-04T13:12:27.521405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"255'106","reported_seq":592,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.458872+0000","last_change":"2024-03-04T12:20:24.912422+0000","last_active":"2024-03-04T13:12:12.458872+0000","last_peered":"2024-03-04T13:12:12.458872+0000","last_clean":"2024-03-04T13:12:12.458872+0000","last_became_active":"2024-03-04T12:20:24.911970+0000","last_became_peered":"2024-03-04T12:20:24.911970+0000","last_unstale":"2024-03-04T13:12:12.458872+0000","last_undegraded":"2024-03-04T13:12:12.458872+0000","last_fullsized":"2024-03-04T13:12:12.458872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":120,"num_write":241,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"255'321","reported_seq":1677,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.459921+0000","last_change":"2024-03-04T12:20:16.825499+0000","last_active":"2024-03-04T13:12:22.459921+0000","last_peered":"2024-03-04T13:12:22.459921+0000","last_clean":"2024-03-04T13:12:22.459921+0000","last_became_active":"2024-03-04T12:20:16.825241+0000","last_became_peered":"2024-03-04T12:20:16.825241+0000","last_unstale":"2024-03-04T13:12:22.459921+0000","last_undegraded":"2024-03-04T13:12:22.459921+0000","last_fullsized":"2024-03-04T13:12:22.459921+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1925,"num_read_kb":1835,"num_write":376,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"255'162","reported_seq":754,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.556660+0000","last_change":"2024-03-04T12:20:14.816111+0000","last_active":"2024-03-04T13:12:22.556660+0000","last_peered":"2024-03-04T13:12:22.556660+0000","last_clean":"2024-03-04T13:12:22.556660+0000","last_became_active":"2024-03-04T12:20:14.815589+0000","last_became_peered":"2024-03-04T12:20:14.815589+0000","last_unstale":"2024-03-04T13:12:22.556660+0000","last_undegraded":"2024-03-04T13:12:22.556660+0000","last_fullsized":"2024-03-04T13:12:22.556660+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11384047,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":367,"num_read_kb":3319,"num_write":965,"num_write_kb":11696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":507,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:17.498811+0000","last_change":"2024-03-04T12:20:05.863980+0000","last_active":"2024-03-04T13:10:17.498811+0000","last_peered":"2024-03-04T13:10:17.498811+0000","last_clean":"2024-03-04T13:10:17.498811+0000","last_became_active":"2024-03-04T12:20:05.863682+0000","last_became_peered":"2024-03-04T12:20:05.863682+0000","last_unstale":"2024-03-04T13:10:17.498811+0000","last_undegraded":"2024-03-04T13:10:17.498811+0000","last_fullsized":"2024-03-04T13:10:17.498811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:13.302689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.480354+0000","last_change":"2024-03-04T12:20:18.834213+0000","last_active":"2024-03-04T13:10:22.480354+0000","last_peered":"2024-03-04T13:10:22.480354+0000","last_clean":"2024-03-04T13:10:22.480354+0000","last_became_active":"2024-03-04T12:20:18.833896+0000","last_became_peered":"2024-03-04T12:20:18.833896+0000","last_unstale":"2024-03-04T13:10:22.480354+0000","last_undegraded":"2024-03-04T13:10:22.480354+0000","last_fullsized":"2024-03-04T13:10:22.480354+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:39:33.270747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"255'200","reported_seq":756,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.351356+0000","last_change":"2024-03-04T12:20:21.642318+0000","last_active":"2024-03-04T13:13:14.351356+0000","last_peered":"2024-03-04T13:13:14.351356+0000","last_clean":"2024-03-04T13:13:14.351356+0000","last_became_active":"2024-03-04T12:20:21.641826+0000","last_became_peered":"2024-03-04T12:20:21.641826+0000","last_unstale":"2024-03-04T13:13:14.351356+0000","last_undegraded":"2024-03-04T13:13:14.351356+0000","last_fullsized":"2024-03-04T13:13:14.351356+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":255,"num_read_kb":248,"num_write":230,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"255'535","reported_seq":4185,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.933669+0000","last_change":"2024-03-04T12:20:22.853803+0000","last_active":"2024-03-04T13:13:20.933669+0000","last_peered":"2024-03-04T13:13:20.933669+0000","last_clean":"2024-03-04T13:13:20.933669+0000","last_became_active":"2024-03-04T12:20:22.853588+0000","last_became_peered":"2024-03-04T12:20:22.853588+0000","last_unstale":"2024-03-04T13:13:20.933669+0000","last_undegraded":"2024-03-04T13:13:20.933669+0000","last_fullsized":"2024-03-04T13:13:20.933669+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:04:32.122406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"255'115","reported_seq":593,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.169462+0000","last_change":"2024-03-04T12:20:24.911411+0000","last_active":"2024-03-04T13:13:14.169462+0000","last_peered":"2024-03-04T13:13:14.169462+0000","last_clean":"2024-03-04T13:13:14.169462+0000","last_became_active":"2024-03-04T12:20:24.911103+0000","last_became_peered":"2024-03-04T12:20:24.911103+0000","last_unstale":"2024-03-04T13:13:14.169462+0000","last_undegraded":"2024-03-04T13:13:14.169462+0000","last_fullsized":"2024-03-04T13:13:14.169462+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":105,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"255'1398","reported_seq":3055,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.328474+0000","last_change":"2024-03-04T12:20:16.834067+0000","last_active":"2024-03-04T13:12:39.328474+0000","last_peered":"2024-03-04T13:12:39.328474+0000","last_clean":"2024-03-04T13:12:39.328474+0000","last_became_active":"2024-03-04T12:20:16.833689+0000","last_became_peered":"2024-03-04T12:20:16.833689+0000","last_unstale":"2024-03-04T13:12:39.328474+0000","last_undegraded":"2024-03-04T13:12:39.328474+0000","last_fullsized":"2024-03-04T13:12:39.328474+0000","mapping_epoch":22,"log_start":"255'1300","ondisk_log_start":"255'1300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":1300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5949,"num_read_kb":5124,"num_write":2086,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"255'143","reported_seq":824,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.162370+0000","last_change":"2024-03-04T12:20:14.814534+0000","last_active":"2024-03-04T13:13:21.162370+0000","last_peered":"2024-03-04T13:13:21.162370+0000","last_clean":"2024-03-04T13:13:21.162370+0000","last_became_active":"2024-03-04T12:20:14.814220+0000","last_became_peered":"2024-03-04T12:20:14.814220+0000","last_unstale":"2024-03-04T13:13:21.162370+0000","last_undegraded":"2024-03-04T13:13:21.162370+0000","last_fullsized":"2024-03-04T13:13:21.162370+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262328,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":11189,"num_write":841,"num_write_kb":14687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":501,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.555046+0000","last_change":"2024-03-04T12:20:05.784418+0000","last_active":"2024-03-04T13:12:07.555046+0000","last_peered":"2024-03-04T13:12:07.555046+0000","last_clean":"2024-03-04T13:12:07.555046+0000","last_became_active":"2024-03-04T12:20:05.784145+0000","last_became_peered":"2024-03-04T12:20:05.784145+0000","last_unstale":"2024-03-04T13:12:07.555046+0000","last_undegraded":"2024-03-04T13:12:07.555046+0000","last_fullsized":"2024-03-04T13:12:07.555046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":492,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.521384+0000","last_change":"2024-03-04T12:20:18.833379+0000","last_active":"2024-03-04T13:12:27.521384+0000","last_peered":"2024-03-04T13:12:27.521384+0000","last_clean":"2024-03-04T13:12:27.521384+0000","last_became_active":"2024-03-04T12:20:18.832932+0000","last_became_peered":"2024-03-04T12:20:18.832932+0000","last_unstale":"2024-03-04T13:12:27.521384+0000","last_undegraded":"2024-03-04T13:12:27.521384+0000","last_fullsized":"2024-03-04T13:12:27.521384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"255'109","reported_seq":642,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.521435+0000","last_change":"2024-03-04T12:20:20.841516+0000","last_active":"2024-03-04T13:12:27.521435+0000","last_peered":"2024-03-04T13:12:27.521435+0000","last_clean":"2024-03-04T13:12:27.521435+0000","last_became_active":"2024-03-04T12:20:20.841108+0000","last_became_peered":"2024-03-04T12:20:20.841108+0000","last_unstale":"2024-03-04T13:12:27.521435+0000","last_undegraded":"2024-03-04T13:12:27.521435+0000","last_fullsized":"2024-03-04T13:12:27.521435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":86,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"255'530","reported_seq":2284,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.247283+0000","last_change":"2024-03-04T12:20:22.859649+0000","last_active":"2024-03-04T13:13:21.247283+0000","last_peered":"2024-03-04T13:13:21.247283+0000","last_clean":"2024-03-04T13:13:21.247283+0000","last_became_active":"2024-03-04T12:20:22.859306+0000","last_became_peered":"2024-03-04T12:20:22.859306+0000","last_unstale":"2024-03-04T13:13:21.247283+0000","last_undegraded":"2024-03-04T13:13:21.247283+0000","last_fullsized":"2024-03-04T13:13:21.247283+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"255'153","reported_seq":635,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.458826+0000","last_change":"2024-03-04T12:20:24.866096+0000","last_active":"2024-03-04T13:12:12.458826+0000","last_peered":"2024-03-04T13:12:12.458826+0000","last_clean":"2024-03-04T13:12:12.458826+0000","last_became_active":"2024-03-04T12:20:24.865816+0000","last_became_peered":"2024-03-04T12:20:24.865816+0000","last_unstale":"2024-03-04T13:12:12.458826+0000","last_undegraded":"2024-03-04T13:12:12.458826+0000","last_fullsized":"2024-03-04T13:12:12.458826+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":201,"num_read_kb":201,"num_write":359,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"255'653","reported_seq":2056,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.577516+0000","last_change":"2024-03-04T12:20:16.825715+0000","last_active":"2024-03-04T13:12:22.577516+0000","last_peered":"2024-03-04T13:12:22.577516+0000","last_clean":"2024-03-04T13:12:22.577516+0000","last_became_active":"2024-03-04T12:20:16.825377+0000","last_became_peered":"2024-03-04T12:20:16.825377+0000","last_unstale":"2024-03-04T13:12:22.577516+0000","last_undegraded":"2024-03-04T13:12:22.577516+0000","last_fullsized":"2024-03-04T13:12:22.577516+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2990,"num_read_kb":2698,"num_write":869,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"255'180","reported_seq":873,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.022128+0000","last_change":"2024-03-04T12:20:14.812062+0000","last_active":"2024-03-04T13:13:21.022128+0000","last_peered":"2024-03-04T13:13:21.022128+0000","last_clean":"2024-03-04T13:13:21.022128+0000","last_became_active":"2024-03-04T12:20:14.811756+0000","last_became_peered":"2024-03-04T12:20:14.811756+0000","last_unstale":"2024-03-04T13:13:21.022128+0000","last_undegraded":"2024-03-04T13:13:21.022128+0000","last_fullsized":"2024-03-04T13:13:21.022128+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104383,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":578,"num_read_kb":172500,"num_write":1029,"num_write_kb":54165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":502,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:57.476776+0000","last_change":"2024-03-04T12:20:05.779688+0000","last_active":"2024-03-04T13:09:57.476776+0000","last_peered":"2024-03-04T13:09:57.476776+0000","last_clean":"2024-03-04T13:09:57.476776+0000","last_became_active":"2024-03-04T12:20:05.779370+0000","last_became_peered":"2024-03-04T12:20:05.779370+0000","last_unstale":"2024-03-04T13:09:57.476776+0000","last_undegraded":"2024-03-04T13:09:57.476776+0000","last_fullsized":"2024-03-04T13:09:57.476776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:52.901612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"32'3","reported_seq":796,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.928915+0000","last_change":"2024-03-04T12:20:18.833572+0000","last_active":"2024-03-04T13:13:20.928915+0000","last_peered":"2024-03-04T13:13:20.928915+0000","last_clean":"2024-03-04T13:13:20.928915+0000","last_became_active":"2024-03-04T12:20:18.833273+0000","last_became_peered":"2024-03-04T12:20:18.833273+0000","last_unstale":"2024-03-04T13:13:20.928915+0000","last_undegraded":"2024-03-04T13:13:20.928915+0000","last_fullsized":"2024-03-04T13:13:20.928915+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":470,"num_read_kb":468,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"255'322","reported_seq":1037,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.213330+0000","last_change":"2024-03-04T12:20:21.643470+0000","last_active":"2024-03-04T13:13:21.213330+0000","last_peered":"2024-03-04T13:13:21.213330+0000","last_clean":"2024-03-04T13:13:21.213330+0000","last_became_active":"2024-03-04T12:20:21.642696+0000","last_became_peered":"2024-03-04T12:20:21.642696+0000","last_unstale":"2024-03-04T13:13:21.213330+0000","last_undegraded":"2024-03-04T13:13:21.213330+0000","last_fullsized":"2024-03-04T13:13:21.213330+0000","mapping_epoch":26,"log_start":"255'300","ondisk_log_start":"255'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:21:06.437125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17780,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":637,"num_write":242,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":476,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.467085+0000","last_change":"2024-03-04T12:20:22.853586+0000","last_active":"2024-03-04T13:12:27.467085+0000","last_peered":"2024-03-04T13:12:27.467085+0000","last_clean":"2024-03-04T13:12:27.467085+0000","last_became_active":"2024-03-04T12:20:22.853272+0000","last_became_peered":"2024-03-04T12:20:22.853272+0000","last_unstale":"2024-03-04T13:12:27.467085+0000","last_undegraded":"2024-03-04T13:12:27.467085+0000","last_fullsized":"2024-03-04T13:12:27.467085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"255'108","reported_seq":582,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:03.491177+0000","last_change":"2024-03-04T12:20:24.864478+0000","last_active":"2024-03-04T13:10:03.491177+0000","last_peered":"2024-03-04T13:10:03.491177+0000","last_clean":"2024-03-04T13:10:03.491177+0000","last_became_active":"2024-03-04T12:20:24.863996+0000","last_became_peered":"2024-03-04T12:20:24.863996+0000","last_unstale":"2024-03-04T13:10:03.491177+0000","last_undegraded":"2024-03-04T13:10:03.491177+0000","last_fullsized":"2024-03-04T13:10:03.491177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:25:42.964622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":275,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"255'114","reported_seq":603,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:32.461135+0000","last_change":"2024-03-04T12:20:24.868945+0000","last_active":"2024-03-04T13:12:32.461135+0000","last_peered":"2024-03-04T13:12:32.461135+0000","last_clean":"2024-03-04T13:12:32.461135+0000","last_became_active":"2024-03-04T12:20:24.868636+0000","last_became_peered":"2024-03-04T12:20:24.868636+0000","last_unstale":"2024-03-04T13:12:32.461135+0000","last_undegraded":"2024-03-04T13:12:32.461135+0000","last_fullsized":"2024-03-04T13:12:32.461135+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":141,"num_write":275,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"255'387","reported_seq":1863,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.591327+0000","last_change":"2024-03-04T12:20:16.823240+0000","last_active":"2024-03-04T13:12:50.591327+0000","last_peered":"2024-03-04T13:12:50.591327+0000","last_clean":"2024-03-04T13:12:50.591327+0000","last_became_active":"2024-03-04T12:20:16.822887+0000","last_became_peered":"2024-03-04T12:20:16.822887+0000","last_unstale":"2024-03-04T13:12:50.591327+0000","last_undegraded":"2024-03-04T13:12:50.591327+0000","last_fullsized":"2024-03-04T13:12:50.591327+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2100,"num_read_kb":1986,"num_write":448,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"255'173","reported_seq":778,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.137695+0000","last_change":"2024-03-04T12:20:14.824134+0000","last_active":"2024-03-04T13:13:21.137695+0000","last_peered":"2024-03-04T13:13:21.137695+0000","last_clean":"2024-03-04T13:13:21.137695+0000","last_became_active":"2024-03-04T12:20:14.823661+0000","last_became_peered":"2024-03-04T12:20:14.823661+0000","last_unstale":"2024-03-04T13:13:21.137695+0000","last_undegraded":"2024-03-04T13:13:21.137695+0000","last_fullsized":"2024-03-04T13:13:21.137695+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":384,"num_read_kb":10388,"num_write":1049,"num_write_kb":6576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:42.552143+0000","last_change":"2024-03-04T12:20:18.836980+0000","last_active":"2024-03-04T13:11:42.552143+0000","last_peered":"2024-03-04T13:11:42.552143+0000","last_clean":"2024-03-04T13:11:42.552143+0000","last_became_active":"2024-03-04T12:20:18.836487+0000","last_became_peered":"2024-03-04T12:20:18.836487+0000","last_unstale":"2024-03-04T13:11:42.552143+0000","last_undegraded":"2024-03-04T13:11:42.552143+0000","last_fullsized":"2024-03-04T13:11:42.552143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"255'141","reported_seq":702,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.111473+0000","last_change":"2024-03-04T12:20:20.841992+0000","last_active":"2024-03-04T13:13:21.111473+0000","last_peered":"2024-03-04T13:13:21.111473+0000","last_clean":"2024-03-04T13:13:21.111473+0000","last_became_active":"2024-03-04T12:20:20.841696+0000","last_became_peered":"2024-03-04T12:20:20.841696+0000","last_unstale":"2024-03-04T13:13:21.111473+0000","last_undegraded":"2024-03-04T13:13:21.111473+0000","last_fullsized":"2024-03-04T13:13:21.111473+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11864,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":271,"num_write":104,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":473,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:42.462058+0000","last_change":"2024-03-04T12:20:22.857779+0000","last_active":"2024-03-04T13:11:42.462058+0000","last_peered":"2024-03-04T13:11:42.462058+0000","last_clean":"2024-03-04T13:11:42.462058+0000","last_became_active":"2024-03-04T12:20:22.857513+0000","last_became_peered":"2024-03-04T12:20:22.857513+0000","last_unstale":"2024-03-04T13:11:42.462058+0000","last_undegraded":"2024-03-04T13:11:42.462058+0000","last_fullsized":"2024-03-04T13:11:42.462058+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"255'97","reported_seq":579,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:32.467681+0000","last_change":"2024-03-04T12:20:24.863622+0000","last_active":"2024-03-04T13:12:32.467681+0000","last_peered":"2024-03-04T13:12:32.467681+0000","last_clean":"2024-03-04T13:12:32.467681+0000","last_became_active":"2024-03-04T12:20:24.863346+0000","last_became_peered":"2024-03-04T12:20:24.863346+0000","last_unstale":"2024-03-04T13:12:32.467681+0000","last_undegraded":"2024-03-04T13:12:32.467681+0000","last_fullsized":"2024-03-04T13:12:32.467681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":222,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"255'705","reported_seq":2062,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.983415+0000","last_change":"2024-03-04T12:20:16.834338+0000","last_active":"2024-03-04T13:12:57.983415+0000","last_peered":"2024-03-04T13:12:57.983415+0000","last_clean":"2024-03-04T13:12:57.983415+0000","last_became_active":"2024-03-04T12:20:16.834080+0000","last_became_peered":"2024-03-04T12:20:16.834080+0000","last_unstale":"2024-03-04T13:12:57.983415+0000","last_undegraded":"2024-03-04T13:12:57.983415+0000","last_fullsized":"2024-03-04T13:12:57.983415+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":600,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3097,"num_read_kb":2763,"num_write":935,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"255'233","reported_seq":909,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.155212+0000","last_change":"2024-03-04T12:20:14.816239+0000","last_active":"2024-03-04T13:13:21.155212+0000","last_peered":"2024-03-04T13:13:21.155212+0000","last_clean":"2024-03-04T13:13:21.155212+0000","last_became_active":"2024-03-04T12:20:14.814738+0000","last_became_peered":"2024-03-04T12:20:14.814738+0000","last_unstale":"2024-03-04T13:13:21.155212+0000","last_undegraded":"2024-03-04T13:13:21.155212+0000","last_fullsized":"2024-03-04T13:13:21.155212+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:21:09.377678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5787887,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":617,"num_read_kb":16203,"num_write":1488,"num_write_kb":37968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:42.462128+0000","last_change":"2024-03-04T12:20:18.835129+0000","last_active":"2024-03-04T13:11:42.462128+0000","last_peered":"2024-03-04T13:11:42.462128+0000","last_clean":"2024-03-04T13:11:42.462128+0000","last_became_active":"2024-03-04T12:20:18.834793+0000","last_became_peered":"2024-03-04T12:20:18.834793+0000","last_unstale":"2024-03-04T13:11:42.462128+0000","last_undegraded":"2024-03-04T13:11:42.462128+0000","last_fullsized":"2024-03-04T13:11:42.462128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"255'57","reported_seq":544,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:42.455226+0000","last_change":"2024-03-04T12:20:20.832322+0000","last_active":"2024-03-04T13:11:42.455226+0000","last_peered":"2024-03-04T13:11:42.455226+0000","last_clean":"2024-03-04T13:11:42.455226+0000","last_became_active":"2024-03-04T12:20:20.832034+0000","last_became_peered":"2024-03-04T12:20:20.832034+0000","last_unstale":"2024-03-04T13:11:42.455226+0000","last_undegraded":"2024-03-04T13:11:42.455226+0000","last_fullsized":"2024-03-04T13:11:42.455226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":40,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.489906+0000","last_change":"2024-03-04T12:20:22.855900+0000","last_active":"2024-03-04T13:09:22.489906+0000","last_peered":"2024-03-04T13:09:22.489906+0000","last_clean":"2024-03-04T13:09:22.489906+0000","last_became_active":"2024-03-04T12:20:22.855477+0000","last_became_peered":"2024-03-04T12:20:22.855477+0000","last_unstale":"2024-03-04T13:09:22.489906+0000","last_undegraded":"2024-03-04T13:09:22.489906+0000","last_fullsized":"2024-03-04T13:09:22.489906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:25:54.549022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"255'84","reported_seq":559,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.464043+0000","last_change":"2024-03-04T12:20:24.865842+0000","last_active":"2024-03-04T13:12:57.464043+0000","last_peered":"2024-03-04T13:12:57.464043+0000","last_clean":"2024-03-04T13:12:57.464043+0000","last_became_active":"2024-03-04T12:20:24.865534+0000","last_became_peered":"2024-03-04T12:20:24.865534+0000","last_unstale":"2024-03-04T13:12:57.464043+0000","last_undegraded":"2024-03-04T13:12:57.464043+0000","last_fullsized":"2024-03-04T13:12:57.464043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":78,"num_write":202,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"255'718","reported_seq":2254,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:04.176339+0000","last_change":"2024-03-04T12:20:16.830393+0000","last_active":"2024-03-04T13:12:04.176339+0000","last_peered":"2024-03-04T13:12:04.176339+0000","last_clean":"2024-03-04T13:12:04.176339+0000","last_became_active":"2024-03-04T12:20:16.829012+0000","last_became_peered":"2024-03-04T12:20:16.829012+0000","last_unstale":"2024-03-04T13:12:04.176339+0000","last_undegraded":"2024-03-04T13:12:04.176339+0000","last_fullsized":"2024-03-04T13:12:04.176339+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3304,"num_read_kb":2912,"num_write":1016,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"255'175","reported_seq":860,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.237642+0000","last_change":"2024-03-04T12:20:14.822487+0000","last_active":"2024-03-04T13:13:21.237642+0000","last_peered":"2024-03-04T13:13:21.237642+0000","last_clean":"2024-03-04T13:13:21.237642+0000","last_became_active":"2024-03-04T12:20:14.822127+0000","last_became_peered":"2024-03-04T12:20:14.822127+0000","last_unstale":"2024-03-04T13:13:21.237642+0000","last_undegraded":"2024-03-04T13:13:21.237642+0000","last_fullsized":"2024-03-04T13:13:21.237642+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:19.430639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947361,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":518,"num_read_kb":182821,"num_write":997,"num_write_kb":40014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.489870+0000","last_change":"2024-03-04T12:20:18.831317+0000","last_active":"2024-03-04T13:09:22.489870+0000","last_peered":"2024-03-04T13:09:22.489870+0000","last_clean":"2024-03-04T13:09:22.489870+0000","last_became_active":"2024-03-04T12:20:18.830818+0000","last_became_peered":"2024-03-04T12:20:18.830818+0000","last_unstale":"2024-03-04T13:09:22.489870+0000","last_undegraded":"2024-03-04T13:09:22.489870+0000","last_fullsized":"2024-03-04T13:09:22.489870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:40:02.931088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"255'164","reported_seq":740,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.015082+0000","last_change":"2024-03-04T12:20:20.841367+0000","last_active":"2024-03-04T13:13:21.015082+0000","last_peered":"2024-03-04T13:13:21.015082+0000","last_clean":"2024-03-04T13:13:21.015082+0000","last_became_active":"2024-03-04T12:20:20.840999+0000","last_became_peered":"2024-03-04T12:20:20.840999+0000","last_unstale":"2024-03-04T13:13:21.015082+0000","last_undegraded":"2024-03-04T13:13:21.015082+0000","last_fullsized":"2024-03-04T13:13:21.015082+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8097,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":284,"num_write":124,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.472066+0000","last_change":"2024-03-04T12:20:22.849190+0000","last_active":"2024-03-04T13:09:22.472066+0000","last_peered":"2024-03-04T13:09:22.472066+0000","last_clean":"2024-03-04T13:09:22.472066+0000","last_became_active":"2024-03-04T12:20:22.848877+0000","last_became_peered":"2024-03-04T12:20:22.848877+0000","last_unstale":"2024-03-04T13:09:22.472066+0000","last_undegraded":"2024-03-04T13:09:22.472066+0000","last_fullsized":"2024-03-04T13:09:22.472066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:55:22.244587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"255'99","reported_seq":570,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:14.114497+0000","last_change":"2024-03-04T12:20:24.864100+0000","last_active":"2024-03-04T13:12:14.114497+0000","last_peered":"2024-03-04T13:12:14.114497+0000","last_clean":"2024-03-04T13:12:14.114497+0000","last_became_active":"2024-03-04T12:20:24.863810+0000","last_became_peered":"2024-03-04T12:20:24.863810+0000","last_unstale":"2024-03-04T13:12:14.114497+0000","last_undegraded":"2024-03-04T13:12:14.114497+0000","last_fullsized":"2024-03-04T13:12:14.114497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:00:35.223823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":234,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"255'782","reported_seq":2314,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.974644+0000","last_change":"2024-03-04T12:20:51.031767+0000","last_active":"2024-03-04T13:12:36.974644+0000","last_peered":"2024-03-04T13:12:36.974644+0000","last_clean":"2024-03-04T13:12:36.974644+0000","last_became_active":"2024-03-04T12:20:51.031448+0000","last_became_peered":"2024-03-04T12:20:51.031448+0000","last_unstale":"2024-03-04T13:12:36.974644+0000","last_undegraded":"2024-03-04T13:12:36.974644+0000","last_fullsized":"2024-03-04T13:12:36.974644+0000","mapping_epoch":33,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3519,"num_read_kb":3144,"num_write":1038,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"255'186","reported_seq":817,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260148+0000","last_change":"2024-03-04T12:20:14.824465+0000","last_active":"2024-03-04T13:13:25.260148+0000","last_peered":"2024-03-04T13:13:25.260148+0000","last_clean":"2024-03-04T13:13:25.260148+0000","last_became_active":"2024-03-04T12:20:14.824152+0000","last_became_peered":"2024-03-04T12:20:14.824152+0000","last_unstale":"2024-03-04T13:13:25.260148+0000","last_undegraded":"2024-03-04T13:13:25.260148+0000","last_fullsized":"2024-03-04T13:13:25.260148+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259657,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":396,"num_read_kb":84164,"num_write":1039,"num_write_kb":34071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":486,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:09:22.472038+0000","last_change":"2024-03-04T12:20:18.839090+0000","last_active":"2024-03-04T13:09:22.472038+0000","last_peered":"2024-03-04T13:09:22.472038+0000","last_clean":"2024-03-04T13:09:22.472038+0000","last_became_active":"2024-03-04T12:20:18.838749+0000","last_became_peered":"2024-03-04T12:20:18.838749+0000","last_unstale":"2024-03-04T13:09:22.472038+0000","last_undegraded":"2024-03-04T13:09:22.472038+0000","last_fullsized":"2024-03-04T13:09:22.472038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:30:49.140805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"255'125","reported_seq":689,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.989916+0000","last_change":"2024-03-04T12:20:20.839637+0000","last_active":"2024-03-04T13:13:20.989916+0000","last_peered":"2024-03-04T13:13:20.989916+0000","last_clean":"2024-03-04T13:13:20.989916+0000","last_became_active":"2024-03-04T12:20:20.839286+0000","last_became_peered":"2024-03-04T12:20:20.839286+0000","last_unstale":"2024-03-04T13:13:20.989916+0000","last_undegraded":"2024-03-04T13:13:20.989916+0000","last_fullsized":"2024-03-04T13:13:20.989916+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:46.347069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":210,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":471,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:42.455287+0000","last_change":"2024-03-04T12:20:22.849602+0000","last_active":"2024-03-04T13:11:42.455287+0000","last_peered":"2024-03-04T13:11:42.455287+0000","last_clean":"2024-03-04T13:11:42.455287+0000","last_became_active":"2024-03-04T12:20:22.849340+0000","last_became_peered":"2024-03-04T12:20:22.849340+0000","last_unstale":"2024-03-04T13:11:42.455287+0000","last_undegraded":"2024-03-04T13:11:42.455287+0000","last_fullsized":"2024-03-04T13:11:42.455287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"255'412","reported_seq":1874,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.782213+0000","last_change":"2024-03-04T12:20:16.821743+0000","last_active":"2024-03-04T13:12:34.782213+0000","last_peered":"2024-03-04T13:12:34.782213+0000","last_clean":"2024-03-04T13:12:34.782213+0000","last_became_active":"2024-03-04T12:20:16.821451+0000","last_became_peered":"2024-03-04T12:20:16.821451+0000","last_unstale":"2024-03-04T13:12:34.782213+0000","last_undegraded":"2024-03-04T13:12:34.782213+0000","last_fullsized":"2024-03-04T13:12:34.782213+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:11:35.448538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2212,"num_read_kb":2069,"num_write":499,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"255'211","reported_seq":803,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.642236+0000","last_change":"2024-03-04T12:20:14.810574+0000","last_active":"2024-03-04T13:13:26.642236+0000","last_peered":"2024-03-04T13:13:26.642236+0000","last_clean":"2024-03-04T13:13:26.642236+0000","last_became_active":"2024-03-04T12:20:14.810309+0000","last_became_peered":"2024-03-04T12:20:14.810309+0000","last_unstale":"2024-03-04T13:13:26.642236+0000","last_undegraded":"2024-03-04T13:13:26.642236+0000","last_fullsized":"2024-03-04T13:13:26.642236+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195451,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":442,"num_read_kb":8634,"num_write":1082,"num_write_kb":36368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":483,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.460560+0000","last_change":"2024-03-04T12:20:18.833581+0000","last_active":"2024-03-04T13:12:27.460560+0000","last_peered":"2024-03-04T13:12:27.460560+0000","last_clean":"2024-03-04T13:12:27.460560+0000","last_became_active":"2024-03-04T12:20:18.833300+0000","last_became_peered":"2024-03-04T12:20:18.833300+0000","last_unstale":"2024-03-04T13:12:27.460560+0000","last_undegraded":"2024-03-04T13:12:27.460560+0000","last_fullsized":"2024-03-04T13:12:27.460560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"255'201","reported_seq":818,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.239551+0000","last_change":"2024-03-04T12:20:20.838878+0000","last_active":"2024-03-04T13:13:21.239551+0000","last_peered":"2024-03-04T13:13:21.239551+0000","last_clean":"2024-03-04T13:13:21.239551+0000","last_became_active":"2024-03-04T12:20:20.838600+0000","last_became_peered":"2024-03-04T12:20:20.838600+0000","last_unstale":"2024-03-04T13:13:21.239551+0000","last_undegraded":"2024-03-04T13:13:21.239551+0000","last_fullsized":"2024-03-04T13:13:21.239551+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17172,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":287,"num_read_kb":431,"num_write":142,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":474,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.355538+0000","last_change":"2024-03-04T12:20:22.855745+0000","last_active":"2024-03-04T13:10:22.355538+0000","last_peered":"2024-03-04T13:10:22.355538+0000","last_clean":"2024-03-04T13:10:22.355538+0000","last_became_active":"2024-03-04T12:20:22.855464+0000","last_became_peered":"2024-03-04T12:20:22.855464+0000","last_unstale":"2024-03-04T13:10:22.355538+0000","last_undegraded":"2024-03-04T13:10:22.355538+0000","last_fullsized":"2024-03-04T13:10:22.355538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:30:46.542674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"255'170","reported_seq":664,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.166693+0000","last_change":"2024-03-04T12:20:24.912595+0000","last_active":"2024-03-04T13:13:14.166693+0000","last_peered":"2024-03-04T13:13:14.166693+0000","last_clean":"2024-03-04T13:13:14.166693+0000","last_became_active":"2024-03-04T12:20:24.912118+0000","last_became_peered":"2024-03-04T12:20:24.912118+0000","last_unstale":"2024-03-04T13:13:14.166693+0000","last_undegraded":"2024-03-04T13:13:14.166693+0000","last_fullsized":"2024-03-04T13:13:14.166693+0000","mapping_epoch":30,"log_start":"250'100","ondisk_log_start":"250'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":221,"num_read_kb":223,"num_write":386,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"255'445","reported_seq":1785,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.575394+0000","last_change":"2024-03-04T12:20:16.828841+0000","last_active":"2024-03-04T13:12:22.575394+0000","last_peered":"2024-03-04T13:12:22.575394+0000","last_clean":"2024-03-04T13:12:22.575394+0000","last_became_active":"2024-03-04T12:20:16.828550+0000","last_became_peered":"2024-03-04T12:20:16.828550+0000","last_unstale":"2024-03-04T13:12:22.575394+0000","last_undegraded":"2024-03-04T13:12:22.575394+0000","last_fullsized":"2024-03-04T13:12:22.575394+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2172,"num_read_kb":1979,"num_write":576,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"255'152","reported_seq":724,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.172084+0000","last_change":"2024-03-04T12:20:14.811751+0000","last_active":"2024-03-04T13:13:21.172084+0000","last_peered":"2024-03-04T13:13:21.172084+0000","last_clean":"2024-03-04T13:13:21.172084+0000","last_became_active":"2024-03-04T12:20:14.811474+0000","last_became_peered":"2024-03-04T12:20:14.811474+0000","last_unstale":"2024-03-04T13:13:21.172084+0000","last_undegraded":"2024-03-04T13:13:21.172084+0000","last_fullsized":"2024-03-04T13:13:21.172084+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1943261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":293,"num_read_kb":3660,"num_write":933,"num_write_kb":16669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.480432+0000","last_change":"2024-03-04T12:20:18.836323+0000","last_active":"2024-03-04T13:10:22.480432+0000","last_peered":"2024-03-04T13:10:22.480432+0000","last_clean":"2024-03-04T13:10:22.480432+0000","last_became_active":"2024-03-04T12:20:18.836021+0000","last_became_peered":"2024-03-04T12:20:18.836021+0000","last_unstale":"2024-03-04T13:10:22.480432+0000","last_undegraded":"2024-03-04T13:10:22.480432+0000","last_fullsized":"2024-03-04T13:10:22.480432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:21:06.430437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"255'166","reported_seq":747,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.998533+0000","last_change":"2024-03-04T12:20:20.838524+0000","last_active":"2024-03-04T13:13:20.998533+0000","last_peered":"2024-03-04T13:13:20.998533+0000","last_clean":"2024-03-04T13:13:20.998533+0000","last_became_active":"2024-03-04T12:20:20.838216+0000","last_became_peered":"2024-03-04T12:20:20.838216+0000","last_unstale":"2024-03-04T13:13:20.998533+0000","last_undegraded":"2024-03-04T13:13:20.998533+0000","last_fullsized":"2024-03-04T13:13:20.998533+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:42:52.068202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12653,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":241,"num_read_kb":319,"num_write":160,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":476,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:52.559940+0000","last_change":"2024-03-04T12:20:22.856748+0000","last_active":"2024-03-04T13:12:52.559940+0000","last_peered":"2024-03-04T13:12:52.559940+0000","last_clean":"2024-03-04T13:12:52.559940+0000","last_became_active":"2024-03-04T12:20:22.856471+0000","last_became_peered":"2024-03-04T12:20:22.856471+0000","last_unstale":"2024-03-04T13:12:52.559940+0000","last_undegraded":"2024-03-04T13:12:52.559940+0000","last_fullsized":"2024-03-04T13:12:52.559940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"255'161","reported_seq":1004,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.643094+0000","last_change":"2024-03-04T12:20:24.863580+0000","last_active":"2024-03-04T13:13:12.643094+0000","last_peered":"2024-03-04T13:13:12.643094+0000","last_clean":"2024-03-04T13:13:12.643094+0000","last_became_active":"2024-03-04T12:20:24.863291+0000","last_became_peered":"2024-03-04T12:20:24.863291+0000","last_unstale":"2024-03-04T13:13:12.643094+0000","last_undegraded":"2024-03-04T13:13:12.643094+0000","last_fullsized":"2024-03-04T13:13:12.643094+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:12:00.193269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1530,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":567,"num_read_kb":564,"num_write":466,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"255'445","reported_seq":1850,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:22.459956+0000","last_change":"2024-03-04T12:20:50.906133+0000","last_active":"2024-03-04T13:13:22.459956+0000","last_peered":"2024-03-04T13:13:22.459956+0000","last_clean":"2024-03-04T13:13:22.459956+0000","last_became_active":"2024-03-04T12:20:50.905894+0000","last_became_peered":"2024-03-04T12:20:50.905894+0000","last_unstale":"2024-03-04T13:13:22.459956+0000","last_undegraded":"2024-03-04T13:13:22.459956+0000","last_fullsized":"2024-03-04T13:13:22.459956+0000","mapping_epoch":33,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2307,"num_read_kb":2145,"num_write":589,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"255'290","reported_seq":1045,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.237194+0000","last_change":"2024-03-04T12:20:14.816872+0000","last_active":"2024-03-04T13:13:21.237194+0000","last_peered":"2024-03-04T13:13:21.237194+0000","last_clean":"2024-03-04T13:13:21.237194+0000","last_became_active":"2024-03-04T12:20:14.816522+0000","last_became_peered":"2024-03-04T12:20:14.816522+0000","last_unstale":"2024-03-04T13:13:21.237194+0000","last_undegraded":"2024-03-04T13:13:21.237194+0000","last_fullsized":"2024-03-04T13:13:21.237194+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291510,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":856,"num_read_kb":55073,"num_write":1469,"num_write_kb":53223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":488,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:52.526120+0000","last_change":"2024-03-04T12:20:18.831825+0000","last_active":"2024-03-04T13:12:52.526120+0000","last_peered":"2024-03-04T13:12:52.526120+0000","last_clean":"2024-03-04T13:12:52.526120+0000","last_became_active":"2024-03-04T12:20:18.831535+0000","last_became_peered":"2024-03-04T12:20:18.831535+0000","last_unstale":"2024-03-04T13:12:52.526120+0000","last_undegraded":"2024-03-04T13:12:52.526120+0000","last_fullsized":"2024-03-04T13:12:52.526120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"255'148","reported_seq":712,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.142739+0000","last_change":"2024-03-04T12:20:21.642237+0000","last_active":"2024-03-04T13:13:21.142739+0000","last_peered":"2024-03-04T13:13:21.142739+0000","last_clean":"2024-03-04T13:13:21.142739+0000","last_became_active":"2024-03-04T12:20:21.641872+0000","last_became_peered":"2024-03-04T12:20:21.641872+0000","last_unstale":"2024-03-04T13:13:21.142739+0000","last_undegraded":"2024-03-04T13:13:21.142739+0000","last_fullsized":"2024-03-04T13:13:21.142739+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6408,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":262,"num_write":108,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.557305+0000","last_change":"2024-03-04T12:20:22.854770+0000","last_active":"2024-03-04T13:12:27.557305+0000","last_peered":"2024-03-04T13:12:27.557305+0000","last_clean":"2024-03-04T13:12:27.557305+0000","last_became_active":"2024-03-04T12:20:22.854454+0000","last_became_peered":"2024-03-04T12:20:22.854454+0000","last_unstale":"2024-03-04T13:12:27.557305+0000","last_undegraded":"2024-03-04T13:12:27.557305+0000","last_fullsized":"2024-03-04T13:12:27.557305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"255'101","reported_seq":576,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.164834+0000","last_change":"2024-03-04T12:20:24.862523+0000","last_active":"2024-03-04T13:13:14.164834+0000","last_peered":"2024-03-04T13:13:14.164834+0000","last_clean":"2024-03-04T13:13:14.164834+0000","last_became_active":"2024-03-04T12:20:24.862179+0000","last_became_peered":"2024-03-04T12:20:24.862179+0000","last_unstale":"2024-03-04T13:13:14.164834+0000","last_undegraded":"2024-03-04T13:13:14.164834+0000","last_fullsized":"2024-03-04T13:13:14.164834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:35:13.449840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":249,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"255'454","reported_seq":1907,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.593548+0000","last_change":"2024-03-04T12:20:16.836521+0000","last_active":"2024-03-04T13:12:50.593548+0000","last_peered":"2024-03-04T13:12:50.593548+0000","last_clean":"2024-03-04T13:12:50.593548+0000","last_became_active":"2024-03-04T12:20:16.836224+0000","last_became_peered":"2024-03-04T12:20:16.836224+0000","last_unstale":"2024-03-04T13:12:50.593548+0000","last_undegraded":"2024-03-04T13:12:50.593548+0000","last_fullsized":"2024-03-04T13:12:50.593548+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2418,"num_read_kb":2273,"num_write":600,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"255'189","reported_seq":780,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.103154+0000","last_change":"2024-03-04T12:20:14.821178+0000","last_active":"2024-03-04T13:13:21.103154+0000","last_peered":"2024-03-04T13:13:21.103154+0000","last_clean":"2024-03-04T13:13:21.103154+0000","last_became_active":"2024-03-04T12:20:14.820789+0000","last_became_peered":"2024-03-04T12:20:14.820789+0000","last_unstale":"2024-03-04T13:13:21.103154+0000","last_undegraded":"2024-03-04T13:13:21.103154+0000","last_fullsized":"2024-03-04T13:13:21.103154+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":398,"num_read_kb":8887,"num_write":907,"num_write_kb":18227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":484,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:52.559920+0000","last_change":"2024-03-04T12:20:18.838301+0000","last_active":"2024-03-04T13:12:52.559920+0000","last_peered":"2024-03-04T13:12:52.559920+0000","last_clean":"2024-03-04T13:12:52.559920+0000","last_became_active":"2024-03-04T12:20:18.837949+0000","last_became_peered":"2024-03-04T12:20:18.837949+0000","last_unstale":"2024-03-04T13:12:52.559920+0000","last_undegraded":"2024-03-04T13:12:52.559920+0000","last_fullsized":"2024-03-04T13:12:52.559920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"255'84","reported_seq":603,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.521519+0000","last_change":"2024-03-04T12:20:21.642153+0000","last_active":"2024-03-04T13:12:27.521519+0000","last_peered":"2024-03-04T13:12:27.521519+0000","last_clean":"2024-03-04T13:12:27.521519+0000","last_became_active":"2024-03-04T12:20:21.641757+0000","last_became_peered":"2024-03-04T12:20:21.641757+0000","last_unstale":"2024-03-04T13:12:27.521519+0000","last_undegraded":"2024-03-04T13:12:27.521519+0000","last_fullsized":"2024-03-04T13:12:27.521519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":90,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"255'498","reported_seq":3564,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.932748+0000","last_change":"2024-03-04T12:20:22.850624+0000","last_active":"2024-03-04T13:13:20.932748+0000","last_peered":"2024-03-04T13:13:20.932748+0000","last_clean":"2024-03-04T13:13:20.932748+0000","last_became_active":"2024-03-04T12:20:22.849630+0000","last_became_peered":"2024-03-04T12:20:22.849630+0000","last_unstale":"2024-03-04T13:13:20.932748+0000","last_undegraded":"2024-03-04T13:13:20.932748+0000","last_fullsized":"2024-03-04T13:13:20.932748+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:05.162543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"255'140","reported_seq":628,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:11.369454+0000","last_change":"2024-03-04T12:20:24.863651+0000","last_active":"2024-03-04T13:12:11.369454+0000","last_peered":"2024-03-04T13:12:11.369454+0000","last_clean":"2024-03-04T13:12:11.369454+0000","last_became_active":"2024-03-04T12:20:24.863312+0000","last_became_peered":"2024-03-04T12:20:24.863312+0000","last_unstale":"2024-03-04T13:12:11.369454+0000","last_undegraded":"2024-03-04T13:12:11.369454+0000","last_fullsized":"2024-03-04T13:12:11.369454+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:08:10.861121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":307,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"255'558","reported_seq":2207,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.525153+0000","last_change":"2024-03-04T12:20:16.828351+0000","last_active":"2024-03-04T13:12:47.525153+0000","last_peered":"2024-03-04T13:12:47.525153+0000","last_clean":"2024-03-04T13:12:47.525153+0000","last_became_active":"2024-03-04T12:20:16.828102+0000","last_became_peered":"2024-03-04T12:20:16.828102+0000","last_unstale":"2024-03-04T13:12:47.525153+0000","last_undegraded":"2024-03-04T13:12:47.525153+0000","last_fullsized":"2024-03-04T13:12:47.525153+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2984,"num_read_kb":2771,"num_write":760,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"255'207","reported_seq":841,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.182107+0000","last_change":"2024-03-04T12:20:14.827443+0000","last_active":"2024-03-04T13:13:21.182107+0000","last_peered":"2024-03-04T13:13:21.182107+0000","last_clean":"2024-03-04T13:13:21.182107+0000","last_became_active":"2024-03-04T12:20:14.826522+0000","last_became_peered":"2024-03-04T12:20:14.826522+0000","last_unstale":"2024-03-04T13:13:21.182107+0000","last_undegraded":"2024-03-04T13:13:21.182107+0000","last_fullsized":"2024-03-04T13:13:21.182107+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:32:50.275769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27217,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":463,"num_read_kb":10394,"num_write":1165,"num_write_kb":28391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.499523+0000","last_change":"2024-03-04T12:20:18.832929+0000","last_active":"2024-03-04T13:10:22.499523+0000","last_peered":"2024-03-04T13:10:22.499523+0000","last_clean":"2024-03-04T13:10:22.499523+0000","last_became_active":"2024-03-04T12:20:18.832607+0000","last_became_peered":"2024-03-04T12:20:18.832607+0000","last_unstale":"2024-03-04T13:10:22.499523+0000","last_undegraded":"2024-03-04T13:10:22.499523+0000","last_fullsized":"2024-03-04T13:10:22.499523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:37:17.213186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"255'174","reported_seq":748,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.191936+0000","last_change":"2024-03-04T12:20:20.838476+0000","last_active":"2024-03-04T13:13:21.191936+0000","last_peered":"2024-03-04T13:13:21.191936+0000","last_clean":"2024-03-04T13:13:21.191936+0000","last_became_active":"2024-03-04T12:20:20.838062+0000","last_became_peered":"2024-03-04T12:20:20.838062+0000","last_unstale":"2024-03-04T13:13:21.191936+0000","last_undegraded":"2024-03-04T13:13:21.191936+0000","last_fullsized":"2024-03-04T13:13:21.191936+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:55.057171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8941,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":239,"num_read_kb":314,"num_write":142,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":470,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.451264+0000","last_change":"2024-03-04T12:20:22.856843+0000","last_active":"2024-03-04T13:11:07.451264+0000","last_peered":"2024-03-04T13:11:07.451264+0000","last_clean":"2024-03-04T13:11:07.451264+0000","last_became_active":"2024-03-04T12:20:22.856540+0000","last_became_peered":"2024-03-04T12:20:22.856540+0000","last_unstale":"2024-03-04T13:11:07.451264+0000","last_undegraded":"2024-03-04T13:11:07.451264+0000","last_fullsized":"2024-03-04T13:11:07.451264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"255'88","reported_seq":574,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:15.292251+0000","last_change":"2024-03-04T12:20:24.867999+0000","last_active":"2024-03-04T13:10:15.292251+0000","last_peered":"2024-03-04T13:10:15.292251+0000","last_clean":"2024-03-04T13:10:15.292251+0000","last_became_active":"2024-03-04T12:20:24.866984+0000","last_became_peered":"2024-03-04T12:20:24.866984+0000","last_unstale":"2024-03-04T13:10:15.292251+0000","last_undegraded":"2024-03-04T13:10:15.292251+0000","last_fullsized":"2024-03-04T13:10:15.292251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:35.692000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":81,"num_write":221,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"255'841","reported_seq":2369,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.525105+0000","last_change":"2024-03-04T12:20:16.827865+0000","last_active":"2024-03-04T13:12:47.525105+0000","last_peered":"2024-03-04T13:12:47.525105+0000","last_clean":"2024-03-04T13:12:47.525105+0000","last_became_active":"2024-03-04T12:20:16.827592+0000","last_became_peered":"2024-03-04T12:20:16.827592+0000","last_unstale":"2024-03-04T13:12:47.525105+0000","last_undegraded":"2024-03-04T13:12:47.525105+0000","last_fullsized":"2024-03-04T13:12:47.525105+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3846,"num_read_kb":3408,"num_write":1191,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"255'226","reported_seq":858,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.026297+0000","last_change":"2024-03-04T12:20:14.827317+0000","last_active":"2024-03-04T13:13:21.026297+0000","last_peered":"2024-03-04T13:13:21.026297+0000","last_clean":"2024-03-04T13:13:21.026297+0000","last_became_active":"2024-03-04T12:20:14.827034+0000","last_became_peered":"2024-03-04T12:20:14.827034+0000","last_unstale":"2024-03-04T13:13:21.026297+0000","last_undegraded":"2024-03-04T13:13:21.026297+0000","last_fullsized":"2024-03-04T13:13:21.026297+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:46:52.185291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":510,"num_read_kb":74328,"num_write":1121,"num_write_kb":53240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:10:22.355518+0000","last_change":"2024-03-04T12:20:18.836142+0000","last_active":"2024-03-04T13:10:22.355518+0000","last_peered":"2024-03-04T13:10:22.355518+0000","last_clean":"2024-03-04T13:10:22.355518+0000","last_became_active":"2024-03-04T12:20:18.835852+0000","last_became_peered":"2024-03-04T12:20:18.835852+0000","last_unstale":"2024-03-04T13:10:22.355518+0000","last_undegraded":"2024-03-04T13:10:22.355518+0000","last_fullsized":"2024-03-04T13:10:22.355518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:36:46.704265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"255'135","reported_seq":687,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.197865+0000","last_change":"2024-03-04T12:20:20.837534+0000","last_active":"2024-03-04T13:13:21.197865+0000","last_peered":"2024-03-04T13:13:21.197865+0000","last_clean":"2024-03-04T13:13:21.197865+0000","last_became_active":"2024-03-04T12:20:20.837239+0000","last_became_peered":"2024-03-04T12:20:20.837239+0000","last_unstale":"2024-03-04T13:13:21.197865+0000","last_undegraded":"2024-03-04T13:13:21.197865+0000","last_fullsized":"2024-03-04T13:13:21.197865+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7816,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":230,"num_write":86,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":477,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:08:52.468138+0000","last_change":"2024-03-04T12:20:22.850044+0000","last_active":"2024-03-04T13:08:52.468138+0000","last_peered":"2024-03-04T13:08:52.468138+0000","last_clean":"2024-03-04T13:08:52.468138+0000","last_became_active":"2024-03-04T12:20:22.849731+0000","last_became_peered":"2024-03-04T12:20:22.849731+0000","last_unstale":"2024-03-04T13:08:52.468138+0000","last_undegraded":"2024-03-04T13:08:52.468138+0000","last_fullsized":"2024-03-04T13:08:52.468138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:14:28.076705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"255'119","reported_seq":618,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.332612+0000","last_change":"2024-03-04T12:20:24.912999+0000","last_active":"2024-03-04T13:12:39.332612+0000","last_peered":"2024-03-04T13:12:39.332612+0000","last_clean":"2024-03-04T13:12:39.332612+0000","last_became_active":"2024-03-04T12:20:24.912599+0000","last_became_peered":"2024-03-04T12:20:24.912599+0000","last_unstale":"2024-03-04T13:12:39.332612+0000","last_undegraded":"2024-03-04T13:12:39.332612+0000","last_fullsized":"2024-03-04T13:12:39.332612+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":888,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":157,"num_write":287,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"255'1175","reported_seq":2748,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.328455+0000","last_change":"2024-03-04T12:20:16.828068+0000","last_active":"2024-03-04T13:12:39.328455+0000","last_peered":"2024-03-04T13:12:39.328455+0000","last_clean":"2024-03-04T13:12:39.328455+0000","last_became_active":"2024-03-04T12:20:16.827448+0000","last_became_peered":"2024-03-04T12:20:16.827448+0000","last_unstale":"2024-03-04T13:12:39.328455+0000","last_undegraded":"2024-03-04T13:12:39.328455+0000","last_fullsized":"2024-03-04T13:12:39.328455+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":1100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5284,"num_read_kb":4621,"num_write":1652,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"255'215","reported_seq":846,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.220408+0000","last_change":"2024-03-04T12:20:14.822903+0000","last_active":"2024-03-04T13:13:21.220408+0000","last_peered":"2024-03-04T13:13:21.220408+0000","last_clean":"2024-03-04T13:13:21.220408+0000","last_became_active":"2024-03-04T12:20:14.822619+0000","last_became_peered":"2024-03-04T12:20:14.822619+0000","last_unstale":"2024-03-04T13:13:21.220408+0000","last_undegraded":"2024-03-04T13:13:21.220408+0000","last_fullsized":"2024-03-04T13:13:21.220408+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9035448,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":16616,"num_write":1088,"num_write_kb":32501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":488,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:07.507107+0000","last_change":"2024-03-04T12:20:18.831493+0000","last_active":"2024-03-04T13:11:07.507107+0000","last_peered":"2024-03-04T13:11:07.507107+0000","last_clean":"2024-03-04T13:11:07.507107+0000","last_became_active":"2024-03-04T12:20:18.831105+0000","last_became_peered":"2024-03-04T12:20:18.831105+0000","last_unstale":"2024-03-04T13:11:07.507107+0000","last_undegraded":"2024-03-04T13:11:07.507107+0000","last_fullsized":"2024-03-04T13:11:07.507107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"255'100","reported_seq":642,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.125345+0000","last_change":"2024-03-04T12:20:20.842912+0000","last_active":"2024-03-04T13:13:21.125345+0000","last_peered":"2024-03-04T13:13:21.125345+0000","last_clean":"2024-03-04T13:13:21.125345+0000","last_became_active":"2024-03-04T12:20:20.842361+0000","last_became_peered":"2024-03-04T12:20:20.842361+0000","last_unstale":"2024-03-04T13:13:21.125345+0000","last_undegraded":"2024-03-04T13:13:21.125345+0000","last_fullsized":"2024-03-04T13:13:21.125345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":178,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:52.526077+0000","last_change":"2024-03-04T12:20:22.857230+0000","last_active":"2024-03-04T13:12:52.526077+0000","last_peered":"2024-03-04T13:12:52.526077+0000","last_clean":"2024-03-04T13:12:52.526077+0000","last_became_active":"2024-03-04T12:20:22.856748+0000","last_became_peered":"2024-03-04T12:20:22.856748+0000","last_unstale":"2024-03-04T13:12:52.526077+0000","last_undegraded":"2024-03-04T13:12:52.526077+0000","last_fullsized":"2024-03-04T13:12:52.526077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"255'148","reported_seq":1190,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.552175+0000","last_change":"2024-03-04T12:20:24.865794+0000","last_active":"2024-03-04T13:13:12.552175+0000","last_peered":"2024-03-04T13:13:12.552175+0000","last_clean":"2024-03-04T13:13:12.552175+0000","last_became_active":"2024-03-04T12:20:24.865363+0000","last_became_peered":"2024-03-04T12:20:24.865363+0000","last_unstale":"2024-03-04T13:13:12.552175+0000","last_undegraded":"2024-03-04T13:13:12.552175+0000","last_fullsized":"2024-03-04T13:13:12.552175+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:49:27.367305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":819,"num_read_kb":785,"num_write":355,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"255'725","reported_seq":2133,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.106410+0000","last_change":"2024-03-04T12:20:16.820242+0000","last_active":"2024-03-04T13:13:27.106410+0000","last_peered":"2024-03-04T13:13:27.106410+0000","last_clean":"2024-03-04T13:13:27.106410+0000","last_became_active":"2024-03-04T12:20:16.819966+0000","last_became_peered":"2024-03-04T12:20:16.819966+0000","last_unstale":"2024-03-04T13:13:27.106410+0000","last_undegraded":"2024-03-04T13:13:27.106410+0000","last_fullsized":"2024-03-04T13:13:27.106410+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3297,"num_read_kb":2935,"num_write":968,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"255'281","reported_seq":927,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.235130+0000","last_change":"2024-03-04T12:20:14.824471+0000","last_active":"2024-03-04T13:13:21.235130+0000","last_peered":"2024-03-04T13:13:21.235130+0000","last_clean":"2024-03-04T13:13:21.235130+0000","last_became_active":"2024-03-04T12:20:14.824168+0000","last_became_peered":"2024-03-04T12:20:14.824168+0000","last_unstale":"2024-03-04T13:13:21.235130+0000","last_undegraded":"2024-03-04T13:13:21.235130+0000","last_fullsized":"2024-03-04T13:13:21.235130+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":709,"num_read_kb":4351,"num_write":1165,"num_write_kb":19276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":485,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:12.548685+0000","last_change":"2024-03-04T12:20:18.836753+0000","last_active":"2024-03-04T13:11:12.548685+0000","last_peered":"2024-03-04T13:11:12.548685+0000","last_clean":"2024-03-04T13:11:12.548685+0000","last_became_active":"2024-03-04T12:20:18.836203+0000","last_became_peered":"2024-03-04T12:20:18.836203+0000","last_unstale":"2024-03-04T13:11:12.548685+0000","last_undegraded":"2024-03-04T13:11:12.548685+0000","last_fullsized":"2024-03-04T13:11:12.548685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"255'161","reported_seq":738,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.150769+0000","last_change":"2024-03-04T12:20:20.842714+0000","last_active":"2024-03-04T13:13:21.150769+0000","last_peered":"2024-03-04T13:13:21.150769+0000","last_clean":"2024-03-04T13:13:21.150769+0000","last_became_active":"2024-03-04T12:20:20.842246+0000","last_became_peered":"2024-03-04T12:20:20.842246+0000","last_unstale":"2024-03-04T13:13:21.150769+0000","last_undegraded":"2024-03-04T13:13:21.150769+0000","last_fullsized":"2024-03-04T13:13:21.150769+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":208,"num_read_kb":255,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":470,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:52.463361+0000","last_change":"2024-03-04T12:20:22.856898+0000","last_active":"2024-03-04T13:12:52.463361+0000","last_peered":"2024-03-04T13:12:52.463361+0000","last_clean":"2024-03-04T13:12:52.463361+0000","last_became_active":"2024-03-04T12:20:22.856597+0000","last_became_peered":"2024-03-04T12:20:22.856597+0000","last_unstale":"2024-03-04T13:12:52.463361+0000","last_undegraded":"2024-03-04T13:12:52.463361+0000","last_fullsized":"2024-03-04T13:12:52.463361+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"255'89","reported_seq":568,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:52.515113+0000","last_change":"2024-03-04T12:20:24.869755+0000","last_active":"2024-03-04T13:11:52.515113+0000","last_peered":"2024-03-04T13:11:52.515113+0000","last_clean":"2024-03-04T13:11:52.515113+0000","last_became_active":"2024-03-04T12:20:24.869207+0000","last_became_peered":"2024-03-04T12:20:24.869207+0000","last_unstale":"2024-03-04T13:11:52.515113+0000","last_undegraded":"2024-03-04T13:11:52.515113+0000","last_fullsized":"2024-03-04T13:11:52.515113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":212,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"255'1092","reported_seq":2658,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.575664+0000","last_change":"2024-03-04T12:20:16.832658+0000","last_active":"2024-03-04T13:12:22.575664+0000","last_peered":"2024-03-04T13:12:22.575664+0000","last_clean":"2024-03-04T13:12:22.575664+0000","last_became_active":"2024-03-04T12:20:16.832377+0000","last_became_peered":"2024-03-04T12:20:16.832377+0000","last_unstale":"2024-03-04T13:12:22.575664+0000","last_undegraded":"2024-03-04T13:12:22.575664+0000","last_fullsized":"2024-03-04T13:12:22.575664+0000","mapping_epoch":22,"log_start":"255'1000","ondisk_log_start":"255'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":1000,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4785,"num_read_kb":4211,"num_write":1502,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"255'213","reported_seq":860,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.122597+0000","last_change":"2024-03-04T12:20:14.817916+0000","last_active":"2024-03-04T13:13:21.122597+0000","last_peered":"2024-03-04T13:13:21.122597+0000","last_clean":"2024-03-04T13:13:21.122597+0000","last_became_active":"2024-03-04T12:20:14.817326+0000","last_became_peered":"2024-03-04T12:20:14.817326+0000","last_unstale":"2024-03-04T13:13:21.122597+0000","last_undegraded":"2024-03-04T13:13:21.122597+0000","last_fullsized":"2024-03-04T13:13:21.122597+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:49:00.626737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":463525,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":541,"num_read_kb":21798,"num_write":1100,"num_write_kb":25910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"255'796","reported_seq":2439,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.118375+0000","last_change":"2024-03-04T12:20:16.835151+0000","last_active":"2024-03-04T13:12:31.118375+0000","last_peered":"2024-03-04T13:12:31.118375+0000","last_clean":"2024-03-04T13:12:31.118375+0000","last_became_active":"2024-03-04T12:20:16.834823+0000","last_became_peered":"2024-03-04T12:20:16.834823+0000","last_unstale":"2024-03-04T13:12:31.118375+0000","last_undegraded":"2024-03-04T13:12:31.118375+0000","last_fullsized":"2024-03-04T13:12:31.118375+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3958,"num_read_kb":3565,"num_write":1074,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"255'210","reported_seq":854,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.228581+0000","last_change":"2024-03-04T12:20:14.819636+0000","last_active":"2024-03-04T13:13:21.228581+0000","last_peered":"2024-03-04T13:13:21.228581+0000","last_clean":"2024-03-04T13:13:21.228581+0000","last_became_active":"2024-03-04T12:20:14.819333+0000","last_became_peered":"2024-03-04T12:20:14.819333+0000","last_unstale":"2024-03-04T13:13:21.228581+0000","last_undegraded":"2024-03-04T13:13:21.228581+0000","last_fullsized":"2024-03-04T13:13:21.228581+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":688512,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":39432,"num_write":1114,"num_write_kb":31535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"255'567","reported_seq":2093,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.955018+0000","last_change":"2024-03-04T12:20:16.829090+0000","last_active":"2024-03-04T13:12:36.955018+0000","last_peered":"2024-03-04T13:12:36.955018+0000","last_clean":"2024-03-04T13:12:36.955018+0000","last_became_active":"2024-03-04T12:20:16.828799+0000","last_became_peered":"2024-03-04T12:20:16.828799+0000","last_unstale":"2024-03-04T13:12:36.955018+0000","last_undegraded":"2024-03-04T13:12:36.955018+0000","last_fullsized":"2024-03-04T13:12:36.955018+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:40:00.875926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2802,"num_read_kb":2536,"num_write":761,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"255'187","reported_seq":792,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.181487+0000","last_change":"2024-03-04T12:20:14.824170+0000","last_active":"2024-03-04T13:13:21.181487+0000","last_peered":"2024-03-04T13:13:21.181487+0000","last_clean":"2024-03-04T13:13:21.181487+0000","last_became_active":"2024-03-04T12:20:14.823794+0000","last_became_peered":"2024-03-04T12:20:14.823794+0000","last_unstale":"2024-03-04T13:13:21.181487+0000","last_undegraded":"2024-03-04T13:13:21.181487+0000","last_fullsized":"2024-03-04T13:13:21.181487+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:58:40.371668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27216,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":368,"num_read_kb":29267,"num_write":940,"num_write_kb":26221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"255'419","reported_seq":2015,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:17.556025+0000","last_change":"2024-03-04T12:20:16.830270+0000","last_active":"2024-03-04T13:12:17.556025+0000","last_peered":"2024-03-04T13:12:17.556025+0000","last_clean":"2024-03-04T13:12:17.556025+0000","last_became_active":"2024-03-04T12:20:16.830023+0000","last_became_peered":"2024-03-04T12:20:16.830023+0000","last_unstale":"2024-03-04T13:12:17.556025+0000","last_undegraded":"2024-03-04T13:12:17.556025+0000","last_fullsized":"2024-03-04T13:12:17.556025+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2457,"num_read_kb":2316,"num_write":500,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"255'181","reported_seq":765,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.206595+0000","last_change":"2024-03-04T12:20:14.814965+0000","last_active":"2024-03-04T13:13:21.206595+0000","last_peered":"2024-03-04T13:13:21.206595+0000","last_clean":"2024-03-04T13:13:21.206595+0000","last_became_active":"2024-03-04T12:20:14.814649+0000","last_became_peered":"2024-03-04T12:20:14.814649+0000","last_unstale":"2024-03-04T13:13:21.206595+0000","last_undegraded":"2024-03-04T13:13:21.206595+0000","last_fullsized":"2024-03-04T13:13:21.206595+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":350,"num_read_kb":14298,"num_write":961,"num_write_kb":45374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"255'670","reported_seq":2119,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.467104+0000","last_change":"2024-03-04T12:20:16.832110+0000","last_active":"2024-03-04T13:12:27.467104+0000","last_peered":"2024-03-04T13:12:27.467104+0000","last_clean":"2024-03-04T13:12:27.467104+0000","last_became_active":"2024-03-04T12:20:16.831861+0000","last_became_peered":"2024-03-04T12:20:16.831861+0000","last_unstale":"2024-03-04T13:12:27.467104+0000","last_undegraded":"2024-03-04T13:12:27.467104+0000","last_fullsized":"2024-03-04T13:12:27.467104+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":600,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3134,"num_read_kb":2831,"num_write":876,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"255'150","reported_seq":783,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.234393+0000","last_change":"2024-03-04T12:20:14.818277+0000","last_active":"2024-03-04T13:13:21.234393+0000","last_peered":"2024-03-04T13:13:21.234393+0000","last_clean":"2024-03-04T13:13:21.234393+0000","last_became_active":"2024-03-04T12:20:14.818011+0000","last_became_peered":"2024-03-04T12:20:14.818011+0000","last_unstale":"2024-03-04T13:13:21.234393+0000","last_undegraded":"2024-03-04T13:13:21.234393+0000","last_fullsized":"2024-03-04T13:13:21.234393+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6900048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":2296,"num_write":812,"num_write_kb":10260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"255'1153","reported_seq":2619,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.576933+0000","last_change":"2024-03-04T12:20:16.821337+0000","last_active":"2024-03-04T13:12:22.576933+0000","last_peered":"2024-03-04T13:12:22.576933+0000","last_clean":"2024-03-04T13:12:22.576933+0000","last_became_active":"2024-03-04T12:20:16.820794+0000","last_became_peered":"2024-03-04T12:20:16.820794+0000","last_unstale":"2024-03-04T13:12:22.576933+0000","last_undegraded":"2024-03-04T13:12:22.576933+0000","last_fullsized":"2024-03-04T13:12:22.576933+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":1100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4910,"num_read_kb":4282,"num_write":1611,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"255'212","reported_seq":836,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.220538+0000","last_change":"2024-03-04T12:20:14.812183+0000","last_active":"2024-03-04T13:13:21.220538+0000","last_peered":"2024-03-04T13:13:21.220538+0000","last_clean":"2024-03-04T13:13:21.220538+0000","last_became_active":"2024-03-04T12:20:14.811334+0000","last_became_peered":"2024-03-04T12:20:14.811334+0000","last_unstale":"2024-03-04T13:13:21.220538+0000","last_undegraded":"2024-03-04T13:13:21.220538+0000","last_fullsized":"2024-03-04T13:13:21.220538+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1577095,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":33282,"num_write":1226,"num_write_kb":31843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"255'760","reported_seq":2378,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.575088+0000","last_change":"2024-03-04T12:20:16.835553+0000","last_active":"2024-03-04T13:12:22.575088+0000","last_peered":"2024-03-04T13:12:22.575088+0000","last_clean":"2024-03-04T13:12:22.575088+0000","last_became_active":"2024-03-04T12:20:16.835285+0000","last_became_peered":"2024-03-04T12:20:16.835285+0000","last_unstale":"2024-03-04T13:12:22.575088+0000","last_undegraded":"2024-03-04T13:12:22.575088+0000","last_fullsized":"2024-03-04T13:12:22.575088+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3723,"num_read_kb":3381,"num_write":1013,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"255'217","reported_seq":846,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.137749+0000","last_change":"2024-03-04T12:20:14.818864+0000","last_active":"2024-03-04T13:13:21.137749+0000","last_peered":"2024-03-04T13:13:21.137749+0000","last_clean":"2024-03-04T13:13:21.137749+0000","last_became_active":"2024-03-04T12:20:14.818385+0000","last_became_peered":"2024-03-04T12:20:14.818385+0000","last_unstale":"2024-03-04T13:13:21.137749+0000","last_undegraded":"2024-03-04T13:13:21.137749+0000","last_fullsized":"2024-03-04T13:13:21.137749+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T12:36:02.154903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":39388,"num_write":1130,"num_write_kb":46394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"255'1082","reported_seq":2780,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.766506+0000","last_change":"2024-03-04T12:20:16.823981+0000","last_active":"2024-03-04T13:12:12.766506+0000","last_peered":"2024-03-04T13:12:12.766506+0000","last_clean":"2024-03-04T13:12:12.766506+0000","last_became_active":"2024-03-04T12:20:16.823596+0000","last_became_peered":"2024-03-04T12:20:16.823596+0000","last_unstale":"2024-03-04T13:12:12.766506+0000","last_undegraded":"2024-03-04T13:12:12.766506+0000","last_fullsized":"2024-03-04T13:12:12.766506+0000","mapping_epoch":22,"log_start":"255'1000","ondisk_log_start":"255'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":1000,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:37:17.796839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5087,"num_read_kb":4523,"num_write":1483,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"255'226","reported_seq":1076,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.234994+0000","last_change":"2024-03-04T12:20:14.818818+0000","last_active":"2024-03-04T13:13:21.234994+0000","last_peered":"2024-03-04T13:13:21.234994+0000","last_clean":"2024-03-04T13:13:21.234994+0000","last_became_active":"2024-03-04T12:20:14.818340+0000","last_became_peered":"2024-03-04T12:20:14.818340+0000","last_unstale":"2024-03-04T13:13:21.234994+0000","last_undegraded":"2024-03-04T13:13:21.234994+0000","last_fullsized":"2024-03-04T13:13:21.234994+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":933,"num_read_kb":21991,"num_write":1290,"num_write_kb":38918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"255'450","reported_seq":1994,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.304237+0000","last_change":"2024-03-04T12:20:16.830513+0000","last_active":"2024-03-04T13:12:31.304237+0000","last_peered":"2024-03-04T13:12:31.304237+0000","last_clean":"2024-03-04T13:12:31.304237+0000","last_became_active":"2024-03-04T12:20:16.830259+0000","last_became_peered":"2024-03-04T12:20:16.830259+0000","last_unstale":"2024-03-04T13:12:31.304237+0000","last_undegraded":"2024-03-04T13:12:31.304237+0000","last_fullsized":"2024-03-04T13:12:31.304237+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2206,"num_write":536,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"255'206","reported_seq":855,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.052457+0000","last_change":"2024-03-04T12:20:14.824797+0000","last_active":"2024-03-04T13:13:21.052457+0000","last_peered":"2024-03-04T13:13:21.052457+0000","last_clean":"2024-03-04T13:13:21.052457+0000","last_became_active":"2024-03-04T12:20:14.823513+0000","last_became_peered":"2024-03-04T12:20:14.823513+0000","last_unstale":"2024-03-04T13:13:21.052457+0000","last_undegraded":"2024-03-04T13:13:21.052457+0000","last_fullsized":"2024-03-04T13:13:21.052457+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:15:56.550416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706375,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":60209,"num_write":1193,"num_write_kb":41508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"255'752","reported_seq":2233,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:05.109559+0000","last_change":"2024-03-04T12:20:16.825790+0000","last_active":"2024-03-04T13:12:05.109559+0000","last_peered":"2024-03-04T13:12:05.109559+0000","last_clean":"2024-03-04T13:12:05.109559+0000","last_became_active":"2024-03-04T12:20:16.825534+0000","last_became_peered":"2024-03-04T12:20:16.825534+0000","last_unstale":"2024-03-04T13:12:05.109559+0000","last_undegraded":"2024-03-04T13:12:05.109559+0000","last_fullsized":"2024-03-04T13:12:05.109559+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3330,"num_read_kb":2980,"num_write":1004,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"255'222","reported_seq":831,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.081294+0000","last_change":"2024-03-04T12:20:14.817902+0000","last_active":"2024-03-04T13:13:21.081294+0000","last_peered":"2024-03-04T13:13:21.081294+0000","last_clean":"2024-03-04T13:13:21.081294+0000","last_became_active":"2024-03-04T12:20:14.817531+0000","last_became_peered":"2024-03-04T12:20:14.817531+0000","last_unstale":"2024-03-04T13:13:21.081294+0000","last_undegraded":"2024-03-04T13:13:21.081294+0000","last_fullsized":"2024-03-04T13:13:21.081294+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7696,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":19231,"num_write":1186,"num_write_kb":63143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"255'534","reported_seq":2108,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.452306+0000","last_change":"2024-03-04T12:20:16.823620+0000","last_active":"2024-03-04T13:12:07.452306+0000","last_peered":"2024-03-04T13:12:07.452306+0000","last_clean":"2024-03-04T13:12:07.452306+0000","last_became_active":"2024-03-04T12:20:16.823358+0000","last_became_peered":"2024-03-04T12:20:16.823358+0000","last_unstale":"2024-03-04T13:12:07.452306+0000","last_undegraded":"2024-03-04T13:12:07.452306+0000","last_fullsized":"2024-03-04T13:12:07.452306+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2875,"num_read_kb":2619,"num_write":718,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"255'185","reported_seq":790,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.122757+0000","last_change":"2024-03-04T12:20:50.902553+0000","last_active":"2024-03-04T13:13:21.122757+0000","last_peered":"2024-03-04T13:13:21.122757+0000","last_clean":"2024-03-04T13:13:21.122757+0000","last_became_active":"2024-03-04T12:20:50.902181+0000","last_became_peered":"2024-03-04T12:20:50.902181+0000","last_unstale":"2024-03-04T13:13:21.122757+0000","last_undegraded":"2024-03-04T13:13:21.122757+0000","last_fullsized":"2024-03-04T13:13:21.122757+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918078,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":20827,"num_write":1047,"num_write_kb":19608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"255'418","reported_seq":1797,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:02.516883+0000","last_change":"2024-03-04T12:20:16.819439+0000","last_active":"2024-03-04T13:12:02.516883+0000","last_peered":"2024-03-04T13:12:02.516883+0000","last_clean":"2024-03-04T13:12:02.516883+0000","last_became_active":"2024-03-04T12:20:16.819169+0000","last_became_peered":"2024-03-04T12:20:16.819169+0000","last_unstale":"2024-03-04T13:12:02.516883+0000","last_undegraded":"2024-03-04T13:12:02.516883+0000","last_fullsized":"2024-03-04T13:12:02.516883+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2116,"num_read_kb":1957,"num_write":522,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"255'172","reported_seq":788,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.052197+0000","last_change":"2024-03-04T12:20:14.823104+0000","last_active":"2024-03-04T13:13:21.052197+0000","last_peered":"2024-03-04T13:13:21.052197+0000","last_clean":"2024-03-04T13:13:21.052197+0000","last_became_active":"2024-03-04T12:20:14.822588+0000","last_became_peered":"2024-03-04T12:20:14.822588+0000","last_unstale":"2024-03-04T13:13:21.052197+0000","last_undegraded":"2024-03-04T13:13:21.052197+0000","last_fullsized":"2024-03-04T13:13:21.052197+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":390,"num_read_kb":47350,"num_write":1028,"num_write_kb":32429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"255'482","reported_seq":2025,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.558145+0000","last_change":"2024-03-04T12:20:16.828912+0000","last_active":"2024-03-04T13:12:22.558145+0000","last_peered":"2024-03-04T13:12:22.558145+0000","last_clean":"2024-03-04T13:12:22.558145+0000","last_became_active":"2024-03-04T12:20:16.828618+0000","last_became_peered":"2024-03-04T12:20:16.828618+0000","last_unstale":"2024-03-04T13:12:22.558145+0000","last_undegraded":"2024-03-04T13:12:22.558145+0000","last_fullsized":"2024-03-04T13:12:22.558145+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:00:24.695585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2516,"num_read_kb":2328,"num_write":610,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"255'180","reported_seq":910,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.206947+0000","last_change":"2024-03-04T12:20:14.819283+0000","last_active":"2024-03-04T13:13:21.206947+0000","last_peered":"2024-03-04T13:13:21.206947+0000","last_clean":"2024-03-04T13:13:21.206947+0000","last_became_active":"2024-03-04T12:20:14.818924+0000","last_became_peered":"2024-03-04T12:20:14.818924+0000","last_unstale":"2024-03-04T13:13:21.206947+0000","last_undegraded":"2024-03-04T13:13:21.206947+0000","last_fullsized":"2024-03-04T13:13:21.206947+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:41:49.091659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":719,"num_read_kb":26573,"num_write":1059,"num_write_kb":25938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"255'850","reported_seq":2379,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.801363+0000","last_change":"2024-03-04T12:20:16.835574+0000","last_active":"2024-03-04T13:12:34.801363+0000","last_peered":"2024-03-04T13:12:34.801363+0000","last_clean":"2024-03-04T13:12:34.801363+0000","last_became_active":"2024-03-04T12:20:16.835308+0000","last_became_peered":"2024-03-04T12:20:16.835308+0000","last_unstale":"2024-03-04T13:12:34.801363+0000","last_undegraded":"2024-03-04T13:12:34.801363+0000","last_fullsized":"2024-03-04T13:12:34.801363+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3917,"num_read_kb":3486,"num_write":1199,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"255'194","reported_seq":801,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.154246+0000","last_change":"2024-03-04T12:20:14.816730+0000","last_active":"2024-03-04T13:13:21.154246+0000","last_peered":"2024-03-04T13:13:21.154246+0000","last_clean":"2024-03-04T13:13:21.154246+0000","last_became_active":"2024-03-04T12:20:14.816440+0000","last_became_peered":"2024-03-04T12:20:14.816440+0000","last_unstale":"2024-03-04T13:13:21.154246+0000","last_undegraded":"2024-03-04T13:13:21.154246+0000","last_fullsized":"2024-03-04T13:13:21.154246+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:27:38.943831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17822208,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":392,"num_read_kb":7899,"num_write":1089,"num_write_kb":49946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"255'688","reported_seq":2009,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.328234+0000","last_change":"2024-03-04T12:20:16.828266+0000","last_active":"2024-03-04T13:12:39.328234+0000","last_peered":"2024-03-04T13:12:39.328234+0000","last_clean":"2024-03-04T13:12:39.328234+0000","last_became_active":"2024-03-04T12:20:16.827770+0000","last_became_peered":"2024-03-04T12:20:16.827770+0000","last_unstale":"2024-03-04T13:12:39.328234+0000","last_undegraded":"2024-03-04T13:12:39.328234+0000","last_fullsized":"2024-03-04T13:12:39.328234+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":600,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3073,"num_read_kb":2741,"num_write":929,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"255'191","reported_seq":799,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.154145+0000","last_change":"2024-03-04T12:20:14.820669+0000","last_active":"2024-03-04T13:13:21.154145+0000","last_peered":"2024-03-04T13:13:21.154145+0000","last_clean":"2024-03-04T13:13:21.154145+0000","last_became_active":"2024-03-04T12:20:14.820393+0000","last_became_peered":"2024-03-04T12:20:14.820393+0000","last_unstale":"2024-03-04T13:13:21.154145+0000","last_undegraded":"2024-03-04T13:13:21.154145+0000","last_fullsized":"2024-03-04T13:13:21.154145+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":6825,"num_write":1149,"num_write_kb":21389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"255'357","reported_seq":1774,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.573122+0000","last_change":"2024-03-04T12:20:16.829573+0000","last_active":"2024-03-04T13:12:50.573122+0000","last_peered":"2024-03-04T13:12:50.573122+0000","last_clean":"2024-03-04T13:12:50.573122+0000","last_became_active":"2024-03-04T12:20:16.829306+0000","last_became_peered":"2024-03-04T12:20:16.829306+0000","last_unstale":"2024-03-04T13:12:50.573122+0000","last_undegraded":"2024-03-04T13:12:50.573122+0000","last_fullsized":"2024-03-04T13:12:50.573122+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:34.297959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1952,"num_read_kb":1858,"num_write":426,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"255'171","reported_seq":773,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.129708+0000","last_change":"2024-03-04T12:20:14.823519+0000","last_active":"2024-03-04T13:13:21.129708+0000","last_peered":"2024-03-04T13:13:21.129708+0000","last_clean":"2024-03-04T13:13:21.129708+0000","last_became_active":"2024-03-04T12:20:14.821961+0000","last_became_peered":"2024-03-04T12:20:14.821961+0000","last_unstale":"2024-03-04T13:13:21.129708+0000","last_undegraded":"2024-03-04T13:13:21.129708+0000","last_fullsized":"2024-03-04T13:13:21.129708+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:18:49.422340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":395,"num_read_kb":13429,"num_write":876,"num_write_kb":50070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"255'154","reported_seq":723,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.154375+0000","last_change":"2024-03-04T12:20:51.031233+0000","last_active":"2024-03-04T13:13:21.154375+0000","last_peered":"2024-03-04T13:13:21.154375+0000","last_clean":"2024-03-04T13:13:21.154375+0000","last_became_active":"2024-03-04T12:20:51.030887+0000","last_became_peered":"2024-03-04T12:20:51.030887+0000","last_unstale":"2024-03-04T13:13:21.154375+0000","last_undegraded":"2024-03-04T13:13:21.154375+0000","last_fullsized":"2024-03-04T13:13:21.154375+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":307,"num_read_kb":55812,"num_write":877,"num_write_kb":48688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"255'385","reported_seq":1779,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.327978+0000","last_change":"2024-03-04T12:20:16.831651+0000","last_active":"2024-03-04T13:12:39.327978+0000","last_peered":"2024-03-04T13:12:39.327978+0000","last_clean":"2024-03-04T13:12:39.327978+0000","last_became_active":"2024-03-04T12:20:16.831393+0000","last_became_peered":"2024-03-04T12:20:16.831393+0000","last_unstale":"2024-03-04T13:12:39.327978+0000","last_undegraded":"2024-03-04T13:12:39.327978+0000","last_fullsized":"2024-03-04T13:12:39.327978+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2009,"num_read_kb":1888,"num_write":461,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"255'192","reported_seq":865,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.228542+0000","last_change":"2024-03-04T12:20:14.818169+0000","last_active":"2024-03-04T13:13:21.228542+0000","last_peered":"2024-03-04T13:13:21.228542+0000","last_clean":"2024-03-04T13:13:21.228542+0000","last_became_active":"2024-03-04T12:20:14.817894+0000","last_became_peered":"2024-03-04T12:20:14.817894+0000","last_unstale":"2024-03-04T13:13:21.228542+0000","last_undegraded":"2024-03-04T13:13:21.228542+0000","last_fullsized":"2024-03-04T13:13:21.228542+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":444,"num_read_kb":164272,"num_write":1071,"num_write_kb":63423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"255'517","reported_seq":1961,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.762307+0000","last_change":"2024-03-04T12:20:16.824278+0000","last_active":"2024-03-04T13:11:27.762307+0000","last_peered":"2024-03-04T13:11:27.762307+0000","last_clean":"2024-03-04T13:11:27.762307+0000","last_became_active":"2024-03-04T12:20:16.823974+0000","last_became_peered":"2024-03-04T12:20:16.823974+0000","last_unstale":"2024-03-04T13:11:27.762307+0000","last_undegraded":"2024-03-04T13:11:27.762307+0000","last_fullsized":"2024-03-04T13:11:27.762307+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:11:53.806735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2611,"num_read_kb":2352,"num_write":706,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":185523,"num_write":154,"num_write_kb":127147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5335,"num_read_kb":3794,"num_write":2149,"num_write_kb":803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1182,"ondisk_log_size":1182,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":10065,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":12124,"num_read_kb":11961,"num_write":14025,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":20130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2376,"ondisk_log_size":2376,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":260729,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8455,"num_read_kb":10448,"num_write":5923,"num_write_kb":2713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1916,"ondisk_log_size":1916,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1637,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1554,"num_read_kb":1549,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":187558,"num_read_kb":170512,"num_write":50934,"num_write_kb":17677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3785,"ondisk_log_size":3785,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":189749578,"num_objects":263,"num_object_clones":0,"num_object_copies":526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":263,"num_whiteouts":0,"num_read":29476,"num_read_kb":2152910,"num_write":68734,"num_write_kb":2157934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":381083648,"data_stored":379499156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4150,"ondisk_log_size":4150,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":196827,"num_write":154,"num_write_kb":127147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575493,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":278660,"kb_used_data":71104,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94093180,"statfs":{"total":96636764160,"available":96351416320,"internally_reserved":0,"allocated":72810496,"data_stored":71072930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212466122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575494,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274148,"kb_used_data":40240,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94097692,"statfs":{"total":96636764160,"available":96356036608,"internally_reserved":0,"allocated":41205760,"data_stored":39656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575494,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149900,"kb_used_data":68804,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94221940,"statfs":{"total":96636764160,"available":96483266560,"internally_reserved":0,"allocated":70455296,"data_stored":68729090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575493,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108236,"kb_used_data":40948,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94263604,"statfs":{"total":96636764160,"available":96525930496,"internally_reserved":0,"allocated":41930752,"data_stored":40369557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575493,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284164,"kb_used_data":76592,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94087676,"statfs":{"total":96636764160,"available":96345780224,"internally_reserved":0,"allocated":78430208,"data_stored":76690401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":212466119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575494,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119312,"kb_used_data":47864,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94252528,"statfs":{"total":96636764160,"available":96514588672,"internally_reserved":0,"allocated":49012736,"data_stored":47453483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575495,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":170940,"kb_used_data":59252,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94200900,"statfs":{"total":96636764160,"available":96461721600,"internally_reserved":0,"allocated":60674048,"data_stored":59087481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575492,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273196,"kb_used_data":61540,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94098644,"statfs":{"total":96636764160,"available":96357011456,"internally_reserved":0,"allocated":63016960,"data_stored":61377358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":47357952,"data_stored":47171521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50876416,"data_stored":50716133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45522944,"data_stored":45373582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":64413696,"data_stored":64121957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32161792,"data_stored":31999474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":56401920,"data_stored":56160984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21966848,"data_stored":21846112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":62382080,"data_stored":62109393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T13:13:28.863 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.863 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.863 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.863 INFO:tasks.ceph:pgid 64.1f last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.864 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.864 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.864 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.864 INFO:tasks.ceph:pgid 64.1e last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.864 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.865 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.865 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.865 INFO:tasks.ceph:pgid 64.1d last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.865 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.865 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.865 INFO:tasks.ceph:pgid 64.1c last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.866 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.866 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.866 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.866 INFO:tasks.ceph:pgid 64.1b last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.866 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.867 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.867 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.867 INFO:tasks.ceph:pgid 64.1a last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.867 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.867 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.867 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.868 INFO:tasks.ceph:pgid 64.19 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.868 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.868 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.868 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.868 INFO:tasks.ceph:pgid 64.18 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.869 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.869 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.869 INFO:tasks.ceph:pgid 64.17 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.869 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.870 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.870 INFO:tasks.ceph:pgid 64.16 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.870 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.870 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.870 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.871 INFO:tasks.ceph:pgid 64.15 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.871 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.871 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.871 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.871 INFO:tasks.ceph:pgid 64.14 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.871 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.872 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.872 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.872 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.872 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.872 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.873 INFO:tasks.ceph:pgid 64.12 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.873 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.873 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.873 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.873 INFO:tasks.ceph:pgid 64.11 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.873 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.874 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.874 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.874 INFO:tasks.ceph:pgid 64.10 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.874 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.874 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.874 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.875 INFO:tasks.ceph:pgid 64.f last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.875 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.875 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.875 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.875 INFO:tasks.ceph:pgid 64.e last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.876 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.876 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.876 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.877 INFO:tasks.ceph:pgid 64.d last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.877 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.877 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.877 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.877 INFO:tasks.ceph:pgid 64.c last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.877 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.878 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.878 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.878 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.878 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.878 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.878 INFO:tasks.ceph:pgid 64.a last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.879 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.879 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.879 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.879 INFO:tasks.ceph:pgid 64.9 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.879 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.879 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.880 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.880 INFO:tasks.ceph:pgid 64.8 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.880 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.880 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.880 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.880 INFO:tasks.ceph:pgid 64.7 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.881 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.881 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.881 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.881 INFO:tasks.ceph:pgid 64.6 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.881 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.881 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.882 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.882 INFO:tasks.ceph:pgid 64.5 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.882 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.882 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.882 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.883 INFO:tasks.ceph:pgid 64.4 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.883 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.883 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.883 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.883 INFO:tasks.ceph:pgid 64.3 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.884 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.884 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.884 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.884 INFO:tasks.ceph:pgid 64.2 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.884 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.884 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.885 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.885 INFO:tasks.ceph:pgid 64.1 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.885 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.885 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.885 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.885 INFO:tasks.ceph:pgid 64.0 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.886 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.886 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.886 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.886 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.886 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.886 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.887 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.887 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.887 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.887 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.887 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.887 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.888 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.888 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.888 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.888 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.888 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.888 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.889 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.889 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.889 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.889 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.889 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.890 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.890 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.890 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.890 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.890 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.891 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.891 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.891 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.891 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.891 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.891 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.892 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.892 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.892 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.892 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.892 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.893 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.893 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.893 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.893 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.893 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.893 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.894 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.894 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.894 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.894 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.894 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.895 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.895 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.895 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.895 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.895 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.895 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.896 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.896 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.896 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.896 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.897 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.897 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.897 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.897 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.897 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.897 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.898 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.898 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.898 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.898 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.898 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.899 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.899 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.899 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.899 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.899 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.899 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.900 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.900 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.900 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.900 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.900 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.900 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.901 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.901 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.901 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.901 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.901 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.901 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.902 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.902 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.902 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.902 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.902 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.902 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.903 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.903 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.903 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.903 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.903 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.904 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.904 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-04T12:19:57.750293+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=19, tm_sec=57, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.904 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-04T12:20:04.766258+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.904 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.904 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.904 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.905 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.905 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.905 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.905 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-04T12:20:04.766258+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.905 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.905 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.906 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.906 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.906 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.906 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.906 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-04T12:20:04.766258+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.906 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.907 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.907 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.907 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.907 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.907 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.907 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-04T12:20:04.766258+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.908 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.908 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.908 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.908 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.908 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.908 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.909 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.909 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-04T12:20:04.766258+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.909 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.909 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.909 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.909 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.910 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.910 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.910 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-04T12:20:04.766258+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.910 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.910 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.910 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.911 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.911 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.911 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.911 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-04T12:20:04.766258+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.911 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.911 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.912 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.912 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.912 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.912 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.912 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-04T12:20:04.766258+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.912 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.913 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.913 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.913 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.913 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.913 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.913 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.914 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.914 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.914 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.914 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.914 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.915 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.915 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.915 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.915 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.915 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.915 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.916 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.916 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.916 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.916 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.916 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.917 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.917 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.917 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.917 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.917 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.918 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.918 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.918 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.918 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.918 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.918 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.919 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.919 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.919 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.919 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.919 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.919 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.920 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.920 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.920 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.920 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.920 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.921 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.921 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.921 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.921 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.921 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.922 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.922 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.922 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.922 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.923 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.923 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.923 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.923 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.923 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.924 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.924 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.924 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.924 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.924 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.925 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.925 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.925 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.925 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.925 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.925 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.926 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.926 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.926 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.926 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.926 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.926 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.927 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.927 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.927 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.927 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.927 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.927 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.928 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.928 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.928 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.928 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.928 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.928 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.929 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.929 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.929 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.929 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.929 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.930 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.930 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.930 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.930 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.930 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.930 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.931 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.931 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.931 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.931 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.931 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.931 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.932 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.932 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.932 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.932 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.933 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.933 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.933 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:28.933 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-04T13:13:48.934 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T13:13:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:13:49.290 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-03-04T13:13:49.293 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":1863,"stamp":"2024-03-04T13:13:48.563533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":224166809,"num_objects":654,"num_object_clones":0,"num_object_copies":1308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":654,"num_whiteouts":0,"num_read":244903,"num_read_kb":2733632,"num_write":142264,"num_write_kb":2439961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":138619,"num_omap_keys":356,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13994,"ondisk_log_size":13994,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1658280,"kb_used_data":466344,"kb_used_omap":12,"kb_used_meta":1191859,"kb_avail":753316440,"statfs":{"total":773094113280,"available":771396034560,"internally_reserved":0,"allocated":477536256,"data_stored":464436620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1220464178},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":133114,"num_omap_keys":343,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004974"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:22.510049+0000","last_change":"2024-03-04T12:46:22.249796+0000","last_active":"2024-03-04T13:11:22.510049+0000","last_peered":"2024-03-04T13:11:22.510049+0000","last_clean":"2024-03-04T13:11:22.510049+0000","last_became_active":"2024-03-04T12:46:22.248352+0000","last_became_peered":"2024-03-04T12:46:22.248352+0000","last_unstale":"2024-03-04T13:11:22.510049+0000","last_undegraded":"2024-03-04T13:11:22.510049+0000","last_fullsized":"2024-03-04T13:11:22.510049+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.805565+0000","last_change":"2024-03-04T13:13:39.805588+0000","last_active":"2024-03-04T13:13:39.805565+0000","last_peered":"2024-03-04T13:13:39.805565+0000","last_clean":"2024-03-04T13:13:39.805565+0000","last_became_active":"2024-03-04T12:32:46.051177+0000","last_became_peered":"2024-03-04T12:32:46.051177+0000","last_unstale":"2024-03-04T13:13:39.805565+0000","last_undegraded":"2024-03-04T13:13:39.805565+0000","last_fullsized":"2024-03-04T13:13:39.805565+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:39.805434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:39.805434+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.805434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:35:27.485196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"255'2","reported_seq":52,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.195877+0000","last_change":"2024-03-04T12:32:42.034412+0000","last_active":"2024-03-04T13:13:21.195877+0000","last_peered":"2024-03-04T13:13:21.195877+0000","last_clean":"2024-03-04T13:13:21.195877+0000","last_became_active":"2024-03-04T12:32:42.034142+0000","last_became_peered":"2024-03-04T12:32:42.034142+0000","last_unstale":"2024-03-04T13:13:21.195877+0000","last_undegraded":"2024-03-04T13:13:21.195877+0000","last_fullsized":"2024-03-04T13:13:21.195877+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"255'17","reported_seq":99,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.898973+0000","last_change":"2024-03-04T13:13:29.899002+0000","last_active":"2024-03-04T13:13:29.898973+0000","last_peered":"2024-03-04T13:13:29.898973+0000","last_clean":"2024-03-04T13:13:29.898973+0000","last_became_active":"2024-03-04T12:29:01.702925+0000","last_became_peered":"2024-03-04T12:29:01.702925+0000","last_unstale":"2024-03-04T13:13:29.898973+0000","last_undegraded":"2024-03-04T13:13:29.898973+0000","last_fullsized":"2024-03-04T13:13:29.898973+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'17","last_scrub_stamp":"2024-03-04T13:13:29.898885+0000","last_deep_scrub":"255'17","last_deep_scrub_stamp":"2024-03-04T13:13:29.898885+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.898885+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:52:30.867951+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":40,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:22.364027+0000","last_change":"2024-03-04T12:46:22.258654+0000","last_active":"2024-03-04T13:11:22.364027+0000","last_peered":"2024-03-04T13:11:22.364027+0000","last_clean":"2024-03-04T13:11:22.364027+0000","last_became_active":"2024-03-04T12:46:22.258268+0000","last_became_peered":"2024-03-04T12:46:22.258268+0000","last_unstale":"2024-03-04T13:11:22.364027+0000","last_undegraded":"2024-03-04T13:11:22.364027+0000","last_fullsized":"2024-03-04T13:11:22.364027+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"255'11","reported_seq":68,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.130764+0000","last_change":"2024-03-04T12:32:46.052063+0000","last_active":"2024-03-04T13:13:21.130764+0000","last_peered":"2024-03-04T13:13:21.130764+0000","last_clean":"2024-03-04T13:13:21.130764+0000","last_became_active":"2024-03-04T12:32:46.051799+0000","last_became_peered":"2024-03-04T12:32:46.051799+0000","last_unstale":"2024-03-04T13:13:21.130764+0000","last_undegraded":"2024-03-04T13:13:21.130764+0000","last_fullsized":"2024-03-04T13:13:21.130764+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":43010,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"255'9","reported_seq":73,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.835628+0000","last_change":"2024-03-04T13:13:38.835666+0000","last_active":"2024-03-04T13:13:38.835628+0000","last_peered":"2024-03-04T13:13:38.835628+0000","last_clean":"2024-03-04T13:13:38.835628+0000","last_became_active":"2024-03-04T12:32:42.037701+0000","last_became_peered":"2024-03-04T12:32:42.037701+0000","last_unstale":"2024-03-04T13:13:38.835628+0000","last_undegraded":"2024-03-04T13:13:38.835628+0000","last_fullsized":"2024-03-04T13:13:38.835628+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'9","last_scrub_stamp":"2024-03-04T13:13:38.835529+0000","last_deep_scrub":"255'9","last_deep_scrub_stamp":"2024-03-04T13:13:38.835529+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.835529+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:14:22.983606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"255'28","reported_seq":128,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.924857+0000","last_change":"2024-03-04T13:13:31.924884+0000","last_active":"2024-03-04T13:13:31.924857+0000","last_peered":"2024-03-04T13:13:31.924857+0000","last_clean":"2024-03-04T13:13:31.924857+0000","last_became_active":"2024-03-04T12:29:01.701003+0000","last_became_peered":"2024-03-04T12:29:01.701003+0000","last_unstale":"2024-03-04T13:13:31.924857+0000","last_undegraded":"2024-03-04T13:13:31.924857+0000","last_fullsized":"2024-03-04T13:13:31.924857+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'28","last_scrub_stamp":"2024-03-04T13:13:31.924756+0000","last_deep_scrub":"255'28","last_deep_scrub_stamp":"2024-03-04T13:13:31.924756+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.924756+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:42:18.274244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":75,"num_write":51,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.467137+0000","last_change":"2024-03-04T12:46:22.308264+0000","last_active":"2024-03-04T13:12:27.467137+0000","last_peered":"2024-03-04T13:12:27.467137+0000","last_clean":"2024-03-04T13:12:27.467137+0000","last_became_active":"2024-03-04T12:46:22.307955+0000","last_became_peered":"2024-03-04T12:46:22.307955+0000","last_unstale":"2024-03-04T13:12:27.467137+0000","last_undegraded":"2024-03-04T13:12:27.467137+0000","last_fullsized":"2024-03-04T13:12:27.467137+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.311738+0000","last_change":"2024-03-04T13:13:45.311794+0000","last_active":"2024-03-04T13:13:45.311738+0000","last_peered":"2024-03-04T13:13:45.311738+0000","last_clean":"2024-03-04T13:13:45.311738+0000","last_became_active":"2024-03-04T12:32:46.053497+0000","last_became_peered":"2024-03-04T12:32:46.053497+0000","last_unstale":"2024-03-04T13:13:45.311738+0000","last_undegraded":"2024-03-04T13:13:45.311738+0000","last_fullsized":"2024-03-04T13:13:45.311738+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:45.311628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:45.311628+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.311628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:03.196481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"255'3","reported_seq":60,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.851594+0000","last_change":"2024-03-04T13:13:40.851637+0000","last_active":"2024-03-04T13:13:40.851594+0000","last_peered":"2024-03-04T13:13:40.851594+0000","last_clean":"2024-03-04T13:13:40.851594+0000","last_became_active":"2024-03-04T12:32:42.036801+0000","last_became_peered":"2024-03-04T12:32:42.036801+0000","last_unstale":"2024-03-04T13:13:40.851594+0000","last_undegraded":"2024-03-04T13:13:40.851594+0000","last_fullsized":"2024-03-04T13:13:40.851594+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'3","last_scrub_stamp":"2024-03-04T13:13:40.851505+0000","last_deep_scrub":"255'3","last_deep_scrub_stamp":"2024-03-04T13:13:40.851505+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.851505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:38.795174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"255'24","reported_seq":117,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.473413+0000","last_change":"2024-03-04T13:13:30.473471+0000","last_active":"2024-03-04T13:13:30.473413+0000","last_peered":"2024-03-04T13:13:30.473413+0000","last_clean":"2024-03-04T13:13:30.473413+0000","last_became_active":"2024-03-04T12:29:01.707589+0000","last_became_peered":"2024-03-04T12:29:01.707589+0000","last_unstale":"2024-03-04T13:13:30.473413+0000","last_undegraded":"2024-03-04T13:13:30.473413+0000","last_fullsized":"2024-03-04T13:13:30.473413+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'24","last_scrub_stamp":"2024-03-04T13:13:30.473283+0000","last_deep_scrub":"255'24","last_deep_scrub_stamp":"2024-03-04T13:13:30.473283+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.473283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:42:05.230338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":71,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260932+0000","last_change":"2024-03-04T12:46:22.310150+0000","last_active":"2024-03-04T13:13:25.260932+0000","last_peered":"2024-03-04T13:13:25.260932+0000","last_clean":"2024-03-04T13:13:25.260932+0000","last_became_active":"2024-03-04T12:46:22.309869+0000","last_became_peered":"2024-03-04T12:46:22.309869+0000","last_unstale":"2024-03-04T13:13:25.260932+0000","last_undegraded":"2024-03-04T13:13:25.260932+0000","last_fullsized":"2024-03-04T13:13:25.260932+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"255'3","reported_seq":46,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.109546+0000","last_change":"2024-03-04T12:32:46.057930+0000","last_active":"2024-03-04T13:13:21.109546+0000","last_peered":"2024-03-04T13:13:21.109546+0000","last_clean":"2024-03-04T13:13:21.109546+0000","last_became_active":"2024-03-04T12:32:46.057603+0000","last_became_peered":"2024-03-04T12:32:46.057603+0000","last_unstale":"2024-03-04T13:13:21.109546+0000","last_undegraded":"2024-03-04T13:13:21.109546+0000","last_fullsized":"2024-03-04T13:13:21.109546+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"250'3","reported_seq":59,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.892793+0000","last_change":"2024-03-04T13:13:25.892816+0000","last_active":"2024-03-04T13:13:25.892793+0000","last_peered":"2024-03-04T13:13:25.892793+0000","last_clean":"2024-03-04T13:13:25.892793+0000","last_became_active":"2024-03-04T12:32:42.032231+0000","last_became_peered":"2024-03-04T12:32:42.032231+0000","last_unstale":"2024-03-04T13:13:25.892793+0000","last_undegraded":"2024-03-04T13:13:25.892793+0000","last_fullsized":"2024-03-04T13:13:25.892793+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'3","last_scrub_stamp":"2024-03-04T13:13:25.892721+0000","last_deep_scrub":"250'3","last_deep_scrub_stamp":"2024-03-04T13:13:25.892721+0000","last_clean_scrub_stamp":"2024-03-04T13:13:25.892721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:39:35.803550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"255'27","reported_seq":120,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.733545+0000","last_change":"2024-03-04T13:13:29.733570+0000","last_active":"2024-03-04T13:13:29.733545+0000","last_peered":"2024-03-04T13:13:29.733545+0000","last_clean":"2024-03-04T13:13:29.733545+0000","last_became_active":"2024-03-04T12:29:01.704548+0000","last_became_peered":"2024-03-04T12:29:01.704548+0000","last_unstale":"2024-03-04T13:13:29.733545+0000","last_undegraded":"2024-03-04T13:13:29.733545+0000","last_fullsized":"2024-03-04T13:13:29.733545+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'27","last_scrub_stamp":"2024-03-04T13:13:29.733457+0000","last_deep_scrub":"255'27","last_deep_scrub_stamp":"2024-03-04T13:13:29.733457+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.733457+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:59:20.666916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":73,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.375711+0000","last_change":"2024-03-04T12:46:22.258204+0000","last_active":"2024-03-04T13:12:57.375711+0000","last_peered":"2024-03-04T13:12:57.375711+0000","last_clean":"2024-03-04T13:12:57.375711+0000","last_became_active":"2024-03-04T12:46:22.257894+0000","last_became_peered":"2024-03-04T12:46:22.257894+0000","last_unstale":"2024-03-04T13:12:57.375711+0000","last_undegraded":"2024-03-04T13:12:57.375711+0000","last_fullsized":"2024-03-04T13:12:57.375711+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:32.511747+0000","last_change":"2024-03-04T12:32:46.054248+0000","last_active":"2024-03-04T13:11:32.511747+0000","last_peered":"2024-03-04T13:11:32.511747+0000","last_clean":"2024-03-04T13:11:32.511747+0000","last_became_active":"2024-03-04T12:32:46.053946+0000","last_became_peered":"2024-03-04T12:32:46.053946+0000","last_unstale":"2024-03-04T13:11:32.511747+0000","last_undegraded":"2024-03-04T13:11:32.511747+0000","last_fullsized":"2024-03-04T13:11:32.511747+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"255'11","reported_seq":69,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.162920+0000","last_change":"2024-03-04T12:32:42.037699+0000","last_active":"2024-03-04T13:13:21.162920+0000","last_peered":"2024-03-04T13:13:21.162920+0000","last_clean":"2024-03-04T13:13:21.162920+0000","last_became_active":"2024-03-04T12:32:42.037387+0000","last_became_peered":"2024-03-04T12:32:42.037387+0000","last_unstale":"2024-03-04T13:13:21.162920+0000","last_undegraded":"2024-03-04T13:13:21.162920+0000","last_fullsized":"2024-03-04T13:13:21.162920+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":15,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"255'50","reported_seq":171,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.770038+0000","last_change":"2024-03-04T13:13:30.770069+0000","last_active":"2024-03-04T13:13:30.770038+0000","last_peered":"2024-03-04T13:13:30.770038+0000","last_clean":"2024-03-04T13:13:30.770038+0000","last_became_active":"2024-03-04T12:29:01.703815+0000","last_became_peered":"2024-03-04T12:29:01.703815+0000","last_unstale":"2024-03-04T13:13:30.770038+0000","last_undegraded":"2024-03-04T13:13:30.770038+0000","last_fullsized":"2024-03-04T13:13:30.770038+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'50","last_scrub_stamp":"2024-03-04T13:13:30.769938+0000","last_deep_scrub":"255'50","last_deep_scrub_stamp":"2024-03-04T13:13:30.769938+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.769938+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:53:25.528615+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":130,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:02.378675+0000","last_change":"2024-03-04T12:46:22.260813+0000","last_active":"2024-03-04T13:13:02.378675+0000","last_peered":"2024-03-04T13:13:02.378675+0000","last_clean":"2024-03-04T13:13:02.378675+0000","last_became_active":"2024-03-04T12:46:22.260529+0000","last_became_peered":"2024-03-04T12:46:22.260529+0000","last_unstale":"2024-03-04T13:13:02.378675+0000","last_undegraded":"2024-03-04T13:13:02.378675+0000","last_fullsized":"2024-03-04T13:13:02.378675+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"255'5","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.789176+0000","last_change":"2024-03-04T13:13:42.789202+0000","last_active":"2024-03-04T13:13:42.789176+0000","last_peered":"2024-03-04T13:13:42.789176+0000","last_clean":"2024-03-04T13:13:42.789176+0000","last_became_active":"2024-03-04T12:32:46.052388+0000","last_became_peered":"2024-03-04T12:32:46.052388+0000","last_unstale":"2024-03-04T13:13:42.789176+0000","last_undegraded":"2024-03-04T13:13:42.789176+0000","last_fullsized":"2024-03-04T13:13:42.789176+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'5","last_scrub_stamp":"2024-03-04T13:13:42.789090+0000","last_deep_scrub":"255'5","last_deep_scrub_stamp":"2024-03-04T13:13:42.789090+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.789090+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:23:38.166737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5160,"num_write":5,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"0'0","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.739807+0000","last_change":"2024-03-04T13:13:28.739826+0000","last_active":"2024-03-04T13:13:28.739807+0000","last_peered":"2024-03-04T13:13:28.739807+0000","last_clean":"2024-03-04T13:13:28.739807+0000","last_became_active":"2024-03-04T12:32:42.030804+0000","last_became_peered":"2024-03-04T12:32:42.030804+0000","last_unstale":"2024-03-04T13:13:28.739807+0000","last_undegraded":"2024-03-04T13:13:28.739807+0000","last_fullsized":"2024-03-04T13:13:28.739807+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:28.739734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:28.739734+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.739734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:08.931360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"255'35","reported_seq":137,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.518644+0000","last_change":"2024-03-04T13:13:33.518670+0000","last_active":"2024-03-04T13:13:33.518644+0000","last_peered":"2024-03-04T13:13:33.518644+0000","last_clean":"2024-03-04T13:13:33.518644+0000","last_became_active":"2024-03-04T12:29:01.703369+0000","last_became_peered":"2024-03-04T12:29:01.703369+0000","last_unstale":"2024-03-04T13:13:33.518644+0000","last_undegraded":"2024-03-04T13:13:33.518644+0000","last_fullsized":"2024-03-04T13:13:33.518644+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'35","last_scrub_stamp":"2024-03-04T13:13:33.518552+0000","last_deep_scrub":"255'35","last_deep_scrub_stamp":"2024-03-04T13:13:33.518552+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.518552+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:11:33.240744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":90,"num_write":62,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:22.459932+0000","last_change":"2024-03-04T12:46:22.256005+0000","last_active":"2024-03-04T13:11:22.459932+0000","last_peered":"2024-03-04T13:11:22.459932+0000","last_clean":"2024-03-04T13:11:22.459932+0000","last_became_active":"2024-03-04T12:46:22.255588+0000","last_became_peered":"2024-03-04T12:46:22.255588+0000","last_unstale":"2024-03-04T13:11:22.459932+0000","last_undegraded":"2024-03-04T13:11:22.459932+0000","last_fullsized":"2024-03-04T13:11:22.459932+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"255'6","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.042670+0000","last_change":"2024-03-04T12:32:46.057798+0000","last_active":"2024-03-04T13:13:21.042670+0000","last_peered":"2024-03-04T13:13:21.042670+0000","last_clean":"2024-03-04T13:13:21.042670+0000","last_became_active":"2024-03-04T12:32:46.057413+0000","last_became_peered":"2024-03-04T12:32:46.057413+0000","last_unstale":"2024-03-04T13:13:21.042670+0000","last_undegraded":"2024-03-04T13:13:21.042670+0000","last_fullsized":"2024-03-04T13:13:21.042670+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"255'9","reported_seq":67,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.777160+0000","last_change":"2024-03-04T13:13:27.777160+0000","last_active":"2024-03-04T13:13:27.777160+0000","last_peered":"2024-03-04T13:13:27.777160+0000","last_clean":"2024-03-04T13:13:27.777160+0000","last_became_active":"2024-03-04T12:32:42.031099+0000","last_became_peered":"2024-03-04T12:32:42.031099+0000","last_unstale":"2024-03-04T13:13:27.777160+0000","last_undegraded":"2024-03-04T13:13:27.777160+0000","last_fullsized":"2024-03-04T13:13:27.777160+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'9","last_scrub_stamp":"2024-03-04T13:13:27.777060+0000","last_deep_scrub":"255'9","last_deep_scrub_stamp":"2024-03-04T13:13:27.777060+0000","last_clean_scrub_stamp":"2024-03-04T13:13:27.777060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:59:51.492042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"255'41","reported_seq":148,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.792075+0000","last_change":"2024-03-04T13:13:31.792100+0000","last_active":"2024-03-04T13:13:31.792075+0000","last_peered":"2024-03-04T13:13:31.792075+0000","last_clean":"2024-03-04T13:13:31.792075+0000","last_became_active":"2024-03-04T12:29:01.700917+0000","last_became_peered":"2024-03-04T12:29:01.700917+0000","last_unstale":"2024-03-04T13:13:31.792075+0000","last_undegraded":"2024-03-04T13:13:31.792075+0000","last_fullsized":"2024-03-04T13:13:31.792075+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'41","last_scrub_stamp":"2024-03-04T13:13:31.791978+0000","last_deep_scrub":"255'41","last_deep_scrub_stamp":"2024-03-04T13:13:31.791978+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.791978+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:10.471705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":100,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":27,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:22.488123+0000","last_change":"2024-03-04T12:46:22.256121+0000","last_active":"2024-03-04T13:11:22.488123+0000","last_peered":"2024-03-04T13:11:22.488123+0000","last_clean":"2024-03-04T13:11:22.488123+0000","last_became_active":"2024-03-04T12:46:22.255812+0000","last_became_peered":"2024-03-04T12:46:22.255812+0000","last_unstale":"2024-03-04T13:11:22.488123+0000","last_undegraded":"2024-03-04T13:11:22.488123+0000","last_fullsized":"2024-03-04T13:11:22.488123+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.525088+0000","last_change":"2024-03-04T12:32:46.053933+0000","last_active":"2024-03-04T13:12:47.525088+0000","last_peered":"2024-03-04T13:12:47.525088+0000","last_clean":"2024-03-04T13:12:47.525088+0000","last_became_active":"2024-03-04T12:32:46.053172+0000","last_became_peered":"2024-03-04T12:32:46.053172+0000","last_unstale":"2024-03-04T13:12:47.525088+0000","last_undegraded":"2024-03-04T13:12:47.525088+0000","last_fullsized":"2024-03-04T13:12:47.525088+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"255'5","reported_seq":62,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.864960+0000","last_change":"2024-03-04T13:13:34.864986+0000","last_active":"2024-03-04T13:13:34.864960+0000","last_peered":"2024-03-04T13:13:34.864960+0000","last_clean":"2024-03-04T13:13:34.864960+0000","last_became_active":"2024-03-04T12:32:42.033315+0000","last_became_peered":"2024-03-04T12:32:42.033315+0000","last_unstale":"2024-03-04T13:13:34.864960+0000","last_undegraded":"2024-03-04T13:13:34.864960+0000","last_fullsized":"2024-03-04T13:13:34.864960+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'5","last_scrub_stamp":"2024-03-04T13:13:34.864868+0000","last_deep_scrub":"255'5","last_deep_scrub_stamp":"2024-03-04T13:13:34.864868+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.864868+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:03:00.925083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5136,"num_write":5,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"255'18","reported_seq":105,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.284800+0000","last_change":"2024-03-04T13:13:39.284829+0000","last_active":"2024-03-04T13:13:39.284800+0000","last_peered":"2024-03-04T13:13:39.284800+0000","last_clean":"2024-03-04T13:13:39.284800+0000","last_became_active":"2024-03-04T12:29:01.706695+0000","last_became_peered":"2024-03-04T12:29:01.706695+0000","last_unstale":"2024-03-04T13:13:39.284800+0000","last_undegraded":"2024-03-04T13:13:39.284800+0000","last_fullsized":"2024-03-04T13:13:39.284800+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'18","last_scrub_stamp":"2024-03-04T13:13:39.284703+0000","last_deep_scrub":"255'18","last_deep_scrub_stamp":"2024-03-04T13:13:39.284703+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.284703+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:36:15.492735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":54,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"252'1","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:37.461823+0000","last_change":"2024-03-04T12:46:51.979336+0000","last_active":"2024-03-04T13:12:37.461823+0000","last_peered":"2024-03-04T13:12:37.461823+0000","last_clean":"2024-03-04T13:12:37.461823+0000","last_became_active":"2024-03-04T12:46:51.977076+0000","last_became_peered":"2024-03-04T12:46:51.977076+0000","last_unstale":"2024-03-04T13:12:37.461823+0000","last_undegraded":"2024-03-04T13:12:37.461823+0000","last_fullsized":"2024-03-04T13:12:37.461823+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.510955+0000","last_change":"2024-03-04T12:32:46.056068+0000","last_active":"2024-03-04T13:11:27.510955+0000","last_peered":"2024-03-04T13:11:27.510955+0000","last_clean":"2024-03-04T13:11:27.510955+0000","last_became_active":"2024-03-04T12:32:46.055692+0000","last_became_peered":"2024-03-04T12:32:46.055692+0000","last_unstale":"2024-03-04T13:11:27.510955+0000","last_undegraded":"2024-03-04T13:11:27.510955+0000","last_fullsized":"2024-03-04T13:11:27.510955+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.729125+0000","last_change":"2024-03-04T13:13:26.729125+0000","last_active":"2024-03-04T13:13:26.729125+0000","last_peered":"2024-03-04T13:13:26.729125+0000","last_clean":"2024-03-04T13:13:26.729125+0000","last_became_active":"2024-03-04T12:32:42.029940+0000","last_became_peered":"2024-03-04T12:32:42.029940+0000","last_unstale":"2024-03-04T13:13:26.729125+0000","last_undegraded":"2024-03-04T13:13:26.729125+0000","last_fullsized":"2024-03-04T13:13:26.729125+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:26.729003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:26.729003+0000","last_clean_scrub_stamp":"2024-03-04T13:13:26.729003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:20.396814+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"255'31","reported_seq":127,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.750911+0000","last_change":"2024-03-04T13:13:35.750956+0000","last_active":"2024-03-04T13:13:35.750911+0000","last_peered":"2024-03-04T13:13:35.750911+0000","last_clean":"2024-03-04T13:13:35.750911+0000","last_became_active":"2024-03-04T12:29:01.701379+0000","last_became_peered":"2024-03-04T12:29:01.701379+0000","last_unstale":"2024-03-04T13:13:35.750911+0000","last_undegraded":"2024-03-04T13:13:35.750911+0000","last_fullsized":"2024-03-04T13:13:35.750911+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'31","last_scrub_stamp":"2024-03-04T13:13:35.750794+0000","last_deep_scrub":"255'31","last_deep_scrub_stamp":"2024-03-04T13:13:35.750794+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.750794+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:08:34.744668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":79,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.470218+0000","last_change":"2024-03-04T12:46:22.309007+0000","last_active":"2024-03-04T13:12:57.470218+0000","last_peered":"2024-03-04T13:12:57.470218+0000","last_clean":"2024-03-04T13:12:57.470218+0000","last_became_active":"2024-03-04T12:46:22.308714+0000","last_became_peered":"2024-03-04T12:46:22.308714+0000","last_unstale":"2024-03-04T13:12:57.470218+0000","last_undegraded":"2024-03-04T13:12:57.470218+0000","last_fullsized":"2024-03-04T13:12:57.470218+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"255'6","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.108765+0000","last_change":"2024-03-04T12:32:46.052223+0000","last_active":"2024-03-04T13:13:21.108765+0000","last_peered":"2024-03-04T13:13:21.108765+0000","last_clean":"2024-03-04T13:13:21.108765+0000","last_became_active":"2024-03-04T12:32:46.051926+0000","last_became_peered":"2024-03-04T12:32:46.051926+0000","last_unstale":"2024-03-04T13:13:21.108765+0000","last_undegraded":"2024-03-04T13:13:21.108765+0000","last_fullsized":"2024-03-04T13:13:21.108765+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.896414+0000","last_change":"2024-03-04T13:13:26.896414+0000","last_active":"2024-03-04T13:13:26.896414+0000","last_peered":"2024-03-04T13:13:26.896414+0000","last_clean":"2024-03-04T13:13:26.896414+0000","last_became_active":"2024-03-04T12:32:42.034301+0000","last_became_peered":"2024-03-04T12:32:42.034301+0000","last_unstale":"2024-03-04T13:13:26.896414+0000","last_undegraded":"2024-03-04T13:13:26.896414+0000","last_fullsized":"2024-03-04T13:13:26.896414+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:26.896317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:26.896317+0000","last_clean_scrub_stamp":"2024-03-04T13:13:26.896317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:03.628863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"255'133","reported_seq":435,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.767287+0000","last_change":"2024-03-04T13:13:32.767316+0000","last_active":"2024-03-04T13:13:32.767287+0000","last_peered":"2024-03-04T13:13:32.767287+0000","last_clean":"2024-03-04T13:13:32.767287+0000","last_became_active":"2024-03-04T12:29:01.703239+0000","last_became_peered":"2024-03-04T12:29:01.703239+0000","last_unstale":"2024-03-04T13:13:32.767287+0000","last_undegraded":"2024-03-04T13:13:32.767287+0000","last_fullsized":"2024-03-04T13:13:32.767287+0000","mapping_epoch":242,"log_start":"255'100","ondisk_log_start":"255'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'133","last_scrub_stamp":"2024-03-04T13:13:32.767201+0000","last_deep_scrub":"255'133","last_deep_scrub_stamp":"2024-03-04T13:13:32.767201+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.767201+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:40:30.355080+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":704,"num_read_kb":496,"num_write":192,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1980,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.526999+0000","last_change":"2024-03-04T12:46:22.259911+0000","last_active":"2024-03-04T13:12:57.526999+0000","last_peered":"2024-03-04T13:12:57.526999+0000","last_clean":"2024-03-04T13:12:57.526999+0000","last_became_active":"2024-03-04T12:46:22.259424+0000","last_became_peered":"2024-03-04T12:46:22.259424+0000","last_unstale":"2024-03-04T13:12:57.526999+0000","last_undegraded":"2024-03-04T13:12:57.526999+0000","last_fullsized":"2024-03-04T13:12:57.526999+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"250'5","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.453778+0000","last_change":"2024-03-04T12:32:46.057250+0000","last_active":"2024-03-04T13:11:27.453778+0000","last_peered":"2024-03-04T13:11:27.453778+0000","last_clean":"2024-03-04T13:11:27.453778+0000","last_became_active":"2024-03-04T12:32:46.056976+0000","last_became_peered":"2024-03-04T12:32:46.056976+0000","last_unstale":"2024-03-04T13:11:27.453778+0000","last_undegraded":"2024-03-04T13:11:27.453778+0000","last_fullsized":"2024-03-04T13:11:27.453778+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.491085+0000","last_change":"2024-03-04T13:13:35.491108+0000","last_active":"2024-03-04T13:13:35.491085+0000","last_peered":"2024-03-04T13:13:35.491085+0000","last_clean":"2024-03-04T13:13:35.491085+0000","last_became_active":"2024-03-04T12:32:42.036694+0000","last_became_peered":"2024-03-04T12:32:42.036694+0000","last_unstale":"2024-03-04T13:13:35.491085+0000","last_undegraded":"2024-03-04T13:13:35.491085+0000","last_fullsized":"2024-03-04T13:13:35.491085+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:35.490995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:35.490995+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.490995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:33:18.682539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"255'13","reported_seq":78,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:32.454767+0000","last_change":"2024-03-04T12:29:01.706751+0000","last_active":"2024-03-04T13:12:32.454767+0000","last_peered":"2024-03-04T13:12:32.454767+0000","last_clean":"2024-03-04T13:12:32.454767+0000","last_became_active":"2024-03-04T12:29:01.706467+0000","last_became_peered":"2024-03-04T12:29:01.706467+0000","last_unstale":"2024-03-04T13:12:32.454767+0000","last_undegraded":"2024-03-04T13:12:32.454767+0000","last_fullsized":"2024-03-04T13:12:32.454767+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:29:00.682919+0000","last_clean_scrub_stamp":"2024-03-04T12:29:00.682919+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.470245+0000","last_change":"2024-03-04T12:46:22.311206+0000","last_active":"2024-03-04T13:12:57.470245+0000","last_peered":"2024-03-04T13:12:57.470245+0000","last_clean":"2024-03-04T13:12:57.470245+0000","last_became_active":"2024-03-04T12:46:22.310952+0000","last_became_peered":"2024-03-04T12:46:22.310952+0000","last_unstale":"2024-03-04T13:12:57.470245+0000","last_undegraded":"2024-03-04T13:12:57.470245+0000","last_fullsized":"2024-03-04T13:12:57.470245+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"250'3","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:27.447918+0000","last_change":"2024-03-04T12:32:46.055077+0000","last_active":"2024-03-04T13:11:27.447918+0000","last_peered":"2024-03-04T13:11:27.447918+0000","last_clean":"2024-03-04T13:11:27.447918+0000","last_became_active":"2024-03-04T12:32:46.054752+0000","last_became_peered":"2024-03-04T12:32:46.054752+0000","last_unstale":"2024-03-04T13:11:27.447918+0000","last_undegraded":"2024-03-04T13:11:27.447918+0000","last_fullsized":"2024-03-04T13:11:27.447918+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"255'2","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.179453+0000","last_change":"2024-03-04T12:32:42.034215+0000","last_active":"2024-03-04T13:13:26.179453+0000","last_peered":"2024-03-04T13:13:26.179453+0000","last_clean":"2024-03-04T13:13:26.179453+0000","last_became_active":"2024-03-04T12:32:42.033898+0000","last_became_peered":"2024-03-04T12:32:42.033898+0000","last_unstale":"2024-03-04T13:13:26.179453+0000","last_undegraded":"2024-03-04T13:13:26.179453+0000","last_fullsized":"2024-03-04T13:13:26.179453+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"255'43","reported_seq":157,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.763641+0000","last_change":"2024-03-04T13:13:28.763662+0000","last_active":"2024-03-04T13:13:28.763641+0000","last_peered":"2024-03-04T13:13:28.763641+0000","last_clean":"2024-03-04T13:13:28.763641+0000","last_became_active":"2024-03-04T12:29:01.705183+0000","last_became_peered":"2024-03-04T12:29:01.705183+0000","last_unstale":"2024-03-04T13:13:28.763641+0000","last_undegraded":"2024-03-04T13:13:28.763641+0000","last_fullsized":"2024-03-04T13:13:28.763641+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'43","last_scrub_stamp":"2024-03-04T13:13:28.763573+0000","last_deep_scrub":"255'43","last_deep_scrub_stamp":"2024-03-04T13:13:28.763573+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.763573+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:05:44.132843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":113,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:02.554403+0000","last_change":"2024-03-04T12:46:22.246381+0000","last_active":"2024-03-04T13:12:02.554403+0000","last_peered":"2024-03-04T13:12:02.554403+0000","last_clean":"2024-03-04T13:12:02.554403+0000","last_became_active":"2024-03-04T12:46:22.245967+0000","last_became_peered":"2024-03-04T12:46:22.245967+0000","last_unstale":"2024-03-04T13:12:02.554403+0000","last_undegraded":"2024-03-04T13:12:02.554403+0000","last_fullsized":"2024-03-04T13:12:02.554403+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.837625+0000","last_change":"2024-03-04T13:13:44.837667+0000","last_active":"2024-03-04T13:13:44.837625+0000","last_peered":"2024-03-04T13:13:44.837625+0000","last_clean":"2024-03-04T13:13:44.837625+0000","last_became_active":"2024-03-04T12:32:46.051360+0000","last_became_peered":"2024-03-04T12:32:46.051360+0000","last_unstale":"2024-03-04T13:13:44.837625+0000","last_undegraded":"2024-03-04T13:13:44.837625+0000","last_fullsized":"2024-03-04T13:13:44.837625+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:44.837523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:44.837523+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.837523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:16:12.218508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.885950+0000","last_change":"2024-03-04T13:13:28.885984+0000","last_active":"2024-03-04T13:13:28.885950+0000","last_peered":"2024-03-04T13:13:28.885950+0000","last_clean":"2024-03-04T13:13:28.885950+0000","last_became_active":"2024-03-04T12:32:42.029559+0000","last_became_peered":"2024-03-04T12:32:42.029559+0000","last_unstale":"2024-03-04T13:13:28.885950+0000","last_undegraded":"2024-03-04T13:13:28.885950+0000","last_fullsized":"2024-03-04T13:13:28.885950+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:28.885848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:28.885848+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.885848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:11.309661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"250'28","reported_seq":125,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.108278+0000","last_change":"2024-03-04T13:13:27.108303+0000","last_active":"2024-03-04T13:13:27.108278+0000","last_peered":"2024-03-04T13:13:27.108278+0000","last_clean":"2024-03-04T13:13:27.108278+0000","last_became_active":"2024-03-04T12:29:01.705726+0000","last_became_peered":"2024-03-04T12:29:01.705726+0000","last_unstale":"2024-03-04T13:13:27.108278+0000","last_undegraded":"2024-03-04T13:13:27.108278+0000","last_fullsized":"2024-03-04T13:13:27.108278+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'28","last_scrub_stamp":"2024-03-04T13:13:27.108190+0000","last_deep_scrub":"250'28","last_deep_scrub_stamp":"2024-03-04T13:13:27.108190+0000","last_clean_scrub_stamp":"2024-03-04T13:13:27.108190+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:54:20.406412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":49,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:02.554435+0000","last_change":"2024-03-04T12:46:22.259972+0000","last_active":"2024-03-04T13:12:02.554435+0000","last_peered":"2024-03-04T13:12:02.554435+0000","last_clean":"2024-03-04T13:12:02.554435+0000","last_became_active":"2024-03-04T12:46:22.259134+0000","last_became_peered":"2024-03-04T12:46:22.259134+0000","last_unstale":"2024-03-04T13:12:02.554435+0000","last_undegraded":"2024-03-04T13:12:02.554435+0000","last_fullsized":"2024-03-04T13:12:02.554435+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.245109+0000","last_change":"2024-03-04T13:13:41.245131+0000","last_active":"2024-03-04T13:13:41.245109+0000","last_peered":"2024-03-04T13:13:41.245109+0000","last_clean":"2024-03-04T13:13:41.245109+0000","last_became_active":"2024-03-04T12:32:46.053156+0000","last_became_peered":"2024-03-04T12:32:46.053156+0000","last_unstale":"2024-03-04T13:13:41.245109+0000","last_undegraded":"2024-03-04T13:13:41.245109+0000","last_fullsized":"2024-03-04T13:13:41.245109+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:41.245016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:41.245016+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.245016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:45.065185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"255'11","reported_seq":79,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.531852+0000","last_change":"2024-03-04T13:13:31.531887+0000","last_active":"2024-03-04T13:13:31.531852+0000","last_peered":"2024-03-04T13:13:31.531852+0000","last_clean":"2024-03-04T13:13:31.531852+0000","last_became_active":"2024-03-04T12:32:42.036617+0000","last_became_peered":"2024-03-04T12:32:42.036617+0000","last_unstale":"2024-03-04T13:13:31.531852+0000","last_undegraded":"2024-03-04T13:13:31.531852+0000","last_fullsized":"2024-03-04T13:13:31.531852+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'11","last_scrub_stamp":"2024-03-04T13:13:31.531774+0000","last_deep_scrub":"255'11","last_deep_scrub_stamp":"2024-03-04T13:13:31.531774+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.531774+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:53:09.775484+0000","scrub_duration":64,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":29698,"num_write":14,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"255'17","reported_seq":103,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.199388+0000","last_change":"2024-03-04T13:13:31.199414+0000","last_active":"2024-03-04T13:13:31.199388+0000","last_peered":"2024-03-04T13:13:31.199388+0000","last_clean":"2024-03-04T13:13:31.199388+0000","last_became_active":"2024-03-04T12:29:01.701712+0000","last_became_peered":"2024-03-04T12:29:01.701712+0000","last_unstale":"2024-03-04T13:13:31.199388+0000","last_undegraded":"2024-03-04T13:13:31.199388+0000","last_fullsized":"2024-03-04T13:13:31.199388+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'17","last_scrub_stamp":"2024-03-04T13:13:31.199260+0000","last_deep_scrub":"255'17","last_deep_scrub_stamp":"2024-03-04T13:13:31.199260+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.199260+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:34:49.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":51,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:02.494130+0000","last_change":"2024-03-04T12:46:22.257008+0000","last_active":"2024-03-04T13:12:02.494130+0000","last_peered":"2024-03-04T13:12:02.494130+0000","last_clean":"2024-03-04T13:12:02.494130+0000","last_became_active":"2024-03-04T12:46:22.256617+0000","last_became_peered":"2024-03-04T12:46:22.256617+0000","last_unstale":"2024-03-04T13:12:02.494130+0000","last_undegraded":"2024-03-04T13:12:02.494130+0000","last_fullsized":"2024-03-04T13:12:02.494130+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":40,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.373556+0000","last_change":"2024-03-04T12:32:46.053973+0000","last_active":"2024-03-04T13:12:27.373556+0000","last_peered":"2024-03-04T13:12:27.373556+0000","last_clean":"2024-03-04T13:12:27.373556+0000","last_became_active":"2024-03-04T12:32:46.053272+0000","last_became_peered":"2024-03-04T12:32:46.053272+0000","last_unstale":"2024-03-04T13:12:27.373556+0000","last_undegraded":"2024-03-04T13:12:27.373556+0000","last_fullsized":"2024-03-04T13:12:27.373556+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.811500+0000","last_change":"2024-03-04T13:13:36.811535+0000","last_active":"2024-03-04T13:13:36.811500+0000","last_peered":"2024-03-04T13:13:36.811500+0000","last_clean":"2024-03-04T13:13:36.811500+0000","last_became_active":"2024-03-04T12:32:42.035923+0000","last_became_peered":"2024-03-04T12:32:42.035923+0000","last_unstale":"2024-03-04T13:13:36.811500+0000","last_undegraded":"2024-03-04T13:13:36.811500+0000","last_fullsized":"2024-03-04T13:13:36.811500+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:36.811383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:36.811383+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.811383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:30.024857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"255'34","reported_seq":140,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.066169+0000","last_change":"2024-03-04T13:13:28.066241+0000","last_active":"2024-03-04T13:13:28.066169+0000","last_peered":"2024-03-04T13:13:28.066169+0000","last_clean":"2024-03-04T13:13:28.066169+0000","last_became_active":"2024-03-04T12:29:01.702327+0000","last_became_peered":"2024-03-04T12:29:01.702327+0000","last_unstale":"2024-03-04T13:13:28.066169+0000","last_undegraded":"2024-03-04T13:13:28.066169+0000","last_fullsized":"2024-03-04T13:13:28.066169+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'34","last_scrub_stamp":"2024-03-04T13:13:28.066051+0000","last_deep_scrub":"255'34","last_deep_scrub_stamp":"2024-03-04T13:13:28.066051+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.066051+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:49:40.472474+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"252'1","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:02.464260+0000","last_change":"2024-03-04T12:46:22.258104+0000","last_active":"2024-03-04T13:12:02.464260+0000","last_peered":"2024-03-04T13:12:02.464260+0000","last_clean":"2024-03-04T13:12:02.464260+0000","last_became_active":"2024-03-04T12:46:22.257651+0000","last_became_peered":"2024-03-04T12:46:22.257651+0000","last_unstale":"2024-03-04T13:12:02.464260+0000","last_undegraded":"2024-03-04T13:12:02.464260+0000","last_fullsized":"2024-03-04T13:12:02.464260+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"250'7","reported_seq":59,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.497449+0000","last_change":"2024-03-04T12:32:46.049805+0000","last_active":"2024-03-04T13:12:27.497449+0000","last_peered":"2024-03-04T13:12:27.497449+0000","last_clean":"2024-03-04T13:12:27.497449+0000","last_became_active":"2024-03-04T12:32:46.049512+0000","last_became_peered":"2024-03-04T12:32:46.049512+0000","last_unstale":"2024-03-04T13:12:27.497449+0000","last_undegraded":"2024-03-04T13:12:27.497449+0000","last_fullsized":"2024-03-04T13:12:27.497449+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":11,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.176706+0000","last_change":"2024-03-04T13:13:33.176739+0000","last_active":"2024-03-04T13:13:33.176706+0000","last_peered":"2024-03-04T13:13:33.176706+0000","last_clean":"2024-03-04T13:13:33.176706+0000","last_became_active":"2024-03-04T12:32:42.032034+0000","last_became_peered":"2024-03-04T12:32:42.032034+0000","last_unstale":"2024-03-04T13:13:33.176706+0000","last_undegraded":"2024-03-04T13:13:33.176706+0000","last_fullsized":"2024-03-04T13:13:33.176706+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:33.176621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:33.176621+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.176621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:55:03.666432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"255'51","reported_seq":179,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.787605+0000","last_change":"2024-03-04T13:13:29.787646+0000","last_active":"2024-03-04T13:13:29.787605+0000","last_peered":"2024-03-04T13:13:29.787605+0000","last_clean":"2024-03-04T13:13:29.787605+0000","last_became_active":"2024-03-04T12:29:01.703361+0000","last_became_peered":"2024-03-04T12:29:01.703361+0000","last_unstale":"2024-03-04T13:13:29.787605+0000","last_undegraded":"2024-03-04T13:13:29.787605+0000","last_fullsized":"2024-03-04T13:13:29.787605+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'51","last_scrub_stamp":"2024-03-04T13:13:29.787500+0000","last_deep_scrub":"255'51","last_deep_scrub_stamp":"2024-03-04T13:13:29.787500+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.787500+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:39:42.421288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":146,"num_write":83,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"253'1","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:22.473142+0000","last_change":"2024-03-04T12:46:22.255919+0000","last_active":"2024-03-04T13:13:22.473142+0000","last_peered":"2024-03-04T13:13:22.473142+0000","last_clean":"2024-03-04T13:13:22.473142+0000","last_became_active":"2024-03-04T12:46:22.255498+0000","last_became_peered":"2024-03-04T12:46:22.255498+0000","last_unstale":"2024-03-04T13:13:22.473142+0000","last_undegraded":"2024-03-04T13:13:22.473142+0000","last_fullsized":"2024-03-04T13:13:22.473142+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"255'2","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.136919+0000","last_change":"2024-03-04T12:32:46.059035+0000","last_active":"2024-03-04T13:13:21.136919+0000","last_peered":"2024-03-04T13:13:21.136919+0000","last_clean":"2024-03-04T13:13:21.136919+0000","last_became_active":"2024-03-04T12:32:46.058792+0000","last_became_peered":"2024-03-04T12:32:46.058792+0000","last_unstale":"2024-03-04T13:13:21.136919+0000","last_undegraded":"2024-03-04T13:13:21.136919+0000","last_fullsized":"2024-03-04T13:13:21.136919+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.380133+0000","last_change":"2024-03-04T12:32:42.036922+0000","last_active":"2024-03-04T13:13:12.380133+0000","last_peered":"2024-03-04T13:13:12.380133+0000","last_clean":"2024-03-04T13:13:12.380133+0000","last_became_active":"2024-03-04T12:32:42.036427+0000","last_became_peered":"2024-03-04T12:32:42.036427+0000","last_unstale":"2024-03-04T13:13:12.380133+0000","last_undegraded":"2024-03-04T13:13:12.380133+0000","last_fullsized":"2024-03-04T13:13:12.380133+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"255'56","reported_seq":186,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.313213+0000","last_change":"2024-03-04T13:13:35.313241+0000","last_active":"2024-03-04T13:13:35.313213+0000","last_peered":"2024-03-04T13:13:35.313213+0000","last_clean":"2024-03-04T13:13:35.313213+0000","last_became_active":"2024-03-04T12:29:01.706666+0000","last_became_peered":"2024-03-04T12:29:01.706666+0000","last_unstale":"2024-03-04T13:13:35.313213+0000","last_undegraded":"2024-03-04T13:13:35.313213+0000","last_fullsized":"2024-03-04T13:13:35.313213+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'56","last_scrub_stamp":"2024-03-04T13:13:35.313119+0000","last_deep_scrub":"255'56","last_deep_scrub_stamp":"2024-03-04T13:13:35.313119+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.313119+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:15.053239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":151,"num_write":99,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:22.473163+0000","last_change":"2024-03-04T12:46:22.257205+0000","last_active":"2024-03-04T13:13:22.473163+0000","last_peered":"2024-03-04T13:13:22.473163+0000","last_clean":"2024-03-04T13:13:22.473163+0000","last_became_active":"2024-03-04T12:46:22.256882+0000","last_became_peered":"2024-03-04T12:46:22.256882+0000","last_unstale":"2024-03-04T13:13:22.473163+0000","last_undegraded":"2024-03-04T13:13:22.473163+0000","last_fullsized":"2024-03-04T13:13:22.473163+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":41,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:17.530473+0000","last_change":"2024-03-04T12:32:46.057344+0000","last_active":"2024-03-04T13:13:17.530473+0000","last_peered":"2024-03-04T13:13:17.530473+0000","last_clean":"2024-03-04T13:13:17.530473+0000","last_became_active":"2024-03-04T12:32:46.057079+0000","last_became_peered":"2024-03-04T12:32:46.057079+0000","last_unstale":"2024-03-04T13:13:17.530473+0000","last_undegraded":"2024-03-04T13:13:17.530473+0000","last_fullsized":"2024-03-04T13:13:17.530473+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"255'9","reported_seq":76,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.775902+0000","last_change":"2024-03-04T13:13:32.775942+0000","last_active":"2024-03-04T13:13:32.775902+0000","last_peered":"2024-03-04T13:13:32.775902+0000","last_clean":"2024-03-04T13:13:32.775902+0000","last_became_active":"2024-03-04T12:32:42.035488+0000","last_became_peered":"2024-03-04T12:32:42.035488+0000","last_unstale":"2024-03-04T13:13:32.775902+0000","last_undegraded":"2024-03-04T13:13:32.775902+0000","last_fullsized":"2024-03-04T13:13:32.775902+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'9","last_scrub_stamp":"2024-03-04T13:13:32.775792+0000","last_deep_scrub":"255'9","last_deep_scrub_stamp":"2024-03-04T13:13:32.775792+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.775792+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:35.718837+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"255'14","reported_seq":88,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.816433+0000","last_change":"2024-03-04T13:13:31.816478+0000","last_active":"2024-03-04T13:13:31.816433+0000","last_peered":"2024-03-04T13:13:31.816433+0000","last_clean":"2024-03-04T13:13:31.816433+0000","last_became_active":"2024-03-04T12:29:01.706786+0000","last_became_peered":"2024-03-04T12:29:01.706786+0000","last_unstale":"2024-03-04T13:13:31.816433+0000","last_undegraded":"2024-03-04T13:13:31.816433+0000","last_fullsized":"2024-03-04T13:13:31.816433+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'14","last_scrub_stamp":"2024-03-04T13:13:31.816328+0000","last_deep_scrub":"255'14","last_deep_scrub_stamp":"2024-03-04T13:13:31.816328+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.816328+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:21.050894+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:22.473176+0000","last_change":"2024-03-04T12:46:22.259694+0000","last_active":"2024-03-04T13:13:22.473176+0000","last_peered":"2024-03-04T13:13:22.473176+0000","last_clean":"2024-03-04T13:13:22.473176+0000","last_became_active":"2024-03-04T12:46:22.259400+0000","last_became_peered":"2024-03-04T12:46:22.259400+0000","last_unstale":"2024-03-04T13:13:22.473176+0000","last_undegraded":"2024-03-04T13:13:22.473176+0000","last_fullsized":"2024-03-04T13:13:22.473176+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.770248+0000","last_change":"2024-03-04T13:13:35.770271+0000","last_active":"2024-03-04T13:13:35.770248+0000","last_peered":"2024-03-04T13:13:35.770248+0000","last_clean":"2024-03-04T13:13:35.770248+0000","last_became_active":"2024-03-04T12:32:46.051318+0000","last_became_peered":"2024-03-04T12:32:46.051318+0000","last_unstale":"2024-03-04T13:13:35.770248+0000","last_undegraded":"2024-03-04T13:13:35.770248+0000","last_fullsized":"2024-03-04T13:13:35.770248+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:35.770135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:35.770135+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.770135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:17:37.665435+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"255'10","reported_seq":64,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.162341+0000","last_change":"2024-03-04T12:32:42.036135+0000","last_active":"2024-03-04T13:13:21.162341+0000","last_peered":"2024-03-04T13:13:21.162341+0000","last_clean":"2024-03-04T13:13:21.162341+0000","last_became_active":"2024-03-04T12:32:42.035743+0000","last_became_peered":"2024-03-04T12:32:42.035743+0000","last_unstale":"2024-03-04T13:13:21.162341+0000","last_undegraded":"2024-03-04T13:13:21.162341+0000","last_fullsized":"2024-03-04T13:13:21.162341+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9243,"num_write":20,"num_write_kb":10267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"255'55","reported_seq":196,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.080239+0000","last_change":"2024-03-04T13:13:30.080264+0000","last_active":"2024-03-04T13:13:30.080239+0000","last_peered":"2024-03-04T13:13:30.080239+0000","last_clean":"2024-03-04T13:13:30.080239+0000","last_became_active":"2024-03-04T12:29:01.700933+0000","last_became_peered":"2024-03-04T12:29:01.700933+0000","last_unstale":"2024-03-04T13:13:30.080239+0000","last_undegraded":"2024-03-04T13:13:30.080239+0000","last_fullsized":"2024-03-04T13:13:30.080239+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'55","last_scrub_stamp":"2024-03-04T13:13:30.080152+0000","last_deep_scrub":"255'55","last_deep_scrub_stamp":"2024-03-04T13:13:30.080152+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.080152+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:28.190583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":175,"num_write":86,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.720228+0000","last_change":"2024-03-04T12:46:22.310324+0000","last_active":"2024-03-04T13:13:25.720228+0000","last_peered":"2024-03-04T13:13:25.720228+0000","last_clean":"2024-03-04T13:13:25.720228+0000","last_became_active":"2024-03-04T12:46:22.310043+0000","last_became_peered":"2024-03-04T12:46:22.310043+0000","last_unstale":"2024-03-04T13:13:25.720228+0000","last_undegraded":"2024-03-04T13:13:25.720228+0000","last_fullsized":"2024-03-04T13:13:25.720228+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"250'3","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:17.466220+0000","last_change":"2024-03-04T12:32:46.056965+0000","last_active":"2024-03-04T13:13:17.466220+0000","last_peered":"2024-03-04T13:13:17.466220+0000","last_clean":"2024-03-04T13:13:17.466220+0000","last_became_active":"2024-03-04T12:32:46.056687+0000","last_became_peered":"2024-03-04T12:32:46.056687+0000","last_unstale":"2024-03-04T13:13:17.466220+0000","last_undegraded":"2024-03-04T13:13:17.466220+0000","last_fullsized":"2024-03-04T13:13:17.466220+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"0'0","reported_seq":55,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.767425+0000","last_change":"2024-03-04T13:13:34.767455+0000","last_active":"2024-03-04T13:13:34.767425+0000","last_peered":"2024-03-04T13:13:34.767425+0000","last_clean":"2024-03-04T13:13:34.767425+0000","last_became_active":"2024-03-04T12:32:42.036690+0000","last_became_peered":"2024-03-04T12:32:42.036690+0000","last_unstale":"2024-03-04T13:13:34.767425+0000","last_undegraded":"2024-03-04T13:13:34.767425+0000","last_fullsized":"2024-03-04T13:13:34.767425+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:34.767317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:34.767317+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.767317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:34:06.921023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"0'0","reported_seq":62,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.252990+0000","last_change":"2024-03-04T13:13:29.253014+0000","last_active":"2024-03-04T13:13:29.252990+0000","last_peered":"2024-03-04T13:13:29.252990+0000","last_clean":"2024-03-04T13:13:29.252990+0000","last_became_active":"2024-03-04T12:29:01.700739+0000","last_became_peered":"2024-03-04T12:29:01.700739+0000","last_unstale":"2024-03-04T13:13:29.252990+0000","last_undegraded":"2024-03-04T13:13:29.252990+0000","last_fullsized":"2024-03-04T13:13:29.252990+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:29.252878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:29.252878+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.252878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:30:12.777518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520317+0000","last_change":"2024-03-04T12:46:22.308562+0000","last_active":"2024-03-04T13:12:22.520317+0000","last_peered":"2024-03-04T13:12:22.520317+0000","last_clean":"2024-03-04T13:12:22.520317+0000","last_became_active":"2024-03-04T12:46:22.308300+0000","last_became_peered":"2024-03-04T12:46:22.308300+0000","last_unstale":"2024-03-04T13:12:22.520317+0000","last_undegraded":"2024-03-04T13:12:22.520317+0000","last_fullsized":"2024-03-04T13:12:22.520317+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":41,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:47.552753+0000","last_change":"2024-03-04T12:32:46.051902+0000","last_active":"2024-03-04T13:11:47.552753+0000","last_peered":"2024-03-04T13:11:47.552753+0000","last_clean":"2024-03-04T13:11:47.552753+0000","last_became_active":"2024-03-04T12:32:46.051614+0000","last_became_peered":"2024-03-04T12:32:46.051614+0000","last_unstale":"2024-03-04T13:11:47.552753+0000","last_undegraded":"2024-03-04T13:11:47.552753+0000","last_fullsized":"2024-03-04T13:11:47.552753+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":55,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.505201+0000","last_change":"2024-03-04T13:13:29.505223+0000","last_active":"2024-03-04T13:13:29.505201+0000","last_peered":"2024-03-04T13:13:29.505201+0000","last_clean":"2024-03-04T13:13:29.505201+0000","last_became_active":"2024-03-04T12:32:42.033182+0000","last_became_peered":"2024-03-04T12:32:42.033182+0000","last_unstale":"2024-03-04T13:13:29.505201+0000","last_undegraded":"2024-03-04T13:13:29.505201+0000","last_fullsized":"2024-03-04T13:13:29.505201+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:29.505109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:29.505109+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.505109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:37.494586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"250'41","reported_seq":169,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.746749+0000","last_change":"2024-03-04T13:13:26.746795+0000","last_active":"2024-03-04T13:13:26.746749+0000","last_peered":"2024-03-04T13:13:26.746749+0000","last_clean":"2024-03-04T13:13:26.746749+0000","last_became_active":"2024-03-04T12:29:01.708876+0000","last_became_peered":"2024-03-04T12:29:01.708876+0000","last_unstale":"2024-03-04T13:13:26.746749+0000","last_undegraded":"2024-03-04T13:13:26.746749+0000","last_fullsized":"2024-03-04T13:13:26.746749+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'41","last_scrub_stamp":"2024-03-04T13:13:26.746633+0000","last_deep_scrub":"250'41","last_deep_scrub_stamp":"2024-03-04T13:13:26.746633+0000","last_clean_scrub_stamp":"2024-03-04T13:13:26.746633+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:14:28.512234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":148,"num_write":55,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520332+0000","last_change":"2024-03-04T12:46:22.256922+0000","last_active":"2024-03-04T13:12:22.520332+0000","last_peered":"2024-03-04T13:12:22.520332+0000","last_clean":"2024-03-04T13:12:22.520332+0000","last_became_active":"2024-03-04T12:46:22.256617+0000","last_became_peered":"2024-03-04T12:46:22.256617+0000","last_unstale":"2024-03-04T13:12:22.520332+0000","last_undegraded":"2024-03-04T13:12:22.520332+0000","last_fullsized":"2024-03-04T13:12:22.520332+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"250'2","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.801269+0000","last_change":"2024-03-04T13:13:46.801296+0000","last_active":"2024-03-04T13:13:46.801269+0000","last_peered":"2024-03-04T13:13:46.801269+0000","last_clean":"2024-03-04T13:13:46.801269+0000","last_became_active":"2024-03-04T12:32:46.055321+0000","last_became_peered":"2024-03-04T12:32:46.055321+0000","last_unstale":"2024-03-04T13:13:46.801269+0000","last_undegraded":"2024-03-04T13:13:46.801269+0000","last_fullsized":"2024-03-04T13:13:46.801269+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:13:46.801181+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:13:46.801181+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.801181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:43:20.617758+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"255'6","reported_seq":67,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.927444+0000","last_change":"2024-03-04T13:13:27.927469+0000","last_active":"2024-03-04T13:13:27.927444+0000","last_peered":"2024-03-04T13:13:27.927444+0000","last_clean":"2024-03-04T13:13:27.927444+0000","last_became_active":"2024-03-04T12:32:42.030512+0000","last_became_peered":"2024-03-04T12:32:42.030512+0000","last_unstale":"2024-03-04T13:13:27.927444+0000","last_undegraded":"2024-03-04T13:13:27.927444+0000","last_fullsized":"2024-03-04T13:13:27.927444+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'6","last_scrub_stamp":"2024-03-04T13:13:27.927372+0000","last_deep_scrub":"255'6","last_deep_scrub_stamp":"2024-03-04T13:13:27.927372+0000","last_clean_scrub_stamp":"2024-03-04T13:13:27.927372+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:53:49.518778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"255'57","reported_seq":197,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.162485+0000","last_change":"2024-03-04T13:13:39.162517+0000","last_active":"2024-03-04T13:13:39.162485+0000","last_peered":"2024-03-04T13:13:39.162485+0000","last_clean":"2024-03-04T13:13:39.162485+0000","last_became_active":"2024-03-04T12:29:01.699507+0000","last_became_peered":"2024-03-04T12:29:01.699507+0000","last_unstale":"2024-03-04T13:13:39.162485+0000","last_undegraded":"2024-03-04T13:13:39.162485+0000","last_fullsized":"2024-03-04T13:13:39.162485+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'57","last_scrub_stamp":"2024-03-04T13:13:39.162388+0000","last_deep_scrub":"255'57","last_deep_scrub_stamp":"2024-03-04T13:13:39.162388+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.162388+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:01:36.647719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":165,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.521393+0000","last_change":"2024-03-04T12:46:22.256492+0000","last_active":"2024-03-04T13:12:27.521393+0000","last_peered":"2024-03-04T13:12:27.521393+0000","last_clean":"2024-03-04T13:12:27.521393+0000","last_became_active":"2024-03-04T12:46:22.256181+0000","last_became_peered":"2024-03-04T12:46:22.256181+0000","last_unstale":"2024-03-04T13:12:27.521393+0000","last_undegraded":"2024-03-04T13:12:27.521393+0000","last_fullsized":"2024-03-04T13:12:27.521393+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"255'9","reported_seq":66,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.191585+0000","last_change":"2024-03-04T13:13:37.191619+0000","last_active":"2024-03-04T13:13:37.191585+0000","last_peered":"2024-03-04T13:13:37.191585+0000","last_clean":"2024-03-04T13:13:37.191585+0000","last_became_active":"2024-03-04T12:32:46.045552+0000","last_became_peered":"2024-03-04T12:32:46.045552+0000","last_unstale":"2024-03-04T13:13:37.191585+0000","last_undegraded":"2024-03-04T13:13:37.191585+0000","last_fullsized":"2024-03-04T13:13:37.191585+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'9","last_scrub_stamp":"2024-03-04T13:13:37.191494+0000","last_deep_scrub":"255'9","last_deep_scrub_stamp":"2024-03-04T13:13:37.191494+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.191494+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:08:46.570487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":55,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.830135+0000","last_change":"2024-03-04T13:13:30.830161+0000","last_active":"2024-03-04T13:13:30.830135+0000","last_peered":"2024-03-04T13:13:30.830135+0000","last_clean":"2024-03-04T13:13:30.830135+0000","last_became_active":"2024-03-04T12:32:42.035436+0000","last_became_peered":"2024-03-04T12:32:42.035436+0000","last_unstale":"2024-03-04T13:13:30.830135+0000","last_undegraded":"2024-03-04T13:13:30.830135+0000","last_fullsized":"2024-03-04T13:13:30.830135+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:30.830047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:30.830047+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.830047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:02.886091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"255'54","reported_seq":188,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.199311+0000","last_change":"2024-03-04T13:13:43.199357+0000","last_active":"2024-03-04T13:13:43.199311+0000","last_peered":"2024-03-04T13:13:43.199311+0000","last_clean":"2024-03-04T13:13:43.199311+0000","last_became_active":"2024-03-04T12:29:01.704434+0000","last_became_peered":"2024-03-04T12:29:01.704434+0000","last_unstale":"2024-03-04T13:13:43.199311+0000","last_undegraded":"2024-03-04T13:13:43.199311+0000","last_fullsized":"2024-03-04T13:13:43.199311+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'54","last_scrub_stamp":"2024-03-04T13:13:43.199179+0000","last_deep_scrub":"255'54","last_deep_scrub_stamp":"2024-03-04T13:13:43.199179+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.199179+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:20:54.600164+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":154,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:22.563281+0000","last_change":"2024-03-04T12:46:22.257771+0000","last_active":"2024-03-04T13:13:22.563281+0000","last_peered":"2024-03-04T13:13:22.563281+0000","last_clean":"2024-03-04T13:13:22.563281+0000","last_became_active":"2024-03-04T12:46:22.257495+0000","last_became_peered":"2024-03-04T12:46:22.257495+0000","last_unstale":"2024-03-04T13:13:22.563281+0000","last_undegraded":"2024-03-04T13:13:22.563281+0000","last_fullsized":"2024-03-04T13:13:22.563281+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"255'3","reported_seq":44,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.109538+0000","last_change":"2024-03-04T12:32:46.057285+0000","last_active":"2024-03-04T13:13:21.109538+0000","last_peered":"2024-03-04T13:13:21.109538+0000","last_clean":"2024-03-04T13:13:21.109538+0000","last_became_active":"2024-03-04T12:32:46.056737+0000","last_became_peered":"2024-03-04T12:32:46.056737+0000","last_unstale":"2024-03-04T13:13:21.109538+0000","last_undegraded":"2024-03-04T13:13:21.109538+0000","last_fullsized":"2024-03-04T13:13:21.109538+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":55,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.747814+0000","last_change":"2024-03-04T13:13:27.747846+0000","last_active":"2024-03-04T13:13:27.747814+0000","last_peered":"2024-03-04T13:13:27.747814+0000","last_clean":"2024-03-04T13:13:27.747814+0000","last_became_active":"2024-03-04T12:32:42.029043+0000","last_became_peered":"2024-03-04T12:32:42.029043+0000","last_unstale":"2024-03-04T13:13:27.747814+0000","last_undegraded":"2024-03-04T13:13:27.747814+0000","last_fullsized":"2024-03-04T13:13:27.747814+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:27.747738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:27.747738+0000","last_clean_scrub_stamp":"2024-03-04T13:13:27.747738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:17.877875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"255'45","reported_seq":165,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.781282+0000","last_change":"2024-03-04T13:13:33.781309+0000","last_active":"2024-03-04T13:13:33.781282+0000","last_peered":"2024-03-04T13:13:33.781282+0000","last_clean":"2024-03-04T13:13:33.781282+0000","last_became_active":"2024-03-04T12:29:01.702146+0000","last_became_peered":"2024-03-04T12:29:01.702146+0000","last_unstale":"2024-03-04T13:13:33.781282+0000","last_undegraded":"2024-03-04T13:13:33.781282+0000","last_fullsized":"2024-03-04T13:13:33.781282+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'45","last_scrub_stamp":"2024-03-04T13:13:33.781174+0000","last_deep_scrub":"255'45","last_deep_scrub_stamp":"2024-03-04T13:13:33.781174+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.781174+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:38:34.888433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":123,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260776+0000","last_change":"2024-03-04T12:46:22.311207+0000","last_active":"2024-03-04T13:13:25.260776+0000","last_peered":"2024-03-04T13:13:25.260776+0000","last_clean":"2024-03-04T13:13:25.260776+0000","last_became_active":"2024-03-04T12:46:22.310830+0000","last_became_peered":"2024-03-04T12:46:22.310830+0000","last_unstale":"2024-03-04T13:13:25.260776+0000","last_undegraded":"2024-03-04T13:13:25.260776+0000","last_fullsized":"2024-03-04T13:13:25.260776+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"255'2","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.040698+0000","last_change":"2024-03-04T12:32:46.058735+0000","last_active":"2024-03-04T13:13:21.040698+0000","last_peered":"2024-03-04T13:13:21.040698+0000","last_clean":"2024-03-04T13:13:21.040698+0000","last_became_active":"2024-03-04T12:32:46.058306+0000","last_became_peered":"2024-03-04T12:32:46.058306+0000","last_unstale":"2024-03-04T13:13:21.040698+0000","last_undegraded":"2024-03-04T13:13:21.040698+0000","last_fullsized":"2024-03-04T13:13:21.040698+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"255'5","reported_seq":63,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.863949+0000","last_change":"2024-03-04T13:13:29.863975+0000","last_active":"2024-03-04T13:13:29.863949+0000","last_peered":"2024-03-04T13:13:29.863949+0000","last_clean":"2024-03-04T13:13:29.863949+0000","last_became_active":"2024-03-04T12:32:42.035302+0000","last_became_peered":"2024-03-04T12:32:42.035302+0000","last_unstale":"2024-03-04T13:13:29.863949+0000","last_undegraded":"2024-03-04T13:13:29.863949+0000","last_fullsized":"2024-03-04T13:13:29.863949+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'5","last_scrub_stamp":"2024-03-04T13:13:29.863854+0000","last_deep_scrub":"255'5","last_deep_scrub_stamp":"2024-03-04T13:13:29.863854+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.863854+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:10.906006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6192,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"255'41","reported_seq":163,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.083220+0000","last_change":"2024-03-04T13:13:28.083241+0000","last_active":"2024-03-04T13:13:28.083220+0000","last_peered":"2024-03-04T13:13:28.083220+0000","last_clean":"2024-03-04T13:13:28.083220+0000","last_became_active":"2024-03-04T12:29:01.706897+0000","last_became_peered":"2024-03-04T12:29:01.706897+0000","last_unstale":"2024-03-04T13:13:28.083220+0000","last_undegraded":"2024-03-04T13:13:28.083220+0000","last_fullsized":"2024-03-04T13:13:28.083220+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'41","last_scrub_stamp":"2024-03-04T13:13:28.083138+0000","last_deep_scrub":"255'41","last_deep_scrub_stamp":"2024-03-04T13:13:28.083138+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.083138+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:30:37.038323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":127,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260802+0000","last_change":"2024-03-04T12:46:22.253306+0000","last_active":"2024-03-04T13:13:25.260802+0000","last_peered":"2024-03-04T13:13:25.260802+0000","last_clean":"2024-03-04T13:13:25.260802+0000","last_became_active":"2024-03-04T12:46:22.252955+0000","last_became_peered":"2024-03-04T12:46:22.252955+0000","last_unstale":"2024-03-04T13:13:25.260802+0000","last_undegraded":"2024-03-04T13:13:25.260802+0000","last_fullsized":"2024-03-04T13:13:25.260802+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"255'11","reported_seq":64,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.190173+0000","last_change":"2024-03-04T12:32:46.056590+0000","last_active":"2024-03-04T13:13:21.190173+0000","last_peered":"2024-03-04T13:13:21.190173+0000","last_clean":"2024-03-04T13:13:21.190173+0000","last_became_active":"2024-03-04T12:32:46.056219+0000","last_became_peered":"2024-03-04T12:32:46.056219+0000","last_unstale":"2024-03-04T13:13:21.190173+0000","last_undegraded":"2024-03-04T13:13:21.190173+0000","last_fullsized":"2024-03-04T13:13:21.190173+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25600,"num_write":16,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"255'8","reported_seq":69,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.917096+0000","last_change":"2024-03-04T13:13:30.917141+0000","last_active":"2024-03-04T13:13:30.917096+0000","last_peered":"2024-03-04T13:13:30.917096+0000","last_clean":"2024-03-04T13:13:30.917096+0000","last_became_active":"2024-03-04T12:32:42.034556+0000","last_became_peered":"2024-03-04T12:32:42.034556+0000","last_unstale":"2024-03-04T13:13:30.917096+0000","last_undegraded":"2024-03-04T13:13:30.917096+0000","last_fullsized":"2024-03-04T13:13:30.917096+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'8","last_scrub_stamp":"2024-03-04T13:13:30.917008+0000","last_deep_scrub":"255'8","last_deep_scrub_stamp":"2024-03-04T13:13:30.917008+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.917008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:17:52.807115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12328,"num_write":8,"num_write_kb":12328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"255'42","reported_seq":156,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.515404+0000","last_change":"2024-03-04T13:13:32.515429+0000","last_active":"2024-03-04T13:13:32.515404+0000","last_peered":"2024-03-04T13:13:32.515404+0000","last_clean":"2024-03-04T13:13:32.515404+0000","last_became_active":"2024-03-04T12:29:01.706549+0000","last_became_peered":"2024-03-04T12:29:01.706549+0000","last_unstale":"2024-03-04T13:13:32.515404+0000","last_undegraded":"2024-03-04T13:13:32.515404+0000","last_fullsized":"2024-03-04T13:13:32.515404+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'42","last_scrub_stamp":"2024-03-04T13:13:32.515310+0000","last_deep_scrub":"255'42","last_deep_scrub_stamp":"2024-03-04T13:13:32.515310+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.515310+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:31:52.043625+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":111,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"252'1","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520532+0000","last_change":"2024-03-04T12:46:22.254600+0000","last_active":"2024-03-04T13:12:22.520532+0000","last_peered":"2024-03-04T13:12:22.520532+0000","last_clean":"2024-03-04T13:12:22.520532+0000","last_became_active":"2024-03-04T12:46:22.254303+0000","last_became_peered":"2024-03-04T12:46:22.254303+0000","last_unstale":"2024-03-04T13:12:22.520532+0000","last_undegraded":"2024-03-04T13:12:22.520532+0000","last_fullsized":"2024-03-04T13:12:22.520532+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"255'3","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.518407+0000","last_change":"2024-03-04T13:13:43.518434+0000","last_active":"2024-03-04T13:13:43.518407+0000","last_peered":"2024-03-04T13:13:43.518407+0000","last_clean":"2024-03-04T13:13:43.518407+0000","last_became_active":"2024-03-04T12:32:46.055497+0000","last_became_peered":"2024-03-04T12:32:46.055497+0000","last_unstale":"2024-03-04T13:13:43.518407+0000","last_undegraded":"2024-03-04T13:13:43.518407+0000","last_fullsized":"2024-03-04T13:13:43.518407+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'3","last_scrub_stamp":"2024-03-04T13:13:43.518316+0000","last_deep_scrub":"255'3","last_deep_scrub_stamp":"2024-03-04T13:13:43.518316+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.518316+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:54.864627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.807236+0000","last_change":"2024-03-04T13:13:31.807264+0000","last_active":"2024-03-04T13:13:31.807236+0000","last_peered":"2024-03-04T13:13:31.807236+0000","last_clean":"2024-03-04T13:13:31.807236+0000","last_became_active":"2024-03-04T12:32:42.036150+0000","last_became_peered":"2024-03-04T12:32:42.036150+0000","last_unstale":"2024-03-04T13:13:31.807236+0000","last_undegraded":"2024-03-04T13:13:31.807236+0000","last_fullsized":"2024-03-04T13:13:31.807236+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:31.807148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:31.807148+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.807148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:09:22.042627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"255'69","reported_seq":280,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.236382+0000","last_change":"2024-03-04T13:13:30.236412+0000","last_active":"2024-03-04T13:13:30.236382+0000","last_peered":"2024-03-04T13:13:30.236382+0000","last_clean":"2024-03-04T13:13:30.236382+0000","last_became_active":"2024-03-04T12:29:01.700624+0000","last_became_peered":"2024-03-04T12:29:01.700624+0000","last_unstale":"2024-03-04T13:13:30.236382+0000","last_undegraded":"2024-03-04T13:13:30.236382+0000","last_fullsized":"2024-03-04T13:13:30.236382+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'69","last_scrub_stamp":"2024-03-04T13:13:30.236288+0000","last_deep_scrub":"255'69","last_deep_scrub_stamp":"2024-03-04T13:13:30.236288+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.236288+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:06:29.427575+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":295,"num_write":88,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4990,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520574+0000","last_change":"2024-03-04T12:46:22.309757+0000","last_active":"2024-03-04T13:12:22.520574+0000","last_peered":"2024-03-04T13:12:22.520574+0000","last_clean":"2024-03-04T13:12:22.520574+0000","last_became_active":"2024-03-04T12:46:22.309493+0000","last_became_peered":"2024-03-04T12:46:22.309493+0000","last_unstale":"2024-03-04T13:12:22.520574+0000","last_undegraded":"2024-03-04T13:12:22.520574+0000","last_fullsized":"2024-03-04T13:12:22.520574+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"255'10","reported_seq":62,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.212221+0000","last_change":"2024-03-04T12:32:46.054533+0000","last_active":"2024-03-04T13:13:21.212221+0000","last_peered":"2024-03-04T13:13:21.212221+0000","last_clean":"2024-03-04T13:13:21.212221+0000","last_became_active":"2024-03-04T12:32:46.054256+0000","last_became_peered":"2024-03-04T12:32:46.054256+0000","last_unstale":"2024-03-04T13:13:21.212221+0000","last_undegraded":"2024-03-04T13:13:21.212221+0000","last_fullsized":"2024-03-04T13:13:21.212221+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":16480,"num_write":15,"num_write_kb":11320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"0'0","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.517623+0000","last_change":"2024-03-04T13:13:28.517646+0000","last_active":"2024-03-04T13:13:28.517623+0000","last_peered":"2024-03-04T13:13:28.517623+0000","last_clean":"2024-03-04T13:13:28.517623+0000","last_became_active":"2024-03-04T12:32:42.035683+0000","last_became_peered":"2024-03-04T12:32:42.035683+0000","last_unstale":"2024-03-04T13:13:28.517623+0000","last_undegraded":"2024-03-04T13:13:28.517623+0000","last_fullsized":"2024-03-04T13:13:28.517623+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:28.517514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:28.517514+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.517514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:09.797649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"255'43","reported_seq":153,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.519890+0000","last_change":"2024-03-04T13:13:34.519938+0000","last_active":"2024-03-04T13:13:34.519890+0000","last_peered":"2024-03-04T13:13:34.519890+0000","last_clean":"2024-03-04T13:13:34.519890+0000","last_became_active":"2024-03-04T12:29:01.701396+0000","last_became_peered":"2024-03-04T12:29:01.701396+0000","last_unstale":"2024-03-04T13:13:34.519890+0000","last_undegraded":"2024-03-04T13:13:34.519890+0000","last_fullsized":"2024-03-04T13:13:34.519890+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'43","last_scrub_stamp":"2024-03-04T13:13:34.519764+0000","last_deep_scrub":"255'43","last_deep_scrub_stamp":"2024-03-04T13:13:34.519764+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.519764+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:54:01.761324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.373460+0000","last_change":"2024-03-04T12:46:22.260088+0000","last_active":"2024-03-04T13:12:27.373460+0000","last_peered":"2024-03-04T13:12:27.373460+0000","last_clean":"2024-03-04T13:12:27.373460+0000","last_became_active":"2024-03-04T12:46:22.259763+0000","last_became_peered":"2024-03-04T12:46:22.259763+0000","last_unstale":"2024-03-04T13:12:27.373460+0000","last_undegraded":"2024-03-04T13:12:27.373460+0000","last_fullsized":"2024-03-04T13:12:27.373460+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"255'5","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.116773+0000","last_change":"2024-03-04T12:32:46.057881+0000","last_active":"2024-03-04T13:13:21.116773+0000","last_peered":"2024-03-04T13:13:21.116773+0000","last_clean":"2024-03-04T13:13:21.116773+0000","last_became_active":"2024-03-04T12:32:46.057646+0000","last_became_peered":"2024-03-04T12:32:46.057646+0000","last_unstale":"2024-03-04T13:13:21.116773+0000","last_undegraded":"2024-03-04T13:13:21.116773+0000","last_fullsized":"2024-03-04T13:13:21.116773+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5168,"num_write":5,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"255'2","reported_seq":59,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.052595+0000","last_change":"2024-03-04T13:13:29.052620+0000","last_active":"2024-03-04T13:13:29.052595+0000","last_peered":"2024-03-04T13:13:29.052595+0000","last_clean":"2024-03-04T13:13:29.052595+0000","last_became_active":"2024-03-04T12:32:42.026771+0000","last_became_peered":"2024-03-04T12:32:42.026771+0000","last_unstale":"2024-03-04T13:13:29.052595+0000","last_undegraded":"2024-03-04T13:13:29.052595+0000","last_fullsized":"2024-03-04T13:13:29.052595+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:29.052506+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:29.052506+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.052506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:13:31.731989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"255'43","reported_seq":162,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.820896+0000","last_change":"2024-03-04T13:13:30.820942+0000","last_active":"2024-03-04T13:13:30.820896+0000","last_peered":"2024-03-04T13:13:30.820896+0000","last_clean":"2024-03-04T13:13:30.820896+0000","last_became_active":"2024-03-04T12:29:01.701812+0000","last_became_peered":"2024-03-04T12:29:01.701812+0000","last_unstale":"2024-03-04T13:13:30.820896+0000","last_undegraded":"2024-03-04T13:13:30.820896+0000","last_fullsized":"2024-03-04T13:13:30.820896+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'43","last_scrub_stamp":"2024-03-04T13:13:30.820770+0000","last_deep_scrub":"255'43","last_deep_scrub_stamp":"2024-03-04T13:13:30.820770+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.820770+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:32:52.795812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":121,"num_write":82,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.720178+0000","last_change":"2024-03-04T12:46:22.247949+0000","last_active":"2024-03-04T13:13:25.720178+0000","last_peered":"2024-03-04T13:13:25.720178+0000","last_clean":"2024-03-04T13:13:25.720178+0000","last_became_active":"2024-03-04T12:46:22.247655+0000","last_became_peered":"2024-03-04T12:46:22.247655+0000","last_unstale":"2024-03-04T13:13:25.720178+0000","last_undegraded":"2024-03-04T13:13:25.720178+0000","last_fullsized":"2024-03-04T13:13:25.720178+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"255'3","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.190891+0000","last_change":"2024-03-04T12:32:46.058700+0000","last_active":"2024-03-04T13:13:21.190891+0000","last_peered":"2024-03-04T13:13:21.190891+0000","last_clean":"2024-03-04T13:13:21.190891+0000","last_became_active":"2024-03-04T12:32:46.058466+0000","last_became_peered":"2024-03-04T12:32:46.058466+0000","last_unstale":"2024-03-04T13:13:21.190891+0000","last_undegraded":"2024-03-04T13:13:21.190891+0000","last_fullsized":"2024-03-04T13:13:21.190891+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.391641+0000","last_change":"2024-03-04T13:13:43.391685+0000","last_active":"2024-03-04T13:13:43.391641+0000","last_peered":"2024-03-04T13:13:43.391641+0000","last_clean":"2024-03-04T13:13:43.391641+0000","last_became_active":"2024-03-04T12:32:42.031410+0000","last_became_peered":"2024-03-04T12:32:42.031410+0000","last_unstale":"2024-03-04T13:13:43.391641+0000","last_undegraded":"2024-03-04T13:13:43.391641+0000","last_fullsized":"2024-03-04T13:13:43.391641+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:43.391527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:43.391527+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.391527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:32.117760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"255'27","reported_seq":124,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.781758+0000","last_change":"2024-03-04T13:13:32.781830+0000","last_active":"2024-03-04T13:13:32.781758+0000","last_peered":"2024-03-04T13:13:32.781758+0000","last_clean":"2024-03-04T13:13:32.781758+0000","last_became_active":"2024-03-04T12:29:01.703420+0000","last_became_peered":"2024-03-04T12:29:01.703420+0000","last_unstale":"2024-03-04T13:13:32.781758+0000","last_undegraded":"2024-03-04T13:13:32.781758+0000","last_fullsized":"2024-03-04T13:13:32.781758+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'27","last_scrub_stamp":"2024-03-04T13:13:32.781646+0000","last_deep_scrub":"255'27","last_deep_scrub_stamp":"2024-03-04T13:13:32.781646+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.781646+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:01.556499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":74,"num_write":42,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.107102+0000","last_change":"2024-03-04T12:46:22.250162+0000","last_active":"2024-03-04T13:13:27.107102+0000","last_peered":"2024-03-04T13:13:27.107102+0000","last_clean":"2024-03-04T13:13:27.107102+0000","last_became_active":"2024-03-04T12:46:22.249854+0000","last_became_peered":"2024-03-04T12:46:22.249854+0000","last_unstale":"2024-03-04T13:13:27.107102+0000","last_undegraded":"2024-03-04T13:13:27.107102+0000","last_fullsized":"2024-03-04T13:13:27.107102+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":42,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.496869+0000","last_change":"2024-03-04T12:32:46.051913+0000","last_active":"2024-03-04T13:12:22.496869+0000","last_peered":"2024-03-04T13:12:22.496869+0000","last_clean":"2024-03-04T13:12:22.496869+0000","last_became_active":"2024-03-04T12:32:46.051498+0000","last_became_peered":"2024-03-04T12:32:46.051498+0000","last_unstale":"2024-03-04T13:12:22.496869+0000","last_undegraded":"2024-03-04T13:12:22.496869+0000","last_fullsized":"2024-03-04T13:12:22.496869+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"255'6","reported_seq":70,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.493334+0000","last_change":"2024-03-04T13:13:39.493363+0000","last_active":"2024-03-04T13:13:39.493334+0000","last_peered":"2024-03-04T13:13:39.493334+0000","last_clean":"2024-03-04T13:13:39.493334+0000","last_became_active":"2024-03-04T12:32:42.038349+0000","last_became_peered":"2024-03-04T12:32:42.038349+0000","last_unstale":"2024-03-04T13:13:39.493334+0000","last_undegraded":"2024-03-04T13:13:39.493334+0000","last_fullsized":"2024-03-04T13:13:39.493334+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'6","last_scrub_stamp":"2024-03-04T13:13:39.493239+0000","last_deep_scrub":"255'6","last_deep_scrub_stamp":"2024-03-04T13:13:39.493239+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.493239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:37:54.785538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"255'90","reported_seq":267,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.211860+0000","last_change":"2024-03-04T13:13:28.211887+0000","last_active":"2024-03-04T13:13:28.211860+0000","last_peered":"2024-03-04T13:13:28.211860+0000","last_clean":"2024-03-04T13:13:28.211860+0000","last_became_active":"2024-03-04T12:29:01.701282+0000","last_became_peered":"2024-03-04T12:29:01.701282+0000","last_unstale":"2024-03-04T13:13:28.211860+0000","last_undegraded":"2024-03-04T13:13:28.211860+0000","last_fullsized":"2024-03-04T13:13:28.211860+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'90","last_scrub_stamp":"2024-03-04T13:13:28.211770+0000","last_deep_scrub":"255'90","last_deep_scrub_stamp":"2024-03-04T13:13:28.211770+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.211770+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:24:35.609835+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":354,"num_read_kb":252,"num_write":156,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.380221+0000","last_change":"2024-03-04T12:46:22.259364+0000","last_active":"2024-03-04T13:13:27.380221+0000","last_peered":"2024-03-04T13:13:27.380221+0000","last_clean":"2024-03-04T13:13:27.380221+0000","last_became_active":"2024-03-04T12:46:22.258936+0000","last_became_peered":"2024-03-04T12:46:22.258936+0000","last_unstale":"2024-03-04T13:13:27.380221+0000","last_undegraded":"2024-03-04T13:13:27.380221+0000","last_fullsized":"2024-03-04T13:13:27.380221+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":42,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.556615+0000","last_change":"2024-03-04T12:32:46.053786+0000","last_active":"2024-03-04T13:12:22.556615+0000","last_peered":"2024-03-04T13:12:22.556615+0000","last_clean":"2024-03-04T13:12:22.556615+0000","last_became_active":"2024-03-04T12:32:46.053456+0000","last_became_peered":"2024-03-04T12:32:46.053456+0000","last_unstale":"2024-03-04T13:12:22.556615+0000","last_undegraded":"2024-03-04T13:12:22.556615+0000","last_fullsized":"2024-03-04T13:12:22.556615+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"0'0","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.872782+0000","last_change":"2024-03-04T13:13:28.872826+0000","last_active":"2024-03-04T13:13:28.872782+0000","last_peered":"2024-03-04T13:13:28.872782+0000","last_clean":"2024-03-04T13:13:28.872782+0000","last_became_active":"2024-03-04T12:32:42.035413+0000","last_became_peered":"2024-03-04T12:32:42.035413+0000","last_unstale":"2024-03-04T13:13:28.872782+0000","last_undegraded":"2024-03-04T13:13:28.872782+0000","last_fullsized":"2024-03-04T13:13:28.872782+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:28.872647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:28.872647+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.872647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:54:46.886474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"255'17","reported_seq":103,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.134636+0000","last_change":"2024-03-04T13:13:41.134664+0000","last_active":"2024-03-04T13:13:41.134636+0000","last_peered":"2024-03-04T13:13:41.134636+0000","last_clean":"2024-03-04T13:13:41.134636+0000","last_became_active":"2024-03-04T12:29:01.702555+0000","last_became_peered":"2024-03-04T12:29:01.702555+0000","last_unstale":"2024-03-04T13:13:41.134636+0000","last_undegraded":"2024-03-04T13:13:41.134636+0000","last_fullsized":"2024-03-04T13:13:41.134636+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'17","last_scrub_stamp":"2024-03-04T13:13:41.134538+0000","last_deep_scrub":"255'17","last_deep_scrub_stamp":"2024-03-04T13:13:41.134538+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.134538+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:28.139595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":47,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"255'178","reported_seq":783,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.234901+0000","last_change":"2024-03-04T12:20:14.820927+0000","last_active":"2024-03-04T13:13:21.234901+0000","last_peered":"2024-03-04T13:13:21.234901+0000","last_clean":"2024-03-04T13:13:21.234901+0000","last_became_active":"2024-03-04T12:20:14.820595+0000","last_became_peered":"2024-03-04T12:20:14.820595+0000","last_unstale":"2024-03-04T13:13:21.234901+0000","last_undegraded":"2024-03-04T13:13:21.234901+0000","last_fullsized":"2024-03-04T13:13:21.234901+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":457,"num_write":1012,"num_write_kb":11218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"255'475","reported_seq":1779,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.376343+0000","last_change":"2024-03-04T12:20:16.828823+0000","last_active":"2024-03-04T13:12:47.376343+0000","last_peered":"2024-03-04T13:12:47.376343+0000","last_clean":"2024-03-04T13:12:47.376343+0000","last_became_active":"2024-03-04T12:20:16.828539+0000","last_became_peered":"2024-03-04T12:20:16.828539+0000","last_unstale":"2024-03-04T13:12:47.376343+0000","last_undegraded":"2024-03-04T13:12:47.376343+0000","last_fullsized":"2024-03-04T13:12:47.376343+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2301,"num_read_kb":2121,"num_write":643,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"255'223","reported_seq":874,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.162921+0000","last_change":"2024-03-04T12:20:14.815583+0000","last_active":"2024-03-04T13:13:21.162921+0000","last_peered":"2024-03-04T13:13:21.162921+0000","last_clean":"2024-03-04T13:13:21.162921+0000","last_became_active":"2024-03-04T12:20:14.814863+0000","last_became_peered":"2024-03-04T12:20:14.814863+0000","last_unstale":"2024-03-04T13:13:21.162921+0000","last_undegraded":"2024-03-04T13:13:21.162921+0000","last_fullsized":"2024-03-04T13:13:21.162921+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591266,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":15449,"num_write":1326,"num_write_kb":40818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"255'559","reported_seq":1910,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.593551+0000","last_change":"2024-03-04T12:20:16.837515+0000","last_active":"2024-03-04T13:12:50.593551+0000","last_peered":"2024-03-04T13:12:50.593551+0000","last_clean":"2024-03-04T13:12:50.593551+0000","last_became_active":"2024-03-04T12:20:16.837200+0000","last_became_peered":"2024-03-04T12:20:16.837200+0000","last_unstale":"2024-03-04T13:12:50.593551+0000","last_undegraded":"2024-03-04T13:12:50.593551+0000","last_fullsized":"2024-03-04T13:12:50.593551+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2594,"num_read_kb":2289,"num_write":764,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"255'155","reported_seq":748,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.234154+0000","last_change":"2024-03-04T12:20:14.816919+0000","last_active":"2024-03-04T13:13:21.234154+0000","last_peered":"2024-03-04T13:13:21.234154+0000","last_clean":"2024-03-04T13:13:21.234154+0000","last_became_active":"2024-03-04T12:20:14.816597+0000","last_became_peered":"2024-03-04T12:20:14.816597+0000","last_unstale":"2024-03-04T13:13:21.234154+0000","last_undegraded":"2024-03-04T13:13:21.234154+0000","last_fullsized":"2024-03-04T13:13:21.234154+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":326,"num_read_kb":1168,"num_write":917,"num_write_kb":5749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"255'452","reported_seq":1951,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.525123+0000","last_change":"2024-03-04T12:20:16.821071+0000","last_active":"2024-03-04T13:12:47.525123+0000","last_peered":"2024-03-04T13:12:47.525123+0000","last_clean":"2024-03-04T13:12:47.525123+0000","last_became_active":"2024-03-04T12:20:16.820419+0000","last_became_peered":"2024-03-04T12:20:16.820419+0000","last_unstale":"2024-03-04T13:12:47.525123+0000","last_undegraded":"2024-03-04T13:12:47.525123+0000","last_fullsized":"2024-03-04T13:12:47.525123+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2318,"num_read_kb":2161,"num_write":537,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"255'245","reported_seq":883,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.065408+0000","last_change":"2024-03-04T12:20:14.826502+0000","last_active":"2024-03-04T13:13:21.065408+0000","last_peered":"2024-03-04T13:13:21.065408+0000","last_clean":"2024-03-04T13:13:21.065408+0000","last_became_active":"2024-03-04T12:20:14.824779+0000","last_became_peered":"2024-03-04T12:20:14.824779+0000","last_unstale":"2024-03-04T13:13:21.065408+0000","last_undegraded":"2024-03-04T13:13:21.065408+0000","last_fullsized":"2024-03-04T13:13:21.065408+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4160401,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":13558,"num_write":1376,"num_write_kb":36455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"255'351","reported_seq":1794,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.462894+0000","last_change":"2024-03-04T12:20:16.828116+0000","last_active":"2024-03-04T13:12:47.462894+0000","last_peered":"2024-03-04T13:12:47.462894+0000","last_clean":"2024-03-04T13:12:47.462894+0000","last_became_active":"2024-03-04T12:20:16.827613+0000","last_became_peered":"2024-03-04T12:20:16.827613+0000","last_unstale":"2024-03-04T13:12:47.462894+0000","last_undegraded":"2024-03-04T13:12:47.462894+0000","last_fullsized":"2024-03-04T13:12:47.462894+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1915,"num_read_kb":1843,"num_write":383,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"255'195","reported_seq":835,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.101506+0000","last_change":"2024-03-04T12:20:14.816830+0000","last_active":"2024-03-04T13:13:21.101506+0000","last_peered":"2024-03-04T13:13:21.101506+0000","last_clean":"2024-03-04T13:13:21.101506+0000","last_became_active":"2024-03-04T12:20:14.816532+0000","last_became_peered":"2024-03-04T12:20:14.816532+0000","last_unstale":"2024-03-04T13:13:21.101506+0000","last_undegraded":"2024-03-04T13:13:21.101506+0000","last_fullsized":"2024-03-04T13:13:21.101506+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5789792,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":440,"num_read_kb":58154,"num_write":1069,"num_write_kb":58795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"255'405","reported_seq":2046,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.123044+0000","last_change":"2024-03-04T12:20:16.816980+0000","last_active":"2024-03-04T13:12:31.123044+0000","last_peered":"2024-03-04T13:12:31.123044+0000","last_clean":"2024-03-04T13:12:31.123044+0000","last_became_active":"2024-03-04T12:20:16.816688+0000","last_became_peered":"2024-03-04T12:20:16.816688+0000","last_unstale":"2024-03-04T13:12:31.123044+0000","last_undegraded":"2024-03-04T13:12:31.123044+0000","last_fullsized":"2024-03-04T13:12:31.123044+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2407,"num_read_kb":2304,"num_write":479,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"255'181","reported_seq":771,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.744308+0000","last_change":"2024-03-04T13:13:33.744384+0000","last_active":"2024-03-04T13:13:33.744308+0000","last_peered":"2024-03-04T13:13:33.744308+0000","last_clean":"2024-03-04T13:13:33.744308+0000","last_became_active":"2024-03-04T12:20:51.030709+0000","last_became_peered":"2024-03-04T12:20:51.030709+0000","last_unstale":"2024-03-04T13:13:33.744308+0000","last_undegraded":"2024-03-04T13:13:33.744308+0000","last_fullsized":"2024-03-04T13:13:33.744308+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'181","last_scrub_stamp":"2024-03-04T13:13:33.744222+0000","last_deep_scrub":"255'181","last_deep_scrub_stamp":"2024-03-04T13:13:33.744222+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.744222+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:41:30.000095+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311793,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":363,"num_read_kb":29477,"num_write":998,"num_write_kb":29693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"255'775","reported_seq":2154,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.328361+0000","last_change":"2024-03-04T12:20:16.825330+0000","last_active":"2024-03-04T13:12:39.328361+0000","last_peered":"2024-03-04T13:12:39.328361+0000","last_clean":"2024-03-04T13:12:39.328361+0000","last_became_active":"2024-03-04T12:20:16.822282+0000","last_became_peered":"2024-03-04T12:20:16.822282+0000","last_unstale":"2024-03-04T13:12:39.328361+0000","last_undegraded":"2024-03-04T13:12:39.328361+0000","last_fullsized":"2024-03-04T13:12:39.328361+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3372,"num_read_kb":2974,"num_write":1065,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"255'195","reported_seq":827,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.102082+0000","last_change":"2024-03-04T12:20:14.815689+0000","last_active":"2024-03-04T13:13:21.102082+0000","last_peered":"2024-03-04T13:13:21.102082+0000","last_clean":"2024-03-04T13:13:21.102082+0000","last_became_active":"2024-03-04T12:20:14.815388+0000","last_became_peered":"2024-03-04T12:20:14.815388+0000","last_unstale":"2024-03-04T13:13:21.102082+0000","last_undegraded":"2024-03-04T13:13:21.102082+0000","last_fullsized":"2024-03-04T13:13:21.102082+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262238,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":61923,"num_write":1063,"num_write_kb":47041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"255'685","reported_seq":2164,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.349576+0000","last_change":"2024-03-04T13:13:47.349621+0000","last_active":"2024-03-04T13:13:47.349576+0000","last_peered":"2024-03-04T13:13:47.349576+0000","last_clean":"2024-03-04T13:13:47.349576+0000","last_became_active":"2024-03-04T12:20:16.833268+0000","last_became_peered":"2024-03-04T12:20:16.833268+0000","last_unstale":"2024-03-04T13:13:47.349576+0000","last_undegraded":"2024-03-04T13:13:47.349576+0000","last_fullsized":"2024-03-04T13:13:47.349576+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'685","last_scrub_stamp":"2024-03-04T13:13:47.349451+0000","last_deep_scrub":"255'685","last_deep_scrub_stamp":"2024-03-04T13:13:47.349451+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.349451+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:59.994253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3214,"num_read_kb":2906,"num_write":892,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"255'232","reported_seq":874,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.228353+0000","last_change":"2024-03-04T12:20:14.828265+0000","last_active":"2024-03-04T13:13:21.228353+0000","last_peered":"2024-03-04T13:13:21.228353+0000","last_clean":"2024-03-04T13:13:21.228353+0000","last_became_active":"2024-03-04T12:20:14.827948+0000","last_became_peered":"2024-03-04T12:20:14.827948+0000","last_unstale":"2024-03-04T13:13:21.228353+0000","last_undegraded":"2024-03-04T13:13:21.228353+0000","last_fullsized":"2024-03-04T13:13:21.228353+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2119867,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":498,"num_read_kb":35496,"num_write":1177,"num_write_kb":50438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"255'329","reported_seq":1702,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.972662+0000","last_change":"2024-03-04T12:20:16.831041+0000","last_active":"2024-03-04T13:12:36.972662+0000","last_peered":"2024-03-04T13:12:36.972662+0000","last_clean":"2024-03-04T13:12:36.972662+0000","last_became_active":"2024-03-04T12:20:16.830773+0000","last_became_peered":"2024-03-04T12:20:16.830773+0000","last_unstale":"2024-03-04T13:12:36.972662+0000","last_undegraded":"2024-03-04T13:12:36.972662+0000","last_fullsized":"2024-03-04T13:12:36.972662+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1823,"num_read_kb":1743,"num_write":376,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"255'403","reported_seq":1978,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.077573+0000","last_change":"2024-03-04T12:20:16.820827+0000","last_active":"2024-03-04T13:12:18.077573+0000","last_peered":"2024-03-04T13:12:18.077573+0000","last_clean":"2024-03-04T13:12:18.077573+0000","last_became_active":"2024-03-04T12:20:16.820533+0000","last_became_peered":"2024-03-04T12:20:16.820533+0000","last_unstale":"2024-03-04T13:12:18.077573+0000","last_undegraded":"2024-03-04T13:12:18.077573+0000","last_fullsized":"2024-03-04T13:12:18.077573+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2265,"num_read_kb":2155,"num_write":466,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"255'193","reported_seq":825,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.487591+0000","last_change":"2024-03-04T12:20:14.820881+0000","last_active":"2024-03-04T13:13:28.487591+0000","last_peered":"2024-03-04T13:13:28.487591+0000","last_clean":"2024-03-04T13:13:28.487591+0000","last_became_active":"2024-03-04T12:20:14.820248+0000","last_became_peered":"2024-03-04T12:20:14.820248+0000","last_unstale":"2024-03-04T13:13:28.487591+0000","last_undegraded":"2024-03-04T13:13:28.487591+0000","last_fullsized":"2024-03-04T13:13:28.487591+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847147,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":428,"num_read_kb":15441,"num_write":1092,"num_write_kb":31882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"255'1140","reported_seq":2691,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.593738+0000","last_change":"2024-03-04T12:20:16.837314+0000","last_active":"2024-03-04T13:12:50.593738+0000","last_peered":"2024-03-04T13:12:50.593738+0000","last_clean":"2024-03-04T13:12:50.593738+0000","last_became_active":"2024-03-04T12:20:16.837126+0000","last_became_peered":"2024-03-04T12:20:16.837126+0000","last_unstale":"2024-03-04T13:12:50.593738+0000","last_undegraded":"2024-03-04T13:12:50.593738+0000","last_fullsized":"2024-03-04T13:12:50.593738+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4770,"num_read_kb":4178,"num_write":1557,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"255'198","reported_seq":815,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.380275+0000","last_change":"2024-03-04T12:20:14.824468+0000","last_active":"2024-03-04T13:13:27.380275+0000","last_peered":"2024-03-04T13:13:27.380275+0000","last_clean":"2024-03-04T13:13:27.380275+0000","last_became_active":"2024-03-04T12:20:14.824133+0000","last_became_peered":"2024-03-04T12:20:14.824133+0000","last_unstale":"2024-03-04T13:13:27.380275+0000","last_undegraded":"2024-03-04T13:13:27.380275+0000","last_fullsized":"2024-03-04T13:13:27.380275+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399138,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":430,"num_read_kb":9751,"num_write":1008,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"255'738","reported_seq":2186,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.798028+0000","last_change":"2024-03-04T12:20:16.825766+0000","last_active":"2024-03-04T13:12:34.798028+0000","last_peered":"2024-03-04T13:12:34.798028+0000","last_clean":"2024-03-04T13:12:34.798028+0000","last_became_active":"2024-03-04T12:20:16.825499+0000","last_became_peered":"2024-03-04T12:20:16.825499+0000","last_unstale":"2024-03-04T13:12:34.798028+0000","last_undegraded":"2024-03-04T13:12:34.798028+0000","last_fullsized":"2024-03-04T13:12:34.798028+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3318,"num_read_kb":2969,"num_write":989,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"255'240","reported_seq":873,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.380259+0000","last_change":"2024-03-04T12:20:14.828323+0000","last_active":"2024-03-04T13:13:27.380259+0000","last_peered":"2024-03-04T13:13:27.380259+0000","last_clean":"2024-03-04T13:13:27.380259+0000","last_became_active":"2024-03-04T12:20:14.827979+0000","last_became_peered":"2024-03-04T12:20:14.827979+0000","last_unstale":"2024-03-04T13:13:27.380259+0000","last_undegraded":"2024-03-04T13:13:27.380259+0000","last_fullsized":"2024-03-04T13:13:27.380259+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":577599,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":7999,"num_write":1192,"num_write_kb":30331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"255'777","reported_seq":2215,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.179051+0000","last_change":"2024-03-04T12:20:16.826162+0000","last_active":"2024-03-04T13:13:26.179051+0000","last_peered":"2024-03-04T13:13:26.179051+0000","last_clean":"2024-03-04T13:13:26.179051+0000","last_became_active":"2024-03-04T12:20:16.825897+0000","last_became_peered":"2024-03-04T12:20:16.825897+0000","last_unstale":"2024-03-04T13:13:26.179051+0000","last_undegraded":"2024-03-04T13:13:26.179051+0000","last_fullsized":"2024-03-04T13:13:26.179051+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3571,"num_read_kb":3184,"num_write":1054,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"255'154","reported_seq":755,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.106284+0000","last_change":"2024-03-04T12:20:14.824375+0000","last_active":"2024-03-04T13:13:27.106284+0000","last_peered":"2024-03-04T13:13:27.106284+0000","last_clean":"2024-03-04T13:13:27.106284+0000","last_became_active":"2024-03-04T12:20:14.823430+0000","last_became_peered":"2024-03-04T12:20:14.823430+0000","last_unstale":"2024-03-04T13:13:27.106284+0000","last_undegraded":"2024-03-04T13:13:27.106284+0000","last_fullsized":"2024-03-04T13:13:27.106284+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1683023,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":325,"num_read_kb":32856,"num_write":784,"num_write_kb":22354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"255'556","reported_seq":2088,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.179051+0000","last_change":"2024-03-04T12:20:16.830040+0000","last_active":"2024-03-04T13:13:26.179051+0000","last_peered":"2024-03-04T13:13:26.179051+0000","last_clean":"2024-03-04T13:13:26.179051+0000","last_became_active":"2024-03-04T12:20:16.829685+0000","last_became_peered":"2024-03-04T12:20:16.829685+0000","last_unstale":"2024-03-04T13:13:26.179051+0000","last_undegraded":"2024-03-04T13:13:26.179051+0000","last_fullsized":"2024-03-04T13:13:26.179051+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2792,"num_read_kb":2527,"num_write":750,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"255'193","reported_seq":777,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.642264+0000","last_change":"2024-03-04T12:20:14.822181+0000","last_active":"2024-03-04T13:13:26.642264+0000","last_peered":"2024-03-04T13:13:26.642264+0000","last_clean":"2024-03-04T13:13:26.642264+0000","last_became_active":"2024-03-04T12:20:14.821923+0000","last_became_peered":"2024-03-04T12:20:14.821923+0000","last_unstale":"2024-03-04T13:13:26.642264+0000","last_undegraded":"2024-03-04T13:13:26.642264+0000","last_fullsized":"2024-03-04T13:13:26.642264+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":428,"num_write":1012,"num_write_kb":16985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"255'373","reported_seq":1790,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.106646+0000","last_change":"2024-03-04T12:20:16.826907+0000","last_active":"2024-03-04T13:13:27.106646+0000","last_peered":"2024-03-04T13:13:27.106646+0000","last_clean":"2024-03-04T13:13:27.106646+0000","last_became_active":"2024-03-04T12:20:16.826208+0000","last_became_peered":"2024-03-04T12:20:16.826208+0000","last_unstale":"2024-03-04T13:13:27.106646+0000","last_undegraded":"2024-03-04T13:13:27.106646+0000","last_fullsized":"2024-03-04T13:13:27.106646+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1988,"num_read_kb":1881,"num_write":441,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"255'173","reported_seq":778,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.207103+0000","last_change":"2024-03-04T12:20:14.812110+0000","last_active":"2024-03-04T13:13:21.207103+0000","last_peered":"2024-03-04T13:13:21.207103+0000","last_clean":"2024-03-04T13:13:21.207103+0000","last_became_active":"2024-03-04T12:20:14.811813+0000","last_became_peered":"2024-03-04T12:20:14.811813+0000","last_unstale":"2024-03-04T13:13:21.207103+0000","last_undegraded":"2024-03-04T13:13:21.207103+0000","last_fullsized":"2024-03-04T13:13:21.207103+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":397,"num_read_kb":4485,"num_write":973,"num_write_kb":10922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"255'94","reported_seq":590,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.145617+0000","last_change":"2024-03-04T13:13:32.145617+0000","last_active":"2024-03-04T13:13:32.145617+0000","last_peered":"2024-03-04T13:13:32.145617+0000","last_clean":"2024-03-04T13:13:32.145617+0000","last_became_active":"2024-03-04T12:20:24.871089+0000","last_became_peered":"2024-03-04T12:20:24.871089+0000","last_unstale":"2024-03-04T13:13:32.145617+0000","last_undegraded":"2024-03-04T13:13:32.145617+0000","last_fullsized":"2024-03-04T13:13:32.145617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'94","last_scrub_stamp":"2024-03-04T13:13:32.145502+0000","last_deep_scrub":"255'94","last_deep_scrub_stamp":"2024-03-04T13:13:32.145502+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.145502+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:10.096376+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":97,"num_write":227,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"255'790","reported_seq":2213,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.075240+0000","last_change":"2024-03-04T12:20:16.829280+0000","last_active":"2024-03-04T13:12:18.075240+0000","last_peered":"2024-03-04T13:12:18.075240+0000","last_clean":"2024-03-04T13:12:18.075240+0000","last_became_active":"2024-03-04T12:20:16.828977+0000","last_became_peered":"2024-03-04T12:20:16.828977+0000","last_unstale":"2024-03-04T13:12:18.075240+0000","last_undegraded":"2024-03-04T13:12:18.075240+0000","last_fullsized":"2024-03-04T13:12:18.075240+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3439,"num_read_kb":3056,"num_write":1047,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"255'219","reported_seq":870,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.173204+0000","last_change":"2024-03-04T12:20:14.817012+0000","last_active":"2024-03-04T13:13:21.173204+0000","last_peered":"2024-03-04T13:13:21.173204+0000","last_clean":"2024-03-04T13:13:21.173204+0000","last_became_active":"2024-03-04T12:20:14.816722+0000","last_became_peered":"2024-03-04T12:20:14.816722+0000","last_unstale":"2024-03-04T13:13:21.173204+0000","last_undegraded":"2024-03-04T13:13:21.173204+0000","last_fullsized":"2024-03-04T13:13:21.173204+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1705735,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":471,"num_read_kb":103623,"num_write":1220,"num_write_kb":57222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":484,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.565528+0000","last_change":"2024-03-04T12:20:18.835916+0000","last_active":"2024-03-04T13:13:27.565528+0000","last_peered":"2024-03-04T13:13:27.565528+0000","last_clean":"2024-03-04T13:13:27.565528+0000","last_became_active":"2024-03-04T12:20:18.835597+0000","last_became_peered":"2024-03-04T12:20:18.835597+0000","last_unstale":"2024-03-04T13:13:27.565528+0000","last_undegraded":"2024-03-04T13:13:27.565528+0000","last_fullsized":"2024-03-04T13:13:27.565528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"255'185","reported_seq":770,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260494+0000","last_change":"2024-03-04T12:20:20.837358+0000","last_active":"2024-03-04T13:13:25.260494+0000","last_peered":"2024-03-04T13:13:25.260494+0000","last_clean":"2024-03-04T13:13:25.260494+0000","last_became_active":"2024-03-04T12:20:20.837048+0000","last_became_peered":"2024-03-04T12:20:20.837048+0000","last_unstale":"2024-03-04T13:13:25.260494+0000","last_undegraded":"2024-03-04T13:13:25.260494+0000","last_fullsized":"2024-03-04T13:13:25.260494+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":254,"num_read_kb":315,"num_write":146,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":491,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.498806+0000","last_change":"2024-03-04T13:13:41.498831+0000","last_active":"2024-03-04T13:13:41.498806+0000","last_peered":"2024-03-04T13:13:41.498806+0000","last_clean":"2024-03-04T13:13:41.498806+0000","last_became_active":"2024-03-04T12:20:22.852461+0000","last_became_peered":"2024-03-04T12:20:22.852461+0000","last_unstale":"2024-03-04T13:13:41.498806+0000","last_undegraded":"2024-03-04T13:13:41.498806+0000","last_fullsized":"2024-03-04T13:13:41.498806+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:41.498692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:41.498692+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.498692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:16:36.806224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"255'2374","reported_seq":4178,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.244538+0000","last_change":"2024-03-04T13:13:32.244538+0000","last_active":"2024-03-04T13:13:32.244538+0000","last_peered":"2024-03-04T13:13:32.244538+0000","last_clean":"2024-03-04T13:13:32.244538+0000","last_became_active":"2024-03-04T12:20:24.869395+0000","last_became_peered":"2024-03-04T12:20:24.869395+0000","last_unstale":"2024-03-04T13:13:32.244538+0000","last_undegraded":"2024-03-04T13:13:32.244538+0000","last_fullsized":"2024-03-04T13:13:32.244538+0000","mapping_epoch":30,"log_start":"255'2300","ondisk_log_start":"255'2300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2374","last_scrub_stamp":"2024-03-04T13:13:32.244414+0000","last_deep_scrub":"255'2374","last_deep_scrub_stamp":"2024-03-04T13:13:32.244414+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.244414+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":2300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:00:10.267491+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5943,"num_read_kb":5935,"num_write":4730,"num_write_kb":1746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"255'348","reported_seq":1824,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.378169+0000","last_change":"2024-03-04T13:13:46.378200+0000","last_active":"2024-03-04T13:13:46.378169+0000","last_peered":"2024-03-04T13:13:46.378169+0000","last_clean":"2024-03-04T13:13:46.378169+0000","last_became_active":"2024-03-04T12:20:16.829441+0000","last_became_peered":"2024-03-04T12:20:16.829441+0000","last_unstale":"2024-03-04T13:13:46.378169+0000","last_undegraded":"2024-03-04T13:13:46.378169+0000","last_fullsized":"2024-03-04T13:13:46.378169+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'348","last_scrub_stamp":"2024-03-04T13:13:46.378079+0000","last_deep_scrub":"255'348","last_deep_scrub_stamp":"2024-03-04T13:13:46.378079+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.378079+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:49:37.173629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2107,"num_read_kb":2006,"num_write":408,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2858,"num_omap_keys":13,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"255'161","reported_seq":725,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.083992+0000","last_change":"2024-03-04T12:20:14.819912+0000","last_active":"2024-03-04T13:13:21.083992+0000","last_peered":"2024-03-04T13:13:21.083992+0000","last_clean":"2024-03-04T13:13:21.083992+0000","last_became_active":"2024-03-04T12:20:14.819559+0000","last_became_peered":"2024-03-04T12:20:14.819559+0000","last_unstale":"2024-03-04T13:13:21.083992+0000","last_undegraded":"2024-03-04T13:13:21.083992+0000","last_fullsized":"2024-03-04T13:13:21.083992+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":323,"num_read_kb":7587,"num_write":849,"num_write_kb":22276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:47.462643+0000","last_change":"2024-03-04T12:20:18.834062+0000","last_active":"2024-03-04T13:11:47.462643+0000","last_peered":"2024-03-04T13:11:47.462643+0000","last_clean":"2024-03-04T13:11:47.462643+0000","last_became_active":"2024-03-04T12:20:18.833470+0000","last_became_peered":"2024-03-04T12:20:18.833470+0000","last_unstale":"2024-03-04T13:11:47.462643+0000","last_undegraded":"2024-03-04T13:11:47.462643+0000","last_fullsized":"2024-03-04T13:11:47.462643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"255'80","reported_seq":606,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.292561+0000","last_change":"2024-03-04T13:13:46.292613+0000","last_active":"2024-03-04T13:13:46.292561+0000","last_peered":"2024-03-04T13:13:46.292561+0000","last_clean":"2024-03-04T13:13:46.292561+0000","last_became_active":"2024-03-04T12:20:20.837905+0000","last_became_peered":"2024-03-04T12:20:20.837905+0000","last_unstale":"2024-03-04T13:13:46.292561+0000","last_undegraded":"2024-03-04T13:13:46.292561+0000","last_fullsized":"2024-03-04T13:13:46.292561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'80","last_scrub_stamp":"2024-03-04T13:13:46.292461+0000","last_deep_scrub":"255'80","last_deep_scrub_stamp":"2024-03-04T13:13:46.292461+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.292461+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:05:22.285515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.224938+0000","last_change":"2024-03-04T13:13:39.224970+0000","last_active":"2024-03-04T13:13:39.224938+0000","last_peered":"2024-03-04T13:13:39.224938+0000","last_clean":"2024-03-04T13:13:39.224938+0000","last_became_active":"2024-03-04T12:20:22.848773+0000","last_became_peered":"2024-03-04T12:20:22.848773+0000","last_unstale":"2024-03-04T13:13:39.224938+0000","last_undegraded":"2024-03-04T13:13:39.224938+0000","last_fullsized":"2024-03-04T13:13:39.224938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:39.224844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:39.224844+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.224844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:01:57.050536+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"255'120","reported_seq":620,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.882743+0000","last_change":"2024-03-04T13:13:33.882777+0000","last_active":"2024-03-04T13:13:33.882743+0000","last_peered":"2024-03-04T13:13:33.882743+0000","last_clean":"2024-03-04T13:13:33.882743+0000","last_became_active":"2024-03-04T12:20:24.868746+0000","last_became_peered":"2024-03-04T12:20:24.868746+0000","last_unstale":"2024-03-04T13:13:33.882743+0000","last_undegraded":"2024-03-04T13:13:33.882743+0000","last_fullsized":"2024-03-04T13:13:33.882743+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'120","last_scrub_stamp":"2024-03-04T13:13:33.882663+0000","last_deep_scrub":"255'120","last_deep_scrub_stamp":"2024-03-04T13:13:33.882663+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.882663+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:25.145935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"255'390","reported_seq":1883,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260514+0000","last_change":"2024-03-04T12:20:16.829905+0000","last_active":"2024-03-04T13:13:25.260514+0000","last_peered":"2024-03-04T13:13:25.260514+0000","last_clean":"2024-03-04T13:13:25.260514+0000","last_became_active":"2024-03-04T12:20:16.829641+0000","last_became_peered":"2024-03-04T12:20:16.829641+0000","last_unstale":"2024-03-04T13:13:25.260514+0000","last_undegraded":"2024-03-04T13:13:25.260514+0000","last_fullsized":"2024-03-04T13:13:25.260514+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2147,"num_read_kb":2039,"num_write":462,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"255'144","reported_seq":759,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.081396+0000","last_change":"2024-03-04T12:20:14.817840+0000","last_active":"2024-03-04T13:13:21.081396+0000","last_peered":"2024-03-04T13:13:21.081396+0000","last_clean":"2024-03-04T13:13:21.081396+0000","last_became_active":"2024-03-04T12:20:14.817556+0000","last_became_peered":"2024-03-04T12:20:14.817556+0000","last_unstale":"2024-03-04T13:13:21.081396+0000","last_undegraded":"2024-03-04T13:13:21.081396+0000","last_fullsized":"2024-03-04T13:13:21.081396+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524480,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":366,"num_read_kb":1564,"num_write":822,"num_write_kb":17292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.642553+0000","last_change":"2024-03-04T12:20:18.836217+0000","last_active":"2024-03-04T13:13:26.642553+0000","last_peered":"2024-03-04T13:13:26.642553+0000","last_clean":"2024-03-04T13:13:26.642553+0000","last_became_active":"2024-03-04T12:20:18.835760+0000","last_became_peered":"2024-03-04T12:20:18.835760+0000","last_unstale":"2024-03-04T13:13:26.642553+0000","last_undegraded":"2024-03-04T13:13:26.642553+0000","last_fullsized":"2024-03-04T13:13:26.642553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"255'119","reported_seq":653,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.035071+0000","last_change":"2024-03-04T13:13:34.035113+0000","last_active":"2024-03-04T13:13:34.035071+0000","last_peered":"2024-03-04T13:13:34.035071+0000","last_clean":"2024-03-04T13:13:34.035071+0000","last_became_active":"2024-03-04T12:20:20.838094+0000","last_became_peered":"2024-03-04T12:20:20.838094+0000","last_unstale":"2024-03-04T13:13:34.035071+0000","last_undegraded":"2024-03-04T13:13:34.035071+0000","last_fullsized":"2024-03-04T13:13:34.035071+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'119","last_scrub_stamp":"2024-03-04T13:13:34.034984+0000","last_deep_scrub":"255'119","last_deep_scrub_stamp":"2024-03-04T13:13:34.034984+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.034984+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:32:21.314242+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":129,"num_write":92,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"255'502","reported_seq":1939,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.473406+0000","last_change":"2024-03-04T13:13:42.473432+0000","last_active":"2024-03-04T13:13:42.473406+0000","last_peered":"2024-03-04T13:13:42.473406+0000","last_clean":"2024-03-04T13:13:42.473406+0000","last_became_active":"2024-03-04T12:20:22.851062+0000","last_became_peered":"2024-03-04T12:20:22.851062+0000","last_unstale":"2024-03-04T13:13:42.473406+0000","last_undegraded":"2024-03-04T13:13:42.473406+0000","last_fullsized":"2024-03-04T13:13:42.473406+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'502","last_scrub_stamp":"2024-03-04T13:13:42.473290+0000","last_deep_scrub":"255'502","last_deep_scrub_stamp":"2024-03-04T13:13:42.473290+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.473290+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:04:59.380321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"255'139","reported_seq":626,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.108679+0000","last_change":"2024-03-04T13:13:31.108749+0000","last_active":"2024-03-04T13:13:31.108679+0000","last_peered":"2024-03-04T13:13:31.108679+0000","last_clean":"2024-03-04T13:13:31.108679+0000","last_became_active":"2024-03-04T12:20:24.912068+0000","last_became_peered":"2024-03-04T12:20:24.912068+0000","last_unstale":"2024-03-04T13:13:31.108679+0000","last_undegraded":"2024-03-04T13:13:31.108679+0000","last_fullsized":"2024-03-04T13:13:31.108679+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'139","last_scrub_stamp":"2024-03-04T13:13:31.108574+0000","last_deep_scrub":"255'139","last_deep_scrub_stamp":"2024-03-04T13:13:31.108574+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.108574+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:53.333608+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":66,"num_write":291,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":168,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"255'856","reported_seq":2538,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.642404+0000","last_change":"2024-03-04T12:20:16.831420+0000","last_active":"2024-03-04T13:13:26.642404+0000","last_peered":"2024-03-04T13:13:26.642404+0000","last_clean":"2024-03-04T13:13:26.642404+0000","last_became_active":"2024-03-04T12:20:16.831039+0000","last_became_peered":"2024-03-04T12:20:16.831039+0000","last_unstale":"2024-03-04T13:13:26.642404+0000","last_undegraded":"2024-03-04T13:13:26.642404+0000","last_fullsized":"2024-03-04T13:13:26.642404+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4009,"num_read_kb":3592,"num_write":1144,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"255'195","reported_seq":799,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.174889+0000","last_change":"2024-03-04T12:20:14.818137+0000","last_active":"2024-03-04T13:13:21.174889+0000","last_peered":"2024-03-04T13:13:21.174889+0000","last_clean":"2024-03-04T13:13:21.174889+0000","last_became_active":"2024-03-04T12:20:14.817863+0000","last_became_peered":"2024-03-04T12:20:14.817863+0000","last_unstale":"2024-03-04T13:13:21.174889+0000","last_undegraded":"2024-03-04T13:13:21.174889+0000","last_fullsized":"2024-03-04T13:13:21.174889+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9161812,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":19635,"num_write":1198,"num_write_kb":36958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"32'4","reported_seq":794,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.565506+0000","last_change":"2024-03-04T12:20:18.838746+0000","last_active":"2024-03-04T13:13:27.565506+0000","last_peered":"2024-03-04T13:13:27.565506+0000","last_clean":"2024-03-04T13:13:27.565506+0000","last_became_active":"2024-03-04T12:20:18.838266+0000","last_became_peered":"2024-03-04T12:20:18.838266+0000","last_unstale":"2024-03-04T13:13:27.565506+0000","last_undegraded":"2024-03-04T13:13:27.565506+0000","last_fullsized":"2024-03-04T13:13:27.565506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":466,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"255'133","reported_seq":707,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.555514+0000","last_change":"2024-03-04T13:13:45.555549+0000","last_active":"2024-03-04T13:13:45.555514+0000","last_peered":"2024-03-04T13:13:45.555514+0000","last_clean":"2024-03-04T13:13:45.555514+0000","last_became_active":"2024-03-04T12:20:21.643542+0000","last_became_peered":"2024-03-04T12:20:21.643542+0000","last_unstale":"2024-03-04T13:13:45.555514+0000","last_undegraded":"2024-03-04T13:13:45.555514+0000","last_fullsized":"2024-03-04T13:13:45.555514+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'133","last_scrub_stamp":"2024-03-04T13:13:45.555419+0000","last_deep_scrub":"255'133","last_deep_scrub_stamp":"2024-03-04T13:13:45.555419+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.555419+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:57:31.107185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9148,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":181,"num_read_kb":265,"num_write":100,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"255'530","reported_seq":1921,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.874270+0000","last_change":"2024-03-04T13:13:45.874327+0000","last_active":"2024-03-04T13:13:45.874270+0000","last_peered":"2024-03-04T13:13:45.874270+0000","last_clean":"2024-03-04T13:13:45.874270+0000","last_became_active":"2024-03-04T12:20:22.858575+0000","last_became_peered":"2024-03-04T12:20:22.858575+0000","last_unstale":"2024-03-04T13:13:45.874270+0000","last_undegraded":"2024-03-04T13:13:45.874270+0000","last_fullsized":"2024-03-04T13:13:45.874270+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'530","last_scrub_stamp":"2024-03-04T13:13:45.874162+0000","last_deep_scrub":"255'530","last_deep_scrub_stamp":"2024-03-04T13:13:45.874162+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.874162+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:41.473943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"255'392","reported_seq":1806,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.417022+0000","last_change":"2024-03-04T13:13:45.417063+0000","last_active":"2024-03-04T13:13:45.417022+0000","last_peered":"2024-03-04T13:13:45.417022+0000","last_clean":"2024-03-04T13:13:45.417022+0000","last_became_active":"2024-03-04T12:20:16.830531+0000","last_became_peered":"2024-03-04T12:20:16.830531+0000","last_unstale":"2024-03-04T13:13:45.417022+0000","last_undegraded":"2024-03-04T13:13:45.417022+0000","last_fullsized":"2024-03-04T13:13:45.417022+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'392","last_scrub_stamp":"2024-03-04T13:13:45.416932+0000","last_deep_scrub":"255'392","last_deep_scrub_stamp":"2024-03-04T13:13:45.416932+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.416932+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:55:36.780667+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2065,"num_write":498,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"255'174","reported_seq":850,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.207257+0000","last_change":"2024-03-04T12:20:14.818724+0000","last_active":"2024-03-04T13:13:21.207257+0000","last_peered":"2024-03-04T13:13:21.207257+0000","last_clean":"2024-03-04T13:13:21.207257+0000","last_became_active":"2024-03-04T12:20:14.818441+0000","last_became_peered":"2024-03-04T12:20:14.818441+0000","last_unstale":"2024-03-04T13:13:21.207257+0000","last_undegraded":"2024-03-04T13:13:21.207257+0000","last_fullsized":"2024-03-04T13:13:21.207257+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10526962,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":524,"num_read_kb":158242,"num_write":986,"num_write_kb":38243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520416+0000","last_change":"2024-03-04T12:20:18.832672+0000","last_active":"2024-03-04T13:12:22.520416+0000","last_peered":"2024-03-04T13:12:22.520416+0000","last_clean":"2024-03-04T13:12:22.520416+0000","last_became_active":"2024-03-04T12:20:18.832349+0000","last_became_peered":"2024-03-04T12:20:18.832349+0000","last_unstale":"2024-03-04T13:12:22.520416+0000","last_undegraded":"2024-03-04T13:12:22.520416+0000","last_fullsized":"2024-03-04T13:12:22.520416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"255'225","reported_seq":838,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.354424+0000","last_change":"2024-03-04T13:13:42.354509+0000","last_active":"2024-03-04T13:13:42.354424+0000","last_peered":"2024-03-04T13:13:42.354424+0000","last_clean":"2024-03-04T13:13:42.354424+0000","last_became_active":"2024-03-04T12:20:21.641749+0000","last_became_peered":"2024-03-04T12:20:21.641749+0000","last_unstale":"2024-03-04T13:13:42.354424+0000","last_undegraded":"2024-03-04T13:13:42.354424+0000","last_fullsized":"2024-03-04T13:13:42.354424+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'225","last_scrub_stamp":"2024-03-04T13:13:42.354322+0000","last_deep_scrub":"255'225","last_deep_scrub_stamp":"2024-03-04T13:13:42.354322+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.354322+0000","objects_scrubbed":9,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:02:03.360542+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6571,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":304,"num_read_kb":381,"num_write":178,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":478,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.554993+0000","last_change":"2024-03-04T12:20:22.852908+0000","last_active":"2024-03-04T13:12:07.554993+0000","last_peered":"2024-03-04T13:12:07.554993+0000","last_clean":"2024-03-04T13:12:07.554993+0000","last_became_active":"2024-03-04T12:20:22.852612+0000","last_became_peered":"2024-03-04T12:20:22.852612+0000","last_unstale":"2024-03-04T13:12:07.554993+0000","last_undegraded":"2024-03-04T13:12:07.554993+0000","last_fullsized":"2024-03-04T13:12:07.554993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"255'524","reported_seq":1326,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.257848+0000","last_change":"2024-03-04T13:13:33.257881+0000","last_active":"2024-03-04T13:13:33.257848+0000","last_peered":"2024-03-04T13:13:33.257848+0000","last_clean":"2024-03-04T13:13:33.257848+0000","last_became_active":"2024-03-04T12:20:24.869409+0000","last_became_peered":"2024-03-04T12:20:24.869409+0000","last_unstale":"2024-03-04T13:13:33.257848+0000","last_undegraded":"2024-03-04T13:13:33.257848+0000","last_fullsized":"2024-03-04T13:13:33.257848+0000","mapping_epoch":30,"log_start":"255'500","ondisk_log_start":"255'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'524","last_scrub_stamp":"2024-03-04T13:13:33.257751+0000","last_deep_scrub":"255'524","last_deep_scrub_stamp":"2024-03-04T13:13:33.257751+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.257751+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:38.905328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1237,"num_read_kb":1237,"num_write":1069,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"255'315","reported_seq":1783,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.592082+0000","last_change":"2024-03-04T12:20:16.826445+0000","last_active":"2024-03-04T13:12:50.592082+0000","last_peered":"2024-03-04T13:12:50.592082+0000","last_clean":"2024-03-04T13:12:50.592082+0000","last_became_active":"2024-03-04T12:20:16.826183+0000","last_became_peered":"2024-03-04T12:20:16.826183+0000","last_unstale":"2024-03-04T13:12:50.592082+0000","last_undegraded":"2024-03-04T13:12:50.592082+0000","last_fullsized":"2024-03-04T13:12:50.592082+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2023,"num_read_kb":1945,"num_write":353,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"255'180","reported_seq":811,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.183155+0000","last_change":"2024-03-04T12:20:14.819684+0000","last_active":"2024-03-04T13:13:21.183155+0000","last_peered":"2024-03-04T13:13:21.183155+0000","last_clean":"2024-03-04T13:13:21.183155+0000","last_became_active":"2024-03-04T12:20:14.819389+0000","last_became_peered":"2024-03-04T12:20:14.819389+0000","last_unstale":"2024-03-04T13:13:21.183155+0000","last_undegraded":"2024-03-04T13:13:21.183155+0000","last_fullsized":"2024-03-04T13:13:21.183155+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":382,"num_read_kb":37991,"num_write":1066,"num_write_kb":16641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.162022+0000","last_change":"2024-03-04T13:13:40.162043+0000","last_active":"2024-03-04T13:13:40.162022+0000","last_peered":"2024-03-04T13:13:40.162022+0000","last_clean":"2024-03-04T13:13:40.162022+0000","last_became_active":"2024-03-04T12:20:18.834619+0000","last_became_peered":"2024-03-04T12:20:18.834619+0000","last_unstale":"2024-03-04T13:13:40.162022+0000","last_undegraded":"2024-03-04T13:13:40.162022+0000","last_fullsized":"2024-03-04T13:13:40.162022+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.161921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.161921+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.161921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:50.976546+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"255'129","reported_seq":685,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.203075+0000","last_change":"2024-03-04T12:20:20.843676+0000","last_active":"2024-03-04T13:13:21.203075+0000","last_peered":"2024-03-04T13:13:21.203075+0000","last_clean":"2024-03-04T13:13:21.203075+0000","last_became_active":"2024-03-04T12:20:20.843195+0000","last_became_peered":"2024-03-04T12:20:20.843195+0000","last_unstale":"2024-03-04T13:13:21.203075+0000","last_undegraded":"2024-03-04T13:13:21.203075+0000","last_fullsized":"2024-03-04T13:13:21.203075+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":216,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":483,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.818122+0000","last_change":"2024-03-04T13:13:43.818146+0000","last_active":"2024-03-04T13:13:43.818122+0000","last_peered":"2024-03-04T13:13:43.818122+0000","last_clean":"2024-03-04T13:13:43.818122+0000","last_became_active":"2024-03-04T12:20:22.858722+0000","last_became_peered":"2024-03-04T12:20:22.858722+0000","last_unstale":"2024-03-04T13:13:43.818122+0000","last_undegraded":"2024-03-04T13:13:43.818122+0000","last_fullsized":"2024-03-04T13:13:43.818122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:43.818034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:43.818034+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.818034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:06:19.231882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"255'182","reported_seq":704,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:42.499570+0000","last_change":"2024-03-04T12:20:24.869476+0000","last_active":"2024-03-04T13:12:42.499570+0000","last_peered":"2024-03-04T13:12:42.499570+0000","last_clean":"2024-03-04T13:12:42.499570+0000","last_became_active":"2024-03-04T12:20:24.869152+0000","last_became_peered":"2024-03-04T12:20:24.869152+0000","last_unstale":"2024-03-04T13:12:42.499570+0000","last_undegraded":"2024-03-04T13:12:42.499570+0000","last_fullsized":"2024-03-04T13:12:42.499570+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":286,"num_read_kb":243,"num_write":358,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"255'1227","reported_seq":2778,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.731782+0000","last_change":"2024-03-04T13:13:43.731818+0000","last_active":"2024-03-04T13:13:43.731782+0000","last_peered":"2024-03-04T13:13:43.731782+0000","last_clean":"2024-03-04T13:13:43.731782+0000","last_became_active":"2024-03-04T12:20:16.826172+0000","last_became_peered":"2024-03-04T12:20:16.826172+0000","last_unstale":"2024-03-04T13:13:43.731782+0000","last_undegraded":"2024-03-04T13:13:43.731782+0000","last_fullsized":"2024-03-04T13:13:43.731782+0000","mapping_epoch":22,"log_start":"255'1200","ondisk_log_start":"255'1200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1227","last_scrub_stamp":"2024-03-04T13:13:43.731679+0000","last_deep_scrub":"255'1227","last_deep_scrub_stamp":"2024-03-04T13:13:43.731679+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.731679+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:47:03.032710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5093,"num_read_kb":4391,"num_write":1710,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"255'179","reported_seq":839,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.140802+0000","last_change":"2024-03-04T12:20:14.828602+0000","last_active":"2024-03-04T13:13:21.140802+0000","last_peered":"2024-03-04T13:13:21.140802+0000","last_clean":"2024-03-04T13:13:21.140802+0000","last_became_active":"2024-03-04T12:20:14.828250+0000","last_became_peered":"2024-03-04T12:20:14.828250+0000","last_unstale":"2024-03-04T13:13:21.140802+0000","last_undegraded":"2024-03-04T13:13:21.140802+0000","last_fullsized":"2024-03-04T13:13:21.140802+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22063,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":10895,"num_write":937,"num_write_kb":21474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.120307+0000","last_change":"2024-03-04T13:13:38.120329+0000","last_active":"2024-03-04T13:13:38.120307+0000","last_peered":"2024-03-04T13:13:38.120307+0000","last_clean":"2024-03-04T13:13:38.120307+0000","last_became_active":"2024-03-04T12:20:18.834897+0000","last_became_peered":"2024-03-04T12:20:18.834897+0000","last_unstale":"2024-03-04T13:13:38.120307+0000","last_undegraded":"2024-03-04T13:13:38.120307+0000","last_fullsized":"2024-03-04T13:13:38.120307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:38.120219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:38.120219+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.120219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:32.193662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"255'162","reported_seq":747,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.118796+0000","last_change":"2024-03-04T12:20:20.839989+0000","last_active":"2024-03-04T13:13:21.118796+0000","last_peered":"2024-03-04T13:13:21.118796+0000","last_clean":"2024-03-04T13:13:21.118796+0000","last_became_active":"2024-03-04T12:20:20.839295+0000","last_became_peered":"2024-03-04T12:20:20.839295+0000","last_unstale":"2024-03-04T13:13:21.118796+0000","last_undegraded":"2024-03-04T13:13:21.118796+0000","last_fullsized":"2024-03-04T13:13:21.118796+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":221,"num_read_kb":283,"num_write":122,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"255'515","reported_seq":1905,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.842588+0000","last_change":"2024-03-04T13:13:45.842618+0000","last_active":"2024-03-04T13:13:45.842588+0000","last_peered":"2024-03-04T13:13:45.842588+0000","last_clean":"2024-03-04T13:13:45.842588+0000","last_became_active":"2024-03-04T12:20:22.852529+0000","last_became_peered":"2024-03-04T12:20:22.852529+0000","last_unstale":"2024-03-04T13:13:45.842588+0000","last_undegraded":"2024-03-04T13:13:45.842588+0000","last_fullsized":"2024-03-04T13:13:45.842588+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'515","last_scrub_stamp":"2024-03-04T13:13:45.842495+0000","last_deep_scrub":"255'515","last_deep_scrub_stamp":"2024-03-04T13:13:45.842495+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.842495+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:13.885952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"255'111","reported_seq":588,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.846625+0000","last_change":"2024-03-04T13:13:36.846656+0000","last_active":"2024-03-04T13:13:36.846625+0000","last_peered":"2024-03-04T13:13:36.846625+0000","last_clean":"2024-03-04T13:13:36.846625+0000","last_became_active":"2024-03-04T12:20:24.868076+0000","last_became_peered":"2024-03-04T12:20:24.868076+0000","last_unstale":"2024-03-04T13:13:36.846625+0000","last_undegraded":"2024-03-04T13:13:36.846625+0000","last_fullsized":"2024-03-04T13:13:36.846625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'111","last_scrub_stamp":"2024-03-04T13:13:36.846535+0000","last_deep_scrub":"255'111","last_deep_scrub_stamp":"2024-03-04T13:13:36.846535+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.846535+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:16.784713+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"255'360","reported_seq":1758,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.444905+0000","last_change":"2024-03-04T12:20:16.829010+0000","last_active":"2024-03-04T13:12:39.444905+0000","last_peered":"2024-03-04T13:12:39.444905+0000","last_clean":"2024-03-04T13:12:39.444905+0000","last_became_active":"2024-03-04T12:20:16.828738+0000","last_became_peered":"2024-03-04T12:20:16.828738+0000","last_unstale":"2024-03-04T13:12:39.444905+0000","last_undegraded":"2024-03-04T13:12:39.444905+0000","last_fullsized":"2024-03-04T13:12:39.444905+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1878,"num_read_kb":1794,"num_write":404,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"255'280","reported_seq":1008,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.237152+0000","last_change":"2024-03-04T12:20:14.824611+0000","last_active":"2024-03-04T13:13:21.237152+0000","last_peered":"2024-03-04T13:13:21.237152+0000","last_clean":"2024-03-04T13:13:21.237152+0000","last_became_active":"2024-03-04T12:20:14.824192+0000","last_became_peered":"2024-03-04T12:20:14.824192+0000","last_unstale":"2024-03-04T13:13:21.237152+0000","last_undegraded":"2024-03-04T13:13:21.237152+0000","last_fullsized":"2024-03-04T13:13:21.237152+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":790,"num_read_kb":21513,"num_write":1394,"num_write_kb":41658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":495,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.156608+0000","last_change":"2024-03-04T13:13:42.156653+0000","last_active":"2024-03-04T13:13:42.156608+0000","last_peered":"2024-03-04T13:13:42.156608+0000","last_clean":"2024-03-04T13:13:42.156608+0000","last_became_active":"2024-03-04T12:20:18.832483+0000","last_became_peered":"2024-03-04T12:20:18.832483+0000","last_unstale":"2024-03-04T13:13:42.156608+0000","last_undegraded":"2024-03-04T13:13:42.156608+0000","last_fullsized":"2024-03-04T13:13:42.156608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:42.156508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:42.156508+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.156508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:17.833533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"255'190","reported_seq":805,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.224983+0000","last_change":"2024-03-04T12:20:20.838146+0000","last_active":"2024-03-04T13:13:21.224983+0000","last_peered":"2024-03-04T13:13:21.224983+0000","last_clean":"2024-03-04T13:13:21.224983+0000","last_became_active":"2024-03-04T12:20:20.837748+0000","last_became_peered":"2024-03-04T12:20:20.837748+0000","last_unstale":"2024-03-04T13:13:21.224983+0000","last_undegraded":"2024-03-04T13:13:21.224983+0000","last_fullsized":"2024-03-04T13:13:21.224983+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13702,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":270,"num_read_kb":346,"num_write":130,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.133564+0000","last_change":"2024-03-04T13:13:30.133607+0000","last_active":"2024-03-04T13:13:30.133564+0000","last_peered":"2024-03-04T13:13:30.133564+0000","last_clean":"2024-03-04T13:13:30.133564+0000","last_became_active":"2024-03-04T12:20:22.849784+0000","last_became_peered":"2024-03-04T12:20:22.849784+0000","last_unstale":"2024-03-04T13:13:30.133564+0000","last_undegraded":"2024-03-04T13:13:30.133564+0000","last_fullsized":"2024-03-04T13:13:30.133564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:30.133463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:30.133463+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.133463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:20:55.533934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"255'100","reported_seq":618,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.759279+0000","last_change":"2024-03-04T13:13:38.759326+0000","last_active":"2024-03-04T13:13:38.759279+0000","last_peered":"2024-03-04T13:13:38.759279+0000","last_clean":"2024-03-04T13:13:38.759279+0000","last_became_active":"2024-03-04T12:20:24.864820+0000","last_became_peered":"2024-03-04T12:20:24.864820+0000","last_unstale":"2024-03-04T13:13:38.759279+0000","last_undegraded":"2024-03-04T13:13:38.759279+0000","last_fullsized":"2024-03-04T13:13:38.759279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'100","last_scrub_stamp":"2024-03-04T13:13:38.759166+0000","last_deep_scrub":"255'100","last_deep_scrub_stamp":"2024-03-04T13:13:38.759166+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.759166+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:12.515390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":165,"num_write":238,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"255'1121","reported_seq":2624,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:15.775415+0000","last_change":"2024-03-04T12:20:16.828787+0000","last_active":"2024-03-04T13:12:15.775415+0000","last_peered":"2024-03-04T13:12:15.775415+0000","last_clean":"2024-03-04T13:12:15.775415+0000","last_became_active":"2024-03-04T12:20:16.828486+0000","last_became_peered":"2024-03-04T12:20:16.828486+0000","last_unstale":"2024-03-04T13:12:15.775415+0000","last_undegraded":"2024-03-04T13:12:15.775415+0000","last_fullsized":"2024-03-04T13:12:15.775415+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4686,"num_read_kb":4085,"num_write":1549,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"255'242","reported_seq":878,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.228399+0000","last_change":"2024-03-04T12:20:14.817073+0000","last_active":"2024-03-04T13:13:21.228399+0000","last_peered":"2024-03-04T13:13:21.228399+0000","last_clean":"2024-03-04T13:13:21.228399+0000","last_became_active":"2024-03-04T12:20:14.816412+0000","last_became_peered":"2024-03-04T12:20:14.816412+0000","last_unstale":"2024-03-04T13:13:21.228399+0000","last_undegraded":"2024-03-04T13:13:21.228399+0000","last_fullsized":"2024-03-04T13:13:21.228399+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399147,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":515,"num_read_kb":1880,"num_write":1395,"num_write_kb":20590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":494,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.164999+0000","last_change":"2024-03-04T13:13:44.165023+0000","last_active":"2024-03-04T13:13:44.164999+0000","last_peered":"2024-03-04T13:13:44.164999+0000","last_clean":"2024-03-04T13:13:44.164999+0000","last_became_active":"2024-03-04T12:20:18.830763+0000","last_became_peered":"2024-03-04T12:20:18.830763+0000","last_unstale":"2024-03-04T13:13:44.164999+0000","last_undegraded":"2024-03-04T13:13:44.164999+0000","last_fullsized":"2024-03-04T13:13:44.164999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:44.164911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:44.164911+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.164911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:03:15.010672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"255'161","reported_seq":739,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.316302+0000","last_change":"2024-03-04T13:13:43.316350+0000","last_active":"2024-03-04T13:13:43.316302+0000","last_peered":"2024-03-04T13:13:43.316302+0000","last_clean":"2024-03-04T13:13:43.316302+0000","last_became_active":"2024-03-04T12:20:20.842216+0000","last_became_peered":"2024-03-04T12:20:20.842216+0000","last_unstale":"2024-03-04T13:13:43.316302+0000","last_undegraded":"2024-03-04T13:13:43.316302+0000","last_fullsized":"2024-03-04T13:13:43.316302+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'161","last_scrub_stamp":"2024-03-04T13:13:43.316208+0000","last_deep_scrub":"255'161","last_deep_scrub_stamp":"2024-03-04T13:13:43.316208+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.316208+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:40:50.582624+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7566,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":219,"num_read_kb":283,"num_write":166,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.835993+0000","last_change":"2024-03-04T13:13:43.836017+0000","last_active":"2024-03-04T13:13:43.835993+0000","last_peered":"2024-03-04T13:13:43.835993+0000","last_clean":"2024-03-04T13:13:43.835993+0000","last_became_active":"2024-03-04T12:20:22.855480+0000","last_became_peered":"2024-03-04T12:20:22.855480+0000","last_unstale":"2024-03-04T13:13:43.835993+0000","last_undegraded":"2024-03-04T13:13:43.835993+0000","last_fullsized":"2024-03-04T13:13:43.835993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:43.835903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:43.835903+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.835903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:52:33.201007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"255'90","reported_seq":573,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.877755+0000","last_change":"2024-03-04T13:13:39.877785+0000","last_active":"2024-03-04T13:13:39.877755+0000","last_peered":"2024-03-04T13:13:39.877755+0000","last_clean":"2024-03-04T13:13:39.877755+0000","last_became_active":"2024-03-04T12:20:24.864982+0000","last_became_peered":"2024-03-04T12:20:24.864982+0000","last_unstale":"2024-03-04T13:13:39.877755+0000","last_undegraded":"2024-03-04T13:13:39.877755+0000","last_fullsized":"2024-03-04T13:13:39.877755+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'90","last_scrub_stamp":"2024-03-04T13:13:39.877674+0000","last_deep_scrub":"255'90","last_deep_scrub_stamp":"2024-03-04T13:13:39.877674+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.877674+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:48:00.079117+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":209,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"255'388","reported_seq":1747,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.301924+0000","last_change":"2024-03-04T13:13:47.301955+0000","last_active":"2024-03-04T13:13:47.301924+0000","last_peered":"2024-03-04T13:13:47.301924+0000","last_clean":"2024-03-04T13:13:47.301924+0000","last_became_active":"2024-03-04T12:20:16.824033+0000","last_became_peered":"2024-03-04T12:20:16.824033+0000","last_unstale":"2024-03-04T13:13:47.301924+0000","last_undegraded":"2024-03-04T13:13:47.301924+0000","last_fullsized":"2024-03-04T13:13:47.301924+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'388","last_scrub_stamp":"2024-03-04T13:13:47.301839+0000","last_deep_scrub":"255'388","last_deep_scrub_stamp":"2024-03-04T13:13:47.301839+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.301839+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:10:35.029482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1899,"num_read_kb":1781,"num_write":448,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"255'222","reported_seq":838,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.189880+0000","last_change":"2024-03-04T12:20:14.818954+0000","last_active":"2024-03-04T13:13:21.189880+0000","last_peered":"2024-03-04T13:13:21.189880+0000","last_clean":"2024-03-04T13:13:21.189880+0000","last_became_active":"2024-03-04T12:20:14.818461+0000","last_became_peered":"2024-03-04T12:20:14.818461+0000","last_unstale":"2024-03-04T13:13:21.189880+0000","last_undegraded":"2024-03-04T13:13:21.189880+0000","last_fullsized":"2024-03-04T13:13:21.189880+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":446,"num_read_kb":17082,"num_write":1054,"num_write_kb":47848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":494,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.702606+0000","last_change":"2024-03-04T13:13:45.702630+0000","last_active":"2024-03-04T13:13:45.702606+0000","last_peered":"2024-03-04T13:13:45.702606+0000","last_clean":"2024-03-04T13:13:45.702606+0000","last_became_active":"2024-03-04T12:20:18.837494+0000","last_became_peered":"2024-03-04T12:20:18.837494+0000","last_unstale":"2024-03-04T13:13:45.702606+0000","last_undegraded":"2024-03-04T13:13:45.702606+0000","last_fullsized":"2024-03-04T13:13:45.702606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:45.702512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:45.702512+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.702512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:28:39.385988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"255'178","reported_seq":764,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.099896+0000","last_change":"2024-03-04T13:13:32.099947+0000","last_active":"2024-03-04T13:13:32.099896+0000","last_peered":"2024-03-04T13:13:32.099896+0000","last_clean":"2024-03-04T13:13:32.099896+0000","last_became_active":"2024-03-04T12:20:20.841801+0000","last_became_peered":"2024-03-04T12:20:20.841801+0000","last_unstale":"2024-03-04T13:13:32.099896+0000","last_undegraded":"2024-03-04T13:13:32.099896+0000","last_fullsized":"2024-03-04T13:13:32.099896+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'178","last_scrub_stamp":"2024-03-04T13:13:32.099796+0000","last_deep_scrub":"255'178","last_deep_scrub_stamp":"2024-03-04T13:13:32.099796+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.099796+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:16.653547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7601,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":303,"num_write":134,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"255'492","reported_seq":1894,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.133143+0000","last_change":"2024-03-04T13:13:29.133166+0000","last_active":"2024-03-04T13:13:29.133143+0000","last_peered":"2024-03-04T13:13:29.133143+0000","last_clean":"2024-03-04T13:13:29.133143+0000","last_became_active":"2024-03-04T12:20:22.857578+0000","last_became_peered":"2024-03-04T12:20:22.857578+0000","last_unstale":"2024-03-04T13:13:29.133143+0000","last_undegraded":"2024-03-04T13:13:29.133143+0000","last_fullsized":"2024-03-04T13:13:29.133143+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'492","last_scrub_stamp":"2024-03-04T13:13:29.133074+0000","last_deep_scrub":"255'492","last_deep_scrub_stamp":"2024-03-04T13:13:29.133074+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.133074+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:25.680835+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"255'110","reported_seq":601,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.731985+0000","last_change":"2024-03-04T13:13:36.732015+0000","last_active":"2024-03-04T13:13:36.731985+0000","last_peered":"2024-03-04T13:13:36.731985+0000","last_clean":"2024-03-04T13:13:36.731985+0000","last_became_active":"2024-03-04T12:20:24.867482+0000","last_became_peered":"2024-03-04T12:20:24.867482+0000","last_unstale":"2024-03-04T13:13:36.731985+0000","last_undegraded":"2024-03-04T13:13:36.731985+0000","last_fullsized":"2024-03-04T13:13:36.731985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'110","last_scrub_stamp":"2024-03-04T13:13:36.731895+0000","last_deep_scrub":"255'110","last_deep_scrub_stamp":"2024-03-04T13:13:36.731895+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.731895+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:44:42.326028+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":731,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":256,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"255'343","reported_seq":1944,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.077672+0000","last_change":"2024-03-04T12:20:16.819106+0000","last_active":"2024-03-04T13:12:18.077672+0000","last_peered":"2024-03-04T13:12:18.077672+0000","last_clean":"2024-03-04T13:12:18.077672+0000","last_became_active":"2024-03-04T12:20:16.818795+0000","last_became_peered":"2024-03-04T12:20:16.818795+0000","last_unstale":"2024-03-04T13:12:18.077672+0000","last_undegraded":"2024-03-04T13:12:18.077672+0000","last_fullsized":"2024-03-04T13:12:18.077672+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2162,"num_read_kb":2105,"num_write":376,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"255'220","reported_seq":840,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.221263+0000","last_change":"2024-03-04T12:20:14.818157+0000","last_active":"2024-03-04T13:13:21.221263+0000","last_peered":"2024-03-04T13:13:21.221263+0000","last_clean":"2024-03-04T13:13:21.221263+0000","last_became_active":"2024-03-04T12:20:14.817859+0000","last_became_peered":"2024-03-04T12:20:14.817859+0000","last_unstale":"2024-03-04T13:13:21.221263+0000","last_undegraded":"2024-03-04T13:13:21.221263+0000","last_fullsized":"2024-03-04T13:13:21.221263+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":387,"num_read_kb":14098,"num_write":1105,"num_write_kb":34013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":1102,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.928652+0000","last_change":"2024-03-04T12:20:18.839281+0000","last_active":"2024-03-04T13:13:20.928652+0000","last_peered":"2024-03-04T13:13:20.928652+0000","last_clean":"2024-03-04T13:13:20.928652+0000","last_became_active":"2024-03-04T12:20:18.838389+0000","last_became_peered":"2024-03-04T12:20:18.838389+0000","last_unstale":"2024-03-04T13:13:20.928652+0000","last_undegraded":"2024-03-04T13:13:20.928652+0000","last_fullsized":"2024-03-04T13:13:20.928652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":615,"num_read_kb":615,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"255'101","reported_seq":609,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.464788+0000","last_change":"2024-03-04T12:20:21.642158+0000","last_active":"2024-03-04T13:12:07.464788+0000","last_peered":"2024-03-04T13:12:07.464788+0000","last_clean":"2024-03-04T13:12:07.464788+0000","last_became_active":"2024-03-04T12:20:21.641809+0000","last_became_peered":"2024-03-04T12:20:21.641809+0000","last_unstale":"2024-03-04T13:12:07.464788+0000","last_undegraded":"2024-03-04T13:12:07.464788+0000","last_fullsized":"2024-03-04T13:12:07.464788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":103,"num_read_kb":92,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"255'498","reported_seq":2287,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.759473+0000","last_change":"2024-03-04T13:13:38.759513+0000","last_active":"2024-03-04T13:13:38.759473+0000","last_peered":"2024-03-04T13:13:38.759473+0000","last_clean":"2024-03-04T13:13:38.759473+0000","last_became_active":"2024-03-04T12:20:22.849288+0000","last_became_peered":"2024-03-04T12:20:22.849288+0000","last_unstale":"2024-03-04T13:13:38.759473+0000","last_undegraded":"2024-03-04T13:13:38.759473+0000","last_fullsized":"2024-03-04T13:13:38.759473+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'498","last_scrub_stamp":"2024-03-04T13:13:38.759380+0000","last_deep_scrub":"255'498","last_deep_scrub_stamp":"2024-03-04T13:13:38.759380+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.759380+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:44:22.451253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"255'88","reported_seq":581,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.175491+0000","last_change":"2024-03-04T13:13:34.175521+0000","last_active":"2024-03-04T13:13:34.175491+0000","last_peered":"2024-03-04T13:13:34.175491+0000","last_clean":"2024-03-04T13:13:34.175491+0000","last_became_active":"2024-03-04T12:20:24.870568+0000","last_became_peered":"2024-03-04T12:20:24.870568+0000","last_unstale":"2024-03-04T13:13:34.175491+0000","last_undegraded":"2024-03-04T13:13:34.175491+0000","last_fullsized":"2024-03-04T13:13:34.175491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'88","last_scrub_stamp":"2024-03-04T13:13:34.175404+0000","last_deep_scrub":"255'88","last_deep_scrub_stamp":"2024-03-04T13:13:34.175404+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.175404+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:42:46.985410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":82,"num_read_kb":81,"num_write":219,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"255'297","reported_seq":1656,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.772629+0000","last_change":"2024-03-04T12:20:16.831299+0000","last_active":"2024-03-04T13:12:12.772629+0000","last_peered":"2024-03-04T13:12:12.772629+0000","last_clean":"2024-03-04T13:12:12.772629+0000","last_became_active":"2024-03-04T12:20:16.831001+0000","last_became_peered":"2024-03-04T12:20:16.831001+0000","last_unstale":"2024-03-04T13:12:12.772629+0000","last_undegraded":"2024-03-04T13:12:12.772629+0000","last_fullsized":"2024-03-04T13:12:12.772629+0000","mapping_epoch":22,"log_start":"255'200","ondisk_log_start":"255'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1692,"num_read_kb":1639,"num_write":326,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"255'199","reported_seq":822,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.222514+0000","last_change":"2024-03-04T12:20:14.813162+0000","last_active":"2024-03-04T13:13:21.222514+0000","last_peered":"2024-03-04T13:13:21.222514+0000","last_clean":"2024-03-04T13:13:21.222514+0000","last_became_active":"2024-03-04T12:20:14.812881+0000","last_became_peered":"2024-03-04T12:20:14.812881+0000","last_unstale":"2024-03-04T13:13:21.222514+0000","last_undegraded":"2024-03-04T13:13:21.222514+0000","last_fullsized":"2024-03-04T13:13:21.222514+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6401060,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":24185,"num_write":1082,"num_write_kb":42346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.517781+0000","last_change":"2024-03-04T12:20:18.836790+0000","last_active":"2024-03-04T13:12:07.517781+0000","last_peered":"2024-03-04T13:12:07.517781+0000","last_clean":"2024-03-04T13:12:07.517781+0000","last_became_active":"2024-03-04T12:20:18.836493+0000","last_became_peered":"2024-03-04T12:20:18.836493+0000","last_unstale":"2024-03-04T13:12:07.517781+0000","last_undegraded":"2024-03-04T13:12:07.517781+0000","last_fullsized":"2024-03-04T13:12:07.517781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"255'249","reported_seq":847,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.075144+0000","last_change":"2024-03-04T12:20:20.839419+0000","last_active":"2024-03-04T13:13:21.075144+0000","last_peered":"2024-03-04T13:13:21.075144+0000","last_clean":"2024-03-04T13:13:21.075144+0000","last_became_active":"2024-03-04T12:20:20.839079+0000","last_became_peered":"2024-03-04T12:20:20.839079+0000","last_unstale":"2024-03-04T13:13:21.075144+0000","last_undegraded":"2024-03-04T13:13:21.075144+0000","last_fullsized":"2024-03-04T13:13:21.075144+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7172,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":931,"num_read_kb":985,"num_write":1462,"num_write_kb":1319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":488,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.767230+0000","last_change":"2024-03-04T13:13:46.767253+0000","last_active":"2024-03-04T13:13:46.767230+0000","last_peered":"2024-03-04T13:13:46.767230+0000","last_clean":"2024-03-04T13:13:46.767230+0000","last_became_active":"2024-03-04T12:20:22.854860+0000","last_became_peered":"2024-03-04T12:20:22.854860+0000","last_unstale":"2024-03-04T13:13:46.767230+0000","last_undegraded":"2024-03-04T13:13:46.767230+0000","last_fullsized":"2024-03-04T13:13:46.767230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:46.767143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:46.767143+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.767143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:00:22.051997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"255'105","reported_seq":594,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.715961+0000","last_change":"2024-03-04T13:13:37.716009+0000","last_active":"2024-03-04T13:13:37.715961+0000","last_peered":"2024-03-04T13:13:37.715961+0000","last_clean":"2024-03-04T13:13:37.715961+0000","last_became_active":"2024-03-04T12:20:24.865830+0000","last_became_peered":"2024-03-04T12:20:24.865830+0000","last_unstale":"2024-03-04T13:13:37.715961+0000","last_undegraded":"2024-03-04T13:13:37.715961+0000","last_fullsized":"2024-03-04T13:13:37.715961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'105","last_scrub_stamp":"2024-03-04T13:13:37.715816+0000","last_deep_scrub":"255'105","last_deep_scrub_stamp":"2024-03-04T13:13:37.715816+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.715816+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:49:50.861340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":242,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"255'318","reported_seq":1696,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:32.498136+0000","last_change":"2024-03-04T12:20:16.821797+0000","last_active":"2024-03-04T13:12:32.498136+0000","last_peered":"2024-03-04T13:12:32.498136+0000","last_clean":"2024-03-04T13:12:32.498136+0000","last_became_active":"2024-03-04T12:20:16.821495+0000","last_became_peered":"2024-03-04T12:20:16.821495+0000","last_unstale":"2024-03-04T13:12:32.498136+0000","last_undegraded":"2024-03-04T13:12:32.498136+0000","last_fullsized":"2024-03-04T13:12:32.498136+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1811,"num_read_kb":1736,"num_write":364,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":665,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.518424+0000","last_change":"2024-03-04T12:19:58.807747+0000","last_active":"2024-03-04T13:12:12.518424+0000","last_peered":"2024-03-04T13:12:12.518424+0000","last_clean":"2024-03-04T13:12:12.518424+0000","last_became_active":"2024-03-04T12:19:58.806723+0000","last_became_peered":"2024-03-04T12:19:58.806723+0000","last_unstale":"2024-03-04T13:12:12.518424+0000","last_undegraded":"2024-03-04T13:12:12.518424+0000","last_fullsized":"2024-03-04T13:12:12.518424+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:19:57.750293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:19:57.750293+0000","last_clean_scrub_stamp":"2024-03-04T12:19:57.750293+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":501,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.371177+0000","last_change":"2024-03-04T12:20:05.783212+0000","last_active":"2024-03-04T13:12:12.371177+0000","last_peered":"2024-03-04T13:12:12.371177+0000","last_clean":"2024-03-04T13:12:12.371177+0000","last_became_active":"2024-03-04T12:20:05.782921+0000","last_became_peered":"2024-03-04T12:20:05.782921+0000","last_unstale":"2024-03-04T13:12:12.371177+0000","last_undegraded":"2024-03-04T13:12:12.371177+0000","last_fullsized":"2024-03-04T13:12:12.371177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"255'178","reported_seq":800,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.130255+0000","last_change":"2024-03-04T13:13:37.130302+0000","last_active":"2024-03-04T13:13:37.130255+0000","last_peered":"2024-03-04T13:13:37.130255+0000","last_clean":"2024-03-04T13:13:37.130255+0000","last_became_active":"2024-03-04T12:20:51.031720+0000","last_became_peered":"2024-03-04T12:20:51.031720+0000","last_unstale":"2024-03-04T13:13:37.130255+0000","last_undegraded":"2024-03-04T13:13:37.130255+0000","last_fullsized":"2024-03-04T13:13:37.130255+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'178","last_scrub_stamp":"2024-03-04T13:13:37.130170+0000","last_deep_scrub":"255'178","last_deep_scrub_stamp":"2024-03-04T13:13:37.130170+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.130170+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:49.252189+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263538,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":417,"num_read_kb":68206,"num_write":949,"num_write_kb":44048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.521464+0000","last_change":"2024-03-04T12:20:18.830022+0000","last_active":"2024-03-04T13:12:27.521464+0000","last_peered":"2024-03-04T13:12:27.521464+0000","last_clean":"2024-03-04T13:12:27.521464+0000","last_became_active":"2024-03-04T12:20:18.829703+0000","last_became_peered":"2024-03-04T12:20:18.829703+0000","last_unstale":"2024-03-04T13:12:27.521464+0000","last_undegraded":"2024-03-04T13:12:27.521464+0000","last_fullsized":"2024-03-04T13:12:27.521464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"255'316","reported_seq":1013,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.439093+0000","last_change":"2024-03-04T13:13:44.439132+0000","last_active":"2024-03-04T13:13:44.439093+0000","last_peered":"2024-03-04T13:13:44.439093+0000","last_clean":"2024-03-04T13:13:44.439093+0000","last_became_active":"2024-03-04T12:20:20.842433+0000","last_became_peered":"2024-03-04T12:20:20.842433+0000","last_unstale":"2024-03-04T13:13:44.439093+0000","last_undegraded":"2024-03-04T13:13:44.439093+0000","last_fullsized":"2024-03-04T13:13:44.439093+0000","mapping_epoch":26,"log_start":"255'300","ondisk_log_start":"255'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'316","last_scrub_stamp":"2024-03-04T13:13:44.439002+0000","last_deep_scrub":"255'316","last_deep_scrub_stamp":"2024-03-04T13:13:44.439002+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.439002+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:32:03.395404+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34072,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":590,"num_read_kb":823,"num_write":540,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99764,"num_omap_keys":240,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":473,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.459969+0000","last_change":"2024-03-04T12:20:22.849592+0000","last_active":"2024-03-04T13:12:22.459969+0000","last_peered":"2024-03-04T13:12:22.459969+0000","last_clean":"2024-03-04T13:12:22.459969+0000","last_became_active":"2024-03-04T12:20:22.849274+0000","last_became_peered":"2024-03-04T12:20:22.849274+0000","last_unstale":"2024-03-04T13:12:22.459969+0000","last_undegraded":"2024-03-04T13:12:22.459969+0000","last_fullsized":"2024-03-04T13:12:22.459969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"255'108","reported_seq":599,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.497418+0000","last_change":"2024-03-04T12:20:24.865055+0000","last_active":"2024-03-04T13:12:27.497418+0000","last_peered":"2024-03-04T13:12:27.497418+0000","last_clean":"2024-03-04T13:12:27.497418+0000","last_became_active":"2024-03-04T12:20:24.864796+0000","last_became_peered":"2024-03-04T12:20:24.864796+0000","last_unstale":"2024-03-04T13:12:27.497418+0000","last_undegraded":"2024-03-04T13:12:27.497418+0000","last_fullsized":"2024-03-04T13:12:27.497418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":748,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":267,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"255'391","reported_seq":1915,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.327779+0000","last_change":"2024-03-04T12:20:16.836409+0000","last_active":"2024-03-04T13:12:39.327779+0000","last_peered":"2024-03-04T13:12:39.327779+0000","last_clean":"2024-03-04T13:12:39.327779+0000","last_became_active":"2024-03-04T12:20:16.836050+0000","last_became_peered":"2024-03-04T12:20:16.836050+0000","last_unstale":"2024-03-04T13:12:39.327779+0000","last_undegraded":"2024-03-04T13:12:39.327779+0000","last_fullsized":"2024-03-04T13:12:39.327779+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2110,"num_read_kb":2020,"num_write":444,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":509,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:17.519378+0000","last_change":"2024-03-04T12:20:05.781479+0000","last_active":"2024-03-04T13:12:17.519378+0000","last_peered":"2024-03-04T13:12:17.519378+0000","last_clean":"2024-03-04T13:12:17.519378+0000","last_became_active":"2024-03-04T12:20:05.781199+0000","last_became_peered":"2024-03-04T12:20:05.781199+0000","last_unstale":"2024-03-04T13:12:17.519378+0000","last_undegraded":"2024-03-04T13:12:17.519378+0000","last_fullsized":"2024-03-04T13:12:17.519378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"255'204","reported_seq":829,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.122048+0000","last_change":"2024-03-04T12:20:14.821799+0000","last_active":"2024-03-04T13:13:21.122048+0000","last_peered":"2024-03-04T13:13:21.122048+0000","last_clean":"2024-03-04T13:13:21.122048+0000","last_became_active":"2024-03-04T12:20:14.821540+0000","last_became_peered":"2024-03-04T12:20:14.821540+0000","last_unstale":"2024-03-04T13:13:21.122048+0000","last_undegraded":"2024-03-04T13:13:21.122048+0000","last_fullsized":"2024-03-04T13:13:21.122048+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":43110,"num_write":1111,"num_write_kb":41335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":486,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.372791+0000","last_change":"2024-03-04T12:20:18.836025+0000","last_active":"2024-03-04T13:12:22.372791+0000","last_peered":"2024-03-04T13:12:22.372791+0000","last_clean":"2024-03-04T13:12:22.372791+0000","last_became_active":"2024-03-04T12:20:18.835509+0000","last_became_peered":"2024-03-04T12:20:18.835509+0000","last_unstale":"2024-03-04T13:12:22.372791+0000","last_undegraded":"2024-03-04T13:12:22.372791+0000","last_fullsized":"2024-03-04T13:12:22.372791+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"255'707","reported_seq":2182,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.241375+0000","last_change":"2024-03-04T12:20:20.838876+0000","last_active":"2024-03-04T13:13:21.241375+0000","last_peered":"2024-03-04T13:13:21.241375+0000","last_clean":"2024-03-04T13:13:21.241375+0000","last_became_active":"2024-03-04T12:20:20.838633+0000","last_became_peered":"2024-03-04T12:20:20.838633+0000","last_unstale":"2024-03-04T13:13:21.241375+0000","last_undegraded":"2024-03-04T13:13:21.241375+0000","last_fullsized":"2024-03-04T13:13:21.241375+0000","mapping_epoch":26,"log_start":"255'600","ondisk_log_start":"255'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24617,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":974,"num_read_kb":1199,"num_write":350,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":494,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.529369+0000","last_change":"2024-03-04T13:13:44.529392+0000","last_active":"2024-03-04T13:13:44.529369+0000","last_peered":"2024-03-04T13:13:44.529369+0000","last_clean":"2024-03-04T13:13:44.529369+0000","last_became_active":"2024-03-04T12:20:22.848403+0000","last_became_peered":"2024-03-04T12:20:22.848403+0000","last_unstale":"2024-03-04T13:13:44.529369+0000","last_undegraded":"2024-03-04T13:13:44.529369+0000","last_fullsized":"2024-03-04T13:13:44.529369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:44.529234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:44.529234+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.529234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:44.260150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"255'85","reported_seq":581,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.771086+0000","last_change":"2024-03-04T13:13:34.771117+0000","last_active":"2024-03-04T13:13:34.771086+0000","last_peered":"2024-03-04T13:13:34.771086+0000","last_clean":"2024-03-04T13:13:34.771086+0000","last_became_active":"2024-03-04T12:20:24.911303+0000","last_became_peered":"2024-03-04T12:20:24.911303+0000","last_unstale":"2024-03-04T13:13:34.771086+0000","last_undegraded":"2024-03-04T13:13:34.771086+0000","last_fullsized":"2024-03-04T13:13:34.771086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'85","last_scrub_stamp":"2024-03-04T13:13:34.770979+0000","last_deep_scrub":"255'85","last_deep_scrub_stamp":"2024-03-04T13:13:34.770979+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.770979+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:29.877688+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":85,"num_write":192,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"255'417","reported_seq":2051,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.594152+0000","last_change":"2024-03-04T12:20:16.828170+0000","last_active":"2024-03-04T13:12:50.594152+0000","last_peered":"2024-03-04T13:12:50.594152+0000","last_clean":"2024-03-04T13:12:50.594152+0000","last_became_active":"2024-03-04T12:20:16.827513+0000","last_became_peered":"2024-03-04T12:20:16.827513+0000","last_unstale":"2024-03-04T13:12:50.594152+0000","last_undegraded":"2024-03-04T13:12:50.594152+0000","last_fullsized":"2024-03-04T13:12:50.594152+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2343,"num_read_kb":2241,"num_write":475,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":510,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.131693+0000","last_change":"2024-03-04T13:13:45.131715+0000","last_active":"2024-03-04T13:13:45.131693+0000","last_peered":"2024-03-04T13:13:45.131693+0000","last_clean":"2024-03-04T13:13:45.131693+0000","last_became_active":"2024-03-04T12:20:05.863125+0000","last_became_peered":"2024-03-04T12:20:05.863125+0000","last_unstale":"2024-03-04T13:13:45.131693+0000","last_undegraded":"2024-03-04T13:13:45.131693+0000","last_fullsized":"2024-03-04T13:13:45.131693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:45.131601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:45.131601+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.131601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:46.397851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"255'167","reported_seq":749,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.220223+0000","last_change":"2024-03-04T12:20:14.813050+0000","last_active":"2024-03-04T13:13:21.220223+0000","last_peered":"2024-03-04T13:13:21.220223+0000","last_clean":"2024-03-04T13:13:21.220223+0000","last_became_active":"2024-03-04T12:20:14.812722+0000","last_became_peered":"2024-03-04T12:20:14.812722+0000","last_unstale":"2024-03-04T13:13:21.220223+0000","last_undegraded":"2024-03-04T13:13:21.220223+0000","last_fullsized":"2024-03-04T13:13:21.220223+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1982965,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":309,"num_read_kb":18084,"num_write":975,"num_write_kb":46336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"255'2","reported_seq":497,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.077673+0000","last_change":"2024-03-04T13:13:36.077712+0000","last_active":"2024-03-04T13:13:36.077673+0000","last_peered":"2024-03-04T13:13:36.077673+0000","last_clean":"2024-03-04T13:13:36.077673+0000","last_became_active":"2024-03-04T12:20:18.839038+0000","last_became_peered":"2024-03-04T12:20:18.839038+0000","last_unstale":"2024-03-04T13:13:36.077673+0000","last_undegraded":"2024-03-04T13:13:36.077673+0000","last_fullsized":"2024-03-04T13:13:36.077673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:36.077585+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:36.077585+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.077585+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:17:39.483287+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"255'254","reported_seq":1434,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.539031+0000","last_change":"2024-03-04T13:13:46.539075+0000","last_active":"2024-03-04T13:13:46.539031+0000","last_peered":"2024-03-04T13:13:46.539031+0000","last_clean":"2024-03-04T13:13:46.539031+0000","last_became_active":"2024-03-04T12:20:21.643475+0000","last_became_peered":"2024-03-04T12:20:21.643475+0000","last_unstale":"2024-03-04T13:13:46.539031+0000","last_undegraded":"2024-03-04T13:13:46.539031+0000","last_fullsized":"2024-03-04T13:13:46.539031+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'254","last_scrub_stamp":"2024-03-04T13:13:46.538942+0000","last_deep_scrub":"255'254","last_deep_scrub_stamp":"2024-03-04T13:13:46.538942+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.538942+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:43:06.071914+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":203,"num_write":195,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.908956+0000","last_change":"2024-03-04T13:13:44.908979+0000","last_active":"2024-03-04T13:13:44.908956+0000","last_peered":"2024-03-04T13:13:44.908956+0000","last_clean":"2024-03-04T13:13:44.908956+0000","last_became_active":"2024-03-04T12:20:22.854343+0000","last_became_peered":"2024-03-04T12:20:22.854343+0000","last_unstale":"2024-03-04T13:13:44.908956+0000","last_undegraded":"2024-03-04T13:13:44.908956+0000","last_fullsized":"2024-03-04T13:13:44.908956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:44.908863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:44.908863+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.908863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:14.482523+0000","scrub_duration":96,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"255'189","reported_seq":709,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.828291+0000","last_change":"2024-03-04T13:13:38.828319+0000","last_active":"2024-03-04T13:13:38.828291+0000","last_peered":"2024-03-04T13:13:38.828291+0000","last_clean":"2024-03-04T13:13:38.828291+0000","last_became_active":"2024-03-04T12:20:24.871020+0000","last_became_peered":"2024-03-04T12:20:24.871020+0000","last_unstale":"2024-03-04T13:13:38.828291+0000","last_undegraded":"2024-03-04T13:13:38.828291+0000","last_fullsized":"2024-03-04T13:13:38.828291+0000","mapping_epoch":30,"log_start":"250'100","ondisk_log_start":"250'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'189","last_scrub_stamp":"2024-03-04T13:13:38.828189+0000","last_deep_scrub":"255'189","last_deep_scrub_stamp":"2024-03-04T13:13:38.828189+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.828189+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:40:40.968338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":353,"num_read_kb":362,"num_write":419,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"255'387","reported_seq":1853,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.971813+0000","last_change":"2024-03-04T12:20:16.825718+0000","last_active":"2024-03-04T13:12:36.971813+0000","last_peered":"2024-03-04T13:12:36.971813+0000","last_clean":"2024-03-04T13:12:36.971813+0000","last_became_active":"2024-03-04T12:20:16.825006+0000","last_became_peered":"2024-03-04T12:20:16.825006+0000","last_unstale":"2024-03-04T13:12:36.971813+0000","last_undegraded":"2024-03-04T13:12:36.971813+0000","last_fullsized":"2024-03-04T13:12:36.971813+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2027,"num_read_kb":1928,"num_write":438,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":501,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.371150+0000","last_change":"2024-03-04T12:20:05.783217+0000","last_active":"2024-03-04T13:12:12.371150+0000","last_peered":"2024-03-04T13:12:12.371150+0000","last_clean":"2024-03-04T13:12:12.371150+0000","last_became_active":"2024-03-04T12:20:05.782897+0000","last_became_peered":"2024-03-04T12:20:05.782897+0000","last_unstale":"2024-03-04T13:12:12.371150+0000","last_undegraded":"2024-03-04T13:12:12.371150+0000","last_fullsized":"2024-03-04T13:12:12.371150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"255'200","reported_seq":875,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.234821+0000","last_change":"2024-03-04T12:20:14.825079+0000","last_active":"2024-03-04T13:13:21.234821+0000","last_peered":"2024-03-04T13:13:21.234821+0000","last_clean":"2024-03-04T13:13:21.234821+0000","last_became_active":"2024-03-04T12:20:14.824810+0000","last_became_peered":"2024-03-04T12:20:14.824810+0000","last_unstale":"2024-03-04T13:13:21.234821+0000","last_undegraded":"2024-03-04T13:13:21.234821+0000","last_fullsized":"2024-03-04T13:13:21.234821+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3544974,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":19088,"num_write":1144,"num_write_kb":38256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:32.461088+0000","last_change":"2024-03-04T12:20:18.833327+0000","last_active":"2024-03-04T13:12:32.461088+0000","last_peered":"2024-03-04T13:12:32.461088+0000","last_clean":"2024-03-04T13:12:32.461088+0000","last_became_active":"2024-03-04T12:20:18.833051+0000","last_became_peered":"2024-03-04T12:20:18.833051+0000","last_unstale":"2024-03-04T13:12:32.461088+0000","last_undegraded":"2024-03-04T13:12:32.461088+0000","last_fullsized":"2024-03-04T13:12:32.461088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"255'125","reported_seq":655,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.466544+0000","last_change":"2024-03-04T12:20:20.845424+0000","last_active":"2024-03-04T13:12:22.466544+0000","last_peered":"2024-03-04T13:12:22.466544+0000","last_clean":"2024-03-04T13:12:22.466544+0000","last_became_active":"2024-03-04T12:20:20.845192+0000","last_became_peered":"2024-03-04T12:20:20.845192+0000","last_unstale":"2024-03-04T13:12:22.466544+0000","last_undegraded":"2024-03-04T13:12:22.466544+0000","last_fullsized":"2024-03-04T13:12:22.466544+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":155,"num_read_kb":149,"num_write":110,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.749495+0000","last_change":"2024-03-04T13:13:44.749534+0000","last_active":"2024-03-04T13:13:44.749495+0000","last_peered":"2024-03-04T13:13:44.749495+0000","last_clean":"2024-03-04T13:13:44.749495+0000","last_became_active":"2024-03-04T12:20:22.852745+0000","last_became_peered":"2024-03-04T12:20:22.852745+0000","last_unstale":"2024-03-04T13:13:44.749495+0000","last_undegraded":"2024-03-04T13:13:44.749495+0000","last_fullsized":"2024-03-04T13:13:44.749495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:44.749366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:44.749366+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.749366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:03:25.765685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"255'85","reported_seq":588,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.265937+0000","last_change":"2024-03-04T13:13:34.265961+0000","last_active":"2024-03-04T13:13:34.265937+0000","last_peered":"2024-03-04T13:13:34.265937+0000","last_clean":"2024-03-04T13:13:34.265937+0000","last_became_active":"2024-03-04T12:20:24.864783+0000","last_became_peered":"2024-03-04T12:20:24.864783+0000","last_unstale":"2024-03-04T13:13:34.265937+0000","last_undegraded":"2024-03-04T13:13:34.265937+0000","last_fullsized":"2024-03-04T13:13:34.265937+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'85","last_scrub_stamp":"2024-03-04T13:13:34.265840+0000","last_deep_scrub":"255'85","last_deep_scrub_stamp":"2024-03-04T13:13:34.265840+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.265840+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:24:43.687453+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":204,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"255'443","reported_seq":1901,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.326519+0000","last_change":"2024-03-04T12:20:16.827086+0000","last_active":"2024-03-04T13:12:39.326519+0000","last_peered":"2024-03-04T13:12:39.326519+0000","last_clean":"2024-03-04T13:12:39.326519+0000","last_became_active":"2024-03-04T12:20:16.826823+0000","last_became_peered":"2024-03-04T12:20:16.826823+0000","last_unstale":"2024-03-04T13:12:39.326519+0000","last_undegraded":"2024-03-04T13:12:39.326519+0000","last_fullsized":"2024-03-04T13:12:39.326519+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2302,"num_read_kb":2131,"num_write":558,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"255'158","reported_seq":754,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.235080+0000","last_change":"2024-03-04T12:20:14.819761+0000","last_active":"2024-03-04T13:13:21.235080+0000","last_peered":"2024-03-04T13:13:21.235080+0000","last_clean":"2024-03-04T13:13:21.235080+0000","last_became_active":"2024-03-04T12:20:14.819483+0000","last_became_peered":"2024-03-04T12:20:14.819483+0000","last_unstale":"2024-03-04T13:13:21.235080+0000","last_undegraded":"2024-03-04T13:13:21.235080+0000","last_fullsized":"2024-03-04T13:13:21.235080+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553728,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":336,"num_read_kb":12779,"num_write":962,"num_write_kb":35384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":502,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:12.555524+0000","last_change":"2024-03-04T12:20:05.863592+0000","last_active":"2024-03-04T13:12:12.555524+0000","last_peered":"2024-03-04T13:12:12.555524+0000","last_clean":"2024-03-04T13:12:12.555524+0000","last_became_active":"2024-03-04T12:20:05.863311+0000","last_became_peered":"2024-03-04T12:20:05.863311+0000","last_unstale":"2024-03-04T13:12:12.555524+0000","last_undegraded":"2024-03-04T13:12:12.555524+0000","last_fullsized":"2024-03-04T13:12:12.555524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.460519+0000","last_change":"2024-03-04T12:20:18.832677+0000","last_active":"2024-03-04T13:12:27.460519+0000","last_peered":"2024-03-04T13:12:27.460519+0000","last_clean":"2024-03-04T13:12:27.460519+0000","last_became_active":"2024-03-04T12:20:18.832355+0000","last_became_peered":"2024-03-04T12:20:18.832355+0000","last_unstale":"2024-03-04T13:12:27.460519+0000","last_undegraded":"2024-03-04T13:12:27.460519+0000","last_fullsized":"2024-03-04T13:12:27.460519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"255'260","reported_seq":910,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.176638+0000","last_change":"2024-03-04T12:20:20.842632+0000","last_active":"2024-03-04T13:13:21.176638+0000","last_peered":"2024-03-04T13:13:21.176638+0000","last_clean":"2024-03-04T13:13:21.176638+0000","last_became_active":"2024-03-04T12:20:20.842330+0000","last_became_peered":"2024-03-04T12:20:20.842330+0000","last_unstale":"2024-03-04T13:13:21.176638+0000","last_undegraded":"2024-03-04T13:13:21.176638+0000","last_fullsized":"2024-03-04T13:13:21.176638+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11717,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":373,"num_read_kb":489,"num_write":198,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":492,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.176595+0000","last_change":"2024-03-04T13:13:38.176635+0000","last_active":"2024-03-04T13:13:38.176595+0000","last_peered":"2024-03-04T13:13:38.176595+0000","last_clean":"2024-03-04T13:13:38.176595+0000","last_became_active":"2024-03-04T12:20:22.854507+0000","last_became_peered":"2024-03-04T12:20:22.854507+0000","last_unstale":"2024-03-04T13:13:38.176595+0000","last_undegraded":"2024-03-04T13:13:38.176595+0000","last_fullsized":"2024-03-04T13:13:38.176595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:38.176494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:38.176494+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.176494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:11:18.467708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"255'107","reported_seq":601,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.894621+0000","last_change":"2024-03-04T13:13:32.894665+0000","last_active":"2024-03-04T13:13:32.894621+0000","last_peered":"2024-03-04T13:13:32.894621+0000","last_clean":"2024-03-04T13:13:32.894621+0000","last_became_active":"2024-03-04T12:20:24.911970+0000","last_became_peered":"2024-03-04T12:20:24.911970+0000","last_unstale":"2024-03-04T13:13:32.894621+0000","last_undegraded":"2024-03-04T13:13:32.894621+0000","last_fullsized":"2024-03-04T13:13:32.894621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'107","last_scrub_stamp":"2024-03-04T13:13:32.894508+0000","last_deep_scrub":"255'107","last_deep_scrub_stamp":"2024-03-04T13:13:32.894508+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.894508+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:03:06.228753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":120,"num_write":241,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"255'321","reported_seq":1677,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.459921+0000","last_change":"2024-03-04T12:20:16.825499+0000","last_active":"2024-03-04T13:12:22.459921+0000","last_peered":"2024-03-04T13:12:22.459921+0000","last_clean":"2024-03-04T13:12:22.459921+0000","last_became_active":"2024-03-04T12:20:16.825241+0000","last_became_peered":"2024-03-04T12:20:16.825241+0000","last_unstale":"2024-03-04T13:12:22.459921+0000","last_undegraded":"2024-03-04T13:12:22.459921+0000","last_fullsized":"2024-03-04T13:12:22.459921+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1925,"num_read_kb":1835,"num_write":376,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"255'162","reported_seq":754,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.556660+0000","last_change":"2024-03-04T12:20:14.816111+0000","last_active":"2024-03-04T13:12:22.556660+0000","last_peered":"2024-03-04T13:12:22.556660+0000","last_clean":"2024-03-04T13:12:22.556660+0000","last_became_active":"2024-03-04T12:20:14.815589+0000","last_became_peered":"2024-03-04T12:20:14.815589+0000","last_unstale":"2024-03-04T13:12:22.556660+0000","last_undegraded":"2024-03-04T13:12:22.556660+0000","last_fullsized":"2024-03-04T13:12:22.556660+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11384047,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":367,"num_read_kb":3319,"num_write":965,"num_write_kb":11696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":508,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520512+0000","last_change":"2024-03-04T12:20:05.863980+0000","last_active":"2024-03-04T13:12:22.520512+0000","last_peered":"2024-03-04T13:12:22.520512+0000","last_clean":"2024-03-04T13:12:22.520512+0000","last_became_active":"2024-03-04T12:20:05.863682+0000","last_became_peered":"2024-03-04T12:20:05.863682+0000","last_unstale":"2024-03-04T13:12:22.520512+0000","last_undegraded":"2024-03-04T13:12:22.520512+0000","last_fullsized":"2024-03-04T13:12:22.520512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":498,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.747839+0000","last_change":"2024-03-04T13:13:41.747864+0000","last_active":"2024-03-04T13:13:41.747839+0000","last_peered":"2024-03-04T13:13:41.747839+0000","last_clean":"2024-03-04T13:13:41.747839+0000","last_became_active":"2024-03-04T12:20:18.833896+0000","last_became_peered":"2024-03-04T12:20:18.833896+0000","last_unstale":"2024-03-04T13:13:41.747839+0000","last_undegraded":"2024-03-04T13:13:41.747839+0000","last_fullsized":"2024-03-04T13:13:41.747839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:41.747741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:41.747741+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.747741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:00:12.641146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"255'200","reported_seq":756,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:14.351356+0000","last_change":"2024-03-04T12:20:21.642318+0000","last_active":"2024-03-04T13:13:14.351356+0000","last_peered":"2024-03-04T13:13:14.351356+0000","last_clean":"2024-03-04T13:13:14.351356+0000","last_became_active":"2024-03-04T12:20:21.641826+0000","last_became_peered":"2024-03-04T12:20:21.641826+0000","last_unstale":"2024-03-04T13:13:14.351356+0000","last_undegraded":"2024-03-04T13:13:14.351356+0000","last_fullsized":"2024-03-04T13:13:14.351356+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":255,"num_read_kb":248,"num_write":230,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"255'535","reported_seq":4194,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.342302+0000","last_change":"2024-03-04T13:13:41.342328+0000","last_active":"2024-03-04T13:13:41.342302+0000","last_peered":"2024-03-04T13:13:41.342302+0000","last_clean":"2024-03-04T13:13:41.342302+0000","last_became_active":"2024-03-04T12:20:22.853588+0000","last_became_peered":"2024-03-04T12:20:22.853588+0000","last_unstale":"2024-03-04T13:13:41.342302+0000","last_undegraded":"2024-03-04T13:13:41.342302+0000","last_fullsized":"2024-03-04T13:13:41.342302+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'535","last_scrub_stamp":"2024-03-04T13:13:41.342199+0000","last_deep_scrub":"255'535","last_deep_scrub_stamp":"2024-03-04T13:13:41.342199+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.342199+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:40:35.313438+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"255'117","reported_seq":603,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.783291+0000","last_change":"2024-03-04T13:13:37.783322+0000","last_active":"2024-03-04T13:13:37.783291+0000","last_peered":"2024-03-04T13:13:37.783291+0000","last_clean":"2024-03-04T13:13:37.783291+0000","last_became_active":"2024-03-04T12:20:24.911103+0000","last_became_peered":"2024-03-04T12:20:24.911103+0000","last_unstale":"2024-03-04T13:13:37.783291+0000","last_undegraded":"2024-03-04T13:13:37.783291+0000","last_fullsized":"2024-03-04T13:13:37.783291+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'117","last_scrub_stamp":"2024-03-04T13:13:37.783200+0000","last_deep_scrub":"255'117","last_deep_scrub_stamp":"2024-03-04T13:13:37.783200+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.783200+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:07:25.533057+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":105,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"255'1398","reported_seq":3055,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.328474+0000","last_change":"2024-03-04T12:20:16.834067+0000","last_active":"2024-03-04T13:12:39.328474+0000","last_peered":"2024-03-04T13:12:39.328474+0000","last_clean":"2024-03-04T13:12:39.328474+0000","last_became_active":"2024-03-04T12:20:16.833689+0000","last_became_peered":"2024-03-04T12:20:16.833689+0000","last_unstale":"2024-03-04T13:12:39.328474+0000","last_undegraded":"2024-03-04T13:12:39.328474+0000","last_fullsized":"2024-03-04T13:12:39.328474+0000","mapping_epoch":22,"log_start":"255'1300","ondisk_log_start":"255'1300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":1300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5949,"num_read_kb":5124,"num_write":2086,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"255'143","reported_seq":824,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.162370+0000","last_change":"2024-03-04T12:20:14.814534+0000","last_active":"2024-03-04T13:13:21.162370+0000","last_peered":"2024-03-04T13:13:21.162370+0000","last_clean":"2024-03-04T13:13:21.162370+0000","last_became_active":"2024-03-04T12:20:14.814220+0000","last_became_peered":"2024-03-04T12:20:14.814220+0000","last_unstale":"2024-03-04T13:13:21.162370+0000","last_undegraded":"2024-03-04T13:13:21.162370+0000","last_fullsized":"2024-03-04T13:13:21.162370+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262328,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":11189,"num_write":841,"num_write_kb":14687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":501,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.555046+0000","last_change":"2024-03-04T12:20:05.784418+0000","last_active":"2024-03-04T13:12:07.555046+0000","last_peered":"2024-03-04T13:12:07.555046+0000","last_clean":"2024-03-04T13:12:07.555046+0000","last_became_active":"2024-03-04T12:20:05.784145+0000","last_became_peered":"2024-03-04T12:20:05.784145+0000","last_unstale":"2024-03-04T13:12:07.555046+0000","last_undegraded":"2024-03-04T13:12:07.555046+0000","last_fullsized":"2024-03-04T13:12:07.555046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":492,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.521384+0000","last_change":"2024-03-04T12:20:18.833379+0000","last_active":"2024-03-04T13:12:27.521384+0000","last_peered":"2024-03-04T13:12:27.521384+0000","last_clean":"2024-03-04T13:12:27.521384+0000","last_became_active":"2024-03-04T12:20:18.832932+0000","last_became_peered":"2024-03-04T12:20:18.832932+0000","last_unstale":"2024-03-04T13:12:27.521384+0000","last_undegraded":"2024-03-04T13:12:27.521384+0000","last_fullsized":"2024-03-04T13:12:27.521384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"255'114","reported_seq":655,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.300972+0000","last_change":"2024-03-04T13:13:44.301018+0000","last_active":"2024-03-04T13:13:44.300972+0000","last_peered":"2024-03-04T13:13:44.300972+0000","last_clean":"2024-03-04T13:13:44.300972+0000","last_became_active":"2024-03-04T12:20:20.841108+0000","last_became_peered":"2024-03-04T12:20:20.841108+0000","last_unstale":"2024-03-04T13:13:44.300972+0000","last_undegraded":"2024-03-04T13:13:44.300972+0000","last_fullsized":"2024-03-04T13:13:44.300972+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'114","last_scrub_stamp":"2024-03-04T13:13:44.300884+0000","last_deep_scrub":"255'114","last_deep_scrub_stamp":"2024-03-04T13:13:44.300884+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.300884+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:55.572601+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":86,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"255'530","reported_seq":2292,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.796423+0000","last_change":"2024-03-04T13:13:42.796467+0000","last_active":"2024-03-04T13:13:42.796423+0000","last_peered":"2024-03-04T13:13:42.796423+0000","last_clean":"2024-03-04T13:13:42.796423+0000","last_became_active":"2024-03-04T12:20:22.859306+0000","last_became_peered":"2024-03-04T12:20:22.859306+0000","last_unstale":"2024-03-04T13:13:42.796423+0000","last_undegraded":"2024-03-04T13:13:42.796423+0000","last_fullsized":"2024-03-04T13:13:42.796423+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'530","last_scrub_stamp":"2024-03-04T13:13:42.796336+0000","last_deep_scrub":"255'530","last_deep_scrub_stamp":"2024-03-04T13:13:42.796336+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.796336+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:53:21.504586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"255'154","reported_seq":644,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.800402+0000","last_change":"2024-03-04T13:13:37.800432+0000","last_active":"2024-03-04T13:13:37.800402+0000","last_peered":"2024-03-04T13:13:37.800402+0000","last_clean":"2024-03-04T13:13:37.800402+0000","last_became_active":"2024-03-04T12:20:24.865816+0000","last_became_peered":"2024-03-04T12:20:24.865816+0000","last_unstale":"2024-03-04T13:13:37.800402+0000","last_undegraded":"2024-03-04T13:13:37.800402+0000","last_fullsized":"2024-03-04T13:13:37.800402+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'154","last_scrub_stamp":"2024-03-04T13:13:37.800314+0000","last_deep_scrub":"255'154","last_deep_scrub_stamp":"2024-03-04T13:13:37.800314+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.800314+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:48:58.994923+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":201,"num_read_kb":201,"num_write":359,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"255'653","reported_seq":2056,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.577516+0000","last_change":"2024-03-04T12:20:16.825715+0000","last_active":"2024-03-04T13:12:22.577516+0000","last_peered":"2024-03-04T13:12:22.577516+0000","last_clean":"2024-03-04T13:12:22.577516+0000","last_became_active":"2024-03-04T12:20:16.825377+0000","last_became_peered":"2024-03-04T12:20:16.825377+0000","last_unstale":"2024-03-04T13:12:22.577516+0000","last_undegraded":"2024-03-04T13:12:22.577516+0000","last_fullsized":"2024-03-04T13:12:22.577516+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2990,"num_read_kb":2698,"num_write":869,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"255'180","reported_seq":873,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.022128+0000","last_change":"2024-03-04T12:20:14.812062+0000","last_active":"2024-03-04T13:13:21.022128+0000","last_peered":"2024-03-04T13:13:21.022128+0000","last_clean":"2024-03-04T13:13:21.022128+0000","last_became_active":"2024-03-04T12:20:14.811756+0000","last_became_peered":"2024-03-04T12:20:14.811756+0000","last_unstale":"2024-03-04T13:13:21.022128+0000","last_undegraded":"2024-03-04T13:13:21.022128+0000","last_fullsized":"2024-03-04T13:13:21.022128+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104383,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":578,"num_read_kb":172500,"num_write":1029,"num_write_kb":54165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":503,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.494868+0000","last_change":"2024-03-04T12:20:05.779688+0000","last_active":"2024-03-04T13:12:07.494868+0000","last_peered":"2024-03-04T13:12:07.494868+0000","last_clean":"2024-03-04T13:12:07.494868+0000","last_became_active":"2024-03-04T12:20:05.779370+0000","last_became_peered":"2024-03-04T12:20:05.779370+0000","last_unstale":"2024-03-04T13:12:07.494868+0000","last_undegraded":"2024-03-04T13:12:07.494868+0000","last_fullsized":"2024-03-04T13:12:07.494868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"32'3","reported_seq":796,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.928915+0000","last_change":"2024-03-04T12:20:18.833572+0000","last_active":"2024-03-04T13:13:20.928915+0000","last_peered":"2024-03-04T13:13:20.928915+0000","last_clean":"2024-03-04T13:13:20.928915+0000","last_became_active":"2024-03-04T12:20:18.833273+0000","last_became_peered":"2024-03-04T12:20:18.833273+0000","last_unstale":"2024-03-04T13:13:20.928915+0000","last_undegraded":"2024-03-04T13:13:20.928915+0000","last_fullsized":"2024-03-04T13:13:20.928915+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":470,"num_read_kb":468,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"255'322","reported_seq":1038,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.214207+0000","last_change":"2024-03-04T12:20:21.643470+0000","last_active":"2024-03-04T13:13:21.214207+0000","last_peered":"2024-03-04T13:13:21.214207+0000","last_clean":"2024-03-04T13:13:21.214207+0000","last_became_active":"2024-03-04T12:20:21.642696+0000","last_became_peered":"2024-03-04T12:20:21.642696+0000","last_unstale":"2024-03-04T13:13:21.214207+0000","last_undegraded":"2024-03-04T13:13:21.214207+0000","last_fullsized":"2024-03-04T13:13:21.214207+0000","mapping_epoch":26,"log_start":"255'300","ondisk_log_start":"255'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17780,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":637,"num_write":242,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":476,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.467085+0000","last_change":"2024-03-04T12:20:22.853586+0000","last_active":"2024-03-04T13:12:27.467085+0000","last_peered":"2024-03-04T13:12:27.467085+0000","last_clean":"2024-03-04T13:12:27.467085+0000","last_became_active":"2024-03-04T12:20:22.853272+0000","last_became_peered":"2024-03-04T12:20:22.853272+0000","last_unstale":"2024-03-04T13:12:27.467085+0000","last_undegraded":"2024-03-04T13:12:27.467085+0000","last_fullsized":"2024-03-04T13:12:27.467085+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"255'111","reported_seq":594,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.276595+0000","last_change":"2024-03-04T13:13:36.276657+0000","last_active":"2024-03-04T13:13:36.276595+0000","last_peered":"2024-03-04T13:13:36.276595+0000","last_clean":"2024-03-04T13:13:36.276595+0000","last_became_active":"2024-03-04T12:20:24.863996+0000","last_became_peered":"2024-03-04T12:20:24.863996+0000","last_unstale":"2024-03-04T13:13:36.276595+0000","last_undegraded":"2024-03-04T13:13:36.276595+0000","last_fullsized":"2024-03-04T13:13:36.276595+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'111","last_scrub_stamp":"2024-03-04T13:13:36.276495+0000","last_deep_scrub":"255'111","last_deep_scrub_stamp":"2024-03-04T13:13:36.276495+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.276495+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:28.929795+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":275,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"255'116","reported_seq":613,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.850786+0000","last_change":"2024-03-04T13:13:35.850828+0000","last_active":"2024-03-04T13:13:35.850786+0000","last_peered":"2024-03-04T13:13:35.850786+0000","last_clean":"2024-03-04T13:13:35.850786+0000","last_became_active":"2024-03-04T12:20:24.868636+0000","last_became_peered":"2024-03-04T12:20:24.868636+0000","last_unstale":"2024-03-04T13:13:35.850786+0000","last_undegraded":"2024-03-04T13:13:35.850786+0000","last_fullsized":"2024-03-04T13:13:35.850786+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'116","last_scrub_stamp":"2024-03-04T13:13:35.850689+0000","last_deep_scrub":"255'116","last_deep_scrub_stamp":"2024-03-04T13:13:35.850689+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.850689+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:58.042029+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":141,"num_write":275,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"255'387","reported_seq":1863,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.591327+0000","last_change":"2024-03-04T12:20:16.823240+0000","last_active":"2024-03-04T13:12:50.591327+0000","last_peered":"2024-03-04T13:12:50.591327+0000","last_clean":"2024-03-04T13:12:50.591327+0000","last_became_active":"2024-03-04T12:20:16.822887+0000","last_became_peered":"2024-03-04T12:20:16.822887+0000","last_unstale":"2024-03-04T13:12:50.591327+0000","last_undegraded":"2024-03-04T13:12:50.591327+0000","last_fullsized":"2024-03-04T13:12:50.591327+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2100,"num_read_kb":1986,"num_write":448,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"255'173","reported_seq":778,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.137695+0000","last_change":"2024-03-04T12:20:14.824134+0000","last_active":"2024-03-04T13:13:21.137695+0000","last_peered":"2024-03-04T13:13:21.137695+0000","last_clean":"2024-03-04T13:13:21.137695+0000","last_became_active":"2024-03-04T12:20:14.823661+0000","last_became_peered":"2024-03-04T12:20:14.823661+0000","last_unstale":"2024-03-04T13:13:21.137695+0000","last_undegraded":"2024-03-04T13:13:21.137695+0000","last_fullsized":"2024-03-04T13:13:21.137695+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":384,"num_read_kb":10388,"num_write":1049,"num_write_kb":6576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":493,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.766432+0000","last_change":"2024-03-04T13:13:43.766456+0000","last_active":"2024-03-04T13:13:43.766432+0000","last_peered":"2024-03-04T13:13:43.766432+0000","last_clean":"2024-03-04T13:13:43.766432+0000","last_became_active":"2024-03-04T12:20:18.836487+0000","last_became_peered":"2024-03-04T12:20:18.836487+0000","last_unstale":"2024-03-04T13:13:43.766432+0000","last_undegraded":"2024-03-04T13:13:43.766432+0000","last_fullsized":"2024-03-04T13:13:43.766432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:43.766306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:43.766306+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.766306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:01:10.055070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"255'141","reported_seq":702,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.111473+0000","last_change":"2024-03-04T12:20:20.841992+0000","last_active":"2024-03-04T13:13:21.111473+0000","last_peered":"2024-03-04T13:13:21.111473+0000","last_clean":"2024-03-04T13:13:21.111473+0000","last_became_active":"2024-03-04T12:20:20.841696+0000","last_became_peered":"2024-03-04T12:20:20.841696+0000","last_unstale":"2024-03-04T13:13:21.111473+0000","last_undegraded":"2024-03-04T13:13:21.111473+0000","last_fullsized":"2024-03-04T13:13:21.111473+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11864,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":271,"num_write":104,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.892167+0000","last_change":"2024-03-04T13:13:46.892194+0000","last_active":"2024-03-04T13:13:46.892167+0000","last_peered":"2024-03-04T13:13:46.892167+0000","last_clean":"2024-03-04T13:13:46.892167+0000","last_became_active":"2024-03-04T12:20:22.857513+0000","last_became_peered":"2024-03-04T12:20:22.857513+0000","last_unstale":"2024-03-04T13:13:46.892167+0000","last_undegraded":"2024-03-04T13:13:46.892167+0000","last_fullsized":"2024-03-04T13:13:46.892167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:46.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:46.892081+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:51.247568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"255'97","reported_seq":587,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.822659+0000","last_change":"2024-03-04T13:13:41.822685+0000","last_active":"2024-03-04T13:13:41.822659+0000","last_peered":"2024-03-04T13:13:41.822659+0000","last_clean":"2024-03-04T13:13:41.822659+0000","last_became_active":"2024-03-04T12:20:24.863346+0000","last_became_peered":"2024-03-04T12:20:24.863346+0000","last_unstale":"2024-03-04T13:13:41.822659+0000","last_undegraded":"2024-03-04T13:13:41.822659+0000","last_fullsized":"2024-03-04T13:13:41.822659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'97","last_scrub_stamp":"2024-03-04T13:13:41.822571+0000","last_deep_scrub":"255'97","last_deep_scrub_stamp":"2024-03-04T13:13:41.822571+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.822571+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:44:53.384390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":222,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"255'707","reported_seq":2072,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.752417+0000","last_change":"2024-03-04T13:13:44.752448+0000","last_active":"2024-03-04T13:13:44.752417+0000","last_peered":"2024-03-04T13:13:44.752417+0000","last_clean":"2024-03-04T13:13:44.752417+0000","last_became_active":"2024-03-04T12:20:16.834080+0000","last_became_peered":"2024-03-04T12:20:16.834080+0000","last_unstale":"2024-03-04T13:13:44.752417+0000","last_undegraded":"2024-03-04T13:13:44.752417+0000","last_fullsized":"2024-03-04T13:13:44.752417+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'707","last_scrub_stamp":"2024-03-04T13:13:44.752324+0000","last_deep_scrub":"255'707","last_deep_scrub_stamp":"2024-03-04T13:13:44.752324+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.752324+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:08:30.399805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3097,"num_read_kb":2763,"num_write":935,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"255'233","reported_seq":910,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.532406+0000","last_change":"2024-03-04T12:20:14.816239+0000","last_active":"2024-03-04T13:13:27.532406+0000","last_peered":"2024-03-04T13:13:27.532406+0000","last_clean":"2024-03-04T13:13:27.532406+0000","last_became_active":"2024-03-04T12:20:14.814738+0000","last_became_peered":"2024-03-04T12:20:14.814738+0000","last_unstale":"2024-03-04T13:13:27.532406+0000","last_undegraded":"2024-03-04T13:13:27.532406+0000","last_fullsized":"2024-03-04T13:13:27.532406+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5787887,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":617,"num_read_kb":16203,"num_write":1488,"num_write_kb":37968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:42.462128+0000","last_change":"2024-03-04T12:20:18.835129+0000","last_active":"2024-03-04T13:11:42.462128+0000","last_peered":"2024-03-04T13:11:42.462128+0000","last_clean":"2024-03-04T13:11:42.462128+0000","last_became_active":"2024-03-04T12:20:18.834793+0000","last_became_peered":"2024-03-04T12:20:18.834793+0000","last_unstale":"2024-03-04T13:11:42.462128+0000","last_undegraded":"2024-03-04T13:11:42.462128+0000","last_fullsized":"2024-03-04T13:11:42.462128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"255'57","reported_seq":544,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:42.455226+0000","last_change":"2024-03-04T12:20:20.832322+0000","last_active":"2024-03-04T13:11:42.455226+0000","last_peered":"2024-03-04T13:11:42.455226+0000","last_clean":"2024-03-04T13:11:42.455226+0000","last_became_active":"2024-03-04T12:20:20.832034+0000","last_became_peered":"2024-03-04T12:20:20.832034+0000","last_unstale":"2024-03-04T13:11:42.455226+0000","last_undegraded":"2024-03-04T13:11:42.455226+0000","last_fullsized":"2024-03-04T13:11:42.455226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":40,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":491,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.472957+0000","last_change":"2024-03-04T13:13:40.472980+0000","last_active":"2024-03-04T13:13:40.472957+0000","last_peered":"2024-03-04T13:13:40.472957+0000","last_clean":"2024-03-04T13:13:40.472957+0000","last_became_active":"2024-03-04T12:20:22.855477+0000","last_became_peered":"2024-03-04T12:20:22.855477+0000","last_unstale":"2024-03-04T13:13:40.472957+0000","last_undegraded":"2024-03-04T13:13:40.472957+0000","last_fullsized":"2024-03-04T13:13:40.472957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.472867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.472867+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.472867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:58:06.611427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"255'85","reported_seq":568,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.856034+0000","last_change":"2024-03-04T13:13:39.856065+0000","last_active":"2024-03-04T13:13:39.856034+0000","last_peered":"2024-03-04T13:13:39.856034+0000","last_clean":"2024-03-04T13:13:39.856034+0000","last_became_active":"2024-03-04T12:20:24.865534+0000","last_became_peered":"2024-03-04T12:20:24.865534+0000","last_unstale":"2024-03-04T13:13:39.856034+0000","last_undegraded":"2024-03-04T13:13:39.856034+0000","last_fullsized":"2024-03-04T13:13:39.856034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'85","last_scrub_stamp":"2024-03-04T13:13:39.855947+0000","last_deep_scrub":"255'85","last_deep_scrub_stamp":"2024-03-04T13:13:39.855947+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.855947+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:38.837480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":78,"num_write":202,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"255'718","reported_seq":2254,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:04.176339+0000","last_change":"2024-03-04T12:20:16.830393+0000","last_active":"2024-03-04T13:12:04.176339+0000","last_peered":"2024-03-04T13:12:04.176339+0000","last_clean":"2024-03-04T13:12:04.176339+0000","last_became_active":"2024-03-04T12:20:16.829012+0000","last_became_peered":"2024-03-04T12:20:16.829012+0000","last_unstale":"2024-03-04T13:12:04.176339+0000","last_undegraded":"2024-03-04T13:12:04.176339+0000","last_fullsized":"2024-03-04T13:12:04.176339+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3304,"num_read_kb":2912,"num_write":1016,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"255'175","reported_seq":861,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.382231+0000","last_change":"2024-03-04T12:20:14.822487+0000","last_active":"2024-03-04T13:13:27.382231+0000","last_peered":"2024-03-04T13:13:27.382231+0000","last_clean":"2024-03-04T13:13:27.382231+0000","last_became_active":"2024-03-04T12:20:14.822127+0000","last_became_peered":"2024-03-04T12:20:14.822127+0000","last_unstale":"2024-03-04T13:13:27.382231+0000","last_undegraded":"2024-03-04T13:13:27.382231+0000","last_fullsized":"2024-03-04T13:13:27.382231+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947361,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":518,"num_read_kb":182821,"num_write":997,"num_write_kb":40014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":491,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:42.513426+0000","last_change":"2024-03-04T12:20:18.831317+0000","last_active":"2024-03-04T13:11:42.513426+0000","last_peered":"2024-03-04T13:11:42.513426+0000","last_clean":"2024-03-04T13:11:42.513426+0000","last_became_active":"2024-03-04T12:20:18.830818+0000","last_became_peered":"2024-03-04T12:20:18.830818+0000","last_unstale":"2024-03-04T13:11:42.513426+0000","last_undegraded":"2024-03-04T13:11:42.513426+0000","last_fullsized":"2024-03-04T13:11:42.513426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"255'164","reported_seq":740,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.015082+0000","last_change":"2024-03-04T12:20:20.841367+0000","last_active":"2024-03-04T13:13:21.015082+0000","last_peered":"2024-03-04T13:13:21.015082+0000","last_clean":"2024-03-04T13:13:21.015082+0000","last_became_active":"2024-03-04T12:20:20.840999+0000","last_became_peered":"2024-03-04T12:20:20.840999+0000","last_unstale":"2024-03-04T13:13:21.015082+0000","last_undegraded":"2024-03-04T13:13:21.015082+0000","last_fullsized":"2024-03-04T13:13:21.015082+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8097,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":284,"num_write":124,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.788144+0000","last_change":"2024-03-04T13:13:36.788169+0000","last_active":"2024-03-04T13:13:36.788144+0000","last_peered":"2024-03-04T13:13:36.788144+0000","last_clean":"2024-03-04T13:13:36.788144+0000","last_became_active":"2024-03-04T12:20:22.848877+0000","last_became_peered":"2024-03-04T12:20:22.848877+0000","last_unstale":"2024-03-04T13:13:36.788144+0000","last_undegraded":"2024-03-04T13:13:36.788144+0000","last_fullsized":"2024-03-04T13:13:36.788144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:36.788037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:36.788037+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.788037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:56:09.294578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"255'100","reported_seq":580,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.290495+0000","last_change":"2024-03-04T13:13:37.290529+0000","last_active":"2024-03-04T13:13:37.290495+0000","last_peered":"2024-03-04T13:13:37.290495+0000","last_clean":"2024-03-04T13:13:37.290495+0000","last_became_active":"2024-03-04T12:20:24.863810+0000","last_became_peered":"2024-03-04T12:20:24.863810+0000","last_unstale":"2024-03-04T13:13:37.290495+0000","last_undegraded":"2024-03-04T13:13:37.290495+0000","last_fullsized":"2024-03-04T13:13:37.290495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'100","last_scrub_stamp":"2024-03-04T13:13:37.290398+0000","last_deep_scrub":"255'100","last_deep_scrub_stamp":"2024-03-04T13:13:37.290398+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.290398+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:39.481362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":234,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"255'783","reported_seq":2323,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.757503+0000","last_change":"2024-03-04T13:13:33.757528+0000","last_active":"2024-03-04T13:13:33.757503+0000","last_peered":"2024-03-04T13:13:33.757503+0000","last_clean":"2024-03-04T13:13:33.757503+0000","last_became_active":"2024-03-04T12:20:51.031448+0000","last_became_peered":"2024-03-04T12:20:51.031448+0000","last_unstale":"2024-03-04T13:13:33.757503+0000","last_undegraded":"2024-03-04T13:13:33.757503+0000","last_fullsized":"2024-03-04T13:13:33.757503+0000","mapping_epoch":33,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'783","last_scrub_stamp":"2024-03-04T13:13:33.757424+0000","last_deep_scrub":"255'783","last_deep_scrub_stamp":"2024-03-04T13:13:33.757424+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.757424+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:34:41.258521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3519,"num_read_kb":3144,"num_write":1038,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":951,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"255'186","reported_seq":817,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260148+0000","last_change":"2024-03-04T12:20:14.824465+0000","last_active":"2024-03-04T13:13:25.260148+0000","last_peered":"2024-03-04T13:13:25.260148+0000","last_clean":"2024-03-04T13:13:25.260148+0000","last_became_active":"2024-03-04T12:20:14.824152+0000","last_became_peered":"2024-03-04T12:20:14.824152+0000","last_unstale":"2024-03-04T13:13:25.260148+0000","last_undegraded":"2024-03-04T13:13:25.260148+0000","last_fullsized":"2024-03-04T13:13:25.260148+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259657,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":396,"num_read_kb":84164,"num_write":1039,"num_write_kb":34071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":495,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.767244+0000","last_change":"2024-03-04T13:13:37.767269+0000","last_active":"2024-03-04T13:13:37.767244+0000","last_peered":"2024-03-04T13:13:37.767244+0000","last_clean":"2024-03-04T13:13:37.767244+0000","last_became_active":"2024-03-04T12:20:18.838749+0000","last_became_peered":"2024-03-04T12:20:18.838749+0000","last_unstale":"2024-03-04T13:13:37.767244+0000","last_undegraded":"2024-03-04T13:13:37.767244+0000","last_fullsized":"2024-03-04T13:13:37.767244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:37.767153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:37.767153+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.767153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:00:15.356508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"255'125","reported_seq":690,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.990926+0000","last_change":"2024-03-04T12:20:20.839637+0000","last_active":"2024-03-04T13:13:20.990926+0000","last_peered":"2024-03-04T13:13:20.990926+0000","last_clean":"2024-03-04T13:13:20.990926+0000","last_became_active":"2024-03-04T12:20:20.839286+0000","last_became_peered":"2024-03-04T12:20:20.839286+0000","last_unstale":"2024-03-04T13:13:20.990926+0000","last_undegraded":"2024-03-04T13:13:20.990926+0000","last_fullsized":"2024-03-04T13:13:20.990926+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":210,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":471,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:11:42.455287+0000","last_change":"2024-03-04T12:20:22.849602+0000","last_active":"2024-03-04T13:11:42.455287+0000","last_peered":"2024-03-04T13:11:42.455287+0000","last_clean":"2024-03-04T13:11:42.455287+0000","last_became_active":"2024-03-04T12:20:22.849340+0000","last_became_peered":"2024-03-04T12:20:22.849340+0000","last_unstale":"2024-03-04T13:11:42.455287+0000","last_undegraded":"2024-03-04T13:11:42.455287+0000","last_fullsized":"2024-03-04T13:11:42.455287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"255'412","reported_seq":1875,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.800857+0000","last_change":"2024-03-04T12:20:16.821743+0000","last_active":"2024-03-04T13:12:34.800857+0000","last_peered":"2024-03-04T13:12:34.800857+0000","last_clean":"2024-03-04T13:12:34.800857+0000","last_became_active":"2024-03-04T12:20:16.821451+0000","last_became_peered":"2024-03-04T12:20:16.821451+0000","last_unstale":"2024-03-04T13:12:34.800857+0000","last_undegraded":"2024-03-04T13:12:34.800857+0000","last_fullsized":"2024-03-04T13:12:34.800857+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2212,"num_read_kb":2069,"num_write":499,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"255'211","reported_seq":803,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.642236+0000","last_change":"2024-03-04T12:20:14.810574+0000","last_active":"2024-03-04T13:13:26.642236+0000","last_peered":"2024-03-04T13:13:26.642236+0000","last_clean":"2024-03-04T13:13:26.642236+0000","last_became_active":"2024-03-04T12:20:14.810309+0000","last_became_peered":"2024-03-04T12:20:14.810309+0000","last_unstale":"2024-03-04T13:13:26.642236+0000","last_undegraded":"2024-03-04T13:13:26.642236+0000","last_fullsized":"2024-03-04T13:13:26.642236+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195451,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":442,"num_read_kb":8634,"num_write":1082,"num_write_kb":36368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":483,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.460560+0000","last_change":"2024-03-04T12:20:18.833581+0000","last_active":"2024-03-04T13:12:27.460560+0000","last_peered":"2024-03-04T13:12:27.460560+0000","last_clean":"2024-03-04T13:12:27.460560+0000","last_became_active":"2024-03-04T12:20:18.833300+0000","last_became_peered":"2024-03-04T12:20:18.833300+0000","last_unstale":"2024-03-04T13:12:27.460560+0000","last_undegraded":"2024-03-04T13:12:27.460560+0000","last_fullsized":"2024-03-04T13:12:27.460560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"255'201","reported_seq":818,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.239551+0000","last_change":"2024-03-04T12:20:20.838878+0000","last_active":"2024-03-04T13:13:21.239551+0000","last_peered":"2024-03-04T13:13:21.239551+0000","last_clean":"2024-03-04T13:13:21.239551+0000","last_became_active":"2024-03-04T12:20:20.838600+0000","last_became_peered":"2024-03-04T12:20:20.838600+0000","last_unstale":"2024-03-04T13:13:21.239551+0000","last_undegraded":"2024-03-04T13:13:21.239551+0000","last_fullsized":"2024-03-04T13:13:21.239551+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17172,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":287,"num_read_kb":431,"num_write":142,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":483,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.332740+0000","last_change":"2024-03-04T13:13:40.332764+0000","last_active":"2024-03-04T13:13:40.332740+0000","last_peered":"2024-03-04T13:13:40.332740+0000","last_clean":"2024-03-04T13:13:40.332740+0000","last_became_active":"2024-03-04T12:20:22.855464+0000","last_became_peered":"2024-03-04T12:20:22.855464+0000","last_unstale":"2024-03-04T13:13:40.332740+0000","last_undegraded":"2024-03-04T13:13:40.332740+0000","last_fullsized":"2024-03-04T13:13:40.332740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.332646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.332646+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.332646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:40:16.755252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"255'173","reported_seq":675,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.819981+0000","last_change":"2024-03-04T13:13:35.820025+0000","last_active":"2024-03-04T13:13:35.819981+0000","last_peered":"2024-03-04T13:13:35.819981+0000","last_clean":"2024-03-04T13:13:35.819981+0000","last_became_active":"2024-03-04T12:20:24.912118+0000","last_became_peered":"2024-03-04T12:20:24.912118+0000","last_unstale":"2024-03-04T13:13:35.819981+0000","last_undegraded":"2024-03-04T13:13:35.819981+0000","last_fullsized":"2024-03-04T13:13:35.819981+0000","mapping_epoch":30,"log_start":"250'100","ondisk_log_start":"250'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'173","last_scrub_stamp":"2024-03-04T13:13:35.819894+0000","last_deep_scrub":"255'173","last_deep_scrub_stamp":"2024-03-04T13:13:35.819894+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.819894+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:25:38.687294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":221,"num_read_kb":223,"num_write":386,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"255'445","reported_seq":1785,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.575394+0000","last_change":"2024-03-04T12:20:16.828841+0000","last_active":"2024-03-04T13:12:22.575394+0000","last_peered":"2024-03-04T13:12:22.575394+0000","last_clean":"2024-03-04T13:12:22.575394+0000","last_became_active":"2024-03-04T12:20:16.828550+0000","last_became_peered":"2024-03-04T12:20:16.828550+0000","last_unstale":"2024-03-04T13:12:22.575394+0000","last_undegraded":"2024-03-04T13:12:22.575394+0000","last_fullsized":"2024-03-04T13:12:22.575394+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2172,"num_read_kb":1979,"num_write":576,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"255'152","reported_seq":725,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.719400+0000","last_change":"2024-03-04T12:20:14.811751+0000","last_active":"2024-03-04T13:13:25.719400+0000","last_peered":"2024-03-04T13:13:25.719400+0000","last_clean":"2024-03-04T13:13:25.719400+0000","last_became_active":"2024-03-04T12:20:14.811474+0000","last_became_peered":"2024-03-04T12:20:14.811474+0000","last_unstale":"2024-03-04T13:13:25.719400+0000","last_undegraded":"2024-03-04T13:13:25.719400+0000","last_fullsized":"2024-03-04T13:13:25.719400+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1943261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":293,"num_read_kb":3660,"num_write":933,"num_write_kb":16669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":498,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.756142+0000","last_change":"2024-03-04T13:13:39.756173+0000","last_active":"2024-03-04T13:13:39.756142+0000","last_peered":"2024-03-04T13:13:39.756142+0000","last_clean":"2024-03-04T13:13:39.756142+0000","last_became_active":"2024-03-04T12:20:18.836021+0000","last_became_peered":"2024-03-04T12:20:18.836021+0000","last_unstale":"2024-03-04T13:13:39.756142+0000","last_undegraded":"2024-03-04T13:13:39.756142+0000","last_fullsized":"2024-03-04T13:13:39.756142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:39.756043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:39.756043+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.756043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:04.157021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"255'166","reported_seq":748,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:20.999590+0000","last_change":"2024-03-04T12:20:20.838524+0000","last_active":"2024-03-04T13:13:20.999590+0000","last_peered":"2024-03-04T13:13:20.999590+0000","last_clean":"2024-03-04T13:13:20.999590+0000","last_became_active":"2024-03-04T12:20:20.838216+0000","last_became_peered":"2024-03-04T12:20:20.838216+0000","last_unstale":"2024-03-04T13:13:20.999590+0000","last_undegraded":"2024-03-04T13:13:20.999590+0000","last_fullsized":"2024-03-04T13:13:20.999590+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12653,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":241,"num_read_kb":319,"num_write":160,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":484,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.818606+0000","last_change":"2024-03-04T13:13:40.818631+0000","last_active":"2024-03-04T13:13:40.818606+0000","last_peered":"2024-03-04T13:13:40.818606+0000","last_clean":"2024-03-04T13:13:40.818606+0000","last_became_active":"2024-03-04T12:20:22.856471+0000","last_became_peered":"2024-03-04T12:20:22.856471+0000","last_unstale":"2024-03-04T13:13:40.818606+0000","last_undegraded":"2024-03-04T13:13:40.818606+0000","last_fullsized":"2024-03-04T13:13:40.818606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.818507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.818507+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.818507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:44.522601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"255'161","reported_seq":1005,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:13.014192+0000","last_change":"2024-03-04T12:20:24.863580+0000","last_active":"2024-03-04T13:13:13.014192+0000","last_peered":"2024-03-04T13:13:13.014192+0000","last_clean":"2024-03-04T13:13:13.014192+0000","last_became_active":"2024-03-04T12:20:24.863291+0000","last_became_peered":"2024-03-04T12:20:24.863291+0000","last_unstale":"2024-03-04T13:13:13.014192+0000","last_undegraded":"2024-03-04T13:13:13.014192+0000","last_fullsized":"2024-03-04T13:13:13.014192+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:23.847019+0000","last_clean_scrub_stamp":"2024-03-04T12:20:23.847019+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1530,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":567,"num_read_kb":564,"num_write":466,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"255'447","reported_seq":1860,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.048758+0000","last_change":"2024-03-04T13:13:33.048795+0000","last_active":"2024-03-04T13:13:33.048758+0000","last_peered":"2024-03-04T13:13:33.048758+0000","last_clean":"2024-03-04T13:13:33.048758+0000","last_became_active":"2024-03-04T12:20:50.905894+0000","last_became_peered":"2024-03-04T12:20:50.905894+0000","last_unstale":"2024-03-04T13:13:33.048758+0000","last_undegraded":"2024-03-04T13:13:33.048758+0000","last_fullsized":"2024-03-04T13:13:33.048758+0000","mapping_epoch":33,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'447","last_scrub_stamp":"2024-03-04T13:13:33.048662+0000","last_deep_scrub":"255'447","last_deep_scrub_stamp":"2024-03-04T13:13:33.048662+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.048662+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:48.190455+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2307,"num_read_kb":2145,"num_write":589,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"255'290","reported_seq":1045,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.237194+0000","last_change":"2024-03-04T12:20:14.816872+0000","last_active":"2024-03-04T13:13:21.237194+0000","last_peered":"2024-03-04T13:13:21.237194+0000","last_clean":"2024-03-04T13:13:21.237194+0000","last_became_active":"2024-03-04T12:20:14.816522+0000","last_became_peered":"2024-03-04T12:20:14.816522+0000","last_unstale":"2024-03-04T13:13:21.237194+0000","last_undegraded":"2024-03-04T13:13:21.237194+0000","last_fullsized":"2024-03-04T13:13:21.237194+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291510,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":856,"num_read_kb":55073,"num_write":1469,"num_write_kb":53223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":488,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:52.526120+0000","last_change":"2024-03-04T12:20:18.831825+0000","last_active":"2024-03-04T13:12:52.526120+0000","last_peered":"2024-03-04T13:12:52.526120+0000","last_clean":"2024-03-04T13:12:52.526120+0000","last_became_active":"2024-03-04T12:20:18.831535+0000","last_became_peered":"2024-03-04T12:20:18.831535+0000","last_unstale":"2024-03-04T13:12:52.526120+0000","last_undegraded":"2024-03-04T13:12:52.526120+0000","last_fullsized":"2024-03-04T13:12:52.526120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"255'148","reported_seq":712,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.142739+0000","last_change":"2024-03-04T12:20:21.642237+0000","last_active":"2024-03-04T13:13:21.142739+0000","last_peered":"2024-03-04T13:13:21.142739+0000","last_clean":"2024-03-04T13:13:21.142739+0000","last_became_active":"2024-03-04T12:20:21.641872+0000","last_became_peered":"2024-03-04T12:20:21.641872+0000","last_unstale":"2024-03-04T13:13:21.142739+0000","last_undegraded":"2024-03-04T13:13:21.142739+0000","last_fullsized":"2024-03-04T13:13:21.142739+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6408,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":262,"num_write":108,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.557305+0000","last_change":"2024-03-04T12:20:22.854770+0000","last_active":"2024-03-04T13:12:27.557305+0000","last_peered":"2024-03-04T13:12:27.557305+0000","last_clean":"2024-03-04T13:12:27.557305+0000","last_became_active":"2024-03-04T12:20:22.854454+0000","last_became_peered":"2024-03-04T12:20:22.854454+0000","last_unstale":"2024-03-04T13:12:27.557305+0000","last_undegraded":"2024-03-04T13:12:27.557305+0000","last_fullsized":"2024-03-04T13:12:27.557305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:21.831706+0000","last_clean_scrub_stamp":"2024-03-04T12:20:21.831706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"255'103","reported_seq":587,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.313219+0000","last_change":"2024-03-04T13:13:38.313257+0000","last_active":"2024-03-04T13:13:38.313219+0000","last_peered":"2024-03-04T13:13:38.313219+0000","last_clean":"2024-03-04T13:13:38.313219+0000","last_became_active":"2024-03-04T12:20:24.862179+0000","last_became_peered":"2024-03-04T12:20:24.862179+0000","last_unstale":"2024-03-04T13:13:38.313219+0000","last_undegraded":"2024-03-04T13:13:38.313219+0000","last_fullsized":"2024-03-04T13:13:38.313219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'103","last_scrub_stamp":"2024-03-04T13:13:38.313124+0000","last_deep_scrub":"255'103","last_deep_scrub_stamp":"2024-03-04T13:13:38.313124+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.313124+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:14:30.991089+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":249,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"255'454","reported_seq":1907,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.593548+0000","last_change":"2024-03-04T12:20:16.836521+0000","last_active":"2024-03-04T13:12:50.593548+0000","last_peered":"2024-03-04T13:12:50.593548+0000","last_clean":"2024-03-04T13:12:50.593548+0000","last_became_active":"2024-03-04T12:20:16.836224+0000","last_became_peered":"2024-03-04T12:20:16.836224+0000","last_unstale":"2024-03-04T13:12:50.593548+0000","last_undegraded":"2024-03-04T13:12:50.593548+0000","last_fullsized":"2024-03-04T13:12:50.593548+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2418,"num_read_kb":2273,"num_write":600,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"255'189","reported_seq":780,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.103154+0000","last_change":"2024-03-04T12:20:14.821178+0000","last_active":"2024-03-04T13:13:21.103154+0000","last_peered":"2024-03-04T13:13:21.103154+0000","last_clean":"2024-03-04T13:13:21.103154+0000","last_became_active":"2024-03-04T12:20:14.820789+0000","last_became_peered":"2024-03-04T12:20:14.820789+0000","last_unstale":"2024-03-04T13:13:21.103154+0000","last_undegraded":"2024-03-04T13:13:21.103154+0000","last_fullsized":"2024-03-04T13:13:21.103154+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":398,"num_read_kb":8887,"num_write":907,"num_write_kb":18227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":484,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:52.559920+0000","last_change":"2024-03-04T12:20:18.838301+0000","last_active":"2024-03-04T13:12:52.559920+0000","last_peered":"2024-03-04T13:12:52.559920+0000","last_clean":"2024-03-04T13:12:52.559920+0000","last_became_active":"2024-03-04T12:20:18.837949+0000","last_became_peered":"2024-03-04T12:20:18.837949+0000","last_unstale":"2024-03-04T13:12:52.559920+0000","last_undegraded":"2024-03-04T13:12:52.559920+0000","last_fullsized":"2024-03-04T13:12:52.559920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"255'90","reported_seq":617,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.216675+0000","last_change":"2024-03-04T13:13:40.216707+0000","last_active":"2024-03-04T13:13:40.216675+0000","last_peered":"2024-03-04T13:13:40.216675+0000","last_clean":"2024-03-04T13:13:40.216675+0000","last_became_active":"2024-03-04T12:20:21.641757+0000","last_became_peered":"2024-03-04T12:20:21.641757+0000","last_unstale":"2024-03-04T13:13:40.216675+0000","last_undegraded":"2024-03-04T13:13:40.216675+0000","last_fullsized":"2024-03-04T13:13:40.216675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'90","last_scrub_stamp":"2024-03-04T13:13:40.216584+0000","last_deep_scrub":"255'90","last_deep_scrub_stamp":"2024-03-04T13:13:40.216584+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.216584+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:25:35.856391+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":90,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"255'498","reported_seq":3573,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.721050+0000","last_change":"2024-03-04T13:13:42.721079+0000","last_active":"2024-03-04T13:13:42.721050+0000","last_peered":"2024-03-04T13:13:42.721050+0000","last_clean":"2024-03-04T13:13:42.721050+0000","last_became_active":"2024-03-04T12:20:22.849630+0000","last_became_peered":"2024-03-04T12:20:22.849630+0000","last_unstale":"2024-03-04T13:13:42.721050+0000","last_undegraded":"2024-03-04T13:13:42.721050+0000","last_fullsized":"2024-03-04T13:13:42.721050+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'498","last_scrub_stamp":"2024-03-04T13:13:42.720946+0000","last_deep_scrub":"255'498","last_deep_scrub_stamp":"2024-03-04T13:13:42.720946+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.720946+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:55:37.618879+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"255'142","reported_seq":639,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.502283+0000","last_change":"2024-03-04T13:13:38.502316+0000","last_active":"2024-03-04T13:13:38.502283+0000","last_peered":"2024-03-04T13:13:38.502283+0000","last_clean":"2024-03-04T13:13:38.502283+0000","last_became_active":"2024-03-04T12:20:24.863312+0000","last_became_peered":"2024-03-04T12:20:24.863312+0000","last_unstale":"2024-03-04T13:13:38.502283+0000","last_undegraded":"2024-03-04T13:13:38.502283+0000","last_fullsized":"2024-03-04T13:13:38.502283+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'142","last_scrub_stamp":"2024-03-04T13:13:38.502185+0000","last_deep_scrub":"255'142","last_deep_scrub_stamp":"2024-03-04T13:13:38.502185+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.502185+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:22:25.568903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":307,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"255'558","reported_seq":2207,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.525153+0000","last_change":"2024-03-04T12:20:16.828351+0000","last_active":"2024-03-04T13:12:47.525153+0000","last_peered":"2024-03-04T13:12:47.525153+0000","last_clean":"2024-03-04T13:12:47.525153+0000","last_became_active":"2024-03-04T12:20:16.828102+0000","last_became_peered":"2024-03-04T12:20:16.828102+0000","last_unstale":"2024-03-04T13:12:47.525153+0000","last_undegraded":"2024-03-04T13:12:47.525153+0000","last_fullsized":"2024-03-04T13:12:47.525153+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2984,"num_read_kb":2771,"num_write":760,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"255'207","reported_seq":842,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.228814+0000","last_change":"2024-03-04T12:20:14.827443+0000","last_active":"2024-03-04T13:13:21.228814+0000","last_peered":"2024-03-04T13:13:21.228814+0000","last_clean":"2024-03-04T13:13:21.228814+0000","last_became_active":"2024-03-04T12:20:14.826522+0000","last_became_peered":"2024-03-04T12:20:14.826522+0000","last_unstale":"2024-03-04T13:13:21.228814+0000","last_undegraded":"2024-03-04T13:13:21.228814+0000","last_fullsized":"2024-03-04T13:13:21.228814+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27217,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":463,"num_read_kb":10394,"num_write":1165,"num_write_kb":28391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:52.526058+0000","last_change":"2024-03-04T12:20:18.832929+0000","last_active":"2024-03-04T13:12:52.526058+0000","last_peered":"2024-03-04T13:12:52.526058+0000","last_clean":"2024-03-04T13:12:52.526058+0000","last_became_active":"2024-03-04T12:20:18.832607+0000","last_became_peered":"2024-03-04T12:20:18.832607+0000","last_unstale":"2024-03-04T13:12:52.526058+0000","last_undegraded":"2024-03-04T13:12:52.526058+0000","last_fullsized":"2024-03-04T13:12:52.526058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"255'174","reported_seq":750,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.565632+0000","last_change":"2024-03-04T12:20:20.838476+0000","last_active":"2024-03-04T13:13:27.565632+0000","last_peered":"2024-03-04T13:13:27.565632+0000","last_clean":"2024-03-04T13:13:27.565632+0000","last_became_active":"2024-03-04T12:20:20.838062+0000","last_became_peered":"2024-03-04T12:20:20.838062+0000","last_unstale":"2024-03-04T13:13:27.565632+0000","last_undegraded":"2024-03-04T13:13:27.565632+0000","last_fullsized":"2024-03-04T13:13:27.565632+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8941,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":239,"num_read_kb":314,"num_write":142,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.813164+0000","last_change":"2024-03-04T13:13:41.813187+0000","last_active":"2024-03-04T13:13:41.813164+0000","last_peered":"2024-03-04T13:13:41.813164+0000","last_clean":"2024-03-04T13:13:41.813164+0000","last_became_active":"2024-03-04T12:20:22.856540+0000","last_became_peered":"2024-03-04T12:20:22.856540+0000","last_unstale":"2024-03-04T13:13:41.813164+0000","last_undegraded":"2024-03-04T13:13:41.813164+0000","last_fullsized":"2024-03-04T13:13:41.813164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:41.813077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:41.813077+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.813077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:29:39.366211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"255'90","reported_seq":586,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.486308+0000","last_change":"2024-03-04T13:13:36.486308+0000","last_active":"2024-03-04T13:13:36.486308+0000","last_peered":"2024-03-04T13:13:36.486308+0000","last_clean":"2024-03-04T13:13:36.486308+0000","last_became_active":"2024-03-04T12:20:24.866984+0000","last_became_peered":"2024-03-04T12:20:24.866984+0000","last_unstale":"2024-03-04T13:13:36.486308+0000","last_undegraded":"2024-03-04T13:13:36.486308+0000","last_fullsized":"2024-03-04T13:13:36.486308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'90","last_scrub_stamp":"2024-03-04T13:13:36.486181+0000","last_deep_scrub":"255'90","last_deep_scrub_stamp":"2024-03-04T13:13:36.486181+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.486181+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:49:23.190861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":81,"num_write":221,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"255'841","reported_seq":2369,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.525105+0000","last_change":"2024-03-04T12:20:16.827865+0000","last_active":"2024-03-04T13:12:47.525105+0000","last_peered":"2024-03-04T13:12:47.525105+0000","last_clean":"2024-03-04T13:12:47.525105+0000","last_became_active":"2024-03-04T12:20:16.827592+0000","last_became_peered":"2024-03-04T12:20:16.827592+0000","last_unstale":"2024-03-04T13:12:47.525105+0000","last_undegraded":"2024-03-04T13:12:47.525105+0000","last_fullsized":"2024-03-04T13:12:47.525105+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3846,"num_read_kb":3408,"num_write":1191,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"255'226","reported_seq":859,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.052364+0000","last_change":"2024-03-04T12:20:14.827317+0000","last_active":"2024-03-04T13:13:21.052364+0000","last_peered":"2024-03-04T13:13:21.052364+0000","last_clean":"2024-03-04T13:13:21.052364+0000","last_became_active":"2024-03-04T12:20:14.827034+0000","last_became_peered":"2024-03-04T12:20:14.827034+0000","last_unstale":"2024-03-04T13:13:21.052364+0000","last_undegraded":"2024-03-04T13:13:21.052364+0000","last_fullsized":"2024-03-04T13:13:21.052364+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":510,"num_read_kb":74328,"num_write":1121,"num_write_kb":53240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":483,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:52.377326+0000","last_change":"2024-03-04T12:20:18.836142+0000","last_active":"2024-03-04T13:12:52.377326+0000","last_peered":"2024-03-04T13:12:52.377326+0000","last_clean":"2024-03-04T13:12:52.377326+0000","last_became_active":"2024-03-04T12:20:18.835852+0000","last_became_peered":"2024-03-04T12:20:18.835852+0000","last_unstale":"2024-03-04T13:12:52.377326+0000","last_undegraded":"2024-03-04T13:12:52.377326+0000","last_fullsized":"2024-03-04T13:12:52.377326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"255'135","reported_seq":688,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260557+0000","last_change":"2024-03-04T12:20:20.837534+0000","last_active":"2024-03-04T13:13:25.260557+0000","last_peered":"2024-03-04T13:13:25.260557+0000","last_clean":"2024-03-04T13:13:25.260557+0000","last_became_active":"2024-03-04T12:20:20.837239+0000","last_became_peered":"2024-03-04T12:20:20.837239+0000","last_unstale":"2024-03-04T13:13:25.260557+0000","last_undegraded":"2024-03-04T13:13:25.260557+0000","last_fullsized":"2024-03-04T13:13:25.260557+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7816,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":230,"num_write":86,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.752812+0000","last_change":"2024-03-04T13:13:40.752812+0000","last_active":"2024-03-04T13:13:40.752812+0000","last_peered":"2024-03-04T13:13:40.752812+0000","last_clean":"2024-03-04T13:13:40.752812+0000","last_became_active":"2024-03-04T12:20:22.849731+0000","last_became_peered":"2024-03-04T12:20:22.849731+0000","last_unstale":"2024-03-04T13:13:40.752812+0000","last_undegraded":"2024-03-04T13:13:40.752812+0000","last_fullsized":"2024-03-04T13:13:40.752812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.752696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.752696+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.752696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:38:32.905040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"255'121","reported_seq":629,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.770329+0000","last_change":"2024-03-04T13:13:34.770329+0000","last_active":"2024-03-04T13:13:34.770329+0000","last_peered":"2024-03-04T13:13:34.770329+0000","last_clean":"2024-03-04T13:13:34.770329+0000","last_became_active":"2024-03-04T12:20:24.912599+0000","last_became_peered":"2024-03-04T12:20:24.912599+0000","last_unstale":"2024-03-04T13:13:34.770329+0000","last_undegraded":"2024-03-04T13:13:34.770329+0000","last_fullsized":"2024-03-04T13:13:34.770329+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'121","last_scrub_stamp":"2024-03-04T13:13:34.770155+0000","last_deep_scrub":"255'121","last_deep_scrub_stamp":"2024-03-04T13:13:34.770155+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.770155+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:15:31.167821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":888,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":157,"num_write":287,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"255'1175","reported_seq":2749,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.642444+0000","last_change":"2024-03-04T12:20:16.828068+0000","last_active":"2024-03-04T13:13:26.642444+0000","last_peered":"2024-03-04T13:13:26.642444+0000","last_clean":"2024-03-04T13:13:26.642444+0000","last_became_active":"2024-03-04T12:20:16.827448+0000","last_became_peered":"2024-03-04T12:20:16.827448+0000","last_unstale":"2024-03-04T13:13:26.642444+0000","last_undegraded":"2024-03-04T13:13:26.642444+0000","last_fullsized":"2024-03-04T13:13:26.642444+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":1100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5284,"num_read_kb":4621,"num_write":1652,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"255'215","reported_seq":846,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.220408+0000","last_change":"2024-03-04T12:20:14.822903+0000","last_active":"2024-03-04T13:13:21.220408+0000","last_peered":"2024-03-04T13:13:21.220408+0000","last_clean":"2024-03-04T13:13:21.220408+0000","last_became_active":"2024-03-04T12:20:14.822619+0000","last_became_peered":"2024-03-04T12:20:14.822619+0000","last_unstale":"2024-03-04T13:13:21.220408+0000","last_undegraded":"2024-03-04T13:13:21.220408+0000","last_fullsized":"2024-03-04T13:13:21.220408+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9035448,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":16616,"num_write":1088,"num_write_kb":32501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.106802+0000","last_change":"2024-03-04T12:20:18.831493+0000","last_active":"2024-03-04T13:13:27.106802+0000","last_peered":"2024-03-04T13:13:27.106802+0000","last_clean":"2024-03-04T13:13:27.106802+0000","last_became_active":"2024-03-04T12:20:18.831105+0000","last_became_peered":"2024-03-04T12:20:18.831105+0000","last_unstale":"2024-03-04T13:13:27.106802+0000","last_undegraded":"2024-03-04T13:13:27.106802+0000","last_fullsized":"2024-03-04T13:13:27.106802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"255'100","reported_seq":642,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.125345+0000","last_change":"2024-03-04T12:20:20.842912+0000","last_active":"2024-03-04T13:13:21.125345+0000","last_peered":"2024-03-04T13:13:21.125345+0000","last_clean":"2024-03-04T13:13:21.125345+0000","last_became_active":"2024-03-04T12:20:20.842361+0000","last_became_peered":"2024-03-04T12:20:20.842361+0000","last_unstale":"2024-03-04T13:13:21.125345+0000","last_undegraded":"2024-03-04T13:13:21.125345+0000","last_fullsized":"2024-03-04T13:13:21.125345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":178,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.171567+0000","last_change":"2024-03-04T13:13:36.171595+0000","last_active":"2024-03-04T13:13:36.171567+0000","last_peered":"2024-03-04T13:13:36.171567+0000","last_clean":"2024-03-04T13:13:36.171567+0000","last_became_active":"2024-03-04T12:20:22.856748+0000","last_became_peered":"2024-03-04T12:20:22.856748+0000","last_unstale":"2024-03-04T13:13:36.171567+0000","last_undegraded":"2024-03-04T13:13:36.171567+0000","last_fullsized":"2024-03-04T13:13:36.171567+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:36.171482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:36.171482+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.171482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:01:15.968186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"255'150","reported_seq":1202,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.495689+0000","last_change":"2024-03-04T13:13:37.495689+0000","last_active":"2024-03-04T13:13:37.495689+0000","last_peered":"2024-03-04T13:13:37.495689+0000","last_clean":"2024-03-04T13:13:37.495689+0000","last_became_active":"2024-03-04T12:20:24.865363+0000","last_became_peered":"2024-03-04T12:20:24.865363+0000","last_unstale":"2024-03-04T13:13:37.495689+0000","last_undegraded":"2024-03-04T13:13:37.495689+0000","last_fullsized":"2024-03-04T13:13:37.495689+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'150","last_scrub_stamp":"2024-03-04T13:13:37.495521+0000","last_deep_scrub":"255'150","last_deep_scrub_stamp":"2024-03-04T13:13:37.495521+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.495521+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:07:28.025150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":819,"num_read_kb":785,"num_write":355,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"255'725","reported_seq":2133,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.106410+0000","last_change":"2024-03-04T12:20:16.820242+0000","last_active":"2024-03-04T13:13:27.106410+0000","last_peered":"2024-03-04T13:13:27.106410+0000","last_clean":"2024-03-04T13:13:27.106410+0000","last_became_active":"2024-03-04T12:20:16.819966+0000","last_became_peered":"2024-03-04T12:20:16.819966+0000","last_unstale":"2024-03-04T13:13:27.106410+0000","last_undegraded":"2024-03-04T13:13:27.106410+0000","last_fullsized":"2024-03-04T13:13:27.106410+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3297,"num_read_kb":2935,"num_write":968,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"255'281","reported_seq":927,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.235130+0000","last_change":"2024-03-04T12:20:14.824471+0000","last_active":"2024-03-04T13:13:21.235130+0000","last_peered":"2024-03-04T13:13:21.235130+0000","last_clean":"2024-03-04T13:13:21.235130+0000","last_became_active":"2024-03-04T12:20:14.824168+0000","last_became_peered":"2024-03-04T12:20:14.824168+0000","last_unstale":"2024-03-04T13:13:21.235130+0000","last_undegraded":"2024-03-04T13:13:21.235130+0000","last_fullsized":"2024-03-04T13:13:21.235130+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":709,"num_read_kb":4351,"num_write":1165,"num_write_kb":19276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"255'2","reported_seq":495,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.776023+0000","last_change":"2024-03-04T13:13:41.776049+0000","last_active":"2024-03-04T13:13:41.776023+0000","last_peered":"2024-03-04T13:13:41.776023+0000","last_clean":"2024-03-04T13:13:41.776023+0000","last_became_active":"2024-03-04T12:20:18.836203+0000","last_became_peered":"2024-03-04T12:20:18.836203+0000","last_unstale":"2024-03-04T13:13:41.776023+0000","last_undegraded":"2024-03-04T13:13:41.776023+0000","last_fullsized":"2024-03-04T13:13:41.776023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:41.775929+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:41.775929+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.775929+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:50:48.463948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"255'164","reported_seq":749,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.295997+0000","last_change":"2024-03-04T13:13:42.296030+0000","last_active":"2024-03-04T13:13:42.295997+0000","last_peered":"2024-03-04T13:13:42.295997+0000","last_clean":"2024-03-04T13:13:42.295997+0000","last_became_active":"2024-03-04T12:20:20.842246+0000","last_became_peered":"2024-03-04T12:20:20.842246+0000","last_unstale":"2024-03-04T13:13:42.295997+0000","last_undegraded":"2024-03-04T13:13:42.295997+0000","last_fullsized":"2024-03-04T13:13:42.295997+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'164","last_scrub_stamp":"2024-03-04T13:13:42.295912+0000","last_deep_scrub":"255'164","last_deep_scrub_stamp":"2024-03-04T13:13:42.295912+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.295912+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:11:48.208552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":208,"num_read_kb":255,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.837055+0000","last_change":"2024-03-04T13:13:40.837077+0000","last_active":"2024-03-04T13:13:40.837055+0000","last_peered":"2024-03-04T13:13:40.837055+0000","last_clean":"2024-03-04T13:13:40.837055+0000","last_became_active":"2024-03-04T12:20:22.856597+0000","last_became_peered":"2024-03-04T12:20:22.856597+0000","last_unstale":"2024-03-04T13:13:40.837055+0000","last_undegraded":"2024-03-04T13:13:40.837055+0000","last_fullsized":"2024-03-04T13:13:40.837055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.836958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.836958+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.836958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:40:36.037380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"255'91","reported_seq":578,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.180139+0000","last_change":"2024-03-04T13:13:35.180186+0000","last_active":"2024-03-04T13:13:35.180139+0000","last_peered":"2024-03-04T13:13:35.180139+0000","last_clean":"2024-03-04T13:13:35.180139+0000","last_became_active":"2024-03-04T12:20:24.869207+0000","last_became_peered":"2024-03-04T12:20:24.869207+0000","last_unstale":"2024-03-04T13:13:35.180139+0000","last_undegraded":"2024-03-04T13:13:35.180139+0000","last_fullsized":"2024-03-04T13:13:35.180139+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'91","last_scrub_stamp":"2024-03-04T13:13:35.180028+0000","last_deep_scrub":"255'91","last_deep_scrub_stamp":"2024-03-04T13:13:35.180028+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.180028+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:13:14.165397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":212,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"255'1093","reported_seq":2667,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.729735+0000","last_change":"2024-03-04T13:13:46.729763+0000","last_active":"2024-03-04T13:13:46.729735+0000","last_peered":"2024-03-04T13:13:46.729735+0000","last_clean":"2024-03-04T13:13:46.729735+0000","last_became_active":"2024-03-04T12:20:16.832377+0000","last_became_peered":"2024-03-04T12:20:16.832377+0000","last_unstale":"2024-03-04T13:13:46.729735+0000","last_undegraded":"2024-03-04T13:13:46.729735+0000","last_fullsized":"2024-03-04T13:13:46.729735+0000","mapping_epoch":22,"log_start":"255'1000","ondisk_log_start":"255'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1093","last_scrub_stamp":"2024-03-04T13:13:46.729643+0000","last_deep_scrub":"255'1093","last_deep_scrub_stamp":"2024-03-04T13:13:46.729643+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.729643+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":1000,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:00:19.632521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4785,"num_read_kb":4211,"num_write":1502,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"255'213","reported_seq":861,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.172551+0000","last_change":"2024-03-04T12:20:14.817916+0000","last_active":"2024-03-04T13:13:21.172551+0000","last_peered":"2024-03-04T13:13:21.172551+0000","last_clean":"2024-03-04T13:13:21.172551+0000","last_became_active":"2024-03-04T12:20:14.817326+0000","last_became_peered":"2024-03-04T12:20:14.817326+0000","last_unstale":"2024-03-04T13:13:21.172551+0000","last_undegraded":"2024-03-04T13:13:21.172551+0000","last_fullsized":"2024-03-04T13:13:21.172551+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":463525,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":541,"num_read_kb":21798,"num_write":1100,"num_write_kb":25910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"255'797","reported_seq":2448,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.757911+0000","last_change":"2024-03-04T13:13:42.757960+0000","last_active":"2024-03-04T13:13:42.757911+0000","last_peered":"2024-03-04T13:13:42.757911+0000","last_clean":"2024-03-04T13:13:42.757911+0000","last_became_active":"2024-03-04T12:20:16.834823+0000","last_became_peered":"2024-03-04T12:20:16.834823+0000","last_unstale":"2024-03-04T13:13:42.757911+0000","last_undegraded":"2024-03-04T13:13:42.757911+0000","last_fullsized":"2024-03-04T13:13:42.757911+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'797","last_scrub_stamp":"2024-03-04T13:13:42.757785+0000","last_deep_scrub":"255'797","last_deep_scrub_stamp":"2024-03-04T13:13:42.757785+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.757785+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:53:56.372808+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3958,"num_read_kb":3565,"num_write":1074,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1914,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"255'213","reported_seq":865,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.170748+0000","last_change":"2024-03-04T13:13:46.170790+0000","last_active":"2024-03-04T13:13:46.170748+0000","last_peered":"2024-03-04T13:13:46.170748+0000","last_clean":"2024-03-04T13:13:46.170748+0000","last_became_active":"2024-03-04T12:20:14.819333+0000","last_became_peered":"2024-03-04T12:20:14.819333+0000","last_unstale":"2024-03-04T13:13:46.170748+0000","last_undegraded":"2024-03-04T13:13:46.170748+0000","last_fullsized":"2024-03-04T13:13:46.170748+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'213","last_scrub_stamp":"2024-03-04T13:13:46.170666+0000","last_deep_scrub":"255'213","last_deep_scrub_stamp":"2024-03-04T13:13:46.170666+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.170666+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:06:30.772153+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":688512,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":39432,"num_write":1114,"num_write_kb":31535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"255'567","reported_seq":2094,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:36.976989+0000","last_change":"2024-03-04T12:20:16.829090+0000","last_active":"2024-03-04T13:12:36.976989+0000","last_peered":"2024-03-04T13:12:36.976989+0000","last_clean":"2024-03-04T13:12:36.976989+0000","last_became_active":"2024-03-04T12:20:16.828799+0000","last_became_peered":"2024-03-04T12:20:16.828799+0000","last_unstale":"2024-03-04T13:12:36.976989+0000","last_undegraded":"2024-03-04T13:12:36.976989+0000","last_fullsized":"2024-03-04T13:12:36.976989+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2802,"num_read_kb":2536,"num_write":761,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"255'187","reported_seq":793,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.228483+0000","last_change":"2024-03-04T12:20:14.824170+0000","last_active":"2024-03-04T13:13:21.228483+0000","last_peered":"2024-03-04T13:13:21.228483+0000","last_clean":"2024-03-04T13:13:21.228483+0000","last_became_active":"2024-03-04T12:20:14.823794+0000","last_became_peered":"2024-03-04T12:20:14.823794+0000","last_unstale":"2024-03-04T13:13:21.228483+0000","last_undegraded":"2024-03-04T13:13:21.228483+0000","last_fullsized":"2024-03-04T13:13:21.228483+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27216,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":368,"num_read_kb":29267,"num_write":940,"num_write_kb":26221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"255'419","reported_seq":2015,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:17.556025+0000","last_change":"2024-03-04T12:20:16.830270+0000","last_active":"2024-03-04T13:12:17.556025+0000","last_peered":"2024-03-04T13:12:17.556025+0000","last_clean":"2024-03-04T13:12:17.556025+0000","last_became_active":"2024-03-04T12:20:16.830023+0000","last_became_peered":"2024-03-04T12:20:16.830023+0000","last_unstale":"2024-03-04T13:12:17.556025+0000","last_undegraded":"2024-03-04T13:12:17.556025+0000","last_fullsized":"2024-03-04T13:12:17.556025+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2457,"num_read_kb":2316,"num_write":500,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"255'181","reported_seq":765,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.206595+0000","last_change":"2024-03-04T12:20:14.814965+0000","last_active":"2024-03-04T13:13:21.206595+0000","last_peered":"2024-03-04T13:13:21.206595+0000","last_clean":"2024-03-04T13:13:21.206595+0000","last_became_active":"2024-03-04T12:20:14.814649+0000","last_became_peered":"2024-03-04T12:20:14.814649+0000","last_unstale":"2024-03-04T13:13:21.206595+0000","last_undegraded":"2024-03-04T13:13:21.206595+0000","last_fullsized":"2024-03-04T13:13:21.206595+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":350,"num_read_kb":14298,"num_write":961,"num_write_kb":45374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"255'670","reported_seq":2119,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.467104+0000","last_change":"2024-03-04T12:20:16.832110+0000","last_active":"2024-03-04T13:12:27.467104+0000","last_peered":"2024-03-04T13:12:27.467104+0000","last_clean":"2024-03-04T13:12:27.467104+0000","last_became_active":"2024-03-04T12:20:16.831861+0000","last_became_peered":"2024-03-04T12:20:16.831861+0000","last_unstale":"2024-03-04T13:12:27.467104+0000","last_undegraded":"2024-03-04T13:12:27.467104+0000","last_fullsized":"2024-03-04T13:12:27.467104+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":600,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3134,"num_read_kb":2831,"num_write":876,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"255'150","reported_seq":783,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.234393+0000","last_change":"2024-03-04T12:20:14.818277+0000","last_active":"2024-03-04T13:13:21.234393+0000","last_peered":"2024-03-04T13:13:21.234393+0000","last_clean":"2024-03-04T13:13:21.234393+0000","last_became_active":"2024-03-04T12:20:14.818011+0000","last_became_peered":"2024-03-04T12:20:14.818011+0000","last_unstale":"2024-03-04T13:13:21.234393+0000","last_undegraded":"2024-03-04T13:13:21.234393+0000","last_fullsized":"2024-03-04T13:13:21.234393+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6900048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":2296,"num_write":812,"num_write_kb":10260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"255'1153","reported_seq":2619,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.576933+0000","last_change":"2024-03-04T12:20:16.821337+0000","last_active":"2024-03-04T13:12:22.576933+0000","last_peered":"2024-03-04T13:12:22.576933+0000","last_clean":"2024-03-04T13:12:22.576933+0000","last_became_active":"2024-03-04T12:20:16.820794+0000","last_became_peered":"2024-03-04T12:20:16.820794+0000","last_unstale":"2024-03-04T13:12:22.576933+0000","last_undegraded":"2024-03-04T13:12:22.576933+0000","last_fullsized":"2024-03-04T13:12:22.576933+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":1100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4910,"num_read_kb":4282,"num_write":1611,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"255'212","reported_seq":836,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.220538+0000","last_change":"2024-03-04T12:20:14.812183+0000","last_active":"2024-03-04T13:13:21.220538+0000","last_peered":"2024-03-04T13:13:21.220538+0000","last_clean":"2024-03-04T13:13:21.220538+0000","last_became_active":"2024-03-04T12:20:14.811334+0000","last_became_peered":"2024-03-04T12:20:14.811334+0000","last_unstale":"2024-03-04T13:13:21.220538+0000","last_undegraded":"2024-03-04T13:13:21.220538+0000","last_fullsized":"2024-03-04T13:13:21.220538+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1577095,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":33282,"num_write":1226,"num_write_kb":31843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"255'760","reported_seq":2378,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.575088+0000","last_change":"2024-03-04T12:20:16.835553+0000","last_active":"2024-03-04T13:12:22.575088+0000","last_peered":"2024-03-04T13:12:22.575088+0000","last_clean":"2024-03-04T13:12:22.575088+0000","last_became_active":"2024-03-04T12:20:16.835285+0000","last_became_peered":"2024-03-04T12:20:16.835285+0000","last_unstale":"2024-03-04T13:12:22.575088+0000","last_undegraded":"2024-03-04T13:12:22.575088+0000","last_fullsized":"2024-03-04T13:12:22.575088+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3723,"num_read_kb":3381,"num_write":1013,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"255'217","reported_seq":847,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.172838+0000","last_change":"2024-03-04T12:20:14.818864+0000","last_active":"2024-03-04T13:13:21.172838+0000","last_peered":"2024-03-04T13:13:21.172838+0000","last_clean":"2024-03-04T13:13:21.172838+0000","last_became_active":"2024-03-04T12:20:14.818385+0000","last_became_peered":"2024-03-04T12:20:14.818385+0000","last_unstale":"2024-03-04T13:13:21.172838+0000","last_undegraded":"2024-03-04T13:13:21.172838+0000","last_fullsized":"2024-03-04T13:13:21.172838+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":39388,"num_write":1130,"num_write_kb":46394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"255'1088","reported_seq":2795,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.743505+0000","last_change":"2024-03-04T13:13:45.743547+0000","last_active":"2024-03-04T13:13:45.743505+0000","last_peered":"2024-03-04T13:13:45.743505+0000","last_clean":"2024-03-04T13:13:45.743505+0000","last_became_active":"2024-03-04T12:20:16.823596+0000","last_became_peered":"2024-03-04T12:20:16.823596+0000","last_unstale":"2024-03-04T13:13:45.743505+0000","last_undegraded":"2024-03-04T13:13:45.743505+0000","last_fullsized":"2024-03-04T13:13:45.743505+0000","mapping_epoch":22,"log_start":"255'1000","ondisk_log_start":"255'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1088","last_scrub_stamp":"2024-03-04T13:13:45.743404+0000","last_deep_scrub":"255'1088","last_deep_scrub_stamp":"2024-03-04T13:13:45.743404+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.743404+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":1000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:44.706870+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5087,"num_read_kb":4523,"num_write":1483,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2399,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"255'226","reported_seq":1076,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.234994+0000","last_change":"2024-03-04T12:20:14.818818+0000","last_active":"2024-03-04T13:13:21.234994+0000","last_peered":"2024-03-04T13:13:21.234994+0000","last_clean":"2024-03-04T13:13:21.234994+0000","last_became_active":"2024-03-04T12:20:14.818340+0000","last_became_peered":"2024-03-04T12:20:14.818340+0000","last_unstale":"2024-03-04T13:13:21.234994+0000","last_undegraded":"2024-03-04T13:13:21.234994+0000","last_fullsized":"2024-03-04T13:13:21.234994+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":933,"num_read_kb":21991,"num_write":1290,"num_write_kb":38918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"255'450","reported_seq":1994,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:31.304237+0000","last_change":"2024-03-04T12:20:16.830513+0000","last_active":"2024-03-04T13:12:31.304237+0000","last_peered":"2024-03-04T13:12:31.304237+0000","last_clean":"2024-03-04T13:12:31.304237+0000","last_became_active":"2024-03-04T12:20:16.830259+0000","last_became_peered":"2024-03-04T12:20:16.830259+0000","last_unstale":"2024-03-04T13:12:31.304237+0000","last_undegraded":"2024-03-04T13:12:31.304237+0000","last_fullsized":"2024-03-04T13:12:31.304237+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2206,"num_write":536,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"255'206","reported_seq":856,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.164401+0000","last_change":"2024-03-04T12:20:14.824797+0000","last_active":"2024-03-04T13:13:21.164401+0000","last_peered":"2024-03-04T13:13:21.164401+0000","last_clean":"2024-03-04T13:13:21.164401+0000","last_became_active":"2024-03-04T12:20:14.823513+0000","last_became_peered":"2024-03-04T12:20:14.823513+0000","last_unstale":"2024-03-04T13:13:21.164401+0000","last_undegraded":"2024-03-04T13:13:21.164401+0000","last_fullsized":"2024-03-04T13:13:21.164401+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706375,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":60209,"num_write":1193,"num_write_kb":41508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"255'752","reported_seq":2233,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:05.109559+0000","last_change":"2024-03-04T12:20:16.825790+0000","last_active":"2024-03-04T13:12:05.109559+0000","last_peered":"2024-03-04T13:12:05.109559+0000","last_clean":"2024-03-04T13:12:05.109559+0000","last_became_active":"2024-03-04T12:20:16.825534+0000","last_became_peered":"2024-03-04T12:20:16.825534+0000","last_unstale":"2024-03-04T13:12:05.109559+0000","last_undegraded":"2024-03-04T13:12:05.109559+0000","last_fullsized":"2024-03-04T13:12:05.109559+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3330,"num_read_kb":2980,"num_write":1004,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"255'222","reported_seq":831,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.081294+0000","last_change":"2024-03-04T12:20:14.817902+0000","last_active":"2024-03-04T13:13:21.081294+0000","last_peered":"2024-03-04T13:13:21.081294+0000","last_clean":"2024-03-04T13:13:21.081294+0000","last_became_active":"2024-03-04T12:20:14.817531+0000","last_became_peered":"2024-03-04T12:20:14.817531+0000","last_unstale":"2024-03-04T13:13:21.081294+0000","last_undegraded":"2024-03-04T13:13:21.081294+0000","last_fullsized":"2024-03-04T13:13:21.081294+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7696,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":19231,"num_write":1186,"num_write_kb":63143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"255'534","reported_seq":2108,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.452306+0000","last_change":"2024-03-04T12:20:16.823620+0000","last_active":"2024-03-04T13:12:07.452306+0000","last_peered":"2024-03-04T13:12:07.452306+0000","last_clean":"2024-03-04T13:12:07.452306+0000","last_became_active":"2024-03-04T12:20:16.823358+0000","last_became_peered":"2024-03-04T12:20:16.823358+0000","last_unstale":"2024-03-04T13:12:07.452306+0000","last_undegraded":"2024-03-04T13:12:07.452306+0000","last_fullsized":"2024-03-04T13:12:07.452306+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2875,"num_read_kb":2619,"num_write":718,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"255'189","reported_seq":802,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.141126+0000","last_change":"2024-03-04T13:13:31.141187+0000","last_active":"2024-03-04T13:13:31.141126+0000","last_peered":"2024-03-04T13:13:31.141126+0000","last_clean":"2024-03-04T13:13:31.141126+0000","last_became_active":"2024-03-04T12:20:50.902181+0000","last_became_peered":"2024-03-04T12:20:50.902181+0000","last_unstale":"2024-03-04T13:13:31.141126+0000","last_undegraded":"2024-03-04T13:13:31.141126+0000","last_fullsized":"2024-03-04T13:13:31.141126+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'189","last_scrub_stamp":"2024-03-04T13:13:31.141036+0000","last_deep_scrub":"255'189","last_deep_scrub_stamp":"2024-03-04T13:13:31.141036+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.141036+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:38:14.485982+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918078,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":20827,"num_write":1047,"num_write_kb":19608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"255'418","reported_seq":1797,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:02.516883+0000","last_change":"2024-03-04T12:20:16.819439+0000","last_active":"2024-03-04T13:12:02.516883+0000","last_peered":"2024-03-04T13:12:02.516883+0000","last_clean":"2024-03-04T13:12:02.516883+0000","last_became_active":"2024-03-04T12:20:16.819169+0000","last_became_peered":"2024-03-04T12:20:16.819169+0000","last_unstale":"2024-03-04T13:12:02.516883+0000","last_undegraded":"2024-03-04T13:12:02.516883+0000","last_fullsized":"2024-03-04T13:12:02.516883+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2116,"num_read_kb":1957,"num_write":522,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"255'172","reported_seq":788,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.052197+0000","last_change":"2024-03-04T12:20:14.823104+0000","last_active":"2024-03-04T13:13:21.052197+0000","last_peered":"2024-03-04T13:13:21.052197+0000","last_clean":"2024-03-04T13:13:21.052197+0000","last_became_active":"2024-03-04T12:20:14.822588+0000","last_became_peered":"2024-03-04T12:20:14.822588+0000","last_unstale":"2024-03-04T13:13:21.052197+0000","last_undegraded":"2024-03-04T13:13:21.052197+0000","last_fullsized":"2024-03-04T13:13:21.052197+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":390,"num_read_kb":47350,"num_write":1028,"num_write_kb":32429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"255'482","reported_seq":2026,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.575961+0000","last_change":"2024-03-04T12:20:16.828912+0000","last_active":"2024-03-04T13:12:22.575961+0000","last_peered":"2024-03-04T13:12:22.575961+0000","last_clean":"2024-03-04T13:12:22.575961+0000","last_became_active":"2024-03-04T12:20:16.828618+0000","last_became_peered":"2024-03-04T12:20:16.828618+0000","last_unstale":"2024-03-04T13:12:22.575961+0000","last_undegraded":"2024-03-04T13:12:22.575961+0000","last_fullsized":"2024-03-04T13:12:22.575961+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2516,"num_read_kb":2328,"num_write":610,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"255'180","reported_seq":911,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.207265+0000","last_change":"2024-03-04T12:20:14.819283+0000","last_active":"2024-03-04T13:13:21.207265+0000","last_peered":"2024-03-04T13:13:21.207265+0000","last_clean":"2024-03-04T13:13:21.207265+0000","last_became_active":"2024-03-04T12:20:14.818924+0000","last_became_peered":"2024-03-04T12:20:14.818924+0000","last_unstale":"2024-03-04T13:13:21.207265+0000","last_undegraded":"2024-03-04T13:13:21.207265+0000","last_fullsized":"2024-03-04T13:13:21.207265+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":719,"num_read_kb":26573,"num_write":1059,"num_write_kb":25938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"255'850","reported_seq":2379,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:34.801363+0000","last_change":"2024-03-04T12:20:16.835574+0000","last_active":"2024-03-04T13:12:34.801363+0000","last_peered":"2024-03-04T13:12:34.801363+0000","last_clean":"2024-03-04T13:12:34.801363+0000","last_became_active":"2024-03-04T12:20:16.835308+0000","last_became_peered":"2024-03-04T12:20:16.835308+0000","last_unstale":"2024-03-04T13:12:34.801363+0000","last_undegraded":"2024-03-04T13:12:34.801363+0000","last_fullsized":"2024-03-04T13:12:34.801363+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3917,"num_read_kb":3486,"num_write":1199,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"255'194","reported_seq":802,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.206750+0000","last_change":"2024-03-04T12:20:14.816730+0000","last_active":"2024-03-04T13:13:21.206750+0000","last_peered":"2024-03-04T13:13:21.206750+0000","last_clean":"2024-03-04T13:13:21.206750+0000","last_became_active":"2024-03-04T12:20:14.816440+0000","last_became_peered":"2024-03-04T12:20:14.816440+0000","last_unstale":"2024-03-04T13:13:21.206750+0000","last_undegraded":"2024-03-04T13:13:21.206750+0000","last_fullsized":"2024-03-04T13:13:21.206750+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17822208,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":392,"num_read_kb":7899,"num_write":1089,"num_write_kb":49946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"255'688","reported_seq":2009,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:39.328234+0000","last_change":"2024-03-04T12:20:16.828266+0000","last_active":"2024-03-04T13:12:39.328234+0000","last_peered":"2024-03-04T13:12:39.328234+0000","last_clean":"2024-03-04T13:12:39.328234+0000","last_became_active":"2024-03-04T12:20:16.827770+0000","last_became_peered":"2024-03-04T12:20:16.827770+0000","last_unstale":"2024-03-04T13:12:39.328234+0000","last_undegraded":"2024-03-04T13:12:39.328234+0000","last_fullsized":"2024-03-04T13:12:39.328234+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":600,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3073,"num_read_kb":2741,"num_write":929,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"255'194","reported_seq":810,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.208707+0000","last_change":"2024-03-04T13:13:47.208750+0000","last_active":"2024-03-04T13:13:47.208707+0000","last_peered":"2024-03-04T13:13:47.208707+0000","last_clean":"2024-03-04T13:13:47.208707+0000","last_became_active":"2024-03-04T12:20:14.820393+0000","last_became_peered":"2024-03-04T12:20:14.820393+0000","last_unstale":"2024-03-04T13:13:47.208707+0000","last_undegraded":"2024-03-04T13:13:47.208707+0000","last_fullsized":"2024-03-04T13:13:47.208707+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'194","last_scrub_stamp":"2024-03-04T13:13:47.208620+0000","last_deep_scrub":"255'194","last_deep_scrub_stamp":"2024-03-04T13:13:47.208620+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.208620+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:32:29.821551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":6825,"num_write":1149,"num_write_kb":21389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"255'357","reported_seq":1775,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:50.593346+0000","last_change":"2024-03-04T12:20:16.829573+0000","last_active":"2024-03-04T13:12:50.593346+0000","last_peered":"2024-03-04T13:12:50.593346+0000","last_clean":"2024-03-04T13:12:50.593346+0000","last_became_active":"2024-03-04T12:20:16.829306+0000","last_became_peered":"2024-03-04T12:20:16.829306+0000","last_unstale":"2024-03-04T13:12:50.593346+0000","last_undegraded":"2024-03-04T13:12:50.593346+0000","last_fullsized":"2024-03-04T13:12:50.593346+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1952,"num_read_kb":1858,"num_write":426,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"255'171","reported_seq":774,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.235796+0000","last_change":"2024-03-04T12:20:14.823519+0000","last_active":"2024-03-04T13:13:21.235796+0000","last_peered":"2024-03-04T13:13:21.235796+0000","last_clean":"2024-03-04T13:13:21.235796+0000","last_became_active":"2024-03-04T12:20:14.821961+0000","last_became_peered":"2024-03-04T12:20:14.821961+0000","last_unstale":"2024-03-04T13:13:21.235796+0000","last_undegraded":"2024-03-04T13:13:21.235796+0000","last_fullsized":"2024-03-04T13:13:21.235796+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":395,"num_read_kb":13429,"num_write":876,"num_write_kb":50070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"255'155","reported_seq":732,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.027327+0000","last_change":"2024-03-04T13:13:35.027360+0000","last_active":"2024-03-04T13:13:35.027327+0000","last_peered":"2024-03-04T13:13:35.027327+0000","last_clean":"2024-03-04T13:13:35.027327+0000","last_became_active":"2024-03-04T12:20:51.030887+0000","last_became_peered":"2024-03-04T12:20:51.030887+0000","last_unstale":"2024-03-04T13:13:35.027327+0000","last_undegraded":"2024-03-04T13:13:35.027327+0000","last_fullsized":"2024-03-04T13:13:35.027327+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'155","last_scrub_stamp":"2024-03-04T13:13:35.027238+0000","last_deep_scrub":"255'155","last_deep_scrub_stamp":"2024-03-04T13:13:35.027238+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.027238+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:09.896709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":307,"num_read_kb":55812,"num_write":877,"num_write_kb":48688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"255'385","reported_seq":1780,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260330+0000","last_change":"2024-03-04T12:20:16.831651+0000","last_active":"2024-03-04T13:13:25.260330+0000","last_peered":"2024-03-04T13:13:25.260330+0000","last_clean":"2024-03-04T13:13:25.260330+0000","last_became_active":"2024-03-04T12:20:16.831393+0000","last_became_peered":"2024-03-04T12:20:16.831393+0000","last_unstale":"2024-03-04T13:13:25.260330+0000","last_undegraded":"2024-03-04T13:13:25.260330+0000","last_fullsized":"2024-03-04T13:13:25.260330+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2009,"num_read_kb":1888,"num_write":461,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"255'192","reported_seq":865,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.228542+0000","last_change":"2024-03-04T12:20:14.818169+0000","last_active":"2024-03-04T13:13:21.228542+0000","last_peered":"2024-03-04T13:13:21.228542+0000","last_clean":"2024-03-04T13:13:21.228542+0000","last_became_active":"2024-03-04T12:20:14.817894+0000","last_became_peered":"2024-03-04T12:20:14.817894+0000","last_unstale":"2024-03-04T13:13:21.228542+0000","last_undegraded":"2024-03-04T13:13:21.228542+0000","last_fullsized":"2024-03-04T13:13:21.228542+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":444,"num_read_kb":164272,"num_write":1071,"num_write_kb":63423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"255'517","reported_seq":1962,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.382251+0000","last_change":"2024-03-04T12:20:16.824278+0000","last_active":"2024-03-04T13:13:27.382251+0000","last_peered":"2024-03-04T13:13:27.382251+0000","last_clean":"2024-03-04T13:13:27.382251+0000","last_became_active":"2024-03-04T12:20:16.823974+0000","last_became_peered":"2024-03-04T12:20:16.823974+0000","last_unstale":"2024-03-04T13:13:27.382251+0000","last_undegraded":"2024-03-04T13:13:27.382251+0000","last_fullsized":"2024-03-04T13:13:27.382251+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2611,"num_read_kb":2352,"num_write":706,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":185523,"num_write":154,"num_write_kb":127147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5335,"num_read_kb":3794,"num_write":2149,"num_write_kb":803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6970,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1184,"ondisk_log_size":1184,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":10065,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":12124,"num_read_kb":11961,"num_write":14025,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1726,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":20130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2322,"ondisk_log_size":2322,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":260729,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8455,"num_read_kb":10448,"num_write":5923,"num_write_kb":2713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121090,"num_omap_keys":294,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1875,"ondisk_log_size":1875,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1637,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1554,"num_read_kb":1549,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":187558,"num_read_kb":170512,"num_write":50934,"num_write_kb":17677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8833,"num_omap_keys":38,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3805,"ondisk_log_size":3805,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":189749578,"num_objects":263,"num_object_clones":0,"num_object_copies":526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":263,"num_whiteouts":0,"num_read":29476,"num_read_kb":2152910,"num_write":68734,"num_write_kb":2157934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":381083648,"data_stored":379499156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4074,"ondisk_log_size":4074,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":196827,"num_write":154,"num_write_kb":127147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575497,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":278600,"kb_used_data":71104,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94093240,"statfs":{"total":96636764160,"available":96351477760,"internally_reserved":0,"allocated":72810496,"data_stored":71072930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212466122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575498,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274104,"kb_used_data":40240,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94097736,"statfs":{"total":96636764160,"available":96356081664,"internally_reserved":0,"allocated":41205760,"data_stored":39656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575498,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149900,"kb_used_data":68804,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94221940,"statfs":{"total":96636764160,"available":96483266560,"internally_reserved":0,"allocated":70455296,"data_stored":68729090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575497,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108220,"kb_used_data":40948,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94263620,"statfs":{"total":96636764160,"available":96525946880,"internally_reserved":0,"allocated":41930752,"data_stored":40369557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575497,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284088,"kb_used_data":76592,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94087752,"statfs":{"total":96636764160,"available":96345858048,"internally_reserved":0,"allocated":78430208,"data_stored":76690401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":212466119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575498,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119296,"kb_used_data":47864,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94252544,"statfs":{"total":96636764160,"available":96514605056,"internally_reserved":0,"allocated":49012736,"data_stored":47453483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575499,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":170876,"kb_used_data":59252,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94200964,"statfs":{"total":96636764160,"available":96461787136,"internally_reserved":0,"allocated":60674048,"data_stored":59087481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575496,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273196,"kb_used_data":61540,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94098644,"statfs":{"total":96636764160,"available":96357011456,"internally_reserved":0,"allocated":63016960,"data_stored":61377358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":47357952,"data_stored":47171521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50876416,"data_stored":50716133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45522944,"data_stored":45373582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":64413696,"data_stored":64121957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32161792,"data_stored":31999474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":56401920,"data_stored":56160984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21966848,"data_stored":21846112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":62382080,"data_stored":62109393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T13:13:49.309 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.310 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.310 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.310 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.310 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.310 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.311 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.311 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.311 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.311 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.311 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.312 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.312 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.312 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.312 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.312 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.312 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.313 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.313 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.313 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.313 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.313 INFO:tasks.ceph:pgid 64.15 last_scrub_stamp 2024-03-04T12:29:00.682919+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=29, tm_sec=0, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.314 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.314 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.314 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.314 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.314 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.315 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.315 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.315 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.315 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.315 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.316 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.316 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.316 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.316 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.316 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.316 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.317 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.317 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.317 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.317 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.317 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.318 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.318 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.318 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.318 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.318 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.319 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.319 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.319 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.319 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.319 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.319 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.320 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.320 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.320 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.320 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.320 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.321 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.321 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.321 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.321 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.321 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.321 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.322 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.322 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.322 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.322 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.322 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.322 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.322 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.323 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.323 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.323 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.323 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.323 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.323 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.324 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.324 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.324 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.324 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.324 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.325 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.325 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.325 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.325 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.325 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.326 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.326 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.326 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.326 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.326 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.326 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.327 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.327 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.327 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.327 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.327 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.327 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.328 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.328 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.328 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.328 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.328 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.329 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.329 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.329 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.329 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.329 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.330 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.330 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.330 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.330 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.330 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.331 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.331 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.331 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.331 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.331 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.332 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.332 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.332 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.332 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-04T12:19:57.750293+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=19, tm_sec=57, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.332 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-04T12:20:04.766258+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.333 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.333 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.333 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.333 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.333 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-04T12:20:04.766258+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.333 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.333 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.334 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.334 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.334 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.334 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.334 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-04T12:20:04.766258+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.335 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.335 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.335 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.335 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.335 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.335 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-04T12:20:04.766258+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.336 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.336 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.336 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.336 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.336 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-04T12:20:04.766258+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.337 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.337 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.337 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.337 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-04T12:20:04.766258+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.337 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.337 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.338 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.338 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-04T12:20:04.766258+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.338 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.338 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.338 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.338 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.339 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.339 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.339 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.339 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.339 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.339 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.340 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.340 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.340 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.340 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.340 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.341 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.341 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.341 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.341 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.341 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.341 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.342 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.342 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.342 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-04T12:20:23.847019+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.342 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.342 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.343 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.343 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-03-04T12:20:21.831706+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.343 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.343 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.343 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.343 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.344 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.344 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.344 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.344 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.344 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.344 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.345 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.345 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.345 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.345 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.345 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.346 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.346 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.346 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.346 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.346 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.346 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.347 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.347 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.347 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.347 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.347 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.347 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.348 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.348 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.348 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.348 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.348 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.348 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.349 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.349 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.349 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.349 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.349 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.349 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.350 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.350 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.350 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.350 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.350 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.350 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.351 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:13:49.351 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-04T13:14:09.352 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T13:14:09.698 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:14:09.711 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-03-04T13:14:09.714 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":1873,"stamp":"2024-03-04T13:14:08.571592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":224166809,"num_objects":654,"num_object_clones":0,"num_object_copies":1308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":654,"num_whiteouts":0,"num_read":244903,"num_read_kb":2733632,"num_write":142264,"num_write_kb":2439961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":189631,"num_omap_keys":538,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14212,"ondisk_log_size":14212,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1662440,"kb_used_data":466344,"kb_used_omap":12,"kb_used_meta":1196019,"kb_avail":753312280,"statfs":{"total":773094113280,"available":771391774720,"internally_reserved":0,"allocated":477536256,"data_stored":464436620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1224724018},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27227,"num_omap_keys":90,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004512"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.107131+0000","last_change":"2024-03-04T12:46:22.249796+0000","last_active":"2024-03-04T13:13:27.107131+0000","last_peered":"2024-03-04T13:13:27.107131+0000","last_clean":"2024-03-04T13:13:27.107131+0000","last_became_active":"2024-03-04T12:46:22.248352+0000","last_became_peered":"2024-03-04T12:46:22.248352+0000","last_unstale":"2024-03-04T13:13:27.107131+0000","last_undegraded":"2024-03-04T13:13:27.107131+0000","last_fullsized":"2024-03-04T13:13:27.107131+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.805565+0000","last_change":"2024-03-04T13:13:39.805588+0000","last_active":"2024-03-04T13:13:39.805565+0000","last_peered":"2024-03-04T13:13:39.805565+0000","last_clean":"2024-03-04T13:13:39.805565+0000","last_became_active":"2024-03-04T12:32:46.051177+0000","last_became_peered":"2024-03-04T12:32:46.051177+0000","last_unstale":"2024-03-04T13:13:39.805565+0000","last_undegraded":"2024-03-04T13:13:39.805565+0000","last_fullsized":"2024-03-04T13:13:39.805565+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:39.805434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:39.805434+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.805434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:35:27.485196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"255'2","reported_seq":60,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:55.217571+0000","last_change":"2024-03-04T13:13:55.217598+0000","last_active":"2024-03-04T13:13:55.217571+0000","last_peered":"2024-03-04T13:13:55.217571+0000","last_clean":"2024-03-04T13:13:55.217571+0000","last_became_active":"2024-03-04T12:32:42.034142+0000","last_became_peered":"2024-03-04T12:32:42.034142+0000","last_unstale":"2024-03-04T13:13:55.217571+0000","last_undegraded":"2024-03-04T13:13:55.217571+0000","last_fullsized":"2024-03-04T13:13:55.217571+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:55.217471+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:55.217471+0000","last_clean_scrub_stamp":"2024-03-04T13:13:55.217471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:44:17.364601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"255'17","reported_seq":99,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.898973+0000","last_change":"2024-03-04T13:13:29.899002+0000","last_active":"2024-03-04T13:13:29.898973+0000","last_peered":"2024-03-04T13:13:29.898973+0000","last_clean":"2024-03-04T13:13:29.898973+0000","last_became_active":"2024-03-04T12:29:01.702925+0000","last_became_peered":"2024-03-04T12:29:01.702925+0000","last_unstale":"2024-03-04T13:13:29.898973+0000","last_undegraded":"2024-03-04T13:13:29.898973+0000","last_fullsized":"2024-03-04T13:13:29.898973+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'17","last_scrub_stamp":"2024-03-04T13:13:29.898885+0000","last_deep_scrub":"255'17","last_deep_scrub_stamp":"2024-03-04T13:13:29.898885+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.898885+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:52:30.867951+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":40,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.566069+0000","last_change":"2024-03-04T12:46:22.258654+0000","last_active":"2024-03-04T13:13:27.566069+0000","last_peered":"2024-03-04T13:13:27.566069+0000","last_clean":"2024-03-04T13:13:27.566069+0000","last_became_active":"2024-03-04T12:46:22.258268+0000","last_became_peered":"2024-03-04T12:46:22.258268+0000","last_unstale":"2024-03-04T13:13:27.566069+0000","last_undegraded":"2024-03-04T13:13:27.566069+0000","last_fullsized":"2024-03-04T13:13:27.566069+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"255'12","reported_seq":77,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:48.856999+0000","last_change":"2024-03-04T13:13:48.857030+0000","last_active":"2024-03-04T13:13:48.856999+0000","last_peered":"2024-03-04T13:13:48.856999+0000","last_clean":"2024-03-04T13:13:48.856999+0000","last_became_active":"2024-03-04T12:32:46.051799+0000","last_became_peered":"2024-03-04T12:32:46.051799+0000","last_unstale":"2024-03-04T13:13:48.856999+0000","last_undegraded":"2024-03-04T13:13:48.856999+0000","last_fullsized":"2024-03-04T13:13:48.856999+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'12","last_scrub_stamp":"2024-03-04T13:13:48.856912+0000","last_deep_scrub":"255'12","last_deep_scrub_stamp":"2024-03-04T13:13:48.856912+0000","last_clean_scrub_stamp":"2024-03-04T13:13:48.856912+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:13:22.869733+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":43010,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"255'9","reported_seq":73,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.835628+0000","last_change":"2024-03-04T13:13:38.835666+0000","last_active":"2024-03-04T13:13:38.835628+0000","last_peered":"2024-03-04T13:13:38.835628+0000","last_clean":"2024-03-04T13:13:38.835628+0000","last_became_active":"2024-03-04T12:32:42.037701+0000","last_became_peered":"2024-03-04T12:32:42.037701+0000","last_unstale":"2024-03-04T13:13:38.835628+0000","last_undegraded":"2024-03-04T13:13:38.835628+0000","last_fullsized":"2024-03-04T13:13:38.835628+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'9","last_scrub_stamp":"2024-03-04T13:13:38.835529+0000","last_deep_scrub":"255'9","last_deep_scrub_stamp":"2024-03-04T13:13:38.835529+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.835529+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:14:22.983606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"255'28","reported_seq":128,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.924857+0000","last_change":"2024-03-04T13:13:31.924884+0000","last_active":"2024-03-04T13:13:31.924857+0000","last_peered":"2024-03-04T13:13:31.924857+0000","last_clean":"2024-03-04T13:13:31.924857+0000","last_became_active":"2024-03-04T12:29:01.701003+0000","last_became_peered":"2024-03-04T12:29:01.701003+0000","last_unstale":"2024-03-04T13:13:31.924857+0000","last_undegraded":"2024-03-04T13:13:31.924857+0000","last_fullsized":"2024-03-04T13:13:31.924857+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'28","last_scrub_stamp":"2024-03-04T13:13:31.924756+0000","last_deep_scrub":"255'28","last_deep_scrub_stamp":"2024-03-04T13:13:31.924756+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.924756+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:42:18.274244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":75,"num_write":51,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.467137+0000","last_change":"2024-03-04T12:46:22.308264+0000","last_active":"2024-03-04T13:12:27.467137+0000","last_peered":"2024-03-04T13:12:27.467137+0000","last_clean":"2024-03-04T13:12:27.467137+0000","last_became_active":"2024-03-04T12:46:22.307955+0000","last_became_peered":"2024-03-04T12:46:22.307955+0000","last_unstale":"2024-03-04T13:12:27.467137+0000","last_undegraded":"2024-03-04T13:12:27.467137+0000","last_fullsized":"2024-03-04T13:12:27.467137+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.311738+0000","last_change":"2024-03-04T13:13:45.311794+0000","last_active":"2024-03-04T13:13:45.311738+0000","last_peered":"2024-03-04T13:13:45.311738+0000","last_clean":"2024-03-04T13:13:45.311738+0000","last_became_active":"2024-03-04T12:32:46.053497+0000","last_became_peered":"2024-03-04T12:32:46.053497+0000","last_unstale":"2024-03-04T13:13:45.311738+0000","last_undegraded":"2024-03-04T13:13:45.311738+0000","last_fullsized":"2024-03-04T13:13:45.311738+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:45.311628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:45.311628+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.311628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:03.196481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"255'3","reported_seq":60,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.851594+0000","last_change":"2024-03-04T13:13:40.851637+0000","last_active":"2024-03-04T13:13:40.851594+0000","last_peered":"2024-03-04T13:13:40.851594+0000","last_clean":"2024-03-04T13:13:40.851594+0000","last_became_active":"2024-03-04T12:32:42.036801+0000","last_became_peered":"2024-03-04T12:32:42.036801+0000","last_unstale":"2024-03-04T13:13:40.851594+0000","last_undegraded":"2024-03-04T13:13:40.851594+0000","last_fullsized":"2024-03-04T13:13:40.851594+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'3","last_scrub_stamp":"2024-03-04T13:13:40.851505+0000","last_deep_scrub":"255'3","last_deep_scrub_stamp":"2024-03-04T13:13:40.851505+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.851505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:38.795174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"255'24","reported_seq":118,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.473471+0000","last_change":"2024-03-04T13:13:30.473471+0000","last_active":"2024-03-04T13:13:30.473471+0000","last_peered":"2024-03-04T13:13:30.473471+0000","last_clean":"2024-03-04T13:13:30.473471+0000","last_became_active":"2024-03-04T12:29:01.707589+0000","last_became_peered":"2024-03-04T12:29:01.707589+0000","last_unstale":"2024-03-04T13:13:30.473471+0000","last_undegraded":"2024-03-04T13:13:30.473471+0000","last_fullsized":"2024-03-04T13:13:30.473471+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'24","last_scrub_stamp":"2024-03-04T13:13:30.473283+0000","last_deep_scrub":"255'24","last_deep_scrub_stamp":"2024-03-04T13:13:30.473283+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.473283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:42:05.230338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":71,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260932+0000","last_change":"2024-03-04T12:46:22.310150+0000","last_active":"2024-03-04T13:13:25.260932+0000","last_peered":"2024-03-04T13:13:25.260932+0000","last_clean":"2024-03-04T13:13:25.260932+0000","last_became_active":"2024-03-04T12:46:22.309869+0000","last_became_peered":"2024-03-04T12:46:22.309869+0000","last_unstale":"2024-03-04T13:13:25.260932+0000","last_undegraded":"2024-03-04T13:13:25.260932+0000","last_fullsized":"2024-03-04T13:13:25.260932+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"255'3","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:58.237086+0000","last_change":"2024-03-04T13:13:58.237114+0000","last_active":"2024-03-04T13:13:58.237086+0000","last_peered":"2024-03-04T13:13:58.237086+0000","last_clean":"2024-03-04T13:13:58.237086+0000","last_became_active":"2024-03-04T12:32:46.057603+0000","last_became_peered":"2024-03-04T12:32:46.057603+0000","last_unstale":"2024-03-04T13:13:58.237086+0000","last_undegraded":"2024-03-04T13:13:58.237086+0000","last_fullsized":"2024-03-04T13:13:58.237086+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'3","last_scrub_stamp":"2024-03-04T13:13:58.236990+0000","last_deep_scrub":"255'3","last_deep_scrub_stamp":"2024-03-04T13:13:58.236990+0000","last_clean_scrub_stamp":"2024-03-04T13:13:58.236990+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:46.230979+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"250'3","reported_seq":59,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.892793+0000","last_change":"2024-03-04T13:13:25.892816+0000","last_active":"2024-03-04T13:13:25.892793+0000","last_peered":"2024-03-04T13:13:25.892793+0000","last_clean":"2024-03-04T13:13:25.892793+0000","last_became_active":"2024-03-04T12:32:42.032231+0000","last_became_peered":"2024-03-04T12:32:42.032231+0000","last_unstale":"2024-03-04T13:13:25.892793+0000","last_undegraded":"2024-03-04T13:13:25.892793+0000","last_fullsized":"2024-03-04T13:13:25.892793+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'3","last_scrub_stamp":"2024-03-04T13:13:25.892721+0000","last_deep_scrub":"250'3","last_deep_scrub_stamp":"2024-03-04T13:13:25.892721+0000","last_clean_scrub_stamp":"2024-03-04T13:13:25.892721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:39:35.803550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"255'27","reported_seq":121,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.733570+0000","last_change":"2024-03-04T13:13:29.733570+0000","last_active":"2024-03-04T13:13:29.733570+0000","last_peered":"2024-03-04T13:13:29.733570+0000","last_clean":"2024-03-04T13:13:29.733570+0000","last_became_active":"2024-03-04T12:29:01.704548+0000","last_became_peered":"2024-03-04T12:29:01.704548+0000","last_unstale":"2024-03-04T13:13:29.733570+0000","last_undegraded":"2024-03-04T13:13:29.733570+0000","last_fullsized":"2024-03-04T13:13:29.733570+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'27","last_scrub_stamp":"2024-03-04T13:13:29.733457+0000","last_deep_scrub":"255'27","last_deep_scrub_stamp":"2024-03-04T13:13:29.733457+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.733457+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:59:20.666916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":73,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":36,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:06.917855+0000","last_change":"2024-03-04T13:14:06.917890+0000","last_active":"2024-03-04T13:14:06.917855+0000","last_peered":"2024-03-04T13:14:06.917855+0000","last_clean":"2024-03-04T13:14:06.917855+0000","last_became_active":"2024-03-04T12:46:22.257894+0000","last_became_peered":"2024-03-04T12:46:22.257894+0000","last_unstale":"2024-03-04T13:14:06.917855+0000","last_undegraded":"2024-03-04T13:14:06.917855+0000","last_fullsized":"2024-03-04T13:14:06.917855+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:06.917757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:06.917757+0000","last_clean_scrub_stamp":"2024-03-04T13:14:06.917757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:27:35.242284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":40,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.107053+0000","last_change":"2024-03-04T12:32:46.054248+0000","last_active":"2024-03-04T13:13:27.107053+0000","last_peered":"2024-03-04T13:13:27.107053+0000","last_clean":"2024-03-04T13:13:27.107053+0000","last_became_active":"2024-03-04T12:32:46.053946+0000","last_became_peered":"2024-03-04T12:32:46.053946+0000","last_unstale":"2024-03-04T13:13:27.107053+0000","last_undegraded":"2024-03-04T13:13:27.107053+0000","last_fullsized":"2024-03-04T13:13:27.107053+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"255'12","reported_seq":78,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:01.849192+0000","last_change":"2024-03-04T13:14:01.849224+0000","last_active":"2024-03-04T13:14:01.849192+0000","last_peered":"2024-03-04T13:14:01.849192+0000","last_clean":"2024-03-04T13:14:01.849192+0000","last_became_active":"2024-03-04T12:32:42.037387+0000","last_became_peered":"2024-03-04T12:32:42.037387+0000","last_unstale":"2024-03-04T13:14:01.849192+0000","last_undegraded":"2024-03-04T13:14:01.849192+0000","last_fullsized":"2024-03-04T13:14:01.849192+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'12","last_scrub_stamp":"2024-03-04T13:14:01.849089+0000","last_deep_scrub":"255'12","last_deep_scrub_stamp":"2024-03-04T13:14:01.849089+0000","last_clean_scrub_stamp":"2024-03-04T13:14:01.849089+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:05:00.852885+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":15,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"255'50","reported_seq":172,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.770069+0000","last_change":"2024-03-04T13:13:30.770069+0000","last_active":"2024-03-04T13:13:30.770069+0000","last_peered":"2024-03-04T13:13:30.770069+0000","last_clean":"2024-03-04T13:13:30.770069+0000","last_became_active":"2024-03-04T12:29:01.703815+0000","last_became_peered":"2024-03-04T12:29:01.703815+0000","last_unstale":"2024-03-04T13:13:30.770069+0000","last_undegraded":"2024-03-04T13:13:30.770069+0000","last_fullsized":"2024-03-04T13:13:30.770069+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'50","last_scrub_stamp":"2024-03-04T13:13:30.769938+0000","last_deep_scrub":"255'50","last_deep_scrub_stamp":"2024-03-04T13:13:30.769938+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.769938+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:53:25.528615+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":130,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:02.378675+0000","last_change":"2024-03-04T12:46:22.260813+0000","last_active":"2024-03-04T13:13:02.378675+0000","last_peered":"2024-03-04T13:13:02.378675+0000","last_clean":"2024-03-04T13:13:02.378675+0000","last_became_active":"2024-03-04T12:46:22.260529+0000","last_became_peered":"2024-03-04T12:46:22.260529+0000","last_unstale":"2024-03-04T13:13:02.378675+0000","last_undegraded":"2024-03-04T13:13:02.378675+0000","last_fullsized":"2024-03-04T13:13:02.378675+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"255'5","reported_seq":57,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.789202+0000","last_change":"2024-03-04T13:13:42.789202+0000","last_active":"2024-03-04T13:13:42.789202+0000","last_peered":"2024-03-04T13:13:42.789202+0000","last_clean":"2024-03-04T13:13:42.789202+0000","last_became_active":"2024-03-04T12:32:46.052388+0000","last_became_peered":"2024-03-04T12:32:46.052388+0000","last_unstale":"2024-03-04T13:13:42.789202+0000","last_undegraded":"2024-03-04T13:13:42.789202+0000","last_fullsized":"2024-03-04T13:13:42.789202+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'5","last_scrub_stamp":"2024-03-04T13:13:42.789090+0000","last_deep_scrub":"255'5","last_deep_scrub_stamp":"2024-03-04T13:13:42.789090+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.789090+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:23:38.166737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5160,"num_write":5,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"0'0","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.739807+0000","last_change":"2024-03-04T13:13:28.739826+0000","last_active":"2024-03-04T13:13:28.739807+0000","last_peered":"2024-03-04T13:13:28.739807+0000","last_clean":"2024-03-04T13:13:28.739807+0000","last_became_active":"2024-03-04T12:32:42.030804+0000","last_became_peered":"2024-03-04T12:32:42.030804+0000","last_unstale":"2024-03-04T13:13:28.739807+0000","last_undegraded":"2024-03-04T13:13:28.739807+0000","last_fullsized":"2024-03-04T13:13:28.739807+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:28.739734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:28.739734+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.739734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:08.931360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"255'35","reported_seq":138,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.518670+0000","last_change":"2024-03-04T13:13:33.518670+0000","last_active":"2024-03-04T13:13:33.518670+0000","last_peered":"2024-03-04T13:13:33.518670+0000","last_clean":"2024-03-04T13:13:33.518670+0000","last_became_active":"2024-03-04T12:29:01.703369+0000","last_became_peered":"2024-03-04T12:29:01.703369+0000","last_unstale":"2024-03-04T13:13:33.518670+0000","last_undegraded":"2024-03-04T13:13:33.518670+0000","last_fullsized":"2024-03-04T13:13:33.518670+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'35","last_scrub_stamp":"2024-03-04T13:13:33.518552+0000","last_deep_scrub":"255'35","last_deep_scrub_stamp":"2024-03-04T13:13:33.518552+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.518552+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:11:33.240744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":90,"num_write":62,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.643089+0000","last_change":"2024-03-04T12:46:22.256005+0000","last_active":"2024-03-04T13:13:26.643089+0000","last_peered":"2024-03-04T13:13:26.643089+0000","last_clean":"2024-03-04T13:13:26.643089+0000","last_became_active":"2024-03-04T12:46:22.255588+0000","last_became_peered":"2024-03-04T12:46:22.255588+0000","last_unstale":"2024-03-04T13:13:26.643089+0000","last_undegraded":"2024-03-04T13:13:26.643089+0000","last_fullsized":"2024-03-04T13:13:26.643089+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"255'6","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.042670+0000","last_change":"2024-03-04T12:32:46.057798+0000","last_active":"2024-03-04T13:13:21.042670+0000","last_peered":"2024-03-04T13:13:21.042670+0000","last_clean":"2024-03-04T13:13:21.042670+0000","last_became_active":"2024-03-04T12:32:46.057413+0000","last_became_peered":"2024-03-04T12:32:46.057413+0000","last_unstale":"2024-03-04T13:13:21.042670+0000","last_undegraded":"2024-03-04T13:13:21.042670+0000","last_fullsized":"2024-03-04T13:13:21.042670+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"255'9","reported_seq":67,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.777160+0000","last_change":"2024-03-04T13:13:27.777160+0000","last_active":"2024-03-04T13:13:27.777160+0000","last_peered":"2024-03-04T13:13:27.777160+0000","last_clean":"2024-03-04T13:13:27.777160+0000","last_became_active":"2024-03-04T12:32:42.031099+0000","last_became_peered":"2024-03-04T12:32:42.031099+0000","last_unstale":"2024-03-04T13:13:27.777160+0000","last_undegraded":"2024-03-04T13:13:27.777160+0000","last_fullsized":"2024-03-04T13:13:27.777160+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'9","last_scrub_stamp":"2024-03-04T13:13:27.777060+0000","last_deep_scrub":"255'9","last_deep_scrub_stamp":"2024-03-04T13:13:27.777060+0000","last_clean_scrub_stamp":"2024-03-04T13:13:27.777060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:59:51.492042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"255'41","reported_seq":148,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.792075+0000","last_change":"2024-03-04T13:13:31.792100+0000","last_active":"2024-03-04T13:13:31.792075+0000","last_peered":"2024-03-04T13:13:31.792075+0000","last_clean":"2024-03-04T13:13:31.792075+0000","last_became_active":"2024-03-04T12:29:01.700917+0000","last_became_peered":"2024-03-04T12:29:01.700917+0000","last_unstale":"2024-03-04T13:13:31.792075+0000","last_undegraded":"2024-03-04T13:13:31.792075+0000","last_fullsized":"2024-03-04T13:13:31.792075+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'41","last_scrub_stamp":"2024-03-04T13:13:31.791978+0000","last_deep_scrub":"255'41","last_deep_scrub_stamp":"2024-03-04T13:13:31.791978+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.791978+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:10.471705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":100,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":36,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:04.936827+0000","last_change":"2024-03-04T13:14:04.936866+0000","last_active":"2024-03-04T13:14:04.936827+0000","last_peered":"2024-03-04T13:14:04.936827+0000","last_clean":"2024-03-04T13:14:04.936827+0000","last_became_active":"2024-03-04T12:46:22.255812+0000","last_became_peered":"2024-03-04T12:46:22.255812+0000","last_unstale":"2024-03-04T13:14:04.936827+0000","last_undegraded":"2024-03-04T13:14:04.936827+0000","last_fullsized":"2024-03-04T13:14:04.936827+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:04.936707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:04.936707+0000","last_clean_scrub_stamp":"2024-03-04T13:14:04.936707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:42:02.353506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:47.525088+0000","last_change":"2024-03-04T12:32:46.053933+0000","last_active":"2024-03-04T13:12:47.525088+0000","last_peered":"2024-03-04T13:12:47.525088+0000","last_clean":"2024-03-04T13:12:47.525088+0000","last_became_active":"2024-03-04T12:32:46.053172+0000","last_became_peered":"2024-03-04T12:32:46.053172+0000","last_unstale":"2024-03-04T13:12:47.525088+0000","last_undegraded":"2024-03-04T13:12:47.525088+0000","last_fullsized":"2024-03-04T13:12:47.525088+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"255'5","reported_seq":63,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.864986+0000","last_change":"2024-03-04T13:13:34.864986+0000","last_active":"2024-03-04T13:13:34.864986+0000","last_peered":"2024-03-04T13:13:34.864986+0000","last_clean":"2024-03-04T13:13:34.864986+0000","last_became_active":"2024-03-04T12:32:42.033315+0000","last_became_peered":"2024-03-04T12:32:42.033315+0000","last_unstale":"2024-03-04T13:13:34.864986+0000","last_undegraded":"2024-03-04T13:13:34.864986+0000","last_fullsized":"2024-03-04T13:13:34.864986+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'5","last_scrub_stamp":"2024-03-04T13:13:34.864868+0000","last_deep_scrub":"255'5","last_deep_scrub_stamp":"2024-03-04T13:13:34.864868+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.864868+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:03:00.925083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5136,"num_write":5,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"255'18","reported_seq":105,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.284800+0000","last_change":"2024-03-04T13:13:39.284829+0000","last_active":"2024-03-04T13:13:39.284800+0000","last_peered":"2024-03-04T13:13:39.284800+0000","last_clean":"2024-03-04T13:13:39.284800+0000","last_became_active":"2024-03-04T12:29:01.706695+0000","last_became_peered":"2024-03-04T12:29:01.706695+0000","last_unstale":"2024-03-04T13:13:39.284800+0000","last_undegraded":"2024-03-04T13:13:39.284800+0000","last_fullsized":"2024-03-04T13:13:39.284800+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'18","last_scrub_stamp":"2024-03-04T13:13:39.284703+0000","last_deep_scrub":"255'18","last_deep_scrub_stamp":"2024-03-04T13:13:39.284703+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.284703+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:36:15.492735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":54,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"252'1","reported_seq":26,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:37.461823+0000","last_change":"2024-03-04T12:46:51.979336+0000","last_active":"2024-03-04T13:12:37.461823+0000","last_peered":"2024-03-04T13:12:37.461823+0000","last_clean":"2024-03-04T13:12:37.461823+0000","last_became_active":"2024-03-04T12:46:51.977076+0000","last_became_peered":"2024-03-04T12:46:51.977076+0000","last_unstale":"2024-03-04T13:12:37.461823+0000","last_undegraded":"2024-03-04T13:12:37.461823+0000","last_fullsized":"2024-03-04T13:12:37.461823+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.563187+0000","last_change":"2024-03-04T13:13:47.563187+0000","last_active":"2024-03-04T13:13:47.563187+0000","last_peered":"2024-03-04T13:13:47.563187+0000","last_clean":"2024-03-04T13:13:47.563187+0000","last_became_active":"2024-03-04T12:32:46.055692+0000","last_became_peered":"2024-03-04T12:32:46.055692+0000","last_unstale":"2024-03-04T13:13:47.563187+0000","last_undegraded":"2024-03-04T13:13:47.563187+0000","last_fullsized":"2024-03-04T13:13:47.563187+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:47.563064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:47.563064+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.563064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:02:50.613812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.729125+0000","last_change":"2024-03-04T13:13:26.729125+0000","last_active":"2024-03-04T13:13:26.729125+0000","last_peered":"2024-03-04T13:13:26.729125+0000","last_clean":"2024-03-04T13:13:26.729125+0000","last_became_active":"2024-03-04T12:32:42.029940+0000","last_became_peered":"2024-03-04T12:32:42.029940+0000","last_unstale":"2024-03-04T13:13:26.729125+0000","last_undegraded":"2024-03-04T13:13:26.729125+0000","last_fullsized":"2024-03-04T13:13:26.729125+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:26.729003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:26.729003+0000","last_clean_scrub_stamp":"2024-03-04T13:13:26.729003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:20.396814+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"255'31","reported_seq":127,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.750911+0000","last_change":"2024-03-04T13:13:35.750956+0000","last_active":"2024-03-04T13:13:35.750911+0000","last_peered":"2024-03-04T13:13:35.750911+0000","last_clean":"2024-03-04T13:13:35.750911+0000","last_became_active":"2024-03-04T12:29:01.701379+0000","last_became_peered":"2024-03-04T12:29:01.701379+0000","last_unstale":"2024-03-04T13:13:35.750911+0000","last_undegraded":"2024-03-04T13:13:35.750911+0000","last_fullsized":"2024-03-04T13:13:35.750911+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'31","last_scrub_stamp":"2024-03-04T13:13:35.750794+0000","last_deep_scrub":"255'31","last_deep_scrub_stamp":"2024-03-04T13:13:35.750794+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.750794+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:08:34.744668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":79,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.470218+0000","last_change":"2024-03-04T12:46:22.309007+0000","last_active":"2024-03-04T13:12:57.470218+0000","last_peered":"2024-03-04T13:12:57.470218+0000","last_clean":"2024-03-04T13:12:57.470218+0000","last_became_active":"2024-03-04T12:46:22.308714+0000","last_became_peered":"2024-03-04T12:46:22.308714+0000","last_unstale":"2024-03-04T13:12:57.470218+0000","last_undegraded":"2024-03-04T13:12:57.470218+0000","last_fullsized":"2024-03-04T13:12:57.470218+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"255'6","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.108765+0000","last_change":"2024-03-04T12:32:46.052223+0000","last_active":"2024-03-04T13:13:21.108765+0000","last_peered":"2024-03-04T13:13:21.108765+0000","last_clean":"2024-03-04T13:13:21.108765+0000","last_became_active":"2024-03-04T12:32:46.051926+0000","last_became_peered":"2024-03-04T12:32:46.051926+0000","last_unstale":"2024-03-04T13:13:21.108765+0000","last_undegraded":"2024-03-04T13:13:21.108765+0000","last_fullsized":"2024-03-04T13:13:21.108765+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.896414+0000","last_change":"2024-03-04T13:13:26.896414+0000","last_active":"2024-03-04T13:13:26.896414+0000","last_peered":"2024-03-04T13:13:26.896414+0000","last_clean":"2024-03-04T13:13:26.896414+0000","last_became_active":"2024-03-04T12:32:42.034301+0000","last_became_peered":"2024-03-04T12:32:42.034301+0000","last_unstale":"2024-03-04T13:13:26.896414+0000","last_undegraded":"2024-03-04T13:13:26.896414+0000","last_fullsized":"2024-03-04T13:13:26.896414+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:26.896317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:26.896317+0000","last_clean_scrub_stamp":"2024-03-04T13:13:26.896317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:03.628863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"255'133","reported_seq":435,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.767287+0000","last_change":"2024-03-04T13:13:32.767316+0000","last_active":"2024-03-04T13:13:32.767287+0000","last_peered":"2024-03-04T13:13:32.767287+0000","last_clean":"2024-03-04T13:13:32.767287+0000","last_became_active":"2024-03-04T12:29:01.703239+0000","last_became_peered":"2024-03-04T12:29:01.703239+0000","last_unstale":"2024-03-04T13:13:32.767287+0000","last_undegraded":"2024-03-04T13:13:32.767287+0000","last_fullsized":"2024-03-04T13:13:32.767287+0000","mapping_epoch":242,"log_start":"255'100","ondisk_log_start":"255'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'133","last_scrub_stamp":"2024-03-04T13:13:32.767201+0000","last_deep_scrub":"255'133","last_deep_scrub_stamp":"2024-03-04T13:13:32.767201+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.767201+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:40:30.355080+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":704,"num_read_kb":496,"num_write":192,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1980,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.526999+0000","last_change":"2024-03-04T12:46:22.259911+0000","last_active":"2024-03-04T13:12:57.526999+0000","last_peered":"2024-03-04T13:12:57.526999+0000","last_clean":"2024-03-04T13:12:57.526999+0000","last_became_active":"2024-03-04T12:46:22.259424+0000","last_became_peered":"2024-03-04T12:46:22.259424+0000","last_unstale":"2024-03-04T13:12:57.526999+0000","last_undegraded":"2024-03-04T13:12:57.526999+0000","last_fullsized":"2024-03-04T13:12:57.526999+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"250'5","reported_seq":55,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260885+0000","last_change":"2024-03-04T12:32:46.057250+0000","last_active":"2024-03-04T13:13:25.260885+0000","last_peered":"2024-03-04T13:13:25.260885+0000","last_clean":"2024-03-04T13:13:25.260885+0000","last_became_active":"2024-03-04T12:32:46.056976+0000","last_became_peered":"2024-03-04T12:32:46.056976+0000","last_unstale":"2024-03-04T13:13:25.260885+0000","last_undegraded":"2024-03-04T13:13:25.260885+0000","last_fullsized":"2024-03-04T13:13:25.260885+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.491085+0000","last_change":"2024-03-04T13:13:35.491108+0000","last_active":"2024-03-04T13:13:35.491085+0000","last_peered":"2024-03-04T13:13:35.491085+0000","last_clean":"2024-03-04T13:13:35.491085+0000","last_became_active":"2024-03-04T12:32:42.036694+0000","last_became_peered":"2024-03-04T12:32:42.036694+0000","last_unstale":"2024-03-04T13:13:35.491085+0000","last_undegraded":"2024-03-04T13:13:35.491085+0000","last_fullsized":"2024-03-04T13:13:35.491085+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:35.490995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:35.490995+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.490995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:33:18.682539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"255'13","reported_seq":86,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:53.204322+0000","last_change":"2024-03-04T13:13:53.204348+0000","last_active":"2024-03-04T13:13:53.204322+0000","last_peered":"2024-03-04T13:13:53.204322+0000","last_clean":"2024-03-04T13:13:53.204322+0000","last_became_active":"2024-03-04T12:29:01.706467+0000","last_became_peered":"2024-03-04T12:29:01.706467+0000","last_unstale":"2024-03-04T13:13:53.204322+0000","last_undegraded":"2024-03-04T13:13:53.204322+0000","last_fullsized":"2024-03-04T13:13:53.204322+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'13","last_scrub_stamp":"2024-03-04T13:13:53.204227+0000","last_deep_scrub":"255'13","last_deep_scrub_stamp":"2024-03-04T13:13:53.204227+0000","last_clean_scrub_stamp":"2024-03-04T13:13:53.204227+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:40.622295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:57.470245+0000","last_change":"2024-03-04T12:46:22.311206+0000","last_active":"2024-03-04T13:12:57.470245+0000","last_peered":"2024-03-04T13:12:57.470245+0000","last_clean":"2024-03-04T13:12:57.470245+0000","last_became_active":"2024-03-04T12:46:22.310952+0000","last_became_peered":"2024-03-04T12:46:22.310952+0000","last_unstale":"2024-03-04T13:12:57.470245+0000","last_undegraded":"2024-03-04T13:12:57.470245+0000","last_fullsized":"2024-03-04T13:12:57.470245+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"250'3","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:57.266789+0000","last_change":"2024-03-04T13:13:57.266831+0000","last_active":"2024-03-04T13:13:57.266789+0000","last_peered":"2024-03-04T13:13:57.266789+0000","last_clean":"2024-03-04T13:13:57.266789+0000","last_became_active":"2024-03-04T12:32:46.054752+0000","last_became_peered":"2024-03-04T12:32:46.054752+0000","last_unstale":"2024-03-04T13:13:57.266789+0000","last_undegraded":"2024-03-04T13:13:57.266789+0000","last_fullsized":"2024-03-04T13:13:57.266789+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'3","last_scrub_stamp":"2024-03-04T13:13:57.266670+0000","last_deep_scrub":"250'3","last_deep_scrub_stamp":"2024-03-04T13:13:57.266670+0000","last_clean_scrub_stamp":"2024-03-04T13:13:57.266670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:05:38.259571+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"255'2","reported_seq":58,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:54.216915+0000","last_change":"2024-03-04T13:13:54.216958+0000","last_active":"2024-03-04T13:13:54.216915+0000","last_peered":"2024-03-04T13:13:54.216915+0000","last_clean":"2024-03-04T13:13:54.216915+0000","last_became_active":"2024-03-04T12:32:42.033898+0000","last_became_peered":"2024-03-04T12:32:42.033898+0000","last_unstale":"2024-03-04T13:13:54.216915+0000","last_undegraded":"2024-03-04T13:13:54.216915+0000","last_fullsized":"2024-03-04T13:13:54.216915+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:54.216795+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:54.216795+0000","last_clean_scrub_stamp":"2024-03-04T13:13:54.216795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:36.222661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"255'43","reported_seq":157,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.763641+0000","last_change":"2024-03-04T13:13:28.763662+0000","last_active":"2024-03-04T13:13:28.763641+0000","last_peered":"2024-03-04T13:13:28.763641+0000","last_clean":"2024-03-04T13:13:28.763641+0000","last_became_active":"2024-03-04T12:29:01.705183+0000","last_became_peered":"2024-03-04T12:29:01.705183+0000","last_unstale":"2024-03-04T13:13:28.763641+0000","last_undegraded":"2024-03-04T13:13:28.763641+0000","last_fullsized":"2024-03-04T13:13:28.763641+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'43","last_scrub_stamp":"2024-03-04T13:13:28.763573+0000","last_deep_scrub":"255'43","last_deep_scrub_stamp":"2024-03-04T13:13:28.763573+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.763573+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:05:44.132843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":113,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:02.554403+0000","last_change":"2024-03-04T12:46:22.246381+0000","last_active":"2024-03-04T13:12:02.554403+0000","last_peered":"2024-03-04T13:12:02.554403+0000","last_clean":"2024-03-04T13:12:02.554403+0000","last_became_active":"2024-03-04T12:46:22.245967+0000","last_became_peered":"2024-03-04T12:46:22.245967+0000","last_unstale":"2024-03-04T13:12:02.554403+0000","last_undegraded":"2024-03-04T13:12:02.554403+0000","last_fullsized":"2024-03-04T13:12:02.554403+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.837625+0000","last_change":"2024-03-04T13:13:44.837667+0000","last_active":"2024-03-04T13:13:44.837625+0000","last_peered":"2024-03-04T13:13:44.837625+0000","last_clean":"2024-03-04T13:13:44.837625+0000","last_became_active":"2024-03-04T12:32:46.051360+0000","last_became_peered":"2024-03-04T12:32:46.051360+0000","last_unstale":"2024-03-04T13:13:44.837625+0000","last_undegraded":"2024-03-04T13:13:44.837625+0000","last_fullsized":"2024-03-04T13:13:44.837625+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:44.837523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:44.837523+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.837523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:16:12.218508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.885950+0000","last_change":"2024-03-04T13:13:28.885984+0000","last_active":"2024-03-04T13:13:28.885950+0000","last_peered":"2024-03-04T13:13:28.885950+0000","last_clean":"2024-03-04T13:13:28.885950+0000","last_became_active":"2024-03-04T12:32:42.029559+0000","last_became_peered":"2024-03-04T12:32:42.029559+0000","last_unstale":"2024-03-04T13:13:28.885950+0000","last_undegraded":"2024-03-04T13:13:28.885950+0000","last_fullsized":"2024-03-04T13:13:28.885950+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:28.885848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:28.885848+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.885848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:11.309661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"250'28","reported_seq":125,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.108278+0000","last_change":"2024-03-04T13:13:27.108303+0000","last_active":"2024-03-04T13:13:27.108278+0000","last_peered":"2024-03-04T13:13:27.108278+0000","last_clean":"2024-03-04T13:13:27.108278+0000","last_became_active":"2024-03-04T12:29:01.705726+0000","last_became_peered":"2024-03-04T12:29:01.705726+0000","last_unstale":"2024-03-04T13:13:27.108278+0000","last_undegraded":"2024-03-04T13:13:27.108278+0000","last_fullsized":"2024-03-04T13:13:27.108278+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'28","last_scrub_stamp":"2024-03-04T13:13:27.108190+0000","last_deep_scrub":"250'28","last_deep_scrub_stamp":"2024-03-04T13:13:27.108190+0000","last_clean_scrub_stamp":"2024-03-04T13:13:27.108190+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:54:20.406412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":49,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":28,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:02.554435+0000","last_change":"2024-03-04T12:46:22.259972+0000","last_active":"2024-03-04T13:12:02.554435+0000","last_peered":"2024-03-04T13:12:02.554435+0000","last_clean":"2024-03-04T13:12:02.554435+0000","last_became_active":"2024-03-04T12:46:22.259134+0000","last_became_peered":"2024-03-04T12:46:22.259134+0000","last_unstale":"2024-03-04T13:12:02.554435+0000","last_undegraded":"2024-03-04T13:12:02.554435+0000","last_fullsized":"2024-03-04T13:12:02.554435+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.245109+0000","last_change":"2024-03-04T13:13:41.245131+0000","last_active":"2024-03-04T13:13:41.245109+0000","last_peered":"2024-03-04T13:13:41.245109+0000","last_clean":"2024-03-04T13:13:41.245109+0000","last_became_active":"2024-03-04T12:32:46.053156+0000","last_became_peered":"2024-03-04T12:32:46.053156+0000","last_unstale":"2024-03-04T13:13:41.245109+0000","last_undegraded":"2024-03-04T13:13:41.245109+0000","last_fullsized":"2024-03-04T13:13:41.245109+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:41.245016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:41.245016+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.245016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:45.065185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"255'11","reported_seq":79,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.531852+0000","last_change":"2024-03-04T13:13:31.531887+0000","last_active":"2024-03-04T13:13:31.531852+0000","last_peered":"2024-03-04T13:13:31.531852+0000","last_clean":"2024-03-04T13:13:31.531852+0000","last_became_active":"2024-03-04T12:32:42.036617+0000","last_became_peered":"2024-03-04T12:32:42.036617+0000","last_unstale":"2024-03-04T13:13:31.531852+0000","last_undegraded":"2024-03-04T13:13:31.531852+0000","last_fullsized":"2024-03-04T13:13:31.531852+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'11","last_scrub_stamp":"2024-03-04T13:13:31.531774+0000","last_deep_scrub":"255'11","last_deep_scrub_stamp":"2024-03-04T13:13:31.531774+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.531774+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:53:09.775484+0000","scrub_duration":64,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":29698,"num_write":14,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"255'17","reported_seq":103,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.199388+0000","last_change":"2024-03-04T13:13:31.199414+0000","last_active":"2024-03-04T13:13:31.199388+0000","last_peered":"2024-03-04T13:13:31.199388+0000","last_clean":"2024-03-04T13:13:31.199388+0000","last_became_active":"2024-03-04T12:29:01.701712+0000","last_became_peered":"2024-03-04T12:29:01.701712+0000","last_unstale":"2024-03-04T13:13:31.199388+0000","last_undegraded":"2024-03-04T13:13:31.199388+0000","last_fullsized":"2024-03-04T13:13:31.199388+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'17","last_scrub_stamp":"2024-03-04T13:13:31.199260+0000","last_deep_scrub":"255'17","last_deep_scrub_stamp":"2024-03-04T13:13:31.199260+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.199260+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:34:49.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":51,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":36,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:05.902965+0000","last_change":"2024-03-04T13:14:05.902986+0000","last_active":"2024-03-04T13:14:05.902965+0000","last_peered":"2024-03-04T13:14:05.902965+0000","last_clean":"2024-03-04T13:14:05.902965+0000","last_became_active":"2024-03-04T12:46:22.256617+0000","last_became_peered":"2024-03-04T12:46:22.256617+0000","last_unstale":"2024-03-04T13:14:05.902965+0000","last_undegraded":"2024-03-04T13:14:05.902965+0000","last_fullsized":"2024-03-04T13:14:05.902965+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:05.902873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:05.902873+0000","last_clean_scrub_stamp":"2024-03-04T13:14:05.902873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:47:41.637069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":40,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.373556+0000","last_change":"2024-03-04T12:32:46.053973+0000","last_active":"2024-03-04T13:12:27.373556+0000","last_peered":"2024-03-04T13:12:27.373556+0000","last_clean":"2024-03-04T13:12:27.373556+0000","last_became_active":"2024-03-04T12:32:46.053272+0000","last_became_peered":"2024-03-04T12:32:46.053272+0000","last_unstale":"2024-03-04T13:12:27.373556+0000","last_undegraded":"2024-03-04T13:12:27.373556+0000","last_fullsized":"2024-03-04T13:12:27.373556+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.811500+0000","last_change":"2024-03-04T13:13:36.811535+0000","last_active":"2024-03-04T13:13:36.811500+0000","last_peered":"2024-03-04T13:13:36.811500+0000","last_clean":"2024-03-04T13:13:36.811500+0000","last_became_active":"2024-03-04T12:32:42.035923+0000","last_became_peered":"2024-03-04T12:32:42.035923+0000","last_unstale":"2024-03-04T13:13:36.811500+0000","last_undegraded":"2024-03-04T13:13:36.811500+0000","last_fullsized":"2024-03-04T13:13:36.811500+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:36.811383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:36.811383+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.811383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:30.024857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"255'34","reported_seq":140,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.066169+0000","last_change":"2024-03-04T13:13:28.066241+0000","last_active":"2024-03-04T13:13:28.066169+0000","last_peered":"2024-03-04T13:13:28.066169+0000","last_clean":"2024-03-04T13:13:28.066169+0000","last_became_active":"2024-03-04T12:29:01.702327+0000","last_became_peered":"2024-03-04T12:29:01.702327+0000","last_unstale":"2024-03-04T13:13:28.066169+0000","last_undegraded":"2024-03-04T13:13:28.066169+0000","last_fullsized":"2024-03-04T13:13:28.066169+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'34","last_scrub_stamp":"2024-03-04T13:13:28.066051+0000","last_deep_scrub":"255'34","last_deep_scrub_stamp":"2024-03-04T13:13:28.066051+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.066051+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:49:40.472474+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"252'1","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:02.464260+0000","last_change":"2024-03-04T12:46:22.258104+0000","last_active":"2024-03-04T13:12:02.464260+0000","last_peered":"2024-03-04T13:12:02.464260+0000","last_clean":"2024-03-04T13:12:02.464260+0000","last_became_active":"2024-03-04T12:46:22.257651+0000","last_became_peered":"2024-03-04T12:46:22.257651+0000","last_unstale":"2024-03-04T13:12:02.464260+0000","last_undegraded":"2024-03-04T13:12:02.464260+0000","last_fullsized":"2024-03-04T13:12:02.464260+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"255'8","reported_seq":68,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:02.886255+0000","last_change":"2024-03-04T13:14:02.886299+0000","last_active":"2024-03-04T13:14:02.886255+0000","last_peered":"2024-03-04T13:14:02.886255+0000","last_clean":"2024-03-04T13:14:02.886255+0000","last_became_active":"2024-03-04T12:32:46.049512+0000","last_became_peered":"2024-03-04T12:32:46.049512+0000","last_unstale":"2024-03-04T13:14:02.886255+0000","last_undegraded":"2024-03-04T13:14:02.886255+0000","last_fullsized":"2024-03-04T13:14:02.886255+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'8","last_scrub_stamp":"2024-03-04T13:14:02.886163+0000","last_deep_scrub":"255'8","last_deep_scrub_stamp":"2024-03-04T13:14:02.886163+0000","last_clean_scrub_stamp":"2024-03-04T13:14:02.886163+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:49:05.625242+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":11,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.176706+0000","last_change":"2024-03-04T13:13:33.176739+0000","last_active":"2024-03-04T13:13:33.176706+0000","last_peered":"2024-03-04T13:13:33.176706+0000","last_clean":"2024-03-04T13:13:33.176706+0000","last_became_active":"2024-03-04T12:32:42.032034+0000","last_became_peered":"2024-03-04T12:32:42.032034+0000","last_unstale":"2024-03-04T13:13:33.176706+0000","last_undegraded":"2024-03-04T13:13:33.176706+0000","last_fullsized":"2024-03-04T13:13:33.176706+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:33.176621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:33.176621+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.176621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:55:03.666432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"255'51","reported_seq":179,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.787605+0000","last_change":"2024-03-04T13:13:29.787646+0000","last_active":"2024-03-04T13:13:29.787605+0000","last_peered":"2024-03-04T13:13:29.787605+0000","last_clean":"2024-03-04T13:13:29.787605+0000","last_became_active":"2024-03-04T12:29:01.703361+0000","last_became_peered":"2024-03-04T12:29:01.703361+0000","last_unstale":"2024-03-04T13:13:29.787605+0000","last_undegraded":"2024-03-04T13:13:29.787605+0000","last_fullsized":"2024-03-04T13:13:29.787605+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'51","last_scrub_stamp":"2024-03-04T13:13:29.787500+0000","last_deep_scrub":"255'51","last_deep_scrub_stamp":"2024-03-04T13:13:29.787500+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.787500+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:39:42.421288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":146,"num_write":83,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"255'2","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:52.887557+0000","last_change":"2024-03-04T13:13:52.887584+0000","last_active":"2024-03-04T13:13:52.887557+0000","last_peered":"2024-03-04T13:13:52.887557+0000","last_clean":"2024-03-04T13:13:52.887557+0000","last_became_active":"2024-03-04T12:46:22.255498+0000","last_became_peered":"2024-03-04T12:46:22.255498+0000","last_unstale":"2024-03-04T13:13:52.887557+0000","last_undegraded":"2024-03-04T13:13:52.887557+0000","last_fullsized":"2024-03-04T13:13:52.887557+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:52.887467+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:52.887467+0000","last_clean_scrub_stamp":"2024-03-04T13:13:52.887467+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:26.340731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"255'2","reported_seq":52,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:00.267407+0000","last_change":"2024-03-04T13:14:00.267451+0000","last_active":"2024-03-04T13:14:00.267407+0000","last_peered":"2024-03-04T13:14:00.267407+0000","last_clean":"2024-03-04T13:14:00.267407+0000","last_became_active":"2024-03-04T12:32:46.058792+0000","last_became_peered":"2024-03-04T12:32:46.058792+0000","last_unstale":"2024-03-04T13:14:00.267407+0000","last_undegraded":"2024-03-04T13:14:00.267407+0000","last_fullsized":"2024-03-04T13:14:00.267407+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:14:00.267292+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:14:00.267292+0000","last_clean_scrub_stamp":"2024-03-04T13:14:00.267292+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:42:02.031538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:12.380133+0000","last_change":"2024-03-04T12:32:42.036922+0000","last_active":"2024-03-04T13:13:12.380133+0000","last_peered":"2024-03-04T13:13:12.380133+0000","last_clean":"2024-03-04T13:13:12.380133+0000","last_became_active":"2024-03-04T12:32:42.036427+0000","last_became_peered":"2024-03-04T12:32:42.036427+0000","last_unstale":"2024-03-04T13:13:12.380133+0000","last_undegraded":"2024-03-04T13:13:12.380133+0000","last_fullsized":"2024-03-04T13:13:12.380133+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:41.007127+0000","last_clean_scrub_stamp":"2024-03-04T12:32:41.007127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"255'56","reported_seq":186,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.313213+0000","last_change":"2024-03-04T13:13:35.313241+0000","last_active":"2024-03-04T13:13:35.313213+0000","last_peered":"2024-03-04T13:13:35.313213+0000","last_clean":"2024-03-04T13:13:35.313213+0000","last_became_active":"2024-03-04T12:29:01.706666+0000","last_became_peered":"2024-03-04T12:29:01.706666+0000","last_unstale":"2024-03-04T13:13:35.313213+0000","last_undegraded":"2024-03-04T13:13:35.313213+0000","last_fullsized":"2024-03-04T13:13:35.313213+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'56","last_scrub_stamp":"2024-03-04T13:13:35.313119+0000","last_deep_scrub":"255'56","last_deep_scrub_stamp":"2024-03-04T13:13:35.313119+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.313119+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:15.053239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":151,"num_write":99,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:22.473163+0000","last_change":"2024-03-04T12:46:22.257205+0000","last_active":"2024-03-04T13:13:22.473163+0000","last_peered":"2024-03-04T13:13:22.473163+0000","last_clean":"2024-03-04T13:13:22.473163+0000","last_became_active":"2024-03-04T12:46:22.256882+0000","last_became_peered":"2024-03-04T12:46:22.256882+0000","last_unstale":"2024-03-04T13:13:22.473163+0000","last_undegraded":"2024-03-04T13:13:22.473163+0000","last_fullsized":"2024-03-04T13:13:22.473163+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":41,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:17.530473+0000","last_change":"2024-03-04T12:32:46.057344+0000","last_active":"2024-03-04T13:13:17.530473+0000","last_peered":"2024-03-04T13:13:17.530473+0000","last_clean":"2024-03-04T13:13:17.530473+0000","last_became_active":"2024-03-04T12:32:46.057079+0000","last_became_peered":"2024-03-04T12:32:46.057079+0000","last_unstale":"2024-03-04T13:13:17.530473+0000","last_undegraded":"2024-03-04T13:13:17.530473+0000","last_fullsized":"2024-03-04T13:13:17.530473+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"255'9","reported_seq":76,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.775902+0000","last_change":"2024-03-04T13:13:32.775942+0000","last_active":"2024-03-04T13:13:32.775902+0000","last_peered":"2024-03-04T13:13:32.775902+0000","last_clean":"2024-03-04T13:13:32.775902+0000","last_became_active":"2024-03-04T12:32:42.035488+0000","last_became_peered":"2024-03-04T12:32:42.035488+0000","last_unstale":"2024-03-04T13:13:32.775902+0000","last_undegraded":"2024-03-04T13:13:32.775902+0000","last_fullsized":"2024-03-04T13:13:32.775902+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'9","last_scrub_stamp":"2024-03-04T13:13:32.775792+0000","last_deep_scrub":"255'9","last_deep_scrub_stamp":"2024-03-04T13:13:32.775792+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.775792+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:35.718837+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"255'14","reported_seq":89,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.816478+0000","last_change":"2024-03-04T13:13:31.816478+0000","last_active":"2024-03-04T13:13:31.816478+0000","last_peered":"2024-03-04T13:13:31.816478+0000","last_clean":"2024-03-04T13:13:31.816478+0000","last_became_active":"2024-03-04T12:29:01.706786+0000","last_became_peered":"2024-03-04T12:29:01.706786+0000","last_unstale":"2024-03-04T13:13:31.816478+0000","last_undegraded":"2024-03-04T13:13:31.816478+0000","last_fullsized":"2024-03-04T13:13:31.816478+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'14","last_scrub_stamp":"2024-03-04T13:13:31.816328+0000","last_deep_scrub":"255'14","last_deep_scrub_stamp":"2024-03-04T13:13:31.816328+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.816328+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:21.050894+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:22.473176+0000","last_change":"2024-03-04T12:46:22.259694+0000","last_active":"2024-03-04T13:13:22.473176+0000","last_peered":"2024-03-04T13:13:22.473176+0000","last_clean":"2024-03-04T13:13:22.473176+0000","last_became_active":"2024-03-04T12:46:22.259400+0000","last_became_peered":"2024-03-04T12:46:22.259400+0000","last_unstale":"2024-03-04T13:13:22.473176+0000","last_undegraded":"2024-03-04T13:13:22.473176+0000","last_fullsized":"2024-03-04T13:13:22.473176+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.770248+0000","last_change":"2024-03-04T13:13:35.770271+0000","last_active":"2024-03-04T13:13:35.770248+0000","last_peered":"2024-03-04T13:13:35.770248+0000","last_clean":"2024-03-04T13:13:35.770248+0000","last_became_active":"2024-03-04T12:32:46.051318+0000","last_became_peered":"2024-03-04T12:32:46.051318+0000","last_unstale":"2024-03-04T13:13:35.770248+0000","last_undegraded":"2024-03-04T13:13:35.770248+0000","last_fullsized":"2024-03-04T13:13:35.770248+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:35.770135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:35.770135+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.770135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:17:37.665435+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"255'10","reported_seq":72,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:56.216958+0000","last_change":"2024-03-04T13:13:56.216984+0000","last_active":"2024-03-04T13:13:56.216958+0000","last_peered":"2024-03-04T13:13:56.216958+0000","last_clean":"2024-03-04T13:13:56.216958+0000","last_became_active":"2024-03-04T12:32:42.035743+0000","last_became_peered":"2024-03-04T12:32:42.035743+0000","last_unstale":"2024-03-04T13:13:56.216958+0000","last_undegraded":"2024-03-04T13:13:56.216958+0000","last_fullsized":"2024-03-04T13:13:56.216958+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'10","last_scrub_stamp":"2024-03-04T13:13:56.216859+0000","last_deep_scrub":"255'10","last_deep_scrub_stamp":"2024-03-04T13:13:56.216859+0000","last_clean_scrub_stamp":"2024-03-04T13:13:56.216859+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:42:29.665183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9243,"num_write":20,"num_write_kb":10267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"255'55","reported_seq":197,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.080264+0000","last_change":"2024-03-04T13:13:30.080264+0000","last_active":"2024-03-04T13:13:30.080264+0000","last_peered":"2024-03-04T13:13:30.080264+0000","last_clean":"2024-03-04T13:13:30.080264+0000","last_became_active":"2024-03-04T12:29:01.700933+0000","last_became_peered":"2024-03-04T12:29:01.700933+0000","last_unstale":"2024-03-04T13:13:30.080264+0000","last_undegraded":"2024-03-04T13:13:30.080264+0000","last_fullsized":"2024-03-04T13:13:30.080264+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'55","last_scrub_stamp":"2024-03-04T13:13:30.080152+0000","last_deep_scrub":"255'55","last_deep_scrub_stamp":"2024-03-04T13:13:30.080152+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.080152+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:28.190583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":175,"num_write":86,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.720228+0000","last_change":"2024-03-04T12:46:22.310324+0000","last_active":"2024-03-04T13:13:25.720228+0000","last_peered":"2024-03-04T13:13:25.720228+0000","last_clean":"2024-03-04T13:13:25.720228+0000","last_became_active":"2024-03-04T12:46:22.310043+0000","last_became_peered":"2024-03-04T12:46:22.310043+0000","last_unstale":"2024-03-04T13:13:25.720228+0000","last_undegraded":"2024-03-04T13:13:25.720228+0000","last_fullsized":"2024-03-04T13:13:25.720228+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"250'3","reported_seq":55,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:50.743561+0000","last_change":"2024-03-04T13:13:50.743585+0000","last_active":"2024-03-04T13:13:50.743561+0000","last_peered":"2024-03-04T13:13:50.743561+0000","last_clean":"2024-03-04T13:13:50.743561+0000","last_became_active":"2024-03-04T12:32:46.056687+0000","last_became_peered":"2024-03-04T12:32:46.056687+0000","last_unstale":"2024-03-04T13:13:50.743561+0000","last_undegraded":"2024-03-04T13:13:50.743561+0000","last_fullsized":"2024-03-04T13:13:50.743561+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'3","last_scrub_stamp":"2024-03-04T13:13:50.743472+0000","last_deep_scrub":"250'3","last_deep_scrub_stamp":"2024-03-04T13:13:50.743472+0000","last_clean_scrub_stamp":"2024-03-04T13:13:50.743472+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:59.306946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"0'0","reported_seq":55,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.767425+0000","last_change":"2024-03-04T13:13:34.767455+0000","last_active":"2024-03-04T13:13:34.767425+0000","last_peered":"2024-03-04T13:13:34.767425+0000","last_clean":"2024-03-04T13:13:34.767425+0000","last_became_active":"2024-03-04T12:32:42.036690+0000","last_became_peered":"2024-03-04T12:32:42.036690+0000","last_unstale":"2024-03-04T13:13:34.767425+0000","last_undegraded":"2024-03-04T13:13:34.767425+0000","last_fullsized":"2024-03-04T13:13:34.767425+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:34.767317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:34.767317+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.767317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:34:06.921023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"0'0","reported_seq":63,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.253014+0000","last_change":"2024-03-04T13:13:29.253014+0000","last_active":"2024-03-04T13:13:29.253014+0000","last_peered":"2024-03-04T13:13:29.253014+0000","last_clean":"2024-03-04T13:13:29.253014+0000","last_became_active":"2024-03-04T12:29:01.700739+0000","last_became_peered":"2024-03-04T12:29:01.700739+0000","last_unstale":"2024-03-04T13:13:29.253014+0000","last_undegraded":"2024-03-04T13:13:29.253014+0000","last_fullsized":"2024-03-04T13:13:29.253014+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:29.252878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:29.252878+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.252878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:30:12.777518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520317+0000","last_change":"2024-03-04T12:46:22.308562+0000","last_active":"2024-03-04T13:12:22.520317+0000","last_peered":"2024-03-04T13:12:22.520317+0000","last_clean":"2024-03-04T13:12:22.520317+0000","last_became_active":"2024-03-04T12:46:22.308300+0000","last_became_peered":"2024-03-04T12:46:22.308300+0000","last_unstale":"2024-03-04T13:12:22.520317+0000","last_undegraded":"2024-03-04T13:12:22.520317+0000","last_fullsized":"2024-03-04T13:12:22.520317+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:06.621245+0000","last_change":"2024-03-04T13:14:06.621286+0000","last_active":"2024-03-04T13:14:06.621245+0000","last_peered":"2024-03-04T13:14:06.621245+0000","last_clean":"2024-03-04T13:14:06.621245+0000","last_became_active":"2024-03-04T12:32:46.051614+0000","last_became_peered":"2024-03-04T12:32:46.051614+0000","last_unstale":"2024-03-04T13:14:06.621245+0000","last_undegraded":"2024-03-04T13:14:06.621245+0000","last_fullsized":"2024-03-04T13:14:06.621245+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:06.621117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:06.621117+0000","last_clean_scrub_stamp":"2024-03-04T13:14:06.621117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:55:56.045859+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.505223+0000","last_change":"2024-03-04T13:13:29.505223+0000","last_active":"2024-03-04T13:13:29.505223+0000","last_peered":"2024-03-04T13:13:29.505223+0000","last_clean":"2024-03-04T13:13:29.505223+0000","last_became_active":"2024-03-04T12:32:42.033182+0000","last_became_peered":"2024-03-04T12:32:42.033182+0000","last_unstale":"2024-03-04T13:13:29.505223+0000","last_undegraded":"2024-03-04T13:13:29.505223+0000","last_fullsized":"2024-03-04T13:13:29.505223+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:29.505109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:29.505109+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.505109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:37.494586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"250'41","reported_seq":170,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.746795+0000","last_change":"2024-03-04T13:13:26.746795+0000","last_active":"2024-03-04T13:13:26.746795+0000","last_peered":"2024-03-04T13:13:26.746795+0000","last_clean":"2024-03-04T13:13:26.746795+0000","last_became_active":"2024-03-04T12:29:01.708876+0000","last_became_peered":"2024-03-04T12:29:01.708876+0000","last_unstale":"2024-03-04T13:13:26.746795+0000","last_undegraded":"2024-03-04T13:13:26.746795+0000","last_fullsized":"2024-03-04T13:13:26.746795+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'41","last_scrub_stamp":"2024-03-04T13:13:26.746633+0000","last_deep_scrub":"250'41","last_deep_scrub_stamp":"2024-03-04T13:13:26.746633+0000","last_clean_scrub_stamp":"2024-03-04T13:13:26.746633+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:14:28.512234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":148,"num_write":55,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520332+0000","last_change":"2024-03-04T12:46:22.256922+0000","last_active":"2024-03-04T13:12:22.520332+0000","last_peered":"2024-03-04T13:12:22.520332+0000","last_clean":"2024-03-04T13:12:22.520332+0000","last_became_active":"2024-03-04T12:46:22.256617+0000","last_became_peered":"2024-03-04T12:46:22.256617+0000","last_unstale":"2024-03-04T13:12:22.520332+0000","last_undegraded":"2024-03-04T13:12:22.520332+0000","last_fullsized":"2024-03-04T13:12:22.520332+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"250'2","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.801296+0000","last_change":"2024-03-04T13:13:46.801296+0000","last_active":"2024-03-04T13:13:46.801296+0000","last_peered":"2024-03-04T13:13:46.801296+0000","last_clean":"2024-03-04T13:13:46.801296+0000","last_became_active":"2024-03-04T12:32:46.055321+0000","last_became_peered":"2024-03-04T12:32:46.055321+0000","last_unstale":"2024-03-04T13:13:46.801296+0000","last_undegraded":"2024-03-04T13:13:46.801296+0000","last_fullsized":"2024-03-04T13:13:46.801296+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:13:46.801181+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:13:46.801181+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.801181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:43:20.617758+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"255'6","reported_seq":67,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.927444+0000","last_change":"2024-03-04T13:13:27.927469+0000","last_active":"2024-03-04T13:13:27.927444+0000","last_peered":"2024-03-04T13:13:27.927444+0000","last_clean":"2024-03-04T13:13:27.927444+0000","last_became_active":"2024-03-04T12:32:42.030512+0000","last_became_peered":"2024-03-04T12:32:42.030512+0000","last_unstale":"2024-03-04T13:13:27.927444+0000","last_undegraded":"2024-03-04T13:13:27.927444+0000","last_fullsized":"2024-03-04T13:13:27.927444+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'6","last_scrub_stamp":"2024-03-04T13:13:27.927372+0000","last_deep_scrub":"255'6","last_deep_scrub_stamp":"2024-03-04T13:13:27.927372+0000","last_clean_scrub_stamp":"2024-03-04T13:13:27.927372+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:53:49.518778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"255'57","reported_seq":197,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.162485+0000","last_change":"2024-03-04T13:13:39.162517+0000","last_active":"2024-03-04T13:13:39.162485+0000","last_peered":"2024-03-04T13:13:39.162485+0000","last_clean":"2024-03-04T13:13:39.162485+0000","last_became_active":"2024-03-04T12:29:01.699507+0000","last_became_peered":"2024-03-04T12:29:01.699507+0000","last_unstale":"2024-03-04T13:13:39.162485+0000","last_undegraded":"2024-03-04T13:13:39.162485+0000","last_fullsized":"2024-03-04T13:13:39.162485+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'57","last_scrub_stamp":"2024-03-04T13:13:39.162388+0000","last_deep_scrub":"255'57","last_deep_scrub_stamp":"2024-03-04T13:13:39.162388+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.162388+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:01:36.647719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":165,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.521393+0000","last_change":"2024-03-04T12:46:22.256492+0000","last_active":"2024-03-04T13:12:27.521393+0000","last_peered":"2024-03-04T13:12:27.521393+0000","last_clean":"2024-03-04T13:12:27.521393+0000","last_became_active":"2024-03-04T12:46:22.256181+0000","last_became_peered":"2024-03-04T12:46:22.256181+0000","last_unstale":"2024-03-04T13:12:27.521393+0000","last_undegraded":"2024-03-04T13:12:27.521393+0000","last_fullsized":"2024-03-04T13:12:27.521393+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"255'9","reported_seq":66,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.191585+0000","last_change":"2024-03-04T13:13:37.191619+0000","last_active":"2024-03-04T13:13:37.191585+0000","last_peered":"2024-03-04T13:13:37.191585+0000","last_clean":"2024-03-04T13:13:37.191585+0000","last_became_active":"2024-03-04T12:32:46.045552+0000","last_became_peered":"2024-03-04T12:32:46.045552+0000","last_unstale":"2024-03-04T13:13:37.191585+0000","last_undegraded":"2024-03-04T13:13:37.191585+0000","last_fullsized":"2024-03-04T13:13:37.191585+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'9","last_scrub_stamp":"2024-03-04T13:13:37.191494+0000","last_deep_scrub":"255'9","last_deep_scrub_stamp":"2024-03-04T13:13:37.191494+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.191494+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:08:46.570487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.830161+0000","last_change":"2024-03-04T13:13:30.830161+0000","last_active":"2024-03-04T13:13:30.830161+0000","last_peered":"2024-03-04T13:13:30.830161+0000","last_clean":"2024-03-04T13:13:30.830161+0000","last_became_active":"2024-03-04T12:32:42.035436+0000","last_became_peered":"2024-03-04T12:32:42.035436+0000","last_unstale":"2024-03-04T13:13:30.830161+0000","last_undegraded":"2024-03-04T13:13:30.830161+0000","last_fullsized":"2024-03-04T13:13:30.830161+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:30.830047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:30.830047+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.830047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:02.886091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"255'54","reported_seq":188,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.199311+0000","last_change":"2024-03-04T13:13:43.199357+0000","last_active":"2024-03-04T13:13:43.199311+0000","last_peered":"2024-03-04T13:13:43.199311+0000","last_clean":"2024-03-04T13:13:43.199311+0000","last_became_active":"2024-03-04T12:29:01.704434+0000","last_became_peered":"2024-03-04T12:29:01.704434+0000","last_unstale":"2024-03-04T13:13:43.199311+0000","last_undegraded":"2024-03-04T13:13:43.199311+0000","last_fullsized":"2024-03-04T13:13:43.199311+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'54","last_scrub_stamp":"2024-03-04T13:13:43.199179+0000","last_deep_scrub":"255'54","last_deep_scrub_stamp":"2024-03-04T13:13:43.199179+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.199179+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:20:54.600164+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":154,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:22.563281+0000","last_change":"2024-03-04T12:46:22.257771+0000","last_active":"2024-03-04T13:13:22.563281+0000","last_peered":"2024-03-04T13:13:22.563281+0000","last_clean":"2024-03-04T13:13:22.563281+0000","last_became_active":"2024-03-04T12:46:22.257495+0000","last_became_peered":"2024-03-04T12:46:22.257495+0000","last_unstale":"2024-03-04T13:13:22.563281+0000","last_undegraded":"2024-03-04T13:13:22.563281+0000","last_fullsized":"2024-03-04T13:13:22.563281+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"255'3","reported_seq":45,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260792+0000","last_change":"2024-03-04T12:32:46.057285+0000","last_active":"2024-03-04T13:13:25.260792+0000","last_peered":"2024-03-04T13:13:25.260792+0000","last_clean":"2024-03-04T13:13:25.260792+0000","last_became_active":"2024-03-04T12:32:46.056737+0000","last_became_peered":"2024-03-04T12:32:46.056737+0000","last_unstale":"2024-03-04T13:13:25.260792+0000","last_undegraded":"2024-03-04T13:13:25.260792+0000","last_fullsized":"2024-03-04T13:13:25.260792+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.747846+0000","last_change":"2024-03-04T13:13:27.747846+0000","last_active":"2024-03-04T13:13:27.747846+0000","last_peered":"2024-03-04T13:13:27.747846+0000","last_clean":"2024-03-04T13:13:27.747846+0000","last_became_active":"2024-03-04T12:32:42.029043+0000","last_became_peered":"2024-03-04T12:32:42.029043+0000","last_unstale":"2024-03-04T13:13:27.747846+0000","last_undegraded":"2024-03-04T13:13:27.747846+0000","last_fullsized":"2024-03-04T13:13:27.747846+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:27.747738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:27.747738+0000","last_clean_scrub_stamp":"2024-03-04T13:13:27.747738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:17.877875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"255'45","reported_seq":165,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.781282+0000","last_change":"2024-03-04T13:13:33.781309+0000","last_active":"2024-03-04T13:13:33.781282+0000","last_peered":"2024-03-04T13:13:33.781282+0000","last_clean":"2024-03-04T13:13:33.781282+0000","last_became_active":"2024-03-04T12:29:01.702146+0000","last_became_peered":"2024-03-04T12:29:01.702146+0000","last_unstale":"2024-03-04T13:13:33.781282+0000","last_undegraded":"2024-03-04T13:13:33.781282+0000","last_fullsized":"2024-03-04T13:13:33.781282+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'45","last_scrub_stamp":"2024-03-04T13:13:33.781174+0000","last_deep_scrub":"255'45","last_deep_scrub_stamp":"2024-03-04T13:13:33.781174+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.781174+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:38:34.888433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":123,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260776+0000","last_change":"2024-03-04T12:46:22.311207+0000","last_active":"2024-03-04T13:13:25.260776+0000","last_peered":"2024-03-04T13:13:25.260776+0000","last_clean":"2024-03-04T13:13:25.260776+0000","last_became_active":"2024-03-04T12:46:22.310830+0000","last_became_peered":"2024-03-04T12:46:22.310830+0000","last_unstale":"2024-03-04T13:13:25.260776+0000","last_undegraded":"2024-03-04T13:13:25.260776+0000","last_fullsized":"2024-03-04T13:13:25.260776+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"255'2","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:59.267934+0000","last_change":"2024-03-04T13:13:59.267963+0000","last_active":"2024-03-04T13:13:59.267934+0000","last_peered":"2024-03-04T13:13:59.267934+0000","last_clean":"2024-03-04T13:13:59.267934+0000","last_became_active":"2024-03-04T12:32:46.058306+0000","last_became_peered":"2024-03-04T12:32:46.058306+0000","last_unstale":"2024-03-04T13:13:59.267934+0000","last_undegraded":"2024-03-04T13:13:59.267934+0000","last_fullsized":"2024-03-04T13:13:59.267934+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:59.267827+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:59.267827+0000","last_clean_scrub_stamp":"2024-03-04T13:13:59.267827+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:55:47.610685+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"255'5","reported_seq":64,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.863975+0000","last_change":"2024-03-04T13:13:29.863975+0000","last_active":"2024-03-04T13:13:29.863975+0000","last_peered":"2024-03-04T13:13:29.863975+0000","last_clean":"2024-03-04T13:13:29.863975+0000","last_became_active":"2024-03-04T12:32:42.035302+0000","last_became_peered":"2024-03-04T12:32:42.035302+0000","last_unstale":"2024-03-04T13:13:29.863975+0000","last_undegraded":"2024-03-04T13:13:29.863975+0000","last_fullsized":"2024-03-04T13:13:29.863975+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'5","last_scrub_stamp":"2024-03-04T13:13:29.863854+0000","last_deep_scrub":"255'5","last_deep_scrub_stamp":"2024-03-04T13:13:29.863854+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.863854+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:10.906006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6192,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"255'41","reported_seq":163,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.083220+0000","last_change":"2024-03-04T13:13:28.083241+0000","last_active":"2024-03-04T13:13:28.083220+0000","last_peered":"2024-03-04T13:13:28.083220+0000","last_clean":"2024-03-04T13:13:28.083220+0000","last_became_active":"2024-03-04T12:29:01.706897+0000","last_became_peered":"2024-03-04T12:29:01.706897+0000","last_unstale":"2024-03-04T13:13:28.083220+0000","last_undegraded":"2024-03-04T13:13:28.083220+0000","last_fullsized":"2024-03-04T13:13:28.083220+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'41","last_scrub_stamp":"2024-03-04T13:13:28.083138+0000","last_deep_scrub":"255'41","last_deep_scrub_stamp":"2024-03-04T13:13:28.083138+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.083138+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:30:37.038323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":127,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260802+0000","last_change":"2024-03-04T12:46:22.253306+0000","last_active":"2024-03-04T13:13:25.260802+0000","last_peered":"2024-03-04T13:13:25.260802+0000","last_clean":"2024-03-04T13:13:25.260802+0000","last_became_active":"2024-03-04T12:46:22.252955+0000","last_became_peered":"2024-03-04T12:46:22.252955+0000","last_unstale":"2024-03-04T13:13:25.260802+0000","last_undegraded":"2024-03-04T13:13:25.260802+0000","last_fullsized":"2024-03-04T13:13:25.260802+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"255'11","reported_seq":64,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.190173+0000","last_change":"2024-03-04T12:32:46.056590+0000","last_active":"2024-03-04T13:13:21.190173+0000","last_peered":"2024-03-04T13:13:21.190173+0000","last_clean":"2024-03-04T13:13:21.190173+0000","last_became_active":"2024-03-04T12:32:46.056219+0000","last_became_peered":"2024-03-04T12:32:46.056219+0000","last_unstale":"2024-03-04T13:13:21.190173+0000","last_undegraded":"2024-03-04T13:13:21.190173+0000","last_fullsized":"2024-03-04T13:13:21.190173+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25600,"num_write":16,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"255'8","reported_seq":70,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.917141+0000","last_change":"2024-03-04T13:13:30.917141+0000","last_active":"2024-03-04T13:13:30.917141+0000","last_peered":"2024-03-04T13:13:30.917141+0000","last_clean":"2024-03-04T13:13:30.917141+0000","last_became_active":"2024-03-04T12:32:42.034556+0000","last_became_peered":"2024-03-04T12:32:42.034556+0000","last_unstale":"2024-03-04T13:13:30.917141+0000","last_undegraded":"2024-03-04T13:13:30.917141+0000","last_fullsized":"2024-03-04T13:13:30.917141+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'8","last_scrub_stamp":"2024-03-04T13:13:30.917008+0000","last_deep_scrub":"255'8","last_deep_scrub_stamp":"2024-03-04T13:13:30.917008+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.917008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:17:52.807115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12328,"num_write":8,"num_write_kb":12328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"255'42","reported_seq":156,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.515404+0000","last_change":"2024-03-04T13:13:32.515429+0000","last_active":"2024-03-04T13:13:32.515404+0000","last_peered":"2024-03-04T13:13:32.515404+0000","last_clean":"2024-03-04T13:13:32.515404+0000","last_became_active":"2024-03-04T12:29:01.706549+0000","last_became_peered":"2024-03-04T12:29:01.706549+0000","last_unstale":"2024-03-04T13:13:32.515404+0000","last_undegraded":"2024-03-04T13:13:32.515404+0000","last_fullsized":"2024-03-04T13:13:32.515404+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'42","last_scrub_stamp":"2024-03-04T13:13:32.515310+0000","last_deep_scrub":"255'42","last_deep_scrub_stamp":"2024-03-04T13:13:32.515310+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.515310+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:31:52.043625+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":111,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"252'1","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520532+0000","last_change":"2024-03-04T12:46:22.254600+0000","last_active":"2024-03-04T13:12:22.520532+0000","last_peered":"2024-03-04T13:12:22.520532+0000","last_clean":"2024-03-04T13:12:22.520532+0000","last_became_active":"2024-03-04T12:46:22.254303+0000","last_became_peered":"2024-03-04T12:46:22.254303+0000","last_unstale":"2024-03-04T13:12:22.520532+0000","last_undegraded":"2024-03-04T13:12:22.520532+0000","last_fullsized":"2024-03-04T13:12:22.520532+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"255'3","reported_seq":55,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.518434+0000","last_change":"2024-03-04T13:13:43.518434+0000","last_active":"2024-03-04T13:13:43.518434+0000","last_peered":"2024-03-04T13:13:43.518434+0000","last_clean":"2024-03-04T13:13:43.518434+0000","last_became_active":"2024-03-04T12:32:46.055497+0000","last_became_peered":"2024-03-04T12:32:46.055497+0000","last_unstale":"2024-03-04T13:13:43.518434+0000","last_undegraded":"2024-03-04T13:13:43.518434+0000","last_fullsized":"2024-03-04T13:13:43.518434+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'3","last_scrub_stamp":"2024-03-04T13:13:43.518316+0000","last_deep_scrub":"255'3","last_deep_scrub_stamp":"2024-03-04T13:13:43.518316+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.518316+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:54.864627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.807236+0000","last_change":"2024-03-04T13:13:31.807264+0000","last_active":"2024-03-04T13:13:31.807236+0000","last_peered":"2024-03-04T13:13:31.807236+0000","last_clean":"2024-03-04T13:13:31.807236+0000","last_became_active":"2024-03-04T12:32:42.036150+0000","last_became_peered":"2024-03-04T12:32:42.036150+0000","last_unstale":"2024-03-04T13:13:31.807236+0000","last_undegraded":"2024-03-04T13:13:31.807236+0000","last_fullsized":"2024-03-04T13:13:31.807236+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:31.807148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:31.807148+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.807148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:09:22.042627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"255'69","reported_seq":280,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.236382+0000","last_change":"2024-03-04T13:13:30.236412+0000","last_active":"2024-03-04T13:13:30.236382+0000","last_peered":"2024-03-04T13:13:30.236382+0000","last_clean":"2024-03-04T13:13:30.236382+0000","last_became_active":"2024-03-04T12:29:01.700624+0000","last_became_peered":"2024-03-04T12:29:01.700624+0000","last_unstale":"2024-03-04T13:13:30.236382+0000","last_undegraded":"2024-03-04T13:13:30.236382+0000","last_fullsized":"2024-03-04T13:13:30.236382+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'69","last_scrub_stamp":"2024-03-04T13:13:30.236288+0000","last_deep_scrub":"255'69","last_deep_scrub_stamp":"2024-03-04T13:13:30.236288+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.236288+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:06:29.427575+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":295,"num_write":88,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4990,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":29,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520574+0000","last_change":"2024-03-04T12:46:22.309757+0000","last_active":"2024-03-04T13:12:22.520574+0000","last_peered":"2024-03-04T13:12:22.520574+0000","last_clean":"2024-03-04T13:12:22.520574+0000","last_became_active":"2024-03-04T12:46:22.309493+0000","last_became_peered":"2024-03-04T12:46:22.309493+0000","last_unstale":"2024-03-04T13:12:22.520574+0000","last_undegraded":"2024-03-04T13:12:22.520574+0000","last_fullsized":"2024-03-04T13:12:22.520574+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"255'10","reported_seq":63,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.565997+0000","last_change":"2024-03-04T12:32:46.054533+0000","last_active":"2024-03-04T13:13:27.565997+0000","last_peered":"2024-03-04T13:13:27.565997+0000","last_clean":"2024-03-04T13:13:27.565997+0000","last_became_active":"2024-03-04T12:32:46.054256+0000","last_became_peered":"2024-03-04T12:32:46.054256+0000","last_unstale":"2024-03-04T13:13:27.565997+0000","last_undegraded":"2024-03-04T13:13:27.565997+0000","last_fullsized":"2024-03-04T13:13:27.565997+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":16480,"num_write":15,"num_write_kb":11320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"0'0","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.517623+0000","last_change":"2024-03-04T13:13:28.517646+0000","last_active":"2024-03-04T13:13:28.517623+0000","last_peered":"2024-03-04T13:13:28.517623+0000","last_clean":"2024-03-04T13:13:28.517623+0000","last_became_active":"2024-03-04T12:32:42.035683+0000","last_became_peered":"2024-03-04T12:32:42.035683+0000","last_unstale":"2024-03-04T13:13:28.517623+0000","last_undegraded":"2024-03-04T13:13:28.517623+0000","last_fullsized":"2024-03-04T13:13:28.517623+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:28.517514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:28.517514+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.517514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:09.797649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"255'43","reported_seq":153,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.519890+0000","last_change":"2024-03-04T13:13:34.519938+0000","last_active":"2024-03-04T13:13:34.519890+0000","last_peered":"2024-03-04T13:13:34.519890+0000","last_clean":"2024-03-04T13:13:34.519890+0000","last_became_active":"2024-03-04T12:29:01.701396+0000","last_became_peered":"2024-03-04T12:29:01.701396+0000","last_unstale":"2024-03-04T13:13:34.519890+0000","last_undegraded":"2024-03-04T13:13:34.519890+0000","last_fullsized":"2024-03-04T13:13:34.519890+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'43","last_scrub_stamp":"2024-03-04T13:13:34.519764+0000","last_deep_scrub":"255'43","last_deep_scrub_stamp":"2024-03-04T13:13:34.519764+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.519764+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:54:01.761324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:27.373460+0000","last_change":"2024-03-04T12:46:22.260088+0000","last_active":"2024-03-04T13:12:27.373460+0000","last_peered":"2024-03-04T13:12:27.373460+0000","last_clean":"2024-03-04T13:12:27.373460+0000","last_became_active":"2024-03-04T12:46:22.259763+0000","last_became_peered":"2024-03-04T12:46:22.259763+0000","last_unstale":"2024-03-04T13:12:27.373460+0000","last_undegraded":"2024-03-04T13:12:27.373460+0000","last_fullsized":"2024-03-04T13:12:27.373460+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"255'5","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.116773+0000","last_change":"2024-03-04T12:32:46.057881+0000","last_active":"2024-03-04T13:13:21.116773+0000","last_peered":"2024-03-04T13:13:21.116773+0000","last_clean":"2024-03-04T13:13:21.116773+0000","last_became_active":"2024-03-04T12:32:46.057646+0000","last_became_peered":"2024-03-04T12:32:46.057646+0000","last_unstale":"2024-03-04T13:13:21.116773+0000","last_undegraded":"2024-03-04T13:13:21.116773+0000","last_fullsized":"2024-03-04T13:13:21.116773+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5168,"num_write":5,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"255'2","reported_seq":59,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.052595+0000","last_change":"2024-03-04T13:13:29.052620+0000","last_active":"2024-03-04T13:13:29.052595+0000","last_peered":"2024-03-04T13:13:29.052595+0000","last_clean":"2024-03-04T13:13:29.052595+0000","last_became_active":"2024-03-04T12:32:42.026771+0000","last_became_peered":"2024-03-04T12:32:42.026771+0000","last_unstale":"2024-03-04T13:13:29.052595+0000","last_undegraded":"2024-03-04T13:13:29.052595+0000","last_fullsized":"2024-03-04T13:13:29.052595+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:29.052506+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:29.052506+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.052506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:13:31.731989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"255'43","reported_seq":162,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.820896+0000","last_change":"2024-03-04T13:13:30.820942+0000","last_active":"2024-03-04T13:13:30.820896+0000","last_peered":"2024-03-04T13:13:30.820896+0000","last_clean":"2024-03-04T13:13:30.820896+0000","last_became_active":"2024-03-04T12:29:01.701812+0000","last_became_peered":"2024-03-04T12:29:01.701812+0000","last_unstale":"2024-03-04T13:13:30.820896+0000","last_undegraded":"2024-03-04T13:13:30.820896+0000","last_fullsized":"2024-03-04T13:13:30.820896+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'43","last_scrub_stamp":"2024-03-04T13:13:30.820770+0000","last_deep_scrub":"255'43","last_deep_scrub_stamp":"2024-03-04T13:13:30.820770+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.820770+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:32:52.795812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":121,"num_write":82,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.720178+0000","last_change":"2024-03-04T12:46:22.247949+0000","last_active":"2024-03-04T13:13:25.720178+0000","last_peered":"2024-03-04T13:13:25.720178+0000","last_clean":"2024-03-04T13:13:25.720178+0000","last_became_active":"2024-03-04T12:46:22.247655+0000","last_became_peered":"2024-03-04T12:46:22.247655+0000","last_unstale":"2024-03-04T13:13:25.720178+0000","last_undegraded":"2024-03-04T13:13:25.720178+0000","last_fullsized":"2024-03-04T13:13:25.720178+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"255'3","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.190891+0000","last_change":"2024-03-04T12:32:46.058700+0000","last_active":"2024-03-04T13:13:21.190891+0000","last_peered":"2024-03-04T13:13:21.190891+0000","last_clean":"2024-03-04T13:13:21.190891+0000","last_became_active":"2024-03-04T12:32:46.058466+0000","last_became_peered":"2024-03-04T12:32:46.058466+0000","last_unstale":"2024-03-04T13:13:21.190891+0000","last_undegraded":"2024-03-04T13:13:21.190891+0000","last_fullsized":"2024-03-04T13:13:21.190891+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.391641+0000","last_change":"2024-03-04T13:13:43.391685+0000","last_active":"2024-03-04T13:13:43.391641+0000","last_peered":"2024-03-04T13:13:43.391641+0000","last_clean":"2024-03-04T13:13:43.391641+0000","last_became_active":"2024-03-04T12:32:42.031410+0000","last_became_peered":"2024-03-04T12:32:42.031410+0000","last_unstale":"2024-03-04T13:13:43.391641+0000","last_undegraded":"2024-03-04T13:13:43.391641+0000","last_fullsized":"2024-03-04T13:13:43.391641+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:43.391527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:43.391527+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.391527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:32.117760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"255'27","reported_seq":124,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.781758+0000","last_change":"2024-03-04T13:13:32.781830+0000","last_active":"2024-03-04T13:13:32.781758+0000","last_peered":"2024-03-04T13:13:32.781758+0000","last_clean":"2024-03-04T13:13:32.781758+0000","last_became_active":"2024-03-04T12:29:01.703420+0000","last_became_peered":"2024-03-04T12:29:01.703420+0000","last_unstale":"2024-03-04T13:13:32.781758+0000","last_undegraded":"2024-03-04T13:13:32.781758+0000","last_fullsized":"2024-03-04T13:13:32.781758+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'27","last_scrub_stamp":"2024-03-04T13:13:32.781646+0000","last_deep_scrub":"255'27","last_deep_scrub_stamp":"2024-03-04T13:13:32.781646+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.781646+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:01.556499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":74,"num_write":42,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.107102+0000","last_change":"2024-03-04T12:46:22.250162+0000","last_active":"2024-03-04T13:13:27.107102+0000","last_peered":"2024-03-04T13:13:27.107102+0000","last_clean":"2024-03-04T13:13:27.107102+0000","last_became_active":"2024-03-04T12:46:22.249854+0000","last_became_peered":"2024-03-04T12:46:22.249854+0000","last_unstale":"2024-03-04T13:13:27.107102+0000","last_undegraded":"2024-03-04T13:13:27.107102+0000","last_fullsized":"2024-03-04T13:13:27.107102+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:03.918174+0000","last_change":"2024-03-04T13:14:03.918200+0000","last_active":"2024-03-04T13:14:03.918174+0000","last_peered":"2024-03-04T13:14:03.918174+0000","last_clean":"2024-03-04T13:14:03.918174+0000","last_became_active":"2024-03-04T12:32:46.051498+0000","last_became_peered":"2024-03-04T12:32:46.051498+0000","last_unstale":"2024-03-04T13:14:03.918174+0000","last_undegraded":"2024-03-04T13:14:03.918174+0000","last_fullsized":"2024-03-04T13:14:03.918174+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:03.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:03.918083+0000","last_clean_scrub_stamp":"2024-03-04T13:14:03.918083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:39:20.277289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"255'6","reported_seq":70,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.493334+0000","last_change":"2024-03-04T13:13:39.493363+0000","last_active":"2024-03-04T13:13:39.493334+0000","last_peered":"2024-03-04T13:13:39.493334+0000","last_clean":"2024-03-04T13:13:39.493334+0000","last_became_active":"2024-03-04T12:32:42.038349+0000","last_became_peered":"2024-03-04T12:32:42.038349+0000","last_unstale":"2024-03-04T13:13:39.493334+0000","last_undegraded":"2024-03-04T13:13:39.493334+0000","last_fullsized":"2024-03-04T13:13:39.493334+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'6","last_scrub_stamp":"2024-03-04T13:13:39.493239+0000","last_deep_scrub":"255'6","last_deep_scrub_stamp":"2024-03-04T13:13:39.493239+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.493239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:37:54.785538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"255'90","reported_seq":267,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.211860+0000","last_change":"2024-03-04T13:13:28.211887+0000","last_active":"2024-03-04T13:13:28.211860+0000","last_peered":"2024-03-04T13:13:28.211860+0000","last_clean":"2024-03-04T13:13:28.211860+0000","last_became_active":"2024-03-04T12:29:01.701282+0000","last_became_peered":"2024-03-04T12:29:01.701282+0000","last_unstale":"2024-03-04T13:13:28.211860+0000","last_undegraded":"2024-03-04T13:13:28.211860+0000","last_fullsized":"2024-03-04T13:13:28.211860+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'90","last_scrub_stamp":"2024-03-04T13:13:28.211770+0000","last_deep_scrub":"255'90","last_deep_scrub_stamp":"2024-03-04T13:13:28.211770+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.211770+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:24:35.609835+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":354,"num_read_kb":252,"num_write":156,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":30,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.380221+0000","last_change":"2024-03-04T12:46:22.259364+0000","last_active":"2024-03-04T13:13:27.380221+0000","last_peered":"2024-03-04T13:13:27.380221+0000","last_clean":"2024-03-04T13:13:27.380221+0000","last_became_active":"2024-03-04T12:46:22.258936+0000","last_became_peered":"2024-03-04T12:46:22.258936+0000","last_unstale":"2024-03-04T13:13:27.380221+0000","last_undegraded":"2024-03-04T13:13:27.380221+0000","last_fullsized":"2024-03-04T13:13:27.380221+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:46:21.235247+0000","last_clean_scrub_stamp":"2024-03-04T12:46:21.235247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":42,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.556615+0000","last_change":"2024-03-04T12:32:46.053786+0000","last_active":"2024-03-04T13:12:22.556615+0000","last_peered":"2024-03-04T13:12:22.556615+0000","last_clean":"2024-03-04T13:12:22.556615+0000","last_became_active":"2024-03-04T12:32:46.053456+0000","last_became_peered":"2024-03-04T12:32:46.053456+0000","last_unstale":"2024-03-04T13:12:22.556615+0000","last_undegraded":"2024-03-04T13:12:22.556615+0000","last_fullsized":"2024-03-04T13:12:22.556615+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:32:45.032463+0000","last_clean_scrub_stamp":"2024-03-04T12:32:45.032463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"0'0","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.872782+0000","last_change":"2024-03-04T13:13:28.872826+0000","last_active":"2024-03-04T13:13:28.872782+0000","last_peered":"2024-03-04T13:13:28.872782+0000","last_clean":"2024-03-04T13:13:28.872782+0000","last_became_active":"2024-03-04T12:32:42.035413+0000","last_became_peered":"2024-03-04T12:32:42.035413+0000","last_unstale":"2024-03-04T13:13:28.872782+0000","last_undegraded":"2024-03-04T13:13:28.872782+0000","last_fullsized":"2024-03-04T13:13:28.872782+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:28.872647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:28.872647+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.872647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:54:46.886474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"255'17","reported_seq":103,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.134636+0000","last_change":"2024-03-04T13:13:41.134664+0000","last_active":"2024-03-04T13:13:41.134636+0000","last_peered":"2024-03-04T13:13:41.134636+0000","last_clean":"2024-03-04T13:13:41.134636+0000","last_became_active":"2024-03-04T12:29:01.702555+0000","last_became_peered":"2024-03-04T12:29:01.702555+0000","last_unstale":"2024-03-04T13:13:41.134636+0000","last_undegraded":"2024-03-04T13:13:41.134636+0000","last_fullsized":"2024-03-04T13:13:41.134636+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'17","last_scrub_stamp":"2024-03-04T13:13:41.134538+0000","last_deep_scrub":"255'17","last_deep_scrub_stamp":"2024-03-04T13:13:41.134538+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.134538+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:28.139595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":47,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"255'180","reported_seq":793,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:56.668512+0000","last_change":"2024-03-04T13:13:56.668570+0000","last_active":"2024-03-04T13:13:56.668512+0000","last_peered":"2024-03-04T13:13:56.668512+0000","last_clean":"2024-03-04T13:13:56.668512+0000","last_became_active":"2024-03-04T12:20:14.820595+0000","last_became_peered":"2024-03-04T12:20:14.820595+0000","last_unstale":"2024-03-04T13:13:56.668512+0000","last_undegraded":"2024-03-04T13:13:56.668512+0000","last_fullsized":"2024-03-04T13:13:56.668512+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'180","last_scrub_stamp":"2024-03-04T13:13:56.668423+0000","last_deep_scrub":"255'180","last_deep_scrub_stamp":"2024-03-04T13:13:56.668423+0000","last_clean_scrub_stamp":"2024-03-04T13:13:56.668423+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:13:06.956800+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":457,"num_write":1012,"num_write_kb":11218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"255'478","reported_seq":1790,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:50.353917+0000","last_change":"2024-03-04T13:13:50.353962+0000","last_active":"2024-03-04T13:13:50.353917+0000","last_peered":"2024-03-04T13:13:50.353917+0000","last_clean":"2024-03-04T13:13:50.353917+0000","last_became_active":"2024-03-04T12:20:16.828539+0000","last_became_peered":"2024-03-04T12:20:16.828539+0000","last_unstale":"2024-03-04T13:13:50.353917+0000","last_undegraded":"2024-03-04T13:13:50.353917+0000","last_fullsized":"2024-03-04T13:13:50.353917+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'478","last_scrub_stamp":"2024-03-04T13:13:50.353824+0000","last_deep_scrub":"255'478","last_deep_scrub_stamp":"2024-03-04T13:13:50.353824+0000","last_clean_scrub_stamp":"2024-03-04T13:13:50.353824+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:54.826761+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2301,"num_read_kb":2121,"num_write":643,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"255'227","reported_seq":886,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:02.616629+0000","last_change":"2024-03-04T13:14:02.616677+0000","last_active":"2024-03-04T13:14:02.616629+0000","last_peered":"2024-03-04T13:14:02.616629+0000","last_clean":"2024-03-04T13:14:02.616629+0000","last_became_active":"2024-03-04T12:20:14.814863+0000","last_became_peered":"2024-03-04T12:20:14.814863+0000","last_unstale":"2024-03-04T13:14:02.616629+0000","last_undegraded":"2024-03-04T13:14:02.616629+0000","last_fullsized":"2024-03-04T13:14:02.616629+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'227","last_scrub_stamp":"2024-03-04T13:14:02.616534+0000","last_deep_scrub":"255'227","last_deep_scrub_stamp":"2024-03-04T13:14:02.616534+0000","last_clean_scrub_stamp":"2024-03-04T13:14:02.616534+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:45:17.859213+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591266,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":15449,"num_write":1326,"num_write_kb":40818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"255'560","reported_seq":1919,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:51.635876+0000","last_change":"2024-03-04T13:13:51.635922+0000","last_active":"2024-03-04T13:13:51.635876+0000","last_peered":"2024-03-04T13:13:51.635876+0000","last_clean":"2024-03-04T13:13:51.635876+0000","last_became_active":"2024-03-04T12:20:16.837200+0000","last_became_peered":"2024-03-04T12:20:16.837200+0000","last_unstale":"2024-03-04T13:13:51.635876+0000","last_undegraded":"2024-03-04T13:13:51.635876+0000","last_fullsized":"2024-03-04T13:13:51.635876+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'560","last_scrub_stamp":"2024-03-04T13:13:51.635762+0000","last_deep_scrub":"255'560","last_deep_scrub_stamp":"2024-03-04T13:13:51.635762+0000","last_clean_scrub_stamp":"2024-03-04T13:13:51.635762+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:42:29.290164+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2594,"num_read_kb":2289,"num_write":764,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"255'155","reported_seq":748,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.234154+0000","last_change":"2024-03-04T12:20:14.816919+0000","last_active":"2024-03-04T13:13:21.234154+0000","last_peered":"2024-03-04T13:13:21.234154+0000","last_clean":"2024-03-04T13:13:21.234154+0000","last_became_active":"2024-03-04T12:20:14.816597+0000","last_became_peered":"2024-03-04T12:20:14.816597+0000","last_unstale":"2024-03-04T13:13:21.234154+0000","last_undegraded":"2024-03-04T13:13:21.234154+0000","last_fullsized":"2024-03-04T13:13:21.234154+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":326,"num_read_kb":1168,"num_write":917,"num_write_kb":5749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"255'454","reported_seq":1961,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:00.133825+0000","last_change":"2024-03-04T13:14:00.133852+0000","last_active":"2024-03-04T13:14:00.133825+0000","last_peered":"2024-03-04T13:14:00.133825+0000","last_clean":"2024-03-04T13:14:00.133825+0000","last_became_active":"2024-03-04T12:20:16.820419+0000","last_became_peered":"2024-03-04T12:20:16.820419+0000","last_unstale":"2024-03-04T13:14:00.133825+0000","last_undegraded":"2024-03-04T13:14:00.133825+0000","last_fullsized":"2024-03-04T13:14:00.133825+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'454","last_scrub_stamp":"2024-03-04T13:14:00.133741+0000","last_deep_scrub":"255'454","last_deep_scrub_stamp":"2024-03-04T13:14:00.133741+0000","last_clean_scrub_stamp":"2024-03-04T13:14:00.133741+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:04:22.061060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2318,"num_read_kb":2161,"num_write":537,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"255'251","reported_seq":897,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:00.509510+0000","last_change":"2024-03-04T13:14:00.509577+0000","last_active":"2024-03-04T13:14:00.509510+0000","last_peered":"2024-03-04T13:14:00.509510+0000","last_clean":"2024-03-04T13:14:00.509510+0000","last_became_active":"2024-03-04T12:20:14.824779+0000","last_became_peered":"2024-03-04T12:20:14.824779+0000","last_unstale":"2024-03-04T13:14:00.509510+0000","last_undegraded":"2024-03-04T13:14:00.509510+0000","last_fullsized":"2024-03-04T13:14:00.509510+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'251","last_scrub_stamp":"2024-03-04T13:14:00.509421+0000","last_deep_scrub":"255'251","last_deep_scrub_stamp":"2024-03-04T13:14:00.509421+0000","last_clean_scrub_stamp":"2024-03-04T13:14:00.509421+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:22.303660+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4160401,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":13558,"num_write":1376,"num_write_kb":36455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"255'352","reported_seq":1803,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:01.875327+0000","last_change":"2024-03-04T13:14:01.875355+0000","last_active":"2024-03-04T13:14:01.875327+0000","last_peered":"2024-03-04T13:14:01.875327+0000","last_clean":"2024-03-04T13:14:01.875327+0000","last_became_active":"2024-03-04T12:20:16.827613+0000","last_became_peered":"2024-03-04T12:20:16.827613+0000","last_unstale":"2024-03-04T13:14:01.875327+0000","last_undegraded":"2024-03-04T13:14:01.875327+0000","last_fullsized":"2024-03-04T13:14:01.875327+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'352","last_scrub_stamp":"2024-03-04T13:14:01.875237+0000","last_deep_scrub":"255'352","last_deep_scrub_stamp":"2024-03-04T13:14:01.875237+0000","last_clean_scrub_stamp":"2024-03-04T13:14:01.875237+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:50:01.808548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1915,"num_read_kb":1843,"num_write":383,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"255'195","reported_seq":835,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.101506+0000","last_change":"2024-03-04T12:20:14.816830+0000","last_active":"2024-03-04T13:13:21.101506+0000","last_peered":"2024-03-04T13:13:21.101506+0000","last_clean":"2024-03-04T13:13:21.101506+0000","last_became_active":"2024-03-04T12:20:14.816532+0000","last_became_peered":"2024-03-04T12:20:14.816532+0000","last_unstale":"2024-03-04T13:13:21.101506+0000","last_undegraded":"2024-03-04T13:13:21.101506+0000","last_fullsized":"2024-03-04T13:13:21.101506+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5789792,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":440,"num_read_kb":58154,"num_write":1069,"num_write_kb":58795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"255'407","reported_seq":2056,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:51.691033+0000","last_change":"2024-03-04T13:13:51.691073+0000","last_active":"2024-03-04T13:13:51.691033+0000","last_peered":"2024-03-04T13:13:51.691033+0000","last_clean":"2024-03-04T13:13:51.691033+0000","last_became_active":"2024-03-04T12:20:16.816688+0000","last_became_peered":"2024-03-04T12:20:16.816688+0000","last_unstale":"2024-03-04T13:13:51.691033+0000","last_undegraded":"2024-03-04T13:13:51.691033+0000","last_fullsized":"2024-03-04T13:13:51.691033+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'407","last_scrub_stamp":"2024-03-04T13:13:51.690939+0000","last_deep_scrub":"255'407","last_deep_scrub_stamp":"2024-03-04T13:13:51.690939+0000","last_clean_scrub_stamp":"2024-03-04T13:13:51.690939+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:33:48.362910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2407,"num_read_kb":2304,"num_write":479,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2630,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"255'181","reported_seq":771,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.744308+0000","last_change":"2024-03-04T13:13:33.744384+0000","last_active":"2024-03-04T13:13:33.744308+0000","last_peered":"2024-03-04T13:13:33.744308+0000","last_clean":"2024-03-04T13:13:33.744308+0000","last_became_active":"2024-03-04T12:20:51.030709+0000","last_became_peered":"2024-03-04T12:20:51.030709+0000","last_unstale":"2024-03-04T13:13:33.744308+0000","last_undegraded":"2024-03-04T13:13:33.744308+0000","last_fullsized":"2024-03-04T13:13:33.744308+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'181","last_scrub_stamp":"2024-03-04T13:13:33.744222+0000","last_deep_scrub":"255'181","last_deep_scrub_stamp":"2024-03-04T13:13:33.744222+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.744222+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:41:30.000095+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311793,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":363,"num_read_kb":29477,"num_write":998,"num_write_kb":29693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"255'777","reported_seq":2164,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:54.229533+0000","last_change":"2024-03-04T13:13:54.229594+0000","last_active":"2024-03-04T13:13:54.229533+0000","last_peered":"2024-03-04T13:13:54.229533+0000","last_clean":"2024-03-04T13:13:54.229533+0000","last_became_active":"2024-03-04T12:20:16.822282+0000","last_became_peered":"2024-03-04T12:20:16.822282+0000","last_unstale":"2024-03-04T13:13:54.229533+0000","last_undegraded":"2024-03-04T13:13:54.229533+0000","last_fullsized":"2024-03-04T13:13:54.229533+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'777","last_scrub_stamp":"2024-03-04T13:13:54.229429+0000","last_deep_scrub":"255'777","last_deep_scrub_stamp":"2024-03-04T13:13:54.229429+0000","last_clean_scrub_stamp":"2024-03-04T13:13:54.229429+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:06.557919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3372,"num_read_kb":2974,"num_write":1065,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":475,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"255'195","reported_seq":827,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.102082+0000","last_change":"2024-03-04T12:20:14.815689+0000","last_active":"2024-03-04T13:13:21.102082+0000","last_peered":"2024-03-04T13:13:21.102082+0000","last_clean":"2024-03-04T13:13:21.102082+0000","last_became_active":"2024-03-04T12:20:14.815388+0000","last_became_peered":"2024-03-04T12:20:14.815388+0000","last_unstale":"2024-03-04T13:13:21.102082+0000","last_undegraded":"2024-03-04T13:13:21.102082+0000","last_fullsized":"2024-03-04T13:13:21.102082+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262238,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":61923,"num_write":1063,"num_write_kb":47041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"255'685","reported_seq":2164,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.349576+0000","last_change":"2024-03-04T13:13:47.349621+0000","last_active":"2024-03-04T13:13:47.349576+0000","last_peered":"2024-03-04T13:13:47.349576+0000","last_clean":"2024-03-04T13:13:47.349576+0000","last_became_active":"2024-03-04T12:20:16.833268+0000","last_became_peered":"2024-03-04T12:20:16.833268+0000","last_unstale":"2024-03-04T13:13:47.349576+0000","last_undegraded":"2024-03-04T13:13:47.349576+0000","last_fullsized":"2024-03-04T13:13:47.349576+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'685","last_scrub_stamp":"2024-03-04T13:13:47.349451+0000","last_deep_scrub":"255'685","last_deep_scrub_stamp":"2024-03-04T13:13:47.349451+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.349451+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:59.994253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3214,"num_read_kb":2906,"num_write":892,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"255'232","reported_seq":874,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.228353+0000","last_change":"2024-03-04T12:20:14.828265+0000","last_active":"2024-03-04T13:13:21.228353+0000","last_peered":"2024-03-04T13:13:21.228353+0000","last_clean":"2024-03-04T13:13:21.228353+0000","last_became_active":"2024-03-04T12:20:14.827948+0000","last_became_peered":"2024-03-04T12:20:14.827948+0000","last_unstale":"2024-03-04T13:13:21.228353+0000","last_undegraded":"2024-03-04T13:13:21.228353+0000","last_fullsized":"2024-03-04T13:13:21.228353+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2119867,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":498,"num_read_kb":35496,"num_write":1177,"num_write_kb":50438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"255'330","reported_seq":1711,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:51.143606+0000","last_change":"2024-03-04T13:13:51.143640+0000","last_active":"2024-03-04T13:13:51.143606+0000","last_peered":"2024-03-04T13:13:51.143606+0000","last_clean":"2024-03-04T13:13:51.143606+0000","last_became_active":"2024-03-04T12:20:16.830773+0000","last_became_peered":"2024-03-04T12:20:16.830773+0000","last_unstale":"2024-03-04T13:13:51.143606+0000","last_undegraded":"2024-03-04T13:13:51.143606+0000","last_fullsized":"2024-03-04T13:13:51.143606+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'330","last_scrub_stamp":"2024-03-04T13:13:51.143518+0000","last_deep_scrub":"255'330","last_deep_scrub_stamp":"2024-03-04T13:13:51.143518+0000","last_clean_scrub_stamp":"2024-03-04T13:13:51.143518+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:50.933252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1823,"num_read_kb":1743,"num_write":376,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":712,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"255'405","reported_seq":1989,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:02.087510+0000","last_change":"2024-03-04T13:14:02.087541+0000","last_active":"2024-03-04T13:14:02.087510+0000","last_peered":"2024-03-04T13:14:02.087510+0000","last_clean":"2024-03-04T13:14:02.087510+0000","last_became_active":"2024-03-04T12:20:16.820533+0000","last_became_peered":"2024-03-04T12:20:16.820533+0000","last_unstale":"2024-03-04T13:14:02.087510+0000","last_undegraded":"2024-03-04T13:14:02.087510+0000","last_fullsized":"2024-03-04T13:14:02.087510+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'405","last_scrub_stamp":"2024-03-04T13:14:02.087418+0000","last_deep_scrub":"255'405","last_deep_scrub_stamp":"2024-03-04T13:14:02.087418+0000","last_clean_scrub_stamp":"2024-03-04T13:14:02.087418+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:57:37.611290+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2265,"num_read_kb":2155,"num_write":466,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"255'203","reported_seq":843,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:58.682103+0000","last_change":"2024-03-04T13:13:58.682203+0000","last_active":"2024-03-04T13:13:58.682103+0000","last_peered":"2024-03-04T13:13:58.682103+0000","last_clean":"2024-03-04T13:13:58.682103+0000","last_became_active":"2024-03-04T12:20:14.820248+0000","last_became_peered":"2024-03-04T12:20:14.820248+0000","last_unstale":"2024-03-04T13:13:58.682103+0000","last_undegraded":"2024-03-04T13:13:58.682103+0000","last_fullsized":"2024-03-04T13:13:58.682103+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'203","last_scrub_stamp":"2024-03-04T13:13:58.682007+0000","last_deep_scrub":"255'203","last_deep_scrub_stamp":"2024-03-04T13:13:58.682007+0000","last_clean_scrub_stamp":"2024-03-04T13:13:58.682007+0000","objects_scrubbed":10,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:17:28.774504+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847147,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":428,"num_read_kb":15441,"num_write":1092,"num_write_kb":31882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"255'1141","reported_seq":2701,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:49.635842+0000","last_change":"2024-03-04T13:13:49.635842+0000","last_active":"2024-03-04T13:13:49.635842+0000","last_peered":"2024-03-04T13:13:49.635842+0000","last_clean":"2024-03-04T13:13:49.635842+0000","last_became_active":"2024-03-04T12:20:16.837126+0000","last_became_peered":"2024-03-04T12:20:16.837126+0000","last_unstale":"2024-03-04T13:13:49.635842+0000","last_undegraded":"2024-03-04T13:13:49.635842+0000","last_fullsized":"2024-03-04T13:13:49.635842+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1141","last_scrub_stamp":"2024-03-04T13:13:49.635671+0000","last_deep_scrub":"255'1141","last_deep_scrub_stamp":"2024-03-04T13:13:49.635671+0000","last_clean_scrub_stamp":"2024-03-04T13:13:49.635671+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":1100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:44:42.530619+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4770,"num_read_kb":4178,"num_write":1557,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"255'200","reported_seq":825,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:58.779166+0000","last_change":"2024-03-04T13:13:58.779206+0000","last_active":"2024-03-04T13:13:58.779166+0000","last_peered":"2024-03-04T13:13:58.779166+0000","last_clean":"2024-03-04T13:13:58.779166+0000","last_became_active":"2024-03-04T12:20:14.824133+0000","last_became_peered":"2024-03-04T12:20:14.824133+0000","last_unstale":"2024-03-04T13:13:58.779166+0000","last_undegraded":"2024-03-04T13:13:58.779166+0000","last_fullsized":"2024-03-04T13:13:58.779166+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'200","last_scrub_stamp":"2024-03-04T13:13:58.779081+0000","last_deep_scrub":"255'200","last_deep_scrub_stamp":"2024-03-04T13:13:58.779081+0000","last_clean_scrub_stamp":"2024-03-04T13:13:58.779081+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:34:23.772345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399138,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":430,"num_read_kb":9751,"num_write":1008,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"255'740","reported_seq":2197,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:52.408120+0000","last_change":"2024-03-04T13:13:52.408120+0000","last_active":"2024-03-04T13:13:52.408120+0000","last_peered":"2024-03-04T13:13:52.408120+0000","last_clean":"2024-03-04T13:13:52.408120+0000","last_became_active":"2024-03-04T12:20:16.825499+0000","last_became_peered":"2024-03-04T12:20:16.825499+0000","last_unstale":"2024-03-04T13:13:52.408120+0000","last_undegraded":"2024-03-04T13:13:52.408120+0000","last_fullsized":"2024-03-04T13:13:52.408120+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'740","last_scrub_stamp":"2024-03-04T13:13:52.407992+0000","last_deep_scrub":"255'740","last_deep_scrub_stamp":"2024-03-04T13:13:52.407992+0000","last_clean_scrub_stamp":"2024-03-04T13:13:52.407992+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:59:17.265181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3318,"num_read_kb":2969,"num_write":989,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"255'243","reported_seq":884,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:59.776408+0000","last_change":"2024-03-04T13:13:59.776462+0000","last_active":"2024-03-04T13:13:59.776408+0000","last_peered":"2024-03-04T13:13:59.776408+0000","last_clean":"2024-03-04T13:13:59.776408+0000","last_became_active":"2024-03-04T12:20:14.827979+0000","last_became_peered":"2024-03-04T12:20:14.827979+0000","last_unstale":"2024-03-04T13:13:59.776408+0000","last_undegraded":"2024-03-04T13:13:59.776408+0000","last_fullsized":"2024-03-04T13:13:59.776408+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'243","last_scrub_stamp":"2024-03-04T13:13:59.776306+0000","last_deep_scrub":"255'243","last_deep_scrub_stamp":"2024-03-04T13:13:59.776306+0000","last_clean_scrub_stamp":"2024-03-04T13:13:59.776306+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:08.287845+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":577599,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":7999,"num_write":1192,"num_write_kb":30331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"255'778","reported_seq":2224,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:49.173740+0000","last_change":"2024-03-04T13:13:49.173764+0000","last_active":"2024-03-04T13:13:49.173740+0000","last_peered":"2024-03-04T13:13:49.173740+0000","last_clean":"2024-03-04T13:13:49.173740+0000","last_became_active":"2024-03-04T12:20:16.825897+0000","last_became_peered":"2024-03-04T12:20:16.825897+0000","last_unstale":"2024-03-04T13:13:49.173740+0000","last_undegraded":"2024-03-04T13:13:49.173740+0000","last_fullsized":"2024-03-04T13:13:49.173740+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'778","last_scrub_stamp":"2024-03-04T13:13:49.173670+0000","last_deep_scrub":"255'778","last_deep_scrub_stamp":"2024-03-04T13:13:49.173670+0000","last_clean_scrub_stamp":"2024-03-04T13:13:49.173670+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:23:07.806426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3571,"num_read_kb":3184,"num_write":1054,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"255'156","reported_seq":765,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:06.184941+0000","last_change":"2024-03-04T13:14:06.184989+0000","last_active":"2024-03-04T13:14:06.184941+0000","last_peered":"2024-03-04T13:14:06.184941+0000","last_clean":"2024-03-04T13:14:06.184941+0000","last_became_active":"2024-03-04T12:20:14.823430+0000","last_became_peered":"2024-03-04T12:20:14.823430+0000","last_unstale":"2024-03-04T13:14:06.184941+0000","last_undegraded":"2024-03-04T13:14:06.184941+0000","last_fullsized":"2024-03-04T13:14:06.184941+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'156","last_scrub_stamp":"2024-03-04T13:14:06.184838+0000","last_deep_scrub":"255'156","last_deep_scrub_stamp":"2024-03-04T13:14:06.184838+0000","last_clean_scrub_stamp":"2024-03-04T13:14:06.184838+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:43:31.809998+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1683023,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":325,"num_read_kb":32856,"num_write":784,"num_write_kb":22354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"255'557","reported_seq":2097,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:50.137449+0000","last_change":"2024-03-04T13:13:50.137503+0000","last_active":"2024-03-04T13:13:50.137449+0000","last_peered":"2024-03-04T13:13:50.137449+0000","last_clean":"2024-03-04T13:13:50.137449+0000","last_became_active":"2024-03-04T12:20:16.829685+0000","last_became_peered":"2024-03-04T12:20:16.829685+0000","last_unstale":"2024-03-04T13:13:50.137449+0000","last_undegraded":"2024-03-04T13:13:50.137449+0000","last_fullsized":"2024-03-04T13:13:50.137449+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'557","last_scrub_stamp":"2024-03-04T13:13:50.137339+0000","last_deep_scrub":"255'557","last_deep_scrub_stamp":"2024-03-04T13:13:50.137339+0000","last_clean_scrub_stamp":"2024-03-04T13:13:50.137339+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:52:59.670826+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2792,"num_read_kb":2527,"num_write":750,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":951,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"255'193","reported_seq":777,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.642264+0000","last_change":"2024-03-04T12:20:14.822181+0000","last_active":"2024-03-04T13:13:26.642264+0000","last_peered":"2024-03-04T13:13:26.642264+0000","last_clean":"2024-03-04T13:13:26.642264+0000","last_became_active":"2024-03-04T12:20:14.821923+0000","last_became_peered":"2024-03-04T12:20:14.821923+0000","last_unstale":"2024-03-04T13:13:26.642264+0000","last_undegraded":"2024-03-04T13:13:26.642264+0000","last_fullsized":"2024-03-04T13:13:26.642264+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":428,"num_write":1012,"num_write_kb":16985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"255'374","reported_seq":1799,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:49.246845+0000","last_change":"2024-03-04T13:13:49.246872+0000","last_active":"2024-03-04T13:13:49.246845+0000","last_peered":"2024-03-04T13:13:49.246845+0000","last_clean":"2024-03-04T13:13:49.246845+0000","last_became_active":"2024-03-04T12:20:16.826208+0000","last_became_peered":"2024-03-04T12:20:16.826208+0000","last_unstale":"2024-03-04T13:13:49.246845+0000","last_undegraded":"2024-03-04T13:13:49.246845+0000","last_fullsized":"2024-03-04T13:13:49.246845+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'374","last_scrub_stamp":"2024-03-04T13:13:49.246754+0000","last_deep_scrub":"255'374","last_deep_scrub_stamp":"2024-03-04T13:13:49.246754+0000","last_clean_scrub_stamp":"2024-03-04T13:13:49.246754+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:36:43.743252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1988,"num_read_kb":1881,"num_write":441,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"255'173","reported_seq":779,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260227+0000","last_change":"2024-03-04T12:20:14.812110+0000","last_active":"2024-03-04T13:13:25.260227+0000","last_peered":"2024-03-04T13:13:25.260227+0000","last_clean":"2024-03-04T13:13:25.260227+0000","last_became_active":"2024-03-04T12:20:14.811813+0000","last_became_peered":"2024-03-04T12:20:14.811813+0000","last_unstale":"2024-03-04T13:13:25.260227+0000","last_undegraded":"2024-03-04T13:13:25.260227+0000","last_fullsized":"2024-03-04T13:13:25.260227+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":397,"num_read_kb":4485,"num_write":973,"num_write_kb":10922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"255'94","reported_seq":590,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.145617+0000","last_change":"2024-03-04T13:13:32.145617+0000","last_active":"2024-03-04T13:13:32.145617+0000","last_peered":"2024-03-04T13:13:32.145617+0000","last_clean":"2024-03-04T13:13:32.145617+0000","last_became_active":"2024-03-04T12:20:24.871089+0000","last_became_peered":"2024-03-04T12:20:24.871089+0000","last_unstale":"2024-03-04T13:13:32.145617+0000","last_undegraded":"2024-03-04T13:13:32.145617+0000","last_fullsized":"2024-03-04T13:13:32.145617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'94","last_scrub_stamp":"2024-03-04T13:13:32.145502+0000","last_deep_scrub":"255'94","last_deep_scrub_stamp":"2024-03-04T13:13:32.145502+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.145502+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:10.096376+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":97,"num_write":227,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"255'792","reported_seq":2224,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:01.907005+0000","last_change":"2024-03-04T13:14:01.907005+0000","last_active":"2024-03-04T13:14:01.907005+0000","last_peered":"2024-03-04T13:14:01.907005+0000","last_clean":"2024-03-04T13:14:01.907005+0000","last_became_active":"2024-03-04T12:20:16.828977+0000","last_became_peered":"2024-03-04T12:20:16.828977+0000","last_unstale":"2024-03-04T13:14:01.907005+0000","last_undegraded":"2024-03-04T13:14:01.907005+0000","last_fullsized":"2024-03-04T13:14:01.907005+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'792","last_scrub_stamp":"2024-03-04T13:14:01.906877+0000","last_deep_scrub":"255'792","last_deep_scrub_stamp":"2024-03-04T13:14:01.906877+0000","last_clean_scrub_stamp":"2024-03-04T13:14:01.906877+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:12:08.591141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3439,"num_read_kb":3056,"num_write":1047,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1187,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"255'219","reported_seq":871,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.487436+0000","last_change":"2024-03-04T12:20:14.817012+0000","last_active":"2024-03-04T13:13:28.487436+0000","last_peered":"2024-03-04T13:13:28.487436+0000","last_clean":"2024-03-04T13:13:28.487436+0000","last_became_active":"2024-03-04T12:20:14.816722+0000","last_became_peered":"2024-03-04T12:20:14.816722+0000","last_unstale":"2024-03-04T13:13:28.487436+0000","last_undegraded":"2024-03-04T13:13:28.487436+0000","last_fullsized":"2024-03-04T13:13:28.487436+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1705735,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":471,"num_read_kb":103623,"num_write":1220,"num_write_kb":57222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":492,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:49.328955+0000","last_change":"2024-03-04T13:13:49.328995+0000","last_active":"2024-03-04T13:13:49.328955+0000","last_peered":"2024-03-04T13:13:49.328955+0000","last_clean":"2024-03-04T13:13:49.328955+0000","last_became_active":"2024-03-04T12:20:18.835597+0000","last_became_peered":"2024-03-04T12:20:18.835597+0000","last_unstale":"2024-03-04T13:13:49.328955+0000","last_undegraded":"2024-03-04T13:13:49.328955+0000","last_fullsized":"2024-03-04T13:13:49.328955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:49.328852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:49.328852+0000","last_clean_scrub_stamp":"2024-03-04T13:13:49.328852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:44:36.686960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"255'189","reported_seq":782,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:06.967199+0000","last_change":"2024-03-04T13:14:06.967273+0000","last_active":"2024-03-04T13:14:06.967199+0000","last_peered":"2024-03-04T13:14:06.967199+0000","last_clean":"2024-03-04T13:14:06.967199+0000","last_became_active":"2024-03-04T12:20:20.837048+0000","last_became_peered":"2024-03-04T12:20:20.837048+0000","last_unstale":"2024-03-04T13:14:06.967199+0000","last_undegraded":"2024-03-04T13:14:06.967199+0000","last_fullsized":"2024-03-04T13:14:06.967199+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'189","last_scrub_stamp":"2024-03-04T13:14:06.967098+0000","last_deep_scrub":"255'189","last_deep_scrub_stamp":"2024-03-04T13:14:06.967098+0000","last_clean_scrub_stamp":"2024-03-04T13:14:06.967098+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:57:04.542111+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":254,"num_read_kb":315,"num_write":146,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":491,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.498806+0000","last_change":"2024-03-04T13:13:41.498831+0000","last_active":"2024-03-04T13:13:41.498806+0000","last_peered":"2024-03-04T13:13:41.498806+0000","last_clean":"2024-03-04T13:13:41.498806+0000","last_became_active":"2024-03-04T12:20:22.852461+0000","last_became_peered":"2024-03-04T12:20:22.852461+0000","last_unstale":"2024-03-04T13:13:41.498806+0000","last_undegraded":"2024-03-04T13:13:41.498806+0000","last_fullsized":"2024-03-04T13:13:41.498806+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:41.498692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:41.498692+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.498692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:16:36.806224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"255'2374","reported_seq":4178,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.244538+0000","last_change":"2024-03-04T13:13:32.244538+0000","last_active":"2024-03-04T13:13:32.244538+0000","last_peered":"2024-03-04T13:13:32.244538+0000","last_clean":"2024-03-04T13:13:32.244538+0000","last_became_active":"2024-03-04T12:20:24.869395+0000","last_became_peered":"2024-03-04T12:20:24.869395+0000","last_unstale":"2024-03-04T13:13:32.244538+0000","last_undegraded":"2024-03-04T13:13:32.244538+0000","last_fullsized":"2024-03-04T13:13:32.244538+0000","mapping_epoch":30,"log_start":"255'2300","ondisk_log_start":"255'2300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2374","last_scrub_stamp":"2024-03-04T13:13:32.244414+0000","last_deep_scrub":"255'2374","last_deep_scrub_stamp":"2024-03-04T13:13:32.244414+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.244414+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":2300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:00:10.267491+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5943,"num_read_kb":5935,"num_write":4730,"num_write_kb":1746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"255'348","reported_seq":1824,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.378169+0000","last_change":"2024-03-04T13:13:46.378200+0000","last_active":"2024-03-04T13:13:46.378169+0000","last_peered":"2024-03-04T13:13:46.378169+0000","last_clean":"2024-03-04T13:13:46.378169+0000","last_became_active":"2024-03-04T12:20:16.829441+0000","last_became_peered":"2024-03-04T12:20:16.829441+0000","last_unstale":"2024-03-04T13:13:46.378169+0000","last_undegraded":"2024-03-04T13:13:46.378169+0000","last_fullsized":"2024-03-04T13:13:46.378169+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'348","last_scrub_stamp":"2024-03-04T13:13:46.378079+0000","last_deep_scrub":"255'348","last_deep_scrub_stamp":"2024-03-04T13:13:46.378079+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.378079+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:49:37.173629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2107,"num_read_kb":2006,"num_write":408,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2858,"num_omap_keys":13,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"255'161","reported_seq":726,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260146+0000","last_change":"2024-03-04T12:20:14.819912+0000","last_active":"2024-03-04T13:13:25.260146+0000","last_peered":"2024-03-04T13:13:25.260146+0000","last_clean":"2024-03-04T13:13:25.260146+0000","last_became_active":"2024-03-04T12:20:14.819559+0000","last_became_peered":"2024-03-04T12:20:14.819559+0000","last_unstale":"2024-03-04T13:13:25.260146+0000","last_undegraded":"2024-03-04T13:13:25.260146+0000","last_fullsized":"2024-03-04T13:13:25.260146+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":323,"num_read_kb":7587,"num_write":849,"num_write_kb":22276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:00.899226+0000","last_change":"2024-03-04T13:14:00.899226+0000","last_active":"2024-03-04T13:14:00.899226+0000","last_peered":"2024-03-04T13:14:00.899226+0000","last_clean":"2024-03-04T13:14:00.899226+0000","last_became_active":"2024-03-04T12:20:18.833470+0000","last_became_peered":"2024-03-04T12:20:18.833470+0000","last_unstale":"2024-03-04T13:14:00.899226+0000","last_undegraded":"2024-03-04T13:14:00.899226+0000","last_fullsized":"2024-03-04T13:14:00.899226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:00.899079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:00.899079+0000","last_clean_scrub_stamp":"2024-03-04T13:14:00.899079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:57:35.968959+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"255'80","reported_seq":606,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.292561+0000","last_change":"2024-03-04T13:13:46.292613+0000","last_active":"2024-03-04T13:13:46.292561+0000","last_peered":"2024-03-04T13:13:46.292561+0000","last_clean":"2024-03-04T13:13:46.292561+0000","last_became_active":"2024-03-04T12:20:20.837905+0000","last_became_peered":"2024-03-04T12:20:20.837905+0000","last_unstale":"2024-03-04T13:13:46.292561+0000","last_undegraded":"2024-03-04T13:13:46.292561+0000","last_fullsized":"2024-03-04T13:13:46.292561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'80","last_scrub_stamp":"2024-03-04T13:13:46.292461+0000","last_deep_scrub":"255'80","last_deep_scrub_stamp":"2024-03-04T13:13:46.292461+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.292461+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:05:22.285515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.224938+0000","last_change":"2024-03-04T13:13:39.224970+0000","last_active":"2024-03-04T13:13:39.224938+0000","last_peered":"2024-03-04T13:13:39.224938+0000","last_clean":"2024-03-04T13:13:39.224938+0000","last_became_active":"2024-03-04T12:20:22.848773+0000","last_became_peered":"2024-03-04T12:20:22.848773+0000","last_unstale":"2024-03-04T13:13:39.224938+0000","last_undegraded":"2024-03-04T13:13:39.224938+0000","last_fullsized":"2024-03-04T13:13:39.224938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:39.224844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:39.224844+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.224844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:01:57.050536+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"255'120","reported_seq":620,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.882743+0000","last_change":"2024-03-04T13:13:33.882777+0000","last_active":"2024-03-04T13:13:33.882743+0000","last_peered":"2024-03-04T13:13:33.882743+0000","last_clean":"2024-03-04T13:13:33.882743+0000","last_became_active":"2024-03-04T12:20:24.868746+0000","last_became_peered":"2024-03-04T12:20:24.868746+0000","last_unstale":"2024-03-04T13:13:33.882743+0000","last_undegraded":"2024-03-04T13:13:33.882743+0000","last_fullsized":"2024-03-04T13:13:33.882743+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'120","last_scrub_stamp":"2024-03-04T13:13:33.882663+0000","last_deep_scrub":"255'120","last_deep_scrub_stamp":"2024-03-04T13:13:33.882663+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.882663+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:25.145935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"255'392","reported_seq":1893,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:55.762490+0000","last_change":"2024-03-04T13:13:55.762525+0000","last_active":"2024-03-04T13:13:55.762490+0000","last_peered":"2024-03-04T13:13:55.762490+0000","last_clean":"2024-03-04T13:13:55.762490+0000","last_became_active":"2024-03-04T12:20:16.829641+0000","last_became_peered":"2024-03-04T12:20:16.829641+0000","last_unstale":"2024-03-04T13:13:55.762490+0000","last_undegraded":"2024-03-04T13:13:55.762490+0000","last_fullsized":"2024-03-04T13:13:55.762490+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'392","last_scrub_stamp":"2024-03-04T13:13:55.762380+0000","last_deep_scrub":"255'392","last_deep_scrub_stamp":"2024-03-04T13:13:55.762380+0000","last_clean_scrub_stamp":"2024-03-04T13:13:55.762380+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:52:43.784728+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2147,"num_read_kb":2039,"num_write":462,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":238,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"255'149","reported_seq":773,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:04.700467+0000","last_change":"2024-03-04T13:14:04.700527+0000","last_active":"2024-03-04T13:14:04.700467+0000","last_peered":"2024-03-04T13:14:04.700467+0000","last_clean":"2024-03-04T13:14:04.700467+0000","last_became_active":"2024-03-04T12:20:14.817556+0000","last_became_peered":"2024-03-04T12:20:14.817556+0000","last_unstale":"2024-03-04T13:14:04.700467+0000","last_undegraded":"2024-03-04T13:14:04.700467+0000","last_fullsized":"2024-03-04T13:14:04.700467+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'149","last_scrub_stamp":"2024-03-04T13:14:04.700365+0000","last_deep_scrub":"255'149","last_deep_scrub_stamp":"2024-03-04T13:14:04.700365+0000","last_clean_scrub_stamp":"2024-03-04T13:14:04.700365+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:59.660187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524480,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":366,"num_read_kb":1564,"num_write":822,"num_write_kb":17292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:04.878289+0000","last_change":"2024-03-04T13:14:04.878314+0000","last_active":"2024-03-04T13:14:04.878289+0000","last_peered":"2024-03-04T13:14:04.878289+0000","last_clean":"2024-03-04T13:14:04.878289+0000","last_became_active":"2024-03-04T12:20:18.835760+0000","last_became_peered":"2024-03-04T12:20:18.835760+0000","last_unstale":"2024-03-04T13:14:04.878289+0000","last_undegraded":"2024-03-04T13:14:04.878289+0000","last_fullsized":"2024-03-04T13:14:04.878289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:04.878198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:04.878198+0000","last_clean_scrub_stamp":"2024-03-04T13:14:04.878198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:33:59.711394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"255'119","reported_seq":654,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.035113+0000","last_change":"2024-03-04T13:13:34.035113+0000","last_active":"2024-03-04T13:13:34.035113+0000","last_peered":"2024-03-04T13:13:34.035113+0000","last_clean":"2024-03-04T13:13:34.035113+0000","last_became_active":"2024-03-04T12:20:20.838094+0000","last_became_peered":"2024-03-04T12:20:20.838094+0000","last_unstale":"2024-03-04T13:13:34.035113+0000","last_undegraded":"2024-03-04T13:13:34.035113+0000","last_fullsized":"2024-03-04T13:13:34.035113+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'119","last_scrub_stamp":"2024-03-04T13:13:34.034984+0000","last_deep_scrub":"255'119","last_deep_scrub_stamp":"2024-03-04T13:13:34.034984+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.034984+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:32:21.314242+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":129,"num_write":92,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"255'502","reported_seq":1939,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.473406+0000","last_change":"2024-03-04T13:13:42.473432+0000","last_active":"2024-03-04T13:13:42.473406+0000","last_peered":"2024-03-04T13:13:42.473406+0000","last_clean":"2024-03-04T13:13:42.473406+0000","last_became_active":"2024-03-04T12:20:22.851062+0000","last_became_peered":"2024-03-04T12:20:22.851062+0000","last_unstale":"2024-03-04T13:13:42.473406+0000","last_undegraded":"2024-03-04T13:13:42.473406+0000","last_fullsized":"2024-03-04T13:13:42.473406+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'502","last_scrub_stamp":"2024-03-04T13:13:42.473290+0000","last_deep_scrub":"255'502","last_deep_scrub_stamp":"2024-03-04T13:13:42.473290+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.473290+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:04:59.380321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"255'139","reported_seq":626,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.108679+0000","last_change":"2024-03-04T13:13:31.108749+0000","last_active":"2024-03-04T13:13:31.108679+0000","last_peered":"2024-03-04T13:13:31.108679+0000","last_clean":"2024-03-04T13:13:31.108679+0000","last_became_active":"2024-03-04T12:20:24.912068+0000","last_became_peered":"2024-03-04T12:20:24.912068+0000","last_unstale":"2024-03-04T13:13:31.108679+0000","last_undegraded":"2024-03-04T13:13:31.108679+0000","last_fullsized":"2024-03-04T13:13:31.108679+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'139","last_scrub_stamp":"2024-03-04T13:13:31.108574+0000","last_deep_scrub":"255'139","last_deep_scrub_stamp":"2024-03-04T13:13:31.108574+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.108574+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:53.333608+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":66,"num_write":291,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":168,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"255'857","reported_seq":2547,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:57.892285+0000","last_change":"2024-03-04T13:13:57.892339+0000","last_active":"2024-03-04T13:13:57.892285+0000","last_peered":"2024-03-04T13:13:57.892285+0000","last_clean":"2024-03-04T13:13:57.892285+0000","last_became_active":"2024-03-04T12:20:16.831039+0000","last_became_peered":"2024-03-04T12:20:16.831039+0000","last_unstale":"2024-03-04T13:13:57.892285+0000","last_undegraded":"2024-03-04T13:13:57.892285+0000","last_fullsized":"2024-03-04T13:13:57.892285+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'857","last_scrub_stamp":"2024-03-04T13:13:57.892181+0000","last_deep_scrub":"255'857","last_deep_scrub_stamp":"2024-03-04T13:13:57.892181+0000","last_clean_scrub_stamp":"2024-03-04T13:13:57.892181+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:12.998142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4009,"num_read_kb":3592,"num_write":1144,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2632,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"255'201","reported_seq":814,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:54.770431+0000","last_change":"2024-03-04T13:13:54.770431+0000","last_active":"2024-03-04T13:13:54.770431+0000","last_peered":"2024-03-04T13:13:54.770431+0000","last_clean":"2024-03-04T13:13:54.770431+0000","last_became_active":"2024-03-04T12:20:14.817863+0000","last_became_peered":"2024-03-04T12:20:14.817863+0000","last_unstale":"2024-03-04T13:13:54.770431+0000","last_undegraded":"2024-03-04T13:13:54.770431+0000","last_fullsized":"2024-03-04T13:13:54.770431+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'201","last_scrub_stamp":"2024-03-04T13:13:54.770251+0000","last_deep_scrub":"255'201","last_deep_scrub_stamp":"2024-03-04T13:13:54.770251+0000","last_clean_scrub_stamp":"2024-03-04T13:13:54.770251+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:40:56.709393+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9161812,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":19635,"num_write":1198,"num_write_kb":36958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"255'5","reported_seq":803,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:55.458309+0000","last_change":"2024-03-04T13:13:55.458358+0000","last_active":"2024-03-04T13:13:55.458309+0000","last_peered":"2024-03-04T13:13:55.458309+0000","last_clean":"2024-03-04T13:13:55.458309+0000","last_became_active":"2024-03-04T12:20:18.838266+0000","last_became_peered":"2024-03-04T12:20:18.838266+0000","last_unstale":"2024-03-04T13:13:55.458309+0000","last_undegraded":"2024-03-04T13:13:55.458309+0000","last_fullsized":"2024-03-04T13:13:55.458309+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'5","last_scrub_stamp":"2024-03-04T13:13:55.458201+0000","last_deep_scrub":"255'5","last_deep_scrub_stamp":"2024-03-04T13:13:55.458201+0000","last_clean_scrub_stamp":"2024-03-04T13:13:55.458201+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:49.141171+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":466,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"255'133","reported_seq":707,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.555514+0000","last_change":"2024-03-04T13:13:45.555549+0000","last_active":"2024-03-04T13:13:45.555514+0000","last_peered":"2024-03-04T13:13:45.555514+0000","last_clean":"2024-03-04T13:13:45.555514+0000","last_became_active":"2024-03-04T12:20:21.643542+0000","last_became_peered":"2024-03-04T12:20:21.643542+0000","last_unstale":"2024-03-04T13:13:45.555514+0000","last_undegraded":"2024-03-04T13:13:45.555514+0000","last_fullsized":"2024-03-04T13:13:45.555514+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'133","last_scrub_stamp":"2024-03-04T13:13:45.555419+0000","last_deep_scrub":"255'133","last_deep_scrub_stamp":"2024-03-04T13:13:45.555419+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.555419+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:57:31.107185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9148,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":181,"num_read_kb":265,"num_write":100,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"255'530","reported_seq":1922,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.874327+0000","last_change":"2024-03-04T13:13:45.874327+0000","last_active":"2024-03-04T13:13:45.874327+0000","last_peered":"2024-03-04T13:13:45.874327+0000","last_clean":"2024-03-04T13:13:45.874327+0000","last_became_active":"2024-03-04T12:20:22.858575+0000","last_became_peered":"2024-03-04T12:20:22.858575+0000","last_unstale":"2024-03-04T13:13:45.874327+0000","last_undegraded":"2024-03-04T13:13:45.874327+0000","last_fullsized":"2024-03-04T13:13:45.874327+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'530","last_scrub_stamp":"2024-03-04T13:13:45.874162+0000","last_deep_scrub":"255'530","last_deep_scrub_stamp":"2024-03-04T13:13:45.874162+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.874162+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:41.473943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"255'392","reported_seq":1806,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.417022+0000","last_change":"2024-03-04T13:13:45.417063+0000","last_active":"2024-03-04T13:13:45.417022+0000","last_peered":"2024-03-04T13:13:45.417022+0000","last_clean":"2024-03-04T13:13:45.417022+0000","last_became_active":"2024-03-04T12:20:16.830531+0000","last_became_peered":"2024-03-04T12:20:16.830531+0000","last_unstale":"2024-03-04T13:13:45.417022+0000","last_undegraded":"2024-03-04T13:13:45.417022+0000","last_fullsized":"2024-03-04T13:13:45.417022+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'392","last_scrub_stamp":"2024-03-04T13:13:45.416932+0000","last_deep_scrub":"255'392","last_deep_scrub_stamp":"2024-03-04T13:13:45.416932+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.416932+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:55:36.780667+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2065,"num_write":498,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"255'177","reported_seq":861,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:02.710579+0000","last_change":"2024-03-04T13:14:02.710623+0000","last_active":"2024-03-04T13:14:02.710579+0000","last_peered":"2024-03-04T13:14:02.710579+0000","last_clean":"2024-03-04T13:14:02.710579+0000","last_became_active":"2024-03-04T12:20:14.818441+0000","last_became_peered":"2024-03-04T12:20:14.818441+0000","last_unstale":"2024-03-04T13:14:02.710579+0000","last_undegraded":"2024-03-04T13:14:02.710579+0000","last_fullsized":"2024-03-04T13:14:02.710579+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'177","last_scrub_stamp":"2024-03-04T13:14:02.710488+0000","last_deep_scrub":"255'177","last_deep_scrub_stamp":"2024-03-04T13:14:02.710488+0000","last_clean_scrub_stamp":"2024-03-04T13:14:02.710488+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:46:46.232644+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10526962,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":524,"num_read_kb":158242,"num_write":986,"num_write_kb":38243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":501,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:57.659087+0000","last_change":"2024-03-04T13:13:57.659109+0000","last_active":"2024-03-04T13:13:57.659087+0000","last_peered":"2024-03-04T13:13:57.659087+0000","last_clean":"2024-03-04T13:13:57.659087+0000","last_became_active":"2024-03-04T12:20:18.832349+0000","last_became_peered":"2024-03-04T12:20:18.832349+0000","last_unstale":"2024-03-04T13:13:57.659087+0000","last_undegraded":"2024-03-04T13:13:57.659087+0000","last_fullsized":"2024-03-04T13:13:57.659087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:57.658995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:57.658995+0000","last_clean_scrub_stamp":"2024-03-04T13:13:57.658995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:10:31.370107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"255'225","reported_seq":838,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.354424+0000","last_change":"2024-03-04T13:13:42.354509+0000","last_active":"2024-03-04T13:13:42.354424+0000","last_peered":"2024-03-04T13:13:42.354424+0000","last_clean":"2024-03-04T13:13:42.354424+0000","last_became_active":"2024-03-04T12:20:21.641749+0000","last_became_peered":"2024-03-04T12:20:21.641749+0000","last_unstale":"2024-03-04T13:13:42.354424+0000","last_undegraded":"2024-03-04T13:13:42.354424+0000","last_fullsized":"2024-03-04T13:13:42.354424+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'225","last_scrub_stamp":"2024-03-04T13:13:42.354322+0000","last_deep_scrub":"255'225","last_deep_scrub_stamp":"2024-03-04T13:13:42.354322+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.354322+0000","objects_scrubbed":9,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:02:03.360542+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6571,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":304,"num_read_kb":381,"num_write":178,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":486,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:55.655698+0000","last_change":"2024-03-04T13:13:55.655745+0000","last_active":"2024-03-04T13:13:55.655698+0000","last_peered":"2024-03-04T13:13:55.655698+0000","last_clean":"2024-03-04T13:13:55.655698+0000","last_became_active":"2024-03-04T12:20:22.852612+0000","last_became_peered":"2024-03-04T12:20:22.852612+0000","last_unstale":"2024-03-04T13:13:55.655698+0000","last_undegraded":"2024-03-04T13:13:55.655698+0000","last_fullsized":"2024-03-04T13:13:55.655698+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:55.655577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:55.655577+0000","last_clean_scrub_stamp":"2024-03-04T13:13:55.655577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:05:35.729959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"255'524","reported_seq":1326,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.257848+0000","last_change":"2024-03-04T13:13:33.257881+0000","last_active":"2024-03-04T13:13:33.257848+0000","last_peered":"2024-03-04T13:13:33.257848+0000","last_clean":"2024-03-04T13:13:33.257848+0000","last_became_active":"2024-03-04T12:20:24.869409+0000","last_became_peered":"2024-03-04T12:20:24.869409+0000","last_unstale":"2024-03-04T13:13:33.257848+0000","last_undegraded":"2024-03-04T13:13:33.257848+0000","last_fullsized":"2024-03-04T13:13:33.257848+0000","mapping_epoch":30,"log_start":"255'500","ondisk_log_start":"255'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'524","last_scrub_stamp":"2024-03-04T13:13:33.257751+0000","last_deep_scrub":"255'524","last_deep_scrub_stamp":"2024-03-04T13:13:33.257751+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.257751+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:38.905328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1237,"num_read_kb":1237,"num_write":1069,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"255'317","reported_seq":1793,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:48.295773+0000","last_change":"2024-03-04T13:13:48.295802+0000","last_active":"2024-03-04T13:13:48.295773+0000","last_peered":"2024-03-04T13:13:48.295773+0000","last_clean":"2024-03-04T13:13:48.295773+0000","last_became_active":"2024-03-04T12:20:16.826183+0000","last_became_peered":"2024-03-04T12:20:16.826183+0000","last_unstale":"2024-03-04T13:13:48.295773+0000","last_undegraded":"2024-03-04T13:13:48.295773+0000","last_fullsized":"2024-03-04T13:13:48.295773+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'317","last_scrub_stamp":"2024-03-04T13:13:48.295675+0000","last_deep_scrub":"255'317","last_deep_scrub_stamp":"2024-03-04T13:13:48.295675+0000","last_clean_scrub_stamp":"2024-03-04T13:13:48.295675+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:22.702685+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2023,"num_read_kb":1945,"num_write":353,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2156,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"255'180","reported_seq":819,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:00.709362+0000","last_change":"2024-03-04T13:14:00.709404+0000","last_active":"2024-03-04T13:14:00.709362+0000","last_peered":"2024-03-04T13:14:00.709362+0000","last_clean":"2024-03-04T13:14:00.709362+0000","last_became_active":"2024-03-04T12:20:14.819389+0000","last_became_peered":"2024-03-04T12:20:14.819389+0000","last_unstale":"2024-03-04T13:14:00.709362+0000","last_undegraded":"2024-03-04T13:14:00.709362+0000","last_fullsized":"2024-03-04T13:14:00.709362+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'180","last_scrub_stamp":"2024-03-04T13:14:00.709243+0000","last_deep_scrub":"255'180","last_deep_scrub_stamp":"2024-03-04T13:14:00.709243+0000","last_clean_scrub_stamp":"2024-03-04T13:14:00.709243+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:34:50.567892+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":382,"num_read_kb":37991,"num_write":1066,"num_write_kb":16641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.162022+0000","last_change":"2024-03-04T13:13:40.162043+0000","last_active":"2024-03-04T13:13:40.162022+0000","last_peered":"2024-03-04T13:13:40.162022+0000","last_clean":"2024-03-04T13:13:40.162022+0000","last_became_active":"2024-03-04T12:20:18.834619+0000","last_became_peered":"2024-03-04T12:20:18.834619+0000","last_unstale":"2024-03-04T13:13:40.162022+0000","last_undegraded":"2024-03-04T13:13:40.162022+0000","last_fullsized":"2024-03-04T13:13:40.162022+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.161921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.161921+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.161921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:50.976546+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"255'133","reported_seq":697,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:53.932324+0000","last_change":"2024-03-04T13:13:53.932360+0000","last_active":"2024-03-04T13:13:53.932324+0000","last_peered":"2024-03-04T13:13:53.932324+0000","last_clean":"2024-03-04T13:13:53.932324+0000","last_became_active":"2024-03-04T12:20:20.843195+0000","last_became_peered":"2024-03-04T12:20:20.843195+0000","last_unstale":"2024-03-04T13:13:53.932324+0000","last_undegraded":"2024-03-04T13:13:53.932324+0000","last_fullsized":"2024-03-04T13:13:53.932324+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'133","last_scrub_stamp":"2024-03-04T13:13:53.932233+0000","last_deep_scrub":"255'133","last_deep_scrub_stamp":"2024-03-04T13:13:53.932233+0000","last_clean_scrub_stamp":"2024-03-04T13:13:53.932233+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:42:10.745700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":216,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":483,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.818122+0000","last_change":"2024-03-04T13:13:43.818146+0000","last_active":"2024-03-04T13:13:43.818122+0000","last_peered":"2024-03-04T13:13:43.818122+0000","last_clean":"2024-03-04T13:13:43.818122+0000","last_became_active":"2024-03-04T12:20:22.858722+0000","last_became_peered":"2024-03-04T12:20:22.858722+0000","last_unstale":"2024-03-04T13:13:43.818122+0000","last_undegraded":"2024-03-04T13:13:43.818122+0000","last_fullsized":"2024-03-04T13:13:43.818122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:43.818034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:43.818034+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.818034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:06:19.231882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"255'183","reported_seq":713,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:00.822345+0000","last_change":"2024-03-04T13:14:00.822382+0000","last_active":"2024-03-04T13:14:00.822345+0000","last_peered":"2024-03-04T13:14:00.822345+0000","last_clean":"2024-03-04T13:14:00.822345+0000","last_became_active":"2024-03-04T12:20:24.869152+0000","last_became_peered":"2024-03-04T12:20:24.869152+0000","last_unstale":"2024-03-04T13:14:00.822345+0000","last_undegraded":"2024-03-04T13:14:00.822345+0000","last_fullsized":"2024-03-04T13:14:00.822345+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'183","last_scrub_stamp":"2024-03-04T13:14:00.822257+0000","last_deep_scrub":"255'183","last_deep_scrub_stamp":"2024-03-04T13:14:00.822257+0000","last_clean_scrub_stamp":"2024-03-04T13:14:00.822257+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:28.956656+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":286,"num_read_kb":243,"num_write":358,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"255'1227","reported_seq":2778,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.731782+0000","last_change":"2024-03-04T13:13:43.731818+0000","last_active":"2024-03-04T13:13:43.731782+0000","last_peered":"2024-03-04T13:13:43.731782+0000","last_clean":"2024-03-04T13:13:43.731782+0000","last_became_active":"2024-03-04T12:20:16.826172+0000","last_became_peered":"2024-03-04T12:20:16.826172+0000","last_unstale":"2024-03-04T13:13:43.731782+0000","last_undegraded":"2024-03-04T13:13:43.731782+0000","last_fullsized":"2024-03-04T13:13:43.731782+0000","mapping_epoch":22,"log_start":"255'1200","ondisk_log_start":"255'1200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1227","last_scrub_stamp":"2024-03-04T13:13:43.731679+0000","last_deep_scrub":"255'1227","last_deep_scrub_stamp":"2024-03-04T13:13:43.731679+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.731679+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:47:03.032710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5093,"num_read_kb":4391,"num_write":1710,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"255'183","reported_seq":851,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:54.676765+0000","last_change":"2024-03-04T13:13:54.676850+0000","last_active":"2024-03-04T13:13:54.676765+0000","last_peered":"2024-03-04T13:13:54.676765+0000","last_clean":"2024-03-04T13:13:54.676765+0000","last_became_active":"2024-03-04T12:20:14.828250+0000","last_became_peered":"2024-03-04T12:20:14.828250+0000","last_unstale":"2024-03-04T13:13:54.676765+0000","last_undegraded":"2024-03-04T13:13:54.676765+0000","last_fullsized":"2024-03-04T13:13:54.676765+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'183","last_scrub_stamp":"2024-03-04T13:13:54.676648+0000","last_deep_scrub":"255'183","last_deep_scrub_stamp":"2024-03-04T13:13:54.676648+0000","last_clean_scrub_stamp":"2024-03-04T13:13:54.676648+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:21:55.952257+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22063,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":10895,"num_write":937,"num_write_kb":21474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":494,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.120307+0000","last_change":"2024-03-04T13:13:38.120329+0000","last_active":"2024-03-04T13:13:38.120307+0000","last_peered":"2024-03-04T13:13:38.120307+0000","last_clean":"2024-03-04T13:13:38.120307+0000","last_became_active":"2024-03-04T12:20:18.834897+0000","last_became_peered":"2024-03-04T12:20:18.834897+0000","last_unstale":"2024-03-04T13:13:38.120307+0000","last_undegraded":"2024-03-04T13:13:38.120307+0000","last_fullsized":"2024-03-04T13:13:38.120307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:38.120219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:38.120219+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.120219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:32.193662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"255'162","reported_seq":747,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.118796+0000","last_change":"2024-03-04T12:20:20.839989+0000","last_active":"2024-03-04T13:13:21.118796+0000","last_peered":"2024-03-04T13:13:21.118796+0000","last_clean":"2024-03-04T13:13:21.118796+0000","last_became_active":"2024-03-04T12:20:20.839295+0000","last_became_peered":"2024-03-04T12:20:20.839295+0000","last_unstale":"2024-03-04T13:13:21.118796+0000","last_undegraded":"2024-03-04T13:13:21.118796+0000","last_fullsized":"2024-03-04T13:13:21.118796+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":221,"num_read_kb":283,"num_write":122,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"255'515","reported_seq":1905,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.842588+0000","last_change":"2024-03-04T13:13:45.842618+0000","last_active":"2024-03-04T13:13:45.842588+0000","last_peered":"2024-03-04T13:13:45.842588+0000","last_clean":"2024-03-04T13:13:45.842588+0000","last_became_active":"2024-03-04T12:20:22.852529+0000","last_became_peered":"2024-03-04T12:20:22.852529+0000","last_unstale":"2024-03-04T13:13:45.842588+0000","last_undegraded":"2024-03-04T13:13:45.842588+0000","last_fullsized":"2024-03-04T13:13:45.842588+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'515","last_scrub_stamp":"2024-03-04T13:13:45.842495+0000","last_deep_scrub":"255'515","last_deep_scrub_stamp":"2024-03-04T13:13:45.842495+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.842495+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:13.885952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"255'111","reported_seq":588,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.846625+0000","last_change":"2024-03-04T13:13:36.846656+0000","last_active":"2024-03-04T13:13:36.846625+0000","last_peered":"2024-03-04T13:13:36.846625+0000","last_clean":"2024-03-04T13:13:36.846625+0000","last_became_active":"2024-03-04T12:20:24.868076+0000","last_became_peered":"2024-03-04T12:20:24.868076+0000","last_unstale":"2024-03-04T13:13:36.846625+0000","last_undegraded":"2024-03-04T13:13:36.846625+0000","last_fullsized":"2024-03-04T13:13:36.846625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'111","last_scrub_stamp":"2024-03-04T13:13:36.846535+0000","last_deep_scrub":"255'111","last_deep_scrub_stamp":"2024-03-04T13:13:36.846535+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.846535+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:16.784713+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"255'364","reported_seq":1770,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:57.855931+0000","last_change":"2024-03-04T13:13:57.855979+0000","last_active":"2024-03-04T13:13:57.855931+0000","last_peered":"2024-03-04T13:13:57.855931+0000","last_clean":"2024-03-04T13:13:57.855931+0000","last_became_active":"2024-03-04T12:20:16.828738+0000","last_became_peered":"2024-03-04T12:20:16.828738+0000","last_unstale":"2024-03-04T13:13:57.855931+0000","last_undegraded":"2024-03-04T13:13:57.855931+0000","last_fullsized":"2024-03-04T13:13:57.855931+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'364","last_scrub_stamp":"2024-03-04T13:13:57.855799+0000","last_deep_scrub":"255'364","last_deep_scrub_stamp":"2024-03-04T13:13:57.855799+0000","last_clean_scrub_stamp":"2024-03-04T13:13:57.855799+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:44:40.462438+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1878,"num_read_kb":1794,"num_write":404,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"255'280","reported_seq":1008,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.237152+0000","last_change":"2024-03-04T12:20:14.824611+0000","last_active":"2024-03-04T13:13:21.237152+0000","last_peered":"2024-03-04T13:13:21.237152+0000","last_clean":"2024-03-04T13:13:21.237152+0000","last_became_active":"2024-03-04T12:20:14.824192+0000","last_became_peered":"2024-03-04T12:20:14.824192+0000","last_unstale":"2024-03-04T13:13:21.237152+0000","last_undegraded":"2024-03-04T13:13:21.237152+0000","last_fullsized":"2024-03-04T13:13:21.237152+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":790,"num_read_kb":21513,"num_write":1394,"num_write_kb":41658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":495,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.156608+0000","last_change":"2024-03-04T13:13:42.156653+0000","last_active":"2024-03-04T13:13:42.156608+0000","last_peered":"2024-03-04T13:13:42.156608+0000","last_clean":"2024-03-04T13:13:42.156608+0000","last_became_active":"2024-03-04T12:20:18.832483+0000","last_became_peered":"2024-03-04T12:20:18.832483+0000","last_unstale":"2024-03-04T13:13:42.156608+0000","last_undegraded":"2024-03-04T13:13:42.156608+0000","last_fullsized":"2024-03-04T13:13:42.156608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:42.156508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:42.156508+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.156508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:17.833533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"255'196","reported_seq":819,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:51.792179+0000","last_change":"2024-03-04T13:13:51.792222+0000","last_active":"2024-03-04T13:13:51.792179+0000","last_peered":"2024-03-04T13:13:51.792179+0000","last_clean":"2024-03-04T13:13:51.792179+0000","last_became_active":"2024-03-04T12:20:20.837748+0000","last_became_peered":"2024-03-04T12:20:20.837748+0000","last_unstale":"2024-03-04T13:13:51.792179+0000","last_undegraded":"2024-03-04T13:13:51.792179+0000","last_fullsized":"2024-03-04T13:13:51.792179+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'196","last_scrub_stamp":"2024-03-04T13:13:51.792082+0000","last_deep_scrub":"255'196","last_deep_scrub_stamp":"2024-03-04T13:13:51.792082+0000","last_clean_scrub_stamp":"2024-03-04T13:13:51.792082+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:41:44.458537+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13702,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":270,"num_read_kb":346,"num_write":130,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.133564+0000","last_change":"2024-03-04T13:13:30.133607+0000","last_active":"2024-03-04T13:13:30.133564+0000","last_peered":"2024-03-04T13:13:30.133564+0000","last_clean":"2024-03-04T13:13:30.133564+0000","last_became_active":"2024-03-04T12:20:22.849784+0000","last_became_peered":"2024-03-04T12:20:22.849784+0000","last_unstale":"2024-03-04T13:13:30.133564+0000","last_undegraded":"2024-03-04T13:13:30.133564+0000","last_fullsized":"2024-03-04T13:13:30.133564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:30.133463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:30.133463+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.133463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:20:55.533934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"255'100","reported_seq":618,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.759279+0000","last_change":"2024-03-04T13:13:38.759326+0000","last_active":"2024-03-04T13:13:38.759279+0000","last_peered":"2024-03-04T13:13:38.759279+0000","last_clean":"2024-03-04T13:13:38.759279+0000","last_became_active":"2024-03-04T12:20:24.864820+0000","last_became_peered":"2024-03-04T12:20:24.864820+0000","last_unstale":"2024-03-04T13:13:38.759279+0000","last_undegraded":"2024-03-04T13:13:38.759279+0000","last_fullsized":"2024-03-04T13:13:38.759279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'100","last_scrub_stamp":"2024-03-04T13:13:38.759166+0000","last_deep_scrub":"255'100","last_deep_scrub_stamp":"2024-03-04T13:13:38.759166+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.759166+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:12.515390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":165,"num_write":238,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"255'1124","reported_seq":2635,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:55.193384+0000","last_change":"2024-03-04T13:13:55.193418+0000","last_active":"2024-03-04T13:13:55.193384+0000","last_peered":"2024-03-04T13:13:55.193384+0000","last_clean":"2024-03-04T13:13:55.193384+0000","last_became_active":"2024-03-04T12:20:16.828486+0000","last_became_peered":"2024-03-04T12:20:16.828486+0000","last_unstale":"2024-03-04T13:13:55.193384+0000","last_undegraded":"2024-03-04T13:13:55.193384+0000","last_fullsized":"2024-03-04T13:13:55.193384+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1124","last_scrub_stamp":"2024-03-04T13:13:55.193291+0000","last_deep_scrub":"255'1124","last_deep_scrub_stamp":"2024-03-04T13:13:55.193291+0000","last_clean_scrub_stamp":"2024-03-04T13:13:55.193291+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":1100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:46:12.654903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4686,"num_read_kb":4085,"num_write":1549,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"255'242","reported_seq":878,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.228399+0000","last_change":"2024-03-04T12:20:14.817073+0000","last_active":"2024-03-04T13:13:21.228399+0000","last_peered":"2024-03-04T13:13:21.228399+0000","last_clean":"2024-03-04T13:13:21.228399+0000","last_became_active":"2024-03-04T12:20:14.816412+0000","last_became_peered":"2024-03-04T12:20:14.816412+0000","last_unstale":"2024-03-04T13:13:21.228399+0000","last_undegraded":"2024-03-04T13:13:21.228399+0000","last_fullsized":"2024-03-04T13:13:21.228399+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399147,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":515,"num_read_kb":1880,"num_write":1395,"num_write_kb":20590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":494,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.164999+0000","last_change":"2024-03-04T13:13:44.165023+0000","last_active":"2024-03-04T13:13:44.164999+0000","last_peered":"2024-03-04T13:13:44.164999+0000","last_clean":"2024-03-04T13:13:44.164999+0000","last_became_active":"2024-03-04T12:20:18.830763+0000","last_became_peered":"2024-03-04T12:20:18.830763+0000","last_unstale":"2024-03-04T13:13:44.164999+0000","last_undegraded":"2024-03-04T13:13:44.164999+0000","last_fullsized":"2024-03-04T13:13:44.164999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:44.164911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:44.164911+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.164911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:03:15.010672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"255'161","reported_seq":739,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.316302+0000","last_change":"2024-03-04T13:13:43.316350+0000","last_active":"2024-03-04T13:13:43.316302+0000","last_peered":"2024-03-04T13:13:43.316302+0000","last_clean":"2024-03-04T13:13:43.316302+0000","last_became_active":"2024-03-04T12:20:20.842216+0000","last_became_peered":"2024-03-04T12:20:20.842216+0000","last_unstale":"2024-03-04T13:13:43.316302+0000","last_undegraded":"2024-03-04T13:13:43.316302+0000","last_fullsized":"2024-03-04T13:13:43.316302+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'161","last_scrub_stamp":"2024-03-04T13:13:43.316208+0000","last_deep_scrub":"255'161","last_deep_scrub_stamp":"2024-03-04T13:13:43.316208+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.316208+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:40:50.582624+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7566,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":219,"num_read_kb":283,"num_write":166,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.835993+0000","last_change":"2024-03-04T13:13:43.836017+0000","last_active":"2024-03-04T13:13:43.835993+0000","last_peered":"2024-03-04T13:13:43.835993+0000","last_clean":"2024-03-04T13:13:43.835993+0000","last_became_active":"2024-03-04T12:20:22.855480+0000","last_became_peered":"2024-03-04T12:20:22.855480+0000","last_unstale":"2024-03-04T13:13:43.835993+0000","last_undegraded":"2024-03-04T13:13:43.835993+0000","last_fullsized":"2024-03-04T13:13:43.835993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:43.835903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:43.835903+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.835903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:52:33.201007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"255'90","reported_seq":573,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.877755+0000","last_change":"2024-03-04T13:13:39.877785+0000","last_active":"2024-03-04T13:13:39.877755+0000","last_peered":"2024-03-04T13:13:39.877755+0000","last_clean":"2024-03-04T13:13:39.877755+0000","last_became_active":"2024-03-04T12:20:24.864982+0000","last_became_peered":"2024-03-04T12:20:24.864982+0000","last_unstale":"2024-03-04T13:13:39.877755+0000","last_undegraded":"2024-03-04T13:13:39.877755+0000","last_fullsized":"2024-03-04T13:13:39.877755+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'90","last_scrub_stamp":"2024-03-04T13:13:39.877674+0000","last_deep_scrub":"255'90","last_deep_scrub_stamp":"2024-03-04T13:13:39.877674+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.877674+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:48:00.079117+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":209,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"255'388","reported_seq":1747,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.301924+0000","last_change":"2024-03-04T13:13:47.301955+0000","last_active":"2024-03-04T13:13:47.301924+0000","last_peered":"2024-03-04T13:13:47.301924+0000","last_clean":"2024-03-04T13:13:47.301924+0000","last_became_active":"2024-03-04T12:20:16.824033+0000","last_became_peered":"2024-03-04T12:20:16.824033+0000","last_unstale":"2024-03-04T13:13:47.301924+0000","last_undegraded":"2024-03-04T13:13:47.301924+0000","last_fullsized":"2024-03-04T13:13:47.301924+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'388","last_scrub_stamp":"2024-03-04T13:13:47.301839+0000","last_deep_scrub":"255'388","last_deep_scrub_stamp":"2024-03-04T13:13:47.301839+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.301839+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:10:35.029482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1899,"num_read_kb":1781,"num_write":448,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"255'224","reported_seq":848,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:57.753735+0000","last_change":"2024-03-04T13:13:57.753778+0000","last_active":"2024-03-04T13:13:57.753735+0000","last_peered":"2024-03-04T13:13:57.753735+0000","last_clean":"2024-03-04T13:13:57.753735+0000","last_became_active":"2024-03-04T12:20:14.818461+0000","last_became_peered":"2024-03-04T12:20:14.818461+0000","last_unstale":"2024-03-04T13:13:57.753735+0000","last_undegraded":"2024-03-04T13:13:57.753735+0000","last_fullsized":"2024-03-04T13:13:57.753735+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'224","last_scrub_stamp":"2024-03-04T13:13:57.753636+0000","last_deep_scrub":"255'224","last_deep_scrub_stamp":"2024-03-04T13:13:57.753636+0000","last_clean_scrub_stamp":"2024-03-04T13:13:57.753636+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:15:52.875371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":446,"num_read_kb":17082,"num_write":1054,"num_write_kb":47848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":494,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.702606+0000","last_change":"2024-03-04T13:13:45.702630+0000","last_active":"2024-03-04T13:13:45.702606+0000","last_peered":"2024-03-04T13:13:45.702606+0000","last_clean":"2024-03-04T13:13:45.702606+0000","last_became_active":"2024-03-04T12:20:18.837494+0000","last_became_peered":"2024-03-04T12:20:18.837494+0000","last_unstale":"2024-03-04T13:13:45.702606+0000","last_undegraded":"2024-03-04T13:13:45.702606+0000","last_fullsized":"2024-03-04T13:13:45.702606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:45.702512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:45.702512+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.702512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:28:39.385988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"255'178","reported_seq":764,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.099896+0000","last_change":"2024-03-04T13:13:32.099947+0000","last_active":"2024-03-04T13:13:32.099896+0000","last_peered":"2024-03-04T13:13:32.099896+0000","last_clean":"2024-03-04T13:13:32.099896+0000","last_became_active":"2024-03-04T12:20:20.841801+0000","last_became_peered":"2024-03-04T12:20:20.841801+0000","last_unstale":"2024-03-04T13:13:32.099896+0000","last_undegraded":"2024-03-04T13:13:32.099896+0000","last_fullsized":"2024-03-04T13:13:32.099896+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'178","last_scrub_stamp":"2024-03-04T13:13:32.099796+0000","last_deep_scrub":"255'178","last_deep_scrub_stamp":"2024-03-04T13:13:32.099796+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.099796+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:16.653547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7601,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":303,"num_write":134,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"255'492","reported_seq":1894,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.133143+0000","last_change":"2024-03-04T13:13:29.133166+0000","last_active":"2024-03-04T13:13:29.133143+0000","last_peered":"2024-03-04T13:13:29.133143+0000","last_clean":"2024-03-04T13:13:29.133143+0000","last_became_active":"2024-03-04T12:20:22.857578+0000","last_became_peered":"2024-03-04T12:20:22.857578+0000","last_unstale":"2024-03-04T13:13:29.133143+0000","last_undegraded":"2024-03-04T13:13:29.133143+0000","last_fullsized":"2024-03-04T13:13:29.133143+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'492","last_scrub_stamp":"2024-03-04T13:13:29.133074+0000","last_deep_scrub":"255'492","last_deep_scrub_stamp":"2024-03-04T13:13:29.133074+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.133074+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:25.680835+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"255'110","reported_seq":601,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.731985+0000","last_change":"2024-03-04T13:13:36.732015+0000","last_active":"2024-03-04T13:13:36.731985+0000","last_peered":"2024-03-04T13:13:36.731985+0000","last_clean":"2024-03-04T13:13:36.731985+0000","last_became_active":"2024-03-04T12:20:24.867482+0000","last_became_peered":"2024-03-04T12:20:24.867482+0000","last_unstale":"2024-03-04T13:13:36.731985+0000","last_undegraded":"2024-03-04T13:13:36.731985+0000","last_fullsized":"2024-03-04T13:13:36.731985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'110","last_scrub_stamp":"2024-03-04T13:13:36.731895+0000","last_deep_scrub":"255'110","last_deep_scrub_stamp":"2024-03-04T13:13:36.731895+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.731895+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:44:42.326028+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":731,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":256,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"255'343","reported_seq":1944,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:18.077672+0000","last_change":"2024-03-04T12:20:16.819106+0000","last_active":"2024-03-04T13:12:18.077672+0000","last_peered":"2024-03-04T13:12:18.077672+0000","last_clean":"2024-03-04T13:12:18.077672+0000","last_became_active":"2024-03-04T12:20:16.818795+0000","last_became_peered":"2024-03-04T12:20:16.818795+0000","last_unstale":"2024-03-04T13:12:18.077672+0000","last_undegraded":"2024-03-04T13:12:18.077672+0000","last_fullsized":"2024-03-04T13:12:18.077672+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2162,"num_read_kb":2105,"num_write":376,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"255'221","reported_seq":849,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:04.118610+0000","last_change":"2024-03-04T13:14:04.118639+0000","last_active":"2024-03-04T13:14:04.118610+0000","last_peered":"2024-03-04T13:14:04.118610+0000","last_clean":"2024-03-04T13:14:04.118610+0000","last_became_active":"2024-03-04T12:20:14.817859+0000","last_became_peered":"2024-03-04T12:20:14.817859+0000","last_unstale":"2024-03-04T13:14:04.118610+0000","last_undegraded":"2024-03-04T13:14:04.118610+0000","last_fullsized":"2024-03-04T13:14:04.118610+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'221","last_scrub_stamp":"2024-03-04T13:14:04.118528+0000","last_deep_scrub":"255'221","last_deep_scrub_stamp":"2024-03-04T13:14:04.118528+0000","last_clean_scrub_stamp":"2024-03-04T13:14:04.118528+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:23:25.440483+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":387,"num_read_kb":14098,"num_write":1105,"num_write_kb":34013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"255'4","reported_seq":1112,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:57.474109+0000","last_change":"2024-03-04T13:13:57.474142+0000","last_active":"2024-03-04T13:13:57.474109+0000","last_peered":"2024-03-04T13:13:57.474109+0000","last_clean":"2024-03-04T13:13:57.474109+0000","last_became_active":"2024-03-04T12:20:18.838389+0000","last_became_peered":"2024-03-04T12:20:18.838389+0000","last_unstale":"2024-03-04T13:13:57.474109+0000","last_undegraded":"2024-03-04T13:13:57.474109+0000","last_fullsized":"2024-03-04T13:13:57.474109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'4","last_scrub_stamp":"2024-03-04T13:13:57.474023+0000","last_deep_scrub":"255'4","last_deep_scrub_stamp":"2024-03-04T13:13:57.474023+0000","last_clean_scrub_stamp":"2024-03-04T13:13:57.474023+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:27.824010+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":615,"num_read_kb":615,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"255'106","reported_seq":622,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:50.881269+0000","last_change":"2024-03-04T13:13:50.881301+0000","last_active":"2024-03-04T13:13:50.881269+0000","last_peered":"2024-03-04T13:13:50.881269+0000","last_clean":"2024-03-04T13:13:50.881269+0000","last_became_active":"2024-03-04T12:20:21.641809+0000","last_became_peered":"2024-03-04T12:20:21.641809+0000","last_unstale":"2024-03-04T13:13:50.881269+0000","last_undegraded":"2024-03-04T13:13:50.881269+0000","last_fullsized":"2024-03-04T13:13:50.881269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'106","last_scrub_stamp":"2024-03-04T13:13:50.881190+0000","last_deep_scrub":"255'106","last_deep_scrub_stamp":"2024-03-04T13:13:50.881190+0000","last_clean_scrub_stamp":"2024-03-04T13:13:50.881190+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:28.284478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":103,"num_read_kb":92,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"255'498","reported_seq":2287,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.759473+0000","last_change":"2024-03-04T13:13:38.759513+0000","last_active":"2024-03-04T13:13:38.759473+0000","last_peered":"2024-03-04T13:13:38.759473+0000","last_clean":"2024-03-04T13:13:38.759473+0000","last_became_active":"2024-03-04T12:20:22.849288+0000","last_became_peered":"2024-03-04T12:20:22.849288+0000","last_unstale":"2024-03-04T13:13:38.759473+0000","last_undegraded":"2024-03-04T13:13:38.759473+0000","last_fullsized":"2024-03-04T13:13:38.759473+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'498","last_scrub_stamp":"2024-03-04T13:13:38.759380+0000","last_deep_scrub":"255'498","last_deep_scrub_stamp":"2024-03-04T13:13:38.759380+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.759380+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:44:22.451253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"255'88","reported_seq":581,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.175491+0000","last_change":"2024-03-04T13:13:34.175521+0000","last_active":"2024-03-04T13:13:34.175491+0000","last_peered":"2024-03-04T13:13:34.175491+0000","last_clean":"2024-03-04T13:13:34.175491+0000","last_became_active":"2024-03-04T12:20:24.870568+0000","last_became_peered":"2024-03-04T12:20:24.870568+0000","last_unstale":"2024-03-04T13:13:34.175491+0000","last_undegraded":"2024-03-04T13:13:34.175491+0000","last_fullsized":"2024-03-04T13:13:34.175491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'88","last_scrub_stamp":"2024-03-04T13:13:34.175404+0000","last_deep_scrub":"255'88","last_deep_scrub_stamp":"2024-03-04T13:13:34.175404+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.175404+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:42:46.985410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":82,"num_read_kb":81,"num_write":219,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"255'300","reported_seq":1667,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:48.715817+0000","last_change":"2024-03-04T13:13:48.715892+0000","last_active":"2024-03-04T13:13:48.715817+0000","last_peered":"2024-03-04T13:13:48.715817+0000","last_clean":"2024-03-04T13:13:48.715817+0000","last_became_active":"2024-03-04T12:20:16.831001+0000","last_became_peered":"2024-03-04T12:20:16.831001+0000","last_unstale":"2024-03-04T13:13:48.715817+0000","last_undegraded":"2024-03-04T13:13:48.715817+0000","last_fullsized":"2024-03-04T13:13:48.715817+0000","mapping_epoch":22,"log_start":"255'200","ondisk_log_start":"255'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'300","last_scrub_stamp":"2024-03-04T13:13:48.715709+0000","last_deep_scrub":"255'300","last_deep_scrub_stamp":"2024-03-04T13:13:48.715709+0000","last_clean_scrub_stamp":"2024-03-04T13:13:48.715709+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:48:05.812832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1692,"num_read_kb":1639,"num_write":326,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":303,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"255'199","reported_seq":822,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.222514+0000","last_change":"2024-03-04T12:20:14.813162+0000","last_active":"2024-03-04T13:13:21.222514+0000","last_peered":"2024-03-04T13:13:21.222514+0000","last_clean":"2024-03-04T13:13:21.222514+0000","last_became_active":"2024-03-04T12:20:14.812881+0000","last_became_peered":"2024-03-04T12:20:14.812881+0000","last_unstale":"2024-03-04T13:13:21.222514+0000","last_undegraded":"2024-03-04T13:13:21.222514+0000","last_fullsized":"2024-03-04T13:13:21.222514+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6401060,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":24185,"num_write":1082,"num_write_kb":42346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:07.517781+0000","last_change":"2024-03-04T12:20:18.836790+0000","last_active":"2024-03-04T13:12:07.517781+0000","last_peered":"2024-03-04T13:12:07.517781+0000","last_clean":"2024-03-04T13:12:07.517781+0000","last_became_active":"2024-03-04T12:20:18.836493+0000","last_became_peered":"2024-03-04T12:20:18.836493+0000","last_unstale":"2024-03-04T13:12:07.517781+0000","last_undegraded":"2024-03-04T13:12:07.517781+0000","last_fullsized":"2024-03-04T13:12:07.517781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:17.810612+0000","last_clean_scrub_stamp":"2024-03-04T12:20:17.810612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"255'249","reported_seq":847,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.075144+0000","last_change":"2024-03-04T12:20:20.839419+0000","last_active":"2024-03-04T13:13:21.075144+0000","last_peered":"2024-03-04T13:13:21.075144+0000","last_clean":"2024-03-04T13:13:21.075144+0000","last_became_active":"2024-03-04T12:20:20.839079+0000","last_became_peered":"2024-03-04T12:20:20.839079+0000","last_unstale":"2024-03-04T13:13:21.075144+0000","last_undegraded":"2024-03-04T13:13:21.075144+0000","last_fullsized":"2024-03-04T13:13:21.075144+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7172,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":931,"num_read_kb":985,"num_write":1462,"num_write_kb":1319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":488,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.767230+0000","last_change":"2024-03-04T13:13:46.767253+0000","last_active":"2024-03-04T13:13:46.767230+0000","last_peered":"2024-03-04T13:13:46.767230+0000","last_clean":"2024-03-04T13:13:46.767230+0000","last_became_active":"2024-03-04T12:20:22.854860+0000","last_became_peered":"2024-03-04T12:20:22.854860+0000","last_unstale":"2024-03-04T13:13:46.767230+0000","last_undegraded":"2024-03-04T13:13:46.767230+0000","last_fullsized":"2024-03-04T13:13:46.767230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:46.767143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:46.767143+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.767143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:00:22.051997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"255'105","reported_seq":594,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.715961+0000","last_change":"2024-03-04T13:13:37.716009+0000","last_active":"2024-03-04T13:13:37.715961+0000","last_peered":"2024-03-04T13:13:37.715961+0000","last_clean":"2024-03-04T13:13:37.715961+0000","last_became_active":"2024-03-04T12:20:24.865830+0000","last_became_peered":"2024-03-04T12:20:24.865830+0000","last_unstale":"2024-03-04T13:13:37.715961+0000","last_undegraded":"2024-03-04T13:13:37.715961+0000","last_fullsized":"2024-03-04T13:13:37.715961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'105","last_scrub_stamp":"2024-03-04T13:13:37.715816+0000","last_deep_scrub":"255'105","last_deep_scrub_stamp":"2024-03-04T13:13:37.715816+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.715816+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:49:50.861340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":242,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"255'320","reported_seq":1706,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.723283+0000","last_change":"2024-03-04T13:13:47.723315+0000","last_active":"2024-03-04T13:13:47.723283+0000","last_peered":"2024-03-04T13:13:47.723283+0000","last_clean":"2024-03-04T13:13:47.723283+0000","last_became_active":"2024-03-04T12:20:16.821495+0000","last_became_peered":"2024-03-04T12:20:16.821495+0000","last_unstale":"2024-03-04T13:13:47.723283+0000","last_undegraded":"2024-03-04T13:13:47.723283+0000","last_fullsized":"2024-03-04T13:13:47.723283+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'320","last_scrub_stamp":"2024-03-04T13:13:47.723196+0000","last_deep_scrub":"255'320","last_deep_scrub_stamp":"2024-03-04T13:13:47.723196+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.723196+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:06:36.776088+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1811,"num_read_kb":1736,"num_write":364,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"255'119","reported_seq":675,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:05.651370+0000","last_change":"2024-03-04T13:14:05.651445+0000","last_active":"2024-03-04T13:14:05.651370+0000","last_peered":"2024-03-04T13:14:05.651370+0000","last_clean":"2024-03-04T13:14:05.651370+0000","last_became_active":"2024-03-04T12:19:58.806723+0000","last_became_peered":"2024-03-04T12:19:58.806723+0000","last_unstale":"2024-03-04T13:14:05.651370+0000","last_undegraded":"2024-03-04T13:14:05.651370+0000","last_fullsized":"2024-03-04T13:14:05.651370+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'119","last_scrub_stamp":"2024-03-04T13:14:05.651262+0000","last_deep_scrub":"255'119","last_deep_scrub_stamp":"2024-03-04T13:14:05.651262+0000","last_clean_scrub_stamp":"2024-03-04T13:14:05.651262+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:33:10.900494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":509,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:01.490402+0000","last_change":"2024-03-04T13:14:01.490463+0000","last_active":"2024-03-04T13:14:01.490402+0000","last_peered":"2024-03-04T13:14:01.490402+0000","last_clean":"2024-03-04T13:14:01.490402+0000","last_became_active":"2024-03-04T12:20:05.782921+0000","last_became_peered":"2024-03-04T12:20:05.782921+0000","last_unstale":"2024-03-04T13:14:01.490402+0000","last_undegraded":"2024-03-04T13:14:01.490402+0000","last_fullsized":"2024-03-04T13:14:01.490402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:01.490265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:01.490265+0000","last_clean_scrub_stamp":"2024-03-04T13:14:01.490265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:29:22.268150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"255'178","reported_seq":800,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.130255+0000","last_change":"2024-03-04T13:13:37.130302+0000","last_active":"2024-03-04T13:13:37.130255+0000","last_peered":"2024-03-04T13:13:37.130255+0000","last_clean":"2024-03-04T13:13:37.130255+0000","last_became_active":"2024-03-04T12:20:51.031720+0000","last_became_peered":"2024-03-04T12:20:51.031720+0000","last_unstale":"2024-03-04T13:13:37.130255+0000","last_undegraded":"2024-03-04T13:13:37.130255+0000","last_fullsized":"2024-03-04T13:13:37.130255+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'178","last_scrub_stamp":"2024-03-04T13:13:37.130170+0000","last_deep_scrub":"255'178","last_deep_scrub_stamp":"2024-03-04T13:13:37.130170+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.130170+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:49.252189+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263538,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":417,"num_read_kb":68206,"num_write":949,"num_write_kb":44048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":502,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:53.652996+0000","last_change":"2024-03-04T13:13:53.653020+0000","last_active":"2024-03-04T13:13:53.652996+0000","last_peered":"2024-03-04T13:13:53.652996+0000","last_clean":"2024-03-04T13:13:53.652996+0000","last_became_active":"2024-03-04T12:20:18.829703+0000","last_became_peered":"2024-03-04T12:20:18.829703+0000","last_unstale":"2024-03-04T13:13:53.652996+0000","last_undegraded":"2024-03-04T13:13:53.652996+0000","last_fullsized":"2024-03-04T13:13:53.652996+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:53.652902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:53.652902+0000","last_clean_scrub_stamp":"2024-03-04T13:13:53.652902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:20:37.667790+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"255'316","reported_seq":1013,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.439093+0000","last_change":"2024-03-04T13:13:44.439132+0000","last_active":"2024-03-04T13:13:44.439093+0000","last_peered":"2024-03-04T13:13:44.439093+0000","last_clean":"2024-03-04T13:13:44.439093+0000","last_became_active":"2024-03-04T12:20:20.842433+0000","last_became_peered":"2024-03-04T12:20:20.842433+0000","last_unstale":"2024-03-04T13:13:44.439093+0000","last_undegraded":"2024-03-04T13:13:44.439093+0000","last_fullsized":"2024-03-04T13:13:44.439093+0000","mapping_epoch":26,"log_start":"255'300","ondisk_log_start":"255'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'316","last_scrub_stamp":"2024-03-04T13:13:44.439002+0000","last_deep_scrub":"255'316","last_deep_scrub_stamp":"2024-03-04T13:13:44.439002+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.439002+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:32:03.395404+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34072,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":590,"num_read_kb":823,"num_write":540,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99764,"num_omap_keys":240,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:48.776759+0000","last_change":"2024-03-04T13:13:48.776783+0000","last_active":"2024-03-04T13:13:48.776759+0000","last_peered":"2024-03-04T13:13:48.776759+0000","last_clean":"2024-03-04T13:13:48.776759+0000","last_became_active":"2024-03-04T12:20:22.849274+0000","last_became_peered":"2024-03-04T12:20:22.849274+0000","last_unstale":"2024-03-04T13:13:48.776759+0000","last_undegraded":"2024-03-04T13:13:48.776759+0000","last_fullsized":"2024-03-04T13:13:48.776759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:48.776653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:48.776653+0000","last_clean_scrub_stamp":"2024-03-04T13:13:48.776653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:51:15.720776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"255'110","reported_seq":609,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:50.728576+0000","last_change":"2024-03-04T13:13:50.728645+0000","last_active":"2024-03-04T13:13:50.728576+0000","last_peered":"2024-03-04T13:13:50.728576+0000","last_clean":"2024-03-04T13:13:50.728576+0000","last_became_active":"2024-03-04T12:20:24.864796+0000","last_became_peered":"2024-03-04T12:20:24.864796+0000","last_unstale":"2024-03-04T13:13:50.728576+0000","last_undegraded":"2024-03-04T13:13:50.728576+0000","last_fullsized":"2024-03-04T13:13:50.728576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'110","last_scrub_stamp":"2024-03-04T13:13:50.728462+0000","last_deep_scrub":"255'110","last_deep_scrub_stamp":"2024-03-04T13:13:50.728462+0000","last_clean_scrub_stamp":"2024-03-04T13:13:50.728462+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:01.552749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":748,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":267,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"255'392","reported_seq":1924,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:56.806910+0000","last_change":"2024-03-04T13:13:56.806941+0000","last_active":"2024-03-04T13:13:56.806910+0000","last_peered":"2024-03-04T13:13:56.806910+0000","last_clean":"2024-03-04T13:13:56.806910+0000","last_became_active":"2024-03-04T12:20:16.836050+0000","last_became_peered":"2024-03-04T12:20:16.836050+0000","last_unstale":"2024-03-04T13:13:56.806910+0000","last_undegraded":"2024-03-04T13:13:56.806910+0000","last_fullsized":"2024-03-04T13:13:56.806910+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'392","last_scrub_stamp":"2024-03-04T13:13:56.806820+0000","last_deep_scrub":"255'392","last_deep_scrub_stamp":"2024-03-04T13:13:56.806820+0000","last_clean_scrub_stamp":"2024-03-04T13:13:56.806820+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:59:44.442344+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2110,"num_read_kb":2020,"num_write":444,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":517,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:06.685271+0000","last_change":"2024-03-04T13:14:06.685299+0000","last_active":"2024-03-04T13:14:06.685271+0000","last_peered":"2024-03-04T13:14:06.685271+0000","last_clean":"2024-03-04T13:14:06.685271+0000","last_became_active":"2024-03-04T12:20:05.781199+0000","last_became_peered":"2024-03-04T12:20:05.781199+0000","last_unstale":"2024-03-04T13:14:06.685271+0000","last_undegraded":"2024-03-04T13:14:06.685271+0000","last_fullsized":"2024-03-04T13:14:06.685271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:06.685171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:06.685171+0000","last_clean_scrub_stamp":"2024-03-04T13:14:06.685171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:51:27.875527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"255'204","reported_seq":829,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.122048+0000","last_change":"2024-03-04T12:20:14.821799+0000","last_active":"2024-03-04T13:13:21.122048+0000","last_peered":"2024-03-04T13:13:21.122048+0000","last_clean":"2024-03-04T13:13:21.122048+0000","last_became_active":"2024-03-04T12:20:14.821540+0000","last_became_peered":"2024-03-04T12:20:14.821540+0000","last_unstale":"2024-03-04T13:13:21.122048+0000","last_undegraded":"2024-03-04T13:13:21.122048+0000","last_fullsized":"2024-03-04T13:13:21.122048+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":43110,"num_write":1111,"num_write_kb":41335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:51.385585+0000","last_change":"2024-03-04T13:13:51.385622+0000","last_active":"2024-03-04T13:13:51.385585+0000","last_peered":"2024-03-04T13:13:51.385585+0000","last_clean":"2024-03-04T13:13:51.385585+0000","last_became_active":"2024-03-04T12:20:18.835509+0000","last_became_peered":"2024-03-04T12:20:18.835509+0000","last_unstale":"2024-03-04T13:13:51.385585+0000","last_undegraded":"2024-03-04T13:13:51.385585+0000","last_fullsized":"2024-03-04T13:13:51.385585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:51.385481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:51.385481+0000","last_clean_scrub_stamp":"2024-03-04T13:13:51.385481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:52:30.322296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"255'719","reported_seq":2202,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:51.693254+0000","last_change":"2024-03-04T13:13:51.693312+0000","last_active":"2024-03-04T13:13:51.693254+0000","last_peered":"2024-03-04T13:13:51.693254+0000","last_clean":"2024-03-04T13:13:51.693254+0000","last_became_active":"2024-03-04T12:20:20.838633+0000","last_became_peered":"2024-03-04T12:20:20.838633+0000","last_unstale":"2024-03-04T13:13:51.693254+0000","last_undegraded":"2024-03-04T13:13:51.693254+0000","last_fullsized":"2024-03-04T13:13:51.693254+0000","mapping_epoch":26,"log_start":"255'700","ondisk_log_start":"255'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'719","last_scrub_stamp":"2024-03-04T13:13:51.693161+0000","last_deep_scrub":"255'719","last_deep_scrub_stamp":"2024-03-04T13:13:51.693161+0000","last_clean_scrub_stamp":"2024-03-04T13:13:51.693161+0000","objects_scrubbed":12,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:44.062786+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24617,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":974,"num_read_kb":1199,"num_write":350,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":494,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.529369+0000","last_change":"2024-03-04T13:13:44.529392+0000","last_active":"2024-03-04T13:13:44.529369+0000","last_peered":"2024-03-04T13:13:44.529369+0000","last_clean":"2024-03-04T13:13:44.529369+0000","last_became_active":"2024-03-04T12:20:22.848403+0000","last_became_peered":"2024-03-04T12:20:22.848403+0000","last_unstale":"2024-03-04T13:13:44.529369+0000","last_undegraded":"2024-03-04T13:13:44.529369+0000","last_fullsized":"2024-03-04T13:13:44.529369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:44.529234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:44.529234+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.529234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:44.260150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"255'85","reported_seq":581,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.771086+0000","last_change":"2024-03-04T13:13:34.771117+0000","last_active":"2024-03-04T13:13:34.771086+0000","last_peered":"2024-03-04T13:13:34.771086+0000","last_clean":"2024-03-04T13:13:34.771086+0000","last_became_active":"2024-03-04T12:20:24.911303+0000","last_became_peered":"2024-03-04T12:20:24.911303+0000","last_unstale":"2024-03-04T13:13:34.771086+0000","last_undegraded":"2024-03-04T13:13:34.771086+0000","last_fullsized":"2024-03-04T13:13:34.771086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'85","last_scrub_stamp":"2024-03-04T13:13:34.770979+0000","last_deep_scrub":"255'85","last_deep_scrub_stamp":"2024-03-04T13:13:34.770979+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.770979+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:29.877688+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":85,"num_write":192,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"255'417","reported_seq":2059,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:52.689279+0000","last_change":"2024-03-04T13:13:52.689303+0000","last_active":"2024-03-04T13:13:52.689279+0000","last_peered":"2024-03-04T13:13:52.689279+0000","last_clean":"2024-03-04T13:13:52.689279+0000","last_became_active":"2024-03-04T12:20:16.827513+0000","last_became_peered":"2024-03-04T12:20:16.827513+0000","last_unstale":"2024-03-04T13:13:52.689279+0000","last_undegraded":"2024-03-04T13:13:52.689279+0000","last_fullsized":"2024-03-04T13:13:52.689279+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'417","last_scrub_stamp":"2024-03-04T13:13:52.689179+0000","last_deep_scrub":"255'417","last_deep_scrub_stamp":"2024-03-04T13:13:52.689179+0000","last_clean_scrub_stamp":"2024-03-04T13:13:52.689179+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:04:38.477298+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2343,"num_read_kb":2241,"num_write":475,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":510,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.131693+0000","last_change":"2024-03-04T13:13:45.131715+0000","last_active":"2024-03-04T13:13:45.131693+0000","last_peered":"2024-03-04T13:13:45.131693+0000","last_clean":"2024-03-04T13:13:45.131693+0000","last_became_active":"2024-03-04T12:20:05.863125+0000","last_became_peered":"2024-03-04T12:20:05.863125+0000","last_unstale":"2024-03-04T13:13:45.131693+0000","last_undegraded":"2024-03-04T13:13:45.131693+0000","last_fullsized":"2024-03-04T13:13:45.131693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:45.131601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:45.131601+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.131601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:46.397851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"255'170","reported_seq":760,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:01.653710+0000","last_change":"2024-03-04T13:14:01.653765+0000","last_active":"2024-03-04T13:14:01.653710+0000","last_peered":"2024-03-04T13:14:01.653710+0000","last_clean":"2024-03-04T13:14:01.653710+0000","last_became_active":"2024-03-04T12:20:14.812722+0000","last_became_peered":"2024-03-04T12:20:14.812722+0000","last_unstale":"2024-03-04T13:14:01.653710+0000","last_undegraded":"2024-03-04T13:14:01.653710+0000","last_fullsized":"2024-03-04T13:14:01.653710+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'170","last_scrub_stamp":"2024-03-04T13:14:01.653613+0000","last_deep_scrub":"255'170","last_deep_scrub_stamp":"2024-03-04T13:14:01.653613+0000","last_clean_scrub_stamp":"2024-03-04T13:14:01.653613+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:06:11.051731+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1982965,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":309,"num_read_kb":18084,"num_write":975,"num_write_kb":46336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"255'2","reported_seq":497,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.077673+0000","last_change":"2024-03-04T13:13:36.077712+0000","last_active":"2024-03-04T13:13:36.077673+0000","last_peered":"2024-03-04T13:13:36.077673+0000","last_clean":"2024-03-04T13:13:36.077673+0000","last_became_active":"2024-03-04T12:20:18.839038+0000","last_became_peered":"2024-03-04T12:20:18.839038+0000","last_unstale":"2024-03-04T13:13:36.077673+0000","last_undegraded":"2024-03-04T13:13:36.077673+0000","last_fullsized":"2024-03-04T13:13:36.077673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:36.077585+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:36.077585+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.077585+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:17:39.483287+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"255'254","reported_seq":1434,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.539031+0000","last_change":"2024-03-04T13:13:46.539075+0000","last_active":"2024-03-04T13:13:46.539031+0000","last_peered":"2024-03-04T13:13:46.539031+0000","last_clean":"2024-03-04T13:13:46.539031+0000","last_became_active":"2024-03-04T12:20:21.643475+0000","last_became_peered":"2024-03-04T12:20:21.643475+0000","last_unstale":"2024-03-04T13:13:46.539031+0000","last_undegraded":"2024-03-04T13:13:46.539031+0000","last_fullsized":"2024-03-04T13:13:46.539031+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'254","last_scrub_stamp":"2024-03-04T13:13:46.538942+0000","last_deep_scrub":"255'254","last_deep_scrub_stamp":"2024-03-04T13:13:46.538942+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.538942+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:43:06.071914+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":203,"num_write":195,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.908956+0000","last_change":"2024-03-04T13:13:44.908979+0000","last_active":"2024-03-04T13:13:44.908956+0000","last_peered":"2024-03-04T13:13:44.908956+0000","last_clean":"2024-03-04T13:13:44.908956+0000","last_became_active":"2024-03-04T12:20:22.854343+0000","last_became_peered":"2024-03-04T12:20:22.854343+0000","last_unstale":"2024-03-04T13:13:44.908956+0000","last_undegraded":"2024-03-04T13:13:44.908956+0000","last_fullsized":"2024-03-04T13:13:44.908956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:44.908863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:44.908863+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.908863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:14.482523+0000","scrub_duration":96,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"255'189","reported_seq":709,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.828291+0000","last_change":"2024-03-04T13:13:38.828319+0000","last_active":"2024-03-04T13:13:38.828291+0000","last_peered":"2024-03-04T13:13:38.828291+0000","last_clean":"2024-03-04T13:13:38.828291+0000","last_became_active":"2024-03-04T12:20:24.871020+0000","last_became_peered":"2024-03-04T12:20:24.871020+0000","last_unstale":"2024-03-04T13:13:38.828291+0000","last_undegraded":"2024-03-04T13:13:38.828291+0000","last_fullsized":"2024-03-04T13:13:38.828291+0000","mapping_epoch":30,"log_start":"250'100","ondisk_log_start":"250'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'189","last_scrub_stamp":"2024-03-04T13:13:38.828189+0000","last_deep_scrub":"255'189","last_deep_scrub_stamp":"2024-03-04T13:13:38.828189+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.828189+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:40:40.968338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":353,"num_read_kb":362,"num_write":419,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"255'389","reported_seq":1863,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:56.685688+0000","last_change":"2024-03-04T13:13:56.685752+0000","last_active":"2024-03-04T13:13:56.685688+0000","last_peered":"2024-03-04T13:13:56.685688+0000","last_clean":"2024-03-04T13:13:56.685688+0000","last_became_active":"2024-03-04T12:20:16.825006+0000","last_became_peered":"2024-03-04T12:20:16.825006+0000","last_unstale":"2024-03-04T13:13:56.685688+0000","last_undegraded":"2024-03-04T13:13:56.685688+0000","last_fullsized":"2024-03-04T13:13:56.685688+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'389","last_scrub_stamp":"2024-03-04T13:13:56.685580+0000","last_deep_scrub":"255'389","last_deep_scrub_stamp":"2024-03-04T13:13:56.685580+0000","last_clean_scrub_stamp":"2024-03-04T13:13:56.685580+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:20.735041+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2027,"num_read_kb":1928,"num_write":438,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":509,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:02.516286+0000","last_change":"2024-03-04T13:14:02.516339+0000","last_active":"2024-03-04T13:14:02.516286+0000","last_peered":"2024-03-04T13:14:02.516286+0000","last_clean":"2024-03-04T13:14:02.516286+0000","last_became_active":"2024-03-04T12:20:05.782897+0000","last_became_peered":"2024-03-04T12:20:05.782897+0000","last_unstale":"2024-03-04T13:14:02.516286+0000","last_undegraded":"2024-03-04T13:14:02.516286+0000","last_fullsized":"2024-03-04T13:14:02.516286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:02.516187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:02.516187+0000","last_clean_scrub_stamp":"2024-03-04T13:14:02.516187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:52.573403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"255'203","reported_seq":886,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:07.190991+0000","last_change":"2024-03-04T13:14:07.191031+0000","last_active":"2024-03-04T13:14:07.190991+0000","last_peered":"2024-03-04T13:14:07.190991+0000","last_clean":"2024-03-04T13:14:07.190991+0000","last_became_active":"2024-03-04T12:20:14.824810+0000","last_became_peered":"2024-03-04T12:20:14.824810+0000","last_unstale":"2024-03-04T13:14:07.190991+0000","last_undegraded":"2024-03-04T13:14:07.190991+0000","last_fullsized":"2024-03-04T13:14:07.190991+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'203","last_scrub_stamp":"2024-03-04T13:14:07.190908+0000","last_deep_scrub":"255'203","last_deep_scrub_stamp":"2024-03-04T13:14:07.190908+0000","last_clean_scrub_stamp":"2024-03-04T13:14:07.190908+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:16:11.443313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3544974,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":19088,"num_write":1144,"num_write_kb":38256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:00.853965+0000","last_change":"2024-03-04T13:14:00.854004+0000","last_active":"2024-03-04T13:14:00.853965+0000","last_peered":"2024-03-04T13:14:00.853965+0000","last_clean":"2024-03-04T13:14:00.853965+0000","last_became_active":"2024-03-04T12:20:18.833051+0000","last_became_peered":"2024-03-04T12:20:18.833051+0000","last_unstale":"2024-03-04T13:14:00.853965+0000","last_undegraded":"2024-03-04T13:14:00.853965+0000","last_fullsized":"2024-03-04T13:14:00.853965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:00.853845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:00.853845+0000","last_clean_scrub_stamp":"2024-03-04T13:14:00.853845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:55:46.994297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"255'132","reported_seq":670,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:51.847462+0000","last_change":"2024-03-04T13:13:51.847500+0000","last_active":"2024-03-04T13:13:51.847462+0000","last_peered":"2024-03-04T13:13:51.847462+0000","last_clean":"2024-03-04T13:13:51.847462+0000","last_became_active":"2024-03-04T12:20:20.845192+0000","last_became_peered":"2024-03-04T12:20:20.845192+0000","last_unstale":"2024-03-04T13:13:51.847462+0000","last_undegraded":"2024-03-04T13:13:51.847462+0000","last_fullsized":"2024-03-04T13:13:51.847462+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'132","last_scrub_stamp":"2024-03-04T13:13:51.847377+0000","last_deep_scrub":"255'132","last_deep_scrub_stamp":"2024-03-04T13:13:51.847377+0000","last_clean_scrub_stamp":"2024-03-04T13:13:51.847377+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:06:43.925197+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":155,"num_read_kb":149,"num_write":110,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1636,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.749495+0000","last_change":"2024-03-04T13:13:44.749534+0000","last_active":"2024-03-04T13:13:44.749495+0000","last_peered":"2024-03-04T13:13:44.749495+0000","last_clean":"2024-03-04T13:13:44.749495+0000","last_became_active":"2024-03-04T12:20:22.852745+0000","last_became_peered":"2024-03-04T12:20:22.852745+0000","last_unstale":"2024-03-04T13:13:44.749495+0000","last_undegraded":"2024-03-04T13:13:44.749495+0000","last_fullsized":"2024-03-04T13:13:44.749495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:44.749366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:44.749366+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.749366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:03:25.765685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"255'85","reported_seq":588,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.265937+0000","last_change":"2024-03-04T13:13:34.265961+0000","last_active":"2024-03-04T13:13:34.265937+0000","last_peered":"2024-03-04T13:13:34.265937+0000","last_clean":"2024-03-04T13:13:34.265937+0000","last_became_active":"2024-03-04T12:20:24.864783+0000","last_became_peered":"2024-03-04T12:20:24.864783+0000","last_unstale":"2024-03-04T13:13:34.265937+0000","last_undegraded":"2024-03-04T13:13:34.265937+0000","last_fullsized":"2024-03-04T13:13:34.265937+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'85","last_scrub_stamp":"2024-03-04T13:13:34.265840+0000","last_deep_scrub":"255'85","last_deep_scrub_stamp":"2024-03-04T13:13:34.265840+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.265840+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:24:43.687453+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":204,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"255'443","reported_seq":1909,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:54.680185+0000","last_change":"2024-03-04T13:13:54.680210+0000","last_active":"2024-03-04T13:13:54.680185+0000","last_peered":"2024-03-04T13:13:54.680185+0000","last_clean":"2024-03-04T13:13:54.680185+0000","last_became_active":"2024-03-04T12:20:16.826823+0000","last_became_peered":"2024-03-04T12:20:16.826823+0000","last_unstale":"2024-03-04T13:13:54.680185+0000","last_undegraded":"2024-03-04T13:13:54.680185+0000","last_fullsized":"2024-03-04T13:13:54.680185+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'443","last_scrub_stamp":"2024-03-04T13:13:54.680062+0000","last_deep_scrub":"255'443","last_deep_scrub_stamp":"2024-03-04T13:13:54.680062+0000","last_clean_scrub_stamp":"2024-03-04T13:13:54.680062+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:42:39.018750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2302,"num_read_kb":2131,"num_write":558,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"255'165","reported_seq":769,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:03.516868+0000","last_change":"2024-03-04T13:14:03.516944+0000","last_active":"2024-03-04T13:14:03.516868+0000","last_peered":"2024-03-04T13:14:03.516868+0000","last_clean":"2024-03-04T13:14:03.516868+0000","last_became_active":"2024-03-04T12:20:14.819483+0000","last_became_peered":"2024-03-04T12:20:14.819483+0000","last_unstale":"2024-03-04T13:14:03.516868+0000","last_undegraded":"2024-03-04T13:14:03.516868+0000","last_fullsized":"2024-03-04T13:14:03.516868+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'165","last_scrub_stamp":"2024-03-04T13:14:03.516772+0000","last_deep_scrub":"255'165","last_deep_scrub_stamp":"2024-03-04T13:14:03.516772+0000","last_clean_scrub_stamp":"2024-03-04T13:14:03.516772+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:37:47.076880+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553728,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":336,"num_read_kb":12779,"num_write":962,"num_write_kb":35384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":510,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:58.638409+0000","last_change":"2024-03-04T13:13:58.638430+0000","last_active":"2024-03-04T13:13:58.638409+0000","last_peered":"2024-03-04T13:13:58.638409+0000","last_clean":"2024-03-04T13:13:58.638409+0000","last_became_active":"2024-03-04T12:20:05.863311+0000","last_became_peered":"2024-03-04T12:20:05.863311+0000","last_unstale":"2024-03-04T13:13:58.638409+0000","last_undegraded":"2024-03-04T13:13:58.638409+0000","last_fullsized":"2024-03-04T13:13:58.638409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:58.638326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:58.638326+0000","last_clean_scrub_stamp":"2024-03-04T13:13:58.638326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:29:48.744706+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:58.847314+0000","last_change":"2024-03-04T13:13:58.847338+0000","last_active":"2024-03-04T13:13:58.847314+0000","last_peered":"2024-03-04T13:13:58.847314+0000","last_clean":"2024-03-04T13:13:58.847314+0000","last_became_active":"2024-03-04T12:20:18.832355+0000","last_became_peered":"2024-03-04T12:20:18.832355+0000","last_unstale":"2024-03-04T13:13:58.847314+0000","last_undegraded":"2024-03-04T13:13:58.847314+0000","last_fullsized":"2024-03-04T13:13:58.847314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:58.847222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:58.847222+0000","last_clean_scrub_stamp":"2024-03-04T13:13:58.847222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:18:25.497962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"255'266","reported_seq":924,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:49.758302+0000","last_change":"2024-03-04T13:13:49.758332+0000","last_active":"2024-03-04T13:13:49.758302+0000","last_peered":"2024-03-04T13:13:49.758302+0000","last_clean":"2024-03-04T13:13:49.758302+0000","last_became_active":"2024-03-04T12:20:20.842330+0000","last_became_peered":"2024-03-04T12:20:20.842330+0000","last_unstale":"2024-03-04T13:13:49.758302+0000","last_undegraded":"2024-03-04T13:13:49.758302+0000","last_fullsized":"2024-03-04T13:13:49.758302+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'266","last_scrub_stamp":"2024-03-04T13:13:49.758236+0000","last_deep_scrub":"255'266","last_deep_scrub_stamp":"2024-03-04T13:13:49.758236+0000","last_clean_scrub_stamp":"2024-03-04T13:13:49.758236+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:53:59.465813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11717,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":373,"num_read_kb":489,"num_write":198,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":492,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.176595+0000","last_change":"2024-03-04T13:13:38.176635+0000","last_active":"2024-03-04T13:13:38.176595+0000","last_peered":"2024-03-04T13:13:38.176595+0000","last_clean":"2024-03-04T13:13:38.176595+0000","last_became_active":"2024-03-04T12:20:22.854507+0000","last_became_peered":"2024-03-04T12:20:22.854507+0000","last_unstale":"2024-03-04T13:13:38.176595+0000","last_undegraded":"2024-03-04T13:13:38.176595+0000","last_fullsized":"2024-03-04T13:13:38.176595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:38.176494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:38.176494+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.176494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:11:18.467708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"255'107","reported_seq":601,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.894621+0000","last_change":"2024-03-04T13:13:32.894665+0000","last_active":"2024-03-04T13:13:32.894621+0000","last_peered":"2024-03-04T13:13:32.894621+0000","last_clean":"2024-03-04T13:13:32.894621+0000","last_became_active":"2024-03-04T12:20:24.911970+0000","last_became_peered":"2024-03-04T12:20:24.911970+0000","last_unstale":"2024-03-04T13:13:32.894621+0000","last_undegraded":"2024-03-04T13:13:32.894621+0000","last_fullsized":"2024-03-04T13:13:32.894621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'107","last_scrub_stamp":"2024-03-04T13:13:32.894508+0000","last_deep_scrub":"255'107","last_deep_scrub_stamp":"2024-03-04T13:13:32.894508+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.894508+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:03:06.228753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":120,"num_write":241,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"255'323","reported_seq":1687,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:03.866574+0000","last_change":"2024-03-04T13:14:03.866603+0000","last_active":"2024-03-04T13:14:03.866574+0000","last_peered":"2024-03-04T13:14:03.866574+0000","last_clean":"2024-03-04T13:14:03.866574+0000","last_became_active":"2024-03-04T12:20:16.825241+0000","last_became_peered":"2024-03-04T12:20:16.825241+0000","last_unstale":"2024-03-04T13:14:03.866574+0000","last_undegraded":"2024-03-04T13:14:03.866574+0000","last_fullsized":"2024-03-04T13:14:03.866574+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'323","last_scrub_stamp":"2024-03-04T13:14:03.866488+0000","last_deep_scrub":"255'323","last_deep_scrub_stamp":"2024-03-04T13:14:03.866488+0000","last_clean_scrub_stamp":"2024-03-04T13:14:03.866488+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:53:00.641099+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1925,"num_read_kb":1835,"num_write":376,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"255'169","reported_seq":769,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:03.600963+0000","last_change":"2024-03-04T13:14:03.601046+0000","last_active":"2024-03-04T13:14:03.600963+0000","last_peered":"2024-03-04T13:14:03.600963+0000","last_clean":"2024-03-04T13:14:03.600963+0000","last_became_active":"2024-03-04T12:20:14.815589+0000","last_became_peered":"2024-03-04T12:20:14.815589+0000","last_unstale":"2024-03-04T13:14:03.600963+0000","last_undegraded":"2024-03-04T13:14:03.600963+0000","last_fullsized":"2024-03-04T13:14:03.600963+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'169","last_scrub_stamp":"2024-03-04T13:14:03.600861+0000","last_deep_scrub":"255'169","last_deep_scrub_stamp":"2024-03-04T13:14:03.600861+0000","last_clean_scrub_stamp":"2024-03-04T13:14:03.600861+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:35:31.161438+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11384047,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":367,"num_read_kb":3319,"num_write":965,"num_write_kb":11696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":508,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:22.520512+0000","last_change":"2024-03-04T12:20:05.863980+0000","last_active":"2024-03-04T13:12:22.520512+0000","last_peered":"2024-03-04T13:12:22.520512+0000","last_clean":"2024-03-04T13:12:22.520512+0000","last_became_active":"2024-03-04T12:20:05.863682+0000","last_became_peered":"2024-03-04T12:20:05.863682+0000","last_unstale":"2024-03-04T13:12:22.520512+0000","last_undegraded":"2024-03-04T13:12:22.520512+0000","last_fullsized":"2024-03-04T13:12:22.520512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:04.766258+0000","last_clean_scrub_stamp":"2024-03-04T12:20:04.766258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":498,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.747839+0000","last_change":"2024-03-04T13:13:41.747864+0000","last_active":"2024-03-04T13:13:41.747839+0000","last_peered":"2024-03-04T13:13:41.747839+0000","last_clean":"2024-03-04T13:13:41.747839+0000","last_became_active":"2024-03-04T12:20:18.833896+0000","last_became_peered":"2024-03-04T12:20:18.833896+0000","last_unstale":"2024-03-04T13:13:41.747839+0000","last_undegraded":"2024-03-04T13:13:41.747839+0000","last_fullsized":"2024-03-04T13:13:41.747839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:41.747741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:41.747741+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.747741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:00:12.641146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"255'208","reported_seq":772,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:53.659612+0000","last_change":"2024-03-04T13:13:53.659653+0000","last_active":"2024-03-04T13:13:53.659612+0000","last_peered":"2024-03-04T13:13:53.659612+0000","last_clean":"2024-03-04T13:13:53.659612+0000","last_became_active":"2024-03-04T12:20:21.641826+0000","last_became_peered":"2024-03-04T12:20:21.641826+0000","last_unstale":"2024-03-04T13:13:53.659612+0000","last_undegraded":"2024-03-04T13:13:53.659612+0000","last_fullsized":"2024-03-04T13:13:53.659612+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'208","last_scrub_stamp":"2024-03-04T13:13:53.659520+0000","last_deep_scrub":"255'208","last_deep_scrub_stamp":"2024-03-04T13:13:53.659520+0000","last_clean_scrub_stamp":"2024-03-04T13:13:53.659520+0000","objects_scrubbed":8,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:21:38.611711+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":255,"num_read_kb":248,"num_write":230,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2634,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"255'535","reported_seq":4194,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.342302+0000","last_change":"2024-03-04T13:13:41.342328+0000","last_active":"2024-03-04T13:13:41.342302+0000","last_peered":"2024-03-04T13:13:41.342302+0000","last_clean":"2024-03-04T13:13:41.342302+0000","last_became_active":"2024-03-04T12:20:22.853588+0000","last_became_peered":"2024-03-04T12:20:22.853588+0000","last_unstale":"2024-03-04T13:13:41.342302+0000","last_undegraded":"2024-03-04T13:13:41.342302+0000","last_fullsized":"2024-03-04T13:13:41.342302+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'535","last_scrub_stamp":"2024-03-04T13:13:41.342199+0000","last_deep_scrub":"255'535","last_deep_scrub_stamp":"2024-03-04T13:13:41.342199+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.342199+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:40:35.313438+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"255'117","reported_seq":603,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.783291+0000","last_change":"2024-03-04T13:13:37.783322+0000","last_active":"2024-03-04T13:13:37.783291+0000","last_peered":"2024-03-04T13:13:37.783291+0000","last_clean":"2024-03-04T13:13:37.783291+0000","last_became_active":"2024-03-04T12:20:24.911103+0000","last_became_peered":"2024-03-04T12:20:24.911103+0000","last_unstale":"2024-03-04T13:13:37.783291+0000","last_undegraded":"2024-03-04T13:13:37.783291+0000","last_fullsized":"2024-03-04T13:13:37.783291+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'117","last_scrub_stamp":"2024-03-04T13:13:37.783200+0000","last_deep_scrub":"255'117","last_deep_scrub_stamp":"2024-03-04T13:13:37.783200+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.783200+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:07:25.533057+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":105,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"255'1399","reported_seq":3064,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:54.922935+0000","last_change":"2024-03-04T13:13:54.922972+0000","last_active":"2024-03-04T13:13:54.922935+0000","last_peered":"2024-03-04T13:13:54.922935+0000","last_clean":"2024-03-04T13:13:54.922935+0000","last_became_active":"2024-03-04T12:20:16.833689+0000","last_became_peered":"2024-03-04T12:20:16.833689+0000","last_unstale":"2024-03-04T13:13:54.922935+0000","last_undegraded":"2024-03-04T13:13:54.922935+0000","last_fullsized":"2024-03-04T13:13:54.922935+0000","mapping_epoch":22,"log_start":"255'1300","ondisk_log_start":"255'1300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1399","last_scrub_stamp":"2024-03-04T13:13:54.922828+0000","last_deep_scrub":"255'1399","last_deep_scrub_stamp":"2024-03-04T13:13:54.922828+0000","last_clean_scrub_stamp":"2024-03-04T13:13:54.922828+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":1300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:38:53.243440+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5949,"num_read_kb":5124,"num_write":2086,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":961,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"255'143","reported_seq":824,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.162370+0000","last_change":"2024-03-04T12:20:14.814534+0000","last_active":"2024-03-04T13:13:21.162370+0000","last_peered":"2024-03-04T13:13:21.162370+0000","last_clean":"2024-03-04T13:13:21.162370+0000","last_became_active":"2024-03-04T12:20:14.814220+0000","last_became_peered":"2024-03-04T12:20:14.814220+0000","last_unstale":"2024-03-04T13:13:21.162370+0000","last_undegraded":"2024-03-04T13:13:21.162370+0000","last_fullsized":"2024-03-04T13:13:21.162370+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262328,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":11189,"num_write":841,"num_write_kb":14687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":509,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:57.685610+0000","last_change":"2024-03-04T13:13:57.685634+0000","last_active":"2024-03-04T13:13:57.685610+0000","last_peered":"2024-03-04T13:13:57.685610+0000","last_clean":"2024-03-04T13:13:57.685610+0000","last_became_active":"2024-03-04T12:20:05.784145+0000","last_became_peered":"2024-03-04T12:20:05.784145+0000","last_unstale":"2024-03-04T13:13:57.685610+0000","last_undegraded":"2024-03-04T13:13:57.685610+0000","last_fullsized":"2024-03-04T13:13:57.685610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:57.685520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:57.685520+0000","last_clean_scrub_stamp":"2024-03-04T13:13:57.685520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:08:06.581172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:01.087571+0000","last_change":"2024-03-04T13:14:01.087593+0000","last_active":"2024-03-04T13:14:01.087571+0000","last_peered":"2024-03-04T13:14:01.087571+0000","last_clean":"2024-03-04T13:14:01.087571+0000","last_became_active":"2024-03-04T12:20:18.832932+0000","last_became_peered":"2024-03-04T12:20:18.832932+0000","last_unstale":"2024-03-04T13:14:01.087571+0000","last_undegraded":"2024-03-04T13:14:01.087571+0000","last_fullsized":"2024-03-04T13:14:01.087571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:01.087446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:01.087446+0000","last_clean_scrub_stamp":"2024-03-04T13:14:01.087446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:33.550007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"255'114","reported_seq":655,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.300972+0000","last_change":"2024-03-04T13:13:44.301018+0000","last_active":"2024-03-04T13:13:44.300972+0000","last_peered":"2024-03-04T13:13:44.300972+0000","last_clean":"2024-03-04T13:13:44.300972+0000","last_became_active":"2024-03-04T12:20:20.841108+0000","last_became_peered":"2024-03-04T12:20:20.841108+0000","last_unstale":"2024-03-04T13:13:44.300972+0000","last_undegraded":"2024-03-04T13:13:44.300972+0000","last_fullsized":"2024-03-04T13:13:44.300972+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'114","last_scrub_stamp":"2024-03-04T13:13:44.300884+0000","last_deep_scrub":"255'114","last_deep_scrub_stamp":"2024-03-04T13:13:44.300884+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.300884+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:55.572601+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":86,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"255'530","reported_seq":2292,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.796423+0000","last_change":"2024-03-04T13:13:42.796467+0000","last_active":"2024-03-04T13:13:42.796423+0000","last_peered":"2024-03-04T13:13:42.796423+0000","last_clean":"2024-03-04T13:13:42.796423+0000","last_became_active":"2024-03-04T12:20:22.859306+0000","last_became_peered":"2024-03-04T12:20:22.859306+0000","last_unstale":"2024-03-04T13:13:42.796423+0000","last_undegraded":"2024-03-04T13:13:42.796423+0000","last_fullsized":"2024-03-04T13:13:42.796423+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'530","last_scrub_stamp":"2024-03-04T13:13:42.796336+0000","last_deep_scrub":"255'530","last_deep_scrub_stamp":"2024-03-04T13:13:42.796336+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.796336+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:53:21.504586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"255'154","reported_seq":644,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.800402+0000","last_change":"2024-03-04T13:13:37.800432+0000","last_active":"2024-03-04T13:13:37.800402+0000","last_peered":"2024-03-04T13:13:37.800402+0000","last_clean":"2024-03-04T13:13:37.800402+0000","last_became_active":"2024-03-04T12:20:24.865816+0000","last_became_peered":"2024-03-04T12:20:24.865816+0000","last_unstale":"2024-03-04T13:13:37.800402+0000","last_undegraded":"2024-03-04T13:13:37.800402+0000","last_fullsized":"2024-03-04T13:13:37.800402+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'154","last_scrub_stamp":"2024-03-04T13:13:37.800314+0000","last_deep_scrub":"255'154","last_deep_scrub_stamp":"2024-03-04T13:13:37.800314+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.800314+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:48:58.994923+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":201,"num_read_kb":201,"num_write":359,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"255'654","reported_seq":2065,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:52.236382+0000","last_change":"2024-03-04T13:13:52.236420+0000","last_active":"2024-03-04T13:13:52.236382+0000","last_peered":"2024-03-04T13:13:52.236382+0000","last_clean":"2024-03-04T13:13:52.236382+0000","last_became_active":"2024-03-04T12:20:16.825377+0000","last_became_peered":"2024-03-04T12:20:16.825377+0000","last_unstale":"2024-03-04T13:13:52.236382+0000","last_undegraded":"2024-03-04T13:13:52.236382+0000","last_fullsized":"2024-03-04T13:13:52.236382+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'654","last_scrub_stamp":"2024-03-04T13:13:52.236282+0000","last_deep_scrub":"255'654","last_deep_scrub_stamp":"2024-03-04T13:13:52.236282+0000","last_clean_scrub_stamp":"2024-03-04T13:13:52.236282+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":600,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:58:08.061948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2990,"num_read_kb":2698,"num_write":869,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"255'180","reported_seq":873,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.022128+0000","last_change":"2024-03-04T12:20:14.812062+0000","last_active":"2024-03-04T13:13:21.022128+0000","last_peered":"2024-03-04T13:13:21.022128+0000","last_clean":"2024-03-04T13:13:21.022128+0000","last_became_active":"2024-03-04T12:20:14.811756+0000","last_became_peered":"2024-03-04T12:20:14.811756+0000","last_unstale":"2024-03-04T13:13:21.022128+0000","last_undegraded":"2024-03-04T13:13:21.022128+0000","last_fullsized":"2024-03-04T13:13:21.022128+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104383,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":578,"num_read_kb":172500,"num_write":1029,"num_write_kb":54165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:52.728634+0000","last_change":"2024-03-04T13:13:52.728668+0000","last_active":"2024-03-04T13:13:52.728634+0000","last_peered":"2024-03-04T13:13:52.728634+0000","last_clean":"2024-03-04T13:13:52.728634+0000","last_became_active":"2024-03-04T12:20:05.779370+0000","last_became_peered":"2024-03-04T12:20:05.779370+0000","last_unstale":"2024-03-04T13:13:52.728634+0000","last_undegraded":"2024-03-04T13:13:52.728634+0000","last_fullsized":"2024-03-04T13:13:52.728634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:52.728539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:52.728539+0000","last_clean_scrub_stamp":"2024-03-04T13:13:52.728539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:00:59.466198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"255'4","reported_seq":805,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:58.932361+0000","last_change":"2024-03-04T13:13:58.932410+0000","last_active":"2024-03-04T13:13:58.932361+0000","last_peered":"2024-03-04T13:13:58.932361+0000","last_clean":"2024-03-04T13:13:58.932361+0000","last_became_active":"2024-03-04T12:20:18.833273+0000","last_became_peered":"2024-03-04T12:20:18.833273+0000","last_unstale":"2024-03-04T13:13:58.932361+0000","last_undegraded":"2024-03-04T13:13:58.932361+0000","last_fullsized":"2024-03-04T13:13:58.932361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'4","last_scrub_stamp":"2024-03-04T13:13:58.932261+0000","last_deep_scrub":"255'4","last_deep_scrub_stamp":"2024-03-04T13:13:58.932261+0000","last_clean_scrub_stamp":"2024-03-04T13:13:58.932261+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:35:37.479599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":470,"num_read_kb":468,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"255'328","reported_seq":1052,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:48.612984+0000","last_change":"2024-03-04T13:13:48.613032+0000","last_active":"2024-03-04T13:13:48.612984+0000","last_peered":"2024-03-04T13:13:48.612984+0000","last_clean":"2024-03-04T13:13:48.612984+0000","last_became_active":"2024-03-04T12:20:21.642696+0000","last_became_peered":"2024-03-04T12:20:21.642696+0000","last_unstale":"2024-03-04T13:13:48.612984+0000","last_undegraded":"2024-03-04T13:13:48.612984+0000","last_fullsized":"2024-03-04T13:13:48.612984+0000","mapping_epoch":26,"log_start":"255'300","ondisk_log_start":"255'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'328","last_scrub_stamp":"2024-03-04T13:13:48.612902+0000","last_deep_scrub":"255'328","last_deep_scrub_stamp":"2024-03-04T13:13:48.612902+0000","last_clean_scrub_stamp":"2024-03-04T13:13:48.612902+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:48:22.425114+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17780,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":637,"num_write":242,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":484,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.880588+0000","last_change":"2024-03-04T13:13:47.880612+0000","last_active":"2024-03-04T13:13:47.880588+0000","last_peered":"2024-03-04T13:13:47.880588+0000","last_clean":"2024-03-04T13:13:47.880588+0000","last_became_active":"2024-03-04T12:20:22.853272+0000","last_became_peered":"2024-03-04T12:20:22.853272+0000","last_unstale":"2024-03-04T13:13:47.880588+0000","last_undegraded":"2024-03-04T13:13:47.880588+0000","last_fullsized":"2024-03-04T13:13:47.880588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:47.880496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:47.880496+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.880496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:16:43.511193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"255'111","reported_seq":594,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.276595+0000","last_change":"2024-03-04T13:13:36.276657+0000","last_active":"2024-03-04T13:13:36.276595+0000","last_peered":"2024-03-04T13:13:36.276595+0000","last_clean":"2024-03-04T13:13:36.276595+0000","last_became_active":"2024-03-04T12:20:24.863996+0000","last_became_peered":"2024-03-04T12:20:24.863996+0000","last_unstale":"2024-03-04T13:13:36.276595+0000","last_undegraded":"2024-03-04T13:13:36.276595+0000","last_fullsized":"2024-03-04T13:13:36.276595+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'111","last_scrub_stamp":"2024-03-04T13:13:36.276495+0000","last_deep_scrub":"255'111","last_deep_scrub_stamp":"2024-03-04T13:13:36.276495+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.276495+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:28.929795+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":275,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"255'116","reported_seq":613,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.850786+0000","last_change":"2024-03-04T13:13:35.850828+0000","last_active":"2024-03-04T13:13:35.850786+0000","last_peered":"2024-03-04T13:13:35.850786+0000","last_clean":"2024-03-04T13:13:35.850786+0000","last_became_active":"2024-03-04T12:20:24.868636+0000","last_became_peered":"2024-03-04T12:20:24.868636+0000","last_unstale":"2024-03-04T13:13:35.850786+0000","last_undegraded":"2024-03-04T13:13:35.850786+0000","last_fullsized":"2024-03-04T13:13:35.850786+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'116","last_scrub_stamp":"2024-03-04T13:13:35.850689+0000","last_deep_scrub":"255'116","last_deep_scrub_stamp":"2024-03-04T13:13:35.850689+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.850689+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:58.042029+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":141,"num_write":275,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"255'389","reported_seq":1874,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:56.197633+0000","last_change":"2024-03-04T13:13:56.197633+0000","last_active":"2024-03-04T13:13:56.197633+0000","last_peered":"2024-03-04T13:13:56.197633+0000","last_clean":"2024-03-04T13:13:56.197633+0000","last_became_active":"2024-03-04T12:20:16.822887+0000","last_became_peered":"2024-03-04T12:20:16.822887+0000","last_unstale":"2024-03-04T13:13:56.197633+0000","last_undegraded":"2024-03-04T13:13:56.197633+0000","last_fullsized":"2024-03-04T13:13:56.197633+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'389","last_scrub_stamp":"2024-03-04T13:13:56.197519+0000","last_deep_scrub":"255'389","last_deep_scrub_stamp":"2024-03-04T13:13:56.197519+0000","last_clean_scrub_stamp":"2024-03-04T13:13:56.197519+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:42:16.844653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2100,"num_read_kb":1986,"num_write":448,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":804,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"255'176","reported_seq":790,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:05.152514+0000","last_change":"2024-03-04T13:14:05.152576+0000","last_active":"2024-03-04T13:14:05.152514+0000","last_peered":"2024-03-04T13:14:05.152514+0000","last_clean":"2024-03-04T13:14:05.152514+0000","last_became_active":"2024-03-04T12:20:14.823661+0000","last_became_peered":"2024-03-04T12:20:14.823661+0000","last_unstale":"2024-03-04T13:14:05.152514+0000","last_undegraded":"2024-03-04T13:14:05.152514+0000","last_fullsized":"2024-03-04T13:14:05.152514+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'176","last_scrub_stamp":"2024-03-04T13:14:05.152387+0000","last_deep_scrub":"255'176","last_deep_scrub_stamp":"2024-03-04T13:14:05.152387+0000","last_clean_scrub_stamp":"2024-03-04T13:14:05.152387+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:54:39.065860+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":384,"num_read_kb":10388,"num_write":1049,"num_write_kb":6576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":494,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.766456+0000","last_change":"2024-03-04T13:13:43.766456+0000","last_active":"2024-03-04T13:13:43.766456+0000","last_peered":"2024-03-04T13:13:43.766456+0000","last_clean":"2024-03-04T13:13:43.766456+0000","last_became_active":"2024-03-04T12:20:18.836487+0000","last_became_peered":"2024-03-04T12:20:18.836487+0000","last_unstale":"2024-03-04T13:13:43.766456+0000","last_undegraded":"2024-03-04T13:13:43.766456+0000","last_fullsized":"2024-03-04T13:13:43.766456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:43.766306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:43.766306+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.766306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:01:10.055070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"255'141","reported_seq":703,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.642612+0000","last_change":"2024-03-04T12:20:20.841992+0000","last_active":"2024-03-04T13:13:26.642612+0000","last_peered":"2024-03-04T13:13:26.642612+0000","last_clean":"2024-03-04T13:13:26.642612+0000","last_became_active":"2024-03-04T12:20:20.841696+0000","last_became_peered":"2024-03-04T12:20:20.841696+0000","last_unstale":"2024-03-04T13:13:26.642612+0000","last_undegraded":"2024-03-04T13:13:26.642612+0000","last_fullsized":"2024-03-04T13:13:26.642612+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11864,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":271,"num_write":104,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.892194+0000","last_change":"2024-03-04T13:13:46.892194+0000","last_active":"2024-03-04T13:13:46.892194+0000","last_peered":"2024-03-04T13:13:46.892194+0000","last_clean":"2024-03-04T13:13:46.892194+0000","last_became_active":"2024-03-04T12:20:22.857513+0000","last_became_peered":"2024-03-04T12:20:22.857513+0000","last_unstale":"2024-03-04T13:13:46.892194+0000","last_undegraded":"2024-03-04T13:13:46.892194+0000","last_fullsized":"2024-03-04T13:13:46.892194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:46.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:46.892081+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:51.247568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"255'97","reported_seq":587,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.822659+0000","last_change":"2024-03-04T13:13:41.822685+0000","last_active":"2024-03-04T13:13:41.822659+0000","last_peered":"2024-03-04T13:13:41.822659+0000","last_clean":"2024-03-04T13:13:41.822659+0000","last_became_active":"2024-03-04T12:20:24.863346+0000","last_became_peered":"2024-03-04T12:20:24.863346+0000","last_unstale":"2024-03-04T13:13:41.822659+0000","last_undegraded":"2024-03-04T13:13:41.822659+0000","last_fullsized":"2024-03-04T13:13:41.822659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'97","last_scrub_stamp":"2024-03-04T13:13:41.822571+0000","last_deep_scrub":"255'97","last_deep_scrub_stamp":"2024-03-04T13:13:41.822571+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.822571+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:44:53.384390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":222,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"255'707","reported_seq":2073,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.752448+0000","last_change":"2024-03-04T13:13:44.752448+0000","last_active":"2024-03-04T13:13:44.752448+0000","last_peered":"2024-03-04T13:13:44.752448+0000","last_clean":"2024-03-04T13:13:44.752448+0000","last_became_active":"2024-03-04T12:20:16.834080+0000","last_became_peered":"2024-03-04T12:20:16.834080+0000","last_unstale":"2024-03-04T13:13:44.752448+0000","last_undegraded":"2024-03-04T13:13:44.752448+0000","last_fullsized":"2024-03-04T13:13:44.752448+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'707","last_scrub_stamp":"2024-03-04T13:13:44.752324+0000","last_deep_scrub":"255'707","last_deep_scrub_stamp":"2024-03-04T13:13:44.752324+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.752324+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:08:30.399805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3097,"num_read_kb":2763,"num_write":935,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"255'233","reported_seq":910,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.532406+0000","last_change":"2024-03-04T12:20:14.816239+0000","last_active":"2024-03-04T13:13:27.532406+0000","last_peered":"2024-03-04T13:13:27.532406+0000","last_clean":"2024-03-04T13:13:27.532406+0000","last_became_active":"2024-03-04T12:20:14.814738+0000","last_became_peered":"2024-03-04T12:20:14.814738+0000","last_unstale":"2024-03-04T13:13:27.532406+0000","last_undegraded":"2024-03-04T13:13:27.532406+0000","last_fullsized":"2024-03-04T13:13:27.532406+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5787887,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":617,"num_read_kb":16203,"num_write":1488,"num_write_kb":37968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:02.915258+0000","last_change":"2024-03-04T13:14:02.915279+0000","last_active":"2024-03-04T13:14:02.915258+0000","last_peered":"2024-03-04T13:14:02.915258+0000","last_clean":"2024-03-04T13:14:02.915258+0000","last_became_active":"2024-03-04T12:20:18.834793+0000","last_became_peered":"2024-03-04T12:20:18.834793+0000","last_unstale":"2024-03-04T13:14:02.915258+0000","last_undegraded":"2024-03-04T13:14:02.915258+0000","last_fullsized":"2024-03-04T13:14:02.915258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:02.915163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:02.915163+0000","last_clean_scrub_stamp":"2024-03-04T13:14:02.915163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:22.172022+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"255'60","reported_seq":556,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:04.915589+0000","last_change":"2024-03-04T13:14:04.915619+0000","last_active":"2024-03-04T13:14:04.915589+0000","last_peered":"2024-03-04T13:14:04.915589+0000","last_clean":"2024-03-04T13:14:04.915589+0000","last_became_active":"2024-03-04T12:20:20.832034+0000","last_became_peered":"2024-03-04T12:20:20.832034+0000","last_unstale":"2024-03-04T13:14:04.915589+0000","last_undegraded":"2024-03-04T13:14:04.915589+0000","last_fullsized":"2024-03-04T13:14:04.915589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'60","last_scrub_stamp":"2024-03-04T13:14:04.915506+0000","last_deep_scrub":"255'60","last_deep_scrub_stamp":"2024-03-04T13:14:04.915506+0000","last_clean_scrub_stamp":"2024-03-04T13:14:04.915506+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:05:50.468935+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":40,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":492,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.472980+0000","last_change":"2024-03-04T13:13:40.472980+0000","last_active":"2024-03-04T13:13:40.472980+0000","last_peered":"2024-03-04T13:13:40.472980+0000","last_clean":"2024-03-04T13:13:40.472980+0000","last_became_active":"2024-03-04T12:20:22.855477+0000","last_became_peered":"2024-03-04T12:20:22.855477+0000","last_unstale":"2024-03-04T13:13:40.472980+0000","last_undegraded":"2024-03-04T13:13:40.472980+0000","last_fullsized":"2024-03-04T13:13:40.472980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.472867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.472867+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.472867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:58:06.611427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"255'85","reported_seq":568,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.856034+0000","last_change":"2024-03-04T13:13:39.856065+0000","last_active":"2024-03-04T13:13:39.856034+0000","last_peered":"2024-03-04T13:13:39.856034+0000","last_clean":"2024-03-04T13:13:39.856034+0000","last_became_active":"2024-03-04T12:20:24.865534+0000","last_became_peered":"2024-03-04T12:20:24.865534+0000","last_unstale":"2024-03-04T13:13:39.856034+0000","last_undegraded":"2024-03-04T13:13:39.856034+0000","last_fullsized":"2024-03-04T13:13:39.856034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'85","last_scrub_stamp":"2024-03-04T13:13:39.855947+0000","last_deep_scrub":"255'85","last_deep_scrub_stamp":"2024-03-04T13:13:39.855947+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.855947+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:38.837480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":78,"num_write":202,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"255'719","reported_seq":2264,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:59.946137+0000","last_change":"2024-03-04T13:13:59.946163+0000","last_active":"2024-03-04T13:13:59.946137+0000","last_peered":"2024-03-04T13:13:59.946137+0000","last_clean":"2024-03-04T13:13:59.946137+0000","last_became_active":"2024-03-04T12:20:16.829012+0000","last_became_peered":"2024-03-04T12:20:16.829012+0000","last_unstale":"2024-03-04T13:13:59.946137+0000","last_undegraded":"2024-03-04T13:13:59.946137+0000","last_fullsized":"2024-03-04T13:13:59.946137+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'719","last_scrub_stamp":"2024-03-04T13:13:59.946053+0000","last_deep_scrub":"255'719","last_deep_scrub_stamp":"2024-03-04T13:13:59.946053+0000","last_clean_scrub_stamp":"2024-03-04T13:13:59.946053+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:41:21.063950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3304,"num_read_kb":2912,"num_write":1016,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"255'181","reported_seq":875,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:04.542529+0000","last_change":"2024-03-04T13:14:04.542589+0000","last_active":"2024-03-04T13:14:04.542529+0000","last_peered":"2024-03-04T13:14:04.542529+0000","last_clean":"2024-03-04T13:14:04.542529+0000","last_became_active":"2024-03-04T12:20:14.822127+0000","last_became_peered":"2024-03-04T12:20:14.822127+0000","last_unstale":"2024-03-04T13:14:04.542529+0000","last_undegraded":"2024-03-04T13:14:04.542529+0000","last_fullsized":"2024-03-04T13:14:04.542529+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'181","last_scrub_stamp":"2024-03-04T13:14:04.542425+0000","last_deep_scrub":"255'181","last_deep_scrub_stamp":"2024-03-04T13:14:04.542425+0000","last_clean_scrub_stamp":"2024-03-04T13:14:04.542425+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:21.443373+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947361,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":518,"num_read_kb":182821,"num_write":997,"num_write_kb":40014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":500,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:55.711774+0000","last_change":"2024-03-04T13:13:55.711774+0000","last_active":"2024-03-04T13:13:55.711774+0000","last_peered":"2024-03-04T13:13:55.711774+0000","last_clean":"2024-03-04T13:13:55.711774+0000","last_became_active":"2024-03-04T12:20:18.830818+0000","last_became_peered":"2024-03-04T12:20:18.830818+0000","last_unstale":"2024-03-04T13:13:55.711774+0000","last_undegraded":"2024-03-04T13:13:55.711774+0000","last_fullsized":"2024-03-04T13:13:55.711774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:55.711646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:55.711646+0000","last_clean_scrub_stamp":"2024-03-04T13:13:55.711646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:25:47.095406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"255'169","reported_seq":754,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:06.918815+0000","last_change":"2024-03-04T13:14:06.918892+0000","last_active":"2024-03-04T13:14:06.918815+0000","last_peered":"2024-03-04T13:14:06.918815+0000","last_clean":"2024-03-04T13:14:06.918815+0000","last_became_active":"2024-03-04T12:20:20.840999+0000","last_became_peered":"2024-03-04T12:20:20.840999+0000","last_unstale":"2024-03-04T13:14:06.918815+0000","last_undegraded":"2024-03-04T13:14:06.918815+0000","last_fullsized":"2024-03-04T13:14:06.918815+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'169","last_scrub_stamp":"2024-03-04T13:14:06.918711+0000","last_deep_scrub":"255'169","last_deep_scrub_stamp":"2024-03-04T13:14:06.918711+0000","last_clean_scrub_stamp":"2024-03-04T13:14:06.918711+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:29:16.607806+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8097,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":284,"num_write":124,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.788169+0000","last_change":"2024-03-04T13:13:36.788169+0000","last_active":"2024-03-04T13:13:36.788169+0000","last_peered":"2024-03-04T13:13:36.788169+0000","last_clean":"2024-03-04T13:13:36.788169+0000","last_became_active":"2024-03-04T12:20:22.848877+0000","last_became_peered":"2024-03-04T12:20:22.848877+0000","last_unstale":"2024-03-04T13:13:36.788169+0000","last_undegraded":"2024-03-04T13:13:36.788169+0000","last_fullsized":"2024-03-04T13:13:36.788169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:36.788037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:36.788037+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.788037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:56:09.294578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"255'100","reported_seq":580,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.290495+0000","last_change":"2024-03-04T13:13:37.290529+0000","last_active":"2024-03-04T13:13:37.290495+0000","last_peered":"2024-03-04T13:13:37.290495+0000","last_clean":"2024-03-04T13:13:37.290495+0000","last_became_active":"2024-03-04T12:20:24.863810+0000","last_became_peered":"2024-03-04T12:20:24.863810+0000","last_unstale":"2024-03-04T13:13:37.290495+0000","last_undegraded":"2024-03-04T13:13:37.290495+0000","last_fullsized":"2024-03-04T13:13:37.290495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'100","last_scrub_stamp":"2024-03-04T13:13:37.290398+0000","last_deep_scrub":"255'100","last_deep_scrub_stamp":"2024-03-04T13:13:37.290398+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.290398+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:39.481362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":234,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"255'783","reported_seq":2324,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.757528+0000","last_change":"2024-03-04T13:13:33.757528+0000","last_active":"2024-03-04T13:13:33.757528+0000","last_peered":"2024-03-04T13:13:33.757528+0000","last_clean":"2024-03-04T13:13:33.757528+0000","last_became_active":"2024-03-04T12:20:51.031448+0000","last_became_peered":"2024-03-04T12:20:51.031448+0000","last_unstale":"2024-03-04T13:13:33.757528+0000","last_undegraded":"2024-03-04T13:13:33.757528+0000","last_fullsized":"2024-03-04T13:13:33.757528+0000","mapping_epoch":33,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'783","last_scrub_stamp":"2024-03-04T13:13:33.757424+0000","last_deep_scrub":"255'783","last_deep_scrub_stamp":"2024-03-04T13:13:33.757424+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.757424+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:34:41.258521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3519,"num_read_kb":3144,"num_write":1038,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":951,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"255'186","reported_seq":817,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260148+0000","last_change":"2024-03-04T12:20:14.824465+0000","last_active":"2024-03-04T13:13:25.260148+0000","last_peered":"2024-03-04T13:13:25.260148+0000","last_clean":"2024-03-04T13:13:25.260148+0000","last_became_active":"2024-03-04T12:20:14.824152+0000","last_became_peered":"2024-03-04T12:20:14.824152+0000","last_unstale":"2024-03-04T13:13:25.260148+0000","last_undegraded":"2024-03-04T13:13:25.260148+0000","last_fullsized":"2024-03-04T13:13:25.260148+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259657,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":396,"num_read_kb":84164,"num_write":1039,"num_write_kb":34071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.767269+0000","last_change":"2024-03-04T13:13:37.767269+0000","last_active":"2024-03-04T13:13:37.767269+0000","last_peered":"2024-03-04T13:13:37.767269+0000","last_clean":"2024-03-04T13:13:37.767269+0000","last_became_active":"2024-03-04T12:20:18.838749+0000","last_became_peered":"2024-03-04T12:20:18.838749+0000","last_unstale":"2024-03-04T13:13:37.767269+0000","last_undegraded":"2024-03-04T13:13:37.767269+0000","last_fullsized":"2024-03-04T13:13:37.767269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:37.767153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:37.767153+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.767153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:00:15.356508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"255'129","reported_seq":703,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:03.707633+0000","last_change":"2024-03-04T13:14:03.707668+0000","last_active":"2024-03-04T13:14:03.707633+0000","last_peered":"2024-03-04T13:14:03.707633+0000","last_clean":"2024-03-04T13:14:03.707633+0000","last_became_active":"2024-03-04T12:20:20.839286+0000","last_became_peered":"2024-03-04T12:20:20.839286+0000","last_unstale":"2024-03-04T13:14:03.707633+0000","last_undegraded":"2024-03-04T13:14:03.707633+0000","last_fullsized":"2024-03-04T13:14:03.707633+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'129","last_scrub_stamp":"2024-03-04T13:14:03.707513+0000","last_deep_scrub":"255'129","last_deep_scrub_stamp":"2024-03-04T13:14:03.707513+0000","last_clean_scrub_stamp":"2024-03-04T13:14:03.707513+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:46:39.316497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":210,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.806027+0000","last_change":"2024-03-04T13:13:47.806027+0000","last_active":"2024-03-04T13:13:47.806027+0000","last_peered":"2024-03-04T13:13:47.806027+0000","last_clean":"2024-03-04T13:13:47.806027+0000","last_became_active":"2024-03-04T12:20:22.849340+0000","last_became_peered":"2024-03-04T12:20:22.849340+0000","last_unstale":"2024-03-04T13:13:47.806027+0000","last_undegraded":"2024-03-04T13:13:47.806027+0000","last_fullsized":"2024-03-04T13:13:47.806027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:47.805916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:47.805916+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.805916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:20:34.391460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"255'415","reported_seq":1886,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:49.764179+0000","last_change":"2024-03-04T13:13:49.764209+0000","last_active":"2024-03-04T13:13:49.764179+0000","last_peered":"2024-03-04T13:13:49.764179+0000","last_clean":"2024-03-04T13:13:49.764179+0000","last_became_active":"2024-03-04T12:20:16.821451+0000","last_became_peered":"2024-03-04T12:20:16.821451+0000","last_unstale":"2024-03-04T13:13:49.764179+0000","last_undegraded":"2024-03-04T13:13:49.764179+0000","last_fullsized":"2024-03-04T13:13:49.764179+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'415","last_scrub_stamp":"2024-03-04T13:13:49.764092+0000","last_deep_scrub":"255'415","last_deep_scrub_stamp":"2024-03-04T13:13:49.764092+0000","last_clean_scrub_stamp":"2024-03-04T13:13:49.764092+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:10:01.819146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2212,"num_read_kb":2069,"num_write":499,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":970,"num_omap_keys":5,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"255'211","reported_seq":803,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.642236+0000","last_change":"2024-03-04T12:20:14.810574+0000","last_active":"2024-03-04T13:13:26.642236+0000","last_peered":"2024-03-04T13:13:26.642236+0000","last_clean":"2024-03-04T13:13:26.642236+0000","last_became_active":"2024-03-04T12:20:14.810309+0000","last_became_peered":"2024-03-04T12:20:14.810309+0000","last_unstale":"2024-03-04T13:13:26.642236+0000","last_undegraded":"2024-03-04T13:13:26.642236+0000","last_fullsized":"2024-03-04T13:13:26.642236+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195451,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":442,"num_read_kb":8634,"num_write":1082,"num_write_kb":36368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":491,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:02.836272+0000","last_change":"2024-03-04T13:14:02.836299+0000","last_active":"2024-03-04T13:14:02.836272+0000","last_peered":"2024-03-04T13:14:02.836272+0000","last_clean":"2024-03-04T13:14:02.836272+0000","last_became_active":"2024-03-04T12:20:18.833300+0000","last_became_peered":"2024-03-04T12:20:18.833300+0000","last_unstale":"2024-03-04T13:14:02.836272+0000","last_undegraded":"2024-03-04T13:14:02.836272+0000","last_fullsized":"2024-03-04T13:14:02.836272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:02.836144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:02.836144+0000","last_clean_scrub_stamp":"2024-03-04T13:14:02.836144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:17:29.936322+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"255'204","reported_seq":829,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:49.723580+0000","last_change":"2024-03-04T13:13:49.723610+0000","last_active":"2024-03-04T13:13:49.723580+0000","last_peered":"2024-03-04T13:13:49.723580+0000","last_clean":"2024-03-04T13:13:49.723580+0000","last_became_active":"2024-03-04T12:20:20.838600+0000","last_became_peered":"2024-03-04T12:20:20.838600+0000","last_unstale":"2024-03-04T13:13:49.723580+0000","last_undegraded":"2024-03-04T13:13:49.723580+0000","last_fullsized":"2024-03-04T13:13:49.723580+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'204","last_scrub_stamp":"2024-03-04T13:13:49.723498+0000","last_deep_scrub":"255'204","last_deep_scrub_stamp":"2024-03-04T13:13:49.723498+0000","last_clean_scrub_stamp":"2024-03-04T13:13:49.723498+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:33:27.828544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17172,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":287,"num_read_kb":431,"num_write":142,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":483,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.332740+0000","last_change":"2024-03-04T13:13:40.332764+0000","last_active":"2024-03-04T13:13:40.332740+0000","last_peered":"2024-03-04T13:13:40.332740+0000","last_clean":"2024-03-04T13:13:40.332740+0000","last_became_active":"2024-03-04T12:20:22.855464+0000","last_became_peered":"2024-03-04T12:20:22.855464+0000","last_unstale":"2024-03-04T13:13:40.332740+0000","last_undegraded":"2024-03-04T13:13:40.332740+0000","last_fullsized":"2024-03-04T13:13:40.332740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.332646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.332646+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.332646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:40:16.755252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"255'173","reported_seq":676,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.820025+0000","last_change":"2024-03-04T13:13:35.820025+0000","last_active":"2024-03-04T13:13:35.820025+0000","last_peered":"2024-03-04T13:13:35.820025+0000","last_clean":"2024-03-04T13:13:35.820025+0000","last_became_active":"2024-03-04T12:20:24.912118+0000","last_became_peered":"2024-03-04T12:20:24.912118+0000","last_unstale":"2024-03-04T13:13:35.820025+0000","last_undegraded":"2024-03-04T13:13:35.820025+0000","last_fullsized":"2024-03-04T13:13:35.820025+0000","mapping_epoch":30,"log_start":"250'100","ondisk_log_start":"250'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'173","last_scrub_stamp":"2024-03-04T13:13:35.819894+0000","last_deep_scrub":"255'173","last_deep_scrub_stamp":"2024-03-04T13:13:35.819894+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.819894+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:25:38.687294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":221,"num_read_kb":223,"num_write":386,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"255'446","reported_seq":1794,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:59.845469+0000","last_change":"2024-03-04T13:13:59.845499+0000","last_active":"2024-03-04T13:13:59.845469+0000","last_peered":"2024-03-04T13:13:59.845469+0000","last_clean":"2024-03-04T13:13:59.845469+0000","last_became_active":"2024-03-04T12:20:16.828550+0000","last_became_peered":"2024-03-04T12:20:16.828550+0000","last_unstale":"2024-03-04T13:13:59.845469+0000","last_undegraded":"2024-03-04T13:13:59.845469+0000","last_fullsized":"2024-03-04T13:13:59.845469+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'446","last_scrub_stamp":"2024-03-04T13:13:59.845377+0000","last_deep_scrub":"255'446","last_deep_scrub_stamp":"2024-03-04T13:13:59.845377+0000","last_clean_scrub_stamp":"2024-03-04T13:13:59.845377+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:43:11.440226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2172,"num_read_kb":1979,"num_write":576,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"255'156","reported_seq":737,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:59.682158+0000","last_change":"2024-03-04T13:13:59.682205+0000","last_active":"2024-03-04T13:13:59.682158+0000","last_peered":"2024-03-04T13:13:59.682158+0000","last_clean":"2024-03-04T13:13:59.682158+0000","last_became_active":"2024-03-04T12:20:14.811474+0000","last_became_peered":"2024-03-04T12:20:14.811474+0000","last_unstale":"2024-03-04T13:13:59.682158+0000","last_undegraded":"2024-03-04T13:13:59.682158+0000","last_fullsized":"2024-03-04T13:13:59.682158+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'156","last_scrub_stamp":"2024-03-04T13:13:59.682069+0000","last_deep_scrub":"255'156","last_deep_scrub_stamp":"2024-03-04T13:13:59.682069+0000","last_clean_scrub_stamp":"2024-03-04T13:13:59.682069+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:58.497427+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1943261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":293,"num_read_kb":3660,"num_write":933,"num_write_kb":16669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":498,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.756142+0000","last_change":"2024-03-04T13:13:39.756173+0000","last_active":"2024-03-04T13:13:39.756142+0000","last_peered":"2024-03-04T13:13:39.756142+0000","last_clean":"2024-03-04T13:13:39.756142+0000","last_became_active":"2024-03-04T12:20:18.836021+0000","last_became_peered":"2024-03-04T12:20:18.836021+0000","last_unstale":"2024-03-04T13:13:39.756142+0000","last_undegraded":"2024-03-04T13:13:39.756142+0000","last_fullsized":"2024-03-04T13:13:39.756142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:39.756043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:39.756043+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.756043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:04.157021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"255'174","reported_seq":764,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:01.728592+0000","last_change":"2024-03-04T13:14:01.728679+0000","last_active":"2024-03-04T13:14:01.728592+0000","last_peered":"2024-03-04T13:14:01.728592+0000","last_clean":"2024-03-04T13:14:01.728592+0000","last_became_active":"2024-03-04T12:20:20.838216+0000","last_became_peered":"2024-03-04T12:20:20.838216+0000","last_unstale":"2024-03-04T13:14:01.728592+0000","last_undegraded":"2024-03-04T13:14:01.728592+0000","last_fullsized":"2024-03-04T13:14:01.728592+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'174","last_scrub_stamp":"2024-03-04T13:14:01.728502+0000","last_deep_scrub":"255'174","last_deep_scrub_stamp":"2024-03-04T13:14:01.728502+0000","last_clean_scrub_stamp":"2024-03-04T13:14:01.728502+0000","objects_scrubbed":8,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:38.376317+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12653,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":241,"num_read_kb":319,"num_write":160,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":484,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.818606+0000","last_change":"2024-03-04T13:13:40.818631+0000","last_active":"2024-03-04T13:13:40.818606+0000","last_peered":"2024-03-04T13:13:40.818606+0000","last_clean":"2024-03-04T13:13:40.818606+0000","last_became_active":"2024-03-04T12:20:22.856471+0000","last_became_peered":"2024-03-04T12:20:22.856471+0000","last_unstale":"2024-03-04T13:13:40.818606+0000","last_undegraded":"2024-03-04T13:13:40.818606+0000","last_fullsized":"2024-03-04T13:13:40.818606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.818507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.818507+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.818507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:44.522601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"255'166","reported_seq":1019,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:48.754200+0000","last_change":"2024-03-04T13:13:48.754200+0000","last_active":"2024-03-04T13:13:48.754200+0000","last_peered":"2024-03-04T13:13:48.754200+0000","last_clean":"2024-03-04T13:13:48.754200+0000","last_became_active":"2024-03-04T12:20:24.863291+0000","last_became_peered":"2024-03-04T12:20:24.863291+0000","last_unstale":"2024-03-04T13:13:48.754200+0000","last_undegraded":"2024-03-04T13:13:48.754200+0000","last_fullsized":"2024-03-04T13:13:48.754200+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'166","last_scrub_stamp":"2024-03-04T13:13:48.754066+0000","last_deep_scrub":"255'166","last_deep_scrub_stamp":"2024-03-04T13:13:48.754066+0000","last_clean_scrub_stamp":"2024-03-04T13:13:48.754066+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:02:22.055722+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1530,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":567,"num_read_kb":564,"num_write":466,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"255'447","reported_seq":1860,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.048758+0000","last_change":"2024-03-04T13:13:33.048795+0000","last_active":"2024-03-04T13:13:33.048758+0000","last_peered":"2024-03-04T13:13:33.048758+0000","last_clean":"2024-03-04T13:13:33.048758+0000","last_became_active":"2024-03-04T12:20:50.905894+0000","last_became_peered":"2024-03-04T12:20:50.905894+0000","last_unstale":"2024-03-04T13:13:33.048758+0000","last_undegraded":"2024-03-04T13:13:33.048758+0000","last_fullsized":"2024-03-04T13:13:33.048758+0000","mapping_epoch":33,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'447","last_scrub_stamp":"2024-03-04T13:13:33.048662+0000","last_deep_scrub":"255'447","last_deep_scrub_stamp":"2024-03-04T13:13:33.048662+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.048662+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:48.190455+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2307,"num_read_kb":2145,"num_write":589,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"255'296","reported_seq":1059,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:03.103648+0000","last_change":"2024-03-04T13:14:03.103733+0000","last_active":"2024-03-04T13:14:03.103648+0000","last_peered":"2024-03-04T13:14:03.103648+0000","last_clean":"2024-03-04T13:14:03.103648+0000","last_became_active":"2024-03-04T12:20:14.816522+0000","last_became_peered":"2024-03-04T12:20:14.816522+0000","last_unstale":"2024-03-04T13:14:03.103648+0000","last_undegraded":"2024-03-04T13:14:03.103648+0000","last_fullsized":"2024-03-04T13:14:03.103648+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'296","last_scrub_stamp":"2024-03-04T13:14:03.103553+0000","last_deep_scrub":"255'296","last_deep_scrub_stamp":"2024-03-04T13:14:03.103553+0000","last_clean_scrub_stamp":"2024-03-04T13:14:03.103553+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:46.251297+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291510,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":856,"num_read_kb":55073,"num_write":1469,"num_write_kb":53223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:59.120054+0000","last_change":"2024-03-04T13:13:59.120093+0000","last_active":"2024-03-04T13:13:59.120054+0000","last_peered":"2024-03-04T13:13:59.120054+0000","last_clean":"2024-03-04T13:13:59.120054+0000","last_became_active":"2024-03-04T12:20:18.831535+0000","last_became_peered":"2024-03-04T12:20:18.831535+0000","last_unstale":"2024-03-04T13:13:59.120054+0000","last_undegraded":"2024-03-04T13:13:59.120054+0000","last_fullsized":"2024-03-04T13:13:59.120054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:59.119910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:59.119910+0000","last_clean_scrub_stamp":"2024-03-04T13:13:59.119910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:39:30.503734+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"255'153","reported_seq":725,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:49.891944+0000","last_change":"2024-03-04T13:13:49.892009+0000","last_active":"2024-03-04T13:13:49.891944+0000","last_peered":"2024-03-04T13:13:49.891944+0000","last_clean":"2024-03-04T13:13:49.891944+0000","last_became_active":"2024-03-04T12:20:21.641872+0000","last_became_peered":"2024-03-04T12:20:21.641872+0000","last_unstale":"2024-03-04T13:13:49.891944+0000","last_undegraded":"2024-03-04T13:13:49.891944+0000","last_fullsized":"2024-03-04T13:13:49.891944+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'153","last_scrub_stamp":"2024-03-04T13:13:49.891864+0000","last_deep_scrub":"255'153","last_deep_scrub_stamp":"2024-03-04T13:13:49.891864+0000","last_clean_scrub_stamp":"2024-03-04T13:13:49.891864+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:49:25.945375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6408,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":262,"num_write":108,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:05.580574+0000","last_change":"2024-03-04T13:14:05.580612+0000","last_active":"2024-03-04T13:14:05.580574+0000","last_peered":"2024-03-04T13:14:05.580574+0000","last_clean":"2024-03-04T13:14:05.580574+0000","last_became_active":"2024-03-04T12:20:22.854454+0000","last_became_peered":"2024-03-04T12:20:22.854454+0000","last_unstale":"2024-03-04T13:14:05.580574+0000","last_undegraded":"2024-03-04T13:14:05.580574+0000","last_fullsized":"2024-03-04T13:14:05.580574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:05.580441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:05.580441+0000","last_clean_scrub_stamp":"2024-03-04T13:14:05.580441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:23:49.950310+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"255'103","reported_seq":588,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.313257+0000","last_change":"2024-03-04T13:13:38.313257+0000","last_active":"2024-03-04T13:13:38.313257+0000","last_peered":"2024-03-04T13:13:38.313257+0000","last_clean":"2024-03-04T13:13:38.313257+0000","last_became_active":"2024-03-04T12:20:24.862179+0000","last_became_peered":"2024-03-04T12:20:24.862179+0000","last_unstale":"2024-03-04T13:13:38.313257+0000","last_undegraded":"2024-03-04T13:13:38.313257+0000","last_fullsized":"2024-03-04T13:13:38.313257+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'103","last_scrub_stamp":"2024-03-04T13:13:38.313124+0000","last_deep_scrub":"255'103","last_deep_scrub_stamp":"2024-03-04T13:13:38.313124+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.313124+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:14:30.991089+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":249,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"255'456","reported_seq":1917,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:52.192318+0000","last_change":"2024-03-04T13:13:52.192366+0000","last_active":"2024-03-04T13:13:52.192318+0000","last_peered":"2024-03-04T13:13:52.192318+0000","last_clean":"2024-03-04T13:13:52.192318+0000","last_became_active":"2024-03-04T12:20:16.836224+0000","last_became_peered":"2024-03-04T12:20:16.836224+0000","last_unstale":"2024-03-04T13:13:52.192318+0000","last_undegraded":"2024-03-04T13:13:52.192318+0000","last_fullsized":"2024-03-04T13:13:52.192318+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'456","last_scrub_stamp":"2024-03-04T13:13:52.192220+0000","last_deep_scrub":"255'456","last_deep_scrub_stamp":"2024-03-04T13:13:52.192220+0000","last_clean_scrub_stamp":"2024-03-04T13:13:52.192220+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:41:47.988147+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2418,"num_read_kb":2273,"num_write":600,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2192,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"255'189","reported_seq":780,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.103154+0000","last_change":"2024-03-04T12:20:14.821178+0000","last_active":"2024-03-04T13:13:21.103154+0000","last_peered":"2024-03-04T13:13:21.103154+0000","last_clean":"2024-03-04T13:13:21.103154+0000","last_became_active":"2024-03-04T12:20:14.820789+0000","last_became_peered":"2024-03-04T12:20:14.820789+0000","last_unstale":"2024-03-04T13:13:21.103154+0000","last_undegraded":"2024-03-04T13:13:21.103154+0000","last_fullsized":"2024-03-04T13:13:21.103154+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":398,"num_read_kb":8887,"num_write":907,"num_write_kb":18227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":492,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.739148+0000","last_change":"2024-03-04T13:13:47.739171+0000","last_active":"2024-03-04T13:13:47.739148+0000","last_peered":"2024-03-04T13:13:47.739148+0000","last_clean":"2024-03-04T13:13:47.739148+0000","last_became_active":"2024-03-04T12:20:18.837949+0000","last_became_peered":"2024-03-04T12:20:18.837949+0000","last_unstale":"2024-03-04T13:13:47.739148+0000","last_undegraded":"2024-03-04T13:13:47.739148+0000","last_fullsized":"2024-03-04T13:13:47.739148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:47.739056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:47.739056+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.739056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:46:50.171454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"255'90","reported_seq":617,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.216675+0000","last_change":"2024-03-04T13:13:40.216707+0000","last_active":"2024-03-04T13:13:40.216675+0000","last_peered":"2024-03-04T13:13:40.216675+0000","last_clean":"2024-03-04T13:13:40.216675+0000","last_became_active":"2024-03-04T12:20:21.641757+0000","last_became_peered":"2024-03-04T12:20:21.641757+0000","last_unstale":"2024-03-04T13:13:40.216675+0000","last_undegraded":"2024-03-04T13:13:40.216675+0000","last_fullsized":"2024-03-04T13:13:40.216675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'90","last_scrub_stamp":"2024-03-04T13:13:40.216584+0000","last_deep_scrub":"255'90","last_deep_scrub_stamp":"2024-03-04T13:13:40.216584+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.216584+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:25:35.856391+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":90,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"255'498","reported_seq":3573,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.721050+0000","last_change":"2024-03-04T13:13:42.721079+0000","last_active":"2024-03-04T13:13:42.721050+0000","last_peered":"2024-03-04T13:13:42.721050+0000","last_clean":"2024-03-04T13:13:42.721050+0000","last_became_active":"2024-03-04T12:20:22.849630+0000","last_became_peered":"2024-03-04T12:20:22.849630+0000","last_unstale":"2024-03-04T13:13:42.721050+0000","last_undegraded":"2024-03-04T13:13:42.721050+0000","last_fullsized":"2024-03-04T13:13:42.721050+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'498","last_scrub_stamp":"2024-03-04T13:13:42.720946+0000","last_deep_scrub":"255'498","last_deep_scrub_stamp":"2024-03-04T13:13:42.720946+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.720946+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:55:37.618879+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"255'142","reported_seq":640,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.502316+0000","last_change":"2024-03-04T13:13:38.502316+0000","last_active":"2024-03-04T13:13:38.502316+0000","last_peered":"2024-03-04T13:13:38.502316+0000","last_clean":"2024-03-04T13:13:38.502316+0000","last_became_active":"2024-03-04T12:20:24.863312+0000","last_became_peered":"2024-03-04T12:20:24.863312+0000","last_unstale":"2024-03-04T13:13:38.502316+0000","last_undegraded":"2024-03-04T13:13:38.502316+0000","last_fullsized":"2024-03-04T13:13:38.502316+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'142","last_scrub_stamp":"2024-03-04T13:13:38.502185+0000","last_deep_scrub":"255'142","last_deep_scrub_stamp":"2024-03-04T13:13:38.502185+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.502185+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:22:25.568903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":307,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"255'561","reported_seq":2218,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:53.198409+0000","last_change":"2024-03-04T13:13:53.198444+0000","last_active":"2024-03-04T13:13:53.198409+0000","last_peered":"2024-03-04T13:13:53.198409+0000","last_clean":"2024-03-04T13:13:53.198409+0000","last_became_active":"2024-03-04T12:20:16.828102+0000","last_became_peered":"2024-03-04T12:20:16.828102+0000","last_unstale":"2024-03-04T13:13:53.198409+0000","last_undegraded":"2024-03-04T13:13:53.198409+0000","last_fullsized":"2024-03-04T13:13:53.198409+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'561","last_scrub_stamp":"2024-03-04T13:13:53.198310+0000","last_deep_scrub":"255'561","last_deep_scrub_stamp":"2024-03-04T13:13:53.198310+0000","last_clean_scrub_stamp":"2024-03-04T13:13:53.198310+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:32:36.820715+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2984,"num_read_kb":2771,"num_write":760,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":148,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"255'209","reported_seq":852,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:56.446947+0000","last_change":"2024-03-04T13:13:56.446987+0000","last_active":"2024-03-04T13:13:56.446947+0000","last_peered":"2024-03-04T13:13:56.446947+0000","last_clean":"2024-03-04T13:13:56.446947+0000","last_became_active":"2024-03-04T12:20:14.826522+0000","last_became_peered":"2024-03-04T12:20:14.826522+0000","last_unstale":"2024-03-04T13:13:56.446947+0000","last_undegraded":"2024-03-04T13:13:56.446947+0000","last_fullsized":"2024-03-04T13:13:56.446947+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'209","last_scrub_stamp":"2024-03-04T13:13:56.446859+0000","last_deep_scrub":"255'209","last_deep_scrub_stamp":"2024-03-04T13:13:56.446859+0000","last_clean_scrub_stamp":"2024-03-04T13:13:56.446859+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:14:35.719559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27217,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":463,"num_read_kb":10394,"num_write":1165,"num_write_kb":28391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":498,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:59.694042+0000","last_change":"2024-03-04T13:13:59.694078+0000","last_active":"2024-03-04T13:13:59.694042+0000","last_peered":"2024-03-04T13:13:59.694042+0000","last_clean":"2024-03-04T13:13:59.694042+0000","last_became_active":"2024-03-04T12:20:18.832607+0000","last_became_peered":"2024-03-04T12:20:18.832607+0000","last_unstale":"2024-03-04T13:13:59.694042+0000","last_undegraded":"2024-03-04T13:13:59.694042+0000","last_fullsized":"2024-03-04T13:13:59.694042+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:59.693943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:59.693943+0000","last_clean_scrub_stamp":"2024-03-04T13:13:59.693943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:57:17.840373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"255'183","reported_seq":767,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:59.495009+0000","last_change":"2024-03-04T13:13:59.495050+0000","last_active":"2024-03-04T13:13:59.495009+0000","last_peered":"2024-03-04T13:13:59.495009+0000","last_clean":"2024-03-04T13:13:59.495009+0000","last_became_active":"2024-03-04T12:20:20.838062+0000","last_became_peered":"2024-03-04T12:20:20.838062+0000","last_unstale":"2024-03-04T13:13:59.495009+0000","last_undegraded":"2024-03-04T13:13:59.495009+0000","last_fullsized":"2024-03-04T13:13:59.495009+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'183","last_scrub_stamp":"2024-03-04T13:13:59.494923+0000","last_deep_scrub":"255'183","last_deep_scrub_stamp":"2024-03-04T13:13:59.494923+0000","last_clean_scrub_stamp":"2024-03-04T13:13:59.494923+0000","objects_scrubbed":9,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:21:01.495138+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8941,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":239,"num_read_kb":314,"num_write":142,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.813164+0000","last_change":"2024-03-04T13:13:41.813187+0000","last_active":"2024-03-04T13:13:41.813164+0000","last_peered":"2024-03-04T13:13:41.813164+0000","last_clean":"2024-03-04T13:13:41.813164+0000","last_became_active":"2024-03-04T12:20:22.856540+0000","last_became_peered":"2024-03-04T12:20:22.856540+0000","last_unstale":"2024-03-04T13:13:41.813164+0000","last_undegraded":"2024-03-04T13:13:41.813164+0000","last_fullsized":"2024-03-04T13:13:41.813164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:41.813077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:41.813077+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.813077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:29:39.366211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"255'90","reported_seq":586,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.486308+0000","last_change":"2024-03-04T13:13:36.486308+0000","last_active":"2024-03-04T13:13:36.486308+0000","last_peered":"2024-03-04T13:13:36.486308+0000","last_clean":"2024-03-04T13:13:36.486308+0000","last_became_active":"2024-03-04T12:20:24.866984+0000","last_became_peered":"2024-03-04T12:20:24.866984+0000","last_unstale":"2024-03-04T13:13:36.486308+0000","last_undegraded":"2024-03-04T13:13:36.486308+0000","last_fullsized":"2024-03-04T13:13:36.486308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'90","last_scrub_stamp":"2024-03-04T13:13:36.486181+0000","last_deep_scrub":"255'90","last_deep_scrub_stamp":"2024-03-04T13:13:36.486181+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.486181+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:49:23.190861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":81,"num_write":221,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"255'842","reported_seq":2378,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:51.269256+0000","last_change":"2024-03-04T13:13:51.269286+0000","last_active":"2024-03-04T13:13:51.269256+0000","last_peered":"2024-03-04T13:13:51.269256+0000","last_clean":"2024-03-04T13:13:51.269256+0000","last_became_active":"2024-03-04T12:20:16.827592+0000","last_became_peered":"2024-03-04T12:20:16.827592+0000","last_unstale":"2024-03-04T13:13:51.269256+0000","last_undegraded":"2024-03-04T13:13:51.269256+0000","last_fullsized":"2024-03-04T13:13:51.269256+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'842","last_scrub_stamp":"2024-03-04T13:13:51.269152+0000","last_deep_scrub":"255'842","last_deep_scrub_stamp":"2024-03-04T13:13:51.269152+0000","last_clean_scrub_stamp":"2024-03-04T13:13:51.269152+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:21.928001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3846,"num_read_kb":3408,"num_write":1191,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"255'227","reported_seq":868,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:58.450512+0000","last_change":"2024-03-04T13:13:58.450542+0000","last_active":"2024-03-04T13:13:58.450512+0000","last_peered":"2024-03-04T13:13:58.450512+0000","last_clean":"2024-03-04T13:13:58.450512+0000","last_became_active":"2024-03-04T12:20:14.827034+0000","last_became_peered":"2024-03-04T12:20:14.827034+0000","last_unstale":"2024-03-04T13:13:58.450512+0000","last_undegraded":"2024-03-04T13:13:58.450512+0000","last_fullsized":"2024-03-04T13:13:58.450512+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'227","last_scrub_stamp":"2024-03-04T13:13:58.450430+0000","last_deep_scrub":"255'227","last_deep_scrub_stamp":"2024-03-04T13:13:58.450430+0000","last_clean_scrub_stamp":"2024-03-04T13:13:58.450430+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:32.009378+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":510,"num_read_kb":74328,"num_write":1121,"num_write_kb":53240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":491,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:53.444157+0000","last_change":"2024-03-04T13:13:53.444214+0000","last_active":"2024-03-04T13:13:53.444157+0000","last_peered":"2024-03-04T13:13:53.444157+0000","last_clean":"2024-03-04T13:13:53.444157+0000","last_became_active":"2024-03-04T12:20:18.835852+0000","last_became_peered":"2024-03-04T12:20:18.835852+0000","last_unstale":"2024-03-04T13:13:53.444157+0000","last_undegraded":"2024-03-04T13:13:53.444157+0000","last_fullsized":"2024-03-04T13:13:53.444157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:53.444055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:53.444055+0000","last_clean_scrub_stamp":"2024-03-04T13:13:53.444055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:08:46.993330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"255'135","reported_seq":688,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.260557+0000","last_change":"2024-03-04T12:20:20.837534+0000","last_active":"2024-03-04T13:13:25.260557+0000","last_peered":"2024-03-04T13:13:25.260557+0000","last_clean":"2024-03-04T13:13:25.260557+0000","last_became_active":"2024-03-04T12:20:20.837239+0000","last_became_peered":"2024-03-04T12:20:20.837239+0000","last_unstale":"2024-03-04T13:13:25.260557+0000","last_undegraded":"2024-03-04T13:13:25.260557+0000","last_fullsized":"2024-03-04T13:13:25.260557+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7816,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":230,"num_write":86,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.752812+0000","last_change":"2024-03-04T13:13:40.752812+0000","last_active":"2024-03-04T13:13:40.752812+0000","last_peered":"2024-03-04T13:13:40.752812+0000","last_clean":"2024-03-04T13:13:40.752812+0000","last_became_active":"2024-03-04T12:20:22.849731+0000","last_became_peered":"2024-03-04T12:20:22.849731+0000","last_unstale":"2024-03-04T13:13:40.752812+0000","last_undegraded":"2024-03-04T13:13:40.752812+0000","last_fullsized":"2024-03-04T13:13:40.752812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.752696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.752696+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.752696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:38:32.905040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"255'121","reported_seq":629,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.770329+0000","last_change":"2024-03-04T13:13:34.770329+0000","last_active":"2024-03-04T13:13:34.770329+0000","last_peered":"2024-03-04T13:13:34.770329+0000","last_clean":"2024-03-04T13:13:34.770329+0000","last_became_active":"2024-03-04T12:20:24.912599+0000","last_became_peered":"2024-03-04T12:20:24.912599+0000","last_unstale":"2024-03-04T13:13:34.770329+0000","last_undegraded":"2024-03-04T13:13:34.770329+0000","last_fullsized":"2024-03-04T13:13:34.770329+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'121","last_scrub_stamp":"2024-03-04T13:13:34.770155+0000","last_deep_scrub":"255'121","last_deep_scrub_stamp":"2024-03-04T13:13:34.770155+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.770155+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:15:31.167821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":888,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":157,"num_write":287,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"255'1177","reported_seq":2759,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:05.926161+0000","last_change":"2024-03-04T13:14:05.926197+0000","last_active":"2024-03-04T13:14:05.926161+0000","last_peered":"2024-03-04T13:14:05.926161+0000","last_clean":"2024-03-04T13:14:05.926161+0000","last_became_active":"2024-03-04T12:20:16.827448+0000","last_became_peered":"2024-03-04T12:20:16.827448+0000","last_unstale":"2024-03-04T13:14:05.926161+0000","last_undegraded":"2024-03-04T13:14:05.926161+0000","last_fullsized":"2024-03-04T13:14:05.926161+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1177","last_scrub_stamp":"2024-03-04T13:14:05.926074+0000","last_deep_scrub":"255'1177","last_deep_scrub_stamp":"2024-03-04T13:14:05.926074+0000","last_clean_scrub_stamp":"2024-03-04T13:14:05.926074+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":1100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:43.948277+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5284,"num_read_kb":4621,"num_write":1652,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2634,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"255'215","reported_seq":846,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.220408+0000","last_change":"2024-03-04T12:20:14.822903+0000","last_active":"2024-03-04T13:13:21.220408+0000","last_peered":"2024-03-04T13:13:21.220408+0000","last_clean":"2024-03-04T13:13:21.220408+0000","last_became_active":"2024-03-04T12:20:14.822619+0000","last_became_peered":"2024-03-04T12:20:14.822619+0000","last_unstale":"2024-03-04T13:13:21.220408+0000","last_undegraded":"2024-03-04T13:13:21.220408+0000","last_fullsized":"2024-03-04T13:13:21.220408+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9035448,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":16616,"num_write":1088,"num_write_kb":32501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:57.157742+0000","last_change":"2024-03-04T13:13:57.157764+0000","last_active":"2024-03-04T13:13:57.157742+0000","last_peered":"2024-03-04T13:13:57.157742+0000","last_clean":"2024-03-04T13:13:57.157742+0000","last_became_active":"2024-03-04T12:20:18.831105+0000","last_became_peered":"2024-03-04T12:20:18.831105+0000","last_unstale":"2024-03-04T13:13:57.157742+0000","last_undegraded":"2024-03-04T13:13:57.157742+0000","last_fullsized":"2024-03-04T13:13:57.157742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:57.157635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:57.157635+0000","last_clean_scrub_stamp":"2024-03-04T13:13:57.157635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:53:03.444698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"255'100","reported_seq":642,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.125345+0000","last_change":"2024-03-04T12:20:20.842912+0000","last_active":"2024-03-04T13:13:21.125345+0000","last_peered":"2024-03-04T13:13:21.125345+0000","last_clean":"2024-03-04T13:13:21.125345+0000","last_became_active":"2024-03-04T12:20:20.842361+0000","last_became_peered":"2024-03-04T12:20:20.842361+0000","last_unstale":"2024-03-04T13:13:21.125345+0000","last_undegraded":"2024-03-04T13:13:21.125345+0000","last_fullsized":"2024-03-04T13:13:21.125345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:19.820805+0000","last_clean_scrub_stamp":"2024-03-04T12:20:19.820805+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":178,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.171567+0000","last_change":"2024-03-04T13:13:36.171595+0000","last_active":"2024-03-04T13:13:36.171567+0000","last_peered":"2024-03-04T13:13:36.171567+0000","last_clean":"2024-03-04T13:13:36.171567+0000","last_became_active":"2024-03-04T12:20:22.856748+0000","last_became_peered":"2024-03-04T12:20:22.856748+0000","last_unstale":"2024-03-04T13:13:36.171567+0000","last_undegraded":"2024-03-04T13:13:36.171567+0000","last_fullsized":"2024-03-04T13:13:36.171567+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:36.171482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:36.171482+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.171482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:01:15.968186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"255'150","reported_seq":1202,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.495689+0000","last_change":"2024-03-04T13:13:37.495689+0000","last_active":"2024-03-04T13:13:37.495689+0000","last_peered":"2024-03-04T13:13:37.495689+0000","last_clean":"2024-03-04T13:13:37.495689+0000","last_became_active":"2024-03-04T12:20:24.865363+0000","last_became_peered":"2024-03-04T12:20:24.865363+0000","last_unstale":"2024-03-04T13:13:37.495689+0000","last_undegraded":"2024-03-04T13:13:37.495689+0000","last_fullsized":"2024-03-04T13:13:37.495689+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'150","last_scrub_stamp":"2024-03-04T13:13:37.495521+0000","last_deep_scrub":"255'150","last_deep_scrub_stamp":"2024-03-04T13:13:37.495521+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.495521+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:07:28.025150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":819,"num_read_kb":785,"num_write":355,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"255'725","reported_seq":2133,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.106410+0000","last_change":"2024-03-04T12:20:16.820242+0000","last_active":"2024-03-04T13:13:27.106410+0000","last_peered":"2024-03-04T13:13:27.106410+0000","last_clean":"2024-03-04T13:13:27.106410+0000","last_became_active":"2024-03-04T12:20:16.819966+0000","last_became_peered":"2024-03-04T12:20:16.819966+0000","last_unstale":"2024-03-04T13:13:27.106410+0000","last_undegraded":"2024-03-04T13:13:27.106410+0000","last_fullsized":"2024-03-04T13:13:27.106410+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3297,"num_read_kb":2935,"num_write":968,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"255'284","reported_seq":938,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:05.953606+0000","last_change":"2024-03-04T13:14:05.953680+0000","last_active":"2024-03-04T13:14:05.953606+0000","last_peered":"2024-03-04T13:14:05.953606+0000","last_clean":"2024-03-04T13:14:05.953606+0000","last_became_active":"2024-03-04T12:20:14.824168+0000","last_became_peered":"2024-03-04T12:20:14.824168+0000","last_unstale":"2024-03-04T13:14:05.953606+0000","last_undegraded":"2024-03-04T13:14:05.953606+0000","last_fullsized":"2024-03-04T13:14:05.953606+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'284","last_scrub_stamp":"2024-03-04T13:14:05.953500+0000","last_deep_scrub":"255'284","last_deep_scrub_stamp":"2024-03-04T13:14:05.953500+0000","last_clean_scrub_stamp":"2024-03-04T13:14:05.953500+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:23.518865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":709,"num_read_kb":4351,"num_write":1165,"num_write_kb":19276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"255'2","reported_seq":495,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.776023+0000","last_change":"2024-03-04T13:13:41.776049+0000","last_active":"2024-03-04T13:13:41.776023+0000","last_peered":"2024-03-04T13:13:41.776023+0000","last_clean":"2024-03-04T13:13:41.776023+0000","last_became_active":"2024-03-04T12:20:18.836203+0000","last_became_peered":"2024-03-04T12:20:18.836203+0000","last_unstale":"2024-03-04T13:13:41.776023+0000","last_undegraded":"2024-03-04T13:13:41.776023+0000","last_fullsized":"2024-03-04T13:13:41.776023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:41.775929+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:41.775929+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.775929+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:50:48.463948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"255'164","reported_seq":749,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.295997+0000","last_change":"2024-03-04T13:13:42.296030+0000","last_active":"2024-03-04T13:13:42.295997+0000","last_peered":"2024-03-04T13:13:42.295997+0000","last_clean":"2024-03-04T13:13:42.295997+0000","last_became_active":"2024-03-04T12:20:20.842246+0000","last_became_peered":"2024-03-04T12:20:20.842246+0000","last_unstale":"2024-03-04T13:13:42.295997+0000","last_undegraded":"2024-03-04T13:13:42.295997+0000","last_fullsized":"2024-03-04T13:13:42.295997+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'164","last_scrub_stamp":"2024-03-04T13:13:42.295912+0000","last_deep_scrub":"255'164","last_deep_scrub_stamp":"2024-03-04T13:13:42.295912+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.295912+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:11:48.208552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":208,"num_read_kb":255,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.837055+0000","last_change":"2024-03-04T13:13:40.837077+0000","last_active":"2024-03-04T13:13:40.837055+0000","last_peered":"2024-03-04T13:13:40.837055+0000","last_clean":"2024-03-04T13:13:40.837055+0000","last_became_active":"2024-03-04T12:20:22.856597+0000","last_became_peered":"2024-03-04T12:20:22.856597+0000","last_unstale":"2024-03-04T13:13:40.837055+0000","last_undegraded":"2024-03-04T13:13:40.837055+0000","last_fullsized":"2024-03-04T13:13:40.837055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.836958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.836958+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.836958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:40:36.037380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"255'91","reported_seq":578,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.180139+0000","last_change":"2024-03-04T13:13:35.180186+0000","last_active":"2024-03-04T13:13:35.180139+0000","last_peered":"2024-03-04T13:13:35.180139+0000","last_clean":"2024-03-04T13:13:35.180139+0000","last_became_active":"2024-03-04T12:20:24.869207+0000","last_became_peered":"2024-03-04T12:20:24.869207+0000","last_unstale":"2024-03-04T13:13:35.180139+0000","last_undegraded":"2024-03-04T13:13:35.180139+0000","last_fullsized":"2024-03-04T13:13:35.180139+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'91","last_scrub_stamp":"2024-03-04T13:13:35.180028+0000","last_deep_scrub":"255'91","last_deep_scrub_stamp":"2024-03-04T13:13:35.180028+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.180028+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:13:14.165397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":212,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"255'1093","reported_seq":2667,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.729735+0000","last_change":"2024-03-04T13:13:46.729763+0000","last_active":"2024-03-04T13:13:46.729735+0000","last_peered":"2024-03-04T13:13:46.729735+0000","last_clean":"2024-03-04T13:13:46.729735+0000","last_became_active":"2024-03-04T12:20:16.832377+0000","last_became_peered":"2024-03-04T12:20:16.832377+0000","last_unstale":"2024-03-04T13:13:46.729735+0000","last_undegraded":"2024-03-04T13:13:46.729735+0000","last_fullsized":"2024-03-04T13:13:46.729735+0000","mapping_epoch":22,"log_start":"255'1000","ondisk_log_start":"255'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1093","last_scrub_stamp":"2024-03-04T13:13:46.729643+0000","last_deep_scrub":"255'1093","last_deep_scrub_stamp":"2024-03-04T13:13:46.729643+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.729643+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":1000,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:00:19.632521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4785,"num_read_kb":4211,"num_write":1502,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"255'219","reported_seq":875,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:53.741029+0000","last_change":"2024-03-04T13:13:53.741080+0000","last_active":"2024-03-04T13:13:53.741029+0000","last_peered":"2024-03-04T13:13:53.741029+0000","last_clean":"2024-03-04T13:13:53.741029+0000","last_became_active":"2024-03-04T12:20:14.817326+0000","last_became_peered":"2024-03-04T12:20:14.817326+0000","last_unstale":"2024-03-04T13:13:53.741029+0000","last_undegraded":"2024-03-04T13:13:53.741029+0000","last_fullsized":"2024-03-04T13:13:53.741029+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'219","last_scrub_stamp":"2024-03-04T13:13:53.740946+0000","last_deep_scrub":"255'219","last_deep_scrub_stamp":"2024-03-04T13:13:53.740946+0000","last_clean_scrub_stamp":"2024-03-04T13:13:53.740946+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:53:35.222082+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":463525,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":541,"num_read_kb":21798,"num_write":1100,"num_write_kb":25910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"255'797","reported_seq":2448,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.757911+0000","last_change":"2024-03-04T13:13:42.757960+0000","last_active":"2024-03-04T13:13:42.757911+0000","last_peered":"2024-03-04T13:13:42.757911+0000","last_clean":"2024-03-04T13:13:42.757911+0000","last_became_active":"2024-03-04T12:20:16.834823+0000","last_became_peered":"2024-03-04T12:20:16.834823+0000","last_unstale":"2024-03-04T13:13:42.757911+0000","last_undegraded":"2024-03-04T13:13:42.757911+0000","last_fullsized":"2024-03-04T13:13:42.757911+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'797","last_scrub_stamp":"2024-03-04T13:13:42.757785+0000","last_deep_scrub":"255'797","last_deep_scrub_stamp":"2024-03-04T13:13:42.757785+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.757785+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:53:56.372808+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3958,"num_read_kb":3565,"num_write":1074,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1914,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"255'213","reported_seq":865,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.170748+0000","last_change":"2024-03-04T13:13:46.170790+0000","last_active":"2024-03-04T13:13:46.170748+0000","last_peered":"2024-03-04T13:13:46.170748+0000","last_clean":"2024-03-04T13:13:46.170748+0000","last_became_active":"2024-03-04T12:20:14.819333+0000","last_became_peered":"2024-03-04T12:20:14.819333+0000","last_unstale":"2024-03-04T13:13:46.170748+0000","last_undegraded":"2024-03-04T13:13:46.170748+0000","last_fullsized":"2024-03-04T13:13:46.170748+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'213","last_scrub_stamp":"2024-03-04T13:13:46.170666+0000","last_deep_scrub":"255'213","last_deep_scrub_stamp":"2024-03-04T13:13:46.170666+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.170666+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:06:30.772153+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":688512,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":39432,"num_write":1114,"num_write_kb":31535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"255'571","reported_seq":2106,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:48.325209+0000","last_change":"2024-03-04T13:13:48.325253+0000","last_active":"2024-03-04T13:13:48.325209+0000","last_peered":"2024-03-04T13:13:48.325209+0000","last_clean":"2024-03-04T13:13:48.325209+0000","last_became_active":"2024-03-04T12:20:16.828799+0000","last_became_peered":"2024-03-04T12:20:16.828799+0000","last_unstale":"2024-03-04T13:13:48.325209+0000","last_undegraded":"2024-03-04T13:13:48.325209+0000","last_fullsized":"2024-03-04T13:13:48.325209+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'571","last_scrub_stamp":"2024-03-04T13:13:48.325117+0000","last_deep_scrub":"255'571","last_deep_scrub_stamp":"2024-03-04T13:13:48.325117+0000","last_clean_scrub_stamp":"2024-03-04T13:13:48.325117+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:26.098338+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2802,"num_read_kb":2536,"num_write":761,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":783,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"255'189","reported_seq":803,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:06.518170+0000","last_change":"2024-03-04T13:14:06.518202+0000","last_active":"2024-03-04T13:14:06.518170+0000","last_peered":"2024-03-04T13:14:06.518170+0000","last_clean":"2024-03-04T13:14:06.518170+0000","last_became_active":"2024-03-04T12:20:14.823794+0000","last_became_peered":"2024-03-04T12:20:14.823794+0000","last_unstale":"2024-03-04T13:14:06.518170+0000","last_undegraded":"2024-03-04T13:14:06.518170+0000","last_fullsized":"2024-03-04T13:14:06.518170+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'189","last_scrub_stamp":"2024-03-04T13:14:06.518085+0000","last_deep_scrub":"255'189","last_deep_scrub_stamp":"2024-03-04T13:14:06.518085+0000","last_clean_scrub_stamp":"2024-03-04T13:14:06.518085+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:09.766393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27216,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":368,"num_read_kb":29267,"num_write":940,"num_write_kb":26221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"255'420","reported_seq":2024,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:50.674696+0000","last_change":"2024-03-04T13:13:50.674724+0000","last_active":"2024-03-04T13:13:50.674696+0000","last_peered":"2024-03-04T13:13:50.674696+0000","last_clean":"2024-03-04T13:13:50.674696+0000","last_became_active":"2024-03-04T12:20:16.830023+0000","last_became_peered":"2024-03-04T12:20:16.830023+0000","last_unstale":"2024-03-04T13:13:50.674696+0000","last_undegraded":"2024-03-04T13:13:50.674696+0000","last_fullsized":"2024-03-04T13:13:50.674696+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'420","last_scrub_stamp":"2024-03-04T13:13:50.674608+0000","last_deep_scrub":"255'420","last_deep_scrub_stamp":"2024-03-04T13:13:50.674608+0000","last_clean_scrub_stamp":"2024-03-04T13:13:50.674608+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:47:59.765664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2457,"num_read_kb":2316,"num_write":500,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1912,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"255'181","reported_seq":765,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.206595+0000","last_change":"2024-03-04T12:20:14.814965+0000","last_active":"2024-03-04T13:13:21.206595+0000","last_peered":"2024-03-04T13:13:21.206595+0000","last_clean":"2024-03-04T13:13:21.206595+0000","last_became_active":"2024-03-04T12:20:14.814649+0000","last_became_peered":"2024-03-04T12:20:14.814649+0000","last_unstale":"2024-03-04T13:13:21.206595+0000","last_undegraded":"2024-03-04T13:13:21.206595+0000","last_fullsized":"2024-03-04T13:13:21.206595+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":350,"num_read_kb":14298,"num_write":961,"num_write_kb":45374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"255'672","reported_seq":2129,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:55.900474+0000","last_change":"2024-03-04T13:13:55.900544+0000","last_active":"2024-03-04T13:13:55.900474+0000","last_peered":"2024-03-04T13:13:55.900474+0000","last_clean":"2024-03-04T13:13:55.900474+0000","last_became_active":"2024-03-04T12:20:16.831861+0000","last_became_peered":"2024-03-04T12:20:16.831861+0000","last_unstale":"2024-03-04T13:13:55.900474+0000","last_undegraded":"2024-03-04T13:13:55.900474+0000","last_fullsized":"2024-03-04T13:13:55.900474+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'672","last_scrub_stamp":"2024-03-04T13:13:55.900379+0000","last_deep_scrub":"255'672","last_deep_scrub_stamp":"2024-03-04T13:13:55.900379+0000","last_clean_scrub_stamp":"2024-03-04T13:13:55.900379+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":600,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:08:34.528220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3134,"num_read_kb":2831,"num_write":876,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"255'150","reported_seq":783,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.234393+0000","last_change":"2024-03-04T12:20:14.818277+0000","last_active":"2024-03-04T13:13:21.234393+0000","last_peered":"2024-03-04T13:13:21.234393+0000","last_clean":"2024-03-04T13:13:21.234393+0000","last_became_active":"2024-03-04T12:20:14.818011+0000","last_became_peered":"2024-03-04T12:20:14.818011+0000","last_unstale":"2024-03-04T13:13:21.234393+0000","last_undegraded":"2024-03-04T13:13:21.234393+0000","last_fullsized":"2024-03-04T13:13:21.234393+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6900048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":2296,"num_write":812,"num_write_kb":10260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"255'1155","reported_seq":2629,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:58.153201+0000","last_change":"2024-03-04T13:13:58.153251+0000","last_active":"2024-03-04T13:13:58.153201+0000","last_peered":"2024-03-04T13:13:58.153201+0000","last_clean":"2024-03-04T13:13:58.153201+0000","last_became_active":"2024-03-04T12:20:16.820794+0000","last_became_peered":"2024-03-04T12:20:16.820794+0000","last_unstale":"2024-03-04T13:13:58.153201+0000","last_undegraded":"2024-03-04T13:13:58.153201+0000","last_fullsized":"2024-03-04T13:13:58.153201+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1155","last_scrub_stamp":"2024-03-04T13:13:58.153115+0000","last_deep_scrub":"255'1155","last_deep_scrub_stamp":"2024-03-04T13:13:58.153115+0000","last_clean_scrub_stamp":"2024-03-04T13:13:58.153115+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":1100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:07:45.841194+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4910,"num_read_kb":4282,"num_write":1611,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"255'219","reported_seq":851,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:00.635685+0000","last_change":"2024-03-04T13:14:00.635789+0000","last_active":"2024-03-04T13:14:00.635685+0000","last_peered":"2024-03-04T13:14:00.635685+0000","last_clean":"2024-03-04T13:14:00.635685+0000","last_became_active":"2024-03-04T12:20:14.811334+0000","last_became_peered":"2024-03-04T12:20:14.811334+0000","last_unstale":"2024-03-04T13:14:00.635685+0000","last_undegraded":"2024-03-04T13:14:00.635685+0000","last_fullsized":"2024-03-04T13:14:00.635685+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'219","last_scrub_stamp":"2024-03-04T13:14:00.635561+0000","last_deep_scrub":"255'219","last_deep_scrub_stamp":"2024-03-04T13:14:00.635561+0000","last_clean_scrub_stamp":"2024-03-04T13:14:00.635561+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:40.033710+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1577095,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":33282,"num_write":1226,"num_write_kb":31843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"255'763","reported_seq":2389,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:56.860186+0000","last_change":"2024-03-04T13:13:56.860235+0000","last_active":"2024-03-04T13:13:56.860186+0000","last_peered":"2024-03-04T13:13:56.860186+0000","last_clean":"2024-03-04T13:13:56.860186+0000","last_became_active":"2024-03-04T12:20:16.835285+0000","last_became_peered":"2024-03-04T12:20:16.835285+0000","last_unstale":"2024-03-04T13:13:56.860186+0000","last_undegraded":"2024-03-04T13:13:56.860186+0000","last_fullsized":"2024-03-04T13:13:56.860186+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'763","last_scrub_stamp":"2024-03-04T13:13:56.860064+0000","last_deep_scrub":"255'763","last_deep_scrub_stamp":"2024-03-04T13:13:56.860064+0000","last_clean_scrub_stamp":"2024-03-04T13:13:56.860064+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:33.188987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3723,"num_read_kb":3381,"num_write":1013,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"255'218","reported_seq":856,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:55.763324+0000","last_change":"2024-03-04T13:13:55.763405+0000","last_active":"2024-03-04T13:13:55.763324+0000","last_peered":"2024-03-04T13:13:55.763324+0000","last_clean":"2024-03-04T13:13:55.763324+0000","last_became_active":"2024-03-04T12:20:14.818385+0000","last_became_peered":"2024-03-04T12:20:14.818385+0000","last_unstale":"2024-03-04T13:13:55.763324+0000","last_undegraded":"2024-03-04T13:13:55.763324+0000","last_fullsized":"2024-03-04T13:13:55.763324+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'218","last_scrub_stamp":"2024-03-04T13:13:55.763228+0000","last_deep_scrub":"255'218","last_deep_scrub_stamp":"2024-03-04T13:13:55.763228+0000","last_clean_scrub_stamp":"2024-03-04T13:13:55.763228+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:42:06.507084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":39388,"num_write":1130,"num_write_kb":46394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"255'1088","reported_seq":2795,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.743505+0000","last_change":"2024-03-04T13:13:45.743547+0000","last_active":"2024-03-04T13:13:45.743505+0000","last_peered":"2024-03-04T13:13:45.743505+0000","last_clean":"2024-03-04T13:13:45.743505+0000","last_became_active":"2024-03-04T12:20:16.823596+0000","last_became_peered":"2024-03-04T12:20:16.823596+0000","last_unstale":"2024-03-04T13:13:45.743505+0000","last_undegraded":"2024-03-04T13:13:45.743505+0000","last_fullsized":"2024-03-04T13:13:45.743505+0000","mapping_epoch":22,"log_start":"255'1000","ondisk_log_start":"255'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1088","last_scrub_stamp":"2024-03-04T13:13:45.743404+0000","last_deep_scrub":"255'1088","last_deep_scrub_stamp":"2024-03-04T13:13:45.743404+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.743404+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":1000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:44.706870+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5087,"num_read_kb":4523,"num_write":1483,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2399,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"255'226","reported_seq":1076,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.234994+0000","last_change":"2024-03-04T12:20:14.818818+0000","last_active":"2024-03-04T13:13:21.234994+0000","last_peered":"2024-03-04T13:13:21.234994+0000","last_clean":"2024-03-04T13:13:21.234994+0000","last_became_active":"2024-03-04T12:20:14.818340+0000","last_became_peered":"2024-03-04T12:20:14.818340+0000","last_unstale":"2024-03-04T13:13:21.234994+0000","last_undegraded":"2024-03-04T13:13:21.234994+0000","last_fullsized":"2024-03-04T13:13:21.234994+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":933,"num_read_kb":21991,"num_write":1290,"num_write_kb":38918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"255'452","reported_seq":2005,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:53.790611+0000","last_change":"2024-03-04T13:13:53.790611+0000","last_active":"2024-03-04T13:13:53.790611+0000","last_peered":"2024-03-04T13:13:53.790611+0000","last_clean":"2024-03-04T13:13:53.790611+0000","last_became_active":"2024-03-04T12:20:16.830259+0000","last_became_peered":"2024-03-04T12:20:16.830259+0000","last_unstale":"2024-03-04T13:13:53.790611+0000","last_undegraded":"2024-03-04T13:13:53.790611+0000","last_fullsized":"2024-03-04T13:13:53.790611+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'452","last_scrub_stamp":"2024-03-04T13:13:53.790495+0000","last_deep_scrub":"255'452","last_deep_scrub_stamp":"2024-03-04T13:13:53.790495+0000","last_clean_scrub_stamp":"2024-03-04T13:13:53.790495+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:53.053685+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2206,"num_write":536,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":950,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"255'206","reported_seq":856,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.164401+0000","last_change":"2024-03-04T12:20:14.824797+0000","last_active":"2024-03-04T13:13:21.164401+0000","last_peered":"2024-03-04T13:13:21.164401+0000","last_clean":"2024-03-04T13:13:21.164401+0000","last_became_active":"2024-03-04T12:20:14.823513+0000","last_became_peered":"2024-03-04T12:20:14.823513+0000","last_unstale":"2024-03-04T13:13:21.164401+0000","last_undegraded":"2024-03-04T13:13:21.164401+0000","last_fullsized":"2024-03-04T13:13:21.164401+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706375,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":60209,"num_write":1193,"num_write_kb":41508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"255'752","reported_seq":2242,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:50.286440+0000","last_change":"2024-03-04T13:13:50.286440+0000","last_active":"2024-03-04T13:13:50.286440+0000","last_peered":"2024-03-04T13:13:50.286440+0000","last_clean":"2024-03-04T13:13:50.286440+0000","last_became_active":"2024-03-04T12:20:16.825534+0000","last_became_peered":"2024-03-04T12:20:16.825534+0000","last_unstale":"2024-03-04T13:13:50.286440+0000","last_undegraded":"2024-03-04T13:13:50.286440+0000","last_fullsized":"2024-03-04T13:13:50.286440+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'752","last_scrub_stamp":"2024-03-04T13:13:50.286319+0000","last_deep_scrub":"255'752","last_deep_scrub_stamp":"2024-03-04T13:13:50.286319+0000","last_clean_scrub_stamp":"2024-03-04T13:13:50.286319+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:44:46.969711+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3330,"num_read_kb":2980,"num_write":1004,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"255'222","reported_seq":831,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.081294+0000","last_change":"2024-03-04T12:20:14.817902+0000","last_active":"2024-03-04T13:13:21.081294+0000","last_peered":"2024-03-04T13:13:21.081294+0000","last_clean":"2024-03-04T13:13:21.081294+0000","last_became_active":"2024-03-04T12:20:14.817531+0000","last_became_peered":"2024-03-04T12:20:14.817531+0000","last_unstale":"2024-03-04T13:13:21.081294+0000","last_undegraded":"2024-03-04T13:13:21.081294+0000","last_fullsized":"2024-03-04T13:13:21.081294+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7696,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":19231,"num_write":1186,"num_write_kb":63143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"255'537","reported_seq":2119,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:48.219134+0000","last_change":"2024-03-04T13:13:48.219165+0000","last_active":"2024-03-04T13:13:48.219134+0000","last_peered":"2024-03-04T13:13:48.219134+0000","last_clean":"2024-03-04T13:13:48.219134+0000","last_became_active":"2024-03-04T12:20:16.823358+0000","last_became_peered":"2024-03-04T12:20:16.823358+0000","last_unstale":"2024-03-04T13:13:48.219134+0000","last_undegraded":"2024-03-04T13:13:48.219134+0000","last_fullsized":"2024-03-04T13:13:48.219134+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'537","last_scrub_stamp":"2024-03-04T13:13:48.219035+0000","last_deep_scrub":"255'537","last_deep_scrub_stamp":"2024-03-04T13:13:48.219035+0000","last_clean_scrub_stamp":"2024-03-04T13:13:48.219035+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:29:07.573496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2875,"num_read_kb":2619,"num_write":718,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2817,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"255'189","reported_seq":802,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.141126+0000","last_change":"2024-03-04T13:13:31.141187+0000","last_active":"2024-03-04T13:13:31.141126+0000","last_peered":"2024-03-04T13:13:31.141126+0000","last_clean":"2024-03-04T13:13:31.141126+0000","last_became_active":"2024-03-04T12:20:50.902181+0000","last_became_peered":"2024-03-04T12:20:50.902181+0000","last_unstale":"2024-03-04T13:13:31.141126+0000","last_undegraded":"2024-03-04T13:13:31.141126+0000","last_fullsized":"2024-03-04T13:13:31.141126+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'189","last_scrub_stamp":"2024-03-04T13:13:31.141036+0000","last_deep_scrub":"255'189","last_deep_scrub_stamp":"2024-03-04T13:13:31.141036+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.141036+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:38:14.485982+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918078,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":20827,"num_write":1047,"num_write_kb":19608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"255'418","reported_seq":1797,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:12:02.516883+0000","last_change":"2024-03-04T12:20:16.819439+0000","last_active":"2024-03-04T13:12:02.516883+0000","last_peered":"2024-03-04T13:12:02.516883+0000","last_clean":"2024-03-04T13:12:02.516883+0000","last_became_active":"2024-03-04T12:20:16.819169+0000","last_became_peered":"2024-03-04T12:20:16.819169+0000","last_unstale":"2024-03-04T13:12:02.516883+0000","last_undegraded":"2024-03-04T13:12:02.516883+0000","last_fullsized":"2024-03-04T13:12:02.516883+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:15.801200+0000","last_clean_scrub_stamp":"2024-03-04T12:20:15.801200+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2116,"num_read_kb":1957,"num_write":522,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"255'172","reported_seq":788,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.052197+0000","last_change":"2024-03-04T12:20:14.823104+0000","last_active":"2024-03-04T13:13:21.052197+0000","last_peered":"2024-03-04T13:13:21.052197+0000","last_clean":"2024-03-04T13:13:21.052197+0000","last_became_active":"2024-03-04T12:20:14.822588+0000","last_became_peered":"2024-03-04T12:20:14.822588+0000","last_unstale":"2024-03-04T13:13:21.052197+0000","last_undegraded":"2024-03-04T13:13:21.052197+0000","last_fullsized":"2024-03-04T13:13:21.052197+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":390,"num_read_kb":47350,"num_write":1028,"num_write_kb":32429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"255'483","reported_seq":2035,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:52.681349+0000","last_change":"2024-03-04T13:13:52.681380+0000","last_active":"2024-03-04T13:13:52.681349+0000","last_peered":"2024-03-04T13:13:52.681349+0000","last_clean":"2024-03-04T13:13:52.681349+0000","last_became_active":"2024-03-04T12:20:16.828618+0000","last_became_peered":"2024-03-04T12:20:16.828618+0000","last_unstale":"2024-03-04T13:13:52.681349+0000","last_undegraded":"2024-03-04T13:13:52.681349+0000","last_fullsized":"2024-03-04T13:13:52.681349+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'483","last_scrub_stamp":"2024-03-04T13:13:52.681231+0000","last_deep_scrub":"255'483","last_deep_scrub_stamp":"2024-03-04T13:13:52.681231+0000","last_clean_scrub_stamp":"2024-03-04T13:13:52.681231+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:48:06.290986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2516,"num_read_kb":2328,"num_write":610,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"255'183","reported_seq":922,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:56.782224+0000","last_change":"2024-03-04T13:13:56.782272+0000","last_active":"2024-03-04T13:13:56.782224+0000","last_peered":"2024-03-04T13:13:56.782224+0000","last_clean":"2024-03-04T13:13:56.782224+0000","last_became_active":"2024-03-04T12:20:14.818924+0000","last_became_peered":"2024-03-04T12:20:14.818924+0000","last_unstale":"2024-03-04T13:13:56.782224+0000","last_undegraded":"2024-03-04T13:13:56.782224+0000","last_fullsized":"2024-03-04T13:13:56.782224+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'183","last_scrub_stamp":"2024-03-04T13:13:56.782121+0000","last_deep_scrub":"255'183","last_deep_scrub_stamp":"2024-03-04T13:13:56.782121+0000","last_clean_scrub_stamp":"2024-03-04T13:13:56.782121+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:22:22.619641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":719,"num_read_kb":26573,"num_write":1059,"num_write_kb":25938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"255'850","reported_seq":2387,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:54.767776+0000","last_change":"2024-03-04T13:13:54.767801+0000","last_active":"2024-03-04T13:13:54.767776+0000","last_peered":"2024-03-04T13:13:54.767776+0000","last_clean":"2024-03-04T13:13:54.767776+0000","last_became_active":"2024-03-04T12:20:16.835308+0000","last_became_peered":"2024-03-04T12:20:16.835308+0000","last_unstale":"2024-03-04T13:13:54.767776+0000","last_undegraded":"2024-03-04T13:13:54.767776+0000","last_fullsized":"2024-03-04T13:13:54.767776+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'850","last_scrub_stamp":"2024-03-04T13:13:54.767671+0000","last_deep_scrub":"255'850","last_deep_scrub_stamp":"2024-03-04T13:13:54.767671+0000","last_clean_scrub_stamp":"2024-03-04T13:13:54.767671+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:54:45.196170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3917,"num_read_kb":3486,"num_write":1199,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"255'194","reported_seq":802,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:21.206750+0000","last_change":"2024-03-04T12:20:14.816730+0000","last_active":"2024-03-04T13:13:21.206750+0000","last_peered":"2024-03-04T13:13:21.206750+0000","last_clean":"2024-03-04T13:13:21.206750+0000","last_became_active":"2024-03-04T12:20:14.816440+0000","last_became_peered":"2024-03-04T12:20:14.816440+0000","last_unstale":"2024-03-04T13:13:21.206750+0000","last_undegraded":"2024-03-04T13:13:21.206750+0000","last_fullsized":"2024-03-04T13:13:21.206750+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T12:20:13.792254+0000","last_clean_scrub_stamp":"2024-03-04T12:20:13.792254+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17822208,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":392,"num_read_kb":7899,"num_write":1089,"num_write_kb":49946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"255'690","reported_seq":2019,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:03.907704+0000","last_change":"2024-03-04T13:14:03.907761+0000","last_active":"2024-03-04T13:14:03.907704+0000","last_peered":"2024-03-04T13:14:03.907704+0000","last_clean":"2024-03-04T13:14:03.907704+0000","last_became_active":"2024-03-04T12:20:16.827770+0000","last_became_peered":"2024-03-04T12:20:16.827770+0000","last_unstale":"2024-03-04T13:14:03.907704+0000","last_undegraded":"2024-03-04T13:14:03.907704+0000","last_fullsized":"2024-03-04T13:14:03.907704+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'690","last_scrub_stamp":"2024-03-04T13:14:03.907595+0000","last_deep_scrub":"255'690","last_deep_scrub_stamp":"2024-03-04T13:14:03.907595+0000","last_clean_scrub_stamp":"2024-03-04T13:14:03.907595+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:45.174258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3073,"num_read_kb":2741,"num_write":929,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1425,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"255'194","reported_seq":811,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.208750+0000","last_change":"2024-03-04T13:13:47.208750+0000","last_active":"2024-03-04T13:13:47.208750+0000","last_peered":"2024-03-04T13:13:47.208750+0000","last_clean":"2024-03-04T13:13:47.208750+0000","last_became_active":"2024-03-04T12:20:14.820393+0000","last_became_peered":"2024-03-04T12:20:14.820393+0000","last_unstale":"2024-03-04T13:13:47.208750+0000","last_undegraded":"2024-03-04T13:13:47.208750+0000","last_fullsized":"2024-03-04T13:13:47.208750+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'194","last_scrub_stamp":"2024-03-04T13:13:47.208620+0000","last_deep_scrub":"255'194","last_deep_scrub_stamp":"2024-03-04T13:13:47.208620+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.208620+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:32:29.821551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":6825,"num_write":1149,"num_write_kb":21389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"255'359","reported_seq":1785,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:50.607970+0000","last_change":"2024-03-04T13:13:50.608003+0000","last_active":"2024-03-04T13:13:50.607970+0000","last_peered":"2024-03-04T13:13:50.607970+0000","last_clean":"2024-03-04T13:13:50.607970+0000","last_became_active":"2024-03-04T12:20:16.829306+0000","last_became_peered":"2024-03-04T12:20:16.829306+0000","last_unstale":"2024-03-04T13:13:50.607970+0000","last_undegraded":"2024-03-04T13:13:50.607970+0000","last_fullsized":"2024-03-04T13:13:50.607970+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'359","last_scrub_stamp":"2024-03-04T13:13:50.607886+0000","last_deep_scrub":"255'359","last_deep_scrub_stamp":"2024-03-04T13:13:50.607886+0000","last_clean_scrub_stamp":"2024-03-04T13:13:50.607886+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:32.533857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1952,"num_read_kb":1858,"num_write":426,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":218,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"255'174","reported_seq":786,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:05.490273+0000","last_change":"2024-03-04T13:14:05.490322+0000","last_active":"2024-03-04T13:14:05.490273+0000","last_peered":"2024-03-04T13:14:05.490273+0000","last_clean":"2024-03-04T13:14:05.490273+0000","last_became_active":"2024-03-04T12:20:14.821961+0000","last_became_peered":"2024-03-04T12:20:14.821961+0000","last_unstale":"2024-03-04T13:14:05.490273+0000","last_undegraded":"2024-03-04T13:14:05.490273+0000","last_fullsized":"2024-03-04T13:14:05.490273+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'174","last_scrub_stamp":"2024-03-04T13:14:05.490166+0000","last_deep_scrub":"255'174","last_deep_scrub_stamp":"2024-03-04T13:14:05.490166+0000","last_clean_scrub_stamp":"2024-03-04T13:14:05.490166+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:57:53.309018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":395,"num_read_kb":13429,"num_write":876,"num_write_kb":50070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"255'155","reported_seq":732,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.027327+0000","last_change":"2024-03-04T13:13:35.027360+0000","last_active":"2024-03-04T13:13:35.027327+0000","last_peered":"2024-03-04T13:13:35.027327+0000","last_clean":"2024-03-04T13:13:35.027327+0000","last_became_active":"2024-03-04T12:20:51.030887+0000","last_became_peered":"2024-03-04T12:20:51.030887+0000","last_unstale":"2024-03-04T13:13:35.027327+0000","last_undegraded":"2024-03-04T13:13:35.027327+0000","last_fullsized":"2024-03-04T13:13:35.027327+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'155","last_scrub_stamp":"2024-03-04T13:13:35.027238+0000","last_deep_scrub":"255'155","last_deep_scrub_stamp":"2024-03-04T13:13:35.027238+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.027238+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:09.896709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":307,"num_read_kb":55812,"num_write":877,"num_write_kb":48688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"255'386","reported_seq":1789,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:52.751995+0000","last_change":"2024-03-04T13:13:52.752044+0000","last_active":"2024-03-04T13:13:52.751995+0000","last_peered":"2024-03-04T13:13:52.751995+0000","last_clean":"2024-03-04T13:13:52.751995+0000","last_became_active":"2024-03-04T12:20:16.831393+0000","last_became_peered":"2024-03-04T12:20:16.831393+0000","last_unstale":"2024-03-04T13:13:52.751995+0000","last_undegraded":"2024-03-04T13:13:52.751995+0000","last_fullsized":"2024-03-04T13:13:52.751995+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'386","last_scrub_stamp":"2024-03-04T13:13:52.751896+0000","last_deep_scrub":"255'386","last_deep_scrub_stamp":"2024-03-04T13:13:52.751896+0000","last_clean_scrub_stamp":"2024-03-04T13:13:52.751896+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:35.580653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2009,"num_read_kb":1888,"num_write":461,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"255'195","reported_seq":877,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:04.567131+0000","last_change":"2024-03-04T13:14:04.567203+0000","last_active":"2024-03-04T13:14:04.567131+0000","last_peered":"2024-03-04T13:14:04.567131+0000","last_clean":"2024-03-04T13:14:04.567131+0000","last_became_active":"2024-03-04T12:20:14.817894+0000","last_became_peered":"2024-03-04T12:20:14.817894+0000","last_unstale":"2024-03-04T13:14:04.567131+0000","last_undegraded":"2024-03-04T13:14:04.567131+0000","last_fullsized":"2024-03-04T13:14:04.567131+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'195","last_scrub_stamp":"2024-03-04T13:14:04.567024+0000","last_deep_scrub":"255'195","last_deep_scrub_stamp":"2024-03-04T13:14:04.567024+0000","last_clean_scrub_stamp":"2024-03-04T13:14:04.567024+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:28:02.979458+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":444,"num_read_kb":164272,"num_write":1071,"num_write_kb":63423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"255'518","reported_seq":1971,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:54.496453+0000","last_change":"2024-03-04T13:13:54.496483+0000","last_active":"2024-03-04T13:13:54.496453+0000","last_peered":"2024-03-04T13:13:54.496453+0000","last_clean":"2024-03-04T13:13:54.496453+0000","last_became_active":"2024-03-04T12:20:16.823974+0000","last_became_peered":"2024-03-04T12:20:16.823974+0000","last_unstale":"2024-03-04T13:13:54.496453+0000","last_undegraded":"2024-03-04T13:13:54.496453+0000","last_fullsized":"2024-03-04T13:13:54.496453+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'518","last_scrub_stamp":"2024-03-04T13:13:54.496362+0000","last_deep_scrub":"255'518","last_deep_scrub_stamp":"2024-03-04T13:13:54.496362+0000","last_clean_scrub_stamp":"2024-03-04T13:13:54.496362+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:44:47.540474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2611,"num_read_kb":2352,"num_write":706,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":185523,"num_write":154,"num_write_kb":127147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5335,"num_read_kb":3794,"num_write":2149,"num_write_kb":803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6970,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1184,"ondisk_log_size":1184,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":10065,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":12124,"num_read_kb":11961,"num_write":14025,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1726,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":20130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2330,"ondisk_log_size":2330,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":260729,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8455,"num_read_kb":10448,"num_write":5923,"num_write_kb":2713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":143352,"num_omap_keys":350,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1870,"ondisk_log_size":1870,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1637,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1554,"num_read_kb":1549,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":187558,"num_read_kb":170512,"num_write":50934,"num_write_kb":17677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":37395,"num_omap_keys":162,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3890,"ondisk_log_size":3890,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":189749578,"num_objects":263,"num_object_clones":0,"num_object_copies":526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":263,"num_whiteouts":0,"num_read":29476,"num_read_kb":2152910,"num_write":68734,"num_write_kb":2157934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":381083648,"data_stored":379499156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4194,"ondisk_log_size":4194,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":196827,"num_write":154,"num_write_kb":127147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575501,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":278600,"kb_used_data":71104,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94093240,"statfs":{"total":96636764160,"available":96351477760,"internally_reserved":0,"allocated":72810496,"data_stored":71072930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212466122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575502,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274104,"kb_used_data":40240,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94097736,"statfs":{"total":96636764160,"available":96356081664,"internally_reserved":0,"allocated":41205760,"data_stored":39656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575502,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149900,"kb_used_data":68804,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94221940,"statfs":{"total":96636764160,"available":96483266560,"internally_reserved":0,"allocated":70455296,"data_stored":68729090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575501,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108220,"kb_used_data":40948,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94263620,"statfs":{"total":96636764160,"available":96525946880,"internally_reserved":0,"allocated":41930752,"data_stored":40369557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575501,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284088,"kb_used_data":76592,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94087752,"statfs":{"total":96636764160,"available":96345858048,"internally_reserved":0,"allocated":78430208,"data_stored":76690401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":212466119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575502,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119296,"kb_used_data":47864,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94252544,"statfs":{"total":96636764160,"available":96514605056,"internally_reserved":0,"allocated":49012736,"data_stored":47453483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575503,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":175036,"kb_used_data":59252,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94196804,"statfs":{"total":96636764160,"available":96457527296,"internally_reserved":0,"allocated":60674048,"data_stored":59087481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575500,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273196,"kb_used_data":61540,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94098644,"statfs":{"total":96636764160,"available":96357011456,"internally_reserved":0,"allocated":63016960,"data_stored":61377358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":47357952,"data_stored":47171521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50876416,"data_stored":50716133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45522944,"data_stored":45373582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":64413696,"data_stored":64121957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32161792,"data_stored":31999474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":56401920,"data_stored":56160984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21966848,"data_stored":21846112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":62382080,"data_stored":62109393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T13:14:09.732 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.733 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.733 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.733 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.734 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.734 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.734 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.734 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.735 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.735 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.735 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.736 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.736 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.736 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.736 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.737 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.737 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.737 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.737 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.738 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-03-04T12:32:41.007127+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=41, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.738 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.738 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.738 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.739 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.739 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.739 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.739 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.740 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.740 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.740 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.740 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.741 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.741 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.741 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.741 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.742 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.742 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.742 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.742 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.742 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.743 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-03-04T12:46:21.235247+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=46, tm_sec=21, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.743 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-03-04T12:32:45.032463+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=32, tm_sec=45, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.743 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.743 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.744 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.744 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.744 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.745 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.745 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.745 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.746 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.746 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.747 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.747 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.747 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.747 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-04T12:20:17.810612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=17, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.748 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.748 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.749 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-04T12:20:04.766258+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=4, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.749 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.749 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.750 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.750 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.750 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.750 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.751 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.751 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.751 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.751 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-03-04T12:20:19.820805+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=19, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.752 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.752 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.752 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.752 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.753 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.753 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.753 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-04T12:20:15.801200+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=15, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.753 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.753 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-04T12:20:13.792254+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=12, tm_min=20, tm_sec=13, tm_wday=0, tm_yday=64, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=4, tm_hour=13, tm_min=13, tm_sec=23, tm_wday=0, tm_yday=64, tm_isdst=0) 2024-03-04T13:14:09.754 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-04T13:14:29.755 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-04T13:14:30.093 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-04T13:14:30.106 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-03-04T13:14:30.108 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":1883,"stamp":"2024-03-04T13:14:28.579650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":224166809,"num_objects":654,"num_object_clones":0,"num_object_copies":1308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":654,"num_whiteouts":0,"num_read":244903,"num_read_kb":2733632,"num_write":142264,"num_write_kb":2439961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":669214,"num_omap_keys":1661,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14266,"ondisk_log_size":14266,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1666600,"kb_used_data":466344,"kb_used_omap":12,"kb_used_meta":1200179,"kb_avail":753308120,"statfs":{"total":773094113280,"available":771387514880,"internally_reserved":0,"allocated":477536256,"data_stored":464436620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1228983858},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004567"},"pg_stats":[{"pgid":"67.1c","version":"0'0","reported_seq":36,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:15.216706+0000","last_change":"2024-03-04T13:14:15.216737+0000","last_active":"2024-03-04T13:14:15.216706+0000","last_peered":"2024-03-04T13:14:15.216706+0000","last_clean":"2024-03-04T13:14:15.216706+0000","last_became_active":"2024-03-04T12:46:22.248352+0000","last_became_peered":"2024-03-04T12:46:22.248352+0000","last_unstale":"2024-03-04T13:14:15.216706+0000","last_undegraded":"2024-03-04T13:14:15.216706+0000","last_fullsized":"2024-03-04T13:14:15.216706+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:15.216624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:15.216624+0000","last_clean_scrub_stamp":"2024-03-04T13:14:15.216624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:17:28.806312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.805565+0000","last_change":"2024-03-04T13:13:39.805588+0000","last_active":"2024-03-04T13:13:39.805565+0000","last_peered":"2024-03-04T13:13:39.805565+0000","last_clean":"2024-03-04T13:13:39.805565+0000","last_became_active":"2024-03-04T12:32:46.051177+0000","last_became_peered":"2024-03-04T12:32:46.051177+0000","last_unstale":"2024-03-04T13:13:39.805565+0000","last_undegraded":"2024-03-04T13:13:39.805565+0000","last_fullsized":"2024-03-04T13:13:39.805565+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:39.805434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:39.805434+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.805434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:35:27.485196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"255'2","reported_seq":60,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:55.217571+0000","last_change":"2024-03-04T13:13:55.217598+0000","last_active":"2024-03-04T13:13:55.217571+0000","last_peered":"2024-03-04T13:13:55.217571+0000","last_clean":"2024-03-04T13:13:55.217571+0000","last_became_active":"2024-03-04T12:32:42.034142+0000","last_became_peered":"2024-03-04T12:32:42.034142+0000","last_unstale":"2024-03-04T13:13:55.217571+0000","last_undegraded":"2024-03-04T13:13:55.217571+0000","last_fullsized":"2024-03-04T13:13:55.217571+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:55.217471+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:55.217471+0000","last_clean_scrub_stamp":"2024-03-04T13:13:55.217471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:44:17.364601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.1f","version":"255'17","reported_seq":99,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.898973+0000","last_change":"2024-03-04T13:13:29.899002+0000","last_active":"2024-03-04T13:13:29.898973+0000","last_peered":"2024-03-04T13:13:29.898973+0000","last_clean":"2024-03-04T13:13:29.898973+0000","last_became_active":"2024-03-04T12:29:01.702925+0000","last_became_peered":"2024-03-04T12:29:01.702925+0000","last_unstale":"2024-03-04T13:13:29.898973+0000","last_undegraded":"2024-03-04T13:13:29.898973+0000","last_fullsized":"2024-03-04T13:13:29.898973+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'17","last_scrub_stamp":"2024-03-04T13:13:29.898885+0000","last_deep_scrub":"255'17","last_deep_scrub_stamp":"2024-03-04T13:13:29.898885+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.898885+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:52:30.867951+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":40,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":36,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:14.455979+0000","last_change":"2024-03-04T13:14:14.456008+0000","last_active":"2024-03-04T13:14:14.455979+0000","last_peered":"2024-03-04T13:14:14.455979+0000","last_clean":"2024-03-04T13:14:14.455979+0000","last_became_active":"2024-03-04T12:46:22.258268+0000","last_became_peered":"2024-03-04T12:46:22.258268+0000","last_unstale":"2024-03-04T13:14:14.455979+0000","last_undegraded":"2024-03-04T13:14:14.455979+0000","last_fullsized":"2024-03-04T13:14:14.455979+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:14.455883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:14.455883+0000","last_clean_scrub_stamp":"2024-03-04T13:14:14.455883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:21:08.867897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"255'12","reported_seq":77,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:48.856999+0000","last_change":"2024-03-04T13:13:48.857030+0000","last_active":"2024-03-04T13:13:48.856999+0000","last_peered":"2024-03-04T13:13:48.856999+0000","last_clean":"2024-03-04T13:13:48.856999+0000","last_became_active":"2024-03-04T12:32:46.051799+0000","last_became_peered":"2024-03-04T12:32:46.051799+0000","last_unstale":"2024-03-04T13:13:48.856999+0000","last_undegraded":"2024-03-04T13:13:48.856999+0000","last_fullsized":"2024-03-04T13:13:48.856999+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'12","last_scrub_stamp":"2024-03-04T13:13:48.856912+0000","last_deep_scrub":"255'12","last_deep_scrub_stamp":"2024-03-04T13:13:48.856912+0000","last_clean_scrub_stamp":"2024-03-04T13:13:48.856912+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:13:22.869733+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":43010,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"255'9","reported_seq":74,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.835666+0000","last_change":"2024-03-04T13:13:38.835666+0000","last_active":"2024-03-04T13:13:38.835666+0000","last_peered":"2024-03-04T13:13:38.835666+0000","last_clean":"2024-03-04T13:13:38.835666+0000","last_became_active":"2024-03-04T12:32:42.037701+0000","last_became_peered":"2024-03-04T12:32:42.037701+0000","last_unstale":"2024-03-04T13:13:38.835666+0000","last_undegraded":"2024-03-04T13:13:38.835666+0000","last_fullsized":"2024-03-04T13:13:38.835666+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'9","last_scrub_stamp":"2024-03-04T13:13:38.835529+0000","last_deep_scrub":"255'9","last_deep_scrub_stamp":"2024-03-04T13:13:38.835529+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.835529+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:14:22.983606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19456,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1e","version":"255'28","reported_seq":128,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.924857+0000","last_change":"2024-03-04T13:13:31.924884+0000","last_active":"2024-03-04T13:13:31.924857+0000","last_peered":"2024-03-04T13:13:31.924857+0000","last_clean":"2024-03-04T13:13:31.924857+0000","last_became_active":"2024-03-04T12:29:01.701003+0000","last_became_peered":"2024-03-04T12:29:01.701003+0000","last_unstale":"2024-03-04T13:13:31.924857+0000","last_undegraded":"2024-03-04T13:13:31.924857+0000","last_fullsized":"2024-03-04T13:13:31.924857+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'28","last_scrub_stamp":"2024-03-04T13:13:31.924756+0000","last_deep_scrub":"255'28","last_deep_scrub_stamp":"2024-03-04T13:13:31.924756+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.924756+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:42:18.274244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":75,"num_write":51,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:23.794563+0000","last_change":"2024-03-04T13:14:23.794563+0000","last_active":"2024-03-04T13:14:23.794563+0000","last_peered":"2024-03-04T13:14:23.794563+0000","last_clean":"2024-03-04T13:14:23.794563+0000","last_became_active":"2024-03-04T12:46:22.307955+0000","last_became_peered":"2024-03-04T12:46:22.307955+0000","last_unstale":"2024-03-04T13:14:23.794563+0000","last_undegraded":"2024-03-04T13:14:23.794563+0000","last_fullsized":"2024-03-04T13:14:23.794563+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:23.794438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:23.794438+0000","last_clean_scrub_stamp":"2024-03-04T13:14:23.794438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:44.480283+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":51,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.311794+0000","last_change":"2024-03-04T13:13:45.311794+0000","last_active":"2024-03-04T13:13:45.311794+0000","last_peered":"2024-03-04T13:13:45.311794+0000","last_clean":"2024-03-04T13:13:45.311794+0000","last_became_active":"2024-03-04T12:32:46.053497+0000","last_became_peered":"2024-03-04T12:32:46.053497+0000","last_unstale":"2024-03-04T13:13:45.311794+0000","last_undegraded":"2024-03-04T13:13:45.311794+0000","last_fullsized":"2024-03-04T13:13:45.311794+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:45.311628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:45.311628+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.311628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:03.196481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"255'3","reported_seq":60,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.851594+0000","last_change":"2024-03-04T13:13:40.851637+0000","last_active":"2024-03-04T13:13:40.851594+0000","last_peered":"2024-03-04T13:13:40.851594+0000","last_clean":"2024-03-04T13:13:40.851594+0000","last_became_active":"2024-03-04T12:32:42.036801+0000","last_became_peered":"2024-03-04T12:32:42.036801+0000","last_unstale":"2024-03-04T13:13:40.851594+0000","last_undegraded":"2024-03-04T13:13:40.851594+0000","last_fullsized":"2024-03-04T13:13:40.851594+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'3","last_scrub_stamp":"2024-03-04T13:13:40.851505+0000","last_deep_scrub":"255'3","last_deep_scrub_stamp":"2024-03-04T13:13:40.851505+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.851505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:38.795174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1d","version":"255'24","reported_seq":118,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.473471+0000","last_change":"2024-03-04T13:13:30.473471+0000","last_active":"2024-03-04T13:13:30.473471+0000","last_peered":"2024-03-04T13:13:30.473471+0000","last_clean":"2024-03-04T13:13:30.473471+0000","last_became_active":"2024-03-04T12:29:01.707589+0000","last_became_peered":"2024-03-04T12:29:01.707589+0000","last_unstale":"2024-03-04T13:13:30.473471+0000","last_undegraded":"2024-03-04T13:13:30.473471+0000","last_fullsized":"2024-03-04T13:13:30.473471+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'24","last_scrub_stamp":"2024-03-04T13:13:30.473283+0000","last_deep_scrub":"255'24","last_deep_scrub_stamp":"2024-03-04T13:13:30.473283+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.473283+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:42:05.230338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":71,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:21.965054+0000","last_change":"2024-03-04T13:14:21.965077+0000","last_active":"2024-03-04T13:14:21.965054+0000","last_peered":"2024-03-04T13:14:21.965054+0000","last_clean":"2024-03-04T13:14:21.965054+0000","last_became_active":"2024-03-04T12:46:22.309869+0000","last_became_peered":"2024-03-04T12:46:22.309869+0000","last_unstale":"2024-03-04T13:14:21.965054+0000","last_undegraded":"2024-03-04T13:14:21.965054+0000","last_fullsized":"2024-03-04T13:14:21.965054+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:21.964964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:21.964964+0000","last_clean_scrub_stamp":"2024-03-04T13:14:21.964964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:42.006706+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"255'3","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:58.237086+0000","last_change":"2024-03-04T13:13:58.237114+0000","last_active":"2024-03-04T13:13:58.237086+0000","last_peered":"2024-03-04T13:13:58.237086+0000","last_clean":"2024-03-04T13:13:58.237086+0000","last_became_active":"2024-03-04T12:32:46.057603+0000","last_became_peered":"2024-03-04T12:32:46.057603+0000","last_unstale":"2024-03-04T13:13:58.237086+0000","last_undegraded":"2024-03-04T13:13:58.237086+0000","last_fullsized":"2024-03-04T13:13:58.237086+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'3","last_scrub_stamp":"2024-03-04T13:13:58.236990+0000","last_deep_scrub":"255'3","last_deep_scrub_stamp":"2024-03-04T13:13:58.236990+0000","last_clean_scrub_stamp":"2024-03-04T13:13:58.236990+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:46.230979+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"250'3","reported_seq":59,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:25.892793+0000","last_change":"2024-03-04T13:13:25.892816+0000","last_active":"2024-03-04T13:13:25.892793+0000","last_peered":"2024-03-04T13:13:25.892793+0000","last_clean":"2024-03-04T13:13:25.892793+0000","last_became_active":"2024-03-04T12:32:42.032231+0000","last_became_peered":"2024-03-04T12:32:42.032231+0000","last_unstale":"2024-03-04T13:13:25.892793+0000","last_undegraded":"2024-03-04T13:13:25.892793+0000","last_fullsized":"2024-03-04T13:13:25.892793+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'3","last_scrub_stamp":"2024-03-04T13:13:25.892721+0000","last_deep_scrub":"250'3","last_deep_scrub_stamp":"2024-03-04T13:13:25.892721+0000","last_clean_scrub_stamp":"2024-03-04T13:13:25.892721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:39:35.803550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.1c","version":"255'27","reported_seq":121,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.733570+0000","last_change":"2024-03-04T13:13:29.733570+0000","last_active":"2024-03-04T13:13:29.733570+0000","last_peered":"2024-03-04T13:13:29.733570+0000","last_clean":"2024-03-04T13:13:29.733570+0000","last_became_active":"2024-03-04T12:29:01.704548+0000","last_became_peered":"2024-03-04T12:29:01.704548+0000","last_unstale":"2024-03-04T13:13:29.733570+0000","last_undegraded":"2024-03-04T13:13:29.733570+0000","last_fullsized":"2024-03-04T13:13:29.733570+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'27","last_scrub_stamp":"2024-03-04T13:13:29.733457+0000","last_deep_scrub":"255'27","last_deep_scrub_stamp":"2024-03-04T13:13:29.733457+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.733457+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:59:20.666916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":73,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":36,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:06.917855+0000","last_change":"2024-03-04T13:14:06.917890+0000","last_active":"2024-03-04T13:14:06.917855+0000","last_peered":"2024-03-04T13:14:06.917855+0000","last_clean":"2024-03-04T13:14:06.917855+0000","last_became_active":"2024-03-04T12:46:22.257894+0000","last_became_peered":"2024-03-04T12:46:22.257894+0000","last_unstale":"2024-03-04T13:14:06.917855+0000","last_undegraded":"2024-03-04T13:14:06.917855+0000","last_fullsized":"2024-03-04T13:14:06.917855+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:06.917757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:06.917757+0000","last_clean_scrub_stamp":"2024-03-04T13:14:06.917757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:27:35.242284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:13.131357+0000","last_change":"2024-03-04T13:14:13.131384+0000","last_active":"2024-03-04T13:14:13.131357+0000","last_peered":"2024-03-04T13:14:13.131357+0000","last_clean":"2024-03-04T13:14:13.131357+0000","last_became_active":"2024-03-04T12:32:46.053946+0000","last_became_peered":"2024-03-04T12:32:46.053946+0000","last_unstale":"2024-03-04T13:14:13.131357+0000","last_undegraded":"2024-03-04T13:14:13.131357+0000","last_fullsized":"2024-03-04T13:14:13.131357+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:13.131153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:13.131153+0000","last_clean_scrub_stamp":"2024-03-04T13:14:13.131153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:59:41.170417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"255'12","reported_seq":78,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:01.849192+0000","last_change":"2024-03-04T13:14:01.849224+0000","last_active":"2024-03-04T13:14:01.849192+0000","last_peered":"2024-03-04T13:14:01.849192+0000","last_clean":"2024-03-04T13:14:01.849192+0000","last_became_active":"2024-03-04T12:32:42.037387+0000","last_became_peered":"2024-03-04T12:32:42.037387+0000","last_unstale":"2024-03-04T13:14:01.849192+0000","last_undegraded":"2024-03-04T13:14:01.849192+0000","last_fullsized":"2024-03-04T13:14:01.849192+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'12","last_scrub_stamp":"2024-03-04T13:14:01.849089+0000","last_deep_scrub":"255'12","last_deep_scrub_stamp":"2024-03-04T13:14:01.849089+0000","last_clean_scrub_stamp":"2024-03-04T13:14:01.849089+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:05:00.852885+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":25602,"num_write":15,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.1b","version":"255'50","reported_seq":172,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.770069+0000","last_change":"2024-03-04T13:13:30.770069+0000","last_active":"2024-03-04T13:13:30.770069+0000","last_peered":"2024-03-04T13:13:30.770069+0000","last_clean":"2024-03-04T13:13:30.770069+0000","last_became_active":"2024-03-04T12:29:01.703815+0000","last_became_peered":"2024-03-04T12:29:01.703815+0000","last_unstale":"2024-03-04T13:13:30.770069+0000","last_undegraded":"2024-03-04T13:13:30.770069+0000","last_fullsized":"2024-03-04T13:13:30.770069+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'50","last_scrub_stamp":"2024-03-04T13:13:30.769938+0000","last_deep_scrub":"255'50","last_deep_scrub_stamp":"2024-03-04T13:13:30.769938+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.769938+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:53:25.528615+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":130,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":36,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:16.393386+0000","last_change":"2024-03-04T13:14:16.393442+0000","last_active":"2024-03-04T13:14:16.393386+0000","last_peered":"2024-03-04T13:14:16.393386+0000","last_clean":"2024-03-04T13:14:16.393386+0000","last_became_active":"2024-03-04T12:46:22.260529+0000","last_became_peered":"2024-03-04T12:46:22.260529+0000","last_unstale":"2024-03-04T13:14:16.393386+0000","last_undegraded":"2024-03-04T13:14:16.393386+0000","last_fullsized":"2024-03-04T13:14:16.393386+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:16.393243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:16.393243+0000","last_clean_scrub_stamp":"2024-03-04T13:14:16.393243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:25:30.257239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"255'5","reported_seq":57,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.789202+0000","last_change":"2024-03-04T13:13:42.789202+0000","last_active":"2024-03-04T13:13:42.789202+0000","last_peered":"2024-03-04T13:13:42.789202+0000","last_clean":"2024-03-04T13:13:42.789202+0000","last_became_active":"2024-03-04T12:32:46.052388+0000","last_became_peered":"2024-03-04T12:32:46.052388+0000","last_unstale":"2024-03-04T13:13:42.789202+0000","last_undegraded":"2024-03-04T13:13:42.789202+0000","last_fullsized":"2024-03-04T13:13:42.789202+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'5","last_scrub_stamp":"2024-03-04T13:13:42.789090+0000","last_deep_scrub":"255'5","last_deep_scrub_stamp":"2024-03-04T13:13:42.789090+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.789090+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:23:38.166737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5160,"num_write":5,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"0'0","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.739807+0000","last_change":"2024-03-04T13:13:28.739826+0000","last_active":"2024-03-04T13:13:28.739807+0000","last_peered":"2024-03-04T13:13:28.739807+0000","last_clean":"2024-03-04T13:13:28.739807+0000","last_became_active":"2024-03-04T12:32:42.030804+0000","last_became_peered":"2024-03-04T12:32:42.030804+0000","last_unstale":"2024-03-04T13:13:28.739807+0000","last_undegraded":"2024-03-04T13:13:28.739807+0000","last_fullsized":"2024-03-04T13:13:28.739807+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:28.739734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:28.739734+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.739734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:08.931360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.1a","version":"255'35","reported_seq":138,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.518670+0000","last_change":"2024-03-04T13:13:33.518670+0000","last_active":"2024-03-04T13:13:33.518670+0000","last_peered":"2024-03-04T13:13:33.518670+0000","last_clean":"2024-03-04T13:13:33.518670+0000","last_became_active":"2024-03-04T12:29:01.703369+0000","last_became_peered":"2024-03-04T12:29:01.703369+0000","last_unstale":"2024-03-04T13:13:33.518670+0000","last_undegraded":"2024-03-04T13:13:33.518670+0000","last_fullsized":"2024-03-04T13:13:33.518670+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'35","last_scrub_stamp":"2024-03-04T13:13:33.518552+0000","last_deep_scrub":"255'35","last_deep_scrub_stamp":"2024-03-04T13:13:33.518552+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.518552+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:11:33.240744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":90,"num_write":62,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":36,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:19.907272+0000","last_change":"2024-03-04T13:14:19.907311+0000","last_active":"2024-03-04T13:14:19.907272+0000","last_peered":"2024-03-04T13:14:19.907272+0000","last_clean":"2024-03-04T13:14:19.907272+0000","last_became_active":"2024-03-04T12:46:22.255588+0000","last_became_peered":"2024-03-04T12:46:22.255588+0000","last_unstale":"2024-03-04T13:14:19.907272+0000","last_undegraded":"2024-03-04T13:14:19.907272+0000","last_fullsized":"2024-03-04T13:14:19.907272+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:19.907152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:19.907152+0000","last_clean_scrub_stamp":"2024-03-04T13:14:19.907152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:56:17.869838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"255'6","reported_seq":58,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:20.013786+0000","last_change":"2024-03-04T13:14:20.013813+0000","last_active":"2024-03-04T13:14:20.013786+0000","last_peered":"2024-03-04T13:14:20.013786+0000","last_clean":"2024-03-04T13:14:20.013786+0000","last_became_active":"2024-03-04T12:32:46.057413+0000","last_became_peered":"2024-03-04T12:32:46.057413+0000","last_unstale":"2024-03-04T13:14:20.013786+0000","last_undegraded":"2024-03-04T13:14:20.013786+0000","last_fullsized":"2024-03-04T13:14:20.013786+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'6","last_scrub_stamp":"2024-03-04T13:14:20.013697+0000","last_deep_scrub":"255'6","last_deep_scrub_stamp":"2024-03-04T13:14:20.013697+0000","last_clean_scrub_stamp":"2024-03-04T13:14:20.013697+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:34:12.362067+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"255'9","reported_seq":67,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.777160+0000","last_change":"2024-03-04T13:13:27.777160+0000","last_active":"2024-03-04T13:13:27.777160+0000","last_peered":"2024-03-04T13:13:27.777160+0000","last_clean":"2024-03-04T13:13:27.777160+0000","last_became_active":"2024-03-04T12:32:42.031099+0000","last_became_peered":"2024-03-04T12:32:42.031099+0000","last_unstale":"2024-03-04T13:13:27.777160+0000","last_undegraded":"2024-03-04T13:13:27.777160+0000","last_fullsized":"2024-03-04T13:13:27.777160+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'9","last_scrub_stamp":"2024-03-04T13:13:27.777060+0000","last_deep_scrub":"255'9","last_deep_scrub_stamp":"2024-03-04T13:13:27.777060+0000","last_clean_scrub_stamp":"2024-03-04T13:13:27.777060+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:59:51.492042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.19","version":"255'41","reported_seq":148,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.792075+0000","last_change":"2024-03-04T13:13:31.792100+0000","last_active":"2024-03-04T13:13:31.792075+0000","last_peered":"2024-03-04T13:13:31.792075+0000","last_clean":"2024-03-04T13:13:31.792075+0000","last_became_active":"2024-03-04T12:29:01.700917+0000","last_became_peered":"2024-03-04T12:29:01.700917+0000","last_unstale":"2024-03-04T13:13:31.792075+0000","last_undegraded":"2024-03-04T13:13:31.792075+0000","last_fullsized":"2024-03-04T13:13:31.792075+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'41","last_scrub_stamp":"2024-03-04T13:13:31.791978+0000","last_deep_scrub":"255'41","last_deep_scrub_stamp":"2024-03-04T13:13:31.791978+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.791978+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:10.471705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":100,"num_write":73,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":36,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:04.936827+0000","last_change":"2024-03-04T13:14:04.936866+0000","last_active":"2024-03-04T13:14:04.936827+0000","last_peered":"2024-03-04T13:14:04.936827+0000","last_clean":"2024-03-04T13:14:04.936827+0000","last_became_active":"2024-03-04T12:46:22.255812+0000","last_became_peered":"2024-03-04T12:46:22.255812+0000","last_unstale":"2024-03-04T13:14:04.936827+0000","last_undegraded":"2024-03-04T13:14:04.936827+0000","last_fullsized":"2024-03-04T13:14:04.936827+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:04.936707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:04.936707+0000","last_clean_scrub_stamp":"2024-03-04T13:14:04.936707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:42:02.353506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":47,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:12.114123+0000","last_change":"2024-03-04T13:14:12.114166+0000","last_active":"2024-03-04T13:14:12.114123+0000","last_peered":"2024-03-04T13:14:12.114123+0000","last_clean":"2024-03-04T13:14:12.114123+0000","last_became_active":"2024-03-04T12:32:46.053172+0000","last_became_peered":"2024-03-04T12:32:46.053172+0000","last_unstale":"2024-03-04T13:14:12.114123+0000","last_undegraded":"2024-03-04T13:14:12.114123+0000","last_fullsized":"2024-03-04T13:14:12.114123+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:12.114004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:12.114004+0000","last_clean_scrub_stamp":"2024-03-04T13:14:12.114004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:46:20.430211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"255'5","reported_seq":63,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.864986+0000","last_change":"2024-03-04T13:13:34.864986+0000","last_active":"2024-03-04T13:13:34.864986+0000","last_peered":"2024-03-04T13:13:34.864986+0000","last_clean":"2024-03-04T13:13:34.864986+0000","last_became_active":"2024-03-04T12:32:42.033315+0000","last_became_peered":"2024-03-04T12:32:42.033315+0000","last_unstale":"2024-03-04T13:13:34.864986+0000","last_undegraded":"2024-03-04T13:13:34.864986+0000","last_fullsized":"2024-03-04T13:13:34.864986+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'5","last_scrub_stamp":"2024-03-04T13:13:34.864868+0000","last_deep_scrub":"255'5","last_deep_scrub_stamp":"2024-03-04T13:13:34.864868+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.864868+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:03:00.925083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5136,"num_write":5,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.18","version":"255'18","reported_seq":105,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.284800+0000","last_change":"2024-03-04T13:13:39.284829+0000","last_active":"2024-03-04T13:13:39.284800+0000","last_peered":"2024-03-04T13:13:39.284800+0000","last_clean":"2024-03-04T13:13:39.284800+0000","last_became_active":"2024-03-04T12:29:01.706695+0000","last_became_peered":"2024-03-04T12:29:01.706695+0000","last_unstale":"2024-03-04T13:13:39.284800+0000","last_undegraded":"2024-03-04T13:13:39.284800+0000","last_fullsized":"2024-03-04T13:13:39.284800+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'18","last_scrub_stamp":"2024-03-04T13:13:39.284703+0000","last_deep_scrub":"255'18","last_deep_scrub_stamp":"2024-03-04T13:13:39.284703+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.284703+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:36:15.492735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":54,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.14","version":"255'2","reported_seq":35,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:24.027538+0000","last_change":"2024-03-04T13:14:24.027578+0000","last_active":"2024-03-04T13:14:24.027538+0000","last_peered":"2024-03-04T13:14:24.027538+0000","last_clean":"2024-03-04T13:14:24.027538+0000","last_became_active":"2024-03-04T12:46:51.977076+0000","last_became_peered":"2024-03-04T12:46:51.977076+0000","last_unstale":"2024-03-04T13:14:24.027538+0000","last_undegraded":"2024-03-04T13:14:24.027538+0000","last_fullsized":"2024-03-04T13:14:24.027538+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:14:24.027448+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:14:24.027448+0000","last_clean_scrub_stamp":"2024-03-04T13:14:24.027448+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:03:29.402731+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.563187+0000","last_change":"2024-03-04T13:13:47.563187+0000","last_active":"2024-03-04T13:13:47.563187+0000","last_peered":"2024-03-04T13:13:47.563187+0000","last_clean":"2024-03-04T13:13:47.563187+0000","last_became_active":"2024-03-04T12:32:46.055692+0000","last_became_peered":"2024-03-04T12:32:46.055692+0000","last_unstale":"2024-03-04T13:13:47.563187+0000","last_undegraded":"2024-03-04T13:13:47.563187+0000","last_fullsized":"2024-03-04T13:13:47.563187+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:47.563064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:47.563064+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.563064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:02:50.613812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.729125+0000","last_change":"2024-03-04T13:13:26.729125+0000","last_active":"2024-03-04T13:13:26.729125+0000","last_peered":"2024-03-04T13:13:26.729125+0000","last_clean":"2024-03-04T13:13:26.729125+0000","last_became_active":"2024-03-04T12:32:42.029940+0000","last_became_peered":"2024-03-04T12:32:42.029940+0000","last_unstale":"2024-03-04T13:13:26.729125+0000","last_undegraded":"2024-03-04T13:13:26.729125+0000","last_fullsized":"2024-03-04T13:13:26.729125+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:26.729003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:26.729003+0000","last_clean_scrub_stamp":"2024-03-04T13:13:26.729003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:20.396814+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.17","version":"255'31","reported_seq":127,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.750911+0000","last_change":"2024-03-04T13:13:35.750956+0000","last_active":"2024-03-04T13:13:35.750911+0000","last_peered":"2024-03-04T13:13:35.750911+0000","last_clean":"2024-03-04T13:13:35.750911+0000","last_became_active":"2024-03-04T12:29:01.701379+0000","last_became_peered":"2024-03-04T12:29:01.701379+0000","last_unstale":"2024-03-04T13:13:35.750911+0000","last_undegraded":"2024-03-04T13:13:35.750911+0000","last_fullsized":"2024-03-04T13:13:35.750911+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'31","last_scrub_stamp":"2024-03-04T13:13:35.750794+0000","last_deep_scrub":"255'31","last_deep_scrub_stamp":"2024-03-04T13:13:35.750794+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.750794+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:08:34.744668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":79,"num_write":53,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":36,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:24.763431+0000","last_change":"2024-03-04T13:14:24.763470+0000","last_active":"2024-03-04T13:14:24.763431+0000","last_peered":"2024-03-04T13:14:24.763431+0000","last_clean":"2024-03-04T13:14:24.763431+0000","last_became_active":"2024-03-04T12:46:22.308714+0000","last_became_peered":"2024-03-04T12:46:22.308714+0000","last_unstale":"2024-03-04T13:14:24.763431+0000","last_undegraded":"2024-03-04T13:14:24.763431+0000","last_fullsized":"2024-03-04T13:14:24.763431+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:24.763313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:24.763313+0000","last_clean_scrub_stamp":"2024-03-04T13:14:24.763313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:42:27.604601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"255'6","reported_seq":57,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:11.493483+0000","last_change":"2024-03-04T13:14:11.493532+0000","last_active":"2024-03-04T13:14:11.493483+0000","last_peered":"2024-03-04T13:14:11.493483+0000","last_clean":"2024-03-04T13:14:11.493483+0000","last_became_active":"2024-03-04T12:32:46.051926+0000","last_became_peered":"2024-03-04T12:32:46.051926+0000","last_unstale":"2024-03-04T13:14:11.493483+0000","last_undegraded":"2024-03-04T13:14:11.493483+0000","last_fullsized":"2024-03-04T13:14:11.493483+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'6","last_scrub_stamp":"2024-03-04T13:14:11.493367+0000","last_deep_scrub":"255'6","last_deep_scrub_stamp":"2024-03-04T13:14:11.493367+0000","last_clean_scrub_stamp":"2024-03-04T13:14:11.493367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:01.812017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.896414+0000","last_change":"2024-03-04T13:13:26.896414+0000","last_active":"2024-03-04T13:13:26.896414+0000","last_peered":"2024-03-04T13:13:26.896414+0000","last_clean":"2024-03-04T13:13:26.896414+0000","last_became_active":"2024-03-04T12:32:42.034301+0000","last_became_peered":"2024-03-04T12:32:42.034301+0000","last_unstale":"2024-03-04T13:13:26.896414+0000","last_undegraded":"2024-03-04T13:13:26.896414+0000","last_fullsized":"2024-03-04T13:13:26.896414+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:26.896317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:26.896317+0000","last_clean_scrub_stamp":"2024-03-04T13:13:26.896317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:03.628863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.16","version":"255'133","reported_seq":435,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.767287+0000","last_change":"2024-03-04T13:13:32.767316+0000","last_active":"2024-03-04T13:13:32.767287+0000","last_peered":"2024-03-04T13:13:32.767287+0000","last_clean":"2024-03-04T13:13:32.767287+0000","last_became_active":"2024-03-04T12:29:01.703239+0000","last_became_peered":"2024-03-04T12:29:01.703239+0000","last_unstale":"2024-03-04T13:13:32.767287+0000","last_undegraded":"2024-03-04T13:13:32.767287+0000","last_fullsized":"2024-03-04T13:13:32.767287+0000","mapping_epoch":242,"log_start":"255'100","ondisk_log_start":"255'100","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'133","last_scrub_stamp":"2024-03-04T13:13:32.767201+0000","last_deep_scrub":"255'133","last_deep_scrub_stamp":"2024-03-04T13:13:32.767201+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.767201+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:40:30.355080+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":704,"num_read_kb":496,"num_write":192,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1980,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":36,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:18.104255+0000","last_change":"2024-03-04T13:14:18.104277+0000","last_active":"2024-03-04T13:14:18.104255+0000","last_peered":"2024-03-04T13:14:18.104255+0000","last_clean":"2024-03-04T13:14:18.104255+0000","last_became_active":"2024-03-04T12:46:22.259424+0000","last_became_peered":"2024-03-04T12:46:22.259424+0000","last_unstale":"2024-03-04T13:14:18.104255+0000","last_undegraded":"2024-03-04T13:14:18.104255+0000","last_fullsized":"2024-03-04T13:14:18.104255+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:18.104153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:18.104153+0000","last_clean_scrub_stamp":"2024-03-04T13:14:18.104153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:44:50.266398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"255'6","reported_seq":64,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:18.008352+0000","last_change":"2024-03-04T13:14:18.008390+0000","last_active":"2024-03-04T13:14:18.008352+0000","last_peered":"2024-03-04T13:14:18.008352+0000","last_clean":"2024-03-04T13:14:18.008352+0000","last_became_active":"2024-03-04T12:32:46.056976+0000","last_became_peered":"2024-03-04T12:32:46.056976+0000","last_unstale":"2024-03-04T13:14:18.008352+0000","last_undegraded":"2024-03-04T13:14:18.008352+0000","last_fullsized":"2024-03-04T13:14:18.008352+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'6","last_scrub_stamp":"2024-03-04T13:14:18.008261+0000","last_deep_scrub":"255'6","last_deep_scrub_stamp":"2024-03-04T13:14:18.008261+0000","last_clean_scrub_stamp":"2024-03-04T13:14:18.008261+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:39:51.982412+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.491085+0000","last_change":"2024-03-04T13:13:35.491108+0000","last_active":"2024-03-04T13:13:35.491085+0000","last_peered":"2024-03-04T13:13:35.491085+0000","last_clean":"2024-03-04T13:13:35.491085+0000","last_became_active":"2024-03-04T12:32:42.036694+0000","last_became_peered":"2024-03-04T12:32:42.036694+0000","last_unstale":"2024-03-04T13:13:35.491085+0000","last_undegraded":"2024-03-04T13:13:35.491085+0000","last_fullsized":"2024-03-04T13:13:35.491085+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:35.490995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:35.490995+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.490995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:33:18.682539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.15","version":"255'13","reported_seq":86,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:53.204322+0000","last_change":"2024-03-04T13:13:53.204348+0000","last_active":"2024-03-04T13:13:53.204322+0000","last_peered":"2024-03-04T13:13:53.204322+0000","last_clean":"2024-03-04T13:13:53.204322+0000","last_became_active":"2024-03-04T12:29:01.706467+0000","last_became_peered":"2024-03-04T12:29:01.706467+0000","last_unstale":"2024-03-04T13:13:53.204322+0000","last_undegraded":"2024-03-04T13:13:53.204322+0000","last_fullsized":"2024-03-04T13:13:53.204322+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'13","last_scrub_stamp":"2024-03-04T13:13:53.204227+0000","last_deep_scrub":"255'13","last_deep_scrub_stamp":"2024-03-04T13:13:53.204227+0000","last_clean_scrub_stamp":"2024-03-04T13:13:53.204227+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:37:40.622295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":36,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:25.807438+0000","last_change":"2024-03-04T13:14:25.807461+0000","last_active":"2024-03-04T13:14:25.807438+0000","last_peered":"2024-03-04T13:14:25.807438+0000","last_clean":"2024-03-04T13:14:25.807438+0000","last_became_active":"2024-03-04T12:46:22.310952+0000","last_became_peered":"2024-03-04T12:46:22.310952+0000","last_unstale":"2024-03-04T13:14:25.807438+0000","last_undegraded":"2024-03-04T13:14:25.807438+0000","last_fullsized":"2024-03-04T13:14:25.807438+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:25.807342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:25.807342+0000","last_clean_scrub_stamp":"2024-03-04T13:14:25.807342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:45:37.522929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"250'3","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:57.266789+0000","last_change":"2024-03-04T13:13:57.266831+0000","last_active":"2024-03-04T13:13:57.266789+0000","last_peered":"2024-03-04T13:13:57.266789+0000","last_clean":"2024-03-04T13:13:57.266789+0000","last_became_active":"2024-03-04T12:32:46.054752+0000","last_became_peered":"2024-03-04T12:32:46.054752+0000","last_unstale":"2024-03-04T13:13:57.266789+0000","last_undegraded":"2024-03-04T13:13:57.266789+0000","last_fullsized":"2024-03-04T13:13:57.266789+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'3","last_scrub_stamp":"2024-03-04T13:13:57.266670+0000","last_deep_scrub":"250'3","last_deep_scrub_stamp":"2024-03-04T13:13:57.266670+0000","last_clean_scrub_stamp":"2024-03-04T13:13:57.266670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:05:38.259571+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"255'2","reported_seq":58,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:54.216915+0000","last_change":"2024-03-04T13:13:54.216958+0000","last_active":"2024-03-04T13:13:54.216915+0000","last_peered":"2024-03-04T13:13:54.216915+0000","last_clean":"2024-03-04T13:13:54.216915+0000","last_became_active":"2024-03-04T12:32:42.033898+0000","last_became_peered":"2024-03-04T12:32:42.033898+0000","last_unstale":"2024-03-04T13:13:54.216915+0000","last_undegraded":"2024-03-04T13:13:54.216915+0000","last_fullsized":"2024-03-04T13:13:54.216915+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:54.216795+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:54.216795+0000","last_clean_scrub_stamp":"2024-03-04T13:13:54.216795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:36.222661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.14","version":"255'43","reported_seq":157,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.763641+0000","last_change":"2024-03-04T13:13:28.763662+0000","last_active":"2024-03-04T13:13:28.763641+0000","last_peered":"2024-03-04T13:13:28.763641+0000","last_clean":"2024-03-04T13:13:28.763641+0000","last_became_active":"2024-03-04T12:29:01.705183+0000","last_became_peered":"2024-03-04T12:29:01.705183+0000","last_unstale":"2024-03-04T13:13:28.763641+0000","last_undegraded":"2024-03-04T13:13:28.763641+0000","last_fullsized":"2024-03-04T13:13:28.763641+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'43","last_scrub_stamp":"2024-03-04T13:13:28.763573+0000","last_deep_scrub":"255'43","last_deep_scrub_stamp":"2024-03-04T13:13:28.763573+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.763573+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:05:44.132843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":113,"num_write":72,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":37,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:08.654046+0000","last_change":"2024-03-04T13:14:08.654046+0000","last_active":"2024-03-04T13:14:08.654046+0000","last_peered":"2024-03-04T13:14:08.654046+0000","last_clean":"2024-03-04T13:14:08.654046+0000","last_became_active":"2024-03-04T12:46:22.245967+0000","last_became_peered":"2024-03-04T12:46:22.245967+0000","last_unstale":"2024-03-04T13:14:08.654046+0000","last_undegraded":"2024-03-04T13:14:08.654046+0000","last_fullsized":"2024-03-04T13:14:08.654046+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:08.653936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:08.653936+0000","last_clean_scrub_stamp":"2024-03-04T13:14:08.653936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:31:43.785315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.837625+0000","last_change":"2024-03-04T13:13:44.837667+0000","last_active":"2024-03-04T13:13:44.837625+0000","last_peered":"2024-03-04T13:13:44.837625+0000","last_clean":"2024-03-04T13:13:44.837625+0000","last_became_active":"2024-03-04T12:32:46.051360+0000","last_became_peered":"2024-03-04T12:32:46.051360+0000","last_unstale":"2024-03-04T13:13:44.837625+0000","last_undegraded":"2024-03-04T13:13:44.837625+0000","last_fullsized":"2024-03-04T13:13:44.837625+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:44.837523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:44.837523+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.837523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:16:12.218508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.885950+0000","last_change":"2024-03-04T13:13:28.885984+0000","last_active":"2024-03-04T13:13:28.885950+0000","last_peered":"2024-03-04T13:13:28.885950+0000","last_clean":"2024-03-04T13:13:28.885950+0000","last_became_active":"2024-03-04T12:32:42.029559+0000","last_became_peered":"2024-03-04T12:32:42.029559+0000","last_unstale":"2024-03-04T13:13:28.885950+0000","last_undegraded":"2024-03-04T13:13:28.885950+0000","last_fullsized":"2024-03-04T13:13:28.885950+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:28.885848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:28.885848+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.885848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:11.309661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.13","version":"250'28","reported_seq":125,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.108278+0000","last_change":"2024-03-04T13:13:27.108303+0000","last_active":"2024-03-04T13:13:27.108278+0000","last_peered":"2024-03-04T13:13:27.108278+0000","last_clean":"2024-03-04T13:13:27.108278+0000","last_became_active":"2024-03-04T12:29:01.705726+0000","last_became_peered":"2024-03-04T12:29:01.705726+0000","last_unstale":"2024-03-04T13:13:27.108278+0000","last_undegraded":"2024-03-04T13:13:27.108278+0000","last_fullsized":"2024-03-04T13:13:27.108278+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'28","last_scrub_stamp":"2024-03-04T13:13:27.108190+0000","last_deep_scrub":"250'28","last_deep_scrub_stamp":"2024-03-04T13:13:27.108190+0000","last_clean_scrub_stamp":"2024-03-04T13:13:27.108190+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:54:20.406412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":76,"num_write":49,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":37,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:11.675262+0000","last_change":"2024-03-04T13:14:11.675262+0000","last_active":"2024-03-04T13:14:11.675262+0000","last_peered":"2024-03-04T13:14:11.675262+0000","last_clean":"2024-03-04T13:14:11.675262+0000","last_became_active":"2024-03-04T12:46:22.259134+0000","last_became_peered":"2024-03-04T12:46:22.259134+0000","last_unstale":"2024-03-04T13:14:11.675262+0000","last_undegraded":"2024-03-04T13:14:11.675262+0000","last_fullsized":"2024-03-04T13:14:11.675262+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:11.675150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:11.675150+0000","last_clean_scrub_stamp":"2024-03-04T13:14:11.675150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:45:57.459123+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.245109+0000","last_change":"2024-03-04T13:13:41.245131+0000","last_active":"2024-03-04T13:13:41.245109+0000","last_peered":"2024-03-04T13:13:41.245109+0000","last_clean":"2024-03-04T13:13:41.245109+0000","last_became_active":"2024-03-04T12:32:46.053156+0000","last_became_peered":"2024-03-04T12:32:46.053156+0000","last_unstale":"2024-03-04T13:13:41.245109+0000","last_undegraded":"2024-03-04T13:13:41.245109+0000","last_fullsized":"2024-03-04T13:13:41.245109+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:41.245016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:41.245016+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.245016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:45.065185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"255'11","reported_seq":79,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.531852+0000","last_change":"2024-03-04T13:13:31.531887+0000","last_active":"2024-03-04T13:13:31.531852+0000","last_peered":"2024-03-04T13:13:31.531852+0000","last_clean":"2024-03-04T13:13:31.531852+0000","last_became_active":"2024-03-04T12:32:42.036617+0000","last_became_peered":"2024-03-04T12:32:42.036617+0000","last_unstale":"2024-03-04T13:13:31.531852+0000","last_undegraded":"2024-03-04T13:13:31.531852+0000","last_fullsized":"2024-03-04T13:13:31.531852+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'11","last_scrub_stamp":"2024-03-04T13:13:31.531774+0000","last_deep_scrub":"255'11","last_deep_scrub_stamp":"2024-03-04T13:13:31.531774+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.531774+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:53:09.775484+0000","scrub_duration":64,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":29698,"num_write":14,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.12","version":"255'17","reported_seq":103,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.199388+0000","last_change":"2024-03-04T13:13:31.199414+0000","last_active":"2024-03-04T13:13:31.199388+0000","last_peered":"2024-03-04T13:13:31.199388+0000","last_clean":"2024-03-04T13:13:31.199388+0000","last_became_active":"2024-03-04T12:29:01.701712+0000","last_became_peered":"2024-03-04T12:29:01.701712+0000","last_unstale":"2024-03-04T13:13:31.199388+0000","last_undegraded":"2024-03-04T13:13:31.199388+0000","last_fullsized":"2024-03-04T13:13:31.199388+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'17","last_scrub_stamp":"2024-03-04T13:13:31.199260+0000","last_deep_scrub":"255'17","last_deep_scrub_stamp":"2024-03-04T13:13:31.199260+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.199260+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:34:49.814019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":51,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":37,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:05.902986+0000","last_change":"2024-03-04T13:14:05.902986+0000","last_active":"2024-03-04T13:14:05.902986+0000","last_peered":"2024-03-04T13:14:05.902986+0000","last_clean":"2024-03-04T13:14:05.902986+0000","last_became_active":"2024-03-04T12:46:22.256617+0000","last_became_peered":"2024-03-04T12:46:22.256617+0000","last_unstale":"2024-03-04T13:14:05.902986+0000","last_undegraded":"2024-03-04T13:14:05.902986+0000","last_fullsized":"2024-03-04T13:14:05.902986+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:05.902873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:05.902873+0000","last_clean_scrub_stamp":"2024-03-04T13:14:05.902873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:47:41.637069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":48,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:12.479867+0000","last_change":"2024-03-04T13:14:12.479891+0000","last_active":"2024-03-04T13:14:12.479867+0000","last_peered":"2024-03-04T13:14:12.479867+0000","last_clean":"2024-03-04T13:14:12.479867+0000","last_became_active":"2024-03-04T12:32:46.053272+0000","last_became_peered":"2024-03-04T12:32:46.053272+0000","last_unstale":"2024-03-04T13:14:12.479867+0000","last_undegraded":"2024-03-04T13:14:12.479867+0000","last_fullsized":"2024-03-04T13:14:12.479867+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:12.479772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:12.479772+0000","last_clean_scrub_stamp":"2024-03-04T13:14:12.479772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:58:36.437263+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.811500+0000","last_change":"2024-03-04T13:13:36.811535+0000","last_active":"2024-03-04T13:13:36.811500+0000","last_peered":"2024-03-04T13:13:36.811500+0000","last_clean":"2024-03-04T13:13:36.811500+0000","last_became_active":"2024-03-04T12:32:42.035923+0000","last_became_peered":"2024-03-04T12:32:42.035923+0000","last_unstale":"2024-03-04T13:13:36.811500+0000","last_undegraded":"2024-03-04T13:13:36.811500+0000","last_fullsized":"2024-03-04T13:13:36.811500+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:36.811383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:36.811383+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.811383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:47:30.024857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.11","version":"255'34","reported_seq":140,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.066169+0000","last_change":"2024-03-04T13:13:28.066241+0000","last_active":"2024-03-04T13:13:28.066169+0000","last_peered":"2024-03-04T13:13:28.066169+0000","last_clean":"2024-03-04T13:13:28.066169+0000","last_became_active":"2024-03-04T12:29:01.702327+0000","last_became_peered":"2024-03-04T12:29:01.702327+0000","last_unstale":"2024-03-04T13:13:28.066169+0000","last_undegraded":"2024-03-04T13:13:28.066169+0000","last_fullsized":"2024-03-04T13:13:28.066169+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'34","last_scrub_stamp":"2024-03-04T13:13:28.066051+0000","last_deep_scrub":"255'34","last_deep_scrub_stamp":"2024-03-04T13:13:28.066051+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.066051+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:49:40.472474+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":99,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"255'2","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:21.859475+0000","last_change":"2024-03-04T13:14:21.859475+0000","last_active":"2024-03-04T13:14:21.859475+0000","last_peered":"2024-03-04T13:14:21.859475+0000","last_clean":"2024-03-04T13:14:21.859475+0000","last_became_active":"2024-03-04T12:46:22.257651+0000","last_became_peered":"2024-03-04T12:46:22.257651+0000","last_unstale":"2024-03-04T13:14:21.859475+0000","last_undegraded":"2024-03-04T13:14:21.859475+0000","last_fullsized":"2024-03-04T13:14:21.859475+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:14:21.859329+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:14:21.859329+0000","last_clean_scrub_stamp":"2024-03-04T13:14:21.859329+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:11:20.334177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"255'8","reported_seq":68,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:02.886255+0000","last_change":"2024-03-04T13:14:02.886299+0000","last_active":"2024-03-04T13:14:02.886255+0000","last_peered":"2024-03-04T13:14:02.886255+0000","last_clean":"2024-03-04T13:14:02.886255+0000","last_became_active":"2024-03-04T12:32:46.049512+0000","last_became_peered":"2024-03-04T12:32:46.049512+0000","last_unstale":"2024-03-04T13:14:02.886255+0000","last_undegraded":"2024-03-04T13:14:02.886255+0000","last_fullsized":"2024-03-04T13:14:02.886255+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'8","last_scrub_stamp":"2024-03-04T13:14:02.886163+0000","last_deep_scrub":"255'8","last_deep_scrub_stamp":"2024-03-04T13:14:02.886163+0000","last_clean_scrub_stamp":"2024-03-04T13:14:02.886163+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:49:05.625242+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":11,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"0'0","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.176706+0000","last_change":"2024-03-04T13:13:33.176739+0000","last_active":"2024-03-04T13:13:33.176706+0000","last_peered":"2024-03-04T13:13:33.176706+0000","last_clean":"2024-03-04T13:13:33.176706+0000","last_became_active":"2024-03-04T12:32:42.032034+0000","last_became_peered":"2024-03-04T12:32:42.032034+0000","last_unstale":"2024-03-04T13:13:33.176706+0000","last_undegraded":"2024-03-04T13:13:33.176706+0000","last_fullsized":"2024-03-04T13:13:33.176706+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:33.176621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:33.176621+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.176621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:55:03.666432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.10","version":"255'51","reported_seq":179,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.787605+0000","last_change":"2024-03-04T13:13:29.787646+0000","last_active":"2024-03-04T13:13:29.787605+0000","last_peered":"2024-03-04T13:13:29.787605+0000","last_clean":"2024-03-04T13:13:29.787605+0000","last_became_active":"2024-03-04T12:29:01.703361+0000","last_became_peered":"2024-03-04T12:29:01.703361+0000","last_unstale":"2024-03-04T13:13:29.787605+0000","last_undegraded":"2024-03-04T13:13:29.787605+0000","last_fullsized":"2024-03-04T13:13:29.787605+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'51","last_scrub_stamp":"2024-03-04T13:13:29.787500+0000","last_deep_scrub":"255'51","last_deep_scrub_stamp":"2024-03-04T13:13:29.787500+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.787500+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:39:42.421288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":146,"num_write":83,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.c","version":"255'2","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:52.887557+0000","last_change":"2024-03-04T13:13:52.887584+0000","last_active":"2024-03-04T13:13:52.887557+0000","last_peered":"2024-03-04T13:13:52.887557+0000","last_clean":"2024-03-04T13:13:52.887557+0000","last_became_active":"2024-03-04T12:46:22.255498+0000","last_became_peered":"2024-03-04T12:46:22.255498+0000","last_unstale":"2024-03-04T13:13:52.887557+0000","last_undegraded":"2024-03-04T13:13:52.887557+0000","last_fullsized":"2024-03-04T13:13:52.887557+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:52.887467+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:52.887467+0000","last_clean_scrub_stamp":"2024-03-04T13:13:52.887467+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:26.340731+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"255'2","reported_seq":52,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:00.267407+0000","last_change":"2024-03-04T13:14:00.267451+0000","last_active":"2024-03-04T13:14:00.267407+0000","last_peered":"2024-03-04T13:14:00.267407+0000","last_clean":"2024-03-04T13:14:00.267407+0000","last_became_active":"2024-03-04T12:32:46.058792+0000","last_became_peered":"2024-03-04T12:32:46.058792+0000","last_unstale":"2024-03-04T13:14:00.267407+0000","last_undegraded":"2024-03-04T13:14:00.267407+0000","last_fullsized":"2024-03-04T13:14:00.267407+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:14:00.267292+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:14:00.267292+0000","last_clean_scrub_stamp":"2024-03-04T13:14:00.267292+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:42:02.031538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":55,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:10.508629+0000","last_change":"2024-03-04T13:14:10.508671+0000","last_active":"2024-03-04T13:14:10.508629+0000","last_peered":"2024-03-04T13:14:10.508629+0000","last_clean":"2024-03-04T13:14:10.508629+0000","last_became_active":"2024-03-04T12:32:42.036427+0000","last_became_peered":"2024-03-04T12:32:42.036427+0000","last_unstale":"2024-03-04T13:14:10.508629+0000","last_undegraded":"2024-03-04T13:14:10.508629+0000","last_fullsized":"2024-03-04T13:14:10.508629+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:10.508528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:10.508528+0000","last_clean_scrub_stamp":"2024-03-04T13:14:10.508528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:11:04.579749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.f","version":"255'56","reported_seq":187,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.313241+0000","last_change":"2024-03-04T13:13:35.313241+0000","last_active":"2024-03-04T13:13:35.313241+0000","last_peered":"2024-03-04T13:13:35.313241+0000","last_clean":"2024-03-04T13:13:35.313241+0000","last_became_active":"2024-03-04T12:29:01.706666+0000","last_became_peered":"2024-03-04T12:29:01.706666+0000","last_unstale":"2024-03-04T13:13:35.313241+0000","last_undegraded":"2024-03-04T13:13:35.313241+0000","last_fullsized":"2024-03-04T13:13:35.313241+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'56","last_scrub_stamp":"2024-03-04T13:13:35.313119+0000","last_deep_scrub":"255'56","last_deep_scrub_stamp":"2024-03-04T13:13:35.313119+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.313119+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:59:15.053239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":151,"num_write":99,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":37,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:20.865520+0000","last_change":"2024-03-04T13:14:20.865572+0000","last_active":"2024-03-04T13:14:20.865520+0000","last_peered":"2024-03-04T13:14:20.865520+0000","last_clean":"2024-03-04T13:14:20.865520+0000","last_became_active":"2024-03-04T12:46:22.256882+0000","last_became_peered":"2024-03-04T12:46:22.256882+0000","last_unstale":"2024-03-04T13:14:20.865520+0000","last_undegraded":"2024-03-04T13:14:20.865520+0000","last_fullsized":"2024-03-04T13:14:20.865520+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:20.865387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:20.865387+0000","last_clean_scrub_stamp":"2024-03-04T13:14:20.865387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:02:26.688098+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:15.628633+0000","last_change":"2024-03-04T13:14:15.628660+0000","last_active":"2024-03-04T13:14:15.628633+0000","last_peered":"2024-03-04T13:14:15.628633+0000","last_clean":"2024-03-04T13:14:15.628633+0000","last_became_active":"2024-03-04T12:32:46.057079+0000","last_became_peered":"2024-03-04T12:32:46.057079+0000","last_unstale":"2024-03-04T13:14:15.628633+0000","last_undegraded":"2024-03-04T13:14:15.628633+0000","last_fullsized":"2024-03-04T13:14:15.628633+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:15.628544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:15.628544+0000","last_clean_scrub_stamp":"2024-03-04T13:14:15.628544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:29:57.300393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"255'9","reported_seq":76,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.775902+0000","last_change":"2024-03-04T13:13:32.775942+0000","last_active":"2024-03-04T13:13:32.775902+0000","last_peered":"2024-03-04T13:13:32.775902+0000","last_clean":"2024-03-04T13:13:32.775902+0000","last_became_active":"2024-03-04T12:32:42.035488+0000","last_became_peered":"2024-03-04T12:32:42.035488+0000","last_unstale":"2024-03-04T13:13:32.775902+0000","last_undegraded":"2024-03-04T13:13:32.775902+0000","last_fullsized":"2024-03-04T13:13:32.775902+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'9","last_scrub_stamp":"2024-03-04T13:13:32.775792+0000","last_deep_scrub":"255'9","last_deep_scrub_stamp":"2024-03-04T13:13:32.775792+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.775792+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:35.718837+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.e","version":"255'14","reported_seq":89,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.816478+0000","last_change":"2024-03-04T13:13:31.816478+0000","last_active":"2024-03-04T13:13:31.816478+0000","last_peered":"2024-03-04T13:13:31.816478+0000","last_clean":"2024-03-04T13:13:31.816478+0000","last_became_active":"2024-03-04T12:29:01.706786+0000","last_became_peered":"2024-03-04T12:29:01.706786+0000","last_unstale":"2024-03-04T13:13:31.816478+0000","last_undegraded":"2024-03-04T13:13:31.816478+0000","last_fullsized":"2024-03-04T13:13:31.816478+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'14","last_scrub_stamp":"2024-03-04T13:13:31.816328+0000","last_deep_scrub":"255'14","last_deep_scrub_stamp":"2024-03-04T13:13:31.816328+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.816328+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:21.050894+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":27,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":37,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:22.832842+0000","last_change":"2024-03-04T13:14:22.832868+0000","last_active":"2024-03-04T13:14:22.832842+0000","last_peered":"2024-03-04T13:14:22.832842+0000","last_clean":"2024-03-04T13:14:22.832842+0000","last_became_active":"2024-03-04T12:46:22.259400+0000","last_became_peered":"2024-03-04T12:46:22.259400+0000","last_unstale":"2024-03-04T13:14:22.832842+0000","last_undegraded":"2024-03-04T13:14:22.832842+0000","last_fullsized":"2024-03-04T13:14:22.832842+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:22.832737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:22.832737+0000","last_clean_scrub_stamp":"2024-03-04T13:14:22.832737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:12:08.553260+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":49,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.770248+0000","last_change":"2024-03-04T13:13:35.770271+0000","last_active":"2024-03-04T13:13:35.770248+0000","last_peered":"2024-03-04T13:13:35.770248+0000","last_clean":"2024-03-04T13:13:35.770248+0000","last_became_active":"2024-03-04T12:32:46.051318+0000","last_became_peered":"2024-03-04T12:32:46.051318+0000","last_unstale":"2024-03-04T13:13:35.770248+0000","last_undegraded":"2024-03-04T13:13:35.770248+0000","last_fullsized":"2024-03-04T13:13:35.770248+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:35.770135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:35.770135+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.770135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:17:37.665435+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"255'10","reported_seq":72,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:56.216958+0000","last_change":"2024-03-04T13:13:56.216984+0000","last_active":"2024-03-04T13:13:56.216958+0000","last_peered":"2024-03-04T13:13:56.216958+0000","last_clean":"2024-03-04T13:13:56.216958+0000","last_became_active":"2024-03-04T12:32:42.035743+0000","last_became_peered":"2024-03-04T12:32:42.035743+0000","last_unstale":"2024-03-04T13:13:56.216958+0000","last_undegraded":"2024-03-04T13:13:56.216958+0000","last_fullsized":"2024-03-04T13:13:56.216958+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'10","last_scrub_stamp":"2024-03-04T13:13:56.216859+0000","last_deep_scrub":"255'10","last_deep_scrub_stamp":"2024-03-04T13:13:56.216859+0000","last_clean_scrub_stamp":"2024-03-04T13:13:56.216859+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:42:29.665183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":9243,"num_write":20,"num_write_kb":10267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"64.d","version":"255'55","reported_seq":197,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.080264+0000","last_change":"2024-03-04T13:13:30.080264+0000","last_active":"2024-03-04T13:13:30.080264+0000","last_peered":"2024-03-04T13:13:30.080264+0000","last_clean":"2024-03-04T13:13:30.080264+0000","last_became_active":"2024-03-04T12:29:01.700933+0000","last_became_peered":"2024-03-04T12:29:01.700933+0000","last_unstale":"2024-03-04T13:13:30.080264+0000","last_undegraded":"2024-03-04T13:13:30.080264+0000","last_fullsized":"2024-03-04T13:13:30.080264+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'55","last_scrub_stamp":"2024-03-04T13:13:30.080152+0000","last_deep_scrub":"255'55","last_deep_scrub_stamp":"2024-03-04T13:13:30.080152+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.080152+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:10:28.190583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":175,"num_write":86,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":37,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:12.669318+0000","last_change":"2024-03-04T13:14:12.669340+0000","last_active":"2024-03-04T13:14:12.669318+0000","last_peered":"2024-03-04T13:14:12.669318+0000","last_clean":"2024-03-04T13:14:12.669318+0000","last_became_active":"2024-03-04T12:46:22.310043+0000","last_became_peered":"2024-03-04T12:46:22.310043+0000","last_unstale":"2024-03-04T13:14:12.669318+0000","last_undegraded":"2024-03-04T13:14:12.669318+0000","last_fullsized":"2024-03-04T13:14:12.669318+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:12.669225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:12.669225+0000","last_clean_scrub_stamp":"2024-03-04T13:14:12.669225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:44:42.898858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"250'3","reported_seq":55,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:50.743561+0000","last_change":"2024-03-04T13:13:50.743585+0000","last_active":"2024-03-04T13:13:50.743561+0000","last_peered":"2024-03-04T13:13:50.743561+0000","last_clean":"2024-03-04T13:13:50.743561+0000","last_became_active":"2024-03-04T12:32:46.056687+0000","last_became_peered":"2024-03-04T12:32:46.056687+0000","last_unstale":"2024-03-04T13:13:50.743561+0000","last_undegraded":"2024-03-04T13:13:50.743561+0000","last_fullsized":"2024-03-04T13:13:50.743561+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'3","last_scrub_stamp":"2024-03-04T13:13:50.743472+0000","last_deep_scrub":"250'3","last_deep_scrub_stamp":"2024-03-04T13:13:50.743472+0000","last_clean_scrub_stamp":"2024-03-04T13:13:50.743472+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:56:59.306946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"0'0","reported_seq":55,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.767425+0000","last_change":"2024-03-04T13:13:34.767455+0000","last_active":"2024-03-04T13:13:34.767425+0000","last_peered":"2024-03-04T13:13:34.767425+0000","last_clean":"2024-03-04T13:13:34.767425+0000","last_became_active":"2024-03-04T12:32:42.036690+0000","last_became_peered":"2024-03-04T12:32:42.036690+0000","last_unstale":"2024-03-04T13:13:34.767425+0000","last_undegraded":"2024-03-04T13:13:34.767425+0000","last_fullsized":"2024-03-04T13:13:34.767425+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:34.767317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:34.767317+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.767317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:34:06.921023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.c","version":"0'0","reported_seq":63,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.253014+0000","last_change":"2024-03-04T13:13:29.253014+0000","last_active":"2024-03-04T13:13:29.253014+0000","last_peered":"2024-03-04T13:13:29.253014+0000","last_clean":"2024-03-04T13:13:29.253014+0000","last_became_active":"2024-03-04T12:29:01.700739+0000","last_became_peered":"2024-03-04T12:29:01.700739+0000","last_unstale":"2024-03-04T13:13:29.253014+0000","last_undegraded":"2024-03-04T13:13:29.253014+0000","last_fullsized":"2024-03-04T13:13:29.253014+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:29.252878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:29.252878+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.252878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:30:12.777518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":37,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:19.637908+0000","last_change":"2024-03-04T13:14:19.637931+0000","last_active":"2024-03-04T13:14:19.637908+0000","last_peered":"2024-03-04T13:14:19.637908+0000","last_clean":"2024-03-04T13:14:19.637908+0000","last_became_active":"2024-03-04T12:46:22.308300+0000","last_became_peered":"2024-03-04T12:46:22.308300+0000","last_unstale":"2024-03-04T13:14:19.637908+0000","last_undegraded":"2024-03-04T13:14:19.637908+0000","last_fullsized":"2024-03-04T13:14:19.637908+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:19.637815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:19.637815+0000","last_clean_scrub_stamp":"2024-03-04T13:14:19.637815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:51.468183+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":50,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:06.621245+0000","last_change":"2024-03-04T13:14:06.621286+0000","last_active":"2024-03-04T13:14:06.621245+0000","last_peered":"2024-03-04T13:14:06.621245+0000","last_clean":"2024-03-04T13:14:06.621245+0000","last_became_active":"2024-03-04T12:32:46.051614+0000","last_became_peered":"2024-03-04T12:32:46.051614+0000","last_unstale":"2024-03-04T13:14:06.621245+0000","last_undegraded":"2024-03-04T13:14:06.621245+0000","last_fullsized":"2024-03-04T13:14:06.621245+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:06.621117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:06.621117+0000","last_clean_scrub_stamp":"2024-03-04T13:14:06.621117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:55:56.045859+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.505223+0000","last_change":"2024-03-04T13:13:29.505223+0000","last_active":"2024-03-04T13:13:29.505223+0000","last_peered":"2024-03-04T13:13:29.505223+0000","last_clean":"2024-03-04T13:13:29.505223+0000","last_became_active":"2024-03-04T12:32:42.033182+0000","last_became_peered":"2024-03-04T12:32:42.033182+0000","last_unstale":"2024-03-04T13:13:29.505223+0000","last_undegraded":"2024-03-04T13:13:29.505223+0000","last_fullsized":"2024-03-04T13:13:29.505223+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:29.505109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:29.505109+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.505109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:58:37.494586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.b","version":"250'41","reported_seq":170,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:26.746795+0000","last_change":"2024-03-04T13:13:26.746795+0000","last_active":"2024-03-04T13:13:26.746795+0000","last_peered":"2024-03-04T13:13:26.746795+0000","last_clean":"2024-03-04T13:13:26.746795+0000","last_became_active":"2024-03-04T12:29:01.708876+0000","last_became_peered":"2024-03-04T12:29:01.708876+0000","last_unstale":"2024-03-04T13:13:26.746795+0000","last_undegraded":"2024-03-04T13:13:26.746795+0000","last_fullsized":"2024-03-04T13:13:26.746795+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'41","last_scrub_stamp":"2024-03-04T13:13:26.746633+0000","last_deep_scrub":"250'41","last_deep_scrub_stamp":"2024-03-04T13:13:26.746633+0000","last_clean_scrub_stamp":"2024-03-04T13:13:26.746633+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:14:28.512234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":148,"num_write":55,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":37,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:17.135825+0000","last_change":"2024-03-04T13:14:17.135862+0000","last_active":"2024-03-04T13:14:17.135825+0000","last_peered":"2024-03-04T13:14:17.135825+0000","last_clean":"2024-03-04T13:14:17.135825+0000","last_became_active":"2024-03-04T12:46:22.256617+0000","last_became_peered":"2024-03-04T12:46:22.256617+0000","last_unstale":"2024-03-04T13:14:17.135825+0000","last_undegraded":"2024-03-04T13:14:17.135825+0000","last_fullsized":"2024-03-04T13:14:17.135825+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:17.135731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:17.135731+0000","last_clean_scrub_stamp":"2024-03-04T13:14:17.135731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:27:05.059008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"250'2","reported_seq":54,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.801296+0000","last_change":"2024-03-04T13:13:46.801296+0000","last_active":"2024-03-04T13:13:46.801296+0000","last_peered":"2024-03-04T13:13:46.801296+0000","last_clean":"2024-03-04T13:13:46.801296+0000","last_became_active":"2024-03-04T12:32:46.055321+0000","last_became_peered":"2024-03-04T12:32:46.055321+0000","last_unstale":"2024-03-04T13:13:46.801296+0000","last_undegraded":"2024-03-04T13:13:46.801296+0000","last_fullsized":"2024-03-04T13:13:46.801296+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'2","last_scrub_stamp":"2024-03-04T13:13:46.801181+0000","last_deep_scrub":"250'2","last_deep_scrub_stamp":"2024-03-04T13:13:46.801181+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.801181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:43:20.617758+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"255'6","reported_seq":67,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.927444+0000","last_change":"2024-03-04T13:13:27.927469+0000","last_active":"2024-03-04T13:13:27.927444+0000","last_peered":"2024-03-04T13:13:27.927444+0000","last_clean":"2024-03-04T13:13:27.927444+0000","last_became_active":"2024-03-04T12:32:42.030512+0000","last_became_peered":"2024-03-04T12:32:42.030512+0000","last_unstale":"2024-03-04T13:13:27.927444+0000","last_undegraded":"2024-03-04T13:13:27.927444+0000","last_fullsized":"2024-03-04T13:13:27.927444+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'6","last_scrub_stamp":"2024-03-04T13:13:27.927372+0000","last_deep_scrub":"255'6","last_deep_scrub_stamp":"2024-03-04T13:13:27.927372+0000","last_clean_scrub_stamp":"2024-03-04T13:13:27.927372+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:53:49.518778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.a","version":"255'57","reported_seq":197,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.162485+0000","last_change":"2024-03-04T13:13:39.162517+0000","last_active":"2024-03-04T13:13:39.162485+0000","last_peered":"2024-03-04T13:13:39.162485+0000","last_clean":"2024-03-04T13:13:39.162485+0000","last_became_active":"2024-03-04T12:29:01.699507+0000","last_became_peered":"2024-03-04T12:29:01.699507+0000","last_unstale":"2024-03-04T13:13:39.162485+0000","last_undegraded":"2024-03-04T13:13:39.162485+0000","last_fullsized":"2024-03-04T13:13:39.162485+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'57","last_scrub_stamp":"2024-03-04T13:13:39.162388+0000","last_deep_scrub":"255'57","last_deep_scrub_stamp":"2024-03-04T13:13:39.162388+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.162388+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:01:36.647719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":165,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":37,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:18.667282+0000","last_change":"2024-03-04T13:14:18.667303+0000","last_active":"2024-03-04T13:14:18.667282+0000","last_peered":"2024-03-04T13:14:18.667282+0000","last_clean":"2024-03-04T13:14:18.667282+0000","last_became_active":"2024-03-04T12:46:22.256181+0000","last_became_peered":"2024-03-04T12:46:22.256181+0000","last_unstale":"2024-03-04T13:14:18.667282+0000","last_undegraded":"2024-03-04T13:14:18.667282+0000","last_fullsized":"2024-03-04T13:14:18.667282+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:18.667157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:18.667157+0000","last_clean_scrub_stamp":"2024-03-04T13:14:18.667157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:50:18.901674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"255'9","reported_seq":66,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.191585+0000","last_change":"2024-03-04T13:13:37.191619+0000","last_active":"2024-03-04T13:13:37.191585+0000","last_peered":"2024-03-04T13:13:37.191585+0000","last_clean":"2024-03-04T13:13:37.191585+0000","last_became_active":"2024-03-04T12:32:46.045552+0000","last_became_peered":"2024-03-04T12:32:46.045552+0000","last_unstale":"2024-03-04T13:13:37.191585+0000","last_undegraded":"2024-03-04T13:13:37.191585+0000","last_fullsized":"2024-03-04T13:13:37.191585+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'9","last_scrub_stamp":"2024-03-04T13:13:37.191494+0000","last_deep_scrub":"255'9","last_deep_scrub_stamp":"2024-03-04T13:13:37.191494+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.191494+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:08:46.570487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"0'0","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.830161+0000","last_change":"2024-03-04T13:13:30.830161+0000","last_active":"2024-03-04T13:13:30.830161+0000","last_peered":"2024-03-04T13:13:30.830161+0000","last_clean":"2024-03-04T13:13:30.830161+0000","last_became_active":"2024-03-04T12:32:42.035436+0000","last_became_peered":"2024-03-04T12:32:42.035436+0000","last_unstale":"2024-03-04T13:13:30.830161+0000","last_undegraded":"2024-03-04T13:13:30.830161+0000","last_fullsized":"2024-03-04T13:13:30.830161+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:30.830047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:30.830047+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.830047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:47:02.886091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.9","version":"255'54","reported_seq":188,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.199311+0000","last_change":"2024-03-04T13:13:43.199357+0000","last_active":"2024-03-04T13:13:43.199311+0000","last_peered":"2024-03-04T13:13:43.199311+0000","last_clean":"2024-03-04T13:13:43.199311+0000","last_became_active":"2024-03-04T12:29:01.704434+0000","last_became_peered":"2024-03-04T12:29:01.704434+0000","last_unstale":"2024-03-04T13:13:43.199311+0000","last_undegraded":"2024-03-04T13:13:43.199311+0000","last_fullsized":"2024-03-04T13:13:43.199311+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'54","last_scrub_stamp":"2024-03-04T13:13:43.199179+0000","last_deep_scrub":"255'54","last_deep_scrub_stamp":"2024-03-04T13:13:43.199179+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.199179+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:20:54.600164+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":154,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":37,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:10.631206+0000","last_change":"2024-03-04T13:14:10.631230+0000","last_active":"2024-03-04T13:14:10.631206+0000","last_peered":"2024-03-04T13:14:10.631206+0000","last_clean":"2024-03-04T13:14:10.631206+0000","last_became_active":"2024-03-04T12:46:22.257495+0000","last_became_peered":"2024-03-04T12:46:22.257495+0000","last_unstale":"2024-03-04T13:14:10.631206+0000","last_undegraded":"2024-03-04T13:14:10.631206+0000","last_fullsized":"2024-03-04T13:14:10.631206+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:10.631115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:10.631115+0000","last_clean_scrub_stamp":"2024-03-04T13:14:10.631115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:22:18.238946+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"255'3","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:18.993787+0000","last_change":"2024-03-04T13:14:18.993841+0000","last_active":"2024-03-04T13:14:18.993787+0000","last_peered":"2024-03-04T13:14:18.993787+0000","last_clean":"2024-03-04T13:14:18.993787+0000","last_became_active":"2024-03-04T12:32:46.056737+0000","last_became_peered":"2024-03-04T12:32:46.056737+0000","last_unstale":"2024-03-04T13:14:18.993787+0000","last_undegraded":"2024-03-04T13:14:18.993787+0000","last_fullsized":"2024-03-04T13:14:18.993787+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'3","last_scrub_stamp":"2024-03-04T13:14:18.993671+0000","last_deep_scrub":"255'3","last_deep_scrub_stamp":"2024-03-04T13:14:18.993671+0000","last_clean_scrub_stamp":"2024-03-04T13:14:18.993671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:45.142816+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"0'0","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:27.747846+0000","last_change":"2024-03-04T13:13:27.747846+0000","last_active":"2024-03-04T13:13:27.747846+0000","last_peered":"2024-03-04T13:13:27.747846+0000","last_clean":"2024-03-04T13:13:27.747846+0000","last_became_active":"2024-03-04T12:32:42.029043+0000","last_became_peered":"2024-03-04T12:32:42.029043+0000","last_unstale":"2024-03-04T13:13:27.747846+0000","last_undegraded":"2024-03-04T13:13:27.747846+0000","last_fullsized":"2024-03-04T13:13:27.747846+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:27.747738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:27.747738+0000","last_clean_scrub_stamp":"2024-03-04T13:13:27.747738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:17.877875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"64.8","version":"255'45","reported_seq":165,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.781282+0000","last_change":"2024-03-04T13:13:33.781309+0000","last_active":"2024-03-04T13:13:33.781282+0000","last_peered":"2024-03-04T13:13:33.781282+0000","last_clean":"2024-03-04T13:13:33.781282+0000","last_became_active":"2024-03-04T12:29:01.702146+0000","last_became_peered":"2024-03-04T12:29:01.702146+0000","last_unstale":"2024-03-04T13:13:33.781282+0000","last_undegraded":"2024-03-04T13:13:33.781282+0000","last_fullsized":"2024-03-04T13:13:33.781282+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'45","last_scrub_stamp":"2024-03-04T13:13:33.781174+0000","last_deep_scrub":"255'45","last_deep_scrub_stamp":"2024-03-04T13:13:33.781174+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.781174+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:38:34.888433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":123,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:22.995863+0000","last_change":"2024-03-04T13:14:22.995892+0000","last_active":"2024-03-04T13:14:22.995863+0000","last_peered":"2024-03-04T13:14:22.995863+0000","last_clean":"2024-03-04T13:14:22.995863+0000","last_became_active":"2024-03-04T12:46:22.310830+0000","last_became_peered":"2024-03-04T12:46:22.310830+0000","last_unstale":"2024-03-04T13:14:22.995863+0000","last_undegraded":"2024-03-04T13:14:22.995863+0000","last_fullsized":"2024-03-04T13:14:22.995863+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:22.995762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:22.995762+0000","last_clean_scrub_stamp":"2024-03-04T13:14:22.995762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:23:28.582969+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"255'2","reported_seq":53,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:59.267934+0000","last_change":"2024-03-04T13:13:59.267963+0000","last_active":"2024-03-04T13:13:59.267934+0000","last_peered":"2024-03-04T13:13:59.267934+0000","last_clean":"2024-03-04T13:13:59.267934+0000","last_became_active":"2024-03-04T12:32:46.058306+0000","last_became_peered":"2024-03-04T12:32:46.058306+0000","last_unstale":"2024-03-04T13:13:59.267934+0000","last_undegraded":"2024-03-04T13:13:59.267934+0000","last_fullsized":"2024-03-04T13:13:59.267934+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:59.267827+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:59.267827+0000","last_clean_scrub_stamp":"2024-03-04T13:13:59.267827+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:55:47.610685+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"255'5","reported_seq":64,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.863975+0000","last_change":"2024-03-04T13:13:29.863975+0000","last_active":"2024-03-04T13:13:29.863975+0000","last_peered":"2024-03-04T13:13:29.863975+0000","last_clean":"2024-03-04T13:13:29.863975+0000","last_became_active":"2024-03-04T12:32:42.035302+0000","last_became_peered":"2024-03-04T12:32:42.035302+0000","last_unstale":"2024-03-04T13:13:29.863975+0000","last_undegraded":"2024-03-04T13:13:29.863975+0000","last_fullsized":"2024-03-04T13:13:29.863975+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'5","last_scrub_stamp":"2024-03-04T13:13:29.863854+0000","last_deep_scrub":"255'5","last_deep_scrub_stamp":"2024-03-04T13:13:29.863854+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.863854+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:03:10.906006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6192,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.7","version":"255'41","reported_seq":163,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.083220+0000","last_change":"2024-03-04T13:13:28.083241+0000","last_active":"2024-03-04T13:13:28.083220+0000","last_peered":"2024-03-04T13:13:28.083220+0000","last_clean":"2024-03-04T13:13:28.083220+0000","last_became_active":"2024-03-04T12:29:01.706897+0000","last_became_peered":"2024-03-04T12:29:01.706897+0000","last_unstale":"2024-03-04T13:13:28.083220+0000","last_undegraded":"2024-03-04T13:13:28.083220+0000","last_fullsized":"2024-03-04T13:13:28.083220+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'41","last_scrub_stamp":"2024-03-04T13:13:28.083138+0000","last_deep_scrub":"255'41","last_deep_scrub_stamp":"2024-03-04T13:13:28.083138+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.083138+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:30:37.038323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":127,"num_write":81,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:21.008500+0000","last_change":"2024-03-04T13:14:21.008524+0000","last_active":"2024-03-04T13:14:21.008500+0000","last_peered":"2024-03-04T13:14:21.008500+0000","last_clean":"2024-03-04T13:14:21.008500+0000","last_became_active":"2024-03-04T12:46:22.252955+0000","last_became_peered":"2024-03-04T12:46:22.252955+0000","last_unstale":"2024-03-04T13:14:21.008500+0000","last_undegraded":"2024-03-04T13:14:21.008500+0000","last_fullsized":"2024-03-04T13:14:21.008500+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:21.008407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:21.008407+0000","last_clean_scrub_stamp":"2024-03-04T13:14:21.008407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:59:48.695433+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"255'11","reported_seq":73,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:14.619520+0000","last_change":"2024-03-04T13:14:14.619520+0000","last_active":"2024-03-04T13:14:14.619520+0000","last_peered":"2024-03-04T13:14:14.619520+0000","last_clean":"2024-03-04T13:14:14.619520+0000","last_became_active":"2024-03-04T12:32:46.056219+0000","last_became_peered":"2024-03-04T12:32:46.056219+0000","last_unstale":"2024-03-04T13:14:14.619520+0000","last_undegraded":"2024-03-04T13:14:14.619520+0000","last_fullsized":"2024-03-04T13:14:14.619520+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'11","last_scrub_stamp":"2024-03-04T13:14:14.619355+0000","last_deep_scrub":"255'11","last_deep_scrub_stamp":"2024-03-04T13:14:14.619355+0000","last_clean_scrub_stamp":"2024-03-04T13:14:14.619355+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:30:00.928550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":25600,"num_write":16,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"255'8","reported_seq":70,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.917141+0000","last_change":"2024-03-04T13:13:30.917141+0000","last_active":"2024-03-04T13:13:30.917141+0000","last_peered":"2024-03-04T13:13:30.917141+0000","last_clean":"2024-03-04T13:13:30.917141+0000","last_became_active":"2024-03-04T12:32:42.034556+0000","last_became_peered":"2024-03-04T12:32:42.034556+0000","last_unstale":"2024-03-04T13:13:30.917141+0000","last_undegraded":"2024-03-04T13:13:30.917141+0000","last_fullsized":"2024-03-04T13:13:30.917141+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'8","last_scrub_stamp":"2024-03-04T13:13:30.917008+0000","last_deep_scrub":"255'8","last_deep_scrub_stamp":"2024-03-04T13:13:30.917008+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.917008+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:17:52.807115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":12328,"num_write":8,"num_write_kb":12328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"64.6","version":"255'42","reported_seq":156,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.515404+0000","last_change":"2024-03-04T13:13:32.515429+0000","last_active":"2024-03-04T13:13:32.515404+0000","last_peered":"2024-03-04T13:13:32.515404+0000","last_clean":"2024-03-04T13:13:32.515404+0000","last_became_active":"2024-03-04T12:29:01.706549+0000","last_became_peered":"2024-03-04T12:29:01.706549+0000","last_unstale":"2024-03-04T13:13:32.515404+0000","last_undegraded":"2024-03-04T13:13:32.515404+0000","last_fullsized":"2024-03-04T13:13:32.515404+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'42","last_scrub_stamp":"2024-03-04T13:13:32.515310+0000","last_deep_scrub":"255'42","last_deep_scrub_stamp":"2024-03-04T13:13:32.515310+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.515310+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:31:52.043625+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":111,"num_write":76,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.6","version":"255'2","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:16.176573+0000","last_change":"2024-03-04T13:14:16.176600+0000","last_active":"2024-03-04T13:14:16.176573+0000","last_peered":"2024-03-04T13:14:16.176573+0000","last_clean":"2024-03-04T13:14:16.176573+0000","last_became_active":"2024-03-04T12:46:22.254303+0000","last_became_peered":"2024-03-04T12:46:22.254303+0000","last_unstale":"2024-03-04T13:14:16.176573+0000","last_undegraded":"2024-03-04T13:14:16.176573+0000","last_fullsized":"2024-03-04T13:14:16.176573+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:14:16.176485+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:14:16.176485+0000","last_clean_scrub_stamp":"2024-03-04T13:14:16.176485+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:34:48.603295+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"255'3","reported_seq":55,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.518434+0000","last_change":"2024-03-04T13:13:43.518434+0000","last_active":"2024-03-04T13:13:43.518434+0000","last_peered":"2024-03-04T13:13:43.518434+0000","last_clean":"2024-03-04T13:13:43.518434+0000","last_became_active":"2024-03-04T12:32:46.055497+0000","last_became_peered":"2024-03-04T12:32:46.055497+0000","last_unstale":"2024-03-04T13:13:43.518434+0000","last_undegraded":"2024-03-04T13:13:43.518434+0000","last_fullsized":"2024-03-04T13:13:43.518434+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'3","last_scrub_stamp":"2024-03-04T13:13:43.518316+0000","last_deep_scrub":"255'3","last_deep_scrub_stamp":"2024-03-04T13:13:43.518316+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.518316+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:18:54.864627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"0'0","reported_seq":57,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.807264+0000","last_change":"2024-03-04T13:13:31.807264+0000","last_active":"2024-03-04T13:13:31.807264+0000","last_peered":"2024-03-04T13:13:31.807264+0000","last_clean":"2024-03-04T13:13:31.807264+0000","last_became_active":"2024-03-04T12:32:42.036150+0000","last_became_peered":"2024-03-04T12:32:42.036150+0000","last_unstale":"2024-03-04T13:13:31.807264+0000","last_undegraded":"2024-03-04T13:13:31.807264+0000","last_fullsized":"2024-03-04T13:13:31.807264+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:31.807148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:31.807148+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.807148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:09:22.042627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"64.5","version":"255'69","reported_seq":280,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.236382+0000","last_change":"2024-03-04T13:13:30.236412+0000","last_active":"2024-03-04T13:13:30.236382+0000","last_peered":"2024-03-04T13:13:30.236382+0000","last_clean":"2024-03-04T13:13:30.236382+0000","last_became_active":"2024-03-04T12:29:01.700624+0000","last_became_peered":"2024-03-04T12:29:01.700624+0000","last_unstale":"2024-03-04T13:13:30.236382+0000","last_undegraded":"2024-03-04T13:13:30.236382+0000","last_fullsized":"2024-03-04T13:13:30.236382+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'69","last_scrub_stamp":"2024-03-04T13:13:30.236288+0000","last_deep_scrub":"255'69","last_deep_scrub_stamp":"2024-03-04T13:13:30.236288+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.236288+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:06:29.427575+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":416,"num_read_kb":295,"num_write":88,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4990,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":37,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:20.633193+0000","last_change":"2024-03-04T13:14:20.633216+0000","last_active":"2024-03-04T13:14:20.633193+0000","last_peered":"2024-03-04T13:14:20.633193+0000","last_clean":"2024-03-04T13:14:20.633193+0000","last_became_active":"2024-03-04T12:46:22.309493+0000","last_became_peered":"2024-03-04T12:46:22.309493+0000","last_unstale":"2024-03-04T13:14:20.633193+0000","last_undegraded":"2024-03-04T13:14:20.633193+0000","last_fullsized":"2024-03-04T13:14:20.633193+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:20.633056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:20.633056+0000","last_clean_scrub_stamp":"2024-03-04T13:14:20.633056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:58:52.606884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"255'10","reported_seq":71,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:13.482830+0000","last_change":"2024-03-04T13:14:13.482881+0000","last_active":"2024-03-04T13:14:13.482830+0000","last_peered":"2024-03-04T13:14:13.482830+0000","last_clean":"2024-03-04T13:14:13.482830+0000","last_became_active":"2024-03-04T12:32:46.054256+0000","last_became_peered":"2024-03-04T12:32:46.054256+0000","last_unstale":"2024-03-04T13:14:13.482830+0000","last_undegraded":"2024-03-04T13:14:13.482830+0000","last_fullsized":"2024-03-04T13:14:13.482830+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'10","last_scrub_stamp":"2024-03-04T13:14:13.482714+0000","last_deep_scrub":"255'10","last_deep_scrub_stamp":"2024-03-04T13:14:13.482714+0000","last_clean_scrub_stamp":"2024-03-04T13:14:13.482714+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:42.927584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":16480,"num_write":15,"num_write_kb":11320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"0'0","reported_seq":56,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.517623+0000","last_change":"2024-03-04T13:13:28.517646+0000","last_active":"2024-03-04T13:13:28.517623+0000","last_peered":"2024-03-04T13:13:28.517623+0000","last_clean":"2024-03-04T13:13:28.517623+0000","last_became_active":"2024-03-04T12:32:42.035683+0000","last_became_peered":"2024-03-04T12:32:42.035683+0000","last_unstale":"2024-03-04T13:13:28.517623+0000","last_undegraded":"2024-03-04T13:13:28.517623+0000","last_fullsized":"2024-03-04T13:13:28.517623+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:28.517514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:28.517514+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.517514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:09.797649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.4","version":"255'43","reported_seq":153,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.519890+0000","last_change":"2024-03-04T13:13:34.519938+0000","last_active":"2024-03-04T13:13:34.519890+0000","last_peered":"2024-03-04T13:13:34.519890+0000","last_clean":"2024-03-04T13:13:34.519890+0000","last_became_active":"2024-03-04T12:29:01.701396+0000","last_became_peered":"2024-03-04T12:29:01.701396+0000","last_unstale":"2024-03-04T13:13:34.519890+0000","last_undegraded":"2024-03-04T13:13:34.519890+0000","last_fullsized":"2024-03-04T13:13:34.519890+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'43","last_scrub_stamp":"2024-03-04T13:13:34.519764+0000","last_deep_scrub":"255'43","last_deep_scrub_stamp":"2024-03-04T13:13:34.519764+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.519764+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:54:01.761324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":79,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":39,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:15.441696+0000","last_change":"2024-03-04T13:14:15.441696+0000","last_active":"2024-03-04T13:14:15.441696+0000","last_peered":"2024-03-04T13:14:15.441696+0000","last_clean":"2024-03-04T13:14:15.441696+0000","last_became_active":"2024-03-04T12:46:22.259763+0000","last_became_peered":"2024-03-04T12:46:22.259763+0000","last_unstale":"2024-03-04T13:14:15.441696+0000","last_undegraded":"2024-03-04T13:14:15.441696+0000","last_fullsized":"2024-03-04T13:14:15.441696+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:15.441541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:15.441541+0000","last_clean_scrub_stamp":"2024-03-04T13:14:15.441541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:00:17.772652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"255'5","reported_seq":59,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:16.643093+0000","last_change":"2024-03-04T13:14:16.643093+0000","last_active":"2024-03-04T13:14:16.643093+0000","last_peered":"2024-03-04T13:14:16.643093+0000","last_clean":"2024-03-04T13:14:16.643093+0000","last_became_active":"2024-03-04T12:32:46.057646+0000","last_became_peered":"2024-03-04T12:32:46.057646+0000","last_unstale":"2024-03-04T13:14:16.643093+0000","last_undegraded":"2024-03-04T13:14:16.643093+0000","last_fullsized":"2024-03-04T13:14:16.643093+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'5","last_scrub_stamp":"2024-03-04T13:14:16.642980+0000","last_deep_scrub":"255'5","last_deep_scrub_stamp":"2024-03-04T13:14:16.642980+0000","last_clean_scrub_stamp":"2024-03-04T13:14:16.642980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:21:17.179960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5168,"num_write":5,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"255'2","reported_seq":60,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.052620+0000","last_change":"2024-03-04T13:13:29.052620+0000","last_active":"2024-03-04T13:13:29.052620+0000","last_peered":"2024-03-04T13:13:29.052620+0000","last_clean":"2024-03-04T13:13:29.052620+0000","last_became_active":"2024-03-04T12:32:42.026771+0000","last_became_peered":"2024-03-04T12:32:42.026771+0000","last_unstale":"2024-03-04T13:13:29.052620+0000","last_undegraded":"2024-03-04T13:13:29.052620+0000","last_fullsized":"2024-03-04T13:13:29.052620+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:29.052506+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:29.052506+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.052506+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:13:31.731989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"64.3","version":"255'43","reported_seq":162,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.820896+0000","last_change":"2024-03-04T13:13:30.820942+0000","last_active":"2024-03-04T13:13:30.820896+0000","last_peered":"2024-03-04T13:13:30.820896+0000","last_clean":"2024-03-04T13:13:30.820896+0000","last_became_active":"2024-03-04T12:29:01.701812+0000","last_became_peered":"2024-03-04T12:29:01.701812+0000","last_unstale":"2024-03-04T13:13:30.820896+0000","last_undegraded":"2024-03-04T13:13:30.820896+0000","last_fullsized":"2024-03-04T13:13:30.820896+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'43","last_scrub_stamp":"2024-03-04T13:13:30.820770+0000","last_deep_scrub":"255'43","last_deep_scrub_stamp":"2024-03-04T13:13:30.820770+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.820770+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:32:52.795812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":121,"num_write":82,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:09.665319+0000","last_change":"2024-03-04T13:14:09.665340+0000","last_active":"2024-03-04T13:14:09.665319+0000","last_peered":"2024-03-04T13:14:09.665319+0000","last_clean":"2024-03-04T13:14:09.665319+0000","last_became_active":"2024-03-04T12:46:22.247655+0000","last_became_peered":"2024-03-04T12:46:22.247655+0000","last_unstale":"2024-03-04T13:14:09.665319+0000","last_undegraded":"2024-03-04T13:14:09.665319+0000","last_fullsized":"2024-03-04T13:14:09.665319+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:09.665246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:09.665246+0000","last_clean_scrub_stamp":"2024-03-04T13:14:09.665246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:42:11.264634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"255'3","reported_seq":58,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:17.692519+0000","last_change":"2024-03-04T13:14:17.692544+0000","last_active":"2024-03-04T13:14:17.692519+0000","last_peered":"2024-03-04T13:14:17.692519+0000","last_clean":"2024-03-04T13:14:17.692519+0000","last_became_active":"2024-03-04T12:32:46.058466+0000","last_became_peered":"2024-03-04T12:32:46.058466+0000","last_unstale":"2024-03-04T13:14:17.692519+0000","last_undegraded":"2024-03-04T13:14:17.692519+0000","last_fullsized":"2024-03-04T13:14:17.692519+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'3","last_scrub_stamp":"2024-03-04T13:14:17.692422+0000","last_deep_scrub":"255'3","last_deep_scrub_stamp":"2024-03-04T13:14:17.692422+0000","last_clean_scrub_stamp":"2024-03-04T13:14:17.692422+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:47:21.392895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"0'0","reported_seq":57,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.391685+0000","last_change":"2024-03-04T13:13:43.391685+0000","last_active":"2024-03-04T13:13:43.391685+0000","last_peered":"2024-03-04T13:13:43.391685+0000","last_clean":"2024-03-04T13:13:43.391685+0000","last_became_active":"2024-03-04T12:32:42.031410+0000","last_became_peered":"2024-03-04T12:32:42.031410+0000","last_unstale":"2024-03-04T13:13:43.391685+0000","last_undegraded":"2024-03-04T13:13:43.391685+0000","last_fullsized":"2024-03-04T13:13:43.391685+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:43.391527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:43.391527+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.391527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:29:32.117760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"64.2","version":"255'27","reported_seq":124,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.781758+0000","last_change":"2024-03-04T13:13:32.781830+0000","last_active":"2024-03-04T13:13:32.781758+0000","last_peered":"2024-03-04T13:13:32.781758+0000","last_clean":"2024-03-04T13:13:32.781758+0000","last_became_active":"2024-03-04T12:29:01.703420+0000","last_became_peered":"2024-03-04T12:29:01.703420+0000","last_unstale":"2024-03-04T13:13:32.781758+0000","last_undegraded":"2024-03-04T13:13:32.781758+0000","last_fullsized":"2024-03-04T13:13:32.781758+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'27","last_scrub_stamp":"2024-03-04T13:13:32.781646+0000","last_deep_scrub":"255'27","last_deep_scrub_stamp":"2024-03-04T13:13:32.781646+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.781646+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:01.556499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":74,"num_write":42,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:14.174882+0000","last_change":"2024-03-04T13:14:14.174923+0000","last_active":"2024-03-04T13:14:14.174882+0000","last_peered":"2024-03-04T13:14:14.174882+0000","last_clean":"2024-03-04T13:14:14.174882+0000","last_became_active":"2024-03-04T12:46:22.249854+0000","last_became_peered":"2024-03-04T12:46:22.249854+0000","last_unstale":"2024-03-04T13:14:14.174882+0000","last_undegraded":"2024-03-04T13:14:14.174882+0000","last_fullsized":"2024-03-04T13:14:14.174882+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:14.174779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:14.174779+0000","last_clean_scrub_stamp":"2024-03-04T13:14:14.174779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:01:49.118349+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":51,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:03.918200+0000","last_change":"2024-03-04T13:14:03.918200+0000","last_active":"2024-03-04T13:14:03.918200+0000","last_peered":"2024-03-04T13:14:03.918200+0000","last_clean":"2024-03-04T13:14:03.918200+0000","last_became_active":"2024-03-04T12:32:46.051498+0000","last_became_peered":"2024-03-04T12:32:46.051498+0000","last_unstale":"2024-03-04T13:14:03.918200+0000","last_undegraded":"2024-03-04T13:14:03.918200+0000","last_fullsized":"2024-03-04T13:14:03.918200+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:03.918083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:03.918083+0000","last_clean_scrub_stamp":"2024-03-04T13:14:03.918083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:39:20.277289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"255'6","reported_seq":70,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.493334+0000","last_change":"2024-03-04T13:13:39.493363+0000","last_active":"2024-03-04T13:13:39.493334+0000","last_peered":"2024-03-04T13:13:39.493334+0000","last_clean":"2024-03-04T13:13:39.493334+0000","last_became_active":"2024-03-04T12:32:42.038349+0000","last_became_peered":"2024-03-04T12:32:42.038349+0000","last_unstale":"2024-03-04T13:13:39.493334+0000","last_undegraded":"2024-03-04T13:13:39.493334+0000","last_fullsized":"2024-03-04T13:13:39.493334+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'6","last_scrub_stamp":"2024-03-04T13:13:39.493239+0000","last_deep_scrub":"255'6","last_deep_scrub_stamp":"2024-03-04T13:13:39.493239+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.493239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:37:54.785538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"64.1","version":"255'90","reported_seq":267,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.211860+0000","last_change":"2024-03-04T13:13:28.211887+0000","last_active":"2024-03-04T13:13:28.211860+0000","last_peered":"2024-03-04T13:13:28.211860+0000","last_clean":"2024-03-04T13:13:28.211860+0000","last_became_active":"2024-03-04T12:29:01.701282+0000","last_became_peered":"2024-03-04T12:29:01.701282+0000","last_unstale":"2024-03-04T13:13:28.211860+0000","last_undegraded":"2024-03-04T13:13:28.211860+0000","last_fullsized":"2024-03-04T13:13:28.211860+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'90","last_scrub_stamp":"2024-03-04T13:13:28.211770+0000","last_deep_scrub":"255'90","last_deep_scrub_stamp":"2024-03-04T13:13:28.211770+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.211770+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:24:35.609835+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":354,"num_read_kb":252,"num_write":156,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":38,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:07.907141+0000","last_change":"2024-03-04T13:14:07.907180+0000","last_active":"2024-03-04T13:14:07.907141+0000","last_peered":"2024-03-04T13:14:07.907141+0000","last_clean":"2024-03-04T13:14:07.907141+0000","last_became_active":"2024-03-04T12:46:22.258936+0000","last_became_peered":"2024-03-04T12:46:22.258936+0000","last_unstale":"2024-03-04T13:14:07.907141+0000","last_undegraded":"2024-03-04T13:14:07.907141+0000","last_fullsized":"2024-03-04T13:14:07.907141+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:07.906995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:07.906995+0000","last_clean_scrub_stamp":"2024-03-04T13:14:07.906995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:04:15.214223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":51,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:07.630032+0000","last_change":"2024-03-04T13:14:07.630032+0000","last_active":"2024-03-04T13:14:07.630032+0000","last_peered":"2024-03-04T13:14:07.630032+0000","last_clean":"2024-03-04T13:14:07.630032+0000","last_became_active":"2024-03-04T12:32:46.053456+0000","last_became_peered":"2024-03-04T12:32:46.053456+0000","last_unstale":"2024-03-04T13:14:07.630032+0000","last_undegraded":"2024-03-04T13:14:07.630032+0000","last_fullsized":"2024-03-04T13:14:07.630032+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":248,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:07.629914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:07.629914+0000","last_clean_scrub_stamp":"2024-03-04T13:14:07.629914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:01.940994+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"0'0","reported_seq":57,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:28.872826+0000","last_change":"2024-03-04T13:13:28.872826+0000","last_active":"2024-03-04T13:13:28.872826+0000","last_peered":"2024-03-04T13:13:28.872826+0000","last_clean":"2024-03-04T13:13:28.872826+0000","last_became_active":"2024-03-04T12:32:42.035413+0000","last_became_peered":"2024-03-04T12:32:42.035413+0000","last_unstale":"2024-03-04T13:13:28.872826+0000","last_undegraded":"2024-03-04T13:13:28.872826+0000","last_fullsized":"2024-03-04T13:13:28.872826+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":245,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:28.872647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:28.872647+0000","last_clean_scrub_stamp":"2024-03-04T13:13:28.872647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:54:46.886474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"64.0","version":"255'17","reported_seq":103,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.134636+0000","last_change":"2024-03-04T13:13:41.134664+0000","last_active":"2024-03-04T13:13:41.134636+0000","last_peered":"2024-03-04T13:13:41.134636+0000","last_clean":"2024-03-04T13:13:41.134636+0000","last_became_active":"2024-03-04T12:29:01.702555+0000","last_became_peered":"2024-03-04T12:29:01.702555+0000","last_unstale":"2024-03-04T13:13:41.134636+0000","last_undegraded":"2024-03-04T13:13:41.134636+0000","last_fullsized":"2024-03-04T13:13:41.134636+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":242,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'17","last_scrub_stamp":"2024-03-04T13:13:41.134538+0000","last_deep_scrub":"255'17","last_deep_scrub_stamp":"2024-03-04T13:13:41.134538+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.134538+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:28.139595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":47,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"255'180","reported_seq":794,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:56.668570+0000","last_change":"2024-03-04T13:13:56.668570+0000","last_active":"2024-03-04T13:13:56.668570+0000","last_peered":"2024-03-04T13:13:56.668570+0000","last_clean":"2024-03-04T13:13:56.668570+0000","last_became_active":"2024-03-04T12:20:14.820595+0000","last_became_peered":"2024-03-04T12:20:14.820595+0000","last_unstale":"2024-03-04T13:13:56.668570+0000","last_undegraded":"2024-03-04T13:13:56.668570+0000","last_fullsized":"2024-03-04T13:13:56.668570+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'180","last_scrub_stamp":"2024-03-04T13:13:56.668423+0000","last_deep_scrub":"255'180","last_deep_scrub_stamp":"2024-03-04T13:13:56.668423+0000","last_clean_scrub_stamp":"2024-03-04T13:13:56.668423+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:13:06.956800+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":457,"num_write":1012,"num_write_kb":11218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"255'478","reported_seq":1790,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:50.353917+0000","last_change":"2024-03-04T13:13:50.353962+0000","last_active":"2024-03-04T13:13:50.353917+0000","last_peered":"2024-03-04T13:13:50.353917+0000","last_clean":"2024-03-04T13:13:50.353917+0000","last_became_active":"2024-03-04T12:20:16.828539+0000","last_became_peered":"2024-03-04T12:20:16.828539+0000","last_unstale":"2024-03-04T13:13:50.353917+0000","last_undegraded":"2024-03-04T13:13:50.353917+0000","last_fullsized":"2024-03-04T13:13:50.353917+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'478","last_scrub_stamp":"2024-03-04T13:13:50.353824+0000","last_deep_scrub":"255'478","last_deep_scrub_stamp":"2024-03-04T13:13:50.353824+0000","last_clean_scrub_stamp":"2024-03-04T13:13:50.353824+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:07:54.826761+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2301,"num_read_kb":2121,"num_write":643,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"255'227","reported_seq":887,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:02.616677+0000","last_change":"2024-03-04T13:14:02.616677+0000","last_active":"2024-03-04T13:14:02.616677+0000","last_peered":"2024-03-04T13:14:02.616677+0000","last_clean":"2024-03-04T13:14:02.616677+0000","last_became_active":"2024-03-04T12:20:14.814863+0000","last_became_peered":"2024-03-04T12:20:14.814863+0000","last_unstale":"2024-03-04T13:14:02.616677+0000","last_undegraded":"2024-03-04T13:14:02.616677+0000","last_fullsized":"2024-03-04T13:14:02.616677+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'227","last_scrub_stamp":"2024-03-04T13:14:02.616534+0000","last_deep_scrub":"255'227","last_deep_scrub_stamp":"2024-03-04T13:14:02.616534+0000","last_clean_scrub_stamp":"2024-03-04T13:14:02.616534+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:45:17.859213+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":591266,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":15449,"num_write":1326,"num_write_kb":40818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"255'560","reported_seq":1919,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:51.635876+0000","last_change":"2024-03-04T13:13:51.635922+0000","last_active":"2024-03-04T13:13:51.635876+0000","last_peered":"2024-03-04T13:13:51.635876+0000","last_clean":"2024-03-04T13:13:51.635876+0000","last_became_active":"2024-03-04T12:20:16.837200+0000","last_became_peered":"2024-03-04T12:20:16.837200+0000","last_unstale":"2024-03-04T13:13:51.635876+0000","last_undegraded":"2024-03-04T13:13:51.635876+0000","last_fullsized":"2024-03-04T13:13:51.635876+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'560","last_scrub_stamp":"2024-03-04T13:13:51.635762+0000","last_deep_scrub":"255'560","last_deep_scrub_stamp":"2024-03-04T13:13:51.635762+0000","last_clean_scrub_stamp":"2024-03-04T13:13:51.635762+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:42:29.290164+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2594,"num_read_kb":2289,"num_write":764,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"255'159","reported_seq":761,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:11.941067+0000","last_change":"2024-03-04T13:14:11.941067+0000","last_active":"2024-03-04T13:14:11.941067+0000","last_peered":"2024-03-04T13:14:11.941067+0000","last_clean":"2024-03-04T13:14:11.941067+0000","last_became_active":"2024-03-04T12:20:14.816597+0000","last_became_peered":"2024-03-04T12:20:14.816597+0000","last_unstale":"2024-03-04T13:14:11.941067+0000","last_undegraded":"2024-03-04T13:14:11.941067+0000","last_fullsized":"2024-03-04T13:14:11.941067+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'159","last_scrub_stamp":"2024-03-04T13:14:11.940926+0000","last_deep_scrub":"255'159","last_deep_scrub_stamp":"2024-03-04T13:14:11.940926+0000","last_clean_scrub_stamp":"2024-03-04T13:14:11.940926+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:14:50.471945+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":326,"num_read_kb":1168,"num_write":917,"num_write_kb":5749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"255'454","reported_seq":1961,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:00.133825+0000","last_change":"2024-03-04T13:14:00.133852+0000","last_active":"2024-03-04T13:14:00.133825+0000","last_peered":"2024-03-04T13:14:00.133825+0000","last_clean":"2024-03-04T13:14:00.133825+0000","last_became_active":"2024-03-04T12:20:16.820419+0000","last_became_peered":"2024-03-04T12:20:16.820419+0000","last_unstale":"2024-03-04T13:14:00.133825+0000","last_undegraded":"2024-03-04T13:14:00.133825+0000","last_fullsized":"2024-03-04T13:14:00.133825+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'454","last_scrub_stamp":"2024-03-04T13:14:00.133741+0000","last_deep_scrub":"255'454","last_deep_scrub_stamp":"2024-03-04T13:14:00.133741+0000","last_clean_scrub_stamp":"2024-03-04T13:14:00.133741+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:04:22.061060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2318,"num_read_kb":2161,"num_write":537,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"255'251","reported_seq":898,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:00.509577+0000","last_change":"2024-03-04T13:14:00.509577+0000","last_active":"2024-03-04T13:14:00.509577+0000","last_peered":"2024-03-04T13:14:00.509577+0000","last_clean":"2024-03-04T13:14:00.509577+0000","last_became_active":"2024-03-04T12:20:14.824779+0000","last_became_peered":"2024-03-04T12:20:14.824779+0000","last_unstale":"2024-03-04T13:14:00.509577+0000","last_undegraded":"2024-03-04T13:14:00.509577+0000","last_fullsized":"2024-03-04T13:14:00.509577+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'251","last_scrub_stamp":"2024-03-04T13:14:00.509421+0000","last_deep_scrub":"255'251","last_deep_scrub_stamp":"2024-03-04T13:14:00.509421+0000","last_clean_scrub_stamp":"2024-03-04T13:14:00.509421+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:48:22.303660+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4160401,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":13558,"num_write":1376,"num_write_kb":36455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"255'352","reported_seq":1803,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:01.875327+0000","last_change":"2024-03-04T13:14:01.875355+0000","last_active":"2024-03-04T13:14:01.875327+0000","last_peered":"2024-03-04T13:14:01.875327+0000","last_clean":"2024-03-04T13:14:01.875327+0000","last_became_active":"2024-03-04T12:20:16.827613+0000","last_became_peered":"2024-03-04T12:20:16.827613+0000","last_unstale":"2024-03-04T13:14:01.875327+0000","last_undegraded":"2024-03-04T13:14:01.875327+0000","last_fullsized":"2024-03-04T13:14:01.875327+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'352","last_scrub_stamp":"2024-03-04T13:14:01.875237+0000","last_deep_scrub":"255'352","last_deep_scrub_stamp":"2024-03-04T13:14:01.875237+0000","last_clean_scrub_stamp":"2024-03-04T13:14:01.875237+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:50:01.808548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1915,"num_read_kb":1843,"num_write":383,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"255'203","reported_seq":851,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:11.659629+0000","last_change":"2024-03-04T13:14:11.659682+0000","last_active":"2024-03-04T13:14:11.659629+0000","last_peered":"2024-03-04T13:14:11.659629+0000","last_clean":"2024-03-04T13:14:11.659629+0000","last_became_active":"2024-03-04T12:20:14.816532+0000","last_became_peered":"2024-03-04T12:20:14.816532+0000","last_unstale":"2024-03-04T13:14:11.659629+0000","last_undegraded":"2024-03-04T13:14:11.659629+0000","last_fullsized":"2024-03-04T13:14:11.659629+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'203","last_scrub_stamp":"2024-03-04T13:14:11.659547+0000","last_deep_scrub":"255'203","last_deep_scrub_stamp":"2024-03-04T13:14:11.659547+0000","last_clean_scrub_stamp":"2024-03-04T13:14:11.659547+0000","objects_scrubbed":8,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:38:20.679774+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5789792,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":440,"num_read_kb":58154,"num_write":1069,"num_write_kb":58795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"255'407","reported_seq":2056,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:51.691033+0000","last_change":"2024-03-04T13:13:51.691073+0000","last_active":"2024-03-04T13:13:51.691033+0000","last_peered":"2024-03-04T13:13:51.691033+0000","last_clean":"2024-03-04T13:13:51.691033+0000","last_became_active":"2024-03-04T12:20:16.816688+0000","last_became_peered":"2024-03-04T12:20:16.816688+0000","last_unstale":"2024-03-04T13:13:51.691033+0000","last_undegraded":"2024-03-04T13:13:51.691033+0000","last_fullsized":"2024-03-04T13:13:51.691033+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'407","last_scrub_stamp":"2024-03-04T13:13:51.690939+0000","last_deep_scrub":"255'407","last_deep_scrub_stamp":"2024-03-04T13:13:51.690939+0000","last_clean_scrub_stamp":"2024-03-04T13:13:51.690939+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:33:48.362910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2407,"num_read_kb":2304,"num_write":479,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2630,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"255'181","reported_seq":771,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.744308+0000","last_change":"2024-03-04T13:13:33.744384+0000","last_active":"2024-03-04T13:13:33.744308+0000","last_peered":"2024-03-04T13:13:33.744308+0000","last_clean":"2024-03-04T13:13:33.744308+0000","last_became_active":"2024-03-04T12:20:51.030709+0000","last_became_peered":"2024-03-04T12:20:51.030709+0000","last_unstale":"2024-03-04T13:13:33.744308+0000","last_undegraded":"2024-03-04T13:13:33.744308+0000","last_fullsized":"2024-03-04T13:13:33.744308+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'181","last_scrub_stamp":"2024-03-04T13:13:33.744222+0000","last_deep_scrub":"255'181","last_deep_scrub_stamp":"2024-03-04T13:13:33.744222+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.744222+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:41:30.000095+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311793,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":363,"num_read_kb":29477,"num_write":998,"num_write_kb":29693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"255'777","reported_seq":2165,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:54.229594+0000","last_change":"2024-03-04T13:13:54.229594+0000","last_active":"2024-03-04T13:13:54.229594+0000","last_peered":"2024-03-04T13:13:54.229594+0000","last_clean":"2024-03-04T13:13:54.229594+0000","last_became_active":"2024-03-04T12:20:16.822282+0000","last_became_peered":"2024-03-04T12:20:16.822282+0000","last_unstale":"2024-03-04T13:13:54.229594+0000","last_undegraded":"2024-03-04T13:13:54.229594+0000","last_fullsized":"2024-03-04T13:13:54.229594+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'777","last_scrub_stamp":"2024-03-04T13:13:54.229429+0000","last_deep_scrub":"255'777","last_deep_scrub_stamp":"2024-03-04T13:13:54.229429+0000","last_clean_scrub_stamp":"2024-03-04T13:13:54.229429+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:06.557919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3372,"num_read_kb":2974,"num_write":1065,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":475,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"255'199","reported_seq":839,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:08.702289+0000","last_change":"2024-03-04T13:14:08.702330+0000","last_active":"2024-03-04T13:14:08.702289+0000","last_peered":"2024-03-04T13:14:08.702289+0000","last_clean":"2024-03-04T13:14:08.702289+0000","last_became_active":"2024-03-04T12:20:14.815388+0000","last_became_peered":"2024-03-04T12:20:14.815388+0000","last_unstale":"2024-03-04T13:14:08.702289+0000","last_undegraded":"2024-03-04T13:14:08.702289+0000","last_fullsized":"2024-03-04T13:14:08.702289+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'199","last_scrub_stamp":"2024-03-04T13:14:08.702204+0000","last_deep_scrub":"255'199","last_deep_scrub_stamp":"2024-03-04T13:14:08.702204+0000","last_clean_scrub_stamp":"2024-03-04T13:14:08.702204+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:49:25.968533+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262238,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":61923,"num_write":1063,"num_write_kb":47041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"255'685","reported_seq":2165,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.349621+0000","last_change":"2024-03-04T13:13:47.349621+0000","last_active":"2024-03-04T13:13:47.349621+0000","last_peered":"2024-03-04T13:13:47.349621+0000","last_clean":"2024-03-04T13:13:47.349621+0000","last_became_active":"2024-03-04T12:20:16.833268+0000","last_became_peered":"2024-03-04T12:20:16.833268+0000","last_unstale":"2024-03-04T13:13:47.349621+0000","last_undegraded":"2024-03-04T13:13:47.349621+0000","last_fullsized":"2024-03-04T13:13:47.349621+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'685","last_scrub_stamp":"2024-03-04T13:13:47.349451+0000","last_deep_scrub":"255'685","last_deep_scrub_stamp":"2024-03-04T13:13:47.349451+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.349451+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:59.994253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3214,"num_read_kb":2906,"num_write":892,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"255'238","reported_seq":888,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:07.937786+0000","last_change":"2024-03-04T13:14:07.937869+0000","last_active":"2024-03-04T13:14:07.937786+0000","last_peered":"2024-03-04T13:14:07.937786+0000","last_clean":"2024-03-04T13:14:07.937786+0000","last_became_active":"2024-03-04T12:20:14.827948+0000","last_became_peered":"2024-03-04T12:20:14.827948+0000","last_unstale":"2024-03-04T13:14:07.937786+0000","last_undegraded":"2024-03-04T13:14:07.937786+0000","last_fullsized":"2024-03-04T13:14:07.937786+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'238","last_scrub_stamp":"2024-03-04T13:14:07.937680+0000","last_deep_scrub":"255'238","last_deep_scrub_stamp":"2024-03-04T13:14:07.937680+0000","last_clean_scrub_stamp":"2024-03-04T13:14:07.937680+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:49:44.663941+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2119867,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":498,"num_read_kb":35496,"num_write":1177,"num_write_kb":50438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"255'330","reported_seq":1712,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:51.143640+0000","last_change":"2024-03-04T13:13:51.143640+0000","last_active":"2024-03-04T13:13:51.143640+0000","last_peered":"2024-03-04T13:13:51.143640+0000","last_clean":"2024-03-04T13:13:51.143640+0000","last_became_active":"2024-03-04T12:20:16.830773+0000","last_became_peered":"2024-03-04T12:20:16.830773+0000","last_unstale":"2024-03-04T13:13:51.143640+0000","last_undegraded":"2024-03-04T13:13:51.143640+0000","last_fullsized":"2024-03-04T13:13:51.143640+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'330","last_scrub_stamp":"2024-03-04T13:13:51.143518+0000","last_deep_scrub":"255'330","last_deep_scrub_stamp":"2024-03-04T13:13:51.143518+0000","last_clean_scrub_stamp":"2024-03-04T13:13:51.143518+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:50.933252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1823,"num_read_kb":1743,"num_write":376,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":712,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"255'405","reported_seq":1989,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:02.087510+0000","last_change":"2024-03-04T13:14:02.087541+0000","last_active":"2024-03-04T13:14:02.087510+0000","last_peered":"2024-03-04T13:14:02.087510+0000","last_clean":"2024-03-04T13:14:02.087510+0000","last_became_active":"2024-03-04T12:20:16.820533+0000","last_became_peered":"2024-03-04T12:20:16.820533+0000","last_unstale":"2024-03-04T13:14:02.087510+0000","last_undegraded":"2024-03-04T13:14:02.087510+0000","last_fullsized":"2024-03-04T13:14:02.087510+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'405","last_scrub_stamp":"2024-03-04T13:14:02.087418+0000","last_deep_scrub":"255'405","last_deep_scrub_stamp":"2024-03-04T13:14:02.087418+0000","last_clean_scrub_stamp":"2024-03-04T13:14:02.087418+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:57:37.611290+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2265,"num_read_kb":2155,"num_write":466,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"255'203","reported_seq":843,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:58.682103+0000","last_change":"2024-03-04T13:13:58.682203+0000","last_active":"2024-03-04T13:13:58.682103+0000","last_peered":"2024-03-04T13:13:58.682103+0000","last_clean":"2024-03-04T13:13:58.682103+0000","last_became_active":"2024-03-04T12:20:14.820248+0000","last_became_peered":"2024-03-04T12:20:14.820248+0000","last_unstale":"2024-03-04T13:13:58.682103+0000","last_undegraded":"2024-03-04T13:13:58.682103+0000","last_fullsized":"2024-03-04T13:13:58.682103+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'203","last_scrub_stamp":"2024-03-04T13:13:58.682007+0000","last_deep_scrub":"255'203","last_deep_scrub_stamp":"2024-03-04T13:13:58.682007+0000","last_clean_scrub_stamp":"2024-03-04T13:13:58.682007+0000","objects_scrubbed":10,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:17:28.774504+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847147,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":428,"num_read_kb":15441,"num_write":1092,"num_write_kb":31882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"255'1141","reported_seq":2701,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:49.635842+0000","last_change":"2024-03-04T13:13:49.635842+0000","last_active":"2024-03-04T13:13:49.635842+0000","last_peered":"2024-03-04T13:13:49.635842+0000","last_clean":"2024-03-04T13:13:49.635842+0000","last_became_active":"2024-03-04T12:20:16.837126+0000","last_became_peered":"2024-03-04T12:20:16.837126+0000","last_unstale":"2024-03-04T13:13:49.635842+0000","last_undegraded":"2024-03-04T13:13:49.635842+0000","last_fullsized":"2024-03-04T13:13:49.635842+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1141","last_scrub_stamp":"2024-03-04T13:13:49.635671+0000","last_deep_scrub":"255'1141","last_deep_scrub_stamp":"2024-03-04T13:13:49.635671+0000","last_clean_scrub_stamp":"2024-03-04T13:13:49.635671+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":1100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:44:42.530619+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4770,"num_read_kb":4178,"num_write":1557,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"255'200","reported_seq":825,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:58.779166+0000","last_change":"2024-03-04T13:13:58.779206+0000","last_active":"2024-03-04T13:13:58.779166+0000","last_peered":"2024-03-04T13:13:58.779166+0000","last_clean":"2024-03-04T13:13:58.779166+0000","last_became_active":"2024-03-04T12:20:14.824133+0000","last_became_peered":"2024-03-04T12:20:14.824133+0000","last_unstale":"2024-03-04T13:13:58.779166+0000","last_undegraded":"2024-03-04T13:13:58.779166+0000","last_fullsized":"2024-03-04T13:13:58.779166+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'200","last_scrub_stamp":"2024-03-04T13:13:58.779081+0000","last_deep_scrub":"255'200","last_deep_scrub_stamp":"2024-03-04T13:13:58.779081+0000","last_clean_scrub_stamp":"2024-03-04T13:13:58.779081+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:34:23.772345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399138,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":430,"num_read_kb":9751,"num_write":1008,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"255'740","reported_seq":2197,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:52.408120+0000","last_change":"2024-03-04T13:13:52.408120+0000","last_active":"2024-03-04T13:13:52.408120+0000","last_peered":"2024-03-04T13:13:52.408120+0000","last_clean":"2024-03-04T13:13:52.408120+0000","last_became_active":"2024-03-04T12:20:16.825499+0000","last_became_peered":"2024-03-04T12:20:16.825499+0000","last_unstale":"2024-03-04T13:13:52.408120+0000","last_undegraded":"2024-03-04T13:13:52.408120+0000","last_fullsized":"2024-03-04T13:13:52.408120+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'740","last_scrub_stamp":"2024-03-04T13:13:52.407992+0000","last_deep_scrub":"255'740","last_deep_scrub_stamp":"2024-03-04T13:13:52.407992+0000","last_clean_scrub_stamp":"2024-03-04T13:13:52.407992+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":700,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:59:17.265181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3318,"num_read_kb":2969,"num_write":989,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"255'243","reported_seq":884,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:59.776408+0000","last_change":"2024-03-04T13:13:59.776462+0000","last_active":"2024-03-04T13:13:59.776408+0000","last_peered":"2024-03-04T13:13:59.776408+0000","last_clean":"2024-03-04T13:13:59.776408+0000","last_became_active":"2024-03-04T12:20:14.827979+0000","last_became_peered":"2024-03-04T12:20:14.827979+0000","last_unstale":"2024-03-04T13:13:59.776408+0000","last_undegraded":"2024-03-04T13:13:59.776408+0000","last_fullsized":"2024-03-04T13:13:59.776408+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'243","last_scrub_stamp":"2024-03-04T13:13:59.776306+0000","last_deep_scrub":"255'243","last_deep_scrub_stamp":"2024-03-04T13:13:59.776306+0000","last_clean_scrub_stamp":"2024-03-04T13:13:59.776306+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:14:08.287845+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":577599,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":7999,"num_write":1192,"num_write_kb":30331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"255'778","reported_seq":2224,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:49.173740+0000","last_change":"2024-03-04T13:13:49.173764+0000","last_active":"2024-03-04T13:13:49.173740+0000","last_peered":"2024-03-04T13:13:49.173740+0000","last_clean":"2024-03-04T13:13:49.173740+0000","last_became_active":"2024-03-04T12:20:16.825897+0000","last_became_peered":"2024-03-04T12:20:16.825897+0000","last_unstale":"2024-03-04T13:13:49.173740+0000","last_undegraded":"2024-03-04T13:13:49.173740+0000","last_fullsized":"2024-03-04T13:13:49.173740+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'778","last_scrub_stamp":"2024-03-04T13:13:49.173670+0000","last_deep_scrub":"255'778","last_deep_scrub_stamp":"2024-03-04T13:13:49.173670+0000","last_clean_scrub_stamp":"2024-03-04T13:13:49.173670+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:23:07.806426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3571,"num_read_kb":3184,"num_write":1054,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"255'156","reported_seq":765,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:06.184941+0000","last_change":"2024-03-04T13:14:06.184989+0000","last_active":"2024-03-04T13:14:06.184941+0000","last_peered":"2024-03-04T13:14:06.184941+0000","last_clean":"2024-03-04T13:14:06.184941+0000","last_became_active":"2024-03-04T12:20:14.823430+0000","last_became_peered":"2024-03-04T12:20:14.823430+0000","last_unstale":"2024-03-04T13:14:06.184941+0000","last_undegraded":"2024-03-04T13:14:06.184941+0000","last_fullsized":"2024-03-04T13:14:06.184941+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'156","last_scrub_stamp":"2024-03-04T13:14:06.184838+0000","last_deep_scrub":"255'156","last_deep_scrub_stamp":"2024-03-04T13:14:06.184838+0000","last_clean_scrub_stamp":"2024-03-04T13:14:06.184838+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:43:31.809998+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1683023,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":325,"num_read_kb":32856,"num_write":784,"num_write_kb":22354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"255'557","reported_seq":2097,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:50.137449+0000","last_change":"2024-03-04T13:13:50.137503+0000","last_active":"2024-03-04T13:13:50.137449+0000","last_peered":"2024-03-04T13:13:50.137449+0000","last_clean":"2024-03-04T13:13:50.137449+0000","last_became_active":"2024-03-04T12:20:16.829685+0000","last_became_peered":"2024-03-04T12:20:16.829685+0000","last_unstale":"2024-03-04T13:13:50.137449+0000","last_undegraded":"2024-03-04T13:13:50.137449+0000","last_fullsized":"2024-03-04T13:13:50.137449+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'557","last_scrub_stamp":"2024-03-04T13:13:50.137339+0000","last_deep_scrub":"255'557","last_deep_scrub_stamp":"2024-03-04T13:13:50.137339+0000","last_clean_scrub_stamp":"2024-03-04T13:13:50.137339+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:52:59.670826+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2792,"num_read_kb":2527,"num_write":750,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":951,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"255'195","reported_seq":787,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:17.924565+0000","last_change":"2024-03-04T13:14:17.924610+0000","last_active":"2024-03-04T13:14:17.924565+0000","last_peered":"2024-03-04T13:14:17.924565+0000","last_clean":"2024-03-04T13:14:17.924565+0000","last_became_active":"2024-03-04T12:20:14.821923+0000","last_became_peered":"2024-03-04T12:20:14.821923+0000","last_unstale":"2024-03-04T13:14:17.924565+0000","last_undegraded":"2024-03-04T13:14:17.924565+0000","last_fullsized":"2024-03-04T13:14:17.924565+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'195","last_scrub_stamp":"2024-03-04T13:14:17.924469+0000","last_deep_scrub":"255'195","last_deep_scrub_stamp":"2024-03-04T13:14:17.924469+0000","last_clean_scrub_stamp":"2024-03-04T13:14:17.924469+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:53:54.789315+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":428,"num_write":1012,"num_write_kb":16985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"255'374","reported_seq":1799,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:49.246845+0000","last_change":"2024-03-04T13:13:49.246872+0000","last_active":"2024-03-04T13:13:49.246845+0000","last_peered":"2024-03-04T13:13:49.246845+0000","last_clean":"2024-03-04T13:13:49.246845+0000","last_became_active":"2024-03-04T12:20:16.826208+0000","last_became_peered":"2024-03-04T12:20:16.826208+0000","last_unstale":"2024-03-04T13:13:49.246845+0000","last_undegraded":"2024-03-04T13:13:49.246845+0000","last_fullsized":"2024-03-04T13:13:49.246845+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'374","last_scrub_stamp":"2024-03-04T13:13:49.246754+0000","last_deep_scrub":"255'374","last_deep_scrub_stamp":"2024-03-04T13:13:49.246754+0000","last_clean_scrub_stamp":"2024-03-04T13:13:49.246754+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:36:43.743252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1988,"num_read_kb":1881,"num_write":441,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"255'175","reported_seq":789,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:09.942747+0000","last_change":"2024-03-04T13:14:09.942798+0000","last_active":"2024-03-04T13:14:09.942747+0000","last_peered":"2024-03-04T13:14:09.942747+0000","last_clean":"2024-03-04T13:14:09.942747+0000","last_became_active":"2024-03-04T12:20:14.811813+0000","last_became_peered":"2024-03-04T12:20:14.811813+0000","last_unstale":"2024-03-04T13:14:09.942747+0000","last_undegraded":"2024-03-04T13:14:09.942747+0000","last_fullsized":"2024-03-04T13:14:09.942747+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'175","last_scrub_stamp":"2024-03-04T13:14:09.942649+0000","last_deep_scrub":"255'175","last_deep_scrub_stamp":"2024-03-04T13:14:09.942649+0000","last_clean_scrub_stamp":"2024-03-04T13:14:09.942649+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:04:29.971819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128707,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":397,"num_read_kb":4485,"num_write":973,"num_write_kb":10922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"255'94","reported_seq":590,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.145617+0000","last_change":"2024-03-04T13:13:32.145617+0000","last_active":"2024-03-04T13:13:32.145617+0000","last_peered":"2024-03-04T13:13:32.145617+0000","last_clean":"2024-03-04T13:13:32.145617+0000","last_became_active":"2024-03-04T12:20:24.871089+0000","last_became_peered":"2024-03-04T12:20:24.871089+0000","last_unstale":"2024-03-04T13:13:32.145617+0000","last_undegraded":"2024-03-04T13:13:32.145617+0000","last_fullsized":"2024-03-04T13:13:32.145617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'94","last_scrub_stamp":"2024-03-04T13:13:32.145502+0000","last_deep_scrub":"255'94","last_deep_scrub_stamp":"2024-03-04T13:13:32.145502+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.145502+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:47:10.096376+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":97,"num_write":227,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"255'792","reported_seq":2224,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:01.907005+0000","last_change":"2024-03-04T13:14:01.907005+0000","last_active":"2024-03-04T13:14:01.907005+0000","last_peered":"2024-03-04T13:14:01.907005+0000","last_clean":"2024-03-04T13:14:01.907005+0000","last_became_active":"2024-03-04T12:20:16.828977+0000","last_became_peered":"2024-03-04T12:20:16.828977+0000","last_unstale":"2024-03-04T13:14:01.907005+0000","last_undegraded":"2024-03-04T13:14:01.907005+0000","last_fullsized":"2024-03-04T13:14:01.907005+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'792","last_scrub_stamp":"2024-03-04T13:14:01.906877+0000","last_deep_scrub":"255'792","last_deep_scrub_stamp":"2024-03-04T13:14:01.906877+0000","last_clean_scrub_stamp":"2024-03-04T13:14:01.906877+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:12:08.591141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3439,"num_read_kb":3056,"num_write":1047,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1187,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"255'225","reported_seq":885,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:12.634405+0000","last_change":"2024-03-04T13:14:12.634475+0000","last_active":"2024-03-04T13:14:12.634405+0000","last_peered":"2024-03-04T13:14:12.634405+0000","last_clean":"2024-03-04T13:14:12.634405+0000","last_became_active":"2024-03-04T12:20:14.816722+0000","last_became_peered":"2024-03-04T12:20:14.816722+0000","last_unstale":"2024-03-04T13:14:12.634405+0000","last_undegraded":"2024-03-04T13:14:12.634405+0000","last_fullsized":"2024-03-04T13:14:12.634405+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'225","last_scrub_stamp":"2024-03-04T13:14:12.634313+0000","last_deep_scrub":"255'225","last_deep_scrub_stamp":"2024-03-04T13:14:12.634313+0000","last_clean_scrub_stamp":"2024-03-04T13:14:12.634313+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:40:11.251658+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1705735,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":471,"num_read_kb":103623,"num_write":1220,"num_write_kb":57222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":492,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:49.328955+0000","last_change":"2024-03-04T13:13:49.328995+0000","last_active":"2024-03-04T13:13:49.328955+0000","last_peered":"2024-03-04T13:13:49.328955+0000","last_clean":"2024-03-04T13:13:49.328955+0000","last_became_active":"2024-03-04T12:20:18.835597+0000","last_became_peered":"2024-03-04T12:20:18.835597+0000","last_unstale":"2024-03-04T13:13:49.328955+0000","last_undegraded":"2024-03-04T13:13:49.328955+0000","last_fullsized":"2024-03-04T13:13:49.328955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:49.328852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:49.328852+0000","last_clean_scrub_stamp":"2024-03-04T13:13:49.328852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:44:36.686960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"255'189","reported_seq":782,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:06.967199+0000","last_change":"2024-03-04T13:14:06.967273+0000","last_active":"2024-03-04T13:14:06.967199+0000","last_peered":"2024-03-04T13:14:06.967199+0000","last_clean":"2024-03-04T13:14:06.967199+0000","last_became_active":"2024-03-04T12:20:20.837048+0000","last_became_peered":"2024-03-04T12:20:20.837048+0000","last_unstale":"2024-03-04T13:14:06.967199+0000","last_undegraded":"2024-03-04T13:14:06.967199+0000","last_fullsized":"2024-03-04T13:14:06.967199+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'189","last_scrub_stamp":"2024-03-04T13:14:06.967098+0000","last_deep_scrub":"255'189","last_deep_scrub_stamp":"2024-03-04T13:14:06.967098+0000","last_clean_scrub_stamp":"2024-03-04T13:14:06.967098+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:57:04.542111+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4721,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":254,"num_read_kb":315,"num_write":146,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":491,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.498806+0000","last_change":"2024-03-04T13:13:41.498831+0000","last_active":"2024-03-04T13:13:41.498806+0000","last_peered":"2024-03-04T13:13:41.498806+0000","last_clean":"2024-03-04T13:13:41.498806+0000","last_became_active":"2024-03-04T12:20:22.852461+0000","last_became_peered":"2024-03-04T12:20:22.852461+0000","last_unstale":"2024-03-04T13:13:41.498806+0000","last_undegraded":"2024-03-04T13:13:41.498806+0000","last_fullsized":"2024-03-04T13:13:41.498806+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:41.498692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:41.498692+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.498692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:16:36.806224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"255'2374","reported_seq":4178,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.244538+0000","last_change":"2024-03-04T13:13:32.244538+0000","last_active":"2024-03-04T13:13:32.244538+0000","last_peered":"2024-03-04T13:13:32.244538+0000","last_clean":"2024-03-04T13:13:32.244538+0000","last_became_active":"2024-03-04T12:20:24.869395+0000","last_became_peered":"2024-03-04T12:20:24.869395+0000","last_unstale":"2024-03-04T13:13:32.244538+0000","last_undegraded":"2024-03-04T13:13:32.244538+0000","last_fullsized":"2024-03-04T13:13:32.244538+0000","mapping_epoch":30,"log_start":"255'2300","ondisk_log_start":"255'2300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2374","last_scrub_stamp":"2024-03-04T13:13:32.244414+0000","last_deep_scrub":"255'2374","last_deep_scrub_stamp":"2024-03-04T13:13:32.244414+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.244414+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":2300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:00:10.267491+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5943,"num_read_kb":5935,"num_write":4730,"num_write_kb":1746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"255'348","reported_seq":1824,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.378169+0000","last_change":"2024-03-04T13:13:46.378200+0000","last_active":"2024-03-04T13:13:46.378169+0000","last_peered":"2024-03-04T13:13:46.378169+0000","last_clean":"2024-03-04T13:13:46.378169+0000","last_became_active":"2024-03-04T12:20:16.829441+0000","last_became_peered":"2024-03-04T12:20:16.829441+0000","last_unstale":"2024-03-04T13:13:46.378169+0000","last_undegraded":"2024-03-04T13:13:46.378169+0000","last_fullsized":"2024-03-04T13:13:46.378169+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'348","last_scrub_stamp":"2024-03-04T13:13:46.378079+0000","last_deep_scrub":"255'348","last_deep_scrub_stamp":"2024-03-04T13:13:46.378079+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.378079+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:49:37.173629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2107,"num_read_kb":2006,"num_write":408,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2858,"num_omap_keys":13,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"255'163","reported_seq":736,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:12.945071+0000","last_change":"2024-03-04T13:14:12.945112+0000","last_active":"2024-03-04T13:14:12.945071+0000","last_peered":"2024-03-04T13:14:12.945071+0000","last_clean":"2024-03-04T13:14:12.945071+0000","last_became_active":"2024-03-04T12:20:14.819559+0000","last_became_peered":"2024-03-04T12:20:14.819559+0000","last_unstale":"2024-03-04T13:14:12.945071+0000","last_undegraded":"2024-03-04T13:14:12.945071+0000","last_fullsized":"2024-03-04T13:14:12.945071+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'163","last_scrub_stamp":"2024-03-04T13:14:12.944982+0000","last_deep_scrub":"255'163","last_deep_scrub_stamp":"2024-03-04T13:14:12.944982+0000","last_clean_scrub_stamp":"2024-03-04T13:14:12.944982+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:19:24.042653+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":323,"num_read_kb":7587,"num_write":849,"num_write_kb":22276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:00.899226+0000","last_change":"2024-03-04T13:14:00.899226+0000","last_active":"2024-03-04T13:14:00.899226+0000","last_peered":"2024-03-04T13:14:00.899226+0000","last_clean":"2024-03-04T13:14:00.899226+0000","last_became_active":"2024-03-04T12:20:18.833470+0000","last_became_peered":"2024-03-04T12:20:18.833470+0000","last_unstale":"2024-03-04T13:14:00.899226+0000","last_undegraded":"2024-03-04T13:14:00.899226+0000","last_fullsized":"2024-03-04T13:14:00.899226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:00.899079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:00.899079+0000","last_clean_scrub_stamp":"2024-03-04T13:14:00.899079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:57:35.968959+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"255'80","reported_seq":606,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.292561+0000","last_change":"2024-03-04T13:13:46.292613+0000","last_active":"2024-03-04T13:13:46.292561+0000","last_peered":"2024-03-04T13:13:46.292561+0000","last_clean":"2024-03-04T13:13:46.292561+0000","last_became_active":"2024-03-04T12:20:20.837905+0000","last_became_peered":"2024-03-04T12:20:20.837905+0000","last_unstale":"2024-03-04T13:13:46.292561+0000","last_undegraded":"2024-03-04T13:13:46.292561+0000","last_fullsized":"2024-03-04T13:13:46.292561+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'80","last_scrub_stamp":"2024-03-04T13:13:46.292461+0000","last_deep_scrub":"255'80","last_deep_scrub_stamp":"2024-03-04T13:13:46.292461+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.292461+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:05:22.285515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":92,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.224938+0000","last_change":"2024-03-04T13:13:39.224970+0000","last_active":"2024-03-04T13:13:39.224938+0000","last_peered":"2024-03-04T13:13:39.224938+0000","last_clean":"2024-03-04T13:13:39.224938+0000","last_became_active":"2024-03-04T12:20:22.848773+0000","last_became_peered":"2024-03-04T12:20:22.848773+0000","last_unstale":"2024-03-04T13:13:39.224938+0000","last_undegraded":"2024-03-04T13:13:39.224938+0000","last_fullsized":"2024-03-04T13:13:39.224938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:39.224844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:39.224844+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.224844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:01:57.050536+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"255'120","reported_seq":620,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.882743+0000","last_change":"2024-03-04T13:13:33.882777+0000","last_active":"2024-03-04T13:13:33.882743+0000","last_peered":"2024-03-04T13:13:33.882743+0000","last_clean":"2024-03-04T13:13:33.882743+0000","last_became_active":"2024-03-04T12:20:24.868746+0000","last_became_peered":"2024-03-04T12:20:24.868746+0000","last_unstale":"2024-03-04T13:13:33.882743+0000","last_undegraded":"2024-03-04T13:13:33.882743+0000","last_fullsized":"2024-03-04T13:13:33.882743+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'120","last_scrub_stamp":"2024-03-04T13:13:33.882663+0000","last_deep_scrub":"255'120","last_deep_scrub_stamp":"2024-03-04T13:13:33.882663+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.882663+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:25.145935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":148,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"255'392","reported_seq":1893,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:55.762490+0000","last_change":"2024-03-04T13:13:55.762525+0000","last_active":"2024-03-04T13:13:55.762490+0000","last_peered":"2024-03-04T13:13:55.762490+0000","last_clean":"2024-03-04T13:13:55.762490+0000","last_became_active":"2024-03-04T12:20:16.829641+0000","last_became_peered":"2024-03-04T12:20:16.829641+0000","last_unstale":"2024-03-04T13:13:55.762490+0000","last_undegraded":"2024-03-04T13:13:55.762490+0000","last_fullsized":"2024-03-04T13:13:55.762490+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'392","last_scrub_stamp":"2024-03-04T13:13:55.762380+0000","last_deep_scrub":"255'392","last_deep_scrub_stamp":"2024-03-04T13:13:55.762380+0000","last_clean_scrub_stamp":"2024-03-04T13:13:55.762380+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:52:43.784728+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2147,"num_read_kb":2039,"num_write":462,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":238,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"255'149","reported_seq":773,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:04.700467+0000","last_change":"2024-03-04T13:14:04.700527+0000","last_active":"2024-03-04T13:14:04.700467+0000","last_peered":"2024-03-04T13:14:04.700467+0000","last_clean":"2024-03-04T13:14:04.700467+0000","last_became_active":"2024-03-04T12:20:14.817556+0000","last_became_peered":"2024-03-04T12:20:14.817556+0000","last_unstale":"2024-03-04T13:14:04.700467+0000","last_undegraded":"2024-03-04T13:14:04.700467+0000","last_fullsized":"2024-03-04T13:14:04.700467+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'149","last_scrub_stamp":"2024-03-04T13:14:04.700365+0000","last_deep_scrub":"255'149","last_deep_scrub_stamp":"2024-03-04T13:14:04.700365+0000","last_clean_scrub_stamp":"2024-03-04T13:14:04.700365+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:27:59.660187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524480,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":366,"num_read_kb":1564,"num_write":822,"num_write_kb":17292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:04.878289+0000","last_change":"2024-03-04T13:14:04.878314+0000","last_active":"2024-03-04T13:14:04.878289+0000","last_peered":"2024-03-04T13:14:04.878289+0000","last_clean":"2024-03-04T13:14:04.878289+0000","last_became_active":"2024-03-04T12:20:18.835760+0000","last_became_peered":"2024-03-04T12:20:18.835760+0000","last_unstale":"2024-03-04T13:14:04.878289+0000","last_undegraded":"2024-03-04T13:14:04.878289+0000","last_fullsized":"2024-03-04T13:14:04.878289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:04.878198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:04.878198+0000","last_clean_scrub_stamp":"2024-03-04T13:14:04.878198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:33:59.711394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"255'119","reported_seq":654,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.035113+0000","last_change":"2024-03-04T13:13:34.035113+0000","last_active":"2024-03-04T13:13:34.035113+0000","last_peered":"2024-03-04T13:13:34.035113+0000","last_clean":"2024-03-04T13:13:34.035113+0000","last_became_active":"2024-03-04T12:20:20.838094+0000","last_became_peered":"2024-03-04T12:20:20.838094+0000","last_unstale":"2024-03-04T13:13:34.035113+0000","last_undegraded":"2024-03-04T13:13:34.035113+0000","last_fullsized":"2024-03-04T13:13:34.035113+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'119","last_scrub_stamp":"2024-03-04T13:13:34.034984+0000","last_deep_scrub":"255'119","last_deep_scrub_stamp":"2024-03-04T13:13:34.034984+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.034984+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:32:21.314242+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":129,"num_write":92,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"255'502","reported_seq":1939,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.473406+0000","last_change":"2024-03-04T13:13:42.473432+0000","last_active":"2024-03-04T13:13:42.473406+0000","last_peered":"2024-03-04T13:13:42.473406+0000","last_clean":"2024-03-04T13:13:42.473406+0000","last_became_active":"2024-03-04T12:20:22.851062+0000","last_became_peered":"2024-03-04T12:20:22.851062+0000","last_unstale":"2024-03-04T13:13:42.473406+0000","last_undegraded":"2024-03-04T13:13:42.473406+0000","last_fullsized":"2024-03-04T13:13:42.473406+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'502","last_scrub_stamp":"2024-03-04T13:13:42.473290+0000","last_deep_scrub":"255'502","last_deep_scrub_stamp":"2024-03-04T13:13:42.473290+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.473290+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:04:59.380321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"255'139","reported_seq":626,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.108679+0000","last_change":"2024-03-04T13:13:31.108749+0000","last_active":"2024-03-04T13:13:31.108679+0000","last_peered":"2024-03-04T13:13:31.108679+0000","last_clean":"2024-03-04T13:13:31.108679+0000","last_became_active":"2024-03-04T12:20:24.912068+0000","last_became_peered":"2024-03-04T12:20:24.912068+0000","last_unstale":"2024-03-04T13:13:31.108679+0000","last_undegraded":"2024-03-04T13:13:31.108679+0000","last_fullsized":"2024-03-04T13:13:31.108679+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'139","last_scrub_stamp":"2024-03-04T13:13:31.108574+0000","last_deep_scrub":"255'139","last_deep_scrub_stamp":"2024-03-04T13:13:31.108574+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.108574+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:11:53.333608+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":66,"num_write":291,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":168,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"255'857","reported_seq":2547,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:57.892285+0000","last_change":"2024-03-04T13:13:57.892339+0000","last_active":"2024-03-04T13:13:57.892285+0000","last_peered":"2024-03-04T13:13:57.892285+0000","last_clean":"2024-03-04T13:13:57.892285+0000","last_became_active":"2024-03-04T12:20:16.831039+0000","last_became_peered":"2024-03-04T12:20:16.831039+0000","last_unstale":"2024-03-04T13:13:57.892285+0000","last_undegraded":"2024-03-04T13:13:57.892285+0000","last_fullsized":"2024-03-04T13:13:57.892285+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'857","last_scrub_stamp":"2024-03-04T13:13:57.892181+0000","last_deep_scrub":"255'857","last_deep_scrub_stamp":"2024-03-04T13:13:57.892181+0000","last_clean_scrub_stamp":"2024-03-04T13:13:57.892181+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:28:12.998142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4009,"num_read_kb":3592,"num_write":1144,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2632,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"255'201","reported_seq":814,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:54.770431+0000","last_change":"2024-03-04T13:13:54.770431+0000","last_active":"2024-03-04T13:13:54.770431+0000","last_peered":"2024-03-04T13:13:54.770431+0000","last_clean":"2024-03-04T13:13:54.770431+0000","last_became_active":"2024-03-04T12:20:14.817863+0000","last_became_peered":"2024-03-04T12:20:14.817863+0000","last_unstale":"2024-03-04T13:13:54.770431+0000","last_undegraded":"2024-03-04T13:13:54.770431+0000","last_fullsized":"2024-03-04T13:13:54.770431+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'201","last_scrub_stamp":"2024-03-04T13:13:54.770251+0000","last_deep_scrub":"255'201","last_deep_scrub_stamp":"2024-03-04T13:13:54.770251+0000","last_clean_scrub_stamp":"2024-03-04T13:13:54.770251+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:40:56.709393+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9161812,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":19635,"num_write":1198,"num_write_kb":36958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"255'5","reported_seq":803,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:55.458309+0000","last_change":"2024-03-04T13:13:55.458358+0000","last_active":"2024-03-04T13:13:55.458309+0000","last_peered":"2024-03-04T13:13:55.458309+0000","last_clean":"2024-03-04T13:13:55.458309+0000","last_became_active":"2024-03-04T12:20:18.838266+0000","last_became_peered":"2024-03-04T12:20:18.838266+0000","last_unstale":"2024-03-04T13:13:55.458309+0000","last_undegraded":"2024-03-04T13:13:55.458309+0000","last_fullsized":"2024-03-04T13:13:55.458309+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'5","last_scrub_stamp":"2024-03-04T13:13:55.458201+0000","last_deep_scrub":"255'5","last_deep_scrub_stamp":"2024-03-04T13:13:55.458201+0000","last_clean_scrub_stamp":"2024-03-04T13:13:55.458201+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:07:49.141171+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":469,"num_read_kb":466,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"255'133","reported_seq":707,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.555514+0000","last_change":"2024-03-04T13:13:45.555549+0000","last_active":"2024-03-04T13:13:45.555514+0000","last_peered":"2024-03-04T13:13:45.555514+0000","last_clean":"2024-03-04T13:13:45.555514+0000","last_became_active":"2024-03-04T12:20:21.643542+0000","last_became_peered":"2024-03-04T12:20:21.643542+0000","last_unstale":"2024-03-04T13:13:45.555514+0000","last_undegraded":"2024-03-04T13:13:45.555514+0000","last_fullsized":"2024-03-04T13:13:45.555514+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'133","last_scrub_stamp":"2024-03-04T13:13:45.555419+0000","last_deep_scrub":"255'133","last_deep_scrub_stamp":"2024-03-04T13:13:45.555419+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.555419+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:57:31.107185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9148,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":181,"num_read_kb":265,"num_write":100,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"255'530","reported_seq":1922,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.874327+0000","last_change":"2024-03-04T13:13:45.874327+0000","last_active":"2024-03-04T13:13:45.874327+0000","last_peered":"2024-03-04T13:13:45.874327+0000","last_clean":"2024-03-04T13:13:45.874327+0000","last_became_active":"2024-03-04T12:20:22.858575+0000","last_became_peered":"2024-03-04T12:20:22.858575+0000","last_unstale":"2024-03-04T13:13:45.874327+0000","last_undegraded":"2024-03-04T13:13:45.874327+0000","last_fullsized":"2024-03-04T13:13:45.874327+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'530","last_scrub_stamp":"2024-03-04T13:13:45.874162+0000","last_deep_scrub":"255'530","last_deep_scrub_stamp":"2024-03-04T13:13:45.874162+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.874162+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:31:41.473943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"255'392","reported_seq":1807,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.417063+0000","last_change":"2024-03-04T13:13:45.417063+0000","last_active":"2024-03-04T13:13:45.417063+0000","last_peered":"2024-03-04T13:13:45.417063+0000","last_clean":"2024-03-04T13:13:45.417063+0000","last_became_active":"2024-03-04T12:20:16.830531+0000","last_became_peered":"2024-03-04T12:20:16.830531+0000","last_unstale":"2024-03-04T13:13:45.417063+0000","last_undegraded":"2024-03-04T13:13:45.417063+0000","last_fullsized":"2024-03-04T13:13:45.417063+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'392","last_scrub_stamp":"2024-03-04T13:13:45.416932+0000","last_deep_scrub":"255'392","last_deep_scrub_stamp":"2024-03-04T13:13:45.416932+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.416932+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:55:36.780667+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2065,"num_write":498,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"255'177","reported_seq":862,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:02.710623+0000","last_change":"2024-03-04T13:14:02.710623+0000","last_active":"2024-03-04T13:14:02.710623+0000","last_peered":"2024-03-04T13:14:02.710623+0000","last_clean":"2024-03-04T13:14:02.710623+0000","last_became_active":"2024-03-04T12:20:14.818441+0000","last_became_peered":"2024-03-04T12:20:14.818441+0000","last_unstale":"2024-03-04T13:14:02.710623+0000","last_undegraded":"2024-03-04T13:14:02.710623+0000","last_fullsized":"2024-03-04T13:14:02.710623+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'177","last_scrub_stamp":"2024-03-04T13:14:02.710488+0000","last_deep_scrub":"255'177","last_deep_scrub_stamp":"2024-03-04T13:14:02.710488+0000","last_clean_scrub_stamp":"2024-03-04T13:14:02.710488+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:46:46.232644+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10526962,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":524,"num_read_kb":158242,"num_write":986,"num_write_kb":38243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":501,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:57.659087+0000","last_change":"2024-03-04T13:13:57.659109+0000","last_active":"2024-03-04T13:13:57.659087+0000","last_peered":"2024-03-04T13:13:57.659087+0000","last_clean":"2024-03-04T13:13:57.659087+0000","last_became_active":"2024-03-04T12:20:18.832349+0000","last_became_peered":"2024-03-04T12:20:18.832349+0000","last_unstale":"2024-03-04T13:13:57.659087+0000","last_undegraded":"2024-03-04T13:13:57.659087+0000","last_fullsized":"2024-03-04T13:13:57.659087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:57.658995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:57.658995+0000","last_clean_scrub_stamp":"2024-03-04T13:13:57.658995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:10:31.370107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"255'225","reported_seq":838,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.354424+0000","last_change":"2024-03-04T13:13:42.354509+0000","last_active":"2024-03-04T13:13:42.354424+0000","last_peered":"2024-03-04T13:13:42.354424+0000","last_clean":"2024-03-04T13:13:42.354424+0000","last_became_active":"2024-03-04T12:20:21.641749+0000","last_became_peered":"2024-03-04T12:20:21.641749+0000","last_unstale":"2024-03-04T13:13:42.354424+0000","last_undegraded":"2024-03-04T13:13:42.354424+0000","last_fullsized":"2024-03-04T13:13:42.354424+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'225","last_scrub_stamp":"2024-03-04T13:13:42.354322+0000","last_deep_scrub":"255'225","last_deep_scrub_stamp":"2024-03-04T13:13:42.354322+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.354322+0000","objects_scrubbed":9,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:02:03.360542+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6571,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":304,"num_read_kb":381,"num_write":178,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:55.655745+0000","last_change":"2024-03-04T13:13:55.655745+0000","last_active":"2024-03-04T13:13:55.655745+0000","last_peered":"2024-03-04T13:13:55.655745+0000","last_clean":"2024-03-04T13:13:55.655745+0000","last_became_active":"2024-03-04T12:20:22.852612+0000","last_became_peered":"2024-03-04T12:20:22.852612+0000","last_unstale":"2024-03-04T13:13:55.655745+0000","last_undegraded":"2024-03-04T13:13:55.655745+0000","last_fullsized":"2024-03-04T13:13:55.655745+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:55.655577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:55.655577+0000","last_clean_scrub_stamp":"2024-03-04T13:13:55.655577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:05:35.729959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"255'524","reported_seq":1326,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.257848+0000","last_change":"2024-03-04T13:13:33.257881+0000","last_active":"2024-03-04T13:13:33.257848+0000","last_peered":"2024-03-04T13:13:33.257848+0000","last_clean":"2024-03-04T13:13:33.257848+0000","last_became_active":"2024-03-04T12:20:24.869409+0000","last_became_peered":"2024-03-04T12:20:24.869409+0000","last_unstale":"2024-03-04T13:13:33.257848+0000","last_undegraded":"2024-03-04T13:13:33.257848+0000","last_fullsized":"2024-03-04T13:13:33.257848+0000","mapping_epoch":30,"log_start":"255'500","ondisk_log_start":"255'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'524","last_scrub_stamp":"2024-03-04T13:13:33.257751+0000","last_deep_scrub":"255'524","last_deep_scrub_stamp":"2024-03-04T13:13:33.257751+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.257751+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:54:38.905328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1237,"num_read_kb":1237,"num_write":1069,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"255'317","reported_seq":1794,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:48.295802+0000","last_change":"2024-03-04T13:13:48.295802+0000","last_active":"2024-03-04T13:13:48.295802+0000","last_peered":"2024-03-04T13:13:48.295802+0000","last_clean":"2024-03-04T13:13:48.295802+0000","last_became_active":"2024-03-04T12:20:16.826183+0000","last_became_peered":"2024-03-04T12:20:16.826183+0000","last_unstale":"2024-03-04T13:13:48.295802+0000","last_undegraded":"2024-03-04T13:13:48.295802+0000","last_fullsized":"2024-03-04T13:13:48.295802+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'317","last_scrub_stamp":"2024-03-04T13:13:48.295675+0000","last_deep_scrub":"255'317","last_deep_scrub_stamp":"2024-03-04T13:13:48.295675+0000","last_clean_scrub_stamp":"2024-03-04T13:13:48.295675+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:16:22.702685+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2023,"num_read_kb":1945,"num_write":353,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2156,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"255'180","reported_seq":820,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:00.709404+0000","last_change":"2024-03-04T13:14:00.709404+0000","last_active":"2024-03-04T13:14:00.709404+0000","last_peered":"2024-03-04T13:14:00.709404+0000","last_clean":"2024-03-04T13:14:00.709404+0000","last_became_active":"2024-03-04T12:20:14.819389+0000","last_became_peered":"2024-03-04T12:20:14.819389+0000","last_unstale":"2024-03-04T13:14:00.709404+0000","last_undegraded":"2024-03-04T13:14:00.709404+0000","last_fullsized":"2024-03-04T13:14:00.709404+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'180","last_scrub_stamp":"2024-03-04T13:14:00.709243+0000","last_deep_scrub":"255'180","last_deep_scrub_stamp":"2024-03-04T13:14:00.709243+0000","last_clean_scrub_stamp":"2024-03-04T13:14:00.709243+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:34:50.567892+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":382,"num_read_kb":37991,"num_write":1066,"num_write_kb":16641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":495,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.162022+0000","last_change":"2024-03-04T13:13:40.162043+0000","last_active":"2024-03-04T13:13:40.162022+0000","last_peered":"2024-03-04T13:13:40.162022+0000","last_clean":"2024-03-04T13:13:40.162022+0000","last_became_active":"2024-03-04T12:20:18.834619+0000","last_became_peered":"2024-03-04T12:20:18.834619+0000","last_unstale":"2024-03-04T13:13:40.162022+0000","last_undegraded":"2024-03-04T13:13:40.162022+0000","last_fullsized":"2024-03-04T13:13:40.162022+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.161921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.161921+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.161921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:33:50.976546+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"255'133","reported_seq":698,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:53.932360+0000","last_change":"2024-03-04T13:13:53.932360+0000","last_active":"2024-03-04T13:13:53.932360+0000","last_peered":"2024-03-04T13:13:53.932360+0000","last_clean":"2024-03-04T13:13:53.932360+0000","last_became_active":"2024-03-04T12:20:20.843195+0000","last_became_peered":"2024-03-04T12:20:20.843195+0000","last_unstale":"2024-03-04T13:13:53.932360+0000","last_undegraded":"2024-03-04T13:13:53.932360+0000","last_fullsized":"2024-03-04T13:13:53.932360+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'133","last_scrub_stamp":"2024-03-04T13:13:53.932233+0000","last_deep_scrub":"255'133","last_deep_scrub_stamp":"2024-03-04T13:13:53.932233+0000","last_clean_scrub_stamp":"2024-03-04T13:13:53.932233+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:42:10.745700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6278,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":216,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":483,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.818122+0000","last_change":"2024-03-04T13:13:43.818146+0000","last_active":"2024-03-04T13:13:43.818122+0000","last_peered":"2024-03-04T13:13:43.818122+0000","last_clean":"2024-03-04T13:13:43.818122+0000","last_became_active":"2024-03-04T12:20:22.858722+0000","last_became_peered":"2024-03-04T12:20:22.858722+0000","last_unstale":"2024-03-04T13:13:43.818122+0000","last_undegraded":"2024-03-04T13:13:43.818122+0000","last_fullsized":"2024-03-04T13:13:43.818122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:43.818034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:43.818034+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.818034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:06:19.231882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"255'183","reported_seq":713,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:00.822345+0000","last_change":"2024-03-04T13:14:00.822382+0000","last_active":"2024-03-04T13:14:00.822345+0000","last_peered":"2024-03-04T13:14:00.822345+0000","last_clean":"2024-03-04T13:14:00.822345+0000","last_became_active":"2024-03-04T12:20:24.869152+0000","last_became_peered":"2024-03-04T12:20:24.869152+0000","last_unstale":"2024-03-04T13:14:00.822345+0000","last_undegraded":"2024-03-04T13:14:00.822345+0000","last_fullsized":"2024-03-04T13:14:00.822345+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'183","last_scrub_stamp":"2024-03-04T13:14:00.822257+0000","last_deep_scrub":"255'183","last_deep_scrub_stamp":"2024-03-04T13:14:00.822257+0000","last_clean_scrub_stamp":"2024-03-04T13:14:00.822257+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:07:28.956656+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":286,"num_read_kb":243,"num_write":358,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"255'1227","reported_seq":2778,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.731782+0000","last_change":"2024-03-04T13:13:43.731818+0000","last_active":"2024-03-04T13:13:43.731782+0000","last_peered":"2024-03-04T13:13:43.731782+0000","last_clean":"2024-03-04T13:13:43.731782+0000","last_became_active":"2024-03-04T12:20:16.826172+0000","last_became_peered":"2024-03-04T12:20:16.826172+0000","last_unstale":"2024-03-04T13:13:43.731782+0000","last_undegraded":"2024-03-04T13:13:43.731782+0000","last_fullsized":"2024-03-04T13:13:43.731782+0000","mapping_epoch":22,"log_start":"255'1200","ondisk_log_start":"255'1200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1227","last_scrub_stamp":"2024-03-04T13:13:43.731679+0000","last_deep_scrub":"255'1227","last_deep_scrub_stamp":"2024-03-04T13:13:43.731679+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.731679+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:47:03.032710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5093,"num_read_kb":4391,"num_write":1710,"num_write_kb":736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"255'183","reported_seq":852,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:54.676850+0000","last_change":"2024-03-04T13:13:54.676850+0000","last_active":"2024-03-04T13:13:54.676850+0000","last_peered":"2024-03-04T13:13:54.676850+0000","last_clean":"2024-03-04T13:13:54.676850+0000","last_became_active":"2024-03-04T12:20:14.828250+0000","last_became_peered":"2024-03-04T12:20:14.828250+0000","last_unstale":"2024-03-04T13:13:54.676850+0000","last_undegraded":"2024-03-04T13:13:54.676850+0000","last_fullsized":"2024-03-04T13:13:54.676850+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'183","last_scrub_stamp":"2024-03-04T13:13:54.676648+0000","last_deep_scrub":"255'183","last_deep_scrub_stamp":"2024-03-04T13:13:54.676648+0000","last_clean_scrub_stamp":"2024-03-04T13:13:54.676648+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:21:55.952257+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22063,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":10895,"num_write":937,"num_write_kb":21474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":495,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.120329+0000","last_change":"2024-03-04T13:13:38.120329+0000","last_active":"2024-03-04T13:13:38.120329+0000","last_peered":"2024-03-04T13:13:38.120329+0000","last_clean":"2024-03-04T13:13:38.120329+0000","last_became_active":"2024-03-04T12:20:18.834897+0000","last_became_peered":"2024-03-04T12:20:18.834897+0000","last_unstale":"2024-03-04T13:13:38.120329+0000","last_undegraded":"2024-03-04T13:13:38.120329+0000","last_fullsized":"2024-03-04T13:13:38.120329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:38.120219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:38.120219+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.120219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:28:32.193662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"255'169","reported_seq":762,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:13.610630+0000","last_change":"2024-03-04T13:14:13.610683+0000","last_active":"2024-03-04T13:14:13.610630+0000","last_peered":"2024-03-04T13:14:13.610630+0000","last_clean":"2024-03-04T13:14:13.610630+0000","last_became_active":"2024-03-04T12:20:20.839295+0000","last_became_peered":"2024-03-04T12:20:20.839295+0000","last_unstale":"2024-03-04T13:14:13.610630+0000","last_undegraded":"2024-03-04T13:14:13.610630+0000","last_fullsized":"2024-03-04T13:14:13.610630+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'169","last_scrub_stamp":"2024-03-04T13:14:13.610535+0000","last_deep_scrub":"255'169","last_deep_scrub_stamp":"2024-03-04T13:14:13.610535+0000","last_clean_scrub_stamp":"2024-03-04T13:14:13.610535+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:19:17.385765+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":221,"num_read_kb":283,"num_write":122,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"255'515","reported_seq":1905,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.842588+0000","last_change":"2024-03-04T13:13:45.842618+0000","last_active":"2024-03-04T13:13:45.842588+0000","last_peered":"2024-03-04T13:13:45.842588+0000","last_clean":"2024-03-04T13:13:45.842588+0000","last_became_active":"2024-03-04T12:20:22.852529+0000","last_became_peered":"2024-03-04T12:20:22.852529+0000","last_unstale":"2024-03-04T13:13:45.842588+0000","last_undegraded":"2024-03-04T13:13:45.842588+0000","last_fullsized":"2024-03-04T13:13:45.842588+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'515","last_scrub_stamp":"2024-03-04T13:13:45.842495+0000","last_deep_scrub":"255'515","last_deep_scrub_stamp":"2024-03-04T13:13:45.842495+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.842495+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:43:13.885952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"255'111","reported_seq":588,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.846625+0000","last_change":"2024-03-04T13:13:36.846656+0000","last_active":"2024-03-04T13:13:36.846625+0000","last_peered":"2024-03-04T13:13:36.846625+0000","last_clean":"2024-03-04T13:13:36.846625+0000","last_became_active":"2024-03-04T12:20:24.868076+0000","last_became_peered":"2024-03-04T12:20:24.868076+0000","last_unstale":"2024-03-04T13:13:36.846625+0000","last_undegraded":"2024-03-04T13:13:36.846625+0000","last_fullsized":"2024-03-04T13:13:36.846625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'111","last_scrub_stamp":"2024-03-04T13:13:36.846535+0000","last_deep_scrub":"255'111","last_deep_scrub_stamp":"2024-03-04T13:13:36.846535+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.846535+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:04:16.784713+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"255'364","reported_seq":1771,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:57.855979+0000","last_change":"2024-03-04T13:13:57.855979+0000","last_active":"2024-03-04T13:13:57.855979+0000","last_peered":"2024-03-04T13:13:57.855979+0000","last_clean":"2024-03-04T13:13:57.855979+0000","last_became_active":"2024-03-04T12:20:16.828738+0000","last_became_peered":"2024-03-04T12:20:16.828738+0000","last_unstale":"2024-03-04T13:13:57.855979+0000","last_undegraded":"2024-03-04T13:13:57.855979+0000","last_fullsized":"2024-03-04T13:13:57.855979+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'364","last_scrub_stamp":"2024-03-04T13:13:57.855799+0000","last_deep_scrub":"255'364","last_deep_scrub_stamp":"2024-03-04T13:13:57.855799+0000","last_clean_scrub_stamp":"2024-03-04T13:13:57.855799+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:44:40.462438+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1878,"num_read_kb":1794,"num_write":404,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"255'284","reported_seq":1021,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:07.538899+0000","last_change":"2024-03-04T13:14:07.538899+0000","last_active":"2024-03-04T13:14:07.538899+0000","last_peered":"2024-03-04T13:14:07.538899+0000","last_clean":"2024-03-04T13:14:07.538899+0000","last_became_active":"2024-03-04T12:20:14.824192+0000","last_became_peered":"2024-03-04T12:20:14.824192+0000","last_unstale":"2024-03-04T13:14:07.538899+0000","last_undegraded":"2024-03-04T13:14:07.538899+0000","last_fullsized":"2024-03-04T13:14:07.538899+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'284","last_scrub_stamp":"2024-03-04T13:14:07.538696+0000","last_deep_scrub":"255'284","last_deep_scrub_stamp":"2024-03-04T13:14:07.538696+0000","last_clean_scrub_stamp":"2024-03-04T13:14:07.538696+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:20:08.841699+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389055,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":790,"num_read_kb":21513,"num_write":1394,"num_write_kb":41658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":495,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.156608+0000","last_change":"2024-03-04T13:13:42.156653+0000","last_active":"2024-03-04T13:13:42.156608+0000","last_peered":"2024-03-04T13:13:42.156608+0000","last_clean":"2024-03-04T13:13:42.156608+0000","last_became_active":"2024-03-04T12:20:18.832483+0000","last_became_peered":"2024-03-04T12:20:18.832483+0000","last_unstale":"2024-03-04T13:13:42.156608+0000","last_undegraded":"2024-03-04T13:13:42.156608+0000","last_fullsized":"2024-03-04T13:13:42.156608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:42.156508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:42.156508+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.156508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:17.833533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"255'196","reported_seq":819,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:51.792179+0000","last_change":"2024-03-04T13:13:51.792222+0000","last_active":"2024-03-04T13:13:51.792179+0000","last_peered":"2024-03-04T13:13:51.792179+0000","last_clean":"2024-03-04T13:13:51.792179+0000","last_became_active":"2024-03-04T12:20:20.837748+0000","last_became_peered":"2024-03-04T12:20:20.837748+0000","last_unstale":"2024-03-04T13:13:51.792179+0000","last_undegraded":"2024-03-04T13:13:51.792179+0000","last_fullsized":"2024-03-04T13:13:51.792179+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'196","last_scrub_stamp":"2024-03-04T13:13:51.792082+0000","last_deep_scrub":"255'196","last_deep_scrub_stamp":"2024-03-04T13:13:51.792082+0000","last_clean_scrub_stamp":"2024-03-04T13:13:51.792082+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:41:44.458537+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13702,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":270,"num_read_kb":346,"num_write":130,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:30.133564+0000","last_change":"2024-03-04T13:13:30.133607+0000","last_active":"2024-03-04T13:13:30.133564+0000","last_peered":"2024-03-04T13:13:30.133564+0000","last_clean":"2024-03-04T13:13:30.133564+0000","last_became_active":"2024-03-04T12:20:22.849784+0000","last_became_peered":"2024-03-04T12:20:22.849784+0000","last_unstale":"2024-03-04T13:13:30.133564+0000","last_undegraded":"2024-03-04T13:13:30.133564+0000","last_fullsized":"2024-03-04T13:13:30.133564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:30.133463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:30.133463+0000","last_clean_scrub_stamp":"2024-03-04T13:13:30.133463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:20:55.533934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"255'100","reported_seq":618,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.759279+0000","last_change":"2024-03-04T13:13:38.759326+0000","last_active":"2024-03-04T13:13:38.759279+0000","last_peered":"2024-03-04T13:13:38.759279+0000","last_clean":"2024-03-04T13:13:38.759279+0000","last_became_active":"2024-03-04T12:20:24.864820+0000","last_became_peered":"2024-03-04T12:20:24.864820+0000","last_unstale":"2024-03-04T13:13:38.759279+0000","last_undegraded":"2024-03-04T13:13:38.759279+0000","last_fullsized":"2024-03-04T13:13:38.759279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'100","last_scrub_stamp":"2024-03-04T13:13:38.759166+0000","last_deep_scrub":"255'100","last_deep_scrub_stamp":"2024-03-04T13:13:38.759166+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.759166+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:12.515390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":165,"num_write":238,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"255'1124","reported_seq":2636,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:55.193418+0000","last_change":"2024-03-04T13:13:55.193418+0000","last_active":"2024-03-04T13:13:55.193418+0000","last_peered":"2024-03-04T13:13:55.193418+0000","last_clean":"2024-03-04T13:13:55.193418+0000","last_became_active":"2024-03-04T12:20:16.828486+0000","last_became_peered":"2024-03-04T12:20:16.828486+0000","last_unstale":"2024-03-04T13:13:55.193418+0000","last_undegraded":"2024-03-04T13:13:55.193418+0000","last_fullsized":"2024-03-04T13:13:55.193418+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1124","last_scrub_stamp":"2024-03-04T13:13:55.193291+0000","last_deep_scrub":"255'1124","last_deep_scrub_stamp":"2024-03-04T13:13:55.193291+0000","last_clean_scrub_stamp":"2024-03-04T13:13:55.193291+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":1100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:46:12.654903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4686,"num_read_kb":4085,"num_write":1549,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"255'245","reported_seq":890,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:13.941659+0000","last_change":"2024-03-04T13:14:13.941659+0000","last_active":"2024-03-04T13:14:13.941659+0000","last_peered":"2024-03-04T13:14:13.941659+0000","last_clean":"2024-03-04T13:14:13.941659+0000","last_became_active":"2024-03-04T12:20:14.816412+0000","last_became_peered":"2024-03-04T12:20:14.816412+0000","last_unstale":"2024-03-04T13:14:13.941659+0000","last_undegraded":"2024-03-04T13:14:13.941659+0000","last_fullsized":"2024-03-04T13:14:13.941659+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'245","last_scrub_stamp":"2024-03-04T13:14:13.941530+0000","last_deep_scrub":"255'245","last_deep_scrub_stamp":"2024-03-04T13:14:13.941530+0000","last_clean_scrub_stamp":"2024-03-04T13:14:13.941530+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:40:11.044154+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399147,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":515,"num_read_kb":1880,"num_write":1395,"num_write_kb":20590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":495,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.165023+0000","last_change":"2024-03-04T13:13:44.165023+0000","last_active":"2024-03-04T13:13:44.165023+0000","last_peered":"2024-03-04T13:13:44.165023+0000","last_clean":"2024-03-04T13:13:44.165023+0000","last_became_active":"2024-03-04T12:20:18.830763+0000","last_became_peered":"2024-03-04T12:20:18.830763+0000","last_unstale":"2024-03-04T13:13:44.165023+0000","last_undegraded":"2024-03-04T13:13:44.165023+0000","last_fullsized":"2024-03-04T13:13:44.165023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:44.164911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:44.164911+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.164911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:03:15.010672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"255'161","reported_seq":740,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.316350+0000","last_change":"2024-03-04T13:13:43.316350+0000","last_active":"2024-03-04T13:13:43.316350+0000","last_peered":"2024-03-04T13:13:43.316350+0000","last_clean":"2024-03-04T13:13:43.316350+0000","last_became_active":"2024-03-04T12:20:20.842216+0000","last_became_peered":"2024-03-04T12:20:20.842216+0000","last_unstale":"2024-03-04T13:13:43.316350+0000","last_undegraded":"2024-03-04T13:13:43.316350+0000","last_fullsized":"2024-03-04T13:13:43.316350+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'161","last_scrub_stamp":"2024-03-04T13:13:43.316208+0000","last_deep_scrub":"255'161","last_deep_scrub_stamp":"2024-03-04T13:13:43.316208+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.316208+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:40:50.582624+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7566,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":219,"num_read_kb":283,"num_write":166,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.836017+0000","last_change":"2024-03-04T13:13:43.836017+0000","last_active":"2024-03-04T13:13:43.836017+0000","last_peered":"2024-03-04T13:13:43.836017+0000","last_clean":"2024-03-04T13:13:43.836017+0000","last_became_active":"2024-03-04T12:20:22.855480+0000","last_became_peered":"2024-03-04T12:20:22.855480+0000","last_unstale":"2024-03-04T13:13:43.836017+0000","last_undegraded":"2024-03-04T13:13:43.836017+0000","last_fullsized":"2024-03-04T13:13:43.836017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:43.835903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:43.835903+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.835903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:52:33.201007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"255'90","reported_seq":573,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.877755+0000","last_change":"2024-03-04T13:13:39.877785+0000","last_active":"2024-03-04T13:13:39.877755+0000","last_peered":"2024-03-04T13:13:39.877755+0000","last_clean":"2024-03-04T13:13:39.877755+0000","last_became_active":"2024-03-04T12:20:24.864982+0000","last_became_peered":"2024-03-04T12:20:24.864982+0000","last_unstale":"2024-03-04T13:13:39.877755+0000","last_undegraded":"2024-03-04T13:13:39.877755+0000","last_fullsized":"2024-03-04T13:13:39.877755+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'90","last_scrub_stamp":"2024-03-04T13:13:39.877674+0000","last_deep_scrub":"255'90","last_deep_scrub_stamp":"2024-03-04T13:13:39.877674+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.877674+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:48:00.079117+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":209,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"255'388","reported_seq":1748,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.301955+0000","last_change":"2024-03-04T13:13:47.301955+0000","last_active":"2024-03-04T13:13:47.301955+0000","last_peered":"2024-03-04T13:13:47.301955+0000","last_clean":"2024-03-04T13:13:47.301955+0000","last_became_active":"2024-03-04T12:20:16.824033+0000","last_became_peered":"2024-03-04T12:20:16.824033+0000","last_unstale":"2024-03-04T13:13:47.301955+0000","last_undegraded":"2024-03-04T13:13:47.301955+0000","last_fullsized":"2024-03-04T13:13:47.301955+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'388","last_scrub_stamp":"2024-03-04T13:13:47.301839+0000","last_deep_scrub":"255'388","last_deep_scrub_stamp":"2024-03-04T13:13:47.301839+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.301839+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:10:35.029482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1899,"num_read_kb":1781,"num_write":448,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"255'224","reported_seq":848,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:57.753735+0000","last_change":"2024-03-04T13:13:57.753778+0000","last_active":"2024-03-04T13:13:57.753735+0000","last_peered":"2024-03-04T13:13:57.753735+0000","last_clean":"2024-03-04T13:13:57.753735+0000","last_became_active":"2024-03-04T12:20:14.818461+0000","last_became_peered":"2024-03-04T12:20:14.818461+0000","last_unstale":"2024-03-04T13:13:57.753735+0000","last_undegraded":"2024-03-04T13:13:57.753735+0000","last_fullsized":"2024-03-04T13:13:57.753735+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'224","last_scrub_stamp":"2024-03-04T13:13:57.753636+0000","last_deep_scrub":"255'224","last_deep_scrub_stamp":"2024-03-04T13:13:57.753636+0000","last_clean_scrub_stamp":"2024-03-04T13:13:57.753636+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:15:52.875371+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":446,"num_read_kb":17082,"num_write":1054,"num_write_kb":47848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.702630+0000","last_change":"2024-03-04T13:13:45.702630+0000","last_active":"2024-03-04T13:13:45.702630+0000","last_peered":"2024-03-04T13:13:45.702630+0000","last_clean":"2024-03-04T13:13:45.702630+0000","last_became_active":"2024-03-04T12:20:18.837494+0000","last_became_peered":"2024-03-04T12:20:18.837494+0000","last_unstale":"2024-03-04T13:13:45.702630+0000","last_undegraded":"2024-03-04T13:13:45.702630+0000","last_fullsized":"2024-03-04T13:13:45.702630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:45.702512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:45.702512+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.702512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:28:39.385988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"255'178","reported_seq":765,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.099947+0000","last_change":"2024-03-04T13:13:32.099947+0000","last_active":"2024-03-04T13:13:32.099947+0000","last_peered":"2024-03-04T13:13:32.099947+0000","last_clean":"2024-03-04T13:13:32.099947+0000","last_became_active":"2024-03-04T12:20:20.841801+0000","last_became_peered":"2024-03-04T12:20:20.841801+0000","last_unstale":"2024-03-04T13:13:32.099947+0000","last_undegraded":"2024-03-04T13:13:32.099947+0000","last_fullsized":"2024-03-04T13:13:32.099947+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'178","last_scrub_stamp":"2024-03-04T13:13:32.099796+0000","last_deep_scrub":"255'178","last_deep_scrub_stamp":"2024-03-04T13:13:32.099796+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.099796+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:08:16.653547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7601,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":303,"num_write":134,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"255'492","reported_seq":1895,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:29.133166+0000","last_change":"2024-03-04T13:13:29.133166+0000","last_active":"2024-03-04T13:13:29.133166+0000","last_peered":"2024-03-04T13:13:29.133166+0000","last_clean":"2024-03-04T13:13:29.133166+0000","last_became_active":"2024-03-04T12:20:22.857578+0000","last_became_peered":"2024-03-04T12:20:22.857578+0000","last_unstale":"2024-03-04T13:13:29.133166+0000","last_undegraded":"2024-03-04T13:13:29.133166+0000","last_fullsized":"2024-03-04T13:13:29.133166+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'492","last_scrub_stamp":"2024-03-04T13:13:29.133074+0000","last_deep_scrub":"255'492","last_deep_scrub_stamp":"2024-03-04T13:13:29.133074+0000","last_clean_scrub_stamp":"2024-03-04T13:13:29.133074+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:56:25.680835+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"255'110","reported_seq":601,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.731985+0000","last_change":"2024-03-04T13:13:36.732015+0000","last_active":"2024-03-04T13:13:36.731985+0000","last_peered":"2024-03-04T13:13:36.731985+0000","last_clean":"2024-03-04T13:13:36.731985+0000","last_became_active":"2024-03-04T12:20:24.867482+0000","last_became_peered":"2024-03-04T12:20:24.867482+0000","last_unstale":"2024-03-04T13:13:36.731985+0000","last_undegraded":"2024-03-04T13:13:36.731985+0000","last_fullsized":"2024-03-04T13:13:36.731985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'110","last_scrub_stamp":"2024-03-04T13:13:36.731895+0000","last_deep_scrub":"255'110","last_deep_scrub_stamp":"2024-03-04T13:13:36.731895+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.731895+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:44:42.326028+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":731,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":256,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"255'346","reported_seq":1956,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:08.142823+0000","last_change":"2024-03-04T13:14:08.142823+0000","last_active":"2024-03-04T13:14:08.142823+0000","last_peered":"2024-03-04T13:14:08.142823+0000","last_clean":"2024-03-04T13:14:08.142823+0000","last_became_active":"2024-03-04T12:20:16.818795+0000","last_became_peered":"2024-03-04T12:20:16.818795+0000","last_unstale":"2024-03-04T13:14:08.142823+0000","last_undegraded":"2024-03-04T13:14:08.142823+0000","last_fullsized":"2024-03-04T13:14:08.142823+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'346","last_scrub_stamp":"2024-03-04T13:14:08.142625+0000","last_deep_scrub":"255'346","last_deep_scrub_stamp":"2024-03-04T13:14:08.142625+0000","last_clean_scrub_stamp":"2024-03-04T13:14:08.142625+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:25:23.053511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2162,"num_read_kb":2105,"num_write":376,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2151,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"255'221","reported_seq":850,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:04.118639+0000","last_change":"2024-03-04T13:14:04.118639+0000","last_active":"2024-03-04T13:14:04.118639+0000","last_peered":"2024-03-04T13:14:04.118639+0000","last_clean":"2024-03-04T13:14:04.118639+0000","last_became_active":"2024-03-04T12:20:14.817859+0000","last_became_peered":"2024-03-04T12:20:14.817859+0000","last_unstale":"2024-03-04T13:14:04.118639+0000","last_undegraded":"2024-03-04T13:14:04.118639+0000","last_fullsized":"2024-03-04T13:14:04.118639+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'221","last_scrub_stamp":"2024-03-04T13:14:04.118528+0000","last_deep_scrub":"255'221","last_deep_scrub_stamp":"2024-03-04T13:14:04.118528+0000","last_clean_scrub_stamp":"2024-03-04T13:14:04.118528+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:23:25.440483+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":387,"num_read_kb":14098,"num_write":1105,"num_write_kb":34013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"255'4","reported_seq":1112,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:57.474109+0000","last_change":"2024-03-04T13:13:57.474142+0000","last_active":"2024-03-04T13:13:57.474109+0000","last_peered":"2024-03-04T13:13:57.474109+0000","last_clean":"2024-03-04T13:13:57.474109+0000","last_became_active":"2024-03-04T12:20:18.838389+0000","last_became_peered":"2024-03-04T12:20:18.838389+0000","last_unstale":"2024-03-04T13:13:57.474109+0000","last_undegraded":"2024-03-04T13:13:57.474109+0000","last_fullsized":"2024-03-04T13:13:57.474109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'4","last_scrub_stamp":"2024-03-04T13:13:57.474023+0000","last_deep_scrub":"255'4","last_deep_scrub_stamp":"2024-03-04T13:13:57.474023+0000","last_clean_scrub_stamp":"2024-03-04T13:13:57.474023+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:45:27.824010+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":615,"num_read_kb":615,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"255'106","reported_seq":623,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:50.881301+0000","last_change":"2024-03-04T13:13:50.881301+0000","last_active":"2024-03-04T13:13:50.881301+0000","last_peered":"2024-03-04T13:13:50.881301+0000","last_clean":"2024-03-04T13:13:50.881301+0000","last_became_active":"2024-03-04T12:20:21.641809+0000","last_became_peered":"2024-03-04T12:20:21.641809+0000","last_unstale":"2024-03-04T13:13:50.881301+0000","last_undegraded":"2024-03-04T13:13:50.881301+0000","last_fullsized":"2024-03-04T13:13:50.881301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'106","last_scrub_stamp":"2024-03-04T13:13:50.881190+0000","last_deep_scrub":"255'106","last_deep_scrub_stamp":"2024-03-04T13:13:50.881190+0000","last_clean_scrub_stamp":"2024-03-04T13:13:50.881190+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:10:28.284478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":103,"num_read_kb":92,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"255'498","reported_seq":2288,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.759513+0000","last_change":"2024-03-04T13:13:38.759513+0000","last_active":"2024-03-04T13:13:38.759513+0000","last_peered":"2024-03-04T13:13:38.759513+0000","last_clean":"2024-03-04T13:13:38.759513+0000","last_became_active":"2024-03-04T12:20:22.849288+0000","last_became_peered":"2024-03-04T12:20:22.849288+0000","last_unstale":"2024-03-04T13:13:38.759513+0000","last_undegraded":"2024-03-04T13:13:38.759513+0000","last_fullsized":"2024-03-04T13:13:38.759513+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'498","last_scrub_stamp":"2024-03-04T13:13:38.759380+0000","last_deep_scrub":"255'498","last_deep_scrub_stamp":"2024-03-04T13:13:38.759380+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.759380+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:44:22.451253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"255'88","reported_seq":581,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.175491+0000","last_change":"2024-03-04T13:13:34.175521+0000","last_active":"2024-03-04T13:13:34.175491+0000","last_peered":"2024-03-04T13:13:34.175491+0000","last_clean":"2024-03-04T13:13:34.175491+0000","last_became_active":"2024-03-04T12:20:24.870568+0000","last_became_peered":"2024-03-04T12:20:24.870568+0000","last_unstale":"2024-03-04T13:13:34.175491+0000","last_undegraded":"2024-03-04T13:13:34.175491+0000","last_fullsized":"2024-03-04T13:13:34.175491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'88","last_scrub_stamp":"2024-03-04T13:13:34.175404+0000","last_deep_scrub":"255'88","last_deep_scrub_stamp":"2024-03-04T13:13:34.175404+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.175404+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:42:46.985410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":82,"num_read_kb":81,"num_write":219,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"255'300","reported_seq":1668,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:48.715892+0000","last_change":"2024-03-04T13:13:48.715892+0000","last_active":"2024-03-04T13:13:48.715892+0000","last_peered":"2024-03-04T13:13:48.715892+0000","last_clean":"2024-03-04T13:13:48.715892+0000","last_became_active":"2024-03-04T12:20:16.831001+0000","last_became_peered":"2024-03-04T12:20:16.831001+0000","last_unstale":"2024-03-04T13:13:48.715892+0000","last_undegraded":"2024-03-04T13:13:48.715892+0000","last_fullsized":"2024-03-04T13:13:48.715892+0000","mapping_epoch":22,"log_start":"255'200","ondisk_log_start":"255'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'300","last_scrub_stamp":"2024-03-04T13:13:48.715709+0000","last_deep_scrub":"255'300","last_deep_scrub_stamp":"2024-03-04T13:13:48.715709+0000","last_clean_scrub_stamp":"2024-03-04T13:13:48.715709+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:48:05.812832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1692,"num_read_kb":1639,"num_write":326,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":303,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"255'205","reported_seq":837,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:11.905350+0000","last_change":"2024-03-04T13:14:11.905350+0000","last_active":"2024-03-04T13:14:11.905350+0000","last_peered":"2024-03-04T13:14:11.905350+0000","last_clean":"2024-03-04T13:14:11.905350+0000","last_became_active":"2024-03-04T12:20:14.812881+0000","last_became_peered":"2024-03-04T12:20:14.812881+0000","last_unstale":"2024-03-04T13:14:11.905350+0000","last_undegraded":"2024-03-04T13:14:11.905350+0000","last_fullsized":"2024-03-04T13:14:11.905350+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'205","last_scrub_stamp":"2024-03-04T13:14:11.905187+0000","last_deep_scrub":"255'205","last_deep_scrub_stamp":"2024-03-04T13:14:11.905187+0000","last_clean_scrub_stamp":"2024-03-04T13:14:11.905187+0000","objects_scrubbed":6,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:46:28.405603+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6401060,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":24185,"num_write":1082,"num_write_kb":42346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:11.131600+0000","last_change":"2024-03-04T13:14:11.131600+0000","last_active":"2024-03-04T13:14:11.131600+0000","last_peered":"2024-03-04T13:14:11.131600+0000","last_clean":"2024-03-04T13:14:11.131600+0000","last_became_active":"2024-03-04T12:20:18.836493+0000","last_became_peered":"2024-03-04T12:20:18.836493+0000","last_unstale":"2024-03-04T13:14:11.131600+0000","last_undegraded":"2024-03-04T13:14:11.131600+0000","last_fullsized":"2024-03-04T13:14:11.131600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:11.131476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:11.131476+0000","last_clean_scrub_stamp":"2024-03-04T13:14:11.131476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:19:23.695953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"255'258","reported_seq":865,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:09.515608+0000","last_change":"2024-03-04T13:14:09.515608+0000","last_active":"2024-03-04T13:14:09.515608+0000","last_peered":"2024-03-04T13:14:09.515608+0000","last_clean":"2024-03-04T13:14:09.515608+0000","last_became_active":"2024-03-04T12:20:20.839079+0000","last_became_peered":"2024-03-04T12:20:20.839079+0000","last_unstale":"2024-03-04T13:14:09.515608+0000","last_undegraded":"2024-03-04T13:14:09.515608+0000","last_fullsized":"2024-03-04T13:14:09.515608+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'258","last_scrub_stamp":"2024-03-04T13:14:09.515456+0000","last_deep_scrub":"255'258","last_deep_scrub_stamp":"2024-03-04T13:14:09.515456+0000","last_clean_scrub_stamp":"2024-03-04T13:14:09.515456+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:00:11.179730+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7172,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":931,"num_read_kb":985,"num_write":1462,"num_write_kb":1319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476558,"num_omap_keys":1106,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.767253+0000","last_change":"2024-03-04T13:13:46.767253+0000","last_active":"2024-03-04T13:13:46.767253+0000","last_peered":"2024-03-04T13:13:46.767253+0000","last_clean":"2024-03-04T13:13:46.767253+0000","last_became_active":"2024-03-04T12:20:22.854860+0000","last_became_peered":"2024-03-04T12:20:22.854860+0000","last_unstale":"2024-03-04T13:13:46.767253+0000","last_undegraded":"2024-03-04T13:13:46.767253+0000","last_fullsized":"2024-03-04T13:13:46.767253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:46.767143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:46.767143+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.767143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:00:22.051997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"255'105","reported_seq":594,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.715961+0000","last_change":"2024-03-04T13:13:37.716009+0000","last_active":"2024-03-04T13:13:37.715961+0000","last_peered":"2024-03-04T13:13:37.715961+0000","last_clean":"2024-03-04T13:13:37.715961+0000","last_became_active":"2024-03-04T12:20:24.865830+0000","last_became_peered":"2024-03-04T12:20:24.865830+0000","last_unstale":"2024-03-04T13:13:37.715961+0000","last_undegraded":"2024-03-04T13:13:37.715961+0000","last_fullsized":"2024-03-04T13:13:37.715961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'105","last_scrub_stamp":"2024-03-04T13:13:37.715816+0000","last_deep_scrub":"255'105","last_deep_scrub_stamp":"2024-03-04T13:13:37.715816+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.715816+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:49:50.861340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":242,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"255'320","reported_seq":1706,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.723283+0000","last_change":"2024-03-04T13:13:47.723315+0000","last_active":"2024-03-04T13:13:47.723283+0000","last_peered":"2024-03-04T13:13:47.723283+0000","last_clean":"2024-03-04T13:13:47.723283+0000","last_became_active":"2024-03-04T12:20:16.821495+0000","last_became_peered":"2024-03-04T12:20:16.821495+0000","last_unstale":"2024-03-04T13:13:47.723283+0000","last_undegraded":"2024-03-04T13:13:47.723283+0000","last_fullsized":"2024-03-04T13:13:47.723283+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'320","last_scrub_stamp":"2024-03-04T13:13:47.723196+0000","last_deep_scrub":"255'320","last_deep_scrub_stamp":"2024-03-04T13:13:47.723196+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.723196+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:06:36.776088+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1811,"num_read_kb":1736,"num_write":364,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"255'119","reported_seq":676,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:05.651445+0000","last_change":"2024-03-04T13:14:05.651445+0000","last_active":"2024-03-04T13:14:05.651445+0000","last_peered":"2024-03-04T13:14:05.651445+0000","last_clean":"2024-03-04T13:14:05.651445+0000","last_became_active":"2024-03-04T12:19:58.806723+0000","last_became_peered":"2024-03-04T12:19:58.806723+0000","last_unstale":"2024-03-04T13:14:05.651445+0000","last_undegraded":"2024-03-04T13:14:05.651445+0000","last_fullsized":"2024-03-04T13:14:05.651445+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'119","last_scrub_stamp":"2024-03-04T13:14:05.651262+0000","last_deep_scrub":"255'119","last_deep_scrub_stamp":"2024-03-04T13:14:05.651262+0000","last_clean_scrub_stamp":"2024-03-04T13:14:05.651262+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:33:10.900494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":510,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:01.490463+0000","last_change":"2024-03-04T13:14:01.490463+0000","last_active":"2024-03-04T13:14:01.490463+0000","last_peered":"2024-03-04T13:14:01.490463+0000","last_clean":"2024-03-04T13:14:01.490463+0000","last_became_active":"2024-03-04T12:20:05.782921+0000","last_became_peered":"2024-03-04T12:20:05.782921+0000","last_unstale":"2024-03-04T13:14:01.490463+0000","last_undegraded":"2024-03-04T13:14:01.490463+0000","last_fullsized":"2024-03-04T13:14:01.490463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:01.490265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:01.490265+0000","last_clean_scrub_stamp":"2024-03-04T13:14:01.490265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:29:22.268150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"255'178","reported_seq":800,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.130255+0000","last_change":"2024-03-04T13:13:37.130302+0000","last_active":"2024-03-04T13:13:37.130255+0000","last_peered":"2024-03-04T13:13:37.130255+0000","last_clean":"2024-03-04T13:13:37.130255+0000","last_became_active":"2024-03-04T12:20:51.031720+0000","last_became_peered":"2024-03-04T12:20:51.031720+0000","last_unstale":"2024-03-04T13:13:37.130255+0000","last_undegraded":"2024-03-04T13:13:37.130255+0000","last_fullsized":"2024-03-04T13:13:37.130255+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'178","last_scrub_stamp":"2024-03-04T13:13:37.130170+0000","last_deep_scrub":"255'178","last_deep_scrub_stamp":"2024-03-04T13:13:37.130170+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.130170+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:48:49.252189+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263538,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":417,"num_read_kb":68206,"num_write":949,"num_write_kb":44048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":502,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:53.652996+0000","last_change":"2024-03-04T13:13:53.653020+0000","last_active":"2024-03-04T13:13:53.652996+0000","last_peered":"2024-03-04T13:13:53.652996+0000","last_clean":"2024-03-04T13:13:53.652996+0000","last_became_active":"2024-03-04T12:20:18.829703+0000","last_became_peered":"2024-03-04T12:20:18.829703+0000","last_unstale":"2024-03-04T13:13:53.652996+0000","last_undegraded":"2024-03-04T13:13:53.652996+0000","last_fullsized":"2024-03-04T13:13:53.652996+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:53.652902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:53.652902+0000","last_clean_scrub_stamp":"2024-03-04T13:13:53.652902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:20:37.667790+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"255'316","reported_seq":1013,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.439093+0000","last_change":"2024-03-04T13:13:44.439132+0000","last_active":"2024-03-04T13:13:44.439093+0000","last_peered":"2024-03-04T13:13:44.439093+0000","last_clean":"2024-03-04T13:13:44.439093+0000","last_became_active":"2024-03-04T12:20:20.842433+0000","last_became_peered":"2024-03-04T12:20:20.842433+0000","last_unstale":"2024-03-04T13:13:44.439093+0000","last_undegraded":"2024-03-04T13:13:44.439093+0000","last_fullsized":"2024-03-04T13:13:44.439093+0000","mapping_epoch":26,"log_start":"255'300","ondisk_log_start":"255'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'316","last_scrub_stamp":"2024-03-04T13:13:44.439002+0000","last_deep_scrub":"255'316","last_deep_scrub_stamp":"2024-03-04T13:13:44.439002+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.439002+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:32:03.395404+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34072,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":590,"num_read_kb":823,"num_write":540,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99764,"num_omap_keys":240,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":481,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:48.776759+0000","last_change":"2024-03-04T13:13:48.776783+0000","last_active":"2024-03-04T13:13:48.776759+0000","last_peered":"2024-03-04T13:13:48.776759+0000","last_clean":"2024-03-04T13:13:48.776759+0000","last_became_active":"2024-03-04T12:20:22.849274+0000","last_became_peered":"2024-03-04T12:20:22.849274+0000","last_unstale":"2024-03-04T13:13:48.776759+0000","last_undegraded":"2024-03-04T13:13:48.776759+0000","last_fullsized":"2024-03-04T13:13:48.776759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:48.776653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:48.776653+0000","last_clean_scrub_stamp":"2024-03-04T13:13:48.776653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:51:15.720776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"255'110","reported_seq":609,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:50.728576+0000","last_change":"2024-03-04T13:13:50.728645+0000","last_active":"2024-03-04T13:13:50.728576+0000","last_peered":"2024-03-04T13:13:50.728576+0000","last_clean":"2024-03-04T13:13:50.728576+0000","last_became_active":"2024-03-04T12:20:24.864796+0000","last_became_peered":"2024-03-04T12:20:24.864796+0000","last_unstale":"2024-03-04T13:13:50.728576+0000","last_undegraded":"2024-03-04T13:13:50.728576+0000","last_fullsized":"2024-03-04T13:13:50.728576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'110","last_scrub_stamp":"2024-03-04T13:13:50.728462+0000","last_deep_scrub":"255'110","last_deep_scrub_stamp":"2024-03-04T13:13:50.728462+0000","last_clean_scrub_stamp":"2024-03-04T13:13:50.728462+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:45:01.552749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":748,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":267,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"255'392","reported_seq":1925,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:56.806941+0000","last_change":"2024-03-04T13:13:56.806941+0000","last_active":"2024-03-04T13:13:56.806941+0000","last_peered":"2024-03-04T13:13:56.806941+0000","last_clean":"2024-03-04T13:13:56.806941+0000","last_became_active":"2024-03-04T12:20:16.836050+0000","last_became_peered":"2024-03-04T12:20:16.836050+0000","last_unstale":"2024-03-04T13:13:56.806941+0000","last_undegraded":"2024-03-04T13:13:56.806941+0000","last_fullsized":"2024-03-04T13:13:56.806941+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'392","last_scrub_stamp":"2024-03-04T13:13:56.806820+0000","last_deep_scrub":"255'392","last_deep_scrub_stamp":"2024-03-04T13:13:56.806820+0000","last_clean_scrub_stamp":"2024-03-04T13:13:56.806820+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:59:44.442344+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2110,"num_read_kb":2020,"num_write":444,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":518,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:06.685299+0000","last_change":"2024-03-04T13:14:06.685299+0000","last_active":"2024-03-04T13:14:06.685299+0000","last_peered":"2024-03-04T13:14:06.685299+0000","last_clean":"2024-03-04T13:14:06.685299+0000","last_became_active":"2024-03-04T12:20:05.781199+0000","last_became_peered":"2024-03-04T12:20:05.781199+0000","last_unstale":"2024-03-04T13:14:06.685299+0000","last_undegraded":"2024-03-04T13:14:06.685299+0000","last_fullsized":"2024-03-04T13:14:06.685299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:06.685171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:06.685171+0000","last_clean_scrub_stamp":"2024-03-04T13:14:06.685171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:51:27.875527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"255'208","reported_seq":842,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:14.995853+0000","last_change":"2024-03-04T13:14:14.995853+0000","last_active":"2024-03-04T13:14:14.995853+0000","last_peered":"2024-03-04T13:14:14.995853+0000","last_clean":"2024-03-04T13:14:14.995853+0000","last_became_active":"2024-03-04T12:20:14.821540+0000","last_became_peered":"2024-03-04T12:20:14.821540+0000","last_unstale":"2024-03-04T13:14:14.995853+0000","last_undegraded":"2024-03-04T13:14:14.995853+0000","last_fullsized":"2024-03-04T13:14:14.995853+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'208","last_scrub_stamp":"2024-03-04T13:14:14.995719+0000","last_deep_scrub":"255'208","last_deep_scrub_stamp":"2024-03-04T13:14:14.995719+0000","last_clean_scrub_stamp":"2024-03-04T13:14:14.995719+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:41:28.655903+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":424,"num_read_kb":43110,"num_write":1111,"num_write_kb":41335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:51.385585+0000","last_change":"2024-03-04T13:13:51.385622+0000","last_active":"2024-03-04T13:13:51.385585+0000","last_peered":"2024-03-04T13:13:51.385585+0000","last_clean":"2024-03-04T13:13:51.385585+0000","last_became_active":"2024-03-04T12:20:18.835509+0000","last_became_peered":"2024-03-04T12:20:18.835509+0000","last_unstale":"2024-03-04T13:13:51.385585+0000","last_undegraded":"2024-03-04T13:13:51.385585+0000","last_fullsized":"2024-03-04T13:13:51.385585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:51.385481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:51.385481+0000","last_clean_scrub_stamp":"2024-03-04T13:13:51.385481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:52:30.322296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"255'719","reported_seq":2202,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:51.693254+0000","last_change":"2024-03-04T13:13:51.693312+0000","last_active":"2024-03-04T13:13:51.693254+0000","last_peered":"2024-03-04T13:13:51.693254+0000","last_clean":"2024-03-04T13:13:51.693254+0000","last_became_active":"2024-03-04T12:20:20.838633+0000","last_became_peered":"2024-03-04T12:20:20.838633+0000","last_unstale":"2024-03-04T13:13:51.693254+0000","last_undegraded":"2024-03-04T13:13:51.693254+0000","last_fullsized":"2024-03-04T13:13:51.693254+0000","mapping_epoch":26,"log_start":"255'700","ondisk_log_start":"255'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'719","last_scrub_stamp":"2024-03-04T13:13:51.693161+0000","last_deep_scrub":"255'719","last_deep_scrub_stamp":"2024-03-04T13:13:51.693161+0000","last_clean_scrub_stamp":"2024-03-04T13:13:51.693161+0000","objects_scrubbed":12,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:44.062786+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24617,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":974,"num_read_kb":1199,"num_write":350,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":494,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.529369+0000","last_change":"2024-03-04T13:13:44.529392+0000","last_active":"2024-03-04T13:13:44.529369+0000","last_peered":"2024-03-04T13:13:44.529369+0000","last_clean":"2024-03-04T13:13:44.529369+0000","last_became_active":"2024-03-04T12:20:22.848403+0000","last_became_peered":"2024-03-04T12:20:22.848403+0000","last_unstale":"2024-03-04T13:13:44.529369+0000","last_undegraded":"2024-03-04T13:13:44.529369+0000","last_fullsized":"2024-03-04T13:13:44.529369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:44.529234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:44.529234+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.529234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:40:44.260150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"255'85","reported_seq":581,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.771086+0000","last_change":"2024-03-04T13:13:34.771117+0000","last_active":"2024-03-04T13:13:34.771086+0000","last_peered":"2024-03-04T13:13:34.771086+0000","last_clean":"2024-03-04T13:13:34.771086+0000","last_became_active":"2024-03-04T12:20:24.911303+0000","last_became_peered":"2024-03-04T12:20:24.911303+0000","last_unstale":"2024-03-04T13:13:34.771086+0000","last_undegraded":"2024-03-04T13:13:34.771086+0000","last_fullsized":"2024-03-04T13:13:34.771086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'85","last_scrub_stamp":"2024-03-04T13:13:34.770979+0000","last_deep_scrub":"255'85","last_deep_scrub_stamp":"2024-03-04T13:13:34.770979+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.770979+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:35:29.877688+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":89,"num_read_kb":85,"num_write":192,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"255'417","reported_seq":2060,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:52.689303+0000","last_change":"2024-03-04T13:13:52.689303+0000","last_active":"2024-03-04T13:13:52.689303+0000","last_peered":"2024-03-04T13:13:52.689303+0000","last_clean":"2024-03-04T13:13:52.689303+0000","last_became_active":"2024-03-04T12:20:16.827513+0000","last_became_peered":"2024-03-04T12:20:16.827513+0000","last_unstale":"2024-03-04T13:13:52.689303+0000","last_undegraded":"2024-03-04T13:13:52.689303+0000","last_fullsized":"2024-03-04T13:13:52.689303+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'417","last_scrub_stamp":"2024-03-04T13:13:52.689179+0000","last_deep_scrub":"255'417","last_deep_scrub_stamp":"2024-03-04T13:13:52.689179+0000","last_clean_scrub_stamp":"2024-03-04T13:13:52.689179+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:04:38.477298+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2343,"num_read_kb":2241,"num_write":475,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":511,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.131715+0000","last_change":"2024-03-04T13:13:45.131715+0000","last_active":"2024-03-04T13:13:45.131715+0000","last_peered":"2024-03-04T13:13:45.131715+0000","last_clean":"2024-03-04T13:13:45.131715+0000","last_became_active":"2024-03-04T12:20:05.863125+0000","last_became_peered":"2024-03-04T12:20:05.863125+0000","last_unstale":"2024-03-04T13:13:45.131715+0000","last_undegraded":"2024-03-04T13:13:45.131715+0000","last_fullsized":"2024-03-04T13:13:45.131715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:45.131601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:45.131601+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.131601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:05:46.397851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"255'170","reported_seq":761,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:01.653765+0000","last_change":"2024-03-04T13:14:01.653765+0000","last_active":"2024-03-04T13:14:01.653765+0000","last_peered":"2024-03-04T13:14:01.653765+0000","last_clean":"2024-03-04T13:14:01.653765+0000","last_became_active":"2024-03-04T12:20:14.812722+0000","last_became_peered":"2024-03-04T12:20:14.812722+0000","last_unstale":"2024-03-04T13:14:01.653765+0000","last_undegraded":"2024-03-04T13:14:01.653765+0000","last_fullsized":"2024-03-04T13:14:01.653765+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'170","last_scrub_stamp":"2024-03-04T13:14:01.653613+0000","last_deep_scrub":"255'170","last_deep_scrub_stamp":"2024-03-04T13:14:01.653613+0000","last_clean_scrub_stamp":"2024-03-04T13:14:01.653613+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:06:11.051731+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1982965,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":309,"num_read_kb":18084,"num_write":975,"num_write_kb":46336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"255'2","reported_seq":497,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.077673+0000","last_change":"2024-03-04T13:13:36.077712+0000","last_active":"2024-03-04T13:13:36.077673+0000","last_peered":"2024-03-04T13:13:36.077673+0000","last_clean":"2024-03-04T13:13:36.077673+0000","last_became_active":"2024-03-04T12:20:18.839038+0000","last_became_peered":"2024-03-04T12:20:18.839038+0000","last_unstale":"2024-03-04T13:13:36.077673+0000","last_undegraded":"2024-03-04T13:13:36.077673+0000","last_fullsized":"2024-03-04T13:13:36.077673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:36.077585+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:36.077585+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.077585+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:17:39.483287+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"255'254","reported_seq":1434,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.539031+0000","last_change":"2024-03-04T13:13:46.539075+0000","last_active":"2024-03-04T13:13:46.539031+0000","last_peered":"2024-03-04T13:13:46.539031+0000","last_clean":"2024-03-04T13:13:46.539031+0000","last_became_active":"2024-03-04T12:20:21.643475+0000","last_became_peered":"2024-03-04T12:20:21.643475+0000","last_unstale":"2024-03-04T13:13:46.539031+0000","last_undegraded":"2024-03-04T13:13:46.539031+0000","last_fullsized":"2024-03-04T13:13:46.539031+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'254","last_scrub_stamp":"2024-03-04T13:13:46.538942+0000","last_deep_scrub":"255'254","last_deep_scrub_stamp":"2024-03-04T13:13:46.538942+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.538942+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:43:06.071914+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":203,"num_write":195,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.908956+0000","last_change":"2024-03-04T13:13:44.908979+0000","last_active":"2024-03-04T13:13:44.908956+0000","last_peered":"2024-03-04T13:13:44.908956+0000","last_clean":"2024-03-04T13:13:44.908956+0000","last_became_active":"2024-03-04T12:20:22.854343+0000","last_became_peered":"2024-03-04T12:20:22.854343+0000","last_unstale":"2024-03-04T13:13:44.908956+0000","last_undegraded":"2024-03-04T13:13:44.908956+0000","last_fullsized":"2024-03-04T13:13:44.908956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:44.908863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:44.908863+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.908863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:14.482523+0000","scrub_duration":96,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"255'189","reported_seq":710,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.828319+0000","last_change":"2024-03-04T13:13:38.828319+0000","last_active":"2024-03-04T13:13:38.828319+0000","last_peered":"2024-03-04T13:13:38.828319+0000","last_clean":"2024-03-04T13:13:38.828319+0000","last_became_active":"2024-03-04T12:20:24.871020+0000","last_became_peered":"2024-03-04T12:20:24.871020+0000","last_unstale":"2024-03-04T13:13:38.828319+0000","last_undegraded":"2024-03-04T13:13:38.828319+0000","last_fullsized":"2024-03-04T13:13:38.828319+0000","mapping_epoch":30,"log_start":"250'100","ondisk_log_start":"250'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'189","last_scrub_stamp":"2024-03-04T13:13:38.828189+0000","last_deep_scrub":"255'189","last_deep_scrub_stamp":"2024-03-04T13:13:38.828189+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.828189+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:40:40.968338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":353,"num_read_kb":362,"num_write":419,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"255'389","reported_seq":1864,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:56.685752+0000","last_change":"2024-03-04T13:13:56.685752+0000","last_active":"2024-03-04T13:13:56.685752+0000","last_peered":"2024-03-04T13:13:56.685752+0000","last_clean":"2024-03-04T13:13:56.685752+0000","last_became_active":"2024-03-04T12:20:16.825006+0000","last_became_peered":"2024-03-04T12:20:16.825006+0000","last_unstale":"2024-03-04T13:13:56.685752+0000","last_undegraded":"2024-03-04T13:13:56.685752+0000","last_fullsized":"2024-03-04T13:13:56.685752+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'389","last_scrub_stamp":"2024-03-04T13:13:56.685580+0000","last_deep_scrub":"255'389","last_deep_scrub_stamp":"2024-03-04T13:13:56.685580+0000","last_clean_scrub_stamp":"2024-03-04T13:13:56.685580+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:11:20.735041+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2027,"num_read_kb":1928,"num_write":438,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":510,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:02.516339+0000","last_change":"2024-03-04T13:14:02.516339+0000","last_active":"2024-03-04T13:14:02.516339+0000","last_peered":"2024-03-04T13:14:02.516339+0000","last_clean":"2024-03-04T13:14:02.516339+0000","last_became_active":"2024-03-04T12:20:05.782897+0000","last_became_peered":"2024-03-04T12:20:05.782897+0000","last_unstale":"2024-03-04T13:14:02.516339+0000","last_undegraded":"2024-03-04T13:14:02.516339+0000","last_fullsized":"2024-03-04T13:14:02.516339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:02.516187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:02.516187+0000","last_clean_scrub_stamp":"2024-03-04T13:14:02.516187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:09:52.573403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"255'203","reported_seq":887,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:07.191031+0000","last_change":"2024-03-04T13:14:07.191031+0000","last_active":"2024-03-04T13:14:07.191031+0000","last_peered":"2024-03-04T13:14:07.191031+0000","last_clean":"2024-03-04T13:14:07.191031+0000","last_became_active":"2024-03-04T12:20:14.824810+0000","last_became_peered":"2024-03-04T12:20:14.824810+0000","last_unstale":"2024-03-04T13:14:07.191031+0000","last_undegraded":"2024-03-04T13:14:07.191031+0000","last_fullsized":"2024-03-04T13:14:07.191031+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'203","last_scrub_stamp":"2024-03-04T13:14:07.190908+0000","last_deep_scrub":"255'203","last_deep_scrub_stamp":"2024-03-04T13:14:07.190908+0000","last_clean_scrub_stamp":"2024-03-04T13:14:07.190908+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:16:11.443313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3544974,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":19088,"num_write":1144,"num_write_kb":38256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:00.853965+0000","last_change":"2024-03-04T13:14:00.854004+0000","last_active":"2024-03-04T13:14:00.853965+0000","last_peered":"2024-03-04T13:14:00.853965+0000","last_clean":"2024-03-04T13:14:00.853965+0000","last_became_active":"2024-03-04T12:20:18.833051+0000","last_became_peered":"2024-03-04T12:20:18.833051+0000","last_unstale":"2024-03-04T13:14:00.853965+0000","last_undegraded":"2024-03-04T13:14:00.853965+0000","last_fullsized":"2024-03-04T13:14:00.853965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:00.853845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:00.853845+0000","last_clean_scrub_stamp":"2024-03-04T13:14:00.853845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:55:46.994297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"255'132","reported_seq":670,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:51.847462+0000","last_change":"2024-03-04T13:13:51.847500+0000","last_active":"2024-03-04T13:13:51.847462+0000","last_peered":"2024-03-04T13:13:51.847462+0000","last_clean":"2024-03-04T13:13:51.847462+0000","last_became_active":"2024-03-04T12:20:20.845192+0000","last_became_peered":"2024-03-04T12:20:20.845192+0000","last_unstale":"2024-03-04T13:13:51.847462+0000","last_undegraded":"2024-03-04T13:13:51.847462+0000","last_fullsized":"2024-03-04T13:13:51.847462+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'132","last_scrub_stamp":"2024-03-04T13:13:51.847377+0000","last_deep_scrub":"255'132","last_deep_scrub_stamp":"2024-03-04T13:13:51.847377+0000","last_clean_scrub_stamp":"2024-03-04T13:13:51.847377+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:06:43.925197+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":155,"num_read_kb":149,"num_write":110,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1636,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":489,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.749495+0000","last_change":"2024-03-04T13:13:44.749534+0000","last_active":"2024-03-04T13:13:44.749495+0000","last_peered":"2024-03-04T13:13:44.749495+0000","last_clean":"2024-03-04T13:13:44.749495+0000","last_became_active":"2024-03-04T12:20:22.852745+0000","last_became_peered":"2024-03-04T12:20:22.852745+0000","last_unstale":"2024-03-04T13:13:44.749495+0000","last_undegraded":"2024-03-04T13:13:44.749495+0000","last_fullsized":"2024-03-04T13:13:44.749495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:44.749366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:44.749366+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.749366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:03:25.765685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"255'85","reported_seq":588,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.265937+0000","last_change":"2024-03-04T13:13:34.265961+0000","last_active":"2024-03-04T13:13:34.265937+0000","last_peered":"2024-03-04T13:13:34.265937+0000","last_clean":"2024-03-04T13:13:34.265937+0000","last_became_active":"2024-03-04T12:20:24.864783+0000","last_became_peered":"2024-03-04T12:20:24.864783+0000","last_unstale":"2024-03-04T13:13:34.265937+0000","last_undegraded":"2024-03-04T13:13:34.265937+0000","last_fullsized":"2024-03-04T13:13:34.265937+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'85","last_scrub_stamp":"2024-03-04T13:13:34.265840+0000","last_deep_scrub":"255'85","last_deep_scrub_stamp":"2024-03-04T13:13:34.265840+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.265840+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:24:43.687453+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":204,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"255'443","reported_seq":1910,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:54.680210+0000","last_change":"2024-03-04T13:13:54.680210+0000","last_active":"2024-03-04T13:13:54.680210+0000","last_peered":"2024-03-04T13:13:54.680210+0000","last_clean":"2024-03-04T13:13:54.680210+0000","last_became_active":"2024-03-04T12:20:16.826823+0000","last_became_peered":"2024-03-04T12:20:16.826823+0000","last_unstale":"2024-03-04T13:13:54.680210+0000","last_undegraded":"2024-03-04T13:13:54.680210+0000","last_fullsized":"2024-03-04T13:13:54.680210+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'443","last_scrub_stamp":"2024-03-04T13:13:54.680062+0000","last_deep_scrub":"255'443","last_deep_scrub_stamp":"2024-03-04T13:13:54.680062+0000","last_clean_scrub_stamp":"2024-03-04T13:13:54.680062+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:42:39.018750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2302,"num_read_kb":2131,"num_write":558,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"255'165","reported_seq":769,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:03.516868+0000","last_change":"2024-03-04T13:14:03.516944+0000","last_active":"2024-03-04T13:14:03.516868+0000","last_peered":"2024-03-04T13:14:03.516868+0000","last_clean":"2024-03-04T13:14:03.516868+0000","last_became_active":"2024-03-04T12:20:14.819483+0000","last_became_peered":"2024-03-04T12:20:14.819483+0000","last_unstale":"2024-03-04T13:14:03.516868+0000","last_undegraded":"2024-03-04T13:14:03.516868+0000","last_fullsized":"2024-03-04T13:14:03.516868+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'165","last_scrub_stamp":"2024-03-04T13:14:03.516772+0000","last_deep_scrub":"255'165","last_deep_scrub_stamp":"2024-03-04T13:14:03.516772+0000","last_clean_scrub_stamp":"2024-03-04T13:14:03.516772+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:37:47.076880+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553728,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":336,"num_read_kb":12779,"num_write":962,"num_write_kb":35384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":511,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:58.638430+0000","last_change":"2024-03-04T13:13:58.638430+0000","last_active":"2024-03-04T13:13:58.638430+0000","last_peered":"2024-03-04T13:13:58.638430+0000","last_clean":"2024-03-04T13:13:58.638430+0000","last_became_active":"2024-03-04T12:20:05.863311+0000","last_became_peered":"2024-03-04T12:20:05.863311+0000","last_unstale":"2024-03-04T13:13:58.638430+0000","last_undegraded":"2024-03-04T13:13:58.638430+0000","last_fullsized":"2024-03-04T13:13:58.638430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:58.638326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:58.638326+0000","last_clean_scrub_stamp":"2024-03-04T13:13:58.638326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:29:48.744706+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:58.847314+0000","last_change":"2024-03-04T13:13:58.847338+0000","last_active":"2024-03-04T13:13:58.847314+0000","last_peered":"2024-03-04T13:13:58.847314+0000","last_clean":"2024-03-04T13:13:58.847314+0000","last_became_active":"2024-03-04T12:20:18.832355+0000","last_became_peered":"2024-03-04T12:20:18.832355+0000","last_unstale":"2024-03-04T13:13:58.847314+0000","last_undegraded":"2024-03-04T13:13:58.847314+0000","last_fullsized":"2024-03-04T13:13:58.847314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:58.847222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:58.847222+0000","last_clean_scrub_stamp":"2024-03-04T13:13:58.847222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:18:25.497962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"255'266","reported_seq":925,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:49.758332+0000","last_change":"2024-03-04T13:13:49.758332+0000","last_active":"2024-03-04T13:13:49.758332+0000","last_peered":"2024-03-04T13:13:49.758332+0000","last_clean":"2024-03-04T13:13:49.758332+0000","last_became_active":"2024-03-04T12:20:20.842330+0000","last_became_peered":"2024-03-04T12:20:20.842330+0000","last_unstale":"2024-03-04T13:13:49.758332+0000","last_undegraded":"2024-03-04T13:13:49.758332+0000","last_fullsized":"2024-03-04T13:13:49.758332+0000","mapping_epoch":26,"log_start":"255'200","ondisk_log_start":"255'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'266","last_scrub_stamp":"2024-03-04T13:13:49.758236+0000","last_deep_scrub":"255'266","last_deep_scrub_stamp":"2024-03-04T13:13:49.758236+0000","last_clean_scrub_stamp":"2024-03-04T13:13:49.758236+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:53:59.465813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11717,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":373,"num_read_kb":489,"num_write":198,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":492,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.176595+0000","last_change":"2024-03-04T13:13:38.176635+0000","last_active":"2024-03-04T13:13:38.176595+0000","last_peered":"2024-03-04T13:13:38.176595+0000","last_clean":"2024-03-04T13:13:38.176595+0000","last_became_active":"2024-03-04T12:20:22.854507+0000","last_became_peered":"2024-03-04T12:20:22.854507+0000","last_unstale":"2024-03-04T13:13:38.176595+0000","last_undegraded":"2024-03-04T13:13:38.176595+0000","last_fullsized":"2024-03-04T13:13:38.176595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:38.176494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:38.176494+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.176494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:11:18.467708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"255'107","reported_seq":602,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:32.894665+0000","last_change":"2024-03-04T13:13:32.894665+0000","last_active":"2024-03-04T13:13:32.894665+0000","last_peered":"2024-03-04T13:13:32.894665+0000","last_clean":"2024-03-04T13:13:32.894665+0000","last_became_active":"2024-03-04T12:20:24.911970+0000","last_became_peered":"2024-03-04T12:20:24.911970+0000","last_unstale":"2024-03-04T13:13:32.894665+0000","last_undegraded":"2024-03-04T13:13:32.894665+0000","last_fullsized":"2024-03-04T13:13:32.894665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'107","last_scrub_stamp":"2024-03-04T13:13:32.894508+0000","last_deep_scrub":"255'107","last_deep_scrub_stamp":"2024-03-04T13:13:32.894508+0000","last_clean_scrub_stamp":"2024-03-04T13:13:32.894508+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:03:06.228753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":120,"num_write":241,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"255'323","reported_seq":1688,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:03.866603+0000","last_change":"2024-03-04T13:14:03.866603+0000","last_active":"2024-03-04T13:14:03.866603+0000","last_peered":"2024-03-04T13:14:03.866603+0000","last_clean":"2024-03-04T13:14:03.866603+0000","last_became_active":"2024-03-04T12:20:16.825241+0000","last_became_peered":"2024-03-04T12:20:16.825241+0000","last_unstale":"2024-03-04T13:14:03.866603+0000","last_undegraded":"2024-03-04T13:14:03.866603+0000","last_fullsized":"2024-03-04T13:14:03.866603+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'323","last_scrub_stamp":"2024-03-04T13:14:03.866488+0000","last_deep_scrub":"255'323","last_deep_scrub_stamp":"2024-03-04T13:14:03.866488+0000","last_clean_scrub_stamp":"2024-03-04T13:14:03.866488+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:53:00.641099+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1925,"num_read_kb":1835,"num_write":376,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"255'169","reported_seq":770,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:03.601046+0000","last_change":"2024-03-04T13:14:03.601046+0000","last_active":"2024-03-04T13:14:03.601046+0000","last_peered":"2024-03-04T13:14:03.601046+0000","last_clean":"2024-03-04T13:14:03.601046+0000","last_became_active":"2024-03-04T12:20:14.815589+0000","last_became_peered":"2024-03-04T12:20:14.815589+0000","last_unstale":"2024-03-04T13:14:03.601046+0000","last_undegraded":"2024-03-04T13:14:03.601046+0000","last_fullsized":"2024-03-04T13:14:03.601046+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'169","last_scrub_stamp":"2024-03-04T13:14:03.600861+0000","last_deep_scrub":"255'169","last_deep_scrub_stamp":"2024-03-04T13:14:03.600861+0000","last_clean_scrub_stamp":"2024-03-04T13:14:03.600861+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:35:31.161438+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11384047,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":367,"num_read_kb":3319,"num_write":965,"num_write_kb":11696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":517,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:07.652535+0000","last_change":"2024-03-04T13:14:07.652535+0000","last_active":"2024-03-04T13:14:07.652535+0000","last_peered":"2024-03-04T13:14:07.652535+0000","last_clean":"2024-03-04T13:14:07.652535+0000","last_became_active":"2024-03-04T12:20:05.863682+0000","last_became_peered":"2024-03-04T12:20:05.863682+0000","last_unstale":"2024-03-04T13:14:07.652535+0000","last_undegraded":"2024-03-04T13:14:07.652535+0000","last_fullsized":"2024-03-04T13:14:07.652535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:07.652422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:07.652422+0000","last_clean_scrub_stamp":"2024-03-04T13:14:07.652422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:02:33.165813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":498,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.747839+0000","last_change":"2024-03-04T13:13:41.747864+0000","last_active":"2024-03-04T13:13:41.747839+0000","last_peered":"2024-03-04T13:13:41.747839+0000","last_clean":"2024-03-04T13:13:41.747839+0000","last_became_active":"2024-03-04T12:20:18.833896+0000","last_became_peered":"2024-03-04T12:20:18.833896+0000","last_unstale":"2024-03-04T13:13:41.747839+0000","last_undegraded":"2024-03-04T13:13:41.747839+0000","last_fullsized":"2024-03-04T13:13:41.747839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:41.747741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:41.747741+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.747741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:00:12.641146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"255'208","reported_seq":772,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:53.659612+0000","last_change":"2024-03-04T13:13:53.659653+0000","last_active":"2024-03-04T13:13:53.659612+0000","last_peered":"2024-03-04T13:13:53.659612+0000","last_clean":"2024-03-04T13:13:53.659612+0000","last_became_active":"2024-03-04T12:20:21.641826+0000","last_became_peered":"2024-03-04T12:20:21.641826+0000","last_unstale":"2024-03-04T13:13:53.659612+0000","last_undegraded":"2024-03-04T13:13:53.659612+0000","last_fullsized":"2024-03-04T13:13:53.659612+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'208","last_scrub_stamp":"2024-03-04T13:13:53.659520+0000","last_deep_scrub":"255'208","last_deep_scrub_stamp":"2024-03-04T13:13:53.659520+0000","last_clean_scrub_stamp":"2024-03-04T13:13:53.659520+0000","objects_scrubbed":8,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:21:38.611711+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":255,"num_read_kb":248,"num_write":230,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2634,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"255'535","reported_seq":4194,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.342302+0000","last_change":"2024-03-04T13:13:41.342328+0000","last_active":"2024-03-04T13:13:41.342302+0000","last_peered":"2024-03-04T13:13:41.342302+0000","last_clean":"2024-03-04T13:13:41.342302+0000","last_became_active":"2024-03-04T12:20:22.853588+0000","last_became_peered":"2024-03-04T12:20:22.853588+0000","last_unstale":"2024-03-04T13:13:41.342302+0000","last_undegraded":"2024-03-04T13:13:41.342302+0000","last_fullsized":"2024-03-04T13:13:41.342302+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'535","last_scrub_stamp":"2024-03-04T13:13:41.342199+0000","last_deep_scrub":"255'535","last_deep_scrub_stamp":"2024-03-04T13:13:41.342199+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.342199+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:40:35.313438+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"255'117","reported_seq":603,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.783291+0000","last_change":"2024-03-04T13:13:37.783322+0000","last_active":"2024-03-04T13:13:37.783291+0000","last_peered":"2024-03-04T13:13:37.783291+0000","last_clean":"2024-03-04T13:13:37.783291+0000","last_became_active":"2024-03-04T12:20:24.911103+0000","last_became_peered":"2024-03-04T12:20:24.911103+0000","last_unstale":"2024-03-04T13:13:37.783291+0000","last_undegraded":"2024-03-04T13:13:37.783291+0000","last_fullsized":"2024-03-04T13:13:37.783291+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'117","last_scrub_stamp":"2024-03-04T13:13:37.783200+0000","last_deep_scrub":"255'117","last_deep_scrub_stamp":"2024-03-04T13:13:37.783200+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.783200+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:07:25.533057+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":641,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":105,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"255'1399","reported_seq":3065,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:54.922972+0000","last_change":"2024-03-04T13:13:54.922972+0000","last_active":"2024-03-04T13:13:54.922972+0000","last_peered":"2024-03-04T13:13:54.922972+0000","last_clean":"2024-03-04T13:13:54.922972+0000","last_became_active":"2024-03-04T12:20:16.833689+0000","last_became_peered":"2024-03-04T12:20:16.833689+0000","last_unstale":"2024-03-04T13:13:54.922972+0000","last_undegraded":"2024-03-04T13:13:54.922972+0000","last_fullsized":"2024-03-04T13:13:54.922972+0000","mapping_epoch":22,"log_start":"255'1300","ondisk_log_start":"255'1300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1399","last_scrub_stamp":"2024-03-04T13:13:54.922828+0000","last_deep_scrub":"255'1399","last_deep_scrub_stamp":"2024-03-04T13:13:54.922828+0000","last_clean_scrub_stamp":"2024-03-04T13:13:54.922828+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":1300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:38:53.243440+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5949,"num_read_kb":5124,"num_write":2086,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":961,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"255'150","reported_seq":840,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:12.949475+0000","last_change":"2024-03-04T13:14:12.949475+0000","last_active":"2024-03-04T13:14:12.949475+0000","last_peered":"2024-03-04T13:14:12.949475+0000","last_clean":"2024-03-04T13:14:12.949475+0000","last_became_active":"2024-03-04T12:20:14.814220+0000","last_became_peered":"2024-03-04T12:20:14.814220+0000","last_unstale":"2024-03-04T13:14:12.949475+0000","last_undegraded":"2024-03-04T13:14:12.949475+0000","last_fullsized":"2024-03-04T13:14:12.949475+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'150","last_scrub_stamp":"2024-03-04T13:14:12.949300+0000","last_deep_scrub":"255'150","last_deep_scrub_stamp":"2024-03-04T13:14:12.949300+0000","last_clean_scrub_stamp":"2024-03-04T13:14:12.949300+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:22:34.850045+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262328,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":11189,"num_write":841,"num_write_kb":14687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":510,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:57.685634+0000","last_change":"2024-03-04T13:13:57.685634+0000","last_active":"2024-03-04T13:13:57.685634+0000","last_peered":"2024-03-04T13:13:57.685634+0000","last_clean":"2024-03-04T13:13:57.685634+0000","last_became_active":"2024-03-04T12:20:05.784145+0000","last_became_peered":"2024-03-04T12:20:05.784145+0000","last_unstale":"2024-03-04T13:13:57.685634+0000","last_undegraded":"2024-03-04T13:13:57.685634+0000","last_fullsized":"2024-03-04T13:13:57.685634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:57.685520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:57.685520+0000","last_clean_scrub_stamp":"2024-03-04T13:13:57.685520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:08:06.581172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:01.087571+0000","last_change":"2024-03-04T13:14:01.087593+0000","last_active":"2024-03-04T13:14:01.087571+0000","last_peered":"2024-03-04T13:14:01.087571+0000","last_clean":"2024-03-04T13:14:01.087571+0000","last_became_active":"2024-03-04T12:20:18.832932+0000","last_became_peered":"2024-03-04T12:20:18.832932+0000","last_unstale":"2024-03-04T13:14:01.087571+0000","last_undegraded":"2024-03-04T13:14:01.087571+0000","last_fullsized":"2024-03-04T13:14:01.087571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:01.087446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:01.087446+0000","last_clean_scrub_stamp":"2024-03-04T13:14:01.087446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:05:33.550007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"255'114","reported_seq":655,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.300972+0000","last_change":"2024-03-04T13:13:44.301018+0000","last_active":"2024-03-04T13:13:44.300972+0000","last_peered":"2024-03-04T13:13:44.300972+0000","last_clean":"2024-03-04T13:13:44.300972+0000","last_became_active":"2024-03-04T12:20:20.841108+0000","last_became_peered":"2024-03-04T12:20:20.841108+0000","last_unstale":"2024-03-04T13:13:44.300972+0000","last_undegraded":"2024-03-04T13:13:44.300972+0000","last_fullsized":"2024-03-04T13:13:44.300972+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'114","last_scrub_stamp":"2024-03-04T13:13:44.300884+0000","last_deep_scrub":"255'114","last_deep_scrub_stamp":"2024-03-04T13:13:44.300884+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.300884+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:55.572601+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":86,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"255'530","reported_seq":2292,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.796423+0000","last_change":"2024-03-04T13:13:42.796467+0000","last_active":"2024-03-04T13:13:42.796423+0000","last_peered":"2024-03-04T13:13:42.796423+0000","last_clean":"2024-03-04T13:13:42.796423+0000","last_became_active":"2024-03-04T12:20:22.859306+0000","last_became_peered":"2024-03-04T12:20:22.859306+0000","last_unstale":"2024-03-04T13:13:42.796423+0000","last_undegraded":"2024-03-04T13:13:42.796423+0000","last_fullsized":"2024-03-04T13:13:42.796423+0000","mapping_epoch":28,"log_start":"255'500","ondisk_log_start":"255'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'530","last_scrub_stamp":"2024-03-04T13:13:42.796336+0000","last_deep_scrub":"255'530","last_deep_scrub_stamp":"2024-03-04T13:13:42.796336+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.796336+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:53:21.504586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"255'154","reported_seq":645,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.800432+0000","last_change":"2024-03-04T13:13:37.800432+0000","last_active":"2024-03-04T13:13:37.800432+0000","last_peered":"2024-03-04T13:13:37.800432+0000","last_clean":"2024-03-04T13:13:37.800432+0000","last_became_active":"2024-03-04T12:20:24.865816+0000","last_became_peered":"2024-03-04T12:20:24.865816+0000","last_unstale":"2024-03-04T13:13:37.800432+0000","last_undegraded":"2024-03-04T13:13:37.800432+0000","last_fullsized":"2024-03-04T13:13:37.800432+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'154","last_scrub_stamp":"2024-03-04T13:13:37.800314+0000","last_deep_scrub":"255'154","last_deep_scrub_stamp":"2024-03-04T13:13:37.800314+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.800314+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:48:58.994923+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":201,"num_read_kb":201,"num_write":359,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"255'654","reported_seq":2066,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:52.236420+0000","last_change":"2024-03-04T13:13:52.236420+0000","last_active":"2024-03-04T13:13:52.236420+0000","last_peered":"2024-03-04T13:13:52.236420+0000","last_clean":"2024-03-04T13:13:52.236420+0000","last_became_active":"2024-03-04T12:20:16.825377+0000","last_became_peered":"2024-03-04T12:20:16.825377+0000","last_unstale":"2024-03-04T13:13:52.236420+0000","last_undegraded":"2024-03-04T13:13:52.236420+0000","last_fullsized":"2024-03-04T13:13:52.236420+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'654","last_scrub_stamp":"2024-03-04T13:13:52.236282+0000","last_deep_scrub":"255'654","last_deep_scrub_stamp":"2024-03-04T13:13:52.236282+0000","last_clean_scrub_stamp":"2024-03-04T13:13:52.236282+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":600,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:58:08.061948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2990,"num_read_kb":2698,"num_write":869,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"255'184","reported_seq":886,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:08.985452+0000","last_change":"2024-03-04T13:14:08.985452+0000","last_active":"2024-03-04T13:14:08.985452+0000","last_peered":"2024-03-04T13:14:08.985452+0000","last_clean":"2024-03-04T13:14:08.985452+0000","last_became_active":"2024-03-04T12:20:14.811756+0000","last_became_peered":"2024-03-04T12:20:14.811756+0000","last_unstale":"2024-03-04T13:14:08.985452+0000","last_undegraded":"2024-03-04T13:14:08.985452+0000","last_fullsized":"2024-03-04T13:14:08.985452+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'184","last_scrub_stamp":"2024-03-04T13:14:08.985302+0000","last_deep_scrub":"255'184","last_deep_scrub_stamp":"2024-03-04T13:14:08.985302+0000","last_clean_scrub_stamp":"2024-03-04T13:14:08.985302+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:41:10.350275+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17104383,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":578,"num_read_kb":172500,"num_write":1029,"num_write_kb":54165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":512,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:52.728668+0000","last_change":"2024-03-04T13:13:52.728668+0000","last_active":"2024-03-04T13:13:52.728668+0000","last_peered":"2024-03-04T13:13:52.728668+0000","last_clean":"2024-03-04T13:13:52.728668+0000","last_became_active":"2024-03-04T12:20:05.779370+0000","last_became_peered":"2024-03-04T12:20:05.779370+0000","last_unstale":"2024-03-04T13:13:52.728668+0000","last_undegraded":"2024-03-04T13:13:52.728668+0000","last_fullsized":"2024-03-04T13:13:52.728668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:52.728539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:52.728539+0000","last_clean_scrub_stamp":"2024-03-04T13:13:52.728539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:00:59.466198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"255'4","reported_seq":806,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:58.932410+0000","last_change":"2024-03-04T13:13:58.932410+0000","last_active":"2024-03-04T13:13:58.932410+0000","last_peered":"2024-03-04T13:13:58.932410+0000","last_clean":"2024-03-04T13:13:58.932410+0000","last_became_active":"2024-03-04T12:20:18.833273+0000","last_became_peered":"2024-03-04T12:20:18.833273+0000","last_unstale":"2024-03-04T13:13:58.932410+0000","last_undegraded":"2024-03-04T13:13:58.932410+0000","last_fullsized":"2024-03-04T13:13:58.932410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'4","last_scrub_stamp":"2024-03-04T13:13:58.932261+0000","last_deep_scrub":"255'4","last_deep_scrub_stamp":"2024-03-04T13:13:58.932261+0000","last_clean_scrub_stamp":"2024-03-04T13:13:58.932261+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:35:37.479599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":470,"num_read_kb":468,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"255'328","reported_seq":1052,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:48.612984+0000","last_change":"2024-03-04T13:13:48.613032+0000","last_active":"2024-03-04T13:13:48.612984+0000","last_peered":"2024-03-04T13:13:48.612984+0000","last_clean":"2024-03-04T13:13:48.612984+0000","last_became_active":"2024-03-04T12:20:21.642696+0000","last_became_peered":"2024-03-04T12:20:21.642696+0000","last_unstale":"2024-03-04T13:13:48.612984+0000","last_undegraded":"2024-03-04T13:13:48.612984+0000","last_fullsized":"2024-03-04T13:13:48.612984+0000","mapping_epoch":26,"log_start":"255'300","ondisk_log_start":"255'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'328","last_scrub_stamp":"2024-03-04T13:13:48.612902+0000","last_deep_scrub":"255'328","last_deep_scrub_stamp":"2024-03-04T13:13:48.612902+0000","last_clean_scrub_stamp":"2024-03-04T13:13:48.612902+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:48:22.425114+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17780,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":473,"num_read_kb":637,"num_write":242,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":484,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.880588+0000","last_change":"2024-03-04T13:13:47.880612+0000","last_active":"2024-03-04T13:13:47.880588+0000","last_peered":"2024-03-04T13:13:47.880588+0000","last_clean":"2024-03-04T13:13:47.880588+0000","last_became_active":"2024-03-04T12:20:22.853272+0000","last_became_peered":"2024-03-04T12:20:22.853272+0000","last_unstale":"2024-03-04T13:13:47.880588+0000","last_undegraded":"2024-03-04T13:13:47.880588+0000","last_fullsized":"2024-03-04T13:13:47.880588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:47.880496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:47.880496+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.880496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:16:43.511193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"255'111","reported_seq":595,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.276657+0000","last_change":"2024-03-04T13:13:36.276657+0000","last_active":"2024-03-04T13:13:36.276657+0000","last_peered":"2024-03-04T13:13:36.276657+0000","last_clean":"2024-03-04T13:13:36.276657+0000","last_became_active":"2024-03-04T12:20:24.863996+0000","last_became_peered":"2024-03-04T12:20:24.863996+0000","last_unstale":"2024-03-04T13:13:36.276657+0000","last_undegraded":"2024-03-04T13:13:36.276657+0000","last_fullsized":"2024-03-04T13:13:36.276657+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'111","last_scrub_stamp":"2024-03-04T13:13:36.276495+0000","last_deep_scrub":"255'111","last_deep_scrub_stamp":"2024-03-04T13:13:36.276495+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.276495+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:42:28.929795+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":275,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"255'116","reported_seq":613,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.850786+0000","last_change":"2024-03-04T13:13:35.850828+0000","last_active":"2024-03-04T13:13:35.850786+0000","last_peered":"2024-03-04T13:13:35.850786+0000","last_clean":"2024-03-04T13:13:35.850786+0000","last_became_active":"2024-03-04T12:20:24.868636+0000","last_became_peered":"2024-03-04T12:20:24.868636+0000","last_unstale":"2024-03-04T13:13:35.850786+0000","last_undegraded":"2024-03-04T13:13:35.850786+0000","last_fullsized":"2024-03-04T13:13:35.850786+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'116","last_scrub_stamp":"2024-03-04T13:13:35.850689+0000","last_deep_scrub":"255'116","last_deep_scrub_stamp":"2024-03-04T13:13:35.850689+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.850689+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:25:58.042029+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":159,"num_read_kb":141,"num_write":275,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"255'389","reported_seq":1874,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:56.197633+0000","last_change":"2024-03-04T13:13:56.197633+0000","last_active":"2024-03-04T13:13:56.197633+0000","last_peered":"2024-03-04T13:13:56.197633+0000","last_clean":"2024-03-04T13:13:56.197633+0000","last_became_active":"2024-03-04T12:20:16.822887+0000","last_became_peered":"2024-03-04T12:20:16.822887+0000","last_unstale":"2024-03-04T13:13:56.197633+0000","last_undegraded":"2024-03-04T13:13:56.197633+0000","last_fullsized":"2024-03-04T13:13:56.197633+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'389","last_scrub_stamp":"2024-03-04T13:13:56.197519+0000","last_deep_scrub":"255'389","last_deep_scrub_stamp":"2024-03-04T13:13:56.197519+0000","last_clean_scrub_stamp":"2024-03-04T13:13:56.197519+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:42:16.844653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2100,"num_read_kb":1986,"num_write":448,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":804,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"255'176","reported_seq":790,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:05.152514+0000","last_change":"2024-03-04T13:14:05.152576+0000","last_active":"2024-03-04T13:14:05.152514+0000","last_peered":"2024-03-04T13:14:05.152514+0000","last_clean":"2024-03-04T13:14:05.152514+0000","last_became_active":"2024-03-04T12:20:14.823661+0000","last_became_peered":"2024-03-04T12:20:14.823661+0000","last_unstale":"2024-03-04T13:14:05.152514+0000","last_undegraded":"2024-03-04T13:14:05.152514+0000","last_fullsized":"2024-03-04T13:14:05.152514+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'176","last_scrub_stamp":"2024-03-04T13:14:05.152387+0000","last_deep_scrub":"255'176","last_deep_scrub_stamp":"2024-03-04T13:14:05.152387+0000","last_clean_scrub_stamp":"2024-03-04T13:14:05.152387+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:54:39.065860+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":384,"num_read_kb":10388,"num_write":1049,"num_write_kb":6576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":494,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:43.766456+0000","last_change":"2024-03-04T13:13:43.766456+0000","last_active":"2024-03-04T13:13:43.766456+0000","last_peered":"2024-03-04T13:13:43.766456+0000","last_clean":"2024-03-04T13:13:43.766456+0000","last_became_active":"2024-03-04T12:20:18.836487+0000","last_became_peered":"2024-03-04T12:20:18.836487+0000","last_unstale":"2024-03-04T13:13:43.766456+0000","last_undegraded":"2024-03-04T13:13:43.766456+0000","last_fullsized":"2024-03-04T13:13:43.766456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:43.766306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:43.766306+0000","last_clean_scrub_stamp":"2024-03-04T13:13:43.766306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:01:10.055070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"255'146","reported_seq":716,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:08.909724+0000","last_change":"2024-03-04T13:14:08.909761+0000","last_active":"2024-03-04T13:14:08.909724+0000","last_peered":"2024-03-04T13:14:08.909724+0000","last_clean":"2024-03-04T13:14:08.909724+0000","last_became_active":"2024-03-04T12:20:20.841696+0000","last_became_peered":"2024-03-04T12:20:20.841696+0000","last_unstale":"2024-03-04T13:14:08.909724+0000","last_undegraded":"2024-03-04T13:14:08.909724+0000","last_fullsized":"2024-03-04T13:14:08.909724+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'146","last_scrub_stamp":"2024-03-04T13:14:08.909631+0000","last_deep_scrub":"255'146","last_deep_scrub_stamp":"2024-03-04T13:14:08.909631+0000","last_clean_scrub_stamp":"2024-03-04T13:14:08.909631+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:05:10.322428+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11864,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":193,"num_read_kb":271,"num_write":104,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":482,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.892194+0000","last_change":"2024-03-04T13:13:46.892194+0000","last_active":"2024-03-04T13:13:46.892194+0000","last_peered":"2024-03-04T13:13:46.892194+0000","last_clean":"2024-03-04T13:13:46.892194+0000","last_became_active":"2024-03-04T12:20:22.857513+0000","last_became_peered":"2024-03-04T12:20:22.857513+0000","last_unstale":"2024-03-04T13:13:46.892194+0000","last_undegraded":"2024-03-04T13:13:46.892194+0000","last_fullsized":"2024-03-04T13:13:46.892194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:46.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:46.892081+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:51.247568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"255'97","reported_seq":587,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.822659+0000","last_change":"2024-03-04T13:13:41.822685+0000","last_active":"2024-03-04T13:13:41.822659+0000","last_peered":"2024-03-04T13:13:41.822659+0000","last_clean":"2024-03-04T13:13:41.822659+0000","last_became_active":"2024-03-04T12:20:24.863346+0000","last_became_peered":"2024-03-04T12:20:24.863346+0000","last_unstale":"2024-03-04T13:13:41.822659+0000","last_undegraded":"2024-03-04T13:13:41.822659+0000","last_fullsized":"2024-03-04T13:13:41.822659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'97","last_scrub_stamp":"2024-03-04T13:13:41.822571+0000","last_deep_scrub":"255'97","last_deep_scrub_stamp":"2024-03-04T13:13:41.822571+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.822571+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:44:53.384390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":222,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"255'707","reported_seq":2073,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:44.752448+0000","last_change":"2024-03-04T13:13:44.752448+0000","last_active":"2024-03-04T13:13:44.752448+0000","last_peered":"2024-03-04T13:13:44.752448+0000","last_clean":"2024-03-04T13:13:44.752448+0000","last_became_active":"2024-03-04T12:20:16.834080+0000","last_became_peered":"2024-03-04T12:20:16.834080+0000","last_unstale":"2024-03-04T13:13:44.752448+0000","last_undegraded":"2024-03-04T13:13:44.752448+0000","last_fullsized":"2024-03-04T13:13:44.752448+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'707","last_scrub_stamp":"2024-03-04T13:13:44.752324+0000","last_deep_scrub":"255'707","last_deep_scrub_stamp":"2024-03-04T13:13:44.752324+0000","last_clean_scrub_stamp":"2024-03-04T13:13:44.752324+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":600,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:08:30.399805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3097,"num_read_kb":2763,"num_write":935,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"255'239","reported_seq":924,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:09.700490+0000","last_change":"2024-03-04T13:14:09.700545+0000","last_active":"2024-03-04T13:14:09.700490+0000","last_peered":"2024-03-04T13:14:09.700490+0000","last_clean":"2024-03-04T13:14:09.700490+0000","last_became_active":"2024-03-04T12:20:14.814738+0000","last_became_peered":"2024-03-04T12:20:14.814738+0000","last_unstale":"2024-03-04T13:14:09.700490+0000","last_undegraded":"2024-03-04T13:14:09.700490+0000","last_fullsized":"2024-03-04T13:14:09.700490+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'239","last_scrub_stamp":"2024-03-04T13:14:09.700400+0000","last_deep_scrub":"255'239","last_deep_scrub_stamp":"2024-03-04T13:14:09.700400+0000","last_clean_scrub_stamp":"2024-03-04T13:14:09.700400+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:26:37.305525+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5787887,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":617,"num_read_kb":16203,"num_write":1488,"num_write_kb":37968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:02.915258+0000","last_change":"2024-03-04T13:14:02.915279+0000","last_active":"2024-03-04T13:14:02.915258+0000","last_peered":"2024-03-04T13:14:02.915258+0000","last_clean":"2024-03-04T13:14:02.915258+0000","last_became_active":"2024-03-04T12:20:18.834793+0000","last_became_peered":"2024-03-04T12:20:18.834793+0000","last_unstale":"2024-03-04T13:14:02.915258+0000","last_undegraded":"2024-03-04T13:14:02.915258+0000","last_fullsized":"2024-03-04T13:14:02.915258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:02.915163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:02.915163+0000","last_clean_scrub_stamp":"2024-03-04T13:14:02.915163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:15:22.172022+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"255'60","reported_seq":556,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:04.915589+0000","last_change":"2024-03-04T13:14:04.915619+0000","last_active":"2024-03-04T13:14:04.915589+0000","last_peered":"2024-03-04T13:14:04.915589+0000","last_clean":"2024-03-04T13:14:04.915589+0000","last_became_active":"2024-03-04T12:20:20.832034+0000","last_became_peered":"2024-03-04T12:20:20.832034+0000","last_unstale":"2024-03-04T13:14:04.915589+0000","last_undegraded":"2024-03-04T13:14:04.915589+0000","last_fullsized":"2024-03-04T13:14:04.915589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'60","last_scrub_stamp":"2024-03-04T13:14:04.915506+0000","last_deep_scrub":"255'60","last_deep_scrub_stamp":"2024-03-04T13:14:04.915506+0000","last_clean_scrub_stamp":"2024-03-04T13:14:04.915506+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:05:50.468935+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":40,"num_write":36,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":492,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.472980+0000","last_change":"2024-03-04T13:13:40.472980+0000","last_active":"2024-03-04T13:13:40.472980+0000","last_peered":"2024-03-04T13:13:40.472980+0000","last_clean":"2024-03-04T13:13:40.472980+0000","last_became_active":"2024-03-04T12:20:22.855477+0000","last_became_peered":"2024-03-04T12:20:22.855477+0000","last_unstale":"2024-03-04T13:13:40.472980+0000","last_undegraded":"2024-03-04T13:13:40.472980+0000","last_fullsized":"2024-03-04T13:13:40.472980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.472867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.472867+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.472867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:58:06.611427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"255'85","reported_seq":568,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.856034+0000","last_change":"2024-03-04T13:13:39.856065+0000","last_active":"2024-03-04T13:13:39.856034+0000","last_peered":"2024-03-04T13:13:39.856034+0000","last_clean":"2024-03-04T13:13:39.856034+0000","last_became_active":"2024-03-04T12:20:24.865534+0000","last_became_peered":"2024-03-04T12:20:24.865534+0000","last_unstale":"2024-03-04T13:13:39.856034+0000","last_undegraded":"2024-03-04T13:13:39.856034+0000","last_fullsized":"2024-03-04T13:13:39.856034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'85","last_scrub_stamp":"2024-03-04T13:13:39.855947+0000","last_deep_scrub":"255'85","last_deep_scrub_stamp":"2024-03-04T13:13:39.855947+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.855947+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:51:38.837480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":79,"num_read_kb":78,"num_write":202,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"255'719","reported_seq":2264,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:59.946137+0000","last_change":"2024-03-04T13:13:59.946163+0000","last_active":"2024-03-04T13:13:59.946137+0000","last_peered":"2024-03-04T13:13:59.946137+0000","last_clean":"2024-03-04T13:13:59.946137+0000","last_became_active":"2024-03-04T12:20:16.829012+0000","last_became_peered":"2024-03-04T12:20:16.829012+0000","last_unstale":"2024-03-04T13:13:59.946137+0000","last_undegraded":"2024-03-04T13:13:59.946137+0000","last_fullsized":"2024-03-04T13:13:59.946137+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'719","last_scrub_stamp":"2024-03-04T13:13:59.946053+0000","last_deep_scrub":"255'719","last_deep_scrub_stamp":"2024-03-04T13:13:59.946053+0000","last_clean_scrub_stamp":"2024-03-04T13:13:59.946053+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:41:21.063950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3304,"num_read_kb":2912,"num_write":1016,"num_write_kb":478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"255'181","reported_seq":875,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:04.542529+0000","last_change":"2024-03-04T13:14:04.542589+0000","last_active":"2024-03-04T13:14:04.542529+0000","last_peered":"2024-03-04T13:14:04.542529+0000","last_clean":"2024-03-04T13:14:04.542529+0000","last_became_active":"2024-03-04T12:20:14.822127+0000","last_became_peered":"2024-03-04T12:20:14.822127+0000","last_unstale":"2024-03-04T13:14:04.542529+0000","last_undegraded":"2024-03-04T13:14:04.542529+0000","last_fullsized":"2024-03-04T13:14:04.542529+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'181","last_scrub_stamp":"2024-03-04T13:14:04.542425+0000","last_deep_scrub":"255'181","last_deep_scrub_stamp":"2024-03-04T13:14:04.542425+0000","last_clean_scrub_stamp":"2024-03-04T13:14:04.542425+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:49:21.443373+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947361,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":518,"num_read_kb":182821,"num_write":997,"num_write_kb":40014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":500,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:55.711774+0000","last_change":"2024-03-04T13:13:55.711774+0000","last_active":"2024-03-04T13:13:55.711774+0000","last_peered":"2024-03-04T13:13:55.711774+0000","last_clean":"2024-03-04T13:13:55.711774+0000","last_became_active":"2024-03-04T12:20:18.830818+0000","last_became_peered":"2024-03-04T12:20:18.830818+0000","last_unstale":"2024-03-04T13:13:55.711774+0000","last_undegraded":"2024-03-04T13:13:55.711774+0000","last_fullsized":"2024-03-04T13:13:55.711774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:55.711646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:55.711646+0000","last_clean_scrub_stamp":"2024-03-04T13:13:55.711646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:25:47.095406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"255'169","reported_seq":754,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:06.918815+0000","last_change":"2024-03-04T13:14:06.918892+0000","last_active":"2024-03-04T13:14:06.918815+0000","last_peered":"2024-03-04T13:14:06.918815+0000","last_clean":"2024-03-04T13:14:06.918815+0000","last_became_active":"2024-03-04T12:20:20.840999+0000","last_became_peered":"2024-03-04T12:20:20.840999+0000","last_unstale":"2024-03-04T13:14:06.918815+0000","last_undegraded":"2024-03-04T13:14:06.918815+0000","last_fullsized":"2024-03-04T13:14:06.918815+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'169","last_scrub_stamp":"2024-03-04T13:14:06.918711+0000","last_deep_scrub":"255'169","last_deep_scrub_stamp":"2024-03-04T13:14:06.918711+0000","last_clean_scrub_stamp":"2024-03-04T13:14:06.918711+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:29:16.607806+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8097,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":284,"num_write":124,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.788169+0000","last_change":"2024-03-04T13:13:36.788169+0000","last_active":"2024-03-04T13:13:36.788169+0000","last_peered":"2024-03-04T13:13:36.788169+0000","last_clean":"2024-03-04T13:13:36.788169+0000","last_became_active":"2024-03-04T12:20:22.848877+0000","last_became_peered":"2024-03-04T12:20:22.848877+0000","last_unstale":"2024-03-04T13:13:36.788169+0000","last_undegraded":"2024-03-04T13:13:36.788169+0000","last_fullsized":"2024-03-04T13:13:36.788169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:36.788037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:36.788037+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.788037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:56:09.294578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"255'100","reported_seq":580,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.290495+0000","last_change":"2024-03-04T13:13:37.290529+0000","last_active":"2024-03-04T13:13:37.290495+0000","last_peered":"2024-03-04T13:13:37.290495+0000","last_clean":"2024-03-04T13:13:37.290495+0000","last_became_active":"2024-03-04T12:20:24.863810+0000","last_became_peered":"2024-03-04T12:20:24.863810+0000","last_unstale":"2024-03-04T13:13:37.290495+0000","last_undegraded":"2024-03-04T13:13:37.290495+0000","last_fullsized":"2024-03-04T13:13:37.290495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'100","last_scrub_stamp":"2024-03-04T13:13:37.290398+0000","last_deep_scrub":"255'100","last_deep_scrub_stamp":"2024-03-04T13:13:37.290398+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.290398+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:38:39.481362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":373,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":234,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"255'783","reported_seq":2324,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.757528+0000","last_change":"2024-03-04T13:13:33.757528+0000","last_active":"2024-03-04T13:13:33.757528+0000","last_peered":"2024-03-04T13:13:33.757528+0000","last_clean":"2024-03-04T13:13:33.757528+0000","last_became_active":"2024-03-04T12:20:51.031448+0000","last_became_peered":"2024-03-04T12:20:51.031448+0000","last_unstale":"2024-03-04T13:13:33.757528+0000","last_undegraded":"2024-03-04T13:13:33.757528+0000","last_fullsized":"2024-03-04T13:13:33.757528+0000","mapping_epoch":33,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'783","last_scrub_stamp":"2024-03-04T13:13:33.757424+0000","last_deep_scrub":"255'783","last_deep_scrub_stamp":"2024-03-04T13:13:33.757424+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.757424+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:34:41.258521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3519,"num_read_kb":3144,"num_write":1038,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":951,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"255'189","reported_seq":828,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:07.958989+0000","last_change":"2024-03-04T13:14:07.959025+0000","last_active":"2024-03-04T13:14:07.958989+0000","last_peered":"2024-03-04T13:14:07.958989+0000","last_clean":"2024-03-04T13:14:07.958989+0000","last_became_active":"2024-03-04T12:20:14.824152+0000","last_became_peered":"2024-03-04T12:20:14.824152+0000","last_unstale":"2024-03-04T13:14:07.958989+0000","last_undegraded":"2024-03-04T13:14:07.958989+0000","last_fullsized":"2024-03-04T13:14:07.958989+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'189","last_scrub_stamp":"2024-03-04T13:14:07.958892+0000","last_deep_scrub":"255'189","last_deep_scrub_stamp":"2024-03-04T13:14:07.958892+0000","last_clean_scrub_stamp":"2024-03-04T13:14:07.958892+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:31:55.043298+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259657,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":396,"num_read_kb":84164,"num_write":1039,"num_write_kb":34071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.767269+0000","last_change":"2024-03-04T13:13:37.767269+0000","last_active":"2024-03-04T13:13:37.767269+0000","last_peered":"2024-03-04T13:13:37.767269+0000","last_clean":"2024-03-04T13:13:37.767269+0000","last_became_active":"2024-03-04T12:20:18.838749+0000","last_became_peered":"2024-03-04T12:20:18.838749+0000","last_unstale":"2024-03-04T13:13:37.767269+0000","last_undegraded":"2024-03-04T13:13:37.767269+0000","last_fullsized":"2024-03-04T13:13:37.767269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:37.767153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:37.767153+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.767153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:00:15.356508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"255'129","reported_seq":703,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:03.707633+0000","last_change":"2024-03-04T13:14:03.707668+0000","last_active":"2024-03-04T13:14:03.707633+0000","last_peered":"2024-03-04T13:14:03.707633+0000","last_clean":"2024-03-04T13:14:03.707633+0000","last_became_active":"2024-03-04T12:20:20.839286+0000","last_became_peered":"2024-03-04T12:20:20.839286+0000","last_unstale":"2024-03-04T13:14:03.707633+0000","last_undegraded":"2024-03-04T13:14:03.707633+0000","last_fullsized":"2024-03-04T13:14:03.707633+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'129","last_scrub_stamp":"2024-03-04T13:14:03.707513+0000","last_deep_scrub":"255'129","last_deep_scrub_stamp":"2024-03-04T13:14:03.707513+0000","last_clean_scrub_stamp":"2024-03-04T13:14:03.707513+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:46:39.316497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6455,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":210,"num_write":82,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":480,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.806027+0000","last_change":"2024-03-04T13:13:47.806027+0000","last_active":"2024-03-04T13:13:47.806027+0000","last_peered":"2024-03-04T13:13:47.806027+0000","last_clean":"2024-03-04T13:13:47.806027+0000","last_became_active":"2024-03-04T12:20:22.849340+0000","last_became_peered":"2024-03-04T12:20:22.849340+0000","last_unstale":"2024-03-04T13:13:47.806027+0000","last_undegraded":"2024-03-04T13:13:47.806027+0000","last_fullsized":"2024-03-04T13:13:47.806027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:47.805916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:47.805916+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.805916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:20:34.391460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"255'415","reported_seq":1887,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:49.764209+0000","last_change":"2024-03-04T13:13:49.764209+0000","last_active":"2024-03-04T13:13:49.764209+0000","last_peered":"2024-03-04T13:13:49.764209+0000","last_clean":"2024-03-04T13:13:49.764209+0000","last_became_active":"2024-03-04T12:20:16.821451+0000","last_became_peered":"2024-03-04T12:20:16.821451+0000","last_unstale":"2024-03-04T13:13:49.764209+0000","last_undegraded":"2024-03-04T13:13:49.764209+0000","last_fullsized":"2024-03-04T13:13:49.764209+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'415","last_scrub_stamp":"2024-03-04T13:13:49.764092+0000","last_deep_scrub":"255'415","last_deep_scrub_stamp":"2024-03-04T13:13:49.764092+0000","last_clean_scrub_stamp":"2024-03-04T13:13:49.764092+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:10:01.819146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2212,"num_read_kb":2069,"num_write":499,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":970,"num_omap_keys":5,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"255'218","reported_seq":818,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:10.926251+0000","last_change":"2024-03-04T13:14:10.926343+0000","last_active":"2024-03-04T13:14:10.926251+0000","last_peered":"2024-03-04T13:14:10.926251+0000","last_clean":"2024-03-04T13:14:10.926251+0000","last_became_active":"2024-03-04T12:20:14.810309+0000","last_became_peered":"2024-03-04T12:20:14.810309+0000","last_unstale":"2024-03-04T13:14:10.926251+0000","last_undegraded":"2024-03-04T13:14:10.926251+0000","last_fullsized":"2024-03-04T13:14:10.926251+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'218","last_scrub_stamp":"2024-03-04T13:14:10.926148+0000","last_deep_scrub":"255'218","last_deep_scrub_stamp":"2024-03-04T13:14:10.926148+0000","last_clean_scrub_stamp":"2024-03-04T13:14:10.926148+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:38:09.958716+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195451,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":442,"num_read_kb":8634,"num_write":1082,"num_write_kb":36368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":492,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:02.836299+0000","last_change":"2024-03-04T13:14:02.836299+0000","last_active":"2024-03-04T13:14:02.836299+0000","last_peered":"2024-03-04T13:14:02.836299+0000","last_clean":"2024-03-04T13:14:02.836299+0000","last_became_active":"2024-03-04T12:20:18.833300+0000","last_became_peered":"2024-03-04T12:20:18.833300+0000","last_unstale":"2024-03-04T13:14:02.836299+0000","last_undegraded":"2024-03-04T13:14:02.836299+0000","last_fullsized":"2024-03-04T13:14:02.836299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:02.836144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:02.836144+0000","last_clean_scrub_stamp":"2024-03-04T13:14:02.836144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:17:29.936322+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"255'204","reported_seq":829,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:49.723580+0000","last_change":"2024-03-04T13:13:49.723610+0000","last_active":"2024-03-04T13:13:49.723580+0000","last_peered":"2024-03-04T13:13:49.723580+0000","last_clean":"2024-03-04T13:13:49.723580+0000","last_became_active":"2024-03-04T12:20:20.838600+0000","last_became_peered":"2024-03-04T12:20:20.838600+0000","last_unstale":"2024-03-04T13:13:49.723580+0000","last_undegraded":"2024-03-04T13:13:49.723580+0000","last_fullsized":"2024-03-04T13:13:49.723580+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'204","last_scrub_stamp":"2024-03-04T13:13:49.723498+0000","last_deep_scrub":"255'204","last_deep_scrub_stamp":"2024-03-04T13:13:49.723498+0000","last_clean_scrub_stamp":"2024-03-04T13:13:49.723498+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:33:27.828544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17172,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":287,"num_read_kb":431,"num_write":142,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":483,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.332740+0000","last_change":"2024-03-04T13:13:40.332764+0000","last_active":"2024-03-04T13:13:40.332740+0000","last_peered":"2024-03-04T13:13:40.332740+0000","last_clean":"2024-03-04T13:13:40.332740+0000","last_became_active":"2024-03-04T12:20:22.855464+0000","last_became_peered":"2024-03-04T12:20:22.855464+0000","last_unstale":"2024-03-04T13:13:40.332740+0000","last_undegraded":"2024-03-04T13:13:40.332740+0000","last_fullsized":"2024-03-04T13:13:40.332740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.332646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.332646+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.332646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:40:16.755252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"255'173","reported_seq":676,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.820025+0000","last_change":"2024-03-04T13:13:35.820025+0000","last_active":"2024-03-04T13:13:35.820025+0000","last_peered":"2024-03-04T13:13:35.820025+0000","last_clean":"2024-03-04T13:13:35.820025+0000","last_became_active":"2024-03-04T12:20:24.912118+0000","last_became_peered":"2024-03-04T12:20:24.912118+0000","last_unstale":"2024-03-04T13:13:35.820025+0000","last_undegraded":"2024-03-04T13:13:35.820025+0000","last_fullsized":"2024-03-04T13:13:35.820025+0000","mapping_epoch":30,"log_start":"250'100","ondisk_log_start":"250'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'173","last_scrub_stamp":"2024-03-04T13:13:35.819894+0000","last_deep_scrub":"255'173","last_deep_scrub_stamp":"2024-03-04T13:13:35.819894+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.819894+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:25:38.687294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":221,"num_read_kb":223,"num_write":386,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"255'446","reported_seq":1795,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:59.845499+0000","last_change":"2024-03-04T13:13:59.845499+0000","last_active":"2024-03-04T13:13:59.845499+0000","last_peered":"2024-03-04T13:13:59.845499+0000","last_clean":"2024-03-04T13:13:59.845499+0000","last_became_active":"2024-03-04T12:20:16.828550+0000","last_became_peered":"2024-03-04T12:20:16.828550+0000","last_unstale":"2024-03-04T13:13:59.845499+0000","last_undegraded":"2024-03-04T13:13:59.845499+0000","last_fullsized":"2024-03-04T13:13:59.845499+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'446","last_scrub_stamp":"2024-03-04T13:13:59.845377+0000","last_deep_scrub":"255'446","last_deep_scrub_stamp":"2024-03-04T13:13:59.845377+0000","last_clean_scrub_stamp":"2024-03-04T13:13:59.845377+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:43:11.440226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2172,"num_read_kb":1979,"num_write":576,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"255'156","reported_seq":737,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:59.682158+0000","last_change":"2024-03-04T13:13:59.682205+0000","last_active":"2024-03-04T13:13:59.682158+0000","last_peered":"2024-03-04T13:13:59.682158+0000","last_clean":"2024-03-04T13:13:59.682158+0000","last_became_active":"2024-03-04T12:20:14.811474+0000","last_became_peered":"2024-03-04T12:20:14.811474+0000","last_unstale":"2024-03-04T13:13:59.682158+0000","last_undegraded":"2024-03-04T13:13:59.682158+0000","last_fullsized":"2024-03-04T13:13:59.682158+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'156","last_scrub_stamp":"2024-03-04T13:13:59.682069+0000","last_deep_scrub":"255'156","last_deep_scrub_stamp":"2024-03-04T13:13:59.682069+0000","last_clean_scrub_stamp":"2024-03-04T13:13:59.682069+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:09:58.497427+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1943261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":293,"num_read_kb":3660,"num_write":933,"num_write_kb":16669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":498,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:39.756142+0000","last_change":"2024-03-04T13:13:39.756173+0000","last_active":"2024-03-04T13:13:39.756142+0000","last_peered":"2024-03-04T13:13:39.756142+0000","last_clean":"2024-03-04T13:13:39.756142+0000","last_became_active":"2024-03-04T12:20:18.836021+0000","last_became_peered":"2024-03-04T12:20:18.836021+0000","last_unstale":"2024-03-04T13:13:39.756142+0000","last_undegraded":"2024-03-04T13:13:39.756142+0000","last_fullsized":"2024-03-04T13:13:39.756142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:39.756043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:39.756043+0000","last_clean_scrub_stamp":"2024-03-04T13:13:39.756043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:03:04.157021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"255'174","reported_seq":764,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:01.728592+0000","last_change":"2024-03-04T13:14:01.728679+0000","last_active":"2024-03-04T13:14:01.728592+0000","last_peered":"2024-03-04T13:14:01.728592+0000","last_clean":"2024-03-04T13:14:01.728592+0000","last_became_active":"2024-03-04T12:20:20.838216+0000","last_became_peered":"2024-03-04T12:20:20.838216+0000","last_unstale":"2024-03-04T13:14:01.728592+0000","last_undegraded":"2024-03-04T13:14:01.728592+0000","last_fullsized":"2024-03-04T13:14:01.728592+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'174","last_scrub_stamp":"2024-03-04T13:14:01.728502+0000","last_deep_scrub":"255'174","last_deep_scrub_stamp":"2024-03-04T13:14:01.728502+0000","last_clean_scrub_stamp":"2024-03-04T13:14:01.728502+0000","objects_scrubbed":8,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:38:38.376317+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12653,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":241,"num_read_kb":319,"num_write":160,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":484,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.818606+0000","last_change":"2024-03-04T13:13:40.818631+0000","last_active":"2024-03-04T13:13:40.818606+0000","last_peered":"2024-03-04T13:13:40.818606+0000","last_clean":"2024-03-04T13:13:40.818606+0000","last_became_active":"2024-03-04T12:20:22.856471+0000","last_became_peered":"2024-03-04T12:20:22.856471+0000","last_unstale":"2024-03-04T13:13:40.818606+0000","last_undegraded":"2024-03-04T13:13:40.818606+0000","last_fullsized":"2024-03-04T13:13:40.818606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.818507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.818507+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.818507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:04:44.522601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"255'166","reported_seq":1019,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:48.754200+0000","last_change":"2024-03-04T13:13:48.754200+0000","last_active":"2024-03-04T13:13:48.754200+0000","last_peered":"2024-03-04T13:13:48.754200+0000","last_clean":"2024-03-04T13:13:48.754200+0000","last_became_active":"2024-03-04T12:20:24.863291+0000","last_became_peered":"2024-03-04T12:20:24.863291+0000","last_unstale":"2024-03-04T13:13:48.754200+0000","last_undegraded":"2024-03-04T13:13:48.754200+0000","last_fullsized":"2024-03-04T13:13:48.754200+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'166","last_scrub_stamp":"2024-03-04T13:13:48.754066+0000","last_deep_scrub":"255'166","last_deep_scrub_stamp":"2024-03-04T13:13:48.754066+0000","last_clean_scrub_stamp":"2024-03-04T13:13:48.754066+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:02:22.055722+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1530,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":567,"num_read_kb":564,"num_write":466,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"255'447","reported_seq":1860,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:33.048758+0000","last_change":"2024-03-04T13:13:33.048795+0000","last_active":"2024-03-04T13:13:33.048758+0000","last_peered":"2024-03-04T13:13:33.048758+0000","last_clean":"2024-03-04T13:13:33.048758+0000","last_became_active":"2024-03-04T12:20:50.905894+0000","last_became_peered":"2024-03-04T12:20:50.905894+0000","last_unstale":"2024-03-04T13:13:33.048758+0000","last_undegraded":"2024-03-04T13:13:33.048758+0000","last_fullsized":"2024-03-04T13:13:33.048758+0000","mapping_epoch":33,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'447","last_scrub_stamp":"2024-03-04T13:13:33.048662+0000","last_deep_scrub":"255'447","last_deep_scrub_stamp":"2024-03-04T13:13:33.048662+0000","last_clean_scrub_stamp":"2024-03-04T13:13:33.048662+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:52:48.190455+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2307,"num_read_kb":2145,"num_write":589,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"255'296","reported_seq":1059,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:03.103648+0000","last_change":"2024-03-04T13:14:03.103733+0000","last_active":"2024-03-04T13:14:03.103648+0000","last_peered":"2024-03-04T13:14:03.103648+0000","last_clean":"2024-03-04T13:14:03.103648+0000","last_became_active":"2024-03-04T12:20:14.816522+0000","last_became_peered":"2024-03-04T12:20:14.816522+0000","last_unstale":"2024-03-04T13:14:03.103648+0000","last_undegraded":"2024-03-04T13:14:03.103648+0000","last_fullsized":"2024-03-04T13:14:03.103648+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'296","last_scrub_stamp":"2024-03-04T13:14:03.103553+0000","last_deep_scrub":"255'296","last_deep_scrub_stamp":"2024-03-04T13:14:03.103553+0000","last_clean_scrub_stamp":"2024-03-04T13:14:03.103553+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:27:46.251297+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291510,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":856,"num_read_kb":55073,"num_write":1469,"num_write_kb":53223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:59.120054+0000","last_change":"2024-03-04T13:13:59.120093+0000","last_active":"2024-03-04T13:13:59.120054+0000","last_peered":"2024-03-04T13:13:59.120054+0000","last_clean":"2024-03-04T13:13:59.120054+0000","last_became_active":"2024-03-04T12:20:18.831535+0000","last_became_peered":"2024-03-04T12:20:18.831535+0000","last_unstale":"2024-03-04T13:13:59.120054+0000","last_undegraded":"2024-03-04T13:13:59.120054+0000","last_fullsized":"2024-03-04T13:13:59.120054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:59.119910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:59.119910+0000","last_clean_scrub_stamp":"2024-03-04T13:13:59.119910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:39:30.503734+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"255'153","reported_seq":725,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:49.891944+0000","last_change":"2024-03-04T13:13:49.892009+0000","last_active":"2024-03-04T13:13:49.891944+0000","last_peered":"2024-03-04T13:13:49.891944+0000","last_clean":"2024-03-04T13:13:49.891944+0000","last_became_active":"2024-03-04T12:20:21.641872+0000","last_became_peered":"2024-03-04T12:20:21.641872+0000","last_unstale":"2024-03-04T13:13:49.891944+0000","last_undegraded":"2024-03-04T13:13:49.891944+0000","last_fullsized":"2024-03-04T13:13:49.891944+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'153","last_scrub_stamp":"2024-03-04T13:13:49.891864+0000","last_deep_scrub":"255'153","last_deep_scrub_stamp":"2024-03-04T13:13:49.891864+0000","last_clean_scrub_stamp":"2024-03-04T13:13:49.891864+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:49:25.945375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6408,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":262,"num_write":108,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:05.580612+0000","last_change":"2024-03-04T13:14:05.580612+0000","last_active":"2024-03-04T13:14:05.580612+0000","last_peered":"2024-03-04T13:14:05.580612+0000","last_clean":"2024-03-04T13:14:05.580612+0000","last_became_active":"2024-03-04T12:20:22.854454+0000","last_became_peered":"2024-03-04T12:20:22.854454+0000","last_unstale":"2024-03-04T13:14:05.580612+0000","last_undegraded":"2024-03-04T13:14:05.580612+0000","last_fullsized":"2024-03-04T13:14:05.580612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:14:05.580441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:14:05.580441+0000","last_clean_scrub_stamp":"2024-03-04T13:14:05.580441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:23:49.950310+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"255'103","reported_seq":588,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.313257+0000","last_change":"2024-03-04T13:13:38.313257+0000","last_active":"2024-03-04T13:13:38.313257+0000","last_peered":"2024-03-04T13:13:38.313257+0000","last_clean":"2024-03-04T13:13:38.313257+0000","last_became_active":"2024-03-04T12:20:24.862179+0000","last_became_peered":"2024-03-04T12:20:24.862179+0000","last_unstale":"2024-03-04T13:13:38.313257+0000","last_undegraded":"2024-03-04T13:13:38.313257+0000","last_fullsized":"2024-03-04T13:13:38.313257+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'103","last_scrub_stamp":"2024-03-04T13:13:38.313124+0000","last_deep_scrub":"255'103","last_deep_scrub_stamp":"2024-03-04T13:13:38.313124+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.313124+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:14:30.991089+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":90,"num_write":249,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"255'456","reported_seq":1917,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:52.192318+0000","last_change":"2024-03-04T13:13:52.192366+0000","last_active":"2024-03-04T13:13:52.192318+0000","last_peered":"2024-03-04T13:13:52.192318+0000","last_clean":"2024-03-04T13:13:52.192318+0000","last_became_active":"2024-03-04T12:20:16.836224+0000","last_became_peered":"2024-03-04T12:20:16.836224+0000","last_unstale":"2024-03-04T13:13:52.192318+0000","last_undegraded":"2024-03-04T13:13:52.192318+0000","last_fullsized":"2024-03-04T13:13:52.192318+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'456","last_scrub_stamp":"2024-03-04T13:13:52.192220+0000","last_deep_scrub":"255'456","last_deep_scrub_stamp":"2024-03-04T13:13:52.192220+0000","last_clean_scrub_stamp":"2024-03-04T13:13:52.192220+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:41:47.988147+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2418,"num_read_kb":2273,"num_write":600,"num_write_kb":182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2192,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"255'191","reported_seq":790,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:13.957143+0000","last_change":"2024-03-04T13:14:13.957186+0000","last_active":"2024-03-04T13:14:13.957143+0000","last_peered":"2024-03-04T13:14:13.957143+0000","last_clean":"2024-03-04T13:14:13.957143+0000","last_became_active":"2024-03-04T12:20:14.820789+0000","last_became_peered":"2024-03-04T12:20:14.820789+0000","last_unstale":"2024-03-04T13:14:13.957143+0000","last_undegraded":"2024-03-04T13:14:13.957143+0000","last_fullsized":"2024-03-04T13:14:13.957143+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'191","last_scrub_stamp":"2024-03-04T13:14:13.957054+0000","last_deep_scrub":"255'191","last_deep_scrub_stamp":"2024-03-04T13:14:13.957054+0000","last_clean_scrub_stamp":"2024-03-04T13:14:13.957054+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:19:10.367896+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":398,"num_read_kb":8887,"num_write":907,"num_write_kb":18227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":492,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.739148+0000","last_change":"2024-03-04T13:13:47.739171+0000","last_active":"2024-03-04T13:13:47.739148+0000","last_peered":"2024-03-04T13:13:47.739148+0000","last_clean":"2024-03-04T13:13:47.739148+0000","last_became_active":"2024-03-04T12:20:18.837949+0000","last_became_peered":"2024-03-04T12:20:18.837949+0000","last_unstale":"2024-03-04T13:13:47.739148+0000","last_undegraded":"2024-03-04T13:13:47.739148+0000","last_fullsized":"2024-03-04T13:13:47.739148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:47.739056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:47.739056+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.739056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:46:50.171454+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"255'90","reported_seq":618,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.216707+0000","last_change":"2024-03-04T13:13:40.216707+0000","last_active":"2024-03-04T13:13:40.216707+0000","last_peered":"2024-03-04T13:13:40.216707+0000","last_clean":"2024-03-04T13:13:40.216707+0000","last_became_active":"2024-03-04T12:20:21.641757+0000","last_became_peered":"2024-03-04T12:20:21.641757+0000","last_unstale":"2024-03-04T13:13:40.216707+0000","last_undegraded":"2024-03-04T13:13:40.216707+0000","last_fullsized":"2024-03-04T13:13:40.216707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'90","last_scrub_stamp":"2024-03-04T13:13:40.216584+0000","last_deep_scrub":"255'90","last_deep_scrub_stamp":"2024-03-04T13:13:40.216584+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.216584+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:25:35.856391+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":90,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"255'498","reported_seq":3573,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.721050+0000","last_change":"2024-03-04T13:13:42.721079+0000","last_active":"2024-03-04T13:13:42.721050+0000","last_peered":"2024-03-04T13:13:42.721050+0000","last_clean":"2024-03-04T13:13:42.721050+0000","last_became_active":"2024-03-04T12:20:22.849630+0000","last_became_peered":"2024-03-04T12:20:22.849630+0000","last_unstale":"2024-03-04T13:13:42.721050+0000","last_undegraded":"2024-03-04T13:13:42.721050+0000","last_fullsized":"2024-03-04T13:13:42.721050+0000","mapping_epoch":28,"log_start":"250'400","ondisk_log_start":"250'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'498","last_scrub_stamp":"2024-03-04T13:13:42.720946+0000","last_deep_scrub":"255'498","last_deep_scrub_stamp":"2024-03-04T13:13:42.720946+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.720946+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:55:37.618879+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"255'142","reported_seq":640,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:38.502316+0000","last_change":"2024-03-04T13:13:38.502316+0000","last_active":"2024-03-04T13:13:38.502316+0000","last_peered":"2024-03-04T13:13:38.502316+0000","last_clean":"2024-03-04T13:13:38.502316+0000","last_became_active":"2024-03-04T12:20:24.863312+0000","last_became_peered":"2024-03-04T12:20:24.863312+0000","last_unstale":"2024-03-04T13:13:38.502316+0000","last_undegraded":"2024-03-04T13:13:38.502316+0000","last_fullsized":"2024-03-04T13:13:38.502316+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'142","last_scrub_stamp":"2024-03-04T13:13:38.502185+0000","last_deep_scrub":"255'142","last_deep_scrub_stamp":"2024-03-04T13:13:38.502185+0000","last_clean_scrub_stamp":"2024-03-04T13:13:38.502185+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:22:25.568903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":88,"num_write":307,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"255'561","reported_seq":2218,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:53.198409+0000","last_change":"2024-03-04T13:13:53.198444+0000","last_active":"2024-03-04T13:13:53.198409+0000","last_peered":"2024-03-04T13:13:53.198409+0000","last_clean":"2024-03-04T13:13:53.198409+0000","last_became_active":"2024-03-04T12:20:16.828102+0000","last_became_peered":"2024-03-04T12:20:16.828102+0000","last_unstale":"2024-03-04T13:13:53.198409+0000","last_undegraded":"2024-03-04T13:13:53.198409+0000","last_fullsized":"2024-03-04T13:13:53.198409+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'561","last_scrub_stamp":"2024-03-04T13:13:53.198310+0000","last_deep_scrub":"255'561","last_deep_scrub_stamp":"2024-03-04T13:13:53.198310+0000","last_clean_scrub_stamp":"2024-03-04T13:13:53.198310+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:32:36.820715+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2984,"num_read_kb":2771,"num_write":760,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":148,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"255'209","reported_seq":852,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:56.446947+0000","last_change":"2024-03-04T13:13:56.446987+0000","last_active":"2024-03-04T13:13:56.446947+0000","last_peered":"2024-03-04T13:13:56.446947+0000","last_clean":"2024-03-04T13:13:56.446947+0000","last_became_active":"2024-03-04T12:20:14.826522+0000","last_became_peered":"2024-03-04T12:20:14.826522+0000","last_unstale":"2024-03-04T13:13:56.446947+0000","last_undegraded":"2024-03-04T13:13:56.446947+0000","last_fullsized":"2024-03-04T13:13:56.446947+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'209","last_scrub_stamp":"2024-03-04T13:13:56.446859+0000","last_deep_scrub":"255'209","last_deep_scrub_stamp":"2024-03-04T13:13:56.446859+0000","last_clean_scrub_stamp":"2024-03-04T13:13:56.446859+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:14:35.719559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27217,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":463,"num_read_kb":10394,"num_write":1165,"num_write_kb":28391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":498,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:59.694042+0000","last_change":"2024-03-04T13:13:59.694078+0000","last_active":"2024-03-04T13:13:59.694042+0000","last_peered":"2024-03-04T13:13:59.694042+0000","last_clean":"2024-03-04T13:13:59.694042+0000","last_became_active":"2024-03-04T12:20:18.832607+0000","last_became_peered":"2024-03-04T12:20:18.832607+0000","last_unstale":"2024-03-04T13:13:59.694042+0000","last_undegraded":"2024-03-04T13:13:59.694042+0000","last_fullsized":"2024-03-04T13:13:59.694042+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:59.693943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:59.693943+0000","last_clean_scrub_stamp":"2024-03-04T13:13:59.693943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:57:17.840373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"255'183","reported_seq":767,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:59.495009+0000","last_change":"2024-03-04T13:13:59.495050+0000","last_active":"2024-03-04T13:13:59.495009+0000","last_peered":"2024-03-04T13:13:59.495009+0000","last_clean":"2024-03-04T13:13:59.495009+0000","last_became_active":"2024-03-04T12:20:20.838062+0000","last_became_peered":"2024-03-04T12:20:20.838062+0000","last_unstale":"2024-03-04T13:13:59.495009+0000","last_undegraded":"2024-03-04T13:13:59.495009+0000","last_fullsized":"2024-03-04T13:13:59.495009+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'183","last_scrub_stamp":"2024-03-04T13:13:59.494923+0000","last_deep_scrub":"255'183","last_deep_scrub_stamp":"2024-03-04T13:13:59.494923+0000","last_clean_scrub_stamp":"2024-03-04T13:13:59.494923+0000","objects_scrubbed":9,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:21:01.495138+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8941,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":239,"num_read_kb":314,"num_write":142,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":479,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.813164+0000","last_change":"2024-03-04T13:13:41.813187+0000","last_active":"2024-03-04T13:13:41.813164+0000","last_peered":"2024-03-04T13:13:41.813164+0000","last_clean":"2024-03-04T13:13:41.813164+0000","last_became_active":"2024-03-04T12:20:22.856540+0000","last_became_peered":"2024-03-04T12:20:22.856540+0000","last_unstale":"2024-03-04T13:13:41.813164+0000","last_undegraded":"2024-03-04T13:13:41.813164+0000","last_fullsized":"2024-03-04T13:13:41.813164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:41.813077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:41.813077+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.813077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:29:39.366211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"255'90","reported_seq":586,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.486308+0000","last_change":"2024-03-04T13:13:36.486308+0000","last_active":"2024-03-04T13:13:36.486308+0000","last_peered":"2024-03-04T13:13:36.486308+0000","last_clean":"2024-03-04T13:13:36.486308+0000","last_became_active":"2024-03-04T12:20:24.866984+0000","last_became_peered":"2024-03-04T12:20:24.866984+0000","last_unstale":"2024-03-04T13:13:36.486308+0000","last_undegraded":"2024-03-04T13:13:36.486308+0000","last_fullsized":"2024-03-04T13:13:36.486308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'90","last_scrub_stamp":"2024-03-04T13:13:36.486181+0000","last_deep_scrub":"255'90","last_deep_scrub_stamp":"2024-03-04T13:13:36.486181+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.486181+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:49:23.190861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":388,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":81,"num_write":221,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"255'842","reported_seq":2378,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:51.269256+0000","last_change":"2024-03-04T13:13:51.269286+0000","last_active":"2024-03-04T13:13:51.269256+0000","last_peered":"2024-03-04T13:13:51.269256+0000","last_clean":"2024-03-04T13:13:51.269256+0000","last_became_active":"2024-03-04T12:20:16.827592+0000","last_became_peered":"2024-03-04T12:20:16.827592+0000","last_unstale":"2024-03-04T13:13:51.269256+0000","last_undegraded":"2024-03-04T13:13:51.269256+0000","last_fullsized":"2024-03-04T13:13:51.269256+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'842","last_scrub_stamp":"2024-03-04T13:13:51.269152+0000","last_deep_scrub":"255'842","last_deep_scrub_stamp":"2024-03-04T13:13:51.269152+0000","last_clean_scrub_stamp":"2024-03-04T13:13:51.269152+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:33:21.928001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3846,"num_read_kb":3408,"num_write":1191,"num_write_kb":522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"255'227","reported_seq":868,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:58.450512+0000","last_change":"2024-03-04T13:13:58.450542+0000","last_active":"2024-03-04T13:13:58.450512+0000","last_peered":"2024-03-04T13:13:58.450512+0000","last_clean":"2024-03-04T13:13:58.450512+0000","last_became_active":"2024-03-04T12:20:14.827034+0000","last_became_peered":"2024-03-04T12:20:14.827034+0000","last_unstale":"2024-03-04T13:13:58.450512+0000","last_undegraded":"2024-03-04T13:13:58.450512+0000","last_fullsized":"2024-03-04T13:13:58.450512+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'227","last_scrub_stamp":"2024-03-04T13:13:58.450430+0000","last_deep_scrub":"255'227","last_deep_scrub_stamp":"2024-03-04T13:13:58.450430+0000","last_clean_scrub_stamp":"2024-03-04T13:13:58.450430+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:19:32.009378+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262163,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":510,"num_read_kb":74328,"num_write":1121,"num_write_kb":53240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":491,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:53.444157+0000","last_change":"2024-03-04T13:13:53.444214+0000","last_active":"2024-03-04T13:13:53.444157+0000","last_peered":"2024-03-04T13:13:53.444157+0000","last_clean":"2024-03-04T13:13:53.444157+0000","last_became_active":"2024-03-04T12:20:18.835852+0000","last_became_peered":"2024-03-04T12:20:18.835852+0000","last_unstale":"2024-03-04T13:13:53.444157+0000","last_undegraded":"2024-03-04T13:13:53.444157+0000","last_fullsized":"2024-03-04T13:13:53.444157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:53.444055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:53.444055+0000","last_clean_scrub_stamp":"2024-03-04T13:13:53.444055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:08:46.993330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"255'139","reported_seq":700,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:16.984249+0000","last_change":"2024-03-04T13:14:16.984324+0000","last_active":"2024-03-04T13:14:16.984249+0000","last_peered":"2024-03-04T13:14:16.984249+0000","last_clean":"2024-03-04T13:14:16.984249+0000","last_became_active":"2024-03-04T12:20:20.837239+0000","last_became_peered":"2024-03-04T12:20:20.837239+0000","last_unstale":"2024-03-04T13:14:16.984249+0000","last_undegraded":"2024-03-04T13:14:16.984249+0000","last_fullsized":"2024-03-04T13:14:16.984249+0000","mapping_epoch":26,"log_start":"255'100","ondisk_log_start":"255'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'139","last_scrub_stamp":"2024-03-04T13:14:16.984152+0000","last_deep_scrub":"255'139","last_deep_scrub_stamp":"2024-03-04T13:14:16.984152+0000","last_clean_scrub_stamp":"2024-03-04T13:14:16.984152+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:19:23.793178+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7816,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":167,"num_read_kb":230,"num_write":86,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.752812+0000","last_change":"2024-03-04T13:13:40.752812+0000","last_active":"2024-03-04T13:13:40.752812+0000","last_peered":"2024-03-04T13:13:40.752812+0000","last_clean":"2024-03-04T13:13:40.752812+0000","last_became_active":"2024-03-04T12:20:22.849731+0000","last_became_peered":"2024-03-04T12:20:22.849731+0000","last_unstale":"2024-03-04T13:13:40.752812+0000","last_undegraded":"2024-03-04T13:13:40.752812+0000","last_fullsized":"2024-03-04T13:13:40.752812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.752696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.752696+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.752696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:38:32.905040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"255'121","reported_seq":629,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:34.770329+0000","last_change":"2024-03-04T13:13:34.770329+0000","last_active":"2024-03-04T13:13:34.770329+0000","last_peered":"2024-03-04T13:13:34.770329+0000","last_clean":"2024-03-04T13:13:34.770329+0000","last_became_active":"2024-03-04T12:20:24.912599+0000","last_became_peered":"2024-03-04T12:20:24.912599+0000","last_unstale":"2024-03-04T13:13:34.770329+0000","last_undegraded":"2024-03-04T13:13:34.770329+0000","last_fullsized":"2024-03-04T13:13:34.770329+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'121","last_scrub_stamp":"2024-03-04T13:13:34.770155+0000","last_deep_scrub":"255'121","last_deep_scrub_stamp":"2024-03-04T13:13:34.770155+0000","last_clean_scrub_stamp":"2024-03-04T13:13:34.770155+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:15:31.167821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":888,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":158,"num_read_kb":157,"num_write":287,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"255'1177","reported_seq":2759,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:05.926161+0000","last_change":"2024-03-04T13:14:05.926197+0000","last_active":"2024-03-04T13:14:05.926161+0000","last_peered":"2024-03-04T13:14:05.926161+0000","last_clean":"2024-03-04T13:14:05.926161+0000","last_became_active":"2024-03-04T12:20:16.827448+0000","last_became_peered":"2024-03-04T12:20:16.827448+0000","last_unstale":"2024-03-04T13:14:05.926161+0000","last_undegraded":"2024-03-04T13:14:05.926161+0000","last_fullsized":"2024-03-04T13:14:05.926161+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1177","last_scrub_stamp":"2024-03-04T13:14:05.926074+0000","last_deep_scrub":"255'1177","last_deep_scrub_stamp":"2024-03-04T13:14:05.926074+0000","last_clean_scrub_stamp":"2024-03-04T13:14:05.926074+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":1100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:09:43.948277+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5284,"num_read_kb":4621,"num_write":1652,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2634,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"255'224","reported_seq":864,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:09.929752+0000","last_change":"2024-03-04T13:14:09.929752+0000","last_active":"2024-03-04T13:14:09.929752+0000","last_peered":"2024-03-04T13:14:09.929752+0000","last_clean":"2024-03-04T13:14:09.929752+0000","last_became_active":"2024-03-04T12:20:14.822619+0000","last_became_peered":"2024-03-04T12:20:14.822619+0000","last_unstale":"2024-03-04T13:14:09.929752+0000","last_undegraded":"2024-03-04T13:14:09.929752+0000","last_fullsized":"2024-03-04T13:14:09.929752+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'224","last_scrub_stamp":"2024-03-04T13:14:09.929614+0000","last_deep_scrub":"255'224","last_deep_scrub_stamp":"2024-03-04T13:14:09.929614+0000","last_clean_scrub_stamp":"2024-03-04T13:14:09.929614+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:43:39.939492+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9035448,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":16616,"num_write":1088,"num_write_kb":32501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:57.157742+0000","last_change":"2024-03-04T13:13:57.157764+0000","last_active":"2024-03-04T13:13:57.157742+0000","last_peered":"2024-03-04T13:13:57.157742+0000","last_clean":"2024-03-04T13:13:57.157742+0000","last_became_active":"2024-03-04T12:20:18.831105+0000","last_became_peered":"2024-03-04T12:20:18.831105+0000","last_unstale":"2024-03-04T13:13:57.157742+0000","last_undegraded":"2024-03-04T13:13:57.157742+0000","last_fullsized":"2024-03-04T13:13:57.157742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:57.157635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:57.157635+0000","last_clean_scrub_stamp":"2024-03-04T13:13:57.157635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:53:03.444698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"255'102","reported_seq":652,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:18.938559+0000","last_change":"2024-03-04T13:14:18.938608+0000","last_active":"2024-03-04T13:14:18.938559+0000","last_peered":"2024-03-04T13:14:18.938559+0000","last_clean":"2024-03-04T13:14:18.938559+0000","last_became_active":"2024-03-04T12:20:20.842361+0000","last_became_peered":"2024-03-04T12:20:20.842361+0000","last_unstale":"2024-03-04T13:14:18.938559+0000","last_undegraded":"2024-03-04T13:14:18.938559+0000","last_fullsized":"2024-03-04T13:14:18.938559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'102","last_scrub_stamp":"2024-03-04T13:14:18.938444+0000","last_deep_scrub":"255'102","last_deep_scrub_stamp":"2024-03-04T13:14:18.938444+0000","last_clean_scrub_stamp":"2024-03-04T13:14:18.938444+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:32:01.875685+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5519,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":178,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:36.171567+0000","last_change":"2024-03-04T13:13:36.171595+0000","last_active":"2024-03-04T13:13:36.171567+0000","last_peered":"2024-03-04T13:13:36.171567+0000","last_clean":"2024-03-04T13:13:36.171567+0000","last_became_active":"2024-03-04T12:20:22.856748+0000","last_became_peered":"2024-03-04T12:20:22.856748+0000","last_unstale":"2024-03-04T13:13:36.171567+0000","last_undegraded":"2024-03-04T13:13:36.171567+0000","last_fullsized":"2024-03-04T13:13:36.171567+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:36.171482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:36.171482+0000","last_clean_scrub_stamp":"2024-03-04T13:13:36.171482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:01:15.968186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"255'150","reported_seq":1202,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:37.495689+0000","last_change":"2024-03-04T13:13:37.495689+0000","last_active":"2024-03-04T13:13:37.495689+0000","last_peered":"2024-03-04T13:13:37.495689+0000","last_clean":"2024-03-04T13:13:37.495689+0000","last_became_active":"2024-03-04T12:20:24.865363+0000","last_became_peered":"2024-03-04T12:20:24.865363+0000","last_unstale":"2024-03-04T13:13:37.495689+0000","last_undegraded":"2024-03-04T13:13:37.495689+0000","last_fullsized":"2024-03-04T13:13:37.495689+0000","mapping_epoch":30,"log_start":"255'100","ondisk_log_start":"255'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'150","last_scrub_stamp":"2024-03-04T13:13:37.495521+0000","last_deep_scrub":"255'150","last_deep_scrub_stamp":"2024-03-04T13:13:37.495521+0000","last_clean_scrub_stamp":"2024-03-04T13:13:37.495521+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:07:28.025150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":819,"num_read_kb":785,"num_write":355,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"255'726","reported_seq":2142,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:10.180797+0000","last_change":"2024-03-04T13:14:10.180826+0000","last_active":"2024-03-04T13:14:10.180797+0000","last_peered":"2024-03-04T13:14:10.180797+0000","last_clean":"2024-03-04T13:14:10.180797+0000","last_became_active":"2024-03-04T12:20:16.819966+0000","last_became_peered":"2024-03-04T12:20:16.819966+0000","last_unstale":"2024-03-04T13:14:10.180797+0000","last_undegraded":"2024-03-04T13:14:10.180797+0000","last_fullsized":"2024-03-04T13:14:10.180797+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'726","last_scrub_stamp":"2024-03-04T13:14:10.180701+0000","last_deep_scrub":"255'726","last_deep_scrub_stamp":"2024-03-04T13:14:10.180701+0000","last_clean_scrub_stamp":"2024-03-04T13:14:10.180701+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:42:40.070110+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3297,"num_read_kb":2935,"num_write":968,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"255'284","reported_seq":939,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:05.953680+0000","last_change":"2024-03-04T13:14:05.953680+0000","last_active":"2024-03-04T13:14:05.953680+0000","last_peered":"2024-03-04T13:14:05.953680+0000","last_clean":"2024-03-04T13:14:05.953680+0000","last_became_active":"2024-03-04T12:20:14.824168+0000","last_became_peered":"2024-03-04T12:20:14.824168+0000","last_unstale":"2024-03-04T13:14:05.953680+0000","last_undegraded":"2024-03-04T13:14:05.953680+0000","last_fullsized":"2024-03-04T13:14:05.953680+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'284","last_scrub_stamp":"2024-03-04T13:14:05.953500+0000","last_deep_scrub":"255'284","last_deep_scrub_stamp":"2024-03-04T13:14:05.953500+0000","last_clean_scrub_stamp":"2024-03-04T13:14:05.953500+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:20:23.518865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":709,"num_read_kb":4351,"num_write":1165,"num_write_kb":19276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"255'2","reported_seq":495,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:41.776023+0000","last_change":"2024-03-04T13:13:41.776049+0000","last_active":"2024-03-04T13:13:41.776023+0000","last_peered":"2024-03-04T13:13:41.776023+0000","last_clean":"2024-03-04T13:13:41.776023+0000","last_became_active":"2024-03-04T12:20:18.836203+0000","last_became_peered":"2024-03-04T12:20:18.836203+0000","last_unstale":"2024-03-04T13:13:41.776023+0000","last_undegraded":"2024-03-04T13:13:41.776023+0000","last_fullsized":"2024-03-04T13:13:41.776023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'2","last_scrub_stamp":"2024-03-04T13:13:41.775929+0000","last_deep_scrub":"255'2","last_deep_scrub_stamp":"2024-03-04T13:13:41.775929+0000","last_clean_scrub_stamp":"2024-03-04T13:13:41.775929+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T22:50:48.463948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"255'164","reported_seq":749,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.295997+0000","last_change":"2024-03-04T13:13:42.296030+0000","last_active":"2024-03-04T13:13:42.295997+0000","last_peered":"2024-03-04T13:13:42.295997+0000","last_clean":"2024-03-04T13:13:42.295997+0000","last_became_active":"2024-03-04T12:20:20.842246+0000","last_became_peered":"2024-03-04T12:20:20.842246+0000","last_unstale":"2024-03-04T13:13:42.295997+0000","last_undegraded":"2024-03-04T13:13:42.295997+0000","last_fullsized":"2024-03-04T13:13:42.295997+0000","mapping_epoch":26,"log_start":"250'100","ondisk_log_start":"250'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'164","last_scrub_stamp":"2024-03-04T13:13:42.295912+0000","last_deep_scrub":"255'164","last_deep_scrub_stamp":"2024-03-04T13:13:42.295912+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.295912+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:11:48.208552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15485,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":208,"num_read_kb":255,"num_write":114,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:40.837055+0000","last_change":"2024-03-04T13:13:40.837077+0000","last_active":"2024-03-04T13:13:40.837055+0000","last_peered":"2024-03-04T13:13:40.837055+0000","last_clean":"2024-03-04T13:13:40.837055+0000","last_became_active":"2024-03-04T12:20:22.856597+0000","last_became_peered":"2024-03-04T12:20:22.856597+0000","last_unstale":"2024-03-04T13:13:40.837055+0000","last_undegraded":"2024-03-04T13:13:40.837055+0000","last_fullsized":"2024-03-04T13:13:40.837055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-04T13:13:40.836958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-04T13:13:40.836958+0000","last_clean_scrub_stamp":"2024-03-04T13:13:40.836958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:40:36.037380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"255'91","reported_seq":579,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.180186+0000","last_change":"2024-03-04T13:13:35.180186+0000","last_active":"2024-03-04T13:13:35.180186+0000","last_peered":"2024-03-04T13:13:35.180186+0000","last_clean":"2024-03-04T13:13:35.180186+0000","last_became_active":"2024-03-04T12:20:24.869207+0000","last_became_peered":"2024-03-04T12:20:24.869207+0000","last_unstale":"2024-03-04T13:13:35.180186+0000","last_undegraded":"2024-03-04T13:13:35.180186+0000","last_fullsized":"2024-03-04T13:13:35.180186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'91","last_scrub_stamp":"2024-03-04T13:13:35.180028+0000","last_deep_scrub":"255'91","last_deep_scrub_stamp":"2024-03-04T13:13:35.180028+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.180028+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:13:14.165397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":212,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"255'1093","reported_seq":2668,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.729763+0000","last_change":"2024-03-04T13:13:46.729763+0000","last_active":"2024-03-04T13:13:46.729763+0000","last_peered":"2024-03-04T13:13:46.729763+0000","last_clean":"2024-03-04T13:13:46.729763+0000","last_became_active":"2024-03-04T12:20:16.832377+0000","last_became_peered":"2024-03-04T12:20:16.832377+0000","last_unstale":"2024-03-04T13:13:46.729763+0000","last_undegraded":"2024-03-04T13:13:46.729763+0000","last_fullsized":"2024-03-04T13:13:46.729763+0000","mapping_epoch":22,"log_start":"255'1000","ondisk_log_start":"255'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1093","last_scrub_stamp":"2024-03-04T13:13:46.729643+0000","last_deep_scrub":"255'1093","last_deep_scrub_stamp":"2024-03-04T13:13:46.729643+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.729643+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":1000,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:00:19.632521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4785,"num_read_kb":4211,"num_write":1502,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"255'219","reported_seq":876,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:53.741080+0000","last_change":"2024-03-04T13:13:53.741080+0000","last_active":"2024-03-04T13:13:53.741080+0000","last_peered":"2024-03-04T13:13:53.741080+0000","last_clean":"2024-03-04T13:13:53.741080+0000","last_became_active":"2024-03-04T12:20:14.817326+0000","last_became_peered":"2024-03-04T12:20:14.817326+0000","last_unstale":"2024-03-04T13:13:53.741080+0000","last_undegraded":"2024-03-04T13:13:53.741080+0000","last_fullsized":"2024-03-04T13:13:53.741080+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'219","last_scrub_stamp":"2024-03-04T13:13:53.740946+0000","last_deep_scrub":"255'219","last_deep_scrub_stamp":"2024-03-04T13:13:53.740946+0000","last_clean_scrub_stamp":"2024-03-04T13:13:53.740946+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:53:35.222082+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":463525,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":541,"num_read_kb":21798,"num_write":1100,"num_write_kb":25910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"255'797","reported_seq":2449,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:42.757960+0000","last_change":"2024-03-04T13:13:42.757960+0000","last_active":"2024-03-04T13:13:42.757960+0000","last_peered":"2024-03-04T13:13:42.757960+0000","last_clean":"2024-03-04T13:13:42.757960+0000","last_became_active":"2024-03-04T12:20:16.834823+0000","last_became_peered":"2024-03-04T12:20:16.834823+0000","last_unstale":"2024-03-04T13:13:42.757960+0000","last_undegraded":"2024-03-04T13:13:42.757960+0000","last_fullsized":"2024-03-04T13:13:42.757960+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'797","last_scrub_stamp":"2024-03-04T13:13:42.757785+0000","last_deep_scrub":"255'797","last_deep_scrub_stamp":"2024-03-04T13:13:42.757785+0000","last_clean_scrub_stamp":"2024-03-04T13:13:42.757785+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:53:56.372808+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3958,"num_read_kb":3565,"num_write":1074,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1914,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"255'213","reported_seq":866,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:46.170790+0000","last_change":"2024-03-04T13:13:46.170790+0000","last_active":"2024-03-04T13:13:46.170790+0000","last_peered":"2024-03-04T13:13:46.170790+0000","last_clean":"2024-03-04T13:13:46.170790+0000","last_became_active":"2024-03-04T12:20:14.819333+0000","last_became_peered":"2024-03-04T12:20:14.819333+0000","last_unstale":"2024-03-04T13:13:46.170790+0000","last_undegraded":"2024-03-04T13:13:46.170790+0000","last_fullsized":"2024-03-04T13:13:46.170790+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'213","last_scrub_stamp":"2024-03-04T13:13:46.170666+0000","last_deep_scrub":"255'213","last_deep_scrub_stamp":"2024-03-04T13:13:46.170666+0000","last_clean_scrub_stamp":"2024-03-04T13:13:46.170666+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:06:30.772153+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":688512,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":39432,"num_write":1114,"num_write_kb":31535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"255'571","reported_seq":2107,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:48.325253+0000","last_change":"2024-03-04T13:13:48.325253+0000","last_active":"2024-03-04T13:13:48.325253+0000","last_peered":"2024-03-04T13:13:48.325253+0000","last_clean":"2024-03-04T13:13:48.325253+0000","last_became_active":"2024-03-04T12:20:16.828799+0000","last_became_peered":"2024-03-04T12:20:16.828799+0000","last_unstale":"2024-03-04T13:13:48.325253+0000","last_undegraded":"2024-03-04T13:13:48.325253+0000","last_fullsized":"2024-03-04T13:13:48.325253+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'571","last_scrub_stamp":"2024-03-04T13:13:48.325117+0000","last_deep_scrub":"255'571","last_deep_scrub_stamp":"2024-03-04T13:13:48.325117+0000","last_clean_scrub_stamp":"2024-03-04T13:13:48.325117+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:23:26.098338+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2802,"num_read_kb":2536,"num_write":761,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":783,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"255'189","reported_seq":804,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:06.518202+0000","last_change":"2024-03-04T13:14:06.518202+0000","last_active":"2024-03-04T13:14:06.518202+0000","last_peered":"2024-03-04T13:14:06.518202+0000","last_clean":"2024-03-04T13:14:06.518202+0000","last_became_active":"2024-03-04T12:20:14.823794+0000","last_became_peered":"2024-03-04T12:20:14.823794+0000","last_unstale":"2024-03-04T13:14:06.518202+0000","last_undegraded":"2024-03-04T13:14:06.518202+0000","last_fullsized":"2024-03-04T13:14:06.518202+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'189","last_scrub_stamp":"2024-03-04T13:14:06.518085+0000","last_deep_scrub":"255'189","last_deep_scrub_stamp":"2024-03-04T13:14:06.518085+0000","last_clean_scrub_stamp":"2024-03-04T13:14:06.518085+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:13:09.766393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27216,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":368,"num_read_kb":29267,"num_write":940,"num_write_kb":26221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"255'420","reported_seq":2025,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:50.674724+0000","last_change":"2024-03-04T13:13:50.674724+0000","last_active":"2024-03-04T13:13:50.674724+0000","last_peered":"2024-03-04T13:13:50.674724+0000","last_clean":"2024-03-04T13:13:50.674724+0000","last_became_active":"2024-03-04T12:20:16.830023+0000","last_became_peered":"2024-03-04T12:20:16.830023+0000","last_unstale":"2024-03-04T13:13:50.674724+0000","last_undegraded":"2024-03-04T13:13:50.674724+0000","last_fullsized":"2024-03-04T13:13:50.674724+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'420","last_scrub_stamp":"2024-03-04T13:13:50.674608+0000","last_deep_scrub":"255'420","last_deep_scrub_stamp":"2024-03-04T13:13:50.674608+0000","last_clean_scrub_stamp":"2024-03-04T13:13:50.674608+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:47:59.765664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2457,"num_read_kb":2316,"num_write":500,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1912,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"255'182","reported_seq":774,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:10.934060+0000","last_change":"2024-03-04T13:14:10.934114+0000","last_active":"2024-03-04T13:14:10.934060+0000","last_peered":"2024-03-04T13:14:10.934060+0000","last_clean":"2024-03-04T13:14:10.934060+0000","last_became_active":"2024-03-04T12:20:14.814649+0000","last_became_peered":"2024-03-04T12:20:14.814649+0000","last_unstale":"2024-03-04T13:14:10.934060+0000","last_undegraded":"2024-03-04T13:14:10.934060+0000","last_fullsized":"2024-03-04T13:14:10.934060+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'182","last_scrub_stamp":"2024-03-04T13:14:10.933946+0000","last_deep_scrub":"255'182","last_deep_scrub_stamp":"2024-03-04T13:14:10.933946+0000","last_clean_scrub_stamp":"2024-03-04T13:14:10.933946+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:06:19.968146+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":350,"num_read_kb":14298,"num_write":961,"num_write_kb":45374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"255'672","reported_seq":2129,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:55.900474+0000","last_change":"2024-03-04T13:13:55.900544+0000","last_active":"2024-03-04T13:13:55.900474+0000","last_peered":"2024-03-04T13:13:55.900474+0000","last_clean":"2024-03-04T13:13:55.900474+0000","last_became_active":"2024-03-04T12:20:16.831861+0000","last_became_peered":"2024-03-04T12:20:16.831861+0000","last_unstale":"2024-03-04T13:13:55.900474+0000","last_undegraded":"2024-03-04T13:13:55.900474+0000","last_fullsized":"2024-03-04T13:13:55.900474+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'672","last_scrub_stamp":"2024-03-04T13:13:55.900379+0000","last_deep_scrub":"255'672","last_deep_scrub_stamp":"2024-03-04T13:13:55.900379+0000","last_clean_scrub_stamp":"2024-03-04T13:13:55.900379+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":600,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:08:34.528220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3134,"num_read_kb":2831,"num_write":876,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"255'154","reported_seq":796,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:15.945402+0000","last_change":"2024-03-04T13:14:15.945402+0000","last_active":"2024-03-04T13:14:15.945402+0000","last_peered":"2024-03-04T13:14:15.945402+0000","last_clean":"2024-03-04T13:14:15.945402+0000","last_became_active":"2024-03-04T12:20:14.818011+0000","last_became_peered":"2024-03-04T12:20:14.818011+0000","last_unstale":"2024-03-04T13:14:15.945402+0000","last_undegraded":"2024-03-04T13:14:15.945402+0000","last_fullsized":"2024-03-04T13:14:15.945402+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'154","last_scrub_stamp":"2024-03-04T13:14:15.945234+0000","last_deep_scrub":"255'154","last_deep_scrub_stamp":"2024-03-04T13:14:15.945234+0000","last_clean_scrub_stamp":"2024-03-04T13:14:15.945234+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:37:09.460631+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6900048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":2296,"num_write":812,"num_write_kb":10260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"255'1155","reported_seq":2630,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:58.153251+0000","last_change":"2024-03-04T13:13:58.153251+0000","last_active":"2024-03-04T13:13:58.153251+0000","last_peered":"2024-03-04T13:13:58.153251+0000","last_clean":"2024-03-04T13:13:58.153251+0000","last_became_active":"2024-03-04T12:20:16.820794+0000","last_became_peered":"2024-03-04T12:20:16.820794+0000","last_unstale":"2024-03-04T13:13:58.153251+0000","last_undegraded":"2024-03-04T13:13:58.153251+0000","last_fullsized":"2024-03-04T13:13:58.153251+0000","mapping_epoch":22,"log_start":"255'1100","ondisk_log_start":"255'1100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1155","last_scrub_stamp":"2024-03-04T13:13:58.153115+0000","last_deep_scrub":"255'1155","last_deep_scrub_stamp":"2024-03-04T13:13:58.153115+0000","last_clean_scrub_stamp":"2024-03-04T13:13:58.153115+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":1100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:07:45.841194+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4910,"num_read_kb":4282,"num_write":1611,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"255'219","reported_seq":852,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:00.635789+0000","last_change":"2024-03-04T13:14:00.635789+0000","last_active":"2024-03-04T13:14:00.635789+0000","last_peered":"2024-03-04T13:14:00.635789+0000","last_clean":"2024-03-04T13:14:00.635789+0000","last_became_active":"2024-03-04T12:20:14.811334+0000","last_became_peered":"2024-03-04T12:20:14.811334+0000","last_unstale":"2024-03-04T13:14:00.635789+0000","last_undegraded":"2024-03-04T13:14:00.635789+0000","last_fullsized":"2024-03-04T13:14:00.635789+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'219","last_scrub_stamp":"2024-03-04T13:14:00.635561+0000","last_deep_scrub":"255'219","last_deep_scrub_stamp":"2024-03-04T13:14:00.635561+0000","last_clean_scrub_stamp":"2024-03-04T13:14:00.635561+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T17:03:40.033710+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1577095,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":33282,"num_write":1226,"num_write_kb":31843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"255'763","reported_seq":2390,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:56.860235+0000","last_change":"2024-03-04T13:13:56.860235+0000","last_active":"2024-03-04T13:13:56.860235+0000","last_peered":"2024-03-04T13:13:56.860235+0000","last_clean":"2024-03-04T13:13:56.860235+0000","last_became_active":"2024-03-04T12:20:16.835285+0000","last_became_peered":"2024-03-04T12:20:16.835285+0000","last_unstale":"2024-03-04T13:13:56.860235+0000","last_undegraded":"2024-03-04T13:13:56.860235+0000","last_fullsized":"2024-03-04T13:13:56.860235+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'763","last_scrub_stamp":"2024-03-04T13:13:56.860064+0000","last_deep_scrub":"255'763","last_deep_scrub_stamp":"2024-03-04T13:13:56.860064+0000","last_clean_scrub_stamp":"2024-03-04T13:13:56.860064+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:12:33.188987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3723,"num_read_kb":3381,"num_write":1013,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"255'218","reported_seq":857,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:55.763405+0000","last_change":"2024-03-04T13:13:55.763405+0000","last_active":"2024-03-04T13:13:55.763405+0000","last_peered":"2024-03-04T13:13:55.763405+0000","last_clean":"2024-03-04T13:13:55.763405+0000","last_became_active":"2024-03-04T12:20:14.818385+0000","last_became_peered":"2024-03-04T12:20:14.818385+0000","last_unstale":"2024-03-04T13:13:55.763405+0000","last_undegraded":"2024-03-04T13:13:55.763405+0000","last_fullsized":"2024-03-04T13:13:55.763405+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'218","last_scrub_stamp":"2024-03-04T13:13:55.763228+0000","last_deep_scrub":"255'218","last_deep_scrub_stamp":"2024-03-04T13:13:55.763228+0000","last_clean_scrub_stamp":"2024-03-04T13:13:55.763228+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T20:42:06.507084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":39388,"num_write":1130,"num_write_kb":46394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"255'1088","reported_seq":2796,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:45.743547+0000","last_change":"2024-03-04T13:13:45.743547+0000","last_active":"2024-03-04T13:13:45.743547+0000","last_peered":"2024-03-04T13:13:45.743547+0000","last_clean":"2024-03-04T13:13:45.743547+0000","last_became_active":"2024-03-04T12:20:16.823596+0000","last_became_peered":"2024-03-04T12:20:16.823596+0000","last_unstale":"2024-03-04T13:13:45.743547+0000","last_undegraded":"2024-03-04T13:13:45.743547+0000","last_fullsized":"2024-03-04T13:13:45.743547+0000","mapping_epoch":22,"log_start":"255'1000","ondisk_log_start":"255'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'1088","last_scrub_stamp":"2024-03-04T13:13:45.743404+0000","last_deep_scrub":"255'1088","last_deep_scrub_stamp":"2024-03-04T13:13:45.743404+0000","last_clean_scrub_stamp":"2024-03-04T13:13:45.743404+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":1000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:29:44.706870+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5087,"num_read_kb":4523,"num_write":1483,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2399,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"255'229","reported_seq":1088,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:16.916562+0000","last_change":"2024-03-04T13:14:16.916562+0000","last_active":"2024-03-04T13:14:16.916562+0000","last_peered":"2024-03-04T13:14:16.916562+0000","last_clean":"2024-03-04T13:14:16.916562+0000","last_became_active":"2024-03-04T12:20:14.818340+0000","last_became_peered":"2024-03-04T12:20:14.818340+0000","last_unstale":"2024-03-04T13:14:16.916562+0000","last_undegraded":"2024-03-04T13:14:16.916562+0000","last_fullsized":"2024-03-04T13:14:16.916562+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'229","last_scrub_stamp":"2024-03-04T13:14:16.916375+0000","last_deep_scrub":"255'229","last_deep_scrub_stamp":"2024-03-04T13:14:16.916375+0000","last_clean_scrub_stamp":"2024-03-04T13:14:16.916375+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:22:20.509997+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":933,"num_read_kb":21991,"num_write":1290,"num_write_kb":38918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"255'452","reported_seq":2005,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:53.790611+0000","last_change":"2024-03-04T13:13:53.790611+0000","last_active":"2024-03-04T13:13:53.790611+0000","last_peered":"2024-03-04T13:13:53.790611+0000","last_clean":"2024-03-04T13:13:53.790611+0000","last_became_active":"2024-03-04T12:20:16.830259+0000","last_became_peered":"2024-03-04T12:20:16.830259+0000","last_unstale":"2024-03-04T13:13:53.790611+0000","last_undegraded":"2024-03-04T13:13:53.790611+0000","last_fullsized":"2024-03-04T13:13:53.790611+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'452","last_scrub_stamp":"2024-03-04T13:13:53.790495+0000","last_deep_scrub":"255'452","last_deep_scrub_stamp":"2024-03-04T13:13:53.790495+0000","last_clean_scrub_stamp":"2024-03-04T13:13:53.790495+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:08:53.053685+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2336,"num_read_kb":2206,"num_write":536,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":950,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"255'213","reported_seq":871,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:08.557645+0000","last_change":"2024-03-04T13:14:08.557692+0000","last_active":"2024-03-04T13:14:08.557645+0000","last_peered":"2024-03-04T13:14:08.557645+0000","last_clean":"2024-03-04T13:14:08.557645+0000","last_became_active":"2024-03-04T12:20:14.823513+0000","last_became_peered":"2024-03-04T12:20:14.823513+0000","last_unstale":"2024-03-04T13:14:08.557645+0000","last_undegraded":"2024-03-04T13:14:08.557645+0000","last_fullsized":"2024-03-04T13:14:08.557645+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'213","last_scrub_stamp":"2024-03-04T13:14:08.557563+0000","last_deep_scrub":"255'213","last_deep_scrub_stamp":"2024-03-04T13:14:08.557563+0000","last_clean_scrub_stamp":"2024-03-04T13:14:08.557563+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:58:17.328398+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706375,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":60209,"num_write":1193,"num_write_kb":41508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"255'752","reported_seq":2242,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:50.286440+0000","last_change":"2024-03-04T13:13:50.286440+0000","last_active":"2024-03-04T13:13:50.286440+0000","last_peered":"2024-03-04T13:13:50.286440+0000","last_clean":"2024-03-04T13:13:50.286440+0000","last_became_active":"2024-03-04T12:20:16.825534+0000","last_became_peered":"2024-03-04T12:20:16.825534+0000","last_unstale":"2024-03-04T13:13:50.286440+0000","last_undegraded":"2024-03-04T13:13:50.286440+0000","last_fullsized":"2024-03-04T13:13:50.286440+0000","mapping_epoch":22,"log_start":"255'700","ondisk_log_start":"255'700","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'752","last_scrub_stamp":"2024-03-04T13:13:50.286319+0000","last_deep_scrub":"255'752","last_deep_scrub_stamp":"2024-03-04T13:13:50.286319+0000","last_clean_scrub_stamp":"2024-03-04T13:13:50.286319+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:44:46.969711+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3330,"num_read_kb":2980,"num_write":1004,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"255'224","reported_seq":842,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:14.943876+0000","last_change":"2024-03-04T13:14:14.943876+0000","last_active":"2024-03-04T13:14:14.943876+0000","last_peered":"2024-03-04T13:14:14.943876+0000","last_clean":"2024-03-04T13:14:14.943876+0000","last_became_active":"2024-03-04T12:20:14.817531+0000","last_became_peered":"2024-03-04T12:20:14.817531+0000","last_unstale":"2024-03-04T13:14:14.943876+0000","last_undegraded":"2024-03-04T13:14:14.943876+0000","last_fullsized":"2024-03-04T13:14:14.943876+0000","mapping_epoch":20,"log_start":"255'200","ondisk_log_start":"255'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'224","last_scrub_stamp":"2024-03-04T13:14:14.943730+0000","last_deep_scrub":"255'224","last_deep_scrub_stamp":"2024-03-04T13:14:14.943730+0000","last_clean_scrub_stamp":"2024-03-04T13:14:14.943730+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:25:45.749965+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7696,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":401,"num_read_kb":19231,"num_write":1186,"num_write_kb":63143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"255'537","reported_seq":2120,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:48.219165+0000","last_change":"2024-03-04T13:13:48.219165+0000","last_active":"2024-03-04T13:13:48.219165+0000","last_peered":"2024-03-04T13:13:48.219165+0000","last_clean":"2024-03-04T13:13:48.219165+0000","last_became_active":"2024-03-04T12:20:16.823358+0000","last_became_peered":"2024-03-04T12:20:16.823358+0000","last_unstale":"2024-03-04T13:13:48.219165+0000","last_undegraded":"2024-03-04T13:13:48.219165+0000","last_fullsized":"2024-03-04T13:13:48.219165+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'537","last_scrub_stamp":"2024-03-04T13:13:48.219035+0000","last_deep_scrub":"255'537","last_deep_scrub_stamp":"2024-03-04T13:13:48.219035+0000","last_clean_scrub_stamp":"2024-03-04T13:13:48.219035+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T18:29:07.573496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2875,"num_read_kb":2619,"num_write":718,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2817,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"255'189","reported_seq":802,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:31.141126+0000","last_change":"2024-03-04T13:13:31.141187+0000","last_active":"2024-03-04T13:13:31.141126+0000","last_peered":"2024-03-04T13:13:31.141126+0000","last_clean":"2024-03-04T13:13:31.141126+0000","last_became_active":"2024-03-04T12:20:50.902181+0000","last_became_peered":"2024-03-04T12:20:50.902181+0000","last_unstale":"2024-03-04T13:13:31.141126+0000","last_undegraded":"2024-03-04T13:13:31.141126+0000","last_fullsized":"2024-03-04T13:13:31.141126+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'189","last_scrub_stamp":"2024-03-04T13:13:31.141036+0000","last_deep_scrub":"255'189","last_deep_scrub_stamp":"2024-03-04T13:13:31.141036+0000","last_clean_scrub_stamp":"2024-03-04T13:13:31.141036+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:38:14.485982+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918078,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":418,"num_read_kb":20827,"num_write":1047,"num_write_kb":19608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"255'419","reported_seq":1807,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:09.132447+0000","last_change":"2024-03-04T13:14:09.132447+0000","last_active":"2024-03-04T13:14:09.132447+0000","last_peered":"2024-03-04T13:14:09.132447+0000","last_clean":"2024-03-04T13:14:09.132447+0000","last_became_active":"2024-03-04T12:20:16.819169+0000","last_became_peered":"2024-03-04T12:20:16.819169+0000","last_unstale":"2024-03-04T13:14:09.132447+0000","last_undegraded":"2024-03-04T13:14:09.132447+0000","last_fullsized":"2024-03-04T13:14:09.132447+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'419","last_scrub_stamp":"2024-03-04T13:14:09.132288+0000","last_deep_scrub":"255'419","last_deep_scrub_stamp":"2024-03-04T13:14:09.132288+0000","last_clean_scrub_stamp":"2024-03-04T13:14:09.132288+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T01:13:57.958319+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2116,"num_read_kb":1957,"num_write":522,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"255'176","reported_seq":801,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:15.973571+0000","last_change":"2024-03-04T13:14:15.973571+0000","last_active":"2024-03-04T13:14:15.973571+0000","last_peered":"2024-03-04T13:14:15.973571+0000","last_clean":"2024-03-04T13:14:15.973571+0000","last_became_active":"2024-03-04T12:20:14.822588+0000","last_became_peered":"2024-03-04T12:20:14.822588+0000","last_unstale":"2024-03-04T13:14:15.973571+0000","last_undegraded":"2024-03-04T13:14:15.973571+0000","last_fullsized":"2024-03-04T13:14:15.973571+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'176","last_scrub_stamp":"2024-03-04T13:14:15.973371+0000","last_deep_scrub":"255'176","last_deep_scrub_stamp":"2024-03-04T13:14:15.973371+0000","last_clean_scrub_stamp":"2024-03-04T13:14:15.973371+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:03:54.091018+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":390,"num_read_kb":47350,"num_write":1028,"num_write_kb":32429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"255'483","reported_seq":2036,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:52.681380+0000","last_change":"2024-03-04T13:13:52.681380+0000","last_active":"2024-03-04T13:13:52.681380+0000","last_peered":"2024-03-04T13:13:52.681380+0000","last_clean":"2024-03-04T13:13:52.681380+0000","last_became_active":"2024-03-04T12:20:16.828618+0000","last_became_peered":"2024-03-04T12:20:16.828618+0000","last_unstale":"2024-03-04T13:13:52.681380+0000","last_undegraded":"2024-03-04T13:13:52.681380+0000","last_fullsized":"2024-03-04T13:13:52.681380+0000","mapping_epoch":22,"log_start":"255'400","ondisk_log_start":"255'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'483","last_scrub_stamp":"2024-03-04T13:13:52.681231+0000","last_deep_scrub":"255'483","last_deep_scrub_stamp":"2024-03-04T13:13:52.681231+0000","last_clean_scrub_stamp":"2024-03-04T13:13:52.681231+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:48:06.290986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2516,"num_read_kb":2328,"num_write":610,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"255'183","reported_seq":923,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:56.782272+0000","last_change":"2024-03-04T13:13:56.782272+0000","last_active":"2024-03-04T13:13:56.782272+0000","last_peered":"2024-03-04T13:13:56.782272+0000","last_clean":"2024-03-04T13:13:56.782272+0000","last_became_active":"2024-03-04T12:20:14.818924+0000","last_became_peered":"2024-03-04T12:20:14.818924+0000","last_unstale":"2024-03-04T13:13:56.782272+0000","last_undegraded":"2024-03-04T13:13:56.782272+0000","last_fullsized":"2024-03-04T13:13:56.782272+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'183","last_scrub_stamp":"2024-03-04T13:13:56.782121+0000","last_deep_scrub":"255'183","last_deep_scrub_stamp":"2024-03-04T13:13:56.782121+0000","last_clean_scrub_stamp":"2024-03-04T13:13:56.782121+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:22:22.619641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":719,"num_read_kb":26573,"num_write":1059,"num_write_kb":25938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"255'850","reported_seq":2388,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:54.767801+0000","last_change":"2024-03-04T13:13:54.767801+0000","last_active":"2024-03-04T13:13:54.767801+0000","last_peered":"2024-03-04T13:13:54.767801+0000","last_clean":"2024-03-04T13:13:54.767801+0000","last_became_active":"2024-03-04T12:20:16.835308+0000","last_became_peered":"2024-03-04T12:20:16.835308+0000","last_unstale":"2024-03-04T13:13:54.767801+0000","last_undegraded":"2024-03-04T13:13:54.767801+0000","last_fullsized":"2024-03-04T13:13:54.767801+0000","mapping_epoch":22,"log_start":"255'800","ondisk_log_start":"255'800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'850","last_scrub_stamp":"2024-03-04T13:13:54.767671+0000","last_deep_scrub":"255'850","last_deep_scrub_stamp":"2024-03-04T13:13:54.767671+0000","last_clean_scrub_stamp":"2024-03-04T13:13:54.767671+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T21:54:45.196170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3917,"num_read_kb":3486,"num_write":1199,"num_write_kb":507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"255'202","reported_seq":819,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:10.718427+0000","last_change":"2024-03-04T13:14:10.718427+0000","last_active":"2024-03-04T13:14:10.718427+0000","last_peered":"2024-03-04T13:14:10.718427+0000","last_clean":"2024-03-04T13:14:10.718427+0000","last_became_active":"2024-03-04T12:20:14.816440+0000","last_became_peered":"2024-03-04T12:20:14.816440+0000","last_unstale":"2024-03-04T13:14:10.718427+0000","last_undegraded":"2024-03-04T13:14:10.718427+0000","last_fullsized":"2024-03-04T13:14:10.718427+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'202","last_scrub_stamp":"2024-03-04T13:14:10.718167+0000","last_deep_scrub":"255'202","last_deep_scrub_stamp":"2024-03-04T13:14:10.718167+0000","last_clean_scrub_stamp":"2024-03-04T13:14:10.718167+0000","objects_scrubbed":8,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T16:29:19.249032+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17822208,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":392,"num_read_kb":7899,"num_write":1089,"num_write_kb":49946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"255'690","reported_seq":2020,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:03.907761+0000","last_change":"2024-03-04T13:14:03.907761+0000","last_active":"2024-03-04T13:14:03.907761+0000","last_peered":"2024-03-04T13:14:03.907761+0000","last_clean":"2024-03-04T13:14:03.907761+0000","last_became_active":"2024-03-04T12:20:16.827770+0000","last_became_peered":"2024-03-04T12:20:16.827770+0000","last_unstale":"2024-03-04T13:14:03.907761+0000","last_undegraded":"2024-03-04T13:14:03.907761+0000","last_fullsized":"2024-03-04T13:14:03.907761+0000","mapping_epoch":22,"log_start":"255'600","ondisk_log_start":"255'600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'690","last_scrub_stamp":"2024-03-04T13:14:03.907595+0000","last_deep_scrub":"255'690","last_deep_scrub_stamp":"2024-03-04T13:14:03.907595+0000","last_clean_scrub_stamp":"2024-03-04T13:14:03.907595+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T13:54:45.174258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3073,"num_read_kb":2741,"num_write":929,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1425,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"255'194","reported_seq":811,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:47.208750+0000","last_change":"2024-03-04T13:13:47.208750+0000","last_active":"2024-03-04T13:13:47.208750+0000","last_peered":"2024-03-04T13:13:47.208750+0000","last_clean":"2024-03-04T13:13:47.208750+0000","last_became_active":"2024-03-04T12:20:14.820393+0000","last_became_peered":"2024-03-04T12:20:14.820393+0000","last_unstale":"2024-03-04T13:13:47.208750+0000","last_undegraded":"2024-03-04T13:13:47.208750+0000","last_fullsized":"2024-03-04T13:13:47.208750+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'194","last_scrub_stamp":"2024-03-04T13:13:47.208620+0000","last_deep_scrub":"255'194","last_deep_scrub_stamp":"2024-03-04T13:13:47.208620+0000","last_clean_scrub_stamp":"2024-03-04T13:13:47.208620+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T19:32:29.821551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262178,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":6825,"num_write":1149,"num_write_kb":21389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"255'359","reported_seq":1785,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:50.607970+0000","last_change":"2024-03-04T13:13:50.608003+0000","last_active":"2024-03-04T13:13:50.607970+0000","last_peered":"2024-03-04T13:13:50.607970+0000","last_clean":"2024-03-04T13:13:50.607970+0000","last_became_active":"2024-03-04T12:20:16.829306+0000","last_became_peered":"2024-03-04T12:20:16.829306+0000","last_unstale":"2024-03-04T13:13:50.607970+0000","last_undegraded":"2024-03-04T13:13:50.607970+0000","last_fullsized":"2024-03-04T13:13:50.607970+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'359","last_scrub_stamp":"2024-03-04T13:13:50.607886+0000","last_deep_scrub":"255'359","last_deep_scrub_stamp":"2024-03-04T13:13:50.607886+0000","last_clean_scrub_stamp":"2024-03-04T13:13:50.607886+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:26:32.533857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1952,"num_read_kb":1858,"num_write":426,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":218,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"255'174","reported_seq":786,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:05.490273+0000","last_change":"2024-03-04T13:14:05.490322+0000","last_active":"2024-03-04T13:14:05.490273+0000","last_peered":"2024-03-04T13:14:05.490273+0000","last_clean":"2024-03-04T13:14:05.490273+0000","last_became_active":"2024-03-04T12:20:14.821961+0000","last_became_peered":"2024-03-04T12:20:14.821961+0000","last_unstale":"2024-03-04T13:14:05.490273+0000","last_undegraded":"2024-03-04T13:14:05.490273+0000","last_fullsized":"2024-03-04T13:14:05.490273+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'174","last_scrub_stamp":"2024-03-04T13:14:05.490166+0000","last_deep_scrub":"255'174","last_deep_scrub_stamp":"2024-03-04T13:14:05.490166+0000","last_clean_scrub_stamp":"2024-03-04T13:14:05.490166+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-06T00:57:53.309018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":395,"num_read_kb":13429,"num_write":876,"num_write_kb":50070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"255'155","reported_seq":732,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:35.027327+0000","last_change":"2024-03-04T13:13:35.027360+0000","last_active":"2024-03-04T13:13:35.027327+0000","last_peered":"2024-03-04T13:13:35.027327+0000","last_clean":"2024-03-04T13:13:35.027327+0000","last_became_active":"2024-03-04T12:20:51.030887+0000","last_became_peered":"2024-03-04T12:20:51.030887+0000","last_unstale":"2024-03-04T13:13:35.027327+0000","last_undegraded":"2024-03-04T13:13:35.027327+0000","last_fullsized":"2024-03-04T13:13:35.027327+0000","mapping_epoch":33,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'155","last_scrub_stamp":"2024-03-04T13:13:35.027238+0000","last_deep_scrub":"255'155","last_deep_scrub_stamp":"2024-03-04T13:13:35.027238+0000","last_clean_scrub_stamp":"2024-03-04T13:13:35.027238+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:23:09.896709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":307,"num_read_kb":55812,"num_write":877,"num_write_kb":48688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"255'386","reported_seq":1789,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:52.751995+0000","last_change":"2024-03-04T13:13:52.752044+0000","last_active":"2024-03-04T13:13:52.751995+0000","last_peered":"2024-03-04T13:13:52.751995+0000","last_clean":"2024-03-04T13:13:52.751995+0000","last_became_active":"2024-03-04T12:20:16.831393+0000","last_became_peered":"2024-03-04T12:20:16.831393+0000","last_unstale":"2024-03-04T13:13:52.751995+0000","last_undegraded":"2024-03-04T13:13:52.751995+0000","last_fullsized":"2024-03-04T13:13:52.751995+0000","mapping_epoch":22,"log_start":"255'300","ondisk_log_start":"255'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'386","last_scrub_stamp":"2024-03-04T13:13:52.751896+0000","last_deep_scrub":"255'386","last_deep_scrub_stamp":"2024-03-04T13:13:52.751896+0000","last_clean_scrub_stamp":"2024-03-04T13:13:52.751896+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T15:41:35.580653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2009,"num_read_kb":1888,"num_write":461,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"255'195","reported_seq":877,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:14:04.567131+0000","last_change":"2024-03-04T13:14:04.567203+0000","last_active":"2024-03-04T13:14:04.567131+0000","last_peered":"2024-03-04T13:14:04.567131+0000","last_clean":"2024-03-04T13:14:04.567131+0000","last_became_active":"2024-03-04T12:20:14.817894+0000","last_became_peered":"2024-03-04T12:20:14.817894+0000","last_unstale":"2024-03-04T13:14:04.567131+0000","last_undegraded":"2024-03-04T13:14:04.567131+0000","last_fullsized":"2024-03-04T13:14:04.567131+0000","mapping_epoch":20,"log_start":"255'100","ondisk_log_start":"255'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'195","last_scrub_stamp":"2024-03-04T13:14:04.567024+0000","last_deep_scrub":"255'195","last_deep_scrub_stamp":"2024-03-04T13:14:04.567024+0000","last_clean_scrub_stamp":"2024-03-04T13:14:04.567024+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T23:28:02.979458+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":444,"num_read_kb":164272,"num_write":1071,"num_write_kb":63423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"255'518","reported_seq":1971,"reported_epoch":255,"state":"active+clean","last_fresh":"2024-03-04T13:13:54.496453+0000","last_change":"2024-03-04T13:13:54.496483+0000","last_active":"2024-03-04T13:13:54.496453+0000","last_peered":"2024-03-04T13:13:54.496453+0000","last_clean":"2024-03-04T13:13:54.496453+0000","last_became_active":"2024-03-04T12:20:16.823974+0000","last_became_peered":"2024-03-04T12:20:16.823974+0000","last_unstale":"2024-03-04T13:13:54.496453+0000","last_undegraded":"2024-03-04T13:13:54.496453+0000","last_fullsized":"2024-03-04T13:13:54.496453+0000","mapping_epoch":22,"log_start":"255'500","ondisk_log_start":"255'500","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"255'518","last_scrub_stamp":"2024-03-04T13:13:54.496362+0000","last_deep_scrub":"255'518","last_deep_scrub_stamp":"2024-03-04T13:13:54.496362+0000","last_clean_scrub_stamp":"2024-03-04T13:13:54.496362+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-05T14:44:47.540474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2611,"num_read_kb":2352,"num_write":706,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":185523,"num_write":154,"num_write_kb":127147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":64,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5335,"num_read_kb":3794,"num_write":2149,"num_write_kb":803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6970,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1184,"ondisk_log_size":1184,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":10065,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":12124,"num_read_kb":11961,"num_write":14025,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1726,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":20130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2330,"ondisk_log_size":2330,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":260729,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":8455,"num_read_kb":10448,"num_write":5923,"num_write_kb":2713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":619910,"num_omap_keys":1456,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1897,"ondisk_log_size":1897,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1637,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1554,"num_read_kb":1549,"num_write":20,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":110,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":187558,"num_read_kb":170512,"num_write":50934,"num_write_kb":17677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":110,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":39856,"num_omap_keys":173,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3895,"ondisk_log_size":3895,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":189749578,"num_objects":263,"num_object_clones":0,"num_object_copies":526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":263,"num_whiteouts":0,"num_read":29476,"num_read_kb":2152910,"num_write":68734,"num_write_kb":2157934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":381083648,"data_stored":379499156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4212,"ondisk_log_size":4212,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":196827,"num_write":154,"num_write_kb":127147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575505,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":278600,"kb_used_data":71104,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94093240,"statfs":{"total":96636764160,"available":96351477760,"internally_reserved":0,"allocated":72810496,"data_stored":71072930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":212466122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575506,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274104,"kb_used_data":40240,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94097736,"statfs":{"total":96636764160,"available":96356081664,"internally_reserved":0,"allocated":41205760,"data_stored":39656320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575506,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149900,"kb_used_data":68804,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94221940,"statfs":{"total":96636764160,"available":96483266560,"internally_reserved":0,"allocated":70455296,"data_stored":68729090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575505,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108220,"kb_used_data":40948,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94263620,"statfs":{"total":96636764160,"available":96525946880,"internally_reserved":0,"allocated":41930752,"data_stored":40369557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575505,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288248,"kb_used_data":76592,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94083592,"statfs":{"total":96636764160,"available":96341598208,"internally_reserved":0,"allocated":78430208,"data_stored":76690401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575506,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119296,"kb_used_data":47864,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94252544,"statfs":{"total":96636764160,"available":96514605056,"internally_reserved":0,"allocated":49012736,"data_stored":47453483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575507,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":175036,"kb_used_data":59252,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94196804,"statfs":{"total":96636764160,"available":96457527296,"internally_reserved":0,"allocated":60674048,"data_stored":59087481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575504,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273196,"kb_used_data":61540,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94098644,"statfs":{"total":96636764160,"available":96357011456,"internally_reserved":0,"allocated":63016960,"data_stored":61377358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":47357952,"data_stored":47171521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50876416,"data_stored":50716133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45522944,"data_stored":45373582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":64413696,"data_stored":64121957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32161792,"data_stored":31999474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":56401920,"data_stored":56160984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":21966848,"data_stored":21846112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":62382080,"data_stored":62109393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":64,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-04T13:14:30.131 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-04T13:14:30.453 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-04T13:14:30.454 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-04T13:14:30.454 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-04T13:14:30.454 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:14:30.500 INFO:tasks.ceph.osd.0:Stopped 2024-03-04T13:14:30.500 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-04T13:14:30.500 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:14:30.546 INFO:tasks.ceph.osd.1:Stopped 2024-03-04T13:14:30.546 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-04T13:14:30.546 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:14:30.583 INFO:tasks.ceph.osd.2:Stopped 2024-03-04T13:14:30.583 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-04T13:14:30.583 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:14:30.661 INFO:tasks.ceph.osd.3:Stopped 2024-03-04T13:14:30.661 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-04T13:14:30.662 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:14:30.707 INFO:tasks.ceph.osd.4:Stopped 2024-03-04T13:14:30.708 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-04T13:14:30.708 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:14:30.752 INFO:tasks.ceph.osd.5:Stopped 2024-03-04T13:14:30.753 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-04T13:14:30.753 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:14:30.800 INFO:tasks.ceph.osd.6:Stopped 2024-03-04T13:14:30.801 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-04T13:14:30.801 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:14:30.852 INFO:tasks.ceph.osd.7:Stopped 2024-03-04T13:14:30.853 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-04T13:14:30.853 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-04T13:14:30.853 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:14:30.877 INFO:tasks.ceph.mgr.y:Stopped 2024-03-04T13:14:30.877 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-04T13:14:30.877 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:14:30.906 INFO:tasks.ceph.mgr.x:Stopped 2024-03-04T13:14:30.906 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-04T13:14:30.906 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-04T13:14:30.906 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:14:30.933 INFO:tasks.ceph.mon.a:Stopped 2024-03-04T13:14:30.933 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-04T13:14:30.934 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:14:30.986 INFO:tasks.ceph.mon.c:Stopped 2024-03-04T13:14:30.986 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-04T13:14:30.986 INFO:teuthology.orchestra.run:waiting for 300 2024-03-04T13:14:30.998 INFO:tasks.ceph.mon.b:Stopped 2024-03-04T13:14:30.998 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-04T13:14:30.998 DEBUG:teuthology.orchestra.run.smithi110:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-03-04T13:14:31.069 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi110.front.sepia.ceph.com 2024-03-04T13:14:31.069 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-04T13:14:31.345 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi110.front.sepia.ceph.com 2024-03-04T13:14:31.345 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-04T13:14:31.430 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi110.front.sepia.ceph.com 2024-03-04T13:14:31.430 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-04T13:14:31.526 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi110.front.sepia.ceph.com 2024-03-04T13:14:31.527 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-04T13:14:31.610 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi172.front.sepia.ceph.com 2024-03-04T13:14:31.610 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-04T13:14:31.826 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi172.front.sepia.ceph.com 2024-03-04T13:14:31.826 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-04T13:14:31.911 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi172.front.sepia.ceph.com 2024-03-04T13:14:31.911 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-04T13:14:31.983 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi172.front.sepia.ceph.com 2024-03-04T13:14:31.984 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-04T13:14:32.057 INFO:tasks.ceph:Archiving mon data... 2024-03-04T13:14:32.059 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061/data/mon.a.tgz 2024-03-04T13:14:32.059 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-03-04T13:14:32.089 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.86ovnJHlNN 2024-03-04T13:14:32.089 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.86ovnJHlNN 2024-03-04T13:14:32.305 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.86ovnJHlNN 2024-03-04T13:14:32.415 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.86ovnJHlNN is 483KB 2024-03-04T13:14:32.514 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.86ovnJHlNN 2024-03-04T13:14:32.541 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061/data/mon.c.tgz 2024-03-04T13:14:32.541 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-03-04T13:14:32.607 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.576jMQtYme 2024-03-04T13:14:32.607 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.576jMQtYme 2024-03-04T13:14:32.799 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.576jMQtYme 2024-03-04T13:14:32.908 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.576jMQtYme is 499KB 2024-03-04T13:14:32.990 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.576jMQtYme 2024-03-04T13:14:33.016 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061/data/mon.b.tgz 2024-03-04T13:14:33.017 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-03-04T13:14:33.045 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.ebNYwfqDMk 2024-03-04T13:14:33.045 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ebNYwfqDMk 2024-03-04T13:14:33.278 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.ebNYwfqDMk 2024-03-04T13:14:33.388 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.ebNYwfqDMk is 499KB 2024-03-04T13:14:33.471 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.ebNYwfqDMk 2024-03-04T13:14:33.497 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-04T13:14:33.498 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-04T13:14:33.500 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-04T13:14:33.682 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-04T13:14:33.710 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-04T13:14:33.710 INFO:tasks.ceph:Archiving crash dumps... 2024-03-04T13:14:33.712 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061/remote/smithi110/crash 2024-03-04T13:14:33.713 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-04T13:14:33.753 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/crash to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061/remote/smithi172/crash 2024-03-04T13:14:33.754 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-04T13:14:33.793 INFO:tasks.ceph:Compressing logs... 2024-03-04T13:14:33.794 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-04T13:14:33.798 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-04T13:14:33.895 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-04T13:14:33.896 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33723.log 2024-03-04T13:14:33.896 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33635.log 2024-03-04T13:14:33.896 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.33723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33723.log.gz 2024-03-04T13:14:33.896 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-04T13:14:33.896 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33635.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-04T13:14:33.896 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33635.log.gz 2024-03-04T13:14:33.897 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-04T13:14:33.897 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-04T13:14:33.897 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33855.log 2024-03-04T13:14:33.897 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33679.log 2024-03-04T13:14:33.897 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33855.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-04T13:14:33.897 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33855.log.gz 2024-03-04T13:14:33.898 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33943.log 2024-03-04T13:14:33.898 INFO:teuthology.orchestra.run.smithi172.stderr: 90.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-04T13:14:33.898 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33679.log.gz 2024-03-04T13:14:33.898 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-04T13:14:33.898 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33943.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33943.log.gz 2024-03-04T13:14:33.898 INFO:teuthology.orchestra.run.smithi172.stderr: -- /var/log/ceph/ceph-client.admin.33899.log 2024-03-04T13:14:33.898 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-04T13:14:33.898 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33899.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.33899.log.gz 2024-03-04T13:14:33.899 INFO:teuthology.orchestra.run.smithi172.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33811.log 2024-03-04T13:14:33.899 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33767.log 2024-03-04T13:14:33.899 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33811.log: /var/log/ceph/ceph-mon.b.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33811.log.gz 2024-03-04T13:14:33.899 INFO:teuthology.orchestra.run.smithi172.stderr: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-04T13:14:33.908 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.33767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33767.log.gz 2024-03-04T13:14:33.970 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40504.log 2024-03-04T13:14:33.970 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142580.log 2024-03-04T13:14:33.970 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39782.log 2024-03-04T13:14:33.970 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40504.log.gz 2024-03-04T13:14:33.970 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.142580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142580.log.gz 2024-03-04T13:14:33.970 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142211.log 2024-03-04T13:14:33.971 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.39782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121783.log 2024-03-04T13:14:33.971 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39782.log.gz 2024-03-04T13:14:33.971 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.142211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69754.log 2024-03-04T13:14:33.971 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142211.log.gz 2024-03-04T13:14:33.971 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.121783.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-04T13:14:33.971 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121783.log.gz 2024-03-04T13:14:33.971 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.69754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89315.log 2024-03-04T13:14:33.972 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39780.log 2024-03-04T13:14:33.972 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.89315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41173.log 2024-03-04T13:14:33.972 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.39780.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.89315.log.gz 2024-03-04T13:14:33.972 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39780.log.gz 2024-03-04T13:14:33.972 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40005.log 2024-03-04T13:14:33.972 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75714.log 2024-03-04T13:14:33.972 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41173.log.gz 2024-03-04T13:14:33.973 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82836.log 2024-03-04T13:14:33.973 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40005.log.gz 2024-03-04T13:14:33.973 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.75714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130099.log 2024-03-04T13:14:33.973 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.82836.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.75714.log.gz 2024-03-04T13:14:33.973 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91082.log 2024-03-04T13:14:33.973 INFO:teuthology.orchestra.run.smithi110.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.82836.log.gz 2024-03-04T13:14:33.973 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.130099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142349.log 2024-03-04T13:14:33.973 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.91082.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.130099.log.gz 2024-03-04T13:14:33.973 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113467.log 2024-03-04T13:14:33.974 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142027.log 2024-03-04T13:14:33.974 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.142349.log: /var/log/ceph/ceph-client.admin.113467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142349.log.gz 2024-03-04T13:14:33.974 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.124483.log 2024-03-04T13:14:33.974 INFO:teuthology.orchestra.run.smithi110.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.113467.log.gz 2024-03-04T13:14:33.974 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.142027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126911.log 2024-03-04T13:14:33.974 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142027.log.gz 2024-03-04T13:14:33.974 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.124483.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.91082.log.gz 2024-03-04T13:14:33.974 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142395.log 2024-03-04T13:14:33.975 INFO:teuthology.orchestra.run.smithi110.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.124483.log.gz 2024-03-04T13:14:33.975 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81069.log 2024-03-04T13:14:33.975 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.126911.log: /var/log/ceph/ceph-client.admin.142395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110522.log 2024-03-04T13:14:33.975 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142395.log.gz 2024-03-04T13:14:33.975 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.81069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50537.log 2024-03-04T13:14:33.975 INFO:teuthology.orchestra.run.smithi110.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.81069.log.gz 2024-03-04T13:14:33.975 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.110522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99330.log 2024-03-04T13:14:33.975 INFO:teuthology.orchestra.run.smithi110.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.110522.log.gz 2024-03-04T13:14:33.976 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50537.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.126911.log.gz 2024-03-04T13:14:33.976 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50537.log.gz 2024-03-04T13:14:33.976 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74533.log 2024-03-04T13:14:33.976 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77083.log 2024-03-04T13:14:33.976 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.99330.log: /var/log/ceph/ceph-client.admin.74533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63614.log 2024-03-04T13:14:33.976 INFO:teuthology.orchestra.run.smithi110.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.99330.log.gz 2024-03-04T13:14:33.976 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.77083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40147.log 2024-03-04T13:14:33.977 INFO:teuthology.orchestra.run.smithi110.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.74533.log.gz 2024-03-04T13:14:33.977 INFO:teuthology.orchestra.run.smithi110.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.77083.log.gz 2024-03-04T13:14:33.977 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.63614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54732.log 2024-03-04T13:14:33.977 INFO:teuthology.orchestra.run.smithi110.stderr: 57.9% -- replaced with /var/log/ceph/ceph-client.admin.63614.log.gz 2024-03-04T13:14:33.977 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132421.log 2024-03-04T13:14:33.977 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40147.log.gz 2024-03-04T13:14:33.977 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.54732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76305.log 2024-03-04T13:14:33.977 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.132421.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.54732.log.gz 2024-03-04T13:14:33.977 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92850.log 2024-03-04T13:14:33.978 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57088.log 2024-03-04T13:14:33.978 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.76305.log: 25.1% -- replaced with /var/log/ceph/ceph-client.admin.76305.log.gz 2024-03-04T13:14:33.978 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.92850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49335.log 2024-03-04T13:14:33.978 INFO:teuthology.orchestra.run.smithi110.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.132421.log.gz 2024-03-04T13:14:33.978 INFO:teuthology.orchestra.run.smithi110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.92850.log.gz 2024-03-04T13:14:33.978 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.57088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40149.log 2024-03-04T13:14:33.978 INFO:teuthology.orchestra.run.smithi110.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.57088.log.gz 2024-03-04T13:14:33.978 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51150.log 2024-03-04T13:14:33.979 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49335.log: /var/log/ceph/ceph-client.admin.40149.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.49335.log.gz 2024-03-04T13:14:33.979 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-03-04T13:14:33.979 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40149.log.gz 2024-03-04T13:14:33.979 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.51150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133029.log 2024-03-04T13:14:33.979 INFO:teuthology.orchestra.run.smithi110.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.51150.log.gz 2024-03-04T13:14:33.979 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/valgrind/ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49924.log 2024-03-04T13:14:33.979 INFO:teuthology.orchestra.run.smithi110.stderr: 62.5% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-03-04T13:14:33.979 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.139149.log 2024-03-04T13:14:33.980 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.133029.log: /var/log/ceph/ceph-client.admin.49924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117002.log 2024-03-04T13:14:33.980 INFO:teuthology.orchestra.run.smithi110.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.49924.log.gz 2024-03-04T13:14:33.980 INFO:teuthology.orchestra.run.smithi110.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.133029.log.gz 2024-03-04T13:14:33.980 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.139149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105809.log 2024-03-04T13:14:33.980 INFO:teuthology.orchestra.run.smithi110.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.139149.log.gz 2024-03-04T13:14:33.980 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40398.log 2024-03-04T13:14:33.980 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.117002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117002.log.gz 2024-03-04T13:14:33.980 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.105809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92260.log 2024-03-04T13:14:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88137.log 2024-03-04T13:14:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40398.log.gz 2024-03-04T13:14:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.92260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81658.log 2024-03-04T13:14:33.981 INFO:teuthology.orchestra.run.smithi110.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.92260.log.gz 2024-03-04T13:14:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.88137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70371.log 2024-03-04T13:14:33.981 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.81658.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.88137.log.gz 2024-03-04T13:14:33.982 INFO:teuthology.orchestra.run.smithi110.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.105809.log.gz 2024-03-04T13:14:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121807.log 2024-03-04T13:14:33.982 INFO:teuthology.orchestra.run.smithi110.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81658.log.gz 2024-03-04T13:14:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.70371.log: /var/log/ceph/ceph-client.admin.142257.log 2024-03-04T13:14:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.121807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115234.log 2024-03-04T13:14:33.982 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121807.log.gz 2024-03-04T13:14:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.142257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142257.log.gz 2024-03-04T13:14:33.982 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96973.log 2024-03-04T13:14:33.983 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.115234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112289.log 2024-03-04T13:14:33.983 INFO:teuthology.orchestra.run.smithi110.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.115234.log.gz 2024-03-04T13:14:33.983 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.96973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58903.log 2024-03-04T13:14:33.983 INFO:teuthology.orchestra.run.smithi110.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.96973.log.gz 2024-03-04T13:14:33.983 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5/var/log/ceph/ceph-client.admin.112289.log: --verbose -- /var/log/ceph/ceph-client.admin.141567.log 2024-03-04T13:14:33.983 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.58903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39386.log 2024-03-04T13:14:33.983 INFO:teuthology.orchestra.run.smithi110.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.112289.log.gz 2024-03-04T13:14:33.983 INFO:teuthology.orchestra.run.smithi110.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.70371.log.gz 2024-03-04T13:14:33.984 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.141567.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.58903.log.gz 2024-03-04T13:14:33.984 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122420.log 2024-03-04T13:14:33.984 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141567.log.gz 2024-03-04T13:14:33.984 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.39386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39386.log.gz 2024-03-04T13:14:33.984 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59492.log 2024-03-04T13:14:33.984 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.122420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41240.log 2024-03-04T13:14:33.984 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.59492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46651.log 2024-03-04T13:14:33.985 INFO:teuthology.orchestra.run.smithi110.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.122420.log.gz 2024-03-04T13:14:33.985 INFO:teuthology.orchestra.run.smithi110.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.59492.log.gz 2024-03-04T13:14:33.985 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.41240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141889.log 2024-03-04T13:14:33.985 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102275.log 2024-03-04T13:14:33.985 INFO:teuthology.orchestra.run.smithi110.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.46651.log.gz 2024-03-04T13:14:33.985 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.141889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141889.log.gz 2024-03-04T13:14:33.985 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101686.log 2024-03-04T13:14:33.985 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.102275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39568.log 2024-03-04T13:14:33.985 INFO:teuthology.orchestra.run.smithi110.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.0.41240.log.gz 2024-03-04T13:14:33.986 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.101686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142119.log 2024-03-04T13:14:33.986 INFO:teuthology.orchestra.run.smithi110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102275.log.gz 2024-03-04T13:14:33.986 INFO:teuthology.orchestra.run.smithi110.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.101686.log.gz 2024-03-04T13:14:33.986 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.39568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39568.log.gz 2024-03-04T13:14:33.986 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40540.log 2024-03-04T13:14:33.986 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.142119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48157.log 2024-03-04T13:14:33.986 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142119.log.gz 2024-03-04T13:14:33.986 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66052.log 2024-03-04T13:14:33.986 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40540.log.gz 2024-03-04T13:14:33.987 INFO:teuthology.orchestra.run.smithi110.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.69754.log.gz 2024-03-04T13:14:33.987 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39476.log 2024-03-04T13:14:33.987 INFO:teuthology.orchestra.run.smithi110.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.48157.log.gz 2024-03-04T13:14:33.987 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.66052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142670.log 2024-03-04T13:14:33.987 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.39476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98151.log 2024-03-04T13:14:33.987 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39476.log.gz 2024-03-04T13:14:33.987 INFO:teuthology.orchestra.run.smithi110.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.66052.log.gz 2024-03-04T13:14:33.987 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.142670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142670.log.gz 2024-03-04T13:14:33.988 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130707.log 2024-03-04T13:14:33.988 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.98151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118201.log 2024-03-04T13:14:33.988 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.130707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80480.log 81.6% 2024-03-04T13:14:33.988 INFO:teuthology.orchestra.run.smithi110.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98151.log.gz 2024-03-04T13:14:33.988 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.118201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40139.log 2024-03-04T13:14:33.988 INFO:teuthology.orchestra.run.smithi110.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.130707.log.gz 2024-03-04T13:14:33.988 INFO:teuthology.orchestra.run.smithi110.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.118201.log.gz 2024-03-04T13:14:33.988 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.80480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39322.log 2024-03-04T13:14:33.988 INFO:teuthology.orchestra.run.smithi110.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.80480.log.gz 2024-03-04T13:14:33.989 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34052.log 2024-03-04T13:14:33.989 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40139.log.gz 2024-03-04T13:14:33.989 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.39322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39322.log.gz 2024-03-04T13:14:33.989 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.137931.log 2024-03-04T13:14:33.989 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.34052.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.34052.log.gz 2024-03-04T13:14:33.989 INFO:teuthology.orchestra.run.smithi110.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.142441.log 2024-03-04T13:14:33.989 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.137931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125132.log 2024-03-04T13:14:33.989 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.142441.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.137931.log.gz 2024-03-04T13:14:33.989 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64136.log 2024-03-04T13:14:33.990 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142441.log.gz 2024-03-04T13:14:33.990 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.125132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73352.log 2024-03-04T13:14:33.990 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.64136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86370.log 2024-03-04T13:14:33.990 INFO:teuthology.orchestra.run.smithi110.stderr: 52.9% -- replaced with /var/log/ceph/ceph-client.admin.64136.log.gz 2024-03-04T13:14:33.990 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.73352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141659.log 2024-03-04T13:14:33.990 INFO:teuthology.orchestra.run.smithi110.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.125132.log.gz 2024-03-04T13:14:33.990 INFO:teuthology.orchestra.run.smithi110.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.73352.log.gz 2024-03-04T13:14:33.990 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.86370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47258.log 2024-03-04T13:14:33.991 INFO:teuthology.orchestra.run.smithi110.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.86370.log.gz 2024-03-04T13:14:33.991 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.141659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41217.log 2024-03-04T13:14:33.991 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141659.log.gz 2024-03-04T13:14:33.991 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69137.log 2024-03-04T13:14:33.991 INFO:teuthology.orchestra.run.smithi110.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.47258.log.gz 2024-03-04T13:14:33.991 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121831.log 2024-03-04T13:14:33.991 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41217.log.gz 2024-03-04T13:14:33.991 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.69137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85781.log 2024-03-04T13:14:33.992 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.121831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117612.log 2024-03-04T13:14:33.992 INFO:teuthology.orchestra.run.smithi110.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121831.log.gz 2024-03-04T13:14:33.992 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.85781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79302.log 2024-03-04T13:14:33.992 INFO:teuthology.orchestra.run.smithi110.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.85781.log.gz 2024-03-04T13:14:33.992 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125740.log 2024-03-04T13:14:33.992 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.117612.log: /var/log/ceph/ceph-client.admin.79302.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.117612.log.gz 2024-03-04T13:14:33.993 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40511.log 2024-03-04T13:14:33.993 INFO:teuthology.orchestra.run.smithi110.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69137.log.gz 2024-03-04T13:14:33.993 INFO:teuthology.orchestra.run.smithi110.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.79302.log.gz 2024-03-04T13:14:33.993 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141751.log 2024-03-04T13:14:33.993 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.125740.log: /var/log/ceph/ceph-client.admin.40511.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-04T13:14:33.993 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40511.log.gz 2024-03-04T13:14:33.993 INFO:teuthology.orchestra.run.smithi110.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.125740.log.gz 2024-03-04T13:14:33.993 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.141751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84014.log 2024-03-04T13:14:33.994 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141751.log.gz 2024-03-04T13:14:33.994 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71605.log 2024-03-04T13:14:33.994 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.84014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111700.log 2024-03-04T13:14:33.994 INFO:teuthology.orchestra.run.smithi110.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.84014.log.gz 2024-03-04T13:14:33.994 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.71605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40505.log 2024-03-04T13:14:33.994 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.111700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39522.log 2024-03-04T13:14:33.994 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85192.log 2024-03-04T13:14:33.994 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40505.log.gz 2024-03-04T13:14:33.994 INFO:teuthology.orchestra.run.smithi110.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.71605.log.gz 2024-03-04T13:14:33.995 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.39522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89904.log 2024-03-04T13:14:33.995 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39522.log.gz 2024-03-04T13:14:33.995 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114056.log 2024-03-04T13:14:33.995 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.85192.log: 94.5%/var/log/ceph/ceph-client.admin.89904.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-04T13:14:33.995 INFO:teuthology.orchestra.run.smithi110.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.85192.log.gz 2024-03-04T13:14:33.995 INFO:teuthology.orchestra.run.smithi110.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.111700.log.gz 2024-03-04T13:14:33.995 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120605.log 2024-03-04T13:14:33.995 INFO:teuthology.orchestra.run.smithi110.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.89904.log.gz 2024-03-04T13:14:33.995 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5/var/log/ceph/ceph-client.admin.114056.log: --verbose -- /var/log/ceph/ceph-client.admin.86959.log 2024-03-04T13:14:33.996 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.120605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128735.log 2024-03-04T13:14:33.996 INFO:teuthology.orchestra.run.smithi110.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.114056.log.gz 2024-03-04T13:14:33.996 INFO:teuthology.orchestra.run.smithi110.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.120605.log.gz 2024-03-04T13:14:33.996 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.86959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142073.log 2024-03-04T13:14:33.996 INFO:teuthology.orchestra.run.smithi110.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.86959.log.gz 2024-03-04T13:14:33.996 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.128735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65435.log 2024-03-04T13:14:33.996 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.142073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58266.log 2024-03-04T13:14:33.996 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142073.log.gz 2024-03-04T13:14:33.997 INFO:teuthology.orchestra.run.smithi110.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.128735.log.gz 2024-03-04T13:14:33.997 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.65435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142487.log 2024-03-04T13:14:33.997 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.58266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131315.log 2024-03-04T13:14:33.997 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.142487.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.58266.log.gz 2024-03-04T13:14:33.997 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109933.log 2024-03-04T13:14:33.997 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142487.log.gz 2024-03-04T13:14:33.997 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.131315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.140805.log 2024-03-04T13:14:33.997 INFO:teuthology.orchestra.run.smithi110.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.131315.log.gz 2024-03-04T13:14:33.997 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.109933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104631.log 2024-03-04T13:14:33.998 INFO:teuthology.orchestra.run.smithi110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109933.log.gz 2024-03-04T13:14:33.998 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97562.log 2024-03-04T13:14:33.998 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.140805.log: /var/log/ceph/ceph-client.admin.104631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107576.log 2024-03-04T13:14:33.998 INFO:teuthology.orchestra.run.smithi110.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.104631.log.gz 2024-03-04T13:14:33.998 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.97562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40764.log 2024-03-04T13:14:33.998 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.107576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64071.log 2024-03-04T13:14:33.998 INFO:teuthology.orchestra.run.smithi110.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.107576.log.gz 2024-03-04T13:14:33.998 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87548.log 2024-03-04T13:14:33.999 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40764.log.gz 2024-03-04T13:14:33.999 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.64071.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-04T13:14:33.999 INFO:teuthology.orchestra.run.smithi110.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.140805.log.gz 2024-03-04T13:14:33.999 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.87548.log: gzip 86.1% -- replaced with /var/log/ceph/ceph-client.admin.97562.log.gz 2024-03-04T13:14:33.999 INFO:teuthology.orchestra.run.smithi110.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61283.log 2024-03-04T13:14:33.999 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.1.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87548.log.gz 2024-03-04T13:14:33.999 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90493.log 2024-03-04T13:14:33.999 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.61283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67903.log 2024-03-04T13:14:33.999 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61283.log.gz 2024-03-04T13:14:33.999 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.90493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93439.log 2024-03-04T13:14:34.000 INFO:teuthology.orchestra.run.smithi110.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.90493.log.gz 2024-03-04T13:14:34.000 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.67903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141705.log 2024-03-04T13:14:34.000 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.93439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43706.log 2024-03-04T13:14:34.000 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.141705.log: gzip 81.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.93439.log.gz --verbose 2024-03-04T13:14:34.000 INFO:teuthology.orchestra.run.smithi110.stderr: -- /var/log/ceph/ceph-client.admin.40718.log 2024-03-04T13:14:34.000 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141705.log.gz 2024-03-04T13:14:34.000 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48746.log 2024-03-04T13:14:34.000 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.43706.log: /var/log/ceph/ceph-client.admin.40718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52917.log 2024-03-04T13:14:34.001 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% 43.9% -- replaced with /var/log/ceph/ceph-client.0.43706.log.gz 2024-03-04T13:14:34.001 INFO:teuthology.orchestra.run.smithi110.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40718.log.gz 2024-03-04T13:14:34.001 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48746.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.48746.log.gz 2024-03-04T13:14:34.001 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50561.log 2024-03-04T13:14:34.001 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.52917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52917.log.gz 2024-03-04T13:14:34.001 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108166.log 2024-03-04T13:14:34.001 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5/var/log/ceph/ceph-client.admin.50561.log: --verbose -- /var/log/ceph/ceph-client.admin.41085.log 2024-03-04T13:14:34.001 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.108166.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.50561.log.gz 2024-03-04T13:14:34.002 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63362.log 82.0% -- replaced with /var/log/ceph/ceph-client.admin.108166.log.gz 2024-03-04T13:14:34.002 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-03-04T13:14:34.002 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41085.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41085.log.gz 2024-03-04T13:14:34.002 INFO:teuthology.orchestra.run.smithi110.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39776.log 2024-03-04T13:14:34.002 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.63362.log: gzip -5 59.6% -- replaced with /var/log/ceph/ceph-client.admin.63362.log.gz 2024-03-04T13:14:34.002 INFO:teuthology.orchestra.run.smithi110.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39430.log 2024-03-04T13:14:34.002 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.39776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39776.log.gz 2024-03-04T13:14:34.003 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73941.log 2024-03-04T13:14:34.003 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5/var/log/ceph/ceph-client.admin.39430.log: --verbose -- /var/log/ceph/ceph-client.0.44309.log 0.0% 2024-03-04T13:14:34.003 INFO:teuthology.orchestra.run.smithi110.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39430.log.gz 2024-03-04T13:14:34.003 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.73941.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.67903.log.gz 2024-03-04T13:14:34.003 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61259.log 2024-03-04T13:14:34.003 INFO:teuthology.orchestra.run.smithi110.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.73941.log.gz 2024-03-04T13:14:34.003 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141981.log 2024-03-04T13:14:34.003 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.44309.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.44309.log.gz 2024-03-04T13:14:34.003 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.61259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64009.log 2024-03-04T13:14:34.004 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61259.log.gz 2024-03-04T13:14:34.004 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.141981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40148.log 2024-03-04T13:14:34.004 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141981.log.gz 2024-03-04T13:14:34.004 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.64009.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.134886.log 2024-03-04T13:14:34.004 INFO:teuthology.orchestra.run.smithi110.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.65435.log.gz 2024-03-04T13:14:34.004 INFO:teuthology.orchestra.run.smithi110.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64009.log.gz 2024-03-04T13:14:34.004 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50513.log 2024-03-04T13:14:34.005 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40148.log.gz 2024-03-04T13:14:34.005 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.134886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82247.log 2024-03-04T13:14:34.005 INFO:teuthology.orchestra.run.smithi110.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.0.134886.log.gz 2024-03-04T13:14:34.005 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50513.log.gz 2024-03-04T13:14:34.005 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60670.log 2024-03-04T13:14:34.005 INFO:teuthology.orchestra.run.smithi110.stderr:gzip/var/log/ceph/ceph-client.admin.82247.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51739.log 2024-03-04T13:14:34.005 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.60670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111111.log 2024-03-04T13:14:34.005 INFO:teuthology.orchestra.run.smithi110.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.82247.log.gz 2024-03-04T13:14:34.005 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.51739.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.60670.log.gz 2024-03-04T13:14:34.006 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.137322.log 2024-03-04T13:14:34.006 INFO:teuthology.orchestra.run.smithi110.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.51739.log.gz 2024-03-04T13:14:34.006 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.111111.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-04T13:14:34.006 INFO:teuthology.orchestra.run.smithi110.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.111111.log.gz 2024-03-04T13:14:34.006 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.137322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142626.log 2024-03-04T13:14:34.006 INFO:teuthology.orchestra.run.smithi110.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.0.137322.log.gz 2024-03-04T13:14:34.006 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119968.log 2024-03-04T13:14:34.006 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.142626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142626.log.gz 2024-03-04T13:14:34.006 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120016.log 2024-03-04T13:14:34.007 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55321.log 2024-03-04T13:14:34.007 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.119968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119968.log.gz 2024-03-04T13:14:34.007 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.120016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77849.log 2024-03-04T13:14:34.007 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.55321.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.120016.log.gz 2024-03-04T13:14:34.007 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52941.log 2024-03-04T13:14:34.007 INFO:teuthology.orchestra.run.smithi110.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.55321.log.gz 2024-03-04T13:14:34.007 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.77849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98740.log 2024-03-04T13:14:34.007 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.52941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52941.log.gz 2024-03-04T13:14:34.007 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103453.log 2024-03-04T13:14:34.008 INFO:teuthology.orchestra.run.smithi110.stderr:gzip/var/log/ceph/ceph-client.admin.98740.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.115823.log 2024-03-04T13:14:34.008 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.103453.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.98740.log.gz 2024-03-04T13:14:34.008 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118790.log 2024-03-04T13:14:34.008 INFO:teuthology.orchestra.run.smithi110.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.103453.log.gz 2024-03-04T13:14:34.008 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.115823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72267.log 2024-03-04T13:14:34.008 INFO:teuthology.orchestra.run.smithi110.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64071.log.gz/var/log/ceph/ceph-client.admin.118790.log: 2024-03-04T13:14:34.008 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44912.log 2024-03-04T13:14:34.008 INFO:teuthology.orchestra.run.smithi110.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.115823.log.gz 2024-03-04T13:14:34.009 INFO:teuthology.orchestra.run.smithi110.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.118790.log.gz 2024-03-04T13:14:34.009 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.72267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63932.log 2024-03-04T13:14:34.009 INFO:teuthology.orchestra.run.smithi110.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.77849.log.gz 84.0% -- replaced with /var/log/ceph/ceph-client.admin.72267.log.gz 2024-03-04T13:14:34.009 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.44912.log: 2024-03-04T13:14:34.009 INFO:teuthology.orchestra.run.smithi110.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.44912.log.gz 2024-03-04T13:14:34.009 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40146.log 2024-03-04T13:14:34.009 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.63932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112878.log 2024-03-04T13:14:34.009 INFO:teuthology.orchestra.run.smithi110.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63932.log.gz 2024-03-04T13:14:34.009 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63725.log 2024-03-04T13:14:34.009 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40146.log.gz 2024-03-04T13:14:34.010 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.112878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34379.log 2024-03-04T13:14:34.010 INFO:teuthology.orchestra.run.smithi110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112878.log.gz 2024-03-04T13:14:34.010 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.63725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123009.log 2024-03-04T13:14:34.010 INFO:teuthology.orchestra.run.smithi110.stderr: 54.2% -- replaced with /var/log/ceph/ceph-client.admin.63725.log.gz 2024-03-04T13:14:34.010 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39778.log 2024-03-04T13:14:34.010 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.34379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34379.log.gz 2024-03-04T13:14:34.010 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.123009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76474.log 2024-03-04T13:14:34.010 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.39778.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.123009.log.gz 2024-03-04T13:14:34.010 INFO:teuthology.orchestra.run.smithi110.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39778.log.gz -5 2024-03-04T13:14:34.011 INFO:teuthology.orchestra.run.smithi110.stderr: --verbose -- /var/log/ceph/ceph-client.admin.141843.log 2024-03-04T13:14:34.011 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.76474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39777.log 2024-03-04T13:14:34.011 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.141843.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.76474.log.gz 2024-03-04T13:14:34.011 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141843.log.gz 2024-03-04T13:14:34.011 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101097.log 2024-03-04T13:14:34.011 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.39777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39777.log.gz 2024-03-04T13:14:34.011 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95206.log 2024-03-04T13:14:34.011 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.101097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41129.log 2024-03-04T13:14:34.011 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.95206.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.101097.log.gz 2024-03-04T13:14:34.012 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39779.log 2024-03-04T13:14:34.012 INFO:teuthology.orchestra.run.smithi110.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.95206.log.gz 2024-03-04T13:14:34.012 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41129.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-03-04T13:14:34.012 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41129.log.gz 2024-03-04T13:14:34.012 INFO:teuthology.orchestra.run.smithi110.stderr:gzip/var/log/ceph/ceph-client.admin.39779.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55910.log 2024-03-04T13:14:34.012 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39779.log.gz 2024-03-04T13:14:34.012 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121194.log 2024-03-04T13:14:34.012 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.55910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109344.log 2024-03-04T13:14:34.013 INFO:teuthology.orchestra.run.smithi110.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.55910.log.gz 2024-03-04T13:14:34.013 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.121194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128127.log 2024-03-04T13:14:34.013 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.109344.log: 86.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56499.log 2024-03-04T13:14:34.013 INFO:teuthology.orchestra.run.smithi110.stderr: -- replaced with /var/log/ceph/ceph-client.admin.121194.log.gz 2024-03-04T13:14:34.013 INFO:teuthology.orchestra.run.smithi110.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.109344.log.gz 2024-03-04T13:14:34.013 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.128127.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-04T13:14:34.014 INFO:teuthology.orchestra.run.smithi110.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.128127.log.gz 2024-03-04T13:14:34.014 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75123.log 2024-03-04T13:14:34.014 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.56499.log: gzip/var/log/ceph/ceph-mgr.y.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.119379.log 2024-03-04T13:14:34.014 INFO:teuthology.orchestra.run.smithi110.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.56499.log.gz/var/log/ceph/ceph-client.admin.75123.log: 2024-03-04T13:14:34.014 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 81.1% -- replaced with /var/log/ceph/ceph-client.admin.75123.log.gz 2024-03-04T13:14:34.014 INFO:teuthology.orchestra.run.smithi110.stderr: --verbose -- /var/log/ceph/ceph-client.admin.70988.log 2024-03-04T13:14:34.014 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.119379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64846.log 2024-03-04T13:14:34.014 INFO:teuthology.orchestra.run.smithi110.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119379.log.gz 2024-03-04T13:14:34.014 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.70988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.136713.log 2024-03-04T13:14:34.015 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.64846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34509.log 2024-03-04T13:14:34.015 INFO:teuthology.orchestra.run.smithi110.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.64846.log.gz 2024-03-04T13:14:34.015 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.136713.log: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-03-04T13:14:34.015 INFO:teuthology.orchestra.run.smithi110.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.136713.log.gz 2024-03-04T13:14:34.015 INFO:teuthology.orchestra.run.smithi110.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.70988.log.gz 2024-03-04T13:14:34.015 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117023.log 2024-03-04T13:14:34.015 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.34509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40810.log 2024-03-04T13:14:34.015 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34509.log.gz 2024-03-04T13:14:34.015 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.117023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66669.log 2024-03-04T13:14:34.016 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40810.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.117023.log.gz 2024-03-04T13:14:34.016 INFO:teuthology.orchestra.run.smithi110.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40810.log.gz 2024-03-04T13:14:34.016 INFO:teuthology.orchestra.run.smithi110.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57677.log 2024-03-04T13:14:34.016 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.66669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100508.log 2024-03-04T13:14:34.016 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.57677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94028.log 2024-03-04T13:14:34.016 INFO:teuthology.orchestra.run.smithi110.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.57677.log.gz 2024-03-04T13:14:34.016 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.100508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39230.log 82.0% -- replaced with /var/log/ceph/ceph-client.admin.100508.log.gz 2024-03-04T13:14:34.016 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-03-04T13:14:34.017 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.94028.log: gzip 82.2% -- replaced with /var/log/ceph/ceph-client.admin.94028.log.gz 2024-03-04T13:14:34.017 INFO:teuthology.orchestra.run.smithi110.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-04T13:14:34.017 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.39230.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39230.log.gz 2024-03-04T13:14:34.017 INFO:teuthology.orchestra.run.smithi110.stderr: --verbose -- /var/log/ceph/ceph-client.0.136104.log 2024-03-04T13:14:34.017 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61307.log 2024-03-04T13:14:34.017 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.136104.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-03-04T13:14:34.017 INFO:teuthology.orchestra.run.smithi110.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.136104.log.gz 2024-03-04T13:14:34.017 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.61307.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.61307.log.gz 2024-03-04T13:14:34.018 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99919.log 2024-03-04T13:14:34.018 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114645.log 2024-03-04T13:14:34.018 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.99919.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.99919.log.gz 2024-03-04T13:14:34.018 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142165.log 2024-03-04T13:14:34.018 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.114645.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114645.log.gz 2024-03-04T13:14:34.018 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91671.log 2024-03-04T13:14:34.018 INFO:teuthology.orchestra.run.smithi110.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.66669.log.gz 2024-03-04T13:14:34.018 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.142165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142165.log.gz 2024-03-04T13:14:34.018 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53554.log 2024-03-04T13:14:34.018 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.91671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40351.log 2024-03-04T13:14:34.019 INFO:teuthology.orchestra.run.smithi110.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.91671.log.gz 2024-03-04T13:14:34.019 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.53554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40397.log 2024-03-04T13:14:34.019 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40351.log.gz 2024-03-04T13:14:34.019 INFO:teuthology.orchestra.run.smithi110.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.53554.log.gz 2024-03-04T13:14:34.019 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119992.log 2024-03-04T13:14:34.019 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106987.log 2024-03-04T13:14:34.019 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40397.log.gz 2024-03-04T13:14:34.019 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.119992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119992.log.gz 2024-03-04T13:14:34.020 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40006.log 2024-03-04T13:14:34.020 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95795.log 2024-03-04T13:14:34.020 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40006.log: /var/log/ceph/ceph-client.admin.106987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40006.log.gz 2024-03-04T13:14:34.020 INFO:teuthology.orchestra.run.smithi110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106987.log.gz 2024-03-04T13:14:34.020 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40150.log 2024-03-04T13:14:34.020 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.95795.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-04T13:14:34.020 INFO:teuthology.orchestra.run.smithi110.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95795.log.gz 2024-03-04T13:14:34.020 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40150.log.gz 2024-03-04T13:14:34.021 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64734.log 2024-03-04T13:14:34.021 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41849.log 2024-03-04T13:14:34.021 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.64734.log: 19.5% -- replaced with /var/log/ceph/ceph-client.admin.64734.log.gz 2024-03-04T13:14:34.021 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52328.log 2024-03-04T13:14:34.021 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.41849.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.41849.log.gz 2024-03-04T13:14:34.021 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79891.log 2024-03-04T13:14:34.021 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.52328.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.52328.log.gz 2024-03-04T13:14:34.021 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-04T13:14:34.021 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.79891.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.79891.log.gz 2024-03-04T13:14:34.022 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61896.log 2024-03-04T13:14:34.022 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.2.log: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-04T13:14:34.022 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96384.log 2024-03-04T13:14:34.022 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.61896.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.61896.log.gz 2024-03-04T13:14:34.022 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.135495.log 2024-03-04T13:14:34.022 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.96384.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.96384.log.gz 2024-03-04T13:14:34.022 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141797.log 2024-03-04T13:14:34.022 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.135495.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.135495.log.gz 2024-03-04T13:14:34.022 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106398.log 2024-03-04T13:14:34.023 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.141797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141797.log.gz 2024-03-04T13:14:34.023 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39781.log 2024-03-04T13:14:34.023 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.106398.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.106398.log.gz 2024-03-04T13:14:34.023 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105220.log 2024-03-04T13:14:34.023 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.39781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39781.log.gz 2024-03-04T13:14:34.023 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83425.log 2024-03-04T13:14:34.024 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.105220.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.105220.log.gz 2024-03-04T13:14:34.024 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84603.log 2024-03-04T13:14:34.024 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.83425.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.83425.log.gz 2024-03-04T13:14:34.024 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-03-04T13:14:34.024 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.84603.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.84603.log.gz 2024-03-04T13:14:34.024 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27931.log 2024-03-04T13:14:34.024 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/rgw.ceph.client.0.log: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-04T13:14:34.024 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78458.log 2024-03-04T13:14:34.025 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.tmp-client.admin.27931.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27931.log.gz 2024-03-04T13:14:34.025 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104042.log 2024-03-04T13:14:34.025 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.78458.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.78458.log.gz 2024-03-04T13:14:34.025 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62485.log 2024-03-04T13:14:34.025 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.104042.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104042.log.gz 2024-03-04T13:14:34.025 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54143.log 2024-03-04T13:14:34.025 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.62485.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.62485.log.gz 2024-03-04T13:14:34.025 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67286.log 2024-03-04T13:14:34.025 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.54143.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.54143.log.gz 2024-03-04T13:14:34.026 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.133668.log 2024-03-04T13:14:34.026 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.67286.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.67286.log.gz 2024-03-04T13:14:34.026 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42494.log 2024-03-04T13:14:34.026 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.133668.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.133668.log.gz 2024-03-04T13:14:34.026 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39775.log 2024-03-04T13:14:34.026 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.42494.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.42494.log.gz 2024-03-04T13:14:34.026 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.140112.log 2024-03-04T13:14:34.026 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.39775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39775.log.gz 2024-03-04T13:14:34.026 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60081.log 2024-03-04T13:14:34.027 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.140112.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.140112.log.gz 2024-03-04T13:14:34.027 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.134277.log 2024-03-04T13:14:34.027 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.60081.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.60081.log.gz 2024-03-04T13:14:34.027 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129491.log 2024-03-04T13:14:34.027 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.134277.log: 80.0% -- replaced with /var/log/ceph/ceph-client.0.134277.log.gz 2024-03-04T13:14:34.027 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.138540.log 2024-03-04T13:14:34.027 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.129491.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.129491.log.gz 2024-03-04T13:14:34.027 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142303.log 2024-03-04T13:14:34.027 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.138540.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.138540.log.gz 2024-03-04T13:14:34.028 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94617.log 2024-03-04T13:14:34.028 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.142303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142303.log.gz 2024-03-04T13:14:34.028 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88726.log 2024-03-04T13:14:34.028 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.94617.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.94617.log.gz 2024-03-04T13:14:34.028 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141935.log 2024-03-04T13:14:34.028 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.88726.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.88726.log.gz 2024-03-04T13:14:34.028 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127519.log 2024-03-04T13:14:34.028 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.141935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141935.log.gz 2024-03-04T13:14:34.029 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43103.log 2024-03-04T13:14:34.029 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.127519.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.127519.log.gz 2024-03-04T13:14:34.029 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64198.log 2024-03-04T13:14:34.029 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.43103.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.43103.log.gz 2024-03-04T13:14:34.029 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52965.log 2024-03-04T13:14:34.029 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.64198.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.64198.log.gz 2024-03-04T13:14:34.029 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102864.log 2024-03-04T13:14:34.029 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.52965.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.52965.log.gz 2024-03-04T13:14:34.029 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40509.log 2024-03-04T13:14:34.030 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.102864.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.102864.log.gz 2024-03-04T13:14:34.030 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68520.log 2024-03-04T13:14:34.030 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40509.log.gz 2024-03-04T13:14:34.030 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141613.log 2024-03-04T13:14:34.030 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.68520.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68520.log.gz 2024-03-04T13:14:34.030 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58879.log 2024-03-04T13:14:34.030 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.141613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141613.log.gz 2024-03-04T13:14:34.030 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142533.log 2024-03-04T13:14:34.030 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.58879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58879.log.gz 2024-03-04T13:14:34.030 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58855.log 2024-03-04T13:14:34.031 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.142533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142533.log.gz 2024-03-04T13:14:34.031 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-04T13:14:34.031 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.58855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58855.log.gz 2024-03-04T13:14:34.031 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116412.log 2024-03-04T13:14:34.034 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108755.log 2024-03-04T13:14:34.034 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.116412.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.116412.log.gz 2024-03-04T13:14:34.035 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77796.log 2024-03-04T13:14:34.035 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.108755.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.108755.log.gz 2024-03-04T13:14:34.035 INFO:teuthology.orchestra.run.smithi110.stderr: 94.4% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-03-04T13:14:34.035 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.77796.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.77796.log.gz 2024-03-04T13:14:34.396 INFO:teuthology.orchestra.run.smithi172.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-04T13:14:34.945 INFO:teuthology.orchestra.run.smithi110.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-04T13:14:35.007 INFO:teuthology.orchestra.run.smithi172.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-04T13:14:36.470 INFO:teuthology.orchestra.run.smithi110.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-04T13:14:37.038 INFO:teuthology.orchestra.run.smithi110.stderr: 92.0% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-03-04T13:14:39.335 INFO:teuthology.orchestra.run.smithi110.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-04T13:14:41.383 INFO:teuthology.orchestra.run.smithi172.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-04T13:14:41.553 INFO:teuthology.orchestra.run.smithi172.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-04T13:14:41.978 INFO:teuthology.orchestra.run.smithi110.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-04T13:14:42.225 INFO:teuthology.orchestra.run.smithi172.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-04T13:14:44.135 INFO:teuthology.orchestra.run.smithi172.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-04T13:14:44.136 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-03-04T13:14:44.137 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m10.270s 2024-03-04T13:14:44.137 INFO:teuthology.orchestra.run.smithi172.stderr:user 0m34.126s 2024-03-04T13:14:44.137 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m1.261s 2024-03-04T13:14:45.303 INFO:teuthology.orchestra.run.smithi110.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-04T13:14:49.192 INFO:teuthology.orchestra.run.smithi110.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-04T13:14:49.194 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-03-04T13:14:49.194 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m15.372s 2024-03-04T13:14:49.195 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m45.585s 2024-03-04T13:14:49.195 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m1.768s 2024-03-04T13:14:49.195 INFO:tasks.ceph:Archiving logs... 2024-03-04T13:14:49.195 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061/remote/smithi110/log 2024-03-04T13:14:49.196 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-04T13:14:55.781 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061/remote/smithi172/log 2024-03-04T13:14:55.782 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-04T13:15:00.935 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-04T13:15:00.949 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-04T13:15:00.949 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-04T13:15:00.952 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-04T13:15:03.217 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-04T13:15:03.227 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-04T13:15:03.228 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T13:15:03.230 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-04T13:15:03.260 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-03-04T13:15:03.262 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-03-04T13:15:03.264 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T13:15:03.264 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-03-04T13:15:03.264 INFO:teuthology.orchestra.run.smithi110.stdout:^- hv01.front.sepia.ceph.com 2 6 377 1 +8110us[+8110us] +/- 163ms 2024-03-04T13:15:03.264 INFO:teuthology.orchestra.run.smithi110.stdout:^* hv02.front.sepia.ceph.com 3 6 377 2 -1743us[-1761us] +/- 53ms 2024-03-04T13:15:03.264 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 +2252us[+2238us] +/- 77ms 2024-03-04T13:15:03.264 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T13:15:03.267 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-04T13:15:03.267 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-03-04T13:15:03.268 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 2 +6687us[+6687us] +/- 163ms 2024-03-04T13:15:03.268 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv02.front.sepia.ceph.com 3 6 377 63 -3156us[-3577us] +/- 52ms 2024-03-04T13:15:03.268 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 129 +898us[ +422us] +/- 76ms 2024-03-04T13:15:03.268 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-03-04T13:15:03.269 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-04T13:15:03.282 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-04T13:15:03.283 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-04T13:15:03.297 DEBUG:teuthology.orchestra.run.smithi110:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-04T13:15:03.391 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-04T13:15:03.516 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T13:15:03.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T13:15:03.559 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-04T13:15:03.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T13:15:03.604 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-04T13:15:03.615 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-04T13:15:03.630 INFO:teuthology.task.internal:Duration was 3749.830112 seconds 2024-03-04T13:15:03.630 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-04T13:15:03.643 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-04T13:15:03.643 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-04T13:15:03.646 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-04T13:15:03.700 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T13:15:03.702 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-04T13:15:04.037 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-04T13:15:04.038 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-03-04T13:15:04.038 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-04T13:15:04.070 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-03-04T13:15:04.070 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-04T13:15:04.108 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-04T13:15:04.109 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-04T13:15:04.113 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-04T13:15:04.190 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-04T13:15:04.190 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-04T13:15:04.194 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-04T13:15:04.341 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-04T13:15:04.355 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-04T13:15:04.355 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-04T13:15:04.394 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-04T13:15:04.434 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-04T13:15:04.446 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-04T13:15:04.448 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-04T13:15:04.485 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-03-04T13:15:04.511 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-03-04T13:15:04.532 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-04T13:15:04.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T13:15:04.566 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-04T13:15:04.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-04T13:15:04.599 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-04T13:15:04.611 INFO:teuthology.task.internal:Transferring archived files... 2024-03-04T13:15:04.611 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061/remote/smithi110 2024-03-04T13:15:04.612 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-04T13:15:04.662 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061/remote/smithi172 2024-03-04T13:15:04.662 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-04T13:15:04.710 INFO:teuthology.task.internal:Removing archive directory... 2024-03-04T13:15:04.710 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-04T13:15:04.713 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-04T13:15:04.771 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-04T13:15:04.785 INFO:teuthology.task.internal:Not uploading archives. 2024-03-04T13:15:04.786 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-04T13:15:04.800 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-04T13:15:04.800 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-04T13:15:04.802 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-04T13:15:04.826 INFO:teuthology.orchestra.run.smithi110.stdout: 265301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 4 13:15 /home/ubuntu/cephtest 2024-03-04T13:15:04.839 INFO:teuthology.orchestra.run.smithi172.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 4 13:15 /home/ubuntu/cephtest 2024-03-04T13:15:04.840 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-04T13:15:04.855 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-04T13:15:04.884 INFO:teuthology.nuke:Checking targets against current locks 2024-03-04T13:15:04.910 DEBUG:teuthology.nuke:shortname: smithi110 2024-03-04T13:15:04.910 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T13:15:04.932 DEBUG:teuthology.nuke:shortname: smithi172 2024-03-04T13:15:04.932 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-04T13:15:04.936 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 12:02:40.645335', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBRfxsTEaInW4UE6C9MmpTeTftsY07BxFw+QHknsPlzJEsYaBqKH1/w6i4fnuuqmlG5TlNfR0V82yyQyIxUQw3c='} 2024-03-04T13:15:04.952 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2024-03-04_08:28:53-rgw-wip-rgw-d4n-distro-default-smithi/7581061', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-04 12:02:40.643657', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8psj+oSZ4kKEr2fYTgbk/TQycVVgPqXLGrcVm/ZViu2EK3wAHNTdYNTXzagMCg0rVKK2nQNd+8fX6dZRPRd7A='} 2024-03-04T13:15:04.981 INFO:teuthology.orchestra.console.smithi110:Power off 2024-03-04T13:15:04.981 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-04T13:15:05.018 INFO:teuthology.orchestra.console.smithi172:Power off 2024-03-04T13:15:05.018 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-04T13:15:05.029 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2024-03-04T13:15:05.030 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T13:15:05.042 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2024-03-04T13:15:05.043 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T13:15:05.059 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-03-04T13:15:05.066 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-04T13:15:09.061 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T13:15:09.071 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T13:15:09.174 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-03-04T13:15:09.186 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-04T13:15:13.176 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T13:15:13.187 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T13:15:13.289 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-03-04T13:15:13.297 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-04T13:15:13.390 INFO:teuthology.orchestra.console.smithi110:Power off completed 2024-03-04T13:15:17.301 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-04T13:15:17.412 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-03-04T13:15:17.513 INFO:teuthology.orchestra.console.smithi172:Power off completed 2024-03-04T13:15:17.620 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 3749.830112218857 failure_reason: 'Command failed (s3 tests against rgw) on smithi110 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m ''not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3''"' flavor: default owner: scheduled_prsrivas@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=bffc5a3f431949f8bfe3f93278ddb8e7 status: fail success: false 2024-03-04T13:15:17.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-04T13:15:17.707 INFO:teuthology.run:FAIL